🚀 NEW on We ❤️ Open Source 🚀

Daniel Paes introduces Runink: a Go-native, open source platform that makes data pipelines fast, secure, and Kubernetes-free. Built with Linux primitives and Raft for strong governance.

https://allthingsopen.org/articles/runink-rethinking-data-pipelines-go-raft-linux-primitives

#WeLoveOpenSource #FOSS #GoLang #Linux #DataOps #DevTools

📸 Handling data in Kubernetes - the cloud native way with Jonathan Gonzalez V.
From zero to a production-ready PostgreSQL cluster using CloudNativePG. Real DevOps for your data layer in action.
#DevOpsDaysAMS #Kubernetes #PostgreSQL #CloudNative #DevOps #DataOps

🚀 OpenSearch 3.0 introduces powerful new PPL commands: lookup, join & subsearch! Supercharge your log analysis with enhanced correlation, efficient data exploration & real-time enrichment - all powered by Apache Calcite. Level up your observability game! 🔍 https://bit.ly/3ZZWwlS
#OpenSearch #DataOps #OpenSource #PPL

🚨 Data diff isn’t enough.
You’re putting out harmless fires while real metric failures burn unnoticed.

You don’t need more diffing. You need better understanding.
Read 👉 https://datarecce.io/blog/more-than-data-diff/

#dataops #datadiff #datavalidation #dataengineering

Join us on Wednesday, June 4 to talk about: Model Context Protocol
Vivek Mangipudi will lead the discussion in our #DataOps meeting.
Want to join? Reply and we'll add you.

Tired of babysitting DIY scraping scripts that crash the moment you scale?
You’re not alone.

PromptCloud takes the pain out of large-scale data extraction with fully managed, reliable solutions — so you can focus on what really matters: insights.

🔗 https://shorturl.at/EApIO

#WebScraping #OpenData #DataEngineering #BigData #Automation #PromptCloud #TechForGood #DataOps

The MLOps skillset is evolving! 🤯

Reddit shows a clear trend: DataOps is emerging as a distinct specialization, separate from traditional DevOps.

Is your organization prepared for this shift?

Full blog post: https://dougortiz.blogspot.com/2025/05/the-quiet-revolution-in-mlops-dataops.html

What training programs are you implementing to address this emerging DataOps talent gap?

#MLOps #DataOps #SkillGap #TheMlopsSkill #DeepLearning

𝐇𝐚𝐫𝐝𝐜𝐨𝐝𝐢𝐧𝐠 𝐢𝐬 𝐇𝐮𝐫𝐭𝐢𝐧𝐠 𝐘𝐨𝐮𝐫 𝐓𝐞𝐚𝐦

Still hardcoding values in your data pipelines?
👎 It’s slowing down scaling.
👎 It creates more bugs.
👎 It’s not enterprise-ready.

Learn how to parameterize Azure Data Factory like a pro - with real-world strategies you can apply immediately after training.

💥 Save your team hours of rework.
💥 Build once, reuse forever.

📅 Live 6/11 - just $249.

🎁 1st 20 registrants get the bonuses!

🔗 Get your seat: https://entdna.com/product/advanced-azure-data-factory-adf-course-jun-2025/

#AzureADF #DataOps #TechTraining

Picked up "Python Polars the definitive guide" by Jeroen Janssens and Thijs Nieuwdorp. The polar bear was already used on another O'Reilly book, but the Iberian lynx is cool.

Never sure how tech books will pan out, but Jeroen's book data science at the command line was a good one, so I am hopeful.

#python #polars #dataframes #datascience #DataEngineering #dataops #book #books #computerscience #analytics

What breaks if I change this column?

Read our technical deep-dive into how Recce constructs column-level lineage from #dbt models

- How we track column origins and transformations using SQLGlot

- How we classify columns as pass-through, renamed, derived, or source

- How we handle tricky edge cases like SELECT *, name collisions, and macro expansion

Read more:
https://datarecce.io/blog/column-level-lineage-internals/

#data #lineage #dataops #dataquality #SQLGlot

Stop duplicating dashboards to preview the impact of dbt model changes!

With Recce, you can:
✅ Diff models
✅ Record data impact
✅ Share results instantly — no dashboards, no SQL, no screenshots

One click. Instant clarity:

https://medium.com/inthepipeline/stop-duplicating-dashboards-just-to-preview-dbt-changes-21ff0ba8dd21

#dbt #DataOps #SQL #data #analyticsengineering #DataEngineering

DBT: трансформация данных без боли

Привет! Меня зовут Кирилл Львов, я fullstack-разработчик в компании СберАналитика. В этой статье хочу рассказать про мощный инструмент трансформации данных — DBT (Data Build Tool). Сегодня любой средний и крупный бизнес хранит множество данных в разрозненных источниках (CRM, ERP, HRM, базы данных, файловые хранилища и т.д.). Каждая из этих систем самодостаточна и закрывает определённую боль бизнеса, но собрав данные из таких источников и стандартизировав их, нам открывается возможность анализировать данные, строить модели машинного обучения и принимать на основе этих данных управленческие решения. Для того чтобы реализовать такой подход строятся ELT (или ETL) процессы. ELT (Extract, Load, Transform) — это процесс, состоящий из трех этапов:

https://habr.com/ru/articles/907540/

#dbt #big_data #data_ingineering #аналитика_данных #трансформация_данных #elt #sql #dataops

Big move: Fivetran + Census unite for seamless data flow. No more custom code headaches. Just pure data harmony.

#DataOps #ETL #DevTools https://www.fivetran.com/blog/why-fivetran-and-census-are-joining-forces

❓Need clear “done” definitions when balancing code & data?

Align engineering & analytics acceptance criteria to avoid moving goalposts.

📋 Read how: https://newsletter.optimistengineer.com/p/your-engineering-team-just-met-data?r=nw9bj&utm_campaign=post&utm_medium=web&showWelcomeOnShare=false

#SoftwareEngineering #DataOps

We believe data should be clean, actionable — and sometimes a little fun.

🥚This table has a hidden message woven into the product titles. Can you find it?

#PromptCloud #EcommerceInsights #DataOps #WebDataExtraction #EasterChallenge

Always wanted to learn the Fundamentals of #DataOps?
🔴 Watch this workshop: https://youtu.be/hZ8NpMgPKcM

💶 𝗧𝗵𝗲 𝗵𝗶𝗱𝗱𝗲𝗻 𝗰𝗼𝘀𝘁 𝗼𝗳 𝗰𝘂𝘁𝘁𝗶𝗻𝗴 𝗰𝗼𝗿𝗻𝗲𝗿𝘀? 𝗧𝗲𝗰𝗵𝗻𝗶𝗰𝗮𝗹 𝗱𝗲𝗯𝘁, not just another corporate buzzword but the silent killer of efficiency, innovation, and organizational success.

👉 Understand what technical debt means in a datamanagement context.
https://www.datalumen.eu/technicaldebt_datamanagement/

#DataGovernance #DataManagement hashtag#DataArchitecture #DataOps #DataOpsFramework #DevOps #DataStrategy #DataAgenda

✨ Latest #ContinuousSpotlight is on
Lisa N. Cao. You might know her as a CDF Ambassador or the person who launched our #DataOps Initiative, but she's so much more. Get to know her: https://cd.foundation/blog/2025/03/24/continuous-spotlight-meet-lisa-n-cao/

📣 Join our next #ContinuousDelivery Workshop on March 27
✨ The Fundamentals of #DataOps with speaker Lisa N. Cao
🎫 It's virtual and free: https://cd.foundation/blog/2025/03/13/workshop-dataops/

📣 Help us develop an inclusive set of #DataOps and #DevOps best practices to allow others leverage open source tools and frameworks for streamlined, secure, and scalable ML application deployment. https://cd.foundation/blog/2025/01/23/announcing-dataops-initiative/