Astronomer lands $93M Series D to boost AI adoption via data orchestration. Their Astro platform, powered by the booming Apache Airflow, helps enterprises manage complex data pipelines needed to operationalize AI effectively.
#ApacheAirflow
🎤Ne manquez pas notre conférence aux #RPLL2025 :
Manipulation de la #GED avec Apache Airflow
🗓️jeudi 15 mai à 12:00
📍Hôtel de la Métropole, Lyon
🙋Présentée par @jeremielesage
👉https://jeci.fr/fr/evenements/rpll-atelier-2025/
#LogicielLibre #floss #ApacheAirflow
Troubleshooting Airflow SQL Server Errors: A Case Study of System Task Initialization Failure
Troubleshoot frustrating Airflow SQL Server errors! This post helps diagnose & fix system task initialization failures and other connection issues. Learn to build robust data pipelines. #AirflowSQLServerErrors #DataEngineering #SQLServer #ApacheAirflow #DatabaseConnection #DataPipelines
https://tech-champion.com/database/sql-server/troubleshooting-airflow-sql-server-errors-a-case-study-of-system-tas...
🤖🚀 Ah yes, because nothing says "simple" like melding Apache Airflow and LLM workflows with a side of AI Agents. Just what every developer dreams of: wrestling with Pydantic AI while pretending to control the automation beast. 🛠️✨
https://github.com/astronomer/airflow-ai-sdk #ApacheAirflow #LLMworkflows #AIAgents #PydanticAutomation #DeveloperDreams #HackerNews #ngated
LLM Workflows then Agents: Getting Started with Apache Airflow
https://github.com/astronomer/airflow-ai-sdk
#HackerNews #LLM #Workflows #Agents #ApacheAirflow #DataEngineering #AIWorkflow
Troubleshooting Airflow SQL Server Errors: A Case Study of System Task Initialization Failure
Troubleshoot frustrating Airflow SQL Server errors! This post helps diagnose & fix system task initialization failures and other connection issues. Learn to build robust data pipelines. #AirflowSQLServerErrors #DataEngineering #SQLServer #ApacheAirflow #DatabaseConnection #DataPipelines
https://tech-champion.com/database/sql-server/troubleshooting-airflow-sql-server-errors-a-case-study-of-system-tas...
🍹 C'est l'heure du cocktail de bienvenue proposé par Satya !
- une dose de #ModernDataStack,
- un trait de géo,
- un zeste d'Open Source,
- et beaucoup d'amour 💗.
Cette recette vous est servie dans cet article qui détaille comment le Gard valorise ses géo-données.
:geotribu: https://geotribu.fr/articles/2025/2025-02-25_stack_data_gard/
Relecture 🧐 : @geojulien & Michaël Galien
#PostgreSQL #PostGIS #GDAL #OGR #DBT #Metabase #ApacheAirflow
Just caught up with the recent Delta Lake webinar,
> Revolutionizing Delta Lake workflows on AWS Lambda with Polars, DuckDB, Daft & Rust
Some interesting hints there regarding lightweight processing of big-ish data. Easy to relate to any other framework instead of Lambda, e.g. #ApacheAirflow tasks
#dataengineering #datascience #duckdb #daft #polars #pandas #python #spark #deltalake #databricks #airflow #bigdata #smalldata
If you're using #ApacheAirflow, I'm interested in hearing your use cases for it.
🚀 Apache Airflow: Orchestrierung komplexer Workflows leicht gemacht 🚀
Wenn du eine Lösung suchst, um komplexe Datenpipelines zu verwalten, ist Apache Airflow eine starke Wahl! In unserem neuen Artikel zeigt unser Entwickler, wie Airflow funktioniert, welche Vorteile es bietet und wie es in Bereichen wie maschinellem Lernen eingesetzt wird. 💻✨ Mit Codebeispielen zeigt er, wie du eigene Workflows effizient aufsetzen kannst.
Hast du schon mit Apache Airflow gearbeitet? Welche Erfahrungen hast du gemacht? Lass uns darüber sprechen! 🛠️👇
https://www.elinext.de/blog/einsatz-von-apache-airflow-mit-maschinellem-lernen/
#ApacheAirflow #Datenpipelines #SoftwareEntwicklung #MaschinellesLernen #OpenSource #Tech
📝 "How to build a data extraction pipeline with Apache Airflow"
👤 Déborah Mesquita
#pyladies #python #oldiebutgoodie #apacheairflow #nlp #handsontutorials #editorspick #datascience
Still, #dagster has less dependencies, and after some battling and downgrading version, I managed to start the dev environment...
Building a #Apacheairflow container, is pure chaos. Installing via pip, is another kind of hell, with broken builds all over the place (google-re2)... A tool that has 9 years in the market, being so overwhelming its installation process
At least I can make #dagster run.
I guess we are all ill served with workflow orchestration tools anyway, on the open source world
I take back what I said yesterday... #dagster installation process is quite clumsy. And I detected some issues in terms of documentation/instructions.
I manage to install and run #Apacheairflow in 2 clicks...
How we orchestrate 2000+ #DBT models in #ApacheAirflow
https://medium.com/@aleexmagno/how-we-orchestrate-2000-dbt-models-in-apache-airflow-90901504032d
Just wanted to take a moment to give a shout out to the @airflow team. I have been using Airflow just under two years and the amount of improvements I have seen during my relatively short tenure are phenomenal. Thanks for all your hard work, and everyone who contributes! ^_^
Tenable Research discovered a one-click account takeover vulnerability in the AWS Managed Workflows Apache Airflow service, and that could have resulted in remote code execution (RCE) on the underlying instance, and in lateral movement to other services. Additional research revealed that numerous shared-parent service domains in AWS, Azure and GCP were misconfigured, putting cloud customers at considerable risk. No CVE ID associated. 🔗 https://www.tenable.com/blog/flowfixation-aws-apache-airflow-service-takeover-vulnerability-and-why-neglecting-guardrails
FlowFixation: AWS Apache Airflow Service Takeover Vulnerability
Date: March 21, 2024
CVE: Not specified
Sources: Tenable Blog
Issue Summary
Tenable Research discovered a vulnerability, named FlowFixation, in AWS Managed Workflows for Apache Airflow (MWAA) that could allow session hijacking leading to a full takeover of the victim's web management panel.
Technical Key findings
FlowFixation combines session fixation and XSS via Amazon AWS domain misconfiguration, enabling attackers to authenticate known sessions and gain control over victim's Apache Airflow management panels.
Vulnerable products
- AWS Managed Workflows for Apache Airflow (MWAA)
Impact assessment
Potential for remote code execution on underlying instances and lateral movement to other services.
Patches or workaround
AWS has addressed the vulnerability. Users should ensure they are using updated services.
Tags
#AWS #ApacheAirflow #CloudSecurity #SessionHijacking #Vulnerability
Tenable Research discovered a critical vulnerability named FlowFixation in AWS Managed Workflows for Apache Airflow (MWAA), which could have allowed attackers to take over a victim's web management panel with a single click. This vulnerability, now fixed, was due to session fixation and cross-site scripting (XSS) vulnerabilities. The issue highlighted a broader problem of misconfigured shared-parent domains in major cloud service providers (CSPs), putting their customers at risk. The vulnerability could have led to remote code execution (RCE) and unauthorized access to other services. The article emphasizes the importance of implementing guardrails, such as adding misconfigured domains to the Public Suffix List (PSL), to prevent such exploits. It also suggests that both cloud providers and customers should adopt responsible security practices to mitigate risks associated with shared-parent service domains.
#cybersecurity #aws #apacheairflow #vulnerability #flowfixation #xss #csp #rce
Quoi de plus satisfaisant qu'un #workflow #data tout 🟢 dans #ApacheAirflow !?
LLMs are good coders, useless writers
https://samfirke.com/2023/12/22/llms-are-good-coders-useless-writers/
Client Info
Server: https://mastodon.social
Version: 2025.04
Repository: https://github.com/cyevgeniy/lmst