Apache Airflow

We've just released Apache Airflow CTL 0.1.0 🎉 This is the first official release of the `airflowctl` - new tool to remotely interact with your Airflow 3 📦 PyPI: https://lnkd.in/dXaiFa2H 📚 Docs: https://lnkd.in/dYEaSkuT 🛠 Release Notes: https://lnkd.in/dzibW7W8 Thanks to all the contributors who made this possible. Special thanks to Buğra Öztürk who has been relentlessly following up his idea to get it implemented and released.

We've just released Apache Airflow 3.1.2 🎉 📦 PyPI: https://lnkd.in/dhaw3ACR 📚 Docs: https://lnkd.in/dmCDsF6f 🛠 Release Notes: https://lnkd.in/d9kTaHCz 🐳 Docker Image: "docker pull apache/airflow:3.1.2" Thanks to all the contributors who made this possible.

🚀 We’re launching the Raleigh Apache Airflow Meetup Chapter on November 12th at Red Hat’s office — and you’re invited! Join us for our first gathering in the area featuring Airflow talks, great food, and awesome swag. Talks include: 🎤 What’s New in Airflow 3.1 — Caitlin Petro & Annie Friedman, Astronomer 🤖 Scaling AI Workflows with Apache Airflow — Chandrakanth Akkinepalli, Red Hat 📅 Nov. 12th | 5:30–8:00 PM CST 📍 Red Hat Office, Raleigh, NC 🎟️ RSVP: https://lnkd.in/guDttpxE We can’t wait to kick off the Raleigh chapter with you!

🤠 Hey Austin- we'll see you next week at Capital Factory for the launch of our Austin Chapter! 🔥 Look forward to an evening of engaging presentations, delicious food and drinks, and awesome swag! 🚀 We'll be discussing What's New in Airflow 3.1, followed by a fireside chat on Pipelines, Privacy, and the Future of Airflow! RSVP 🔗 https://lnkd.in/gx5RfuHe

📣 We’ve just released Apache Airflow 3.1.1. 📦 PyPI: https://lnkd.in/dizkHpeD 📚 Docs: https://lnkd.in/dH4Y-kPJ 🛠️ Release Notes: https://lnkd.in/dGizv5gJ 🐳 Docker Image: "docker pull apache/airflow:3.1.1" 🚏 Constraints: https://lnkd.in/dXQK8txc Thanks to all the contributors who made this possible. #Airflow #Airflow3 #AI #DataEngineering

What an incredible Airflow Summit! The in-person event last week, followed by the online recap this week, was outstanding! I was privileged to kick off the keynote on Day One with an overview of Airflow 3. After a year of hard work, it was so rewarding to see everything come together, with eleven tech leads demonstrating new features live on stage! Huge shoutout to Jedidiah Cunningham, Daniel Standish, Brent Bovenzi, Pierre Jeambrun, Kaxil Naik, Amogh Desai, Jens Scheffler, Buğra Öztürk, Constance Martineau, Vincent BECK, and Ash Berlin-Taylor for the demos, Briana Steel for organization, Erin O'Donnell for graphics, and Kenten Danas and Mat Keep for reviews and guidance. From the Day 1 talks I caught, several stood out: • OpenAI (Ping Zhang and Howie Wang) spoke to a packed house how they made “a deliberate shift to unify on Airflow as the backbone”, now orchestrating over 7k DAGs. Their biggest challenge is running out of computing infrastructure! • Financial Times (Zdravko Hvarlingov and Ivan Nikolov) demonstrated GenAI workflows that analyze public filings and “bring new stories to light”. • Xena’s Naseem Shah showed how they use GenAI to analyze user reviews for consumer products. Day Two opened with a keynote from GitHub’s Tala Karadsheh and hearing that Airflow has become a “sacred” part of their data infrastructure gave me goosebumps. Highlights that I caught on Day 2: • Duolingo’s Belle Romea talked about orchestrating GenAI for episode creation: cutting review time from 6 hours to 0 and costs by 99%, powering 243 courses for 5M learners. • Stripe’s Sabrina Liu shared how 500+ teams use Airflow, including their internal no-code DAG generation layer. • Sriraj Dheeraj Turaga and Nicholas Redd from Qualcomm showed Airflow for chip validation across global data centers. This took me straight back to my semiconductor days (yes, going into fabs wearing bunny suits!). Day Three began with a keynote featuring Weav’s Peeyush Rai. I loved interviewing him about building an Agentic co-pilot for the insurance space: invoking AI models, evaluating their output with other models, and adding human-in-the-loop review. The demo based on Airflow 3.1 was heartwarming. Highlights that I caught on Day 3:  • Pinterest’s Rachel Sun showed 10k+ DAGs running their data and ML infrastructure, leveraging LLMs for quick problem resolution. • Redhat’s Shoubhik Bose showcased Airflow for Dataverse, their company-wide platform for data, ML, and AI, detailing their governance model. • Gurmeet Singh Saran and Kushal Thakkar from Anthropic (a closing talk) were excellent! Hearing Claude Code team members explain the importance of leveraging frameworks with AI coding assistants was a great reminder of fundamentals.  I’m so grateful to be part of this wonderful community and loved meeting so many of you in person. Events like these absolutely inspire me and I’m looking forward to catching you at next year’s Summit! #apacheairflow

🤠 Austin- we're coming your way! On Nov. 6th, join us at Capital Factory for an evening of engaging talks from Airflow practitioners, great food and drinks, and some awesome Airflow swag. 🎟️ RSVP: https://lnkd.in/gx5RfuHe 🎤 Featured Talks What's New in Airflow 3.1 — Ryan Pecor, Sales Engineer at Astronomer Fireside Chat: Pipelines, Privacy, and the Future of Airflow — Brian Sandahl, Data & Analytics Sr. Leader, Atmosphere TV & Sam Rahman, Senior Data Solutions Developer, BigCommerce 📅 Event Details  🕕 Time: Thursday, Nov. 6th, 2025 | 5:30–8:00 PM CST 📍 Location: Capital Factory, 701 Brazos St, 8th Floor, Room: ACL  🎟️ RSVP: https://lnkd.in/gx5RfuHe #bigdata #austintech #austindata #austintechmeetup #austintechevent

The Project Management Committee (PMC) for Apache Airflow has invited 2 PMC members and new contributor: New PMC members: * Vincent Beck (Vincent BECK) * Wei Lee (Wei Lee) New Committer: * Guan Ming(Wesley) Chiu (Guan-Ming (Wesley) Chiu) And we are pleased to announce that they have all accepted. Please join us in welcoming Vincent, Wei Lee, Guan Ming to their new role and responsibility in our project community. Congratulations. Well-deserved ! #newposition

Want to take the Airflow 3.0 DAG Authoring Cert? Fill out the Airflow Survey for a free code! ▶️ https://lnkd.in/gC62gq6w https://lnkd.in/gfRn5Rs6

If you were not able to attend Airflow Summit- join the virtual version Oct .15-16! Enjoy the main keynotes and most popular talks, all at your fingertips!