Home
Categories
EXPLORE
True Crime
Comedy
Business
Society & Culture
History
Sports
Technology
About Us
Contact Us
Copyright
© 2024 PodJoint
00:00 / 00:00
Sign in

or

Don't have an account?
Sign up
Forgot password
https://is1-ssl.mzstatic.com/image/thumb/Podcasts221/v4/03/b0/38/03b03894-a103-21c1-aa77-fcd8b0d2ff65/mza_4276056948887286043.jpg/600x600bb.jpg
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI
Astronomer
83 episodes
3 days ago
Welcome to The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI— the podcast where we keep you up to date with insights and ideas propelling the Airflow community forward. Join us each week, as we explore the current state, future and potential of Airflow with leading thinkers in the community, and discover how best to leverage this workflow management system to meet the ever-evolving needs of data engineering and AI ecosystems. Podcast Webpage: https://www.astronomer.io/podcast/
Show more...
Technology
RSS
All content for The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI is the property of Astronomer and is served directly from their servers with no modification, redirects, or rehosting. The podcast is not affiliated with or endorsed by Podjoint in any way.
Welcome to The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI— the podcast where we keep you up to date with insights and ideas propelling the Airflow community forward. Join us each week, as we explore the current state, future and potential of Airflow with leading thinkers in the community, and discover how best to leverage this workflow management system to meet the ever-evolving needs of data engineering and AI ecosystems. Podcast Webpage: https://www.astronomer.io/podcast/
Show more...
Technology
https://files.cohostpodcasting.com/cohost/dbcdfaae-58e3-4bce-9cf7-fd6dbc27a8f5/shows/50fd8116-be73-4852-be37-94d8bc0082fa/episodes/0925ae36-3a91-4ba2-bbe2-54ba5c7ccd1a/c5f0abd24a.jpg
How Snowflake Uses Airflow Sensors To Keep Financial Metrics Accurate with Ayush Pradhan
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI
18 minutes 28 seconds
3 days ago
How Snowflake Uses Airflow Sensors To Keep Financial Metrics Accurate with Ayush Pradhan

Clean financial reporting depends on orchestration that catches issues early, prevents bad data from spreading and helps teams react fast when something breaks.


In this episode, Ayush Pradhan, Senior Analytics Engineer at Snowflake, joins us to explain how Snowflake’s finance data team relies on @Apache Airflow, sensors and dbt to keep revenue, cost and accounting pipelines accurate.


Key Takeaways:


00:00 Introduction.

02:25 Airflow is used to coordinate recurring finance workflows.

04:20 Sensors enforce the timing for the end of the measurement period

06:50 Anomaly checks help catch issues near the source.

08:30 Alerts route to owners quickly through common channels.

10:38 Failed quality checks block downstream publishing.

11:50 New features are adopted only when tied to business value.

15:42 Vendor sensors can trigger workflows after upstream updates.

16:52 Community learnings help teams keep pace with open-source change.


Resources Mentioned:


Ayush Pradhan

https://www.linkedin.com/in/ayush-pradhan-845a19194/


Snowflake | LinkedIn

https://www.linkedin.com/company/snowflake-computing/


Snowflake | Website

https://www.snowflake.com


Apache Airflow

https://airflow.apache.org/


dbt Labs

https://www.getdbt.com/


Slack

https://slack.com/




Thanks for listening to “The Data Flowcast: Mastering Apache Airflow® for Data Engineering and AI.” If you enjoyed this episode, please leave a 5-star review to help get the word out about the show. And be sure to subscribe so you never miss any of the insightful conversations.



#AI #Automation #Airflow

The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI
Welcome to The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI— the podcast where we keep you up to date with insights and ideas propelling the Airflow community forward. Join us each week, as we explore the current state, future and potential of Airflow with leading thinkers in the community, and discover how best to leverage this workflow management system to meet the ever-evolving needs of data engineering and AI ecosystems. Podcast Webpage: https://www.astronomer.io/podcast/