Long gone are the days when data is batch loaded into a data warehouse for business intelligence reports that are looked at periodically and if something is broken, a few internal people would have to wait. Today, data pipelines are “infinitely more complicated”, with more sources from cloud services to on premises systems, and supporting data applications that are critical parts of a business’ ecosystem.
In this episode, Dormain Drewitz sits down with Manuraj Rajasekharan, Senior Director of Analytics and Data Engineering at PagerDuty, and James Zhao, Senior Product Manager at Snowflake to discuss how DataOps has evolved and how it will be essential to support large language models (LLMs) in production.