Around a decade ago, “big data” became fashionable. There were lots of jokes and memes created around “big data”. Everyone wanted to do big data.
Now, in 2021, the hype around big data may have died down, but how to roganise and store data remains an important problem for organistions to solve.
Today’s guest is Rangarajan Vasudevan, founder and CEO of TheDataTeam, which builds AI solutions for customer intelligence. We talk about the history of big data, what companies look for when they want to organise their data, technolgies and all such.
Show Notes:
00:03:00 - What is Big Data?
00:10:10 - Why do we need to store data?
00:14:00 - Principles of data architecture
00:20:00 - How does data evolve as companies evolve?
00:24:30 - Data warehouse and data lake and data marts and other jargons
00:34:00 - How to avoid silos, and whether to centralise data engineering, analytics, etc.
00:42:40 - More on Hadoop
00:50:30 - How should a startup architect its data team (no pun intended)?
Data Chatter is a podcast on all things data. It is a series of conversations with experts and industry leaders in data, and each week we aim to unpack a different compartment of the "data suitcase".
The podcast is hosted by Karthik Shashidhar. He is a blogger, newspaper columnist, book author and a former data and strategy consultant. Karthik currently heads Analytics and Business Intelligence for Delhivery, one of India’s largest logistics companies.
You can follow him on twitter at @karthiks, and read his blog at noenthuda.com/blog