The Transformative Ideas Podcast (formerly the ACIT Science Podcast). This podcast is to provide a glimpse into the life of scientists: to learn about the ideas they are passionate about, to find out what gets them out of bed every day to face the challenges and frustrations of working at the frontier to the unknown, and to share in some of the most important lessons they have learned in their career. For inquiries, reach out to manu.brenn@gmail.com.
All content for The Transformative Ideas Podcast is the property of Manuel Brenner and is served directly from their servers
with no modification, redirects, or rehosting. The podcast is not affiliated with or endorsed by Podjoint in any way.
The Transformative Ideas Podcast (formerly the ACIT Science Podcast). This podcast is to provide a glimpse into the life of scientists: to learn about the ideas they are passionate about, to find out what gets them out of bed every day to face the challenges and frustrations of working at the frontier to the unknown, and to share in some of the most important lessons they have learned in their career. For inquiries, reach out to manu.brenn@gmail.com.
#31: Deep Metric Learning, Generalization and Transformers with Karsten Roth
The Transformative Ideas Podcast
2 hours 23 minutes 9 seconds
3 years ago
#31: Deep Metric Learning, Generalization and Transformers with Karsten Roth
We are now the Transformative Ideas Podcast (formerly the ACIT Science Podcast)!
In this episode, we are joined by Karsten Roth. Karsten is a PhD Student at the Explainable Machine Learning group in Tuebingen, supervised by Zeynep Akata & Oriol Vinyals (https://karroth.com/).
His interests lie in most things Machine Learning and AI related.
We discuss ideas surrounding AI for medical applications, deep metric learning, generalization and representation learning, the surprising success of transformers, diffusion models, large language models and joint representations, generalization, inductive biases and neuroplasticity, AI research and bad incentives in the publishing culture, ML conferences, the interplay of industry and academia, advice for how to be a successful researchers, physics as a foundation for ML, and much more.
For inquiries, contact manu.brenn@gmail.com or reach out to me on Linkedin (https://www.linkedin.com/in/manuel-brenner-772261191/).
The Transformative Ideas Podcast
The Transformative Ideas Podcast (formerly the ACIT Science Podcast). This podcast is to provide a glimpse into the life of scientists: to learn about the ideas they are passionate about, to find out what gets them out of bed every day to face the challenges and frustrations of working at the frontier to the unknown, and to share in some of the most important lessons they have learned in their career. For inquiries, reach out to manu.brenn@gmail.com.