To understand how Generative AI works, we must first understand AI #FoundationModels, which are neural networks trained on huge datasets that can be used to create a plethora of use case specific AI solutions.

In this episode of Neural NebulAI, Randall Hunt, Brian Tarbox, and special guest, Suraj Subramanian, Machine Learning Engineer at Meta, dive into foundation models, from development to training and fine-tuning. They also discuss how different development strategies can introduce challenges such as hallucinations and catastrophic forgetting, and how new models such as Llama 2 are using interesting reward modelling strategies to improve response accuracy and relevance.

Edited by Aman Wadhwa. Produced by Cynthia Lam. Music by Larry Poppinz.

Follow Caylent on Twitter, LinkedIn, TikTok, and Instagram. Visit our website to find out more about us: www.caylent.com