#51 – Jeffrey Quesnelle on Nous Research, large language models, and the human mind

https://is1-ssl.mzstatic.com/image/thumb/Podcasts221/v4/91/67/5a/91675afd-be2d-533f-be7e-b85b996f1b91/mza_4541276372262748610.jpg/600x600bb.jpg

Into the Bytecode

Sina Habibian

52 episodes

5 months ago

Into the Bytecode is a podcast about building the future. Check out these links for more: - Twitter: twitter.com/sinahab - Website: intothebytecode.com - Newsletter for updates: bytecode.substack.com

Technology

Business

RSS

All content for Into the Bytecode is the property of Sina Habibian and is served directly from their servers with no modification, redirects, or rehosting. The podcast is not affiliated with or endorsed by Podjoint in any way.

Into the Bytecode is a podcast about building the future. Check out these links for more: - Twitter: twitter.com/sinahab - Website: intothebytecode.com - Newsletter for updates: bytecode.substack.com

Technology

Business

https://img.transistor.fm/548GDG_myZcljgKc9A2Jyfd84fUOyLfX9uZ7xWG39-M/rs:fill:3000:3000:1/q:60/aHR0cHM6Ly9pbWct/dXBsb2FkLXByb2R1/Y3Rpb24udHJhbnNp/c3Rvci5mbS81NThm/NjQ2Y2U3YmI0MDk3/MGFhZWIwOGUwMWNl/ZmYzOC5qcGc.jpg

#51 – Jeffrey Quesnelle on Nous Research, large language models, and the human mind

Into the Bytecode

2 hours 5 minutes

8 months ago

#51 – Jeffrey Quesnelle on Nous Research, large language models, and the human mind

This is my conversation with Jeffrey Quesnelle, cofounder of Nous Research.

Timestamps:
- (00:00:00) intro
- (00:01:08) working with new technologies
- (00:06:15) Nous Research origin story
- (00:14:08) open frontiers in research
- (00:26:07) fourier transforms for gradient compression
- (00:32:58) math behind distributed training
- (00:38:18) sponsor: Splits
- (00:39:02) neural networks history and fundamentals
- (00:51:29) the human mind and AI, hyperdimensional representation
- (01:01:15) intuition and reasoning
- (01:15:00) parallels with reinforcement learning
- (01:19:15) the cat is out of the bag
- (01:47:11) deeper mysteries

Links:
- Jeffrey Quesnelle: https://jeffq.com/
- Jeffrey Quesnelle on X: https://x.com/theemozilla
- Nous Research: https://nousresearch.com/
- Psyche: https://nousresearch.com/nous-psyche/

Thank you to our sponsor for making this podcast possible:
- Splits: https://splits.org

Into the Bytecode:
- Sina Habibian on X: https://twitter.com/sinahab
- Sina Habibian on Farcaster: https://warpcast.com/sinahab
- Into the Bytecode: https://intothebytecode.com

Disclaimer:
This podcast is for informational purposes only. It is not financial advice nor a recommendation to buy or sell securities. The host and guests may hold positions in the projects discussed.