Home
Categories
EXPLORE
True Crime
Comedy
Society & Culture
Business
Sports
TV & Film
Technology
About Us
Contact Us
Copyright
© 2024 PodJoint
00:00 / 00:00
Sign in

or

Don't have an account?
Sign up
Forgot password
https://is1-ssl.mzstatic.com/image/thumb/Podcasts113/v4/15/52/64/15526441-1826-4375-f29a-d1061afc2295/mza_14702076207132770940.jpg/600x600bb.jpg
TechFirst with John Koetsier
John Koetsier
345 episodes
5 days ago
Tech that is changing the world. Innovators who are shaping the future. Deep discussions with diverse leaders from Silicon Valley giants and scrappy global startups. Plus some short monologues based on my Forbes columns.
Show more...
Tech News
News
RSS
All content for TechFirst with John Koetsier is the property of John Koetsier and is served directly from their servers with no modification, redirects, or rehosting. The podcast is not affiliated with or endorsed by Podjoint in any way.
Tech that is changing the world. Innovators who are shaping the future. Deep discussions with diverse leaders from Silicon Valley giants and scrappy global startups. Plus some short monologues based on my Forbes columns.
Show more...
Tech News
News
https://d3t3ozftmdmh3i.cloudfront.net/production/podcast_uploaded_nologo/2690224/2690224-1582573637310-521276d101469.jpg
Fruit fly AI: SLMs are the new LLMs
TechFirst with John Koetsier
22 minutes 57 seconds
1 week ago
Fruit fly AI: SLMs are the new LLMs

AI is devouring the planet’s electricity ... already using up to 2% of global energy and projected to hit 5% by 2030. But a Spanish-Canadian company, Multiverse Computing, says it can slash that energy footprint by up to 95% without sacrificing performance.


They specialize in tiny AI: one model has the processing power of just 2 fruit fly brains. Another tiny model lives on a Raspberry Pi.


The opportunities for edge AI are huge. But the opportunities in the cloud are also massive.


In this episode of TechFirst, host John Koetsier talks with Samuel Mugel, Multiverse’s CEO, about how quantum-inspired algorithms can drastically compress large language models while keeping them smart, useful, and fast. Mugel explains how their approach -- intelligently pruning and reorganizing model weights -- lets them fit functioning AIs into hardware as tiny as a Raspberry Pi or the equivalent of a fly’s brain.


They explore how small language models could power Edge AI, smart appliances, and robots that work offline and in real time, while also making AI more sustainable, accessible, and affordable.


Mugel also discusses how ideas from quantum tensor networks help identify only the most relevant parts of a model, and how the company uses an “intelligently destructive” approach that saves massive compute and power.


00:00 – AI’s energy crisis

01:00 – A model in a fly’s brain

02:00 – Why tiny AIs work

03:00 – Edge AI everywhere

05:00 – Agent compute overload

06:00 – 200× too much compute

07:00 – The GPU crunch

08:00 – Smart matter vision

09:00 – AI on a Raspberry Pi

10:00 – How compression works

11:00 – Intelligent destruction

13:00 – General vs. narrow AIs

15:00 – Quantum inspiration

17:00 – Quantum + AI future

18:00 – AI’s carbon footprint

19:00 – Cost of using AI

20:00 – Cloud to edge shift

21:00 – Robots need fast AI

22:00 – Wrapping up

TechFirst with John Koetsier
Tech that is changing the world. Innovators who are shaping the future. Deep discussions with diverse leaders from Silicon Valley giants and scrappy global startups. Plus some short monologues based on my Forbes columns.