Hammerspace Breaks IO500 Barriers: How They Built the Fastest NFS-Based Benchmark Ever w/ Jon Flynn

https://is1-ssl.mzstatic.com/image/thumb/Podcasts112/v4/9a/64/da/9a64da91-d0cb-042f-68fe-dfb4a9a5f82a/mza_11714306392272815108.jpg/600x600bb.jpg

Data Unchained

Hammerspace

102 episodes

2 weeks ago

In the digital age, businesses run on data. Especially at a time when workers are distributed across the globe, it's more important than ever that teams have access to the data they need, when they need it, wherever they are. In this show, we explore the world of decentralized data and the issues it raises for doing business in the 21st century. Host Molly Presley talks with a fascinating lineup of guests, including scientists, business leaders, and thinkers at the cutting edge of data science about how and why data matters, and the ideas and technologies helping to advance our understanding of how to manage data in the 21st century.

Hosted on Acast. See acast.com/privacy for more information.

Technology

RSS

All content for Data Unchained is the property of Hammerspace and is served directly from their servers with no modification, redirects, or rehosting. The podcast is not affiliated with or endorsed by Podjoint in any way.

Hosted on Acast. See acast.com/privacy for more information.

Technology

https://assets.pippa.io/shows/65e0f5b7b8456c0016989a98/1763672377226-616c6e1f-0b4e-4013-b68e-602ff67f60ac.jpeg

Hammerspace Breaks IO500 Barriers: How They Built the Fastest NFS-Based Benchmark Ever w/ Jon Flynn

Data Unchained

24 minutes 24 seconds

1 month ago

Hammerspace Breaks IO500 Barriers: How They Built the Fastest NFS-Based Benchmark Ever w/ Jon Flynn

In this landmark 100th episode of Data Unchained, host Molly Presley sits down with Jonathan Flynn, Director of Applied Systems at Hammerspace, live from Supercomputing 2025. Together they explore the performance engineering breakthroughs that enabled Hammerspace and Samsung to deliver a historic IO500 10 Node Production result using only standard Linux, the upstream NFSv4.2 client, and off the shelf NVMe hardware.

This episode breaks down how the Hammerspace Data Platform delivered more than a 33 percent gain over earlier submissions, doubled overall bandwidth, and achieved an unprecedented 809 percent improvement in the IO Hard Read test using Samsung PM1753 Gen 5 NVMe SSDs. Jonathan explains the Linux kernel innovations, metadata advancements, IO path optimization, parallel file system breakthroughs, and multi instance file placement strategies that allowed Hammerspace to reach genuine HPC class performance without proprietary clients or custom networking.

Listeners get a detailed walkthrough of the architectural differences between Research and Production IO500 submissions, the impact of metadata redundancy, the performance benefits of NFSd direct and NFS direct, the role of ZFS locking improvements, and how upstream Linux contributions directly advanced the state of HPC and AI data infrastructure. Jonathan also highlights the evolution of MLPerf benchmarking, the benefits of tier zero storage, and how Hammerspace performance engineering is unlocking new levels of efficiency and scalability for AI training, scientific workloads, and large scale analytics.

This episode is essential for AI architects, HPC engineers, kernel developers, data scientists, and infrastructure leaders building the next generation of high performance data platforms.

Cyberpunk by jiglr | https://soundcloud.com/jiglrmusic

Music promoted by https://www.free-stock-music.com

Creative Commons Attribution 3.0 Unported License

https://creativecommons.org/licenses/by/3.0/deed.en_US

Hosted on Acast. See acast.com/privacy for more information.