Home
Categories
EXPLORE
True Crime
Comedy
Society & Culture
Business
Sports
TV & Film
Technology
About Us
Contact Us
Copyright
© 2024 PodJoint
00:00 / 00:00
Sign in

or

Don't have an account?
Sign up
Forgot password
https://is1-ssl.mzstatic.com/image/thumb/Podcasts125/v4/c7/7a/da/c77adaef-1c29-fdb4-149f-784c5c7fd256/mza_15107942769330438025.jpg/600x600bb.jpg
Complete Developer Podcast
BJ Burns and Will Gant
331 episodes
9 months ago
A podcast by coders for coders about all aspects of life as a developer.

Hosted on Acast. See acast.com/privacy for more information.

Show more...
Technology
Business,
Careers
RSS
All content for Complete Developer Podcast is the property of BJ Burns and Will Gant and is served directly from their servers with no modification, redirects, or rehosting. The podcast is not affiliated with or endorsed by Podjoint in any way.
A podcast by coders for coders about all aspects of life as a developer.

Hosted on Acast. See acast.com/privacy for more information.

Show more...
Technology
Business,
Careers
https://assets.pippa.io/shows/64fe2007b206be0011298bff/show-cover.jpg
Database Sharding
Complete Developer Podcast
51 minutes 28 seconds
2 years ago
Database Sharding

Database sharding is a process of storing a large database across multiple machines. Because a single machine can only hold and process so much data, eventually some systems will scale beyond the ability of a single machine to handle data. Further, as systems scale, they may also need to split data between machines due to security and location considerations. Database sharding overcomes these problems by splitting the system into smaller chunks, allowing work to either be done in parallel, or only in the locations with the relevant data.

Obviously, it matters a lot how you split up your data. For instance, it's unlikely that splitting a customer table based on the customer last name will be as helpful in a large distributed system as it would be to split up customers by location. You probably also want to have shards that are roughly the same size. The idea behind sharding is to improve performance, specifically via parallelization, but it's also helpful if it also provides some resilience to outages. So that will also need to be a consideration when you start thinking about sharding.

Database sharding can be a very useful tool for making your application more resilient to load. However, it's complex and you really need to think through it carefully if you are considering using it in your environment. There are several different ways to do it, with different advantages and disadvantages, and these will need to be thoroughly considered before starting. Plus, sharding is actually a fairly drastic operation, requiring support and extra work for the remaining lifetime of your application. This means that you shouldn't really consider it until most other options have been exhausted.

Links

Join Us On Patreon

Level Up Financial Planning

The post Database Sharding appeared first on Complete Developer Podcast.



Hosted on Acast. See acast.com/privacy for more information.

Complete Developer Podcast
A podcast by coders for coders about all aspects of life as a developer.

Hosted on Acast. See acast.com/privacy for more information.