All content for Linear Digressions is the property of Ben Jaffe and Katie Malone and is served directly from their servers
with no modification, redirects, or rehosting. The podcast is not affiliated with or endorsed by Podjoint in any way.
In each episode, your hosts explore machine learning and data science through interesting (and often very unusual) applications.
Keeping ourselves honest when we work with observational healthcare data
Linear Digressions
19 minutes 8 seconds
5 years ago
Keeping ourselves honest when we work with observational healthcare data
The abundance of data in healthcare, and the value we could capture from structuring and analyzing that data, is a huge opportunity. It also presents huge challenges. One of the biggest challenges is how, exactly, to do that structuring and analysis—data scientists working with this data have hundreds or thousands of small, and sometimes large, decisions to make in their day-to-day analysis work. What data should they include in their studies? What method should they use to analyze it? What hyperparameter settings should they explore, and how should they pick a value for their hyperparameters? The thing that’s really difficult here is that, depending on which path they choose among many reasonable options, a data scientist can get really different answers to the underlying question, which makes you wonder how to conclude anything with certainty at all.
The paper for this week’s episode performs a systematic study of many, many different permutations of the questions above on a set of benchmark datasets where the “right” answers are known. Which strategies are most likely to yield the “right” answers? That’s the whole topic of discussion.
Relevant links:
https://hdsr.mitpress.mit.edu/pub/fxz7kr65
Linear Digressions
In each episode, your hosts explore machine learning and data science through interesting (and often very unusual) applications.