Data Q&A: Answering the Real Questions with Python#
Data Q&A is a series of articles where I answer questions people asked on Reddit’s statistics forum and on Cross Validated, the statistics Q&A site. I chose questions that come up often or that look simple but turn out not to be, and I answer each one with Python code in a Jupyter notebook. When the question comes with data, I use it.
The articles are grouped into five parts:
Probability and distributions: what PMFs, PDFs and likelihoods mean, the gambler’s fallacy, hazard rates, and how to tell whether events arrive at random.
Summarizing data: which standard deviation to use, percentile ranks, Likert scales, and combining risks.
Estimation and uncertainty: what a confidence interval means, bootstrapping proportions, means and percentiles, and Bayesian estimation with small samples.
Testing, sample size, and experiments: comparing percentiles and slopes, choosing a sample size, and analyzing a small experiment.
Regression and models: correlation and trend lines, R-squared versus p-values, heteroskedasticity, standardizing variables, and data where the subjects can’t be told apart.
Each article stands on its own, so you can start anywhere. At the top of each one there’s a link you can use to run the notebook on Colab.
The series is complete for now, but I might add more articles. If you have a question you’d like me to answer, or suggestions about these articles, create an issue in the GitHub repository.