What is the Philosophy of Statistics

Statistics is the analysis of quantitative (that is, numerical) data from what are called samples of a population in order to make inferences about the properties of a population.

For example, if we want to determine the average height of all men (the population) we can, following specific rules, look at a subset of all men, perhaps 100 chosen randomly, compute the average height of those 100 men, and again following specific rules, make an inference about the average height of all men.

The Philosophy of Statistics, is the branch of Philosophy which studies Statistic, and makes statements about such things as, what forms of Statistics are valid to use, why they are or are not valid, and providing justification for various forms of statistical reasoning.

One of the most import books in the field is:

Logic of Statistical Inference by Ian Hacking