-
Notifications
You must be signed in to change notification settings - Fork 240
Open
Description
Section 3.4.1 discusses R repeats of V-fold cross validation and incorrectly states that the variance reduction will be by a factor of Sqrt(R). This would be true only if the measures across repeats were independent, which they are not. In fact, the variance reduction depends on the value of V. As an extreme example, for leave-one-out cross validation there can be no variance reduction at all. Even at the other extreme, with V=2, variance reduction will not reach Sqrt(R). To help understand the issues involved, consider two facts: there are a finite (though very large) number of possible partitions for cross validation, and the training set is itself a random sample from the population.
Metadata
Metadata
Assignees
Labels
No labels