Replies: 1 comment
|
No special fork bug with the default joblib path, but
Integer seeds avoid that chaining. Each From the Controlling randomness guide: int for splitters, Checked |
|
No special fork bug with the default joblib path, but
Integer seeds avoid that chaining. Each From the Controlling randomness guide: int for splitters, Checked |
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
In Controlling randomness, the guide is discussing how to properly control randomness either for an estimator or CV or when using both. However, there is no mention if
random_stateandn_jobs > 1interact in any unexpected way.Lets consider a typical use case where a user cross validates a
RandomForestClassifierwithKFold:Since
n_jobs=-1this means that multiple cores will be used for cross validation (e.g. 1 core per fold).With regards to estimator, would the same state be used for the different folds since during multiprocessing the estimator and hence the rng passed to it, is copied via fork?
All reactions