Model Evaluation

1. For GPT2 implementation, are the evaluation samples are being taken from the training dataset? 
2. Regarding the paper's quantitative comparison (Table 2), is the benchmark there also the training dataset for the models? 
3. How do the models perform for out of distribution samples (i.e. prompts that are not from the dataset)?