-
Notifications
You must be signed in to change notification settings - Fork 33
Open
Labels
Description
Contains both multiple choice & free form questions, so probably we want to split it into two dataset classes PathVQAMultipleChoice
and PathVQAFreeForm
The PathVQA dataset has an active leaderboard on Papers with Code where models are ranked based on three metrics: "Yes/No Accuracy", "Free-form accuracy" and "Overall accuracy". "Yes/No Accuracy" is the accuracy of a model's generated answers for the subset of binary "yes/no" questions. "Free-form accuracy" is the accuracy of a model's generated answers for the subset of open-ended questions. "Overall accuracy" is the accuracy of a model's generated answers across all questions.