Thanks to visit codestin.com
Credit goes to github.com

Skip to content

Add PathVQA dataset #909

@nkaenzig

Description

@nkaenzig

Contains both multiple choice & free form questions, so probably we want to split it into two dataset classes PathVQAMultipleChoice and PathVQAFreeForm

The PathVQA dataset has an active leaderboard on Papers with Code where models are ranked based on three metrics: "Yes/No Accuracy", "Free-form accuracy" and "Overall accuracy". "Yes/No Accuracy" is the accuracy of a model's generated answers for the subset of binary "yes/no" questions. "Free-form accuracy" is the accuracy of a model's generated answers for the subset of open-ended questions. "Overall accuracy" is the accuracy of a model's generated answers across all questions.

https://huggingface.co/datasets/flaviagiammarino/path-vqa

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions