Home repository for the README-EVAL evaluation system

The ACL 2014 Semantic Parsing workshop abstract describing what README-EVAL is about is available here Towards README-EVAL : Interpreting README File Instructions.

The poster I showed at the workshop is README-EVAL poster PDF (PowerPoint).

README-EVAL has not been implemented yet which is why there is no code or data here. The code that does exist is an RPM distro file extractor and browser. That code (PackageExtractor and PackageIndexer) is in the ReadIt repository and should work with most any Fedora RPMS distribution. That data is not reproduced here because it is fairly large when unpacked (~35GB for Fedora Core 17).

Please subscribe to this repo and/or send me an email if you're interested in this project and would like to use README-EVAL.