A few scripts for computing inter-annotator agreement for MAE/MAI XMLs.

cohen.py : Methods for computing Cohen's kappa coefficient

corpus.py : Module for working with collections of documents

fleiss.py : Methods for computing Fleiss's kappa coefficient

krippendorff.py : Methods for computing Krippendorff's alpha coefficient

test_kappa.py : Test suite for Fleiss's and Cohen's kappas

iaa.py : Script for loading a corpus from a directory and computing IAA

prf.py : Starter code for computing Precision, Recall, and F1