Source code for our TBD paper : Multi-Evidence based Fact Verification via A Confidential Graph Neural Network

Click the links below to view our papers and checkpoints

If you find this work useful, please cite our paper and give us a shining star 🌟

@article{Lan2024MultiEvidenceBF,
  title={Multi-Evidence based Fact Verification via A Confidential Graph Neural Network},
  author={Yuqing Lan and Zhenghao Liu and Yu Gu and Xiaoyuan Yi and Xiaohua Li and Liner Yang and Ge Yu},
  journal={IEEE Transactions on Big Data},
  year={2024},
  url={https://api.semanticscholar.org/CorpusID:269899642}
}

CO-GAT designs an additional node representation masking mechanism before the graph reasoning modeling, which controls the evidence information flow into the graph reasoning model.

1. Install the following packages using Pip or Conda under this environment

Python==3.7
Pytorch
transformers
prettytable
scikit-learn
jsonlines
pandas

We provide the version file requirements.txt of all our used packages, if you have any problems configuring the environment, please refer to this document.

• First, use git clone to download this project:

git clone https://github.com/NEUIR/CO-GAT
cd CO-GAT

• Download link for FEVER
• Download link for SCIFACT(CO-GAT).
• Place the downloaded dataset in the data folder:

data/
├──fever/
│   ├── bert_train.json
│   ├── bert_dev.json
│   ├── bert_test.json
│   ├── bert_eval.json
│   ├── dev_eval.json
│   └── all_test.json
└──scifact/
    ├── prediction
    ├── corpus.jsonl
    ├── train_cogat.json
    ├── dev_cogat.json
    ├── claims_dev.json
    └── claim_test.json

I will show you how to reproduce the results in the CO-GAT paper.

• For the FEVER dataset: Go to the cogat-fever folder and train the CO-GAT model checkpoint:

cd cogat-fever
bash train_twostep.sh

• For the SCIFACT dataset: Go to the cogat-scifact folder and train the CO-GAT model checkpoint:

cd cogat-scifact
bash train.sh

• These experimental results are shown in Table 3 of our paper.
• Go to the cogat-fever or cogat-scifact folder and evaluate model performance as follow:

bash test.sh
bash inference.sh

The results are shown as follows.

• FEVER

• SCIFACT

If you have questions, suggestions, and bug reports, please email:

[email protected]