您好，

原始檔案我要再找找，如果急用的話，我剛剛稍微從 chat.py改了一下，雖然還沒有實際跑過，不過流程應該是對的

    def dumpQAPairs(self, path):

        with open("data/Titles.txt",'r',encoding='utf-8') as data:
            titles = [line.strip('\n') for line in data]

        with open(path, 'w', encoding='utf-8') as dump:
            index = 0

            for title in titles:
                q = title
                res = json.load(open(os.path.join("data/processed/reply/",str(int(index/1000))+'.json'),'r',encoding='utf-8'))
                targetId = index % 1000

                try:
                    candiates = self.evaluator.getBestResponse(res[targetId])
                    a = self.randomPick(candiates)
                    dump.write(q + "\t" + a + "\n")
                except:
                    print("[Err] : ", index + 1)

                index += 1
                if index % 1000 == 0:
                    print("Dumped %d QA Pairs" % (index))

理論上 json.load(open(os.path.join("data/processed/reply/",str(int(index/1000))+'.json'),'r',encoding='utf-8')) 是可以不用重複載入的，因為一個 json 檔中存了很多篇文章的回應，不過就先將就一下吧 <(_ _)>

如何抽取問答配對？ #1

Description

Metadata

Metadata

Assignees

Labels

Projects

Milestone

Relationships

Development

Issue actions