BBPE 底层实现

Docker image for OpenClash

Contrastive Fact Verification

Large language Model fintuning bloom , opt , gpt, gpt2 ,llama,llama-2,cpmant and so on

Use multiprocess to segmentation by jieba and compute TF-IDF

realize the reinforcement learning training for gpt2 llama bloom and so on llm model

the tool to dectect language with ML

The implementation of http://aclweb.org/anthology/D18-1531

Natural Language Processing Tutorial for Deep Learning Researchers

Morphological-segmentation-of-data

Uyghur

基于自由度（熵）、凝固度 新词发现算法实现