sub-words

Here are 3 public repositories matching this topic...

papers and codes for text summarization research see readme for more details

Learning Embeddings with Multiple Linguistic Fields @NAACL2021

word2vec embeddings sub-words

Fast & efficient BPE tokenizer written in C & python for LLM tranining

tokenizer tokenization sub-words tiktoken llm-training

Add a description, image, and links to the sub-words topic page so that developers can more easily learn about it.

To associate your repository with the sub-words topic, visit your repo's landing page and select "manage topics."