A library for trimming tokens in encoding and decoding in LLM (Large Language Model) applications. It provides utilities to compress text by removing stopwords, punctuation, spaces, and applying stemming, with the ability to reverse the process as much as possible.

Fast-polyvalent trimmer used for several applications of next-generation sequencing