DeepSpeed-based Training

This repo contains a standalone DeepSpeed training implementation.

Name		Name	Last commit message	Last commit date
Latest commit History 20 Commits
.github/workflows		.github/workflows
sample-data		sample-data
scripts		scripts
.gitignore		.gitignore
.isort.cfg		.isort.cfg
.markdownlint-cli2.yaml		.markdownlint-cli2.yaml
.pylintrc		.pylintrc
.spellcheck-en-custom.txt		.spellcheck-en-custom.txt
.spellcheck.yml		.spellcheck.yml
LICENSE		LICENSE
Makefile		Makefile
README.md		README.md
__init__.py		__init__.py
data_process.py		data_process.py
ilab_to_sdg.py		ilab_to_sdg.py
main_ds.py		main_ds.py
multipack_sampler.py		multipack_sampler.py
pyproject.toml		pyproject.toml
requirements-dev.txt		requirements-dev.txt
requirements.txt		requirements.txt
token_dataset.py		token_dataset.py
tokenizer_utils.py		tokenizer_utils.py
tox.ini		tox.ini
utils.py		utils.py

Provide feedback