8000 Megatron-DeepSpeed/dataset at main · deepspeedai/Megatron-DeepSpeed · GitHub

Name		Name	Last commit message	Last commit date
parent directory ..
README.md		README.md
download_books.sh		download_books.sh
download_ckpt.sh		download_ckpt.sh
download_vocab.sh		download_vocab.sh

README.md

Run the scripts below to setup dataset

bash download_books.sh

bash download_vocab.sh

0