I just started using this, and the review is not ready yet since I just started testing (training first, but you get the picture). The installation and configuration are very straightforward, with good integration with HuggingFace Transformers and Pytorch Lightning. My training models so far are in a multi-node configuration compatible with OpenMPI. More later! #training #testing #pytorch #deepspeed #huggingface #datascience #ai #ml
GitHub Link:
https://github.com/microsoft/DeepSpeed
No comments:
Post a Comment