Skip to content

NVIDIA/Megatron-LM

Error
Looks like something went wrong!

About

Ongoing research training transformer models at scale

docs.nvidia.com/megatron-core/developer-guide/latest/user-guide/index.html#quick-start

Topics

transformers model-para large-language-models

Resources

Readme

License

View license
Activity
Custom properties

Stars

12.6k stars

Watchers

174 watching

Forks

2.8k forks
Report repository

Releases 18

NVIDIA Megatron Core 0.12.1 Latest
May 23, 2025
+ 17 releases

Packages

No packages published

Contributors 168

+ 154 contributors

Languages