Guides
- User Guide3,898 words, about 17 min to read. Markdown
- Admin Guide4,704 words, about 20 min to read. Markdown
NousResearch/DisTrO
DisTrO (Distributed Training Over-the-Internet) is a family of architecture-agnostic and network-agnostic distributed optimizers that reduce inter-GPU communication during neural network training by four to five orders of magnitude.
Generated May 2026 from NousResearch/DisTrO at 24f1062
AI-generated documentation. The library is checked by sampling (three repositories so far); this guide was not individually reviewed. Verify against the project before relying on it.
Source and caveats
Built from the public repository github.com/NousResearch/DisTrO at commit 24f1062. Upstream may have moved on since.
Unofficial; not affiliated with or reviewed by the project. How the guides were made, and how they were checked: guide library.