FlagOS is a unified, open-source AI system software stack designed for multi-chip scenarios. It was jointly initiated and established by over ten domestic and international organizations, including chip companies, system manufacturers, algorithm and software-related entities, non-profit organizations, and research institutions.
Addressing core pain points in utilizing diverse AI chips, FlagOS builds a comprehensive system software ecosystem that demonstrates the potential to break down ecosystem barriers between different chip software stacks, effectively reducing migration costs for developers.
| Component | Purpose | Repository |
|---|---|---|
| FlagGems | High-performance universal AI operator library | FlagGems |
| FlagTree | Unified AI compiler | FlagTree |
| FlagScale | Unified parallel training and inference framework | FlagScale |
| FlagCX | Unified communication library | FlagCX |
| FlagPerf | Multi-chip evaluation tool | FlagPerf |
| FlagRelease | Large model release platform | FlagRelease |
| Triton-Copilot | AI enabled operator develop tool | Triton-Copilot |
-
TritonCopilot: Next-generation AI-assisted kernel engineering for multi-chip systems → TritonCopilot
-
libtriton_jit: Triton JIT C++ runtime for reduced Python overhead → libtriton_jit
-
Megatron-LM-FL: GPU-optimized library for training transformer models at scale → Megatron-LM-FL
-
TransformerEngine-FL: FP8 mixed precision training for transformer models → TransformerEngine-FL
-
vllm-FL: A vLLM plugin built on FlagOS unified multi-chip backend for LLM serving → vllm-FL
-
vllm-plugin-FL: Advanced vLLM plugin for enhanced multi-chip support → vllm-plugin-FL
-
EasyOfUse: Simplify development for open compute - plug-and-play solutions and best practices → EasyOfUse
-
Community: FlagOS community governance, contribution guides, and communication hub → Community
- FlagOS Wiki & Documentation: DeepWiki Portal
- Latest Release v1.5: Announcement
- ModelScope: FlagRelease Models
- Hugging Face: FlagRelease Models
- WiseModel: FlagRelease Models
- WeChat Official Account: FlagOpen
- WeChat Channels Account: FlagOpen
Ready to contribute or learn more? Visit the FlagOS Community Repository for:
- 📖 Comprehensive contribution guidelines
- 💬 Community discussions and support
- 🤝 Ways to get involved
- 📚 Resources and documentation
We welcome contributions from the community! Whether through starring, forking, or submitting pull requests, your involvement helps make FlagOS better.
- ⭐ Star - Show your support!
- 🔔 Watch - Stay updated with our latest releases
- 🍴 Fork - Start contributing!
Please read and respect our Code of Conduct:
- Code of Conduct (English)
FlagOS and its components are licensed under the Apache License 2.0. See individual repositories for details.
FlagOS is jointly supported by leading organizations in chip manufacturing, system software, and AI research. This collaborative effort demonstrates the commitment to building an open, unified ecosystem for AI system software across diverse hardware platforms.
Join us in building the future of AI system software! 🚀