LoongForge：打造跨模態大模型訓練的模組化引擎 | LoongForge: A Modular Engine for Cross-Modal Large Model Training
一個模組化、可擴展且高效能的訓練框架，專為語言、多模態與具身智能模型而生。 | A modular, scalable, and highly efficient training framework designed for language, multimodal, and embodied models. 🔎 工具速覽 / AT A GLANCE Category AI Training Framework Pricing Open Source BestFor Large-scale model pre-training and SFT across heterogeneous hardware GitHub Stars ⭐ 136 🚀 引言 / Introduction LoongForge 是百度 Baige AI 基礎設施平台推出的 Loong 開源系列之一。基於 Megatron-LM 並進行深度優化，它提供了一個高效且具備高度擴展性的解決方案，涵蓋從預訓練、持續預訓練到監督微調（SFT）的全過程。 | LoongForge is part of the Loong open-source series from Baidu's Baige AI infrastructure platform. Built upon and significantly enhancing Megatron-LM, it delivers an efficient and highly extensible solution covering pre-training, continued pre-training, and supervised fine-tuning (SFT). 🛠️ 核心功能 / Key Features 原生支持 LLM、VLM、VLA 及擴散模型，透過靈活的組件抽象化輕鬆添加新模態。 | Natively supports LLMs, ...