Codestral Mamba Mistral (2024年)（コーデストラルマンバ）

概要

Codestral Mamba 7B は2024年7月Mistral AI発表・Industry-leading Mamba state-space code LLM 2024年Mistral AI Codestral Mamba 7B Apache 2.0 Mamba code LLM position確立。Industry-leading linear-time scaling + 256K context + Mamba-2 architecture + Codestral original Transformer 22B alternative + Apache 2.0 license。

主な特徴・仕組み

• Industry-leading Mistral AI (Founded 2023 Paris France by Arthur Mensch ex-DeepMind)
• Industry-leading Codestral Mamba 7B Mamba code LLM 2024年7月 release
• Industry-leading Mamba state-space code LLM signature (first production Mamba code)
• Industry-leading linear-time scaling O(n) signature (vs Transformer O(n²))
• Industry-leading 256K context window signature (longest 2024年7月 code)
• Industry-leading Mamba-2 architecture signature
• Industry-leading Codestral original Transformer 22B alternative signature
• Industry-leading 7B parameters efficient signature
• Industry-leading Apache 2.0 license signature
• Industry-leading Tri Dao + Albert Gu collaboration signature
• Industry-leading Mistral AI 2023 Paris Arthur Mensch + Guillaume Lample + Timothée Lacroix 1 year

まとめ

Codestral Mamba 7B = 2024年7月Mistral AI発表のpremium Apache 2.0 Mamba code LLM。Industry-leading Mamba state-space code LLM first production Mamba code + linear-time scaling O(n) vs Transformer O(n²) + 256K context window longest 2024年7月 code + Mamba-2 architecture + Codestral original Transformer 22B alternative + 7B parameters efficient + Apache 2.0 license + Tri Dao + Albert Gu collaboration + Mistral AI 2023 Paris Arthur Mensch + Guillaume Lample + Timothée Lacroix 1 year position確立。