Codestral Code Generation (Mistral 2024年)(コーデストラル)
2024年Mistral AI発表Codestral・Industry-leading Mistral code generation LLM + Industry-leading 22B / Mamba 7B + Industry-leading 80+ programming languages + Industry-leading 32K context + Industry-leading Non-Production License。
概要
Codestral Code Generation は、2024年Mistral AI発表Codestral・Industry-leading Mistral code generation LLM 2024年 + Industry-leading 80+ programming languages position確立。Codestral specifications = Industry-leading Mistral code generation LLM (Industry-leading Codestral 2024 + Industry-leading Mistral code generation + Industry-leading Codestral flagship) + Industry-leading 22B / Mamba 7B (Industry-leading Codestral 22B + Codestral Mamba 7B SSM variants) + Industry-leading 80+ programming languages (Industry-leading 80+ langs support) + Industry-leading 32K context (Industry-leading 32K context) + Industry-leading Non-Production License (Industry-leading Mistral Non-Production License)。
主な特徴・仕組み
- Org: Industry-leading Mistral AI (France・Founder Arthur Mensch + Guillaume Lample + Timothée Lacroix)
- Year: 2024年 (Codestral 22B 2024年5月 + Codestral Mamba 2024年7月)
- Variants: Industry-leading Codestral 22B (dense Transformer) + Codestral Mamba 7B (SSM architecture)
- Languages: Industry-leading 80+ programming languages support
- Context Length: Industry-leading 32K tokens context (22B) / 256K Mamba 7B
- Mamba Architecture: Industry-leading Codestral Mamba 7B SSM architecture (vs Transformer)
- HumanEval: Industry-leading HumanEval pass@1 81.1% Codestral 22B
- License: Industry-leading Mistral Non-Production License (non-commercial research/test)
- Codestral Mamba License: Industry-leading Apache 2.0 (Mamba 7B only)
- Mistral AI: Industry-leading Mistral AI Arthur Mensch + Lample + Lacroix Paris 2023
- HuggingFace: Industry-leading mistralai/Codestral-22B-v0.1
- Industry-Leading: Industry-leading Mistral Codestral 22B + Mamba 7B 2024
スペック比較表
| LLM Code Generation (2023-2024) | Year | Org | Sizes | Industry Position |
|---|---|---|---|---|
| Codestral | 2024 | Mistral AI | 22B / Mamba 7B | Industry-leading Mistral Codestral |
| Qwen2.5-Coder | 2024 | Alibaba Qwen | 0.5B/1.5B/3B/7B/14B/32B | Industry-leading Qwen2.5-Coder 92.7% |
| DeepSeek-Coder | 2023 | DeepSeek AI | 1.3B-33B + V2 236B MoE | Industry-leading DeepSeek-Coder V2 |
| StarCoder 2 | 2024 | BigCode HF+ServiceNow | 3B/7B/15B 619 langs | Industry-leading BigCode open |
| CodeLlama | 2023 | Meta AI | 7B/13B/34B/70B | Industry-leading Meta CodeLlama |
具体例・対応製品
- Codestral (2024年, Mistral AI): Industry-leading Mistral code generation LLM
- Industry-leading Codestral 22B dense + Codestral Mamba 7B SSM: Industry-leading 22B + Mamba 7B variants
- Industry-leading 80+ programming languages: Industry-leading 80+ langs
- Industry-leading 32K context 22B / 256K Mamba 7B: Industry-leading 32K / 256K Mamba
- Industry-leading Mistral AI Arthur Mensch Paris 2023: Industry-leading Mistral AI Paris
- 競合 StarCoder 2 + CodeLlama + DeepSeek-Coder + Qwen2.5-Coder: Industry-leading code gen competitors
自作PCでの選び方・注意点
Codestral Code Generation は「Industry-leading Mistral code generation LLM + Industry-leading 22B / Mamba 7B」「Industry-leading 80+ programming languages + Industry-leading 32K context + Industry-leading Non-Production License」用途のIndustry-leading Mistral code generation 2024年Mistral AI発表product。Industry-leading 22B + Mamba 7B (Industry-leading Codestral 22B dense Transformer + Codestral Mamba 7B SSM architecture + Industry-leading Mistral 2-variants signature) で Industry-leading 22B + Mamba 7B + Industry-leading Mistral signature。Industry-leading Mamba SSM (Industry-leading Codestral Mamba 7B SSM architecture vs Transformer + Industry-leading 256K context Mamba 7B + Industry-leading SSM architecture innovation) で Industry-leading Mamba SSM + Industry-leading 256K context + Industry-leading SSM innovation。Industry-leading 80+ langs + 32K (Industry-leading 80+ programming languages support + Industry-leading 32K tokens context 22B + Industry-leading Codestral language signature) で Industry-leading 80+ langs + Industry-leading 32K context + Industry-leading Codestral signature。Industry-leading HumanEval 81.1% (Industry-leading HumanEval pass@1 81.1% Codestral 22B + Industry-leading Codestral 22B performance + Industry-leading code generation evaluation) で Industry-leading HumanEval 81.1% + Industry-leading Codestral performance + Industry-leading code eval。Industry-leading Non-Production License (Industry-leading Mistral Non-Production License non-commercial research/test + Industry-leading Codestral Mamba Apache 2.0 only + Industry-leading 2-license tier) で Industry-leading Non-Production + Industry-leading Mamba Apache + Industry-leading 2-license tier。Industry-leading Mistral AI Paris (Industry-leading Mistral AI Arthur Mensch + Guillaume Lample + Timothée Lacroix Paris 2023 founded + Industry-leading mistralai/Codestral-22B-v0.1 HuggingFace + Industry-leading Mistral Codestral 22B + Mamba 7B 2024) で Industry-leading Mistral AI Arthur Mensch Paris + Industry-leading mistralai/Codestral HuggingFace + Industry-leading Codestral 22B+Mamba 7B 2024。但しIndustry-leading StarCoder 2 + CodeLlama + DeepSeek-Coder + Qwen2.5-Coder competition (Industry-leading StarCoder 2 BigCode 619 langs Open RAIL-M 2024 + CodeLlama Meta 7B-70B 2023 + DeepSeek-Coder V2 MoE 236B 2023 + Qwen2.5-Coder Alibaba 0.5B-32B 92.7% Apache 2024 vs Codestral Mistral 22B / Mamba 7B SSM 80+ langs 32K/256K Non-Production License 2024 trade-off) で Industry-leading 4-code generation model competitors vs Codestral + Industry-leading 22B dense + Mamba 7B SSM architecture + 80+ programming languages + 32K / 256K Mamba context + HumanEval 81.1% 22B + Non-Production License + Mamba Apache 2.0 + Mistral AI Arthur Mensch Paris 2024 unique advantage adoption alignment必須。
関連用語との違い
- vs Qwen2.5-Coder (Alibaba 2024): Codestralは22B + Mamba 7B + Non-Production・Qwen2.5-Coderは0.5B-32B + Apache 2.0 + 92.7%
- vs DeepSeek-Coder V2 (236B MoE 2024): Codestralは22B dense + Mamba SSM・DeepSeek-Coder V2はMoE 236B
- vs StarCoder 2/CodeLlama (Open-source): CodestralはNon-Production License・StarCoder 2/CodeLlamaはOpen RAIL-M / Llama Community License
よくある質問(FAQ)
Q1: Codestral vs Qwen2.5-Coder 違いは? A: Codestral (Industry-leading Codestral 22B dense Transformer + Codestral Mamba 7B SSM architecture + 80+ programming languages + 32K context 22B / 256K Mamba 7B + HumanEval pass@1 81.1% 22B + Mistral Non-Production License + Codestral Mamba Apache 2.0 + Mistral AI Arthur Mensch + Lample + Lacroix Paris 2024) vs Qwen2.5-Coder (Industry-leading 0.5B + 1.5B + 3B + 7B + 14B + 32B 6-tier dense + 92+ programming languages + 5.5T tokens + 128K context + HumanEval pass@1 92.7% 32B-Instruct highest + Apache 2.0 + Alibaba Qwen Tongyi Lab 2024)・Industry-leading 22B + Mamba 7B SSM + 80+ langs + 32K/256K + Mistral Paris = Codestral + Industry-leading 6 sizes + 92+ langs + 92.7% + Apache 2.0 + Alibaba = Qwen2.5-Coder preference judgment。
Q2: Industry-leading 22B + Mamba 7B SSM value は? A: Industry-leading 22B + Mamba SSM (Industry-leading Codestral 22B dense Transformer + Industry-leading Codestral Mamba 7B SSM architecture + Industry-leading 256K context Mamba 7B + Industry-leading SSM architecture innovation vs Transformer)。
Q3: Industry-leading Non-Production License + Mistral Paris value は? A: Industry-leading Non-Production + Mistral (Industry-leading Mistral Non-Production License non-commercial research/test + Industry-leading Codestral Mamba Apache 2.0 only + Industry-leading 2-license tier + Industry-leading Mistral AI Arthur Mensch + Guillaume Lample + Timothée Lacroix Paris 2023 founded)。
まとめ
Codestral = 2024年Mistral AI Arthur Mensch + Guillaume Lample + Timothée Lacroix Paris発表のMistral code generation LLM。Industry-leading Codestral 22B dense Transformer + Industry-leading Codestral Mamba 7B SSM architecture + Industry-leading SSM architecture innovation vs Transformer + Industry-leading 80+ programming languages support + Industry-leading 32K tokens context 22B / 256K Mamba 7B + Industry-leading HumanEval pass@1 81.1% Codestral 22B + Industry-leading Mistral Non-Production License non-commercial research/test + Industry-leading Codestral Mamba Apache 2.0 only + Industry-leading 2-license tier + Industry-leading mistralai/Codestral-22B-v0.1 HuggingFace + Industry-leading Mistral Codestral 22B + Mamba 7B 2024 position確立。