CodeLlama Code Generation (Meta 2023年)（コードラマ）
2023年Meta AI発表CodeLlama・Industry-leading Meta code generation LLM + Industry-leading 7B/13B/34B/70B + Industry-leading 16K-100K context + Industry-leading Python+Instruct variants。
概要
CodeLlama Code Generation は、2023年Meta AI発表CodeLlama・Industry-leading Meta code generation LLM 2023年 + Industry-leading Python+Instruct variants position確立。CodeLlama specifications = Industry-leading Meta code generation LLM (Industry-leading CodeLlama 2023 + Industry-leading Meta code generation + Industry-leading CodeLlama flagship) + Industry-leading 7B/13B/34B/70B (Industry-leading 4-tier sizes) + Industry-leading 16K-100K context (Industry-leading 16K base + 100K extended context) + Industry-leading Python+Instruct variants (Industry-leading Python-specialized + Instruct-tuned variants)。
主な特徴・仕組み
- Org: Industry-leading Meta AI (FAIR + GenAI team)
- Year: 2023年 (arXiv 2023年8月発表 + 2024年1月CodeLlama 70B release)
- Paper: Industry-leading "Code Llama: Open Foundation Models for Code" arXiv 2308.12950
- Sizes: Industry-leading 7B + 13B + 34B + 70B 4-tier variants
- Base Model: Industry-leading Llama 2 base fine-tuned for code
- Context: Industry-leading 16K tokens base + 100K extended context support
- Variants: Industry-leading Code Llama base + Python-specialized + Instruct-tuned 3 types
- Python Specialization: Industry-leading Code Llama - Python Python-specialized
- Instruct Tuning: Industry-leading Code Llama - Instruct natural language instruction following
- License: Industry-leading Llama Community License (commercial use up to 700M MAU)
- HumanEval: Industry-leading HumanEval pass@1 67.8% (Code Llama 70B Instruct)
- HuggingFace: Industry-leading codellama/CodeLlama-70b-Instruct-hf
- Industry-Leading: Industry-leading Meta CodeLlama 70B code generation 2023
スペック比較表
| LLM Code Generation (2023-2024) | Year | Org | Sizes | Industry Position |
|---|---|---|---|---|
| CodeLlama | 2023 | Meta AI | 7B/13B/34B/70B | Industry-leading Meta CodeLlama |
| StarCoder 2 | 2024 | BigCode HF+ServiceNow | 3B/7B/15B 619 langs | Industry-leading BigCode open |
| DeepSeek-Coder | 2023 | DeepSeek AI | 1.3B-33B + V2 236B MoE | Industry-leading DeepSeek-Coder V2 |
| Qwen2.5-Coder | 2024 | Alibaba Qwen | 0.5B/1.5B/3B/7B/14B/32B | Industry-leading Qwen2.5-Coder |
| Codestral | 2024 | Mistral AI | 22B / Mamba 7B | Industry-leading Mistral Codestral |
具体例・対応製品
- CodeLlama (2023年, Meta AI): Industry-leading Meta code generation LLM
- Industry-leading 7B + 13B + 34B + 70B 4-tier variants: Industry-leading 7B-70B 4-tier
- Industry-leading 16K base + 100K extended context: Industry-leading 16K-100K context
- Industry-leading Code Llama + Python + Instruct 3 variants: Industry-leading 3 variant types
- Industry-leading HumanEval pass@1 67.8% Code Llama 70B Instruct: Industry-leading HumanEval 67.8%
- 競合 StarCoder 2 + DeepSeek-Coder + Qwen2.5-Coder + Codestral: Industry-leading code gen competitors
自作PCでの選び方・注意点
CodeLlama Code Generation は「Industry-leading Meta code generation LLM + Industry-leading 7B/13B/34B/70B」「Industry-leading 16K-100K context + Industry-leading Python+Instruct variants」用途のIndustry-leading Meta code generation 2023年Meta AI発表product。Industry-leading 4-tier (Industry-leading 7B + 13B + 34B + 70B 4-tier variants + Industry-leading CodeLlama 4-tier signature + Industry-leading widest size range) で Industry-leading 4-tier + Industry-leading CodeLlama signature + Industry-leading widest range。Industry-leading 16K-100K (Industry-leading 16K tokens base + 100K extended context + Industry-leading CodeLlama long context signature + Industry-leading 100K extended unique) で Industry-leading 16K-100K + Industry-leading long context + Industry-leading 100K unique。Industry-leading 3 variants (Industry-leading Code Llama base + Python-specialized + Instruct-tuned 3 types + Industry-leading CodeLlama 3 variants signature) で Industry-leading 3 variants + Industry-leading CodeLlama signature + Industry-leading 3 variants types。Industry-leading Llama 2 base (Industry-leading Llama 2 base fine-tuned for code + Industry-leading Llama Community License commercial use up to 700M MAU + Industry-leading Meta-backed) で Industry-leading Llama 2 base + Industry-leading Community License + Industry-leading Meta-backed。Industry-leading HumanEval 67.8% (Industry-leading HumanEval pass@1 67.8% Code Llama 70B Instruct + Industry-leading CodeLlama HumanEval performance + Industry-leading 70B Instruct flagship) で Industry-leading HumanEval 67.8% + Industry-leading CodeLlama performance + Industry-leading 70B flagship。Industry-leading Meta AI FAIR (Industry-leading Meta AI FAIR + GenAI team + Industry-leading codellama/CodeLlama-70b-Instruct-hf HuggingFace + Industry-leading Meta CodeLlama 70B code generation 2023) で Industry-leading Meta AI FAIR+GenAI + Industry-leading codellama/CodeLlama HuggingFace + Industry-leading Meta CodeLlama 2023。但しIndustry-leading StarCoder 2 + DeepSeek-Coder + Qwen2.5-Coder + Codestral competition (Industry-leading StarCoder 2 BigCode 619 langs Open RAIL-M 2024 + DeepSeek-Coder V2 MoE 236B 2023 + Qwen2.5-Coder Alibaba 0.5B-32B 2024 + Codestral Mistral 22B/Mamba 7B 2024 vs CodeLlama Meta 7B-70B Llama 2 base 100K context 2023 trade-off) で Industry-leading 4-code generation model competitors vs CodeLlama + Industry-leading 7B-70B 4-tier + Llama 2 base + 16K-100K context + Code Llama + Python + Instruct 3 variants + HumanEval 67.8% + Llama Community License + Meta AI 2023 unique advantage adoption alignment必須。
関連用語との違い
- vs StarCoder 2 (BigCode 2024): CodeLlamaはMeta + 7B-70B + Llama 2 + 100K context・StarCoder 2はBigCode + 3B-15B + 619 langs + Open RAIL-M
- vs DeepSeek-Coder V2 (236B MoE 2024): CodeLlamaは7B-70B dense + Meta・DeepSeek-Coder V2はMoE 236B + 86 langs
- vs Codestral (Mistral 22B 2024): CodeLlamaはMeta + 7B-70B + Llama Community・CodestralはMistral + 22B + Non-Production License
よくある質問（FAQ）
Q1: CodeLlama vs StarCoder 2 違いは？ A: CodeLlama (Industry-leading 7B + 13B + 34B + 70B 4-tier + Llama 2 base + 16K-100K extended context + Code Llama + Python + Instruct 3 variants + HumanEval pass@1 67.8% 70B Instruct + Llama Community License + Meta AI FAIR + GenAI 2023) vs StarCoder 2 (Industry-leading 3B + 7B + 15B 3-tier + 619 programming languages + The Stack v2 67TB + 4T+ tokens + FIM + 16K context + BigCode Open RAIL-M + BigCode HF+ServiceNow+NVIDIA 2024)・Industry-leading Meta + 7B-70B + Llama 2 + 100K + HumanEval 67.8% = CodeLlama + Industry-leading BigCode + 3B-15B + 619 langs + Stack v2 + Open RAIL-M = StarCoder 2 preference judgment。
Q2: Industry-leading 7B-70B + Llama 2 base value は？ A: Industry-leading 7B-70B + Llama 2 (Industry-leading 7B + 13B + 34B + 70B 4-tier variants + Industry-leading Llama 2 base fine-tuned for code + Industry-leading widest size range + Industry-leading CodeLlama 4-tier signature)。
Q3: Industry-leading 100K context + 3 variants value は？ A: Industry-leading 100K + 3 variants (Industry-leading 16K tokens base + 100K extended context support + Industry-leading Code Llama base + Python-specialized + Instruct-tuned 3 variants + Industry-leading CodeLlama 100K + 3 variants signature)。
まとめ
CodeLlama = 2023年Meta AI発表のMeta code generation LLM。Industry-leading 7B + 13B + 34B + 70B 4-tier variants + Industry-leading Llama 2 base fine-tuned for code + Industry-leading 16K tokens base + 100K extended context + Industry-leading Code Llama base + Python-specialized + Instruct-tuned 3 variants + Industry-leading HumanEval pass@1 67.8% Code Llama 70B Instruct + Industry-leading Llama Community License commercial use up to 700M MAU + Industry-leading Meta AI FAIR + GenAI team + Industry-leading codellama/CodeLlama-70b-Instruct-hf HuggingFace + Industry-leading Meta CodeLlama 70B code generation 2023 position確立。