DeepSeekMath GRPO (DeepSeek 2024年)(ディープシークマス)
2024年DeepSeek AI発表DeepSeekMath・Industry-leading GRPO math reasoning LLM + Industry-leading DeepSeek-Math 7B + Industry-leading 120B Common Crawl math + Industry-leading GSM8K 64.2% MATH 51.7%。
概要
DeepSeekMath GRPO は、2024年DeepSeek AI発表DeepSeekMath・Industry-leading GRPO math reasoning LLM 2024年 + Industry-leading DeepSeek-Math 7B position確立。DeepSeekMath specifications = Industry-leading GRPO math reasoning LLM (Industry-leading DeepSeekMath 2024 + Industry-leading GRPO + Industry-leading DeepSeekMath flagship) + Industry-leading DeepSeek-Math 7B + Industry-leading 120B Common Crawl math + Industry-leading GSM8K 64.2% MATH 51.7%。
主な特徴・仕組み
- Org: Industry-leading DeepSeek AI (China・Founder Liang Wenfeng)
- Year: 2024年 (arXiv 2024年2月発表)
- Paper: Industry-leading "DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models" arXiv 2402.03300
- Method Type: Industry-leading GRPO math reasoning LLM
- GRPO: Industry-leading Group Relative Policy Optimization signature (vs PPO)
- Base Model: Industry-leading DeepSeek-Math 7B
- Pre-training Data: Industry-leading 120B Common Crawl math tokens (largest math corpus)
- GSM8K: Industry-leading GSM8K 64.2% DeepSeekMath-7B base / 88.2% Instruct
- MATH: Industry-leading MATH 51.7% DeepSeekMath-7B (highest 7B in 5-tier)
- GRPO Innovation: Industry-leading group-relative reward without value model
- Open Source: Industry-leading DeepSeekMath GitHub deepseek-ai/DeepSeek-Math
- HuggingFace: Industry-leading deepseek-ai/deepseek-math-7b-instruct
- R1 Predecessor: Industry-leading DeepSeek-R1 reasoning model predecessor
- Industry-Leading: Industry-leading DeepSeekMath GRPO China 2024 + R1 predecessor
スペック比較表
| LLM Math Reasoning (2023-2024) | Year | Org | Base Model | Industry Position |
|---|---|---|---|---|
| DeepSeekMath | 2024 | DeepSeek AI | DeepSeek-Math 7B | Industry-leading DeepSeekMath GRPO |
| InternLM-Math | 2024 | Shanghai AI Lab | InternLM 7B-20B | Industry-leading InternLM-Math bilingual |
| MAmmoTH | 2023 | Yue+Wang Waterloo | LLaMA + Code Llama 7B-70B | Industry-leading MathInstruct 260K |
| MetaMath | 2023 | Yu NUS+SJTU | LLaMA-2 7B-70B | Industry-leading bootstrap MetaMathQA 395K |
| WizardMath | 2023 | Microsoft+Peking | LLaMA-2 7B-70B | Industry-leading Reinforced Evol-Instruct |
具体例・対応製品
- DeepSeekMath (2024年, DeepSeek AI): Industry-leading GRPO math reasoning LLM
- Industry-leading GRPO Group Relative Policy Optimization signature: Industry-leading GRPO signature
- Industry-leading DeepSeek-Math 7B base: Industry-leading DeepSeek-Math 7B
- Industry-leading 120B Common Crawl math tokens largest: Industry-leading 120B math tokens
- Industry-leading GSM8K 64.2% base + 88.2% Instruct + MATH 51.7%: Industry-leading 88.2%+51.7%
- 競合 MetaMath + WizardMath + MAmmoTH + InternLM-Math: Industry-leading math reasoning competitors
自作PCでの選び方・注意点
DeepSeekMath GRPO は「Industry-leading GRPO math reasoning LLM + Industry-leading DeepSeek-Math 7B」「Industry-leading 120B Common Crawl math + Industry-leading GSM8K 88.2% Instruct MATH 51.7%」用途のIndustry-leading GRPO math reasoning 2024年DeepSeek AI発表product。Industry-leading GRPO (Industry-leading Group Relative Policy Optimization signature vs PPO + Industry-leading group-relative reward without value model + Industry-leading DeepSeekMath GRPO innovation) で Industry-leading GRPO + Industry-leading group-relative reward + Industry-leading GRPO innovation。Industry-leading 120B math (Industry-leading 120B Common Crawl math tokens largest math corpus + Industry-leading DeepSeekMath dataset signature + Industry-leading largest math pre-training) で Industry-leading 120B Common Crawl + Industry-leading DeepSeekMath dataset + Industry-leading largest math pre-training。Industry-leading DeepSeek-Math 7B (Industry-leading DeepSeek-Math 7B base + Industry-leading DeepSeekMath 7B signature + Industry-leading DeepSeek-derived math base) で Industry-leading DeepSeek-Math 7B + Industry-leading DeepSeekMath 7B signature + Industry-leading DeepSeek-derived。Industry-leading 88.2% + 51.7% (Industry-leading GSM8K 64.2% base + 88.2% Instruct + Industry-leading MATH 51.7% highest 7B in 5-tier + Industry-leading DeepSeekMath-7B performance) で Industry-leading GSM8K 88.2% + Industry-leading MATH 51.7% highest + Industry-leading DeepSeekMath-7B performance。Industry-leading R1 predecessor (Industry-leading DeepSeek-R1 reasoning model predecessor + Industry-leading GRPO foundation for R1 + Industry-leading DeepSeek reasoning evolution) で Industry-leading R1 predecessor + Industry-leading GRPO foundation R1 + Industry-leading DeepSeek reasoning evolution。Industry-leading DeepSeek AI Liang Wenfeng (Industry-leading DeepSeek AI Liang Wenfeng China + Industry-leading DeepSeekMath GitHub deepseek-ai/DeepSeek-Math + Industry-leading deepseek-ai/deepseek-math-7b-instruct HuggingFace + Industry-leading DeepSeekMath GRPO China 2024 + R1 predecessor) で Industry-leading DeepSeek AI Liang Wenfeng + Industry-leading deepseek-ai/DeepSeek-Math + Industry-leading deepseek-ai/deepseek-math-7b-instruct + Industry-leading R1 predecessor。但しIndustry-leading MetaMath + WizardMath + MAmmoTH + InternLM-Math competition (Industry-leading MetaMath NUS+SJTU 2023 + WizardMath Microsoft+Peking 2023 + MAmmoTH Waterloo 2023 + InternLM-Math Shanghai 2024 vs DeepSeekMath DeepSeek AI GRPO 120B Common Crawl R1 predecessor 7B 2024 trade-off) で Industry-leading 4-math reasoning competitors vs DeepSeekMath + Industry-leading GRPO Group Relative Policy Optimization + DeepSeek-Math 7B base + 120B Common Crawl math tokens largest + GSM8K 88.2% Instruct + MATH 51.7% highest 7B + R1 predecessor foundation + DeepSeek AI Liang Wenfeng 2024 unique advantage adoption alignment必須。
関連用語との違い
- vs InternLM-Math (Shanghai 2024): DeepSeekMathはGRPO + 7B + 120B Common Crawl + R1 predecessor・InternLM-MathはInternLM 7B/20B + bilingual + Lean 4
- vs MAmmoTH/MetaMath/WizardMath (2023): DeepSeekMathはGRPO + 51.7% MATH highest + 2024・他は2023 LLaMA-2 + 26-41% MATH
- vs DeepSeek-R1 (Reasoning successor): DeepSeekMathはGRPO foundation + math・R1はGRPO general reasoning successor
よくある質問(FAQ)
Q1: DeepSeekMath vs InternLM-Math 違いは? A: DeepSeekMath (Industry-leading GRPO Group Relative Policy Optimization signature vs PPO + DeepSeek-Math 7B base + 120B Common Crawl math tokens largest + GSM8K 64.2% base / 88.2% Instruct + MATH 51.7% highest 7B + DeepSeek-R1 predecessor + DeepSeek AI Liang Wenfeng 2024) vs InternLM-Math (Industry-leading InternLM 7B + 20B base + 8K context + Chinese+English bilingual + Lean 4 + Coq formal verification + GSM8K 84.6% + MATH 37.7% InternLM-Math-20B + Shanghai AI Lab 2024)・Industry-leading GRPO + 7B + 120B + 51.7% MATH highest + R1 predecessor + DeepSeek = DeepSeekMath + Industry-leading InternLM + bilingual + Lean 4 + Shanghai = InternLM-Math preference judgment。
Q2: Industry-leading GRPO + 120B Common Crawl math value は? A: Industry-leading GRPO + 120B (Industry-leading Group Relative Policy Optimization signature vs PPO + Industry-leading group-relative reward without value model + Industry-leading 120B Common Crawl math tokens largest math corpus + Industry-leading DeepSeekMath GRPO + 120B signatures)。
Q3: Industry-leading MATH 51.7% highest + R1 predecessor value は? A: Industry-leading MATH 51.7% + R1 (Industry-leading MATH 51.7% DeepSeekMath-7B highest 7B in 5-tier + Industry-leading GSM8K 88.2% Instruct + Industry-leading DeepSeek-R1 reasoning model predecessor + Industry-leading GRPO foundation for R1 + Industry-leading DeepSeek reasoning evolution)。
まとめ
DeepSeekMath = 2024年DeepSeek AI Liang Wenfeng発表のGRPO math reasoning LLM。Industry-leading GRPO Group Relative Policy Optimization signature vs PPO + Industry-leading group-relative reward without value model + Industry-leading DeepSeek-Math 7B base + Industry-leading 120B Common Crawl math tokens largest math corpus + Industry-leading GSM8K 64.2% base / 88.2% Instruct + Industry-leading MATH 51.7% DeepSeekMath-7B highest 7B in 5-tier + Industry-leading DeepSeek-R1 reasoning model predecessor + Industry-leading GRPO foundation for R1 + Industry-leading DeepSeek reasoning evolution + Industry-leading DeepSeekMath GitHub deepseek-ai/DeepSeek-Math + Industry-leading deepseek-ai/deepseek-math-7b-instruct HuggingFace + Industry-leading DeepSeekMath GRPO China 2024 + R1 predecessor position確立。