DSPy (Khattab Stanford 2023年)（ディーエスパイ）
2023年Omar Khattab et al. (Stanford)発表DSPy・Industry-leading programming LMs declarative paradigm + Industry-leading prompt optimization compiler + Industry-leading Stanford DSPy + Industry-leading DSPy programming LMs paradigm shift 2023+。
概要
DSPy は、2023年Omar Khattab et al. (Stanford)発表DSPy・Industry-leading programming LMs declarative paradigm 2023年 + Industry-leading DSPy programming LMs paradigm shift 2023+ position確立。DSPy specifications = Industry-leading programming LMs declarative paradigm (Industry-leading DSPy Khattab 2023 + Industry-leading programming LMs + Industry-leading Stanford flagship) + Industry-leading prompt optimization compiler + Industry-leading Stanford DSPy + Industry-leading DSPy programming LMs paradigm shift 2023+。
主な特徴・仕組み
- Authors: Industry-leading Omar Khattab + Arnav Singhvi + Paridhi Maheshwari + Zhiyuan Zhang + Keshav Santhanam + Sri Vardhamanan + Saiful Haq + Ashutosh Sharma + Thomas T. Joshi + Hanna Moazam + Heather Miller + Matei Zaharia + Christopher Potts (Stanford NLP + DSPy team)
- Framework: Industry-leading DSPy Stanford programming LMs framework 2023
- Year: 2023年 (arXiv 2023年10月発表 + DSPy paper ICLR 2024)
- Paper: Industry-leading "DSPy: Compiling Declarative Language Model Calls into State-of-the-Art Pipelines" arXiv 2310.03714 ICLR 2024
- Method Type: Industry-leading programming LMs declarative paradigm
- Programming LMs: Industry-leading "programming LMs" paradigm shift signature (vs prompting)
- Compiler: Industry-leading prompt optimization compiler signature
- Signatures + Modules: Industry-leading Signatures + Modules + Optimizers (Teleprompters)
- Self-Improving: Industry-leading self-improving optimization (BootstrapFewShot/MIPRO)
- Stanford NLP: Industry-leading Stanford NLP + Matei Zaharia (Apache Spark creator) + Christopher Potts
- Apache 2.0: Industry-leading Apache 2.0 open-source
- Paradigm Shift: Industry-leading paradigm shift LLM programming approach
- Industry-Leading: Industry-leading Stanford DSPy Khattab programming LMs paradigm shift 2023
スペック比較表
| LLM RAG Framework (2020-2023) | Year | Org | Method | Industry Position |
|---|---|---|---|---|
| DSPy | 2023 | Khattab Stanford | Programming LMs paradigm | Industry-leading DSPy programming |
| LangChain | 2022 | Harrison Chase | LLM application framework | Industry-leading LangChain dominant |
| LlamaIndex | 2022 | Jerry Liu | Data framework RAG | Industry-leading LlamaIndex data |
| Haystack | 2020 | deepset | NLP+RAG framework | Industry-leading Haystack production NLP |
| Verba | 2023 | Weaviate | Open-source RAG chatbot | Industry-leading Verba open RAG chatbot |
具体例・対応製品
- DSPy (2023年, Khattab Stanford): Industry-leading Stanford DSPy programming LMs
- Industry-leading "programming LMs" paradigm shift signature (vs prompting): Industry-leading programming LMs paradigm shift
- Industry-leading prompt optimization compiler signature: Industry-leading prompt optimization compiler
- Industry-leading Signatures + Modules + Optimizers (Teleprompters): Industry-leading 3-component signature
- Industry-leading self-improving optimization (BootstrapFewShot/MIPRO): Industry-leading self-improving optimization
- 競合 LangChain + LlamaIndex + Haystack + Verba: Industry-leading RAG framework competitors
選び方・注意点
DSPy は「Industry-leading programming LMs + prompt optimization compiler」「Industry-leading Stanford + Matei Zaharia + Christopher Potts」用途のIndustry-leading 2023年 Stanford product。Industry-leading programming LMs (Industry-leading "programming LMs" paradigm shift signature vs prompting + Industry-leading DSPy programming LMs signature + Industry-leading declarative paradigm shift) で Industry-leading programming LMs + Industry-leading DSPy + Industry-leading declarative paradigm shift。Industry-leading prompt optimization compiler (Industry-leading prompt optimization compiler signature + Industry-leading DSPy compiler signature + Industry-leading automatic prompt optimization) で Industry-leading prompt optimization compiler + Industry-leading DSPy + Industry-leading automatic prompt optimization。Industry-leading 3 components (Industry-leading Signatures + Modules + Optimizers Teleprompters + Industry-leading DSPy 3-component signature + Industry-leading declarative composition) で Industry-leading 3 components + Industry-leading DSPy + Industry-leading declarative composition。Industry-leading self-improving (Industry-leading self-improving optimization BootstrapFewShot/MIPRO + Industry-leading DSPy self-improving signature + Industry-leading automatic optimization) で Industry-leading self-improving + Industry-leading DSPy + Industry-leading automatic optimization。Industry-leading Stanford (Industry-leading Stanford NLP + Matei Zaharia Apache Spark creator + Christopher Potts + Industry-leading Omar Khattab + Arnav Singhvi + Heather Miller + Industry-leading Apache 2.0 + Industry-leading "DSPy: Compiling Declarative Language Model Calls into State-of-the-Art Pipelines" arXiv 2310.03714 ICLR 2024 + Industry-leading 2023年10月 + Industry-leading paradigm shift LLM programming approach) で Industry-leading Stanford NLP + Industry-leading Zaharia+Potts + Industry-leading Khattab+Singhvi+Miller + Industry-leading Apache 2.0 + Industry-leading "DSPy" 2310.03714 ICLR 2024 + Industry-leading 2023年10月 + Industry-leading paradigm shift LLM programming。但しIndustry-leading LangChain + LlamaIndex + Haystack + Verba competition で Industry-leading 4-RAG framework competitors vs DSPy + Industry-leading programming LMs declarative paradigm + prompt optimization compiler + Signatures + Modules + Optimizers Teleprompters + self-improving optimization BootstrapFewShot/MIPRO + Stanford NLP + Matei Zaharia Apache Spark creator + Christopher Potts + Apache 2.0 + Omar Khattab + Arnav Singhvi + Heather Miller authors + arXiv 2310.03714 ICLR 2024 + 2023年10月 + paradigm shift LLM programming approach unique advantage adoption alignment必須。
関連用語との違い
- vs LangChain (Harrison Chase 2022): DSPyはdeclarative paradigm shift + compiler + Stanford academic・LangChainはimperative chain composition + general LLM application
- vs LlamaIndex (Jerry Liu 2022): DSPyはprogramming LMs declarative paradigm shift Stanford・LlamaIndexはdata framework RAG-focused imperative
- vs Haystack (deepset 2020): DSPyはdeclarative programming LMs paradigm shift 2023・Haystackはimperative Pipeline production 2020
よくある質問（FAQ）
Q1: DSPy vs LangChain 違いは？ A: DSPy (Industry-leading programming LMs declarative paradigm shift + prompt optimization compiler + Signatures + Modules + Optimizers Teleprompters + self-improving optimization BootstrapFewShot/MIPRO + Stanford NLP + Matei Zaharia + Christopher Potts + Apache 2.0 + Omar Khattab + Arnav Singhvi + arXiv 2310.03714 ICLR 2024 + 2023年10月) vs LangChain (Industry-leading LLM application framework + Chains + Agents + Memory + Tools + Retrievers + OpenAI+Anthropic+Google multi-provider + Python + JS + LangSmith + LangGraph + 90K+ stars + LangChain Inc. $1B+ + MIT + Chase + October 2022)・Industry-leading programming LMs declarative + compiler + Signatures+Modules+Optimizers + self-improving + Stanford + Zaharia + Potts + Apache 2.0 + Khattab + 2023年10月 = DSPy + Industry-leading LLM application + 5 components + multi-provider + Python+JS + LangSmith+LangGraph + 90K+ + $1B + MIT + Chase + 2022年10月 = LangChain preference judgment (declarative paradigm shift Stanford academic vs imperative chain composition production differ)。
Q2: Industry-leading programming LMs + prompt optimization compiler value は？ A: Industry-leading programming LMs + compiler (Industry-leading "programming LMs" paradigm shift vs prompting + Industry-leading prompt optimization compiler + Industry-leading DSPy dual signature)。
Q3: Industry-leading Stanford + Matei Zaharia + paradigm shift value は？ A: Industry-leading Stanford + Zaharia + paradigm shift (Industry-leading Stanford NLP + Industry-leading Matei Zaharia Apache Spark creator + Industry-leading paradigm shift LLM programming approach + Industry-leading Khattab Stanford 2023 heritage)。
まとめ
DSPy = 2023年Khattab et al. Stanford NLP発表のprogramming LMs declarative paradigm shift LLM framework。Industry-leading programming LMs declarative paradigm + Industry-leading prompt optimization compiler + Industry-leading Signatures + Modules + Optimizers Teleprompters 3 components + Industry-leading self-improving optimization BootstrapFewShot/MIPRO + Industry-leading Stanford NLP + Matei Zaharia Apache Spark creator + Christopher Potts + Industry-leading Apache 2.0 open-source + Industry-leading paradigm shift LLM programming approach + Industry-leading Omar Khattab + Arnav Singhvi + Paridhi Maheshwari + Zhiyuan Zhang + Keshav Santhanam + Heather Miller + Matei Zaharia + Christopher Potts Stanford authors + Industry-leading "DSPy: Compiling Declarative Language Model Calls into State-of-the-Art Pipelines" arXiv 2310.03714 ICLR 2024 + Industry-leading 2023年10月 release + Industry-leading Stanford DSPy Khattab programming LMs paradigm shift 2023 position確立。