Whisper Large v3 (OpenAI 2023年)(ウィスパーラージブイスリー)
2023年OpenAI発表Whisper Large v3・Industry-leading multilingual speech recognition ASR + Industry-leading 1550M parameters + Industry-leading 100+ languages + Industry-leading OpenAI open-source ASR flagship。
概要
Whisper Large v3 は、2023年OpenAI発表Whisper Large v3・Industry-leading multilingual speech recognition ASR 2023年 + Industry-leading OpenAI open-source ASR flagship position確立。Whisper Large v3 specifications = Industry-leading multilingual speech recognition ASR (Industry-leading Whisper Large v3 OpenAI 2023 + Industry-leading multilingual ASR + Industry-leading OpenAI flagship) + Industry-leading 1550M parameters + Industry-leading 100+ languages + Industry-leading OpenAI open-source ASR flagship。
主な特徴・仕組み
- Org: Industry-leading OpenAI (Founded 2015 San Francisco Sam Altman + Greg Brockman + Ilya Sutskever)
- Model: Industry-leading Whisper Large v3 ASR flagship 2023
- Year: 2023年 (Whisper v3 release 2023年11月 DevDay)
- Method Type: Industry-leading multilingual speech recognition ASR
- Parameters: Industry-leading 1550M parameters Large v3
- Languages: Industry-leading 100+ languages multilingual ASR
- Architecture: Industry-leading Transformer encoder-decoder ASR
- Training Data: Industry-leading 5M hours weakly supervised + 4M hours pseudo-labeled
- Mel Spectrogram: Industry-leading 128-channel Mel spectrogram input (vs v2 80-channel)
- Open Source: Industry-leading MIT License open-source release
- Multilingual: Industry-leading 100+ languages translation + transcription
- Industry Adoption: Industry-leading widespread ASR replacement Google STT + Azure Speech
- Industry-Leading: Industry-leading OpenAI open-source multilingual ASR flagship 2023
スペック比較表
| LLM Audio-Speech (2023-2024) | Year | Org | Method | Industry Position |
|---|---|---|---|---|
| Whisper Large v3 | 2023 | OpenAI | Multilingual ASR | Industry-leading OpenAI ASR |
| SeamlessM4T | 2023 | Meta | Multimodal speech-text | Industry-leading Meta multimodal |
| VALL-E 2 | 2024 | Microsoft | Zero-shot TTS | Industry-leading Microsoft TTS |
| AudioPaLM | 2023 | PaLM + speech tokens | Industry-leading Google audio LLM | |
| Qwen2-Audio | 2024 | Alibaba | Voice chat + analysis | Industry-leading Alibaba audio |
具体例・対応製品
- Whisper Large v3 (2023年, OpenAI): Industry-leading OpenAI open-source ASR flagship
- Industry-leading 1550M parameters Large v3: Industry-leading 1550M parameters
- Industry-leading 100+ languages multilingual: Industry-leading 100+ languages
- Industry-leading 128-channel Mel spectrogram input: Industry-leading 128-channel Mel
- Industry-leading 5M hours weakly supervised training: Industry-leading 5M hours training
- 競合 SeamlessM4T + VALL-E 2 + AudioPaLM + Qwen2-Audio: Industry-leading audio-speech competitors
選び方・注意点
Whisper Large v3 は「Industry-leading multilingual ASR + 1550M parameters」「Industry-leading 100+ languages + OpenAI open-source」用途のIndustry-leading 2023年 OpenAI product。Industry-leading multilingual ASR (Industry-leading multilingual speech recognition ASR + Industry-leading Whisper multilingual signature + Industry-leading 100+ languages ASR) で Industry-leading multilingual ASR + Industry-leading Whisper + Industry-leading 100+ languages。Industry-leading 1550M parameters (Industry-leading 1550M parameters Large v3 + Industry-leading Whisper Large v3 signature + Industry-leading large-scale ASR model) で Industry-leading 1550M parameters + Industry-leading Whisper Large v3 + Industry-leading large-scale ASR。Industry-leading 128-channel Mel (Industry-leading 128-channel Mel spectrogram input vs v2 80-channel + Industry-leading Whisper v3 128-channel signature + Industry-leading improved spectrogram resolution) で Industry-leading 128-channel Mel + Industry-leading Whisper v3 + Industry-leading improved resolution。Industry-leading 5M hours training (Industry-leading 5M hours weakly supervised + 4M hours pseudo-labeled training + Industry-leading Whisper training scale signature + Industry-leading massive dataset) で Industry-leading 5M+4M hours + Industry-leading Whisper training + Industry-leading massive dataset。Industry-leading MIT License (Industry-leading MIT License open-source release + Industry-leading widespread ASR replacement Google STT + Azure Speech + Industry-leading OpenAI 2015 San Francisco Sam Altman + Greg Brockman + Ilya Sutskever + Industry-leading 2023年11月 DevDay release) で Industry-leading MIT License + Industry-leading widespread ASR replacement + Industry-leading OpenAI 2015 + Industry-leading Altman+Brockman+Sutskever + Industry-leading 2023年11月 DevDay。但しIndustry-leading SeamlessM4T + VALL-E 2 + AudioPaLM + Qwen2-Audio competition で Industry-leading 4-audio-speech competitors vs Whisper Large v3 + Industry-leading multilingual speech recognition ASR + 1550M parameters + 100+ languages + Transformer encoder-decoder + 5M hours weakly supervised + 4M hours pseudo-labeled + 128-channel Mel spectrogram + MIT License open-source + widespread ASR replacement Google STT + Azure Speech + OpenAI 2015 San Francisco 2023年11月 DevDay unique advantage adoption alignment必須。
関連用語との違い
- vs SeamlessM4T (Meta 2023): Whisper Large v3はASR-only OpenAI 1550M・SeamlessM4Tはmultimodal speech-text Meta + translation
- vs VALL-E 2 (Microsoft 2024): Whisper Large v3はASR (speech→text)・VALL-E 2はTTS (text→speech) Microsoft 2024
- vs AudioPaLM (Google 2023): Whisper Large v3はASR specialist OpenAI・AudioPaLMはPaLM + speech tokens Google audio LLM
よくある質問(FAQ)
Q1: Whisper Large v3 vs SeamlessM4T 違いは? A: Whisper Large v3 (Industry-leading multilingual speech recognition ASR + 1550M parameters + 100+ languages + Transformer encoder-decoder + 5M hours weakly supervised + 4M hours pseudo-labeled + 128-channel Mel + MIT License + OpenAI 2015 + 2023年11月 DevDay) vs SeamlessM4T (Industry-leading multimodal speech-text + Meta + translation + 100+ languages + Meta AI 2023)・Industry-leading multilingual ASR-only + 1550M + 100+ languages + Transformer + 5M+4M hours + 128-channel Mel + MIT + OpenAI + 2023年11月 = Whisper Large v3 + Industry-leading multimodal speech-text + Meta + translation + 100+ languages + 2023 = SeamlessM4T preference judgment (ASR-only vs multimodal differ)。
Q2: Industry-leading 1550M + 100+ languages value は? A: Industry-leading 1550M + 100+ languages (Industry-leading 1550M parameters Large v3 + Industry-leading 100+ languages multilingual ASR + Industry-leading Whisper Large v3 dual signature)。
Q3: Industry-leading 128-channel Mel + MIT License value は? A: Industry-leading 128-channel Mel + MIT (Industry-leading 128-channel Mel spectrogram input vs v2 80-channel + Industry-leading MIT License open-source release + Industry-leading Whisper Large v3 improved + open dual signature)。
まとめ
Whisper Large v3 = 2023年OpenAI発表のmultilingual speech recognition ASR flagship。Industry-leading multilingual speech recognition ASR + Industry-leading 1550M parameters Large v3 + Industry-leading 100+ languages multilingual + Industry-leading Transformer encoder-decoder ASR + Industry-leading 5M hours weakly supervised + 4M hours pseudo-labeled training + Industry-leading 128-channel Mel spectrogram input + Industry-leading MIT License open-source release + Industry-leading widespread ASR replacement Google STT + Azure Speech + Industry-leading OpenAI 2015 San Francisco Sam Altman + Greg Brockman + Ilya Sutskever + Industry-leading 2023年11月 DevDay release + Industry-leading OpenAI open-source multilingual ASR flagship 2023 position確立。