NVIDIA H100 Confidential Compute (GPU TEE・2023年)(エヌビディアエイチワンハンドレッドコンフィデンシャル)
2023年Q4 NVIDIA発表のH100 Confidential Compute (CC) ・NVIDIA H100 Hopper GPU (2022年発売) のGPU レベルConfidential Computing機能・Intel TDX / AMD SEV-SNP / Arm CCA RealmのCPU TEE と組合せでLLM training/inference workloadがGPU Memory level (80GB HBM3) でも暗号化保護 + Attestation検証可能・GPU内Encrypted Memory + Encrypted GPU-to-CPU PCIe接続 + Hardware Attestation report + NVIDIA Attestation Service (NRAS) 連携・Microsoft Azure / Google Cloud / Oracle Cloud / AWS / NVIDIA DGX Cloud Preview/GA・LLM Model IP保護 + Training data Confidentiality確保のFrontier AI Confidential Computing基盤。
概要
NVIDIA H100 Confidential Compute (CC) は、2023年Q4にNVIDIA発表のNVIDIA H100 Hopper GPU (2022年発売・Data Center AI GPU Flagship・80GB HBM3 + 989 TFLOPS FP8・$25k-$40k/GPU) のGPU レベルConfidential Computing機能。Intel TDX (2023年・Sapphire Rapids) / AMD SEV-SNP (2020年・Milan以降) / Arm CCA Realm (2023年・Cobalt 100以降) のCPU TEE と組合せでLarge Language Model (LLM) training / inference workloadがGPU Memory level (80GB HBM3) でも暗号化保護 + Attestation検証可能になる Industry-first GPU TEE。GPU内Encrypted Memory (HBM3 80GB全暗号化・AES-256-GCM) + Encrypted GPU-to-CPU PCIe 5.0 x16通信 (PCIe Link Encryption) + Hardware Attestation report (NVIDIA Hopper Attestation document・workload identity + GPU state verification) + NVIDIA Attestation Service (NRAS・NVIDIA Cloud Attestation Service) 連携 + Hopper Confidential Compute Library・Microsoft Azure (DCasv5/ECasv5 + H100 Confidential VM・2024年Q2 Preview) / Google Cloud (A3 VM + H100 Confidential・2024年Q2 Preview) / Oracle Cloud (BM.GPU.H100 Confidential・2024年Q3 Preview) / AWS (p5d.24xlarge + Confidential variant・2024年Q4 Beta) / NVIDIA DGX Cloud (DGX Cloud Confidential mode・2024年Q3 Preview) 全主要Hyperscaler Preview/GA展開。LLM Model IP保護 (Customer trained model weights confidentialty) + Training data Confidentiality (Customer training data not exposed to Cloud Provider) 確保のFrontier AI Confidential Computing基盤として Healthcare LLM / Finance LLM / Pharmaceutical LLM 等のCustomer LLM Use case 拡大の中核technology。
主な特徴・仕組み
- GPU Memory Encryption: HBM3 80GB全暗号化 (AES-256-GCM Hardware-accelerated) ・Performance overhead約2-5%
- PCIe Link Encryption: GPU-to-CPU PCIe 5.0 x16通信暗号化 (PCIe Link Encryption・AES-GCM)
- Hardware Attestation: NVIDIA Hopper Attestation document (PEM/COSE format) ・workload identity + GPU state + Driver version + Firmware version verification
- NRAS (NVIDIA Attestation Service): NVIDIA Cloud Attestation Service・Hopper Attestation document verification + signed token issue
- Hopper Confidential Compute Library: CUDA + Confidential Compute API・既存CUDA application最小Code modification で Confidential mode起動
- CPU TEE組合せ必須: Intel TDX / AMD SEV-SNP / Arm CCA Realm のCPU TEE で起動した VM内でのみH100 CC利用可能
- Performance Overhead: GPU Memory encryption約2-5% performance impact (LLM training/inference workloadほぼ実用速度)
- Use Cases: LLM training Customer data confidential / LLM inference Model IP protection / Pharmaceutical AI research / Healthcare AI
- Cloud Provider Adoption: Azure (Preview 2024 Q2) / GCP (Preview 2024 Q2) / Oracle (Preview 2024 Q3) / AWS (Beta 2024 Q4) / NVIDIA DGX Cloud (Preview 2024 Q3)
- Pricing: 標準H100 instance + 5-15% Confidential premium (Hyperscaler によって異なる)
スペック比較表
| GPU TEE | Vendor | GPU | Memory Encryption | PCIe Encryption | Year |
|---|---|---|---|---|---|
| H100 Confidential Compute | NVIDIA | H100 (Hopper) | ◎ HBM3 80GB AES-256-GCM | ○ PCIe 5.0 Link Encryption | 2023 Q4 |
| H200 Confidential Compute | NVIDIA | H200 | ◎ HBM3e 141GB | ○ | 2024 Q3 (発表 2024 Q1) |
| B200 Confidential Compute (予定) | NVIDIA | B200 (Blackwell) | ◎ HBM3e 192GB | ○ NVLink 5 + PCIe 5 | 2025 Q1予定 |
| AMD MI300X CC (予定) | AMD | MI300X | △ 192GB HBM3 (CC未確定) | △ | 2025 Q2-Q3予定 |
| Intel Gaudi 3 CC (予定) | Intel | Gaudi 3 | △ 128GB HBM2e | △ | 2025 Q3-Q4予定 |
具体例・対応製品
- Azure NC H100 v5 Confidential (Preview): H100 80GB SXM5 + DCasv5 (AMD SEV-SNP)・$5-$10/hour
- GCP A3 + H100 Confidential (Preview): H100 80GB SXM5 + C3 (Intel TDX Beta)・$4-$8/hour
- Oracle Cloud BM.GPU.H100 Confidential (Preview): H100 80GB SXM5 + Standard.E5.Dense (AMD Genoa)・$4.5-$8.5/hour
- NVIDIA DGX Cloud Confidential (Preview): H100 SuperPOD + Confidential mode・$30k-$50k/month
- AWS p5d Confidential (Beta): H100 80GB SXM5 + Custom AMD instance・$5-$10/hour (Beta pricing)
自作PCでの選び方・注意点
NVIDIA H100 Confidential Compute は「LLM Customer Confidential Training (Customer training data not exposed to Cloud Provider)」「LLM Model IP保護 (Customer trained model weights Confidential)」「Healthcare / Finance / Pharmaceutical Frontier AI workload (PHI / PII Confidentiality strict要件)」用途のEnterprise tier GPU Confidential Computing technology。Consumer / 自作PC範囲外・H100 GPU $25k-$40k/枚 + Confidential mode利用に Hyperscaler Cloud (Azure / GCP / Oracle / AWS / NVIDIA DGX Cloud) instance subscription必要 + Premium pricing ($5-$10/hour for H100 80GB instance)。Mayo Clinic / Johns Hopkins (Healthcare LLM Confidential training)・Goldman Sachs (Finance Trading LLM Model IP保護)・Pfizer / Novartis (Pharmaceutical Drug Discovery LLM Confidential research) 等のTier-1 Enterprise customer初期deployment実績で 2025-2027年でTier-2 Enterprise (Bank / Insurance / Hospital / Pharma 中堅) に拡大予想。Performance overhead約2-5%は LLM training/inference workloadほぼ実用速度・CPU TEE (Intel TDX / AMD SEV-SNP / Arm CCA) 組合せ必須・Cloud Provider選択時はCPU TEE technology + H100 CC compatibility確認必要。NVIDIA Blackwell B200 (2025年Q1予定) でも Confidential Compute継承予定・将来GB200 NVL72 Confidential Computing も 2025-2026年で実現予想・Frontier AI Confidential Computing基盤 として継続成長分野。
関連用語との違い
- vs Intel TDX (CPU TEE): H100 CCはGPU Memory + PCIe encryption・TDXはCPU Memory + VM isolation・組合せ必須 (GPU + CPU両方Confidential)
- vs AMD SEV-SNP: 同じく組合せCPU TEE・SEV-SNPは AMD Milan以降・H100 CC + SEV-SNP がAzure DCasv5 + H100の構成
- vs H200 / B200 Confidential Compute: H100 CCは2023 Q4初期・H200は2024 Q3後継 (141GB HBM3e)・B200は2025 Q1予定 (Blackwell)
よくある質問(FAQ)
Q1: H100 CC のPerformance overheadは実用的? A: HBM3 Memory encryption (AES-256-GCM Hardware-accelerated) overhead約2-5%・PCIe Link Encryption overhead約3-7%・total約5-12% performance impact・LLM training (大規模workload・週単位 training run) では実用許容範囲内・Inference (low-latency要件) では careful evaluation必要。
Q2: H100 CC利用にどのCPU TEE組合せ必要? A: 必須CPU TEE: Intel TDX (Sapphire Rapids以降) / AMD SEV-SNP (Milan以降) / Arm CCA Realm (Armv9 Realm対応CPU)。 Azure DCasv5 (AMD SEV-SNP) + H100 が現在最 Production成熟・GCP C3 (Intel TDX Beta) + H100は2024 Q4 Beta段階。
Q3: NRAS (NVIDIA Attestation Service) とは? A: NVIDIA Cloud Attestation Service・Hopper Attestation document (workload identity + GPU state + Driver/Firmware version) verification + signed JWT-format Attestation token issue。Customer side workload (CPU TEE内run) からNRASに Attestation request → NRAS verify + signed token return → Customer use this token as evidence for Compliance audit / Customer trust evidence。
まとめ
NVIDIA H100 Confidential Compute = 2023年Q4 NVIDIA発表のGPU TEE。H100 Hopper GPU Memory level encryption (HBM3 80GB AES-256-GCM) + Encrypted PCIe 5.0 + Hardware Attestation + NRAS連携・Intel TDX/AMD SEV-SNP/Arm CCA Realm CPU TEE組合せ必須・LLM Customer Confidential Training + Model IP保護のFrontier AI Confidential Computing基盤・Azure/GCP/Oracle/AWS/NVIDIA DGX Cloud全Hyperscaler Preview/GA展開。