GPU Custom Kernel。NVIDIA CUTLASS 3.6 (CUDA Templates・GEMM)・cuDNN 9.x (Deep Neural Network)・cuBLAS・Liger Kernel (LinkedIn・Triton)・FlashInfer (高速Inference Kernel)・FlashAttention v3 (Hopper)・FlashDecoding++ (KV Cache 8x)・xFormers Memory Efficient Attention・SageAttention (Smooth+Sparse)・Marlin (4-bit GPTQ Kernel)・¥0 OSS、2026年FlashAttn 4+SageAttn普及。