Microsoft has launched the new ND H100v5 virtual machine series, equipped with 8 NVIDIA H100 chips. The virtual machines feature AI supercomputing GPUs, next-generation CPUs, and low-latency networking. When using the new 8-bit FP8 floating-point data type for matrix multiplication operations, the speed has increased sixfold. ND H100v5 VM helps large language models achieve up to two times the inference speed improvement.