NVIDIA, founded in 1993, is renowned for the role it plays in the computer graphics and gaming industries. The company's GPUs enable realistic and high-performance graphics for gaming, professional visualization, scientific research and AI applications. NVIDIA (News - Alert)'s CUDA architecture and parallel processing capabilities have also made its GPUs widely adopted in fields like deep learning, accelerating AI model training and inference. 

To back up the impact NVIDIA has made on various fields and industries, the company’s revenue amounted to $27 billion in fiscal 2023, according to a report from Statista. NVIDIA's 2023 fiscal year also saw its teams spend a record $7.3 billion on research and development as NVIDIA looks to strengthen its product range.

Building on that research and innovation, NVIDIA will deliver AI-ready servers that support VMware Private AI Foundation with NVIDIA to help companies customize and deploy generative AI applications using their proprietary business data.

Renowned computer makers are building NVIDIA AI-ready servers. This includes the Dell (News - Alert) PowerEdge R760xa, HPE ProLiant Gen11 servers for VMware Private AI Foundation with NVIDIA and Lenovo ThinkSystem SR675 V3.

“Dell Generative AI Solutions with NVIDIA AI-ready servers will play a critical role in advancing human progress by driving unprecedented levels of productivity and revolutionizing the way industries operate," said Michael Dell, chairman and CEO, Dell.

NVIDIA AI-ready servers include NVIDIA L40S GPUs, NVIDIA BlueField-3 DPUs, and NVIDIA AI Enterprise software to enable enterprises to fine-tune generative AI foundation models and deploy generative AI applications like intelligent chatbots, search and summarization tools.

L40S GPUs are built to handle complex AI workloads with billions of parameters and include fourth-generation Tensor Cores and an FP8 Transformer Engine, delivering over 1.45 petaflops of tensor processing power and up to 1.7x training performance compared with the NVIDIA A100 Tensor Core GPU.

For generative AI applications such as intelligent chatbots, assistants, search and summarization, the NVIDIA L40S enables up to 1.2-times more generative AI inference performance than the NVIDIA A100 GPU.

Integrating NVIDIA BlueField DPUs drives further speedups by accelerating, offloading and isolating the compute load of virtualization, networking, storage, security and other cloud-native AI services. NVIDIA ConnectX-7 SmartNICs offer advanced hardware offloads and ultra-low latency, delivering best-in-class, scalable performance for data-intensive generative AI workloads.

The servers feature NVIDIA AI Enterprise, the operating system of the NVIDIA AI platform. The software provides production-ready enterprise support and security for over 100 frameworks, pretrained models, toolkits and software, including NVIDIA NeMo for LLMs, NVIDIA Modulus for simulations, NVIDIA RAPIDS for data science and NVIDIA Triton Inference Server for production AI.

“A new computing era has begun,” said Jensen Huang, founder and CEO of NVIDIA. “Companies in every industry are racing to adopt generative AI. With our ecosystem of world-leading software and system partners, we are bringing generative AI to the world’s enterprises.”

These servers also provide NVIDIA-accelerated infrastructure and software to power VMware Private AI Foundation with NVIDIA. NVIDIA AI-ready servers are an ideal platform for businesses that will deploy VMware Private AI Foundation with NVIDIA.

“Generative AI is supercharging digital transformation, and enterprises need a fully integrated solution to more securely build applications that enable them to advance their business,” said Raghu Raghuram, CEO of VMware. “Through the combined expertise of VMware, NVIDIA and our server manufacturer partners, businesses will be able to develop and deploy AI with data privacy, security and control.”

NVIDIA AI-ready servers with L40S GPUs and BlueField DPUs will be available by the end of this year, with instances available from cloud service providers expected in the coming months.