At its annual Discover event, Hewlett Packard Enterprise (HPE) has unveiled a new platform developed in partnership with NVIDIA. The platform, called “Enterprise Computing Solution for Generation AI,” is an integrated solution that combines HPE and NVIDIA software, including GPU, network equipment, and AI software.
This platform is specifically designed for corporate customers, allowing them to customize existing AI models for their specific needs and use these models for data analysis. One of the key features of the platform is its “Rack-Scale” architecture, which consolidates multiple components into a single rack in the data center. The computational foundation of the platform consists of 16 Proliant DL380A Gen11 servers equipped with Intel Xeon Scalable processors and four NVIDIA L40 GPUs.
In terms of networking capabilities, the platform incorporates the spectrum-X switch and NVIDIA network adapters based on the Bluefield-3 DPU chip. It is also finely tuned to support the LLAMA-2 model from META*, which has 70 billion parameters. The infrastructure software includes the HPE Machine Learning Development Environment, as well as NVIDIA’s AI Enterprise Suite and Nemo Framework for conversational AI.
HPE emphasizes the need for a new computing architecture for AI and stresses the importance of an integrated approach from hardware to software for successful AI implementation. The pricing details for the HPE and NVIDIA platform have not been disclosed yet, but it is expected to be available for order in the first quarter of 2024.
HPE has also announced that its machine learning environment is now available as a managed service in public clouds, as part of the company’s strategy to simplify the process of training AI models. Additionally, HPE has enhanced its GreenLake offering for file storage, tailoring it to meet the requirements of AI tasks. The plans for GreenLake include expanding data storage capabilities up to 250 Petabytes and adding support for NVIDIA Quantum-2 network technologies.
*Please note that META and its products are considered extremist and are prohibited within the territory of the Russian Federation.