Digital Event Horizon
Together AI has made a groundbreaking announcement in its pursuit to accelerate AI development by partnering with Hypertec Cloud to co-build one of the world's largest optimized GPU clusters, featuring 36,000 NVIDIA GB200 NVL72 GPUs. This monumental undertaking aims to empower companies to push the boundaries of AI without compromising on performance, cost, or reliability.
Together AI is co-building one of the world’s largest optimized GPU clusters with Hypertec Cloud. The cluster features 36,000 NVIDIA GB200 NVL72 GPUs and serves as the backbone for large-scale AI training and inference. The partnership combines strengths to deliver next-generation infrastructure for accelerating AI workloads. The GPU cluster boasts cutting-edge technology, including Blackwell Tensor Core GPUs and Infiniband. The platform delivers enhanced performance, scalability, and cost efficiency through optimized hardware and software. The partnership aims to create an AI acceleration supercloud that maximizes performance for generative AI workloads.
Together AI's ambitious endeavor marks an exciting milestone in its journey to accelerate AI development. Today, we're thrilled to announce that we are co-building one of the world’s largest optimized GPU clusters, featuring 36,000 NVIDIA GB200 NVL72 GPUs, in partnership with Hypertec Cloud.
This monumental undertaking is the culmination of years of research and development by Together AI's high-performance GPU Clusters team, who have meticulously crafted a bespoke platform designed specifically for large-scale AI training and inference. The partnership between Together AI and Hypertec Cloud combines their respective strengths to deliver next-generation infrastructure that accelerates training, fine-tuning, and inference of large generative AI models.
The NVIDIA GB200 NVL72 GPUs serve as the backbone of this behemoth cluster, boasting an unprecedented number of 36,000 GPUs. This staggering figure is poised to redefine the current state-of-the-art in AI infrastructure, enabling developers and enterprises alike to tackle even the most demanding AI workloads with unprecedented efficiency and scalability.
One of the standout features of Together AI's GPU Clusters is their integration of cutting-edge technology, including Blackwell Tensor Core GPUs, Grace CPUs, NVIDIA’s NVLink and Infiniband, and the Together Kernel Collection. This comprehensive stack of hardware and software optimization ensures that the platform delivers enhanced performance, scalability, and cost efficiency.
The partnership between Together AI and Hypertec Cloud is a testament to their shared commitment to driving innovation in the realm of AI infrastructure. By combining their respective expertise, they aim to create an AI acceleration supercloud that maximizes performance for today’s generative AI workloads and scales seamlessly to meet tomorrow’s exponential demands.
Jonathan Ahdoot, President of Hypertec Cloud, expressed his excitement about this strategic partnership: "We are excited to announce this strategic partnership with Together AI and bring together our expertise to deliver next-generation high-performance AI solutions that are efficient and powerful."
Vipul Ved Prakash, CEO of Together AI, echoed the sentiments, stating: "We are excited to partner with Hypertec Cloud to expand our highly performant and reliable Together GPU Cluster footprint, serving the exponentially growing computational needs of our global customers."
This historic partnership is set to revolutionize the way AI infrastructure is approached, enabling companies to push the boundaries of what's possible without compromising on performance, cost, or reliability. As we look to the future, it's clear that this monumental undertaking will play a pivotal role in shaping the next generation of AI innovations.
Related Information:
https://www.together.ai/blog/nvidia-gb200-together-gpu-cluster-36k
Published: Mon Nov 18 08:07:39 2024 by llama3.2 3B Q4_K_M
