In a significant strategic move, IBM has committed to a multi-year, $240 million partnership with the burgeoning startup, Together AI. This collaboration is set to establish a powerful artificial intelligence cluster, specifically designed to harness the cutting-edge capabilities of Nvidia's hardware. The core objective of this initiative is to foster the development and deployment of open AI models, catering to the escalating demand for accessible and adaptable AI solutions across various industries.
Together AI, a San Francisco-based company, specializes in providing the foundational infrastructure necessary for enterprises to execute and train their AI workloads effectively. Their platform supports a diverse range of open models, including prominent names like DeepSeek, MiniMax, and Kimi. This extensive support highlights Together AI's commitment to advancing the open-source AI ecosystem.
The announcement, made earlier this week, detailed plans for the proposed AI cluster to primarily facilitate inference – the process where trained AI models generate outputs or make predictions. This critical function will be made available for open-source AI models, ensuring wider access and utilization. The entire infrastructure will be hosted on IBM Cloud and will incorporate Nvidia's advanced HGX B300 systems, featuring their latest Blackwell processors, alongside Nvidia Spectrum-X Ethernet networking for optimized performance.
Nvidia has emphasized the transformative potential of this infrastructure, projecting that it will deliver an astounding 30-fold increase in AI factory output compared to previous generations. The initial phase of this ambitious project involves a U.S.-based deployment that will house approximately 2,000 Nvidia Blackwell chips. This powerful setup is anticipated to commence operations by the first quarter of 2027.
This substantial investment and partnership come at a pivotal time, amidst increasing global discourse surrounding the capabilities and inherent security risks associated with increasingly autonomous AI systems. Recent cybersecurity incidents involving models from leading AI developers like Anthropic, OpenAI, and Meta have underscored the critical need for robust and secure AI infrastructure. Consequently, there has been a notable surge in interest in open models, which offer transparency, modifiability, and often more cost-effective alternatives to proprietary, closed-source solutions.
Vipul Ved Prakash, CEO of Together AI, articulated the rationale behind the growing appeal of open models, stating, "Enterprises seek the superior performance of leading-edge models without the prohibitive cost associated with closed-source alternatives. This is only achievable when the underlying infrastructure is both fast and reliably scalable." He further emphasized the significance of this cluster as a major leap forward in positioning open-source AI as the preferred choice for businesses worldwide.
This collaboration is also a testament to the ongoing and expanding partnership between IBM and Nvidia. Both technology giants have been actively working together to enhance AI infrastructure and software solutions tailored for enterprise clients. A notable instance of this partnership was in March, when they announced an expanded collaboration at GTC 2026. This broader initiative aimed to empower enterprises to operationalize AI at scale, encompassing GPU-accelerated data analytics, the processing of unstructured data, regulated AI infrastructure, and comprehensive cloud computing and consulting services.
This significant agreement between IBM and Together AI, powered by Nvidia's advanced technology, represents a crucial step in the evolution of AI infrastructure. It underscores a commitment to fostering an open, powerful, and accessible AI ecosystem that can meet the complex demands of modern enterprises while addressing the challenges of security and scalability. The forthcoming AI cluster is poised to accelerate innovation in open-source AI, offering businesses unprecedented opportunities to leverage artificial intelligence for transformative growth.
