To improve the efficiency and security of AI in sovereign cloud environments, NVIDIA and F5 are integrating NVIDIA BlueField-3 DPUs with F5 BIG-IP Next for Kubernetes for application delivery and security.
The collaboration, announced today at the NVIDIA AI Summit in Mumbai, India, is ideal for industries with stringent data governance, privacy or compliance requirements and addresses the growing demand for scalable AI infrastructure.
“We are working with NVIDIA to enable industries to deploy secure and scalable AI solutions faster, with better performance, all while ensuring data remains protected,” said Ahmed Katari, vice president and general manager of the service provider at F5.
The collaboration aims to help governments and industries manage sensitive data while accelerating the delivery of AI applications. The sovereign cloud market is expected to reach $250 billion by 2027, according to IDC. Meanwhile, ABI Research expects the foundation model market to reach $30 billion by 2027.
Sovereign clouds are designed to meet stringent requirements for data privacy and localization. It is critical for industries that handle sensitive data, such as telecommunications and financial services, as well as government agencies.
F5 BIG-IP Next for Kubernetes deployed on NVIDIA BlueField-3 DPUs provides a secure and compliant AI networking infrastructure, allowing industries to adopt advanced AI capabilities without compromising data privacy.
By offloading tasks like load balancing, routing, and security to the BlueField-3 DPU, F5 BIG-IP Next for Kubernetes routes AI claims to LLM instances efficiently and reduces power usage. This ensures scalable AI performance while optimizing GPU resource utilization.
NVIDIA NIM microservices, which accelerate the deployment of core models, will also benefit from the collaboration thanks to more efficient AI workload management.
The combined solutions from NVIDIA and F5 promise enhanced security and efficiency, which is key for industries moving to cloud-native infrastructures. Through these innovations, industries in highly regulated sectors can scale AI applications securely and reliably, while meeting the highest data protection standards.
Editor's Note: Figures for the global sovereign cloud market come from the IDC report “Global Sovereign Cloud Market Outlook, 2022-2027,” Document No. US49695922, published November 2023. Data on the generative AI software market provided by ABI Research “Generative AI Software Report “, MD-AISG-101, published July 2024.
