Enterprises are on the lookout for more and more highly effective compute to assist their AI workloads and speed up information processing. The effectivity gained can translate to raised returns for his or her investments in AI coaching and fine-tuning, and improved consumer experiences for AI inference.
On the Oracle CloudWorld convention as we speak, Oracle Cloud Infrastructure (OCI) introduced the primary zettascale OCI Supercluster, accelerated by the NVIDIA Blackwell platform, to assist enterprises prepare and deploy next-generation AI fashions utilizing greater than 100,000 of NVIDIA’s latest-generation GPUs.
OCI Superclusters permit clients to select from a variety of NVIDIA GPUs and deploy them anyplace: on premises, public cloud and sovereign cloud. Set for availability within the first half of subsequent 12 months, the Blackwell-based programs can scale as much as 131,072 Blackwell GPUs with NVIDIA ConnectX-7 NICs for RoCEv2 or NVIDIA Quantum-2 InfiniBand networking to ship an astounding 2.4 zettaflops of peak AI compute to the cloud. (Learn the press launch to study extra about OCI Superclusters.)
On the present, Oracle additionally previewed NVIDIA GB200 NVL72 liquid-cooled bare-metal situations to assist energy generative AI purposes. The situations are able to large-scale coaching with Quantum-2 InfiniBand and real-time inference of trillion-parameter fashions inside the expanded 72-GPU NVIDIA NVLink area, which may act as a single, large GPU.
This 12 months, OCI will supply NVIDIA HGX H200 — connecting eight NVIDIA H200 Tensor Core GPUs in a single bare-metal occasion by way of NVLink and NVLink Swap, and scaling to 65,536 H200 GPUs with NVIDIA ConnectX-7 NICs over RoCEv2 cluster networking. The occasion is on the market to order for patrons trying to ship real-time inference at scale and speed up their coaching workloads. (Learn a weblog on OCI Superclusters with NVIDIA B200, GB200 and H200 GPUs.)
OCI additionally introduced basic availability of NVIDIA L40S GPU-accelerated situations for midrange AI workloads, NVIDIA Omniverse and visualization. (Learn a weblog on OCI Superclusters with NVIDIA L40S GPUs.)
For single-node to multi-rack options, Oracle’s edge choices present scalable AI on the edge accelerated by NVIDIA GPUs, even in disconnected and distant places. For instance, smaller-scale deployments with Oracle’s Roving Edge Machine v2 will now assist as much as three NVIDIA L4 Tensor Core GPUs.
Corporations are utilizing NVIDIA-powered OCI Superclusters to drive AI innovation. Basis mannequin startup Reka, for instance, is utilizing the clusters to develop superior multimodal AI fashions to develop enterprise brokers.
“Reka’s multimodal AI fashions, constructed with OCI and NVIDIA expertise, empower next-generation enterprise brokers that may learn, see, hear and communicate to make sense of our complicated world,” mentioned Dani Yogatama, cofounder and CEO of Reka. “With NVIDIA GPU-accelerated infrastructure, we will deal with very giant fashions and in depth contexts with ease, all whereas enabling dense and sparse coaching to scale effectively at cluster ranges.”
NVIDIA acquired the 2024 Oracle Know-how Answer Accomplice Award in Innovation for its full-stack strategy to innovation.
Accelerating Generative AI Oracle Database Workloads
Oracle Autonomous Database is gaining NVIDIA GPU assist for Oracle Machine Studying notebooks to permit clients to speed up their information processing workloads on Oracle Autonomous Database.
At Oracle CloudWorld, NVIDIA and Oracle are partnering to show three capabilities that present how the NVIDIA accelerated computing platform might be used as we speak or sooner or later to speed up key elements of generative AI retrieval-augmented era pipelines.
The primary will showcase how NVIDIA GPUs can be utilized to speed up bulk vector embeddings straight from inside Oracle Autonomous Database Serverless to effectively deliver enterprise information nearer to AI. These vectors might be searched utilizing Oracle Database 23ai’s AI Vector Search.
The second demonstration will showcase a proof-of-concept prototype that makes use of NVIDIA GPUs, NVIDIA cuVS and an Oracle-developed offload framework to speed up vector graph index era, which considerably reduces the time wanted to construct indexes for environment friendly vector searches.
The third demonstration illustrates how NVIDIA NIM, a set of easy-to-use inference microservices, can enhance generative AI efficiency for textual content era and translation use instances throughout a variety of mannequin sizes and concurrency ranges.
Collectively, these new Oracle Database capabilities and demonstrations spotlight how NVIDIA GPUs can be utilized to assist enterprises deliver generative AI to their structured and unstructured information housed in or managed by an Oracle Database.
Sovereign AI Worldwide
NVIDIA and Oracle are collaborating to ship sovereign AI infrastructure worldwide, serving to deal with the info residency wants of governments and enterprises.
Brazil-based startup Huge Labs educated and deployed Amazonia IA, one of many first giant language fashions for Brazilian Portuguese, utilizing NVIDIA H100 Tensor Core GPUs and the NVIDIA NeMo framework in OCI’s Brazilian information facilities to assist guarantee information sovereignty.
“Creating a sovereign LLM permits us to supply shoppers a service that processes their information inside Brazilian borders, giving Amazônia a singular market place,” mentioned Nelson Leoni, CEO of Huge Labs. “Utilizing the NVIDIA NeMo framework, we efficiently educated Amazônia IA.”
In Japan, Nomura Analysis Institute, a number one international supplier of consulting providers and system options, is utilizing OCI’s Alloy infrastructure with NVIDIA GPUs to reinforce its monetary AI platform with LLMs working in accordance with monetary laws and information sovereignty necessities.
Communication and collaboration firm Zoom shall be utilizing NVIDIA GPUs in OCI’s Saudi Arabian information facilities to assist assist compliance with native information necessities.
And geospatial modeling firm RSS-Hydro is demonstrating how its flood mapping platform — constructed on the NVIDIA Omniverse platform and powered by L40S GPUs on OCI — can use digital twins to simulate flood impacts in Japan’s Kumamoto area, serving to mitigate the impression of local weather change.
These clients are amongst quite a few nations and organizations constructing and deploying home AI purposes powered by NVIDIA and OCI, driving financial resilience by sovereign AI infrastructure.
Enterprise-Prepared AI With NVIDIA and Oracle
Enterprises can speed up job automation on OCI by deploying NVIDIA software program corresponding to NIM microservices and NVIDIA cuOpt with OCI’s scalable cloud options. These options allow enterprises to rapidly undertake generative AI and construct agentic workflows for complicated duties like code era and route optimization.
NVIDIA cuOpt, NIM, RAPIDS and extra are included within the NVIDIA AI Enterprise software program platform, obtainable on the Oracle Cloud Market.
Study Extra at Oracle CloudWorld
Be part of NVIDIA at Oracle CloudWorld 2024 to find out how the businesses’ collaboration is bringing AI and accelerated information processing to the world’s organizations.
Register to the occasion to observe periods, see demos and be part of Oracle and NVIDIA for the answer keynote, “Unlock AI Efficiency with NVIDIA’s Accelerated Computing Platform” (SOL3866), on Wednesday, Sept. 11, in Las Vegas.