AI infrastructure
Run the most demanding AI workloads faster, including generative AI, computer vision, and predictive analytics, anywhere in our distributed cloud. Use Oracle Cloud Infrastructure (OCI) Supercluster to scale up to 32,768 GPUs today and 131,072 GPUs soon.*
Learn how to speed up AI training and inference
Why run on OCI AI infrastructure?
Leading AI performance and value
OCI AI infrastructure provides the highest-tier performance and value for all AI workloads—including inferencing, training, and AI assistants.
HPC storage
Take advantage of high performance mount targets (HPMTs) for up to 500 Gb/sec of sustained throughput. Use 61.44 TB of local storage capacity, the highest in the industry for instances with NVIDIA H100 GPUs.
Enable sovereign AI
Oracle’s distributed cloud enables you to deploy AI infrastructure anywhere to help meet performance, security and AI sovereignty requirements.
The image shows boxes that represent compute and storage, connected by lines for cluster networking. On the far left, there are four boxes of compute and two for storage for the smallest cluster with 16,000 NVIDIA H100 GPUs. To its right there are 8 boxes of compute and 4 boxes of storage for 32,000 NVIDIA A100 GPUs in a cluster. Next, there are 16 boxes of compute and 8 boxes of storage for 64,000 NVIDIA H200 GPUs. Finally, to the far right, there are 32 boxes of compute and 16 boxes of storage for 128,000 NVIDIA Blackwell and Grace Blackwell GPUs. This shows scalability of OCI Supercluster increasing by 8X from the smallest 16,000 GPU configuration on the far left to the largest 128,000 GPU configuration on the far right.
OCI Supercluster with NVIDIA Blackwell and Hopper GPUs
Up to 131,072 GPUs, 8X more scalability
Network fabric innovations will enable OCI Supercluster to scale up to 131,072 NVIDIA B200 GPUs, more than 100,000 Blackwell GPUs in NVIDIA Grace Blackwell Superchips, and 65,536 NVIDIA H200 GPUs. Get up to 8X more scalability over current limits for OCI Supercluster with NVIDIA A100 and H100 GPUs.
OCI AI infrastructure for all your needs
Whether you’re looking to perform inferencing or fine-tuning or train large scale-out models for generative AI, OCI offers industry-leading bare metal and virtual machine GPU cluster options powered by an ultrahigh-bandwidth network and high performance storage to fit your AI needs.
AI innovators leverage OCI to host, train, and inference next-generation AI models.
Explore OCI Supercluster for large-scale AI training
Available now: Massive scale-out clusters with NVIDIA H100, A100, and L40S GPUs
Compute
• 8x NVIDIA H100 GPUs; 61.44 TB NVMe SSDs per node
• 8x NVIDIA A100 GPUs; 27.2 TB NVMe SSDs per node
• 4x NVIDIA L40S GPUs; 7.38 TB NVMe SSDs per node
Storage
• Block storage: Up to 32 TB per volume
• Object storage: Up to 10 TiB per object
• File storage: Up to 8 EB per file system
• Storage clusters with Dense I/O shapes
Networking
• RDMA over Converged Ethernet (RoCE v2)
• Few microseconds of latency between nodes
• OCI Supercluster internode bandwidth:
o NVIDIA H100: 3200 Gb/sec
o NVIDIA A100: 1600 Gb/sec
o NVIDIA L40S: 800 Gb/sec
Compute for Supercluster
OCI bare metal instances powered by NVIDIA L40S, H100, and A100 GPUs enable customers to run large AI models for use cases that include deep learning, conversational AI, and generative AI. With OCI Supercluster, customers can scale up to 32,768 A100 GPUs, 16,384 H100 GPUs, and 3,840 L40S GPUs per cluster.
Enlarge+
Networking for Supercluster
High-speed RDMA cluster networking powered by NVIDIA ConnectX network interface cards with RDMA over Converged Ethernet version 2 lets you create large clusters of GPU instances with the same ultralow-latency networking and application scalability you expect on-premises.
You don’t pay extra for RDMA capability, block storage, or network bandwidth, and the first 10 TB of egress is free.
Enlarge+
Storage for OCI Supercluster
Through OCI Supercluster, customers can access local, block, object, and file storage for exascale computing. Among major cloud providers, OCI offers the highest capacity of high performance local NVMe storage for more frequent checkpointing during training runs, resulting in faster recovery from failures.
HPC file systems, including BeeGFS, GlusterFS, Lustre, and WEKA, can be used for AI training at scale without compromising performance.
How OCI Supercluster works
Watch Chief Technical Architect Pradeep Vincent explain how OCI Supercluster powers the training and inferencing of machine learning models, scaling to tens of thousands of NVIDIA GPUs.
Typical AI infrastructure use cases
- Deep learning training and inferencing
- Fraud detection augmented by AI
- AI-based medical image analysis
- Using AI to accelerate drug discovery
Train AI models on OCI bare metal instances powered by GPUs, RDMA cluster networking, and OCI Data Science.
Protecting the billions of financial transactions that happen every day requires enhanced AI tools that can analyze large amounts of historical customer data. AI models running on OCI Compute powered by NVIDIA GPUs along with model management tools such as OCI Data Science and other open source models help financial institutions mitigate fraud.
AI is often used to analyze various types of medical images (such as X-rays and MRIs) in a hospital. Trained models can help prioritize cases that need immediate review by a radiologist and report conclusive results on others.
Drug discovery is a time consuming and expensive process that can take many years and cost millions of dollars. By leveraging AI infrastructure and analytics, researchers can accelerate drug discovery. Additionally, OCI Compute powered by NVIDIA GPUs along with AI workflow management tools such as BioNeMo enables customers to curate and preprocess their data.
AI infrastructure customer successes
Get started with OCI AI infrastructure
Try Oracle AI and get a 30-day trial
Oracle offers a free pricing tier for most AI services as well as a free trial account with US$300 in credits to try additional cloud services. AI services are a collection of offerings, including generative AI, with prebuilt machine learning models that make it easier for developers to apply AI to applications and business operations.
-
Which Oracle AI and ML services offer a free pricing tier?
- OCI Speech
- OCI Language
- OCI Vision
- OCI Document Understanding
- Machine Learning in Oracle Database
- OCI Data Labeling
You also only have to pay compute and storage charges for OCI Data Science.
Additional resources
Learn more about RDMA cluster networking, GPU instances, bare metal servers, and more.
See how much you can save with OCI
Oracle Cloud pricing is simple, with consistent low pricing worldwide, supporting a wide range of use cases. To estimate your low rate, check out the cost estimator and configure the services to suit your needs.
Access AI subject matter experts
Get help with building your next AI solution or deploying your workload on OCI AI infrastructure.
-
They can answer questions such as
- How do I get started with Oracle Cloud?
- What kinds of AI workloads can I run on OCI?
- What types of AI services does OCI offer?