Is this page helpful?

Platform Support#

This page outlines the platform requirements for the NVIDIA NIM Operator and the hardware and storage requirements for its supported microservices.

NVIDIA NIM Operator Life Cycle#

When a new major version of NVIDIA NIM Operator is released, the previous major version enters deprecated support and only receives patch release updates for critical bug and CVE fixes. All prior major versions enter end of support and are no longer supported and do not receive patch release updates.

The product life cycle and versioning are subject to change in the future.

Note

Upgrades are only supported within a major release or to the next major release.

Support Status for Releases#

NIM Operator Version

Status

3.x.x

Supported

2.x.x

Deprecated

1.x.x

End of Support

NVIDIA NIM Microservices#

The NIM Operator supports deployment of NVIDIA NIM across various domains such as reasoning, retrieval, speech, and biology. For a full list of supported NIM, refer to build.nvidia.com. Refer to documentation for a specific NIM to learn more about its features and capabilities.

For details on supported architectures for the Multi-LLM NIM container, refer to the Supported Architectures for NVIDIA NIM for LLMs documentation

NIM Microservice System Requirements#

The GPU requirements for the NIM microservices depend on the workload and model. Depending on the microservice and model, supported GPUs include NVIDIA B300, H100, A100 80 GB, and L40S GPUs. For example, large models can exceed the memory capacity of one GPU, meaning you will need to add more GPUs to your cluster.

When you deploy a NIM Service or NIM pipeline, you can specify more than one GPU for a workload. You can download your models using NIM Cache.

You can view supported models and their resource requirements on build.nvidia.com. Refer to the model details on build.nvidia.com for specific details on storage, GPU model, and GPU count for the NVIDIA NIM you want to use.

To find details on supported models on build.nvidia.com:

  1. Use the Filter by text to search for NVIDIA NIM models and select Run Anywhere from the NIM Type drop down menu. Use the additional filter options to find the exact model you want.

  2. Click on the model you want to use.

  3. Click Model Card to view details about the NIM deployment requirements.

NVIDIA NeMo Microservices#

NVIDIA NIM Operator supports the following NeMo microservices.

Microservice

Version

NVIDIA NeMo Data Store

v25.8.0

NVIDIA NeMo Entity Store

v25.8.0

NVIDIA NeMo Guardrails

v25.10.0

NVIDIA NeMo Evaluator

v25.6.0

NVIDIA NeMo Customizer

v25.8.0

NeMo Microservices System Requirements#

Refer to the NeMo Requirements documentation for full details on system requirements.

Operating Systems and Kubernetes Platforms#

NVIDIA NIM Operator requires NVIDIA GPU Operator version 24.3.0 or higher to be installed on your cluster. Refer to Supported Operating Systems and Kubernetes Platforms in the GPU Operator documentation for supported operating systems and Kubernetes platforms.

Command-Line Tools#

Tool

Installation Documentation

kubectl (version matching your Kubernetes cluster)

Refer to Install Tools in the Kubernetes documentation for more information.

Helm v3 and higher

Refer to Install Helm in the Helm documentation for more information.