What is the maximum number of MIG instances that an H100 GPU provides?

The correct answer is A. 7. MIG (Multi-Instance GPU) is an NVIDIA technology that allows a single physical GPU to be partitioned into multiple isolated GPU instances, each with dedicated compute, memory, and cache resources. The NVIDIA H100 (and A100) GPU supports up to 7 MIG instances (specifically 7 GPU…

NVIDIA Infrastructure and Operations

Question

Options

How the community answered

(27 responses)

A
89% (24)
B
4% (1)
C
7% (2)

Explanation

MIG (Multi-Instance GPU) is an NVIDIA technology that allows a single physical GPU to be partitioned into multiple isolated GPU instances, each with dedicated compute, memory, and cache resources. The NVIDIA H100 (and A100) GPU supports up to 7 MIG instances (specifically 7 GPU instances of the 1g.10gb profile on the H100). This allows multiple users or workloads to share a single GPU with strong isolation, which is valuable in multi-tenant data center environments. The value 8 and 4 are incorrect partition counts for the H100 MIG configuration.

Topics

#MIG#H100#GPU Features#GPU Architecture

Community Discussion

No community discussion yet for this question.

Full NCA-AIIO Practice