GPU Sharing

Note: Before changing the Worker MIG Strategy, scale the application using GPU Operator to 0

Step 1: In the menu, select AI Infrastructure> Managed GPU Cluster. The system will display the GPU Cluster Management page. Select the cluster you want to add GPU software to.

Step 2: In the Node Pools tab, select the Worker MIG Strategy you want to use.

Step 3: Select the MIG Profile, then click the Save button

None: No GPU sharing - each Pod uses an entire physical GPU.

Single: Each GPU is divided into smaller portions.

• MIG-single-7x1g.10gb: Divides the physical GPU into 7 1g.10gb instances

• MIG-single-4x1g.20gb: Divides the physical GPU into 4 instances of 1g.20gb

• MIG-single-3x2g.2gb: Split the physical GPU into 3 instances of 2g.20gb

• MIG-single-2x3g.40gb: Divides the physical GPU into 2 instances of 3g.40gb

• MIG-single-1x4g.40gb: Split the physical GPU into 1 instance of 4g.40gb

• MIG-single-1.7g.80gb: Split the physical GPU into 1 instance of 7g.80gb

→ If you do not need to split the GPU, select None.

Note:

The MIG strategy change process will take a few minutes, and the Cluster status will change to Processing until the new worker successfully joins the cluster. The cluster will continue to operate normally during this process