MIG 可以把一个 NVIDIA GPU 当作多块使用(最多 七个),划分后每个都是完全独立的,有各自的带宽显存。
可以通过 [[nvidia-smi]] 命令查看显卡是否支持:nvidia-smi mig -lgip,如果支持会有如下输出:
+-----------------------------------------------------------------------------+| GPU instance profiles: || GPU Name ID Instances Memory P2P SM DEC ENC || Free/Total GiB CE JPEG OFA ||=============================================================================|| 0 MIG 1g.5gb 19 7/7 4.75 No 14 0 0 || 1 0 0 |+-----------------------------------------------------------------------------+| 0 MIG 1g.5gb+me 20 1/1 4.75 No 14 1 0 || 1 1 1 |+-----------------------------------------------------------------------------+| 0 MIG 1g.10gb 15 4/4 9.75 No 14 1 0 || 1 0 0 |+-----------------------------------------------------------------------------+| 0 MIG 2g.10gb 14 3/3 9.75 No 28 1 0 || 2 0 0 |+-----------------------------------------------------------------------------+| 0 MIG 3g.20gb 9 2/2 19.62 No 42 2 0 || 3 0 0 |+-----------------------------------------------------------------------------+| 0 MIG 4g.20gb 5 1/1 19.62 No 56 2 0 || 4 0 0 |+-----------------------------------------------------------------------------+| 0 MIG 7g.40gb 0 1/1 39.38 No 98 5 0 || 7 1 1 |+-----------------------------------------------------------------------------+| 1 MIG 1g.5gb 19 7/7 4.75 No 14 0 0 || 1 0 0 |+-----------------------------------------------------------------------------+| 1 MIG 1g.5gb+me 20 1/1 4.75 No 14 1 0 || 1 1 1 |+-----------------------------------------------------------------------------+| 1 MIG 1g.10gb 15 4/4 9.75 No 14 1 0 || 1 0 0 |+-----------------------------------------------------------------------------+| 1 MIG 2g.10gb 14 3/3 9.75 No 28 1 0 || 2 0 0 |+-----------------------------------------------------------------------------+| 1 MIG 3g.20gb 9 2/2 19.62 No 42 2 0 || 3 0 0 |+-----------------------------------------------------------------------------+| 1 MIG 4g.20gb 5 1/1 19.62 No 56 2 0 || 4 0 0 |+-----------------------------------------------------------------------------+| 1 MIG 7g.40gb 0 1/1 39.38 No 98 5 0 || 7 1 1 |+-----------------------------------------------------------------------------+| 2 MIG 1g.5gb 19 7/7 4.75 No 14 0 0 || 1 0 0 |+-----------------------------------------------------------------------------+| 2 MIG 1g.5gb+me 20 1/1 4.75 No 14 1 0 || 1 1 1 |+-----------------------------------------------------------------------------+| 2 MIG 1g.10gb 15 4/4 9.75 No 14 1 0 || 1 0 0 |+-----------------------------------------------------------------------------+| 2 MIG 2g.10gb 14 3/3 9.75 No 28 1 0 || 2 0 0 |+-----------------------------------------------------------------------------+| 2 MIG 3g.20gb 9 2/2 19.62 No 42 2 0 || 3 0 0 |+-----------------------------------------------------------------------------+| 2 MIG 4g.20gb 5 1/1 19.62 No 56 2 0 || 4 0 0 |+-----------------------------------------------------------------------------+| 2 MIG 7g.40gb 0 1/1 39.38 No 98 5 0 || 7 1 1 |+-----------------------------------------------------------------------------+| 3 MIG 1g.5gb 19 7/7 4.75 No 14 0 0 || 1 0 0 |+-----------------------------------------------------------------------------+| 3 MIG 1g.5gb+me 20 1/1 4.75 No 14 1 0 || 1 1 1 |+-----------------------------------------------------------------------------+| 3 MIG 1g.10gb 15 4/4 9.75 No 14 1 0 || 1 0 0 |+-----------------------------------------------------------------------------+| 3 MIG 2g.10gb 14 3/3 9.75 No 28 1 0 || 2 0 0 |+-----------------------------------------------------------------------------+| 3 MIG 3g.20gb 9 2/2 19.62 No 42 2 0 || 3 0 0 |+-----------------------------------------------------------------------------+| 3 MIG 4g.20gb 5 1/1 19.62 No 56 2 0 || 4 0 0 |+-----------------------------------------------------------------------------+| 3 MIG 7g.40gb 0 1/1 39.38 No 98 5 0 || 7 1 1 |+-----------------------------------------------------------------------------+另外家用显卡,比如 4090、5090 等都不支持 MIG,也可以在这个页面查看哪些显卡支持:NVIDIA Multi-Instance GPU User Guide .