Merge: vfio/nvgrace-gpu: Add vfio pci variant module for grace hopper

MR: https://gitlab.com/redhat/centos-stream/src/kernel/centos-stream-9/-/merge_requests/4776

JIRA: https://issues.redhat.com/browse/RHEL-36542
JIRA: https://issues.redhat.com/browse/RHEL-36543
JIRA: https://issues.redhat.com/browse/RHEL-36544

Adding kernel pieces for VFIO-PCI variant module for NVIDIA's Grace GPU.
This module is used for vgpu on Grace-Hopper, and eventually, Grace-Blackwell.

The four commits enable the assignment to a guest.
To test, NVIDIA is providing a qemu-kvm invocation that will pass the VFIO-PCI device to the variant driver in the guest.  
This is basic vfio-pci device passthrough enablement, and requires further SMMUv3 updates to make the functionality complete and performant.

The four commits backport upstream commits listed in RHEL-36542, -36543, & -36544 which were not included in the kvm: arm: part-1 backport series (by Sebastian Ott).

The (first) push will initially be marked as Draft, until NVIDIA provides a method for RH-QE to test the ability to assign a vfio-pci variant device to a guest. Once that's been verified by this author, this MR's draft status will be removed, and the rest of the kernel workflow can continue.

Pushing this series now so eyes can see it, and others who want to grab it for testing or additional patch additions can do so.

Update: (July 19, 2024)
Pulling-out of draft mode: Verified via modified qemu-kvm command line and added instructions in RHEL-19393 (from the non-RHEL qemu-system-aarch64 cmdline), since QE now can test/verify basic assignment functionality.

v2: Remove CONFIG for RHEL; disabling build since testing showed it could enable crash of guest if nvidia-smi test was run after assignment of Hopper vGPU to guest.  Upstream commit to repair unlikely to make 9.5 functional freeze.  Take incremental step of getting 90% of functionality into RHEL kernel, and await last vma-related, v2 upstream post & acceptance of partner patch.
No code changes.

v3:
Fix CONFIG to disable for all arch's for now.

Signed-off-by: Donald Dutile <ddutile@redhat.com>

Approved-by: Eric Auger <eric.auger@redhat.com>
Approved-by: Sebastian Ott <sebott@redhat.com>
Approved-by: Cornelia Huck <cohuck@redhat.com>
Approved-by: Alex Williamson <alex.williamson@redhat.com>
Approved-by: Gavin Shan <gshan@redhat.com>
Approved-by: Jerry Snitselaar <jsnitsel@redhat.com>
Approved-by: CKI KWF Bot <cki-ci-bot+kwf-gitlab-com@redhat.com>

Merged-by: Lucas Zampieri <lzampier@redhat.com>

Author: zampierilucas

MAINTAINERS

@@ -20286,6 +20286,12 @@ F:	drivers/vfio/mdev/
 F:	include/linux/mdev.h
 F:	samples/vfio-mdev/
 
+VFIO NVIDIA GRACE GPU DRIVER
+M:	Ankit Agrawal <ankita@nvidia.com>
+L:	kvm@vger.kernel.org
+S:	Supported
+F:	drivers/vfio/pci/nvgrace-gpu/
+
 VFIO PCI DEVICE SPECIFIC DRIVERS
 R:	Jason Gunthorpe <jgg@nvidia.com>
 R:	Yishai Hadas <yishaih@nvidia.com>

drivers/vfio/pci/Kconfig

@@ -62,4 +62,6 @@ endif
 
 source "drivers/vfio/pci/mlx5/Kconfig"
 
+source "drivers/vfio/pci/nvgrace-gpu/Kconfig"
+
 endmenu

drivers/vfio/pci/Makefile

@@ -9,3 +9,5 @@ vfio-pci-$(CONFIG_VFIO_PCI_IGD) += vfio_pci_igd.o
 obj-$(CONFIG_VFIO_PCI) += vfio-pci.o
 
 obj-$(CONFIG_MLX5_VFIO_PCI)           += mlx5/
+
+obj-$(CONFIG_NVGRACE_GPU_VFIO_PCI) += nvgrace-gpu/

drivers/vfio/pci/nvgrace-gpu/Kconfig

@@ -0,0 +1,10 @@
+# SPDX-License-Identifier: GPL-2.0-only
+config NVGRACE_GPU_VFIO_PCI
+	tristate "VFIO support for the GPU in the NVIDIA Grace Hopper Superchip"
+	depends on ARM64 || (COMPILE_TEST && 64BIT)
+	select VFIO_PCI_CORE
+	help
+	  VFIO support for the GPU in the NVIDIA Grace Hopper Superchip is
+	  required to assign the GPU device to userspace using KVM/qemu/etc.
+
+	  If you don't know what to do here, say N.

drivers/vfio/pci/nvgrace-gpu/Makefile

@@ -0,0 +1,3 @@
+# SPDX-License-Identifier: GPL-2.0-only
+obj-$(CONFIG_NVGRACE_GPU_VFIO_PCI) += nvgrace-gpu-vfio-pci.o
+nvgrace-gpu-vfio-pci-y := main.o