Skip to content

Commit 3048240

Browse files
authored
Merge pull request #4258 from unsuman/add/krunkit-caveats
docs: add a caveat pointer for cpu inferencing in `krunkit`
2 parents c4e4f34 + d2dad5e commit 3048240

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

website/content/en/docs/config/vmtype/krunkit.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -85,4 +85,5 @@ sudo install-vulkan-gpu.sh
8585
- macOS Ventura or later on Apple Silicon is required.
8686
- GPU mode requires a Fedora image/template; Fedora 40+ recommended for Mesa/Vulkan (Venus).
8787
- To verify GPU/Vulkan in the guest, use tools like `vulkaninfo` after running the install script.
88+
- `Libkrun` and [`Ramalama`](https://github.com/containers/ramalama)(a tool that simplifies running AI models locally) use CPU inferencing as of **July 2, 2025** and are actively working to support GPU inferencing. [More info](https://developers.redhat.com/articles/2025/07/02/supercharging-ai-isolation-microvms-ramalama-libkrun#current_limitations_and_future_directions__gpu_enablement).
8889
- Driver architecture details: see [Virtual Machine Drivers](../../dev/drivers).

0 commit comments

Comments
 (0)