Skip to content

Commit fc29e59

Browse files
authored
Generative AI Examples from GTC25 XR Pavilion (#278)
* Create README.md * Create README.md * Create README.md * Create README.md * Update README.md * Create tmp.txt * Create tmp.txt * Add files via upload * Update README.md * Delete GTC25/VirtualAthlete/images/tmp.txt * Update README.md * Add files via upload * Create tmp.txt * Add files via upload * Update README.md * Delete GTC25/PersonalizedCharacter/images/tmp.txt * Update README.md * Create tmp.txt * Add files via upload * Delete GTC25/EnvironmentDesign/images/tmp.txt * Delete GTC25/DrawWithAI/images/tmp.txt * Renamed from "GTC25" to "VFX", added spdx to all files * Removed spdx from README.md files * Delete VFX/.DS_Store * Delete .DS_Store
1 parent 45d09be commit fc29e59

File tree

8 files changed

+75
-0
lines changed

8 files changed

+75
-0
lines changed

VFX/DrawWithAI/README.md

Lines changed: 20 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,20 @@
1+
![](images/DrawWithAI-HeaderImage.png)
2+
3+
# **Draw with AI**
4+
5+
6+
## **Demo Overview**
7+
8+
This workflow showcases how NVIDIA GPU supports AI generations with control nets, Loras, and the connection between different applications all at the same time. Accelerated by NVIDIA Blackwell, drawings come to life interactively!
9+
10+
11+
## **Key Points**
12+
13+
14+
15+
* The ability to connect between AI generative processes and the sketch input from other applications like Adobe Photoshop, makes it easy to integrate with users’ current workflows.
16+
* Combined with text prompting, Control Nets give us the control we need over the generations. This is what makes our sketch guide the design of the generation
17+
* To turn the sketches into any style, Loras are applied. An amazing example of how finetuning can help the user define a style.
18+
19+
NVIDIA GPUs help run all these processes simultaneously in order to generate interactively, as the user sketches their vision.
20+
520 KB
Loading

VFX/EnvironmentDesign/README.md

Lines changed: 18 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,18 @@
1+
![](images/EnvironmentDesign-HeaderImage.png)
2+
3+
# **Environment Design**
4+
5+
6+
## **Demo Overview**
7+
8+
This workflow is using Generative AI to allow users to retexturize, relight any place objects into a new environment or the same one. Powered by NVIDIA Blackwell, this workflow accelerates design iterations with unparalleled speed and efficiency.
9+
10+
11+
## **Key Points**
12+
13+
14+
15+
* Generate a specific material over a preselected object from an image - using CosXL for retexturing and SAM2 for accurate selections
16+
* Reinforce texture/material onto object if necessary with IPAdapters using strong style transfer
17+
* Relight the object in the same scene or a new designed space. Selected light colors and direction - Using IC- Relight and Stable Diffusion 1.5
18+
* Upscale your final design to add extra detail - Using SAM ( Segment anything Models), In Context Lora, And Clip VIsion with Flux Redux, Flux Turbo and Flux Dev Fill.
2.43 MB
Loading
Lines changed: 22 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,22 @@
1+
![](images/PersonalizedCharacter-HeaderImage.png)
2+
3+
# **Personalized Character**
4+
5+
6+
## **Demo Overview**
7+
8+
This workflow leverages Generative AI to turn any person into an illustrated character. It chains together 5 distinct AI workflows to produce character sheets and an animated turntable video. On an NVIDIA GPU, running on a powerful workstation, all of this content can be composed in just under 1.5 minutes.
9+
10+
Finally everything comes together though compositing automation and SAM . Customized background elements, text and generated assets come together to create the final composition.
11+
12+
13+
## **Key Points**
14+
15+
16+
17+
* Generate a specific character in a T-pose, based off of real life images - Using Instant ID & IP Adapter Face, Controlnet Open Pose and Stable Diffusion XL \
18+
19+
* Generate a full body character in multiple angles using Diffusers based Multi View
20+
* Upscale Illustrations and create high quality faces with Generative AI upscale methods, Face Detailer and Face Detection Ultralytics , and SD Ultimate Upscale.
21+
* Create unique character expressions for your character sheet using Live Portrait
22+
* Extract Key colors and elements from the scene using AI color extractors
1.69 MB
Loading

VFX/VirtualAthlete/README.md

Lines changed: 15 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,15 @@
1+
![](images/VirtualAthlete-HeaderImage.png)
2+
3+
# **Virtual Athlete**
4+
5+
This workflow is using Generative AI and automated compositing to allow users to design a custom esports jersey based off of their own colors, style selections, identity and team logo design. This will ultimately composite all together into a nice esport trading card
6+
7+
8+
## **Key Points**
9+
10+
11+
12+
* Generate a specific logo based on user input name - using FLUX and FLUX LoRA
13+
* Create a custom realistic Jersey and put it on the person - Using SAM ( Segment anything Models) , In Context Lora, And Clip Vision with Flux Redux, Flux Turbo and Flux Dev Fill.
14+
* Relight the scene to the user selected colors Using IC- Relight and Stable Diffusion 1.5
15+
* Creating an export card layout with user name and random number, as well as their custom logo
1.54 MB
Loading

0 commit comments

Comments
 (0)