Skip to content

Commit 37e183a

Browse files
authored
Adding Data-Flywheel Notebooks (#285)
* Adding Data-Flywheel Notebooks * Update README.md * Update README.md * Update README.md * Update README.md
1 parent b4f5054 commit 37e183a

File tree

11 files changed

+4052
-0
lines changed

11 files changed

+4052
-0
lines changed

README.md

Lines changed: 20 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -13,11 +13,14 @@ This repository is a starting point for developers looking to integrate with the
1313
<!-- TOC -->
1414

1515
* [What's New?](#whats-new)
16+
* [Data Flywheel](#data-flywheel)
1617
* [Knowledge Graph RAG](#knowledge-graph-rag)
1718
* [Agentic Workflows with Llama 3.1](#agentic-workflows-with-llama-31)
1819
* [RAG with Local NIM Deployment and LangChain](#rag-with-local-nim-deployment-and-langchain)
1920
* [Vision NIM Workflows](#vision-nim-workflows)
2021
* [Try it Now!](#try-it-now)
22+
* [Data Flywheel](#data-flywheel)
23+
* [Tool-Calling Notebooks](#tool-calling-notebooks)
2124
* [RAG](#rag)
2225
* [RAG Notebooks](#rag-notebooks)
2326
* [RAG Examples](#rag-examples)
@@ -33,6 +36,12 @@ This repository is a starting point for developers looking to integrate with the
3336

3437
## What's New?
3538

39+
### Data Flywheel
40+
41+
This tutorial demonstrates an end-to-end Data Flywheel implementation that uses NVIDIA NeMo Microservices. It features a tool-calling workflow with the NVIDIA NeMo Datastore, NeMo Entity Store, NeMo Customizer, NeMo Evaluator, NeMo Guardrails microservices, and NVIDIA NIMs.
42+
43+
- [Tool Calling Fine-tuning, Inference, and Evaluation with NVIDIA NeMo Microservices and NIMs](./nemo/data-flywheel/tool-calling)
44+
3645
### Knowledge Graph RAG
3746

3847
This example implements a GPU-accelerated pipeline for creating and querying knowledge graphs using RAG by leveraging NIM microservices and the RAPIDS ecosystem to process large-scale datasets efficiently.
@@ -104,6 +113,16 @@ Experience NVIDIA RAG Pipelines with just a few steps!
104113
105114

106115

116+
## Data Flywheel
117+
118+
A [Data Flywheel](https://www.nvidia.com/en-us/glossary/data-flywheel/) is a self-reinforcing cycle where user interactions generate data that improves AI models or products, leading to better outcomes that attract more users and further enhance data quality. This feedback loop relies on continuous data processing, model refinement, and guardrails to ensure accuracy and compliance while compounding value over time. Real-world applications range from personalized customer experiences to operational systems like inventory management, where improved predictions drive efficiency and growth.
119+
120+
### Tool-Calling Notebooks
121+
122+
Tool calling empowers Large Language Models (LLMs) to integrate with external APIs, execute dynamic workflows, and retrieve real-time data beyond their training scope. The NVIDIA NeMo microservices platform offers a modular infrastructure for deploying AI pipelines that includes fine-tuning, evaluation, inference, and guardrail enforcement—across Kubernetes clusters in cloud or on-premises environments.
123+
124+
This end-to-end [tutorial](./nemo/data-flywheel/tool-calling) demonstrates how to leverage NeMo Microservices to customize [Llama-3.2-1B-Instruct](https://huggingface.co/meta-llama/Llama-3.2-1B-Instruct) by using the [xLAM](https://huggingface.co/datasets/Salesforce/xlam-function-calling-60k) function-calling dataset, assess its accuracy, and implement safety constraints to govern its behavior.
125+
107126
## RAG
108127

109128
### RAG Notebooks
@@ -186,3 +205,4 @@ Example tools and tutorials to enhance LLM development and productivity when usi
186205
## Community
187206
We're posting these examples on GitHub to support the NVIDIA LLM community and facilitate feedback.
188207
We invite contributions! Open a GitHub issue or pull request! See [contributing](docs/contributing.md) Check out the [community](./community/README.md) examples and notebooks.
208+

nemo/data-flywheel/README.md

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,3 @@
1+
# nemo-data-flywheel-tutorials
2+
3+
Tutorials for the NVIDIA NeMo Microservices Data Flywheel, featuring examples with NeMo Datastore, NeMo Entity Store, NeMo Customizer, NeMo Evaluator, NeMo Guardrails microservices, and NVIDIA NIMs.

0 commit comments

Comments
 (0)