Skip to content

Commit d57dbba

Browse files
authored
Add AI Toolkit Copilot doc support (#9002)
* initial submit * update toc * updated based on feedback.
1 parent 20de3d8 commit d57dbba

File tree

3 files changed

+167
-0
lines changed

3 files changed

+167
-0
lines changed
Lines changed: 163 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,163 @@
1+
---
2+
ContentId: fb94d678-70e5-49e9-9192-a1294a2bc14d
3+
DateApproved: 10/28/2025
4+
MetaDescription: Get Started using the AI Toolkit Copilot tools to streamline and enhance the development of AI Agent Applications.
5+
---
6+
# Use AI Toolkit Copilot tools for AI agent development
7+
8+
The AI Toolkit Copilot tools help you build AI Agent applications faster. These tools give you ready-made features, templates, and best practices. You can create smart applications that use AI more quickly.
9+
10+
> [!NOTE]
11+
> The AI Toolkit Copilot tools use the VS Code [Language Model Tool API](https://code.visualstudio.com/api/extension-guides/ai/tools). These tools extend a large language model (LLM) with domain-specific features in chat. In agent mode, VS Code can automatically use these tools to handle user prompts and perform tasks.
12+
13+
The AI Toolkit Copilot tools include four main tools:
14+
15+
- Agent Code Gen
16+
- AI Model Guide
17+
- Evaluation Code Gen
18+
- Tracing Code Gen
19+
20+
## Prerequisites
21+
22+
1. [Visual Studio Code](https://code.visualstudio.com/) - Latest version to support MCP Server development.
23+
1. [GitHub Copilot](https://marketplace.visualstudio.com/items?itemName=GitHub.copilot) Visual Studio Code extension
24+
1. [GitHub Copilot Chat](https://marketplace.visualstudio.com/items?itemName=GitHub.copilot-chat) Visual Studio Code extension
25+
1. [AI Toolkit](https://marketplace.visualstudio.com/items?itemName=ms-ai.vscode-ai-toolkit) Visual Studio Code extension
26+
27+
## Using Copilot tools in AI Toolkit
28+
29+
After installing the prerequisites, you can use the tools AI Toolkit provides in agent mode:
30+
31+
1. Open the Chat view (`Ctrl+Alt+I`), and select Agent mode from the dropdown.
32+
33+
1. Select the **Tools** button to view the list of available tools.
34+
Optionally, select or deselect the tools you want to use. You can search tools by typing in the search box.
35+
![Screenshot showing the Chat view in Visual Studio Code with Agent mode selected. The Tools button is highlighted, displaying a list of available tools including Agent Code Gen, AI Model Guide, Evaluation Code Gen, and Tracing Code Gen.](./images/copilottools/select-tools.png)
36+
37+
## Agent Code Gen tool
38+
39+
The **Agent Code Gen** tool helps developers create agent code more easily. Use this tool to quickly make code snippets and templates that work well for AI agents. This approach makes development faster and ensures your code follows best practices for AI agent development.
40+
41+
### Key Features of Agent Code Gen tool
42+
43+
The **Agent Code Gen** tool has several important features:
44+
45+
- **Intelligent Agent Code Generation:** The tool creates agent code based on what you need.
46+
- **Default Framework Selection:** If you don't choose a framework, the tool picks Microsoft Agent Framework SDK for you.
47+
48+
Example requirement:
49+
50+
```text
51+
Create an AI app that helps me to manage travel queries.
52+
```
53+
54+
- **Integrated Model Guidance:** The tool uses the **AI Model Guide** to give you model details while building agents. It picks **gpt4.1** as the default model unless you choose another.
55+
56+
Example requirement:
57+
58+
```text
59+
Create an AI app to manage travel queries, use Azure AI Foundry models.
60+
```
61+
62+
- **Various Agent Framework functionality support:** The tool supports many features like function calling, MCP, and streaming responses.
63+
64+
Example requirement:
65+
66+
```text
67+
Create an AI app to check the CNN headline, use local MCP playwright to fetch CNN web page.
68+
```
69+
70+
- **Workflow support:** The tool supports many workflows in Agent Framework, like Sequential, Switch-case, Loop, and Human-In-The-Loop.
71+
72+
Example requirement:
73+
74+
```text
75+
Build a conditional routing workflow based on email classification:
76+
- "Email Classifier": determines if email is spam or legitimate.
77+
- "Spam Handler": processes spam emails (if spam detected).
78+
- "Email Assistant": drafts responses for legitimate emails (if not spam).
79+
```
80+
81+
## AI Model Guide Tool
82+
83+
The AI Model Guide tool helps developers pick the best AI models for their apps. It recommends Azure AI Foundry and GitHub models, including the latest and most popular ones. The tool provides details like input types, context length, cost, and metrics (quality, speed, safety). It also explains how to connect to models, such as GitHub endpoints and tokens.
84+
85+
This tool supports:
86+
87+
-Basic model recommendation:
88+
89+
Example information prompt:
90+
91+
```text
92+
Which models are specifically designed for reasoning or math tasks?
93+
```
94+
95+
For this example, Copilot gathers model information from this tool and recommends o-series models for reasoning/math tasks.
96+
97+
- Working together with the Code Gen tool to provide model selection during agent code generation:
98+
99+
Example requirement prompt:
100+
101+
```text
102+
Create a quick demo AI Chat app
103+
```
104+
105+
For this example, Copilot selects a model like the free GitHub gpt-4.1 for the chat app.
106+
107+
- Model selection based on specific requirements:
108+
109+
Example requirement prompt:
110+
111+
```text
112+
Create an AI app to manage travel queries using a cheap and fast azure model.
113+
```
114+
115+
For this example, Copilot selects a model like Azure AI Foundry gpt-4.1-mini model.
116+
117+
## Evaluation Code Gen Tool
118+
119+
The Evaluation Code Gen Tool helps you add evaluation to your AI apps or agents. It uses a Plan tool to gather details and prepare assets before generating code.
120+
121+
### Key Features of the Evaluation Code Gen Tool
122+
123+
The Evaluation Code Gen Tool has four main features:
124+
125+
- **Analysis and Metric Suggestion:** This feature reviews your AI app and suggests the best tests.
126+
- **Synthetic Query Generation:** This feature creates test questions based on your testing goals.
127+
- **Batch Application Execution:** This feature runs your app multiple times with test questions and collects results.
128+
- **Evaluation Code Generation:** This feature generates test code using the Azure AI Eval SDK.
129+
130+
These tools are helpful for everyone. New developers get guidance on tests and tools. Experienced developers save time. The Plan Tool finds your test files or asks where they are, making it easy to add testing to your app.
131+
132+
Example requirement prompts:
133+
134+
- Example 1:
135+
```text
136+
Create an evaluation for my AI travel assistant application that assesses response accuracy and user satisfaction.
137+
```
138+
- Example 2:
139+
```text
140+
Measure the tool call accuracy of the agent.
141+
```
142+
143+
## Tracing Code Gen Tool
144+
145+
The **Tracing Code Gen** tool shares best practices for adding tracing to AI apps. It helps developers monitor and debug AI agents and workflows with ease.
146+
This tool supports local tracing for these languages and SDKs:
147+
148+
- (**Python**) agent-framework, azure-ai-inference, azure-ai-agents, azure-ai-projects, openai, openai-agents, langchain, google-genai, anthropic
149+
- (**JS/TS**) azure-ai-inference, azure-ai-projects, openai, langchain, anthropic
150+
151+
Example requirement prompt:
152+
153+
```text
154+
Enable tracing for my AI travel assistant application built with the agent-framework SDK in Python.
155+
```
156+
157+
## What you learned
158+
159+
In this article, you learned how to:
160+
- Use AI tools to speed up app development.
161+
- Add tracing to monitor and debug your AI apps.
162+
- Pick the best AI models for your tasks.
163+
- Include evaluation and testing in your AI workflow.
Lines changed: 3 additions & 0 deletions
Loading

docs/toc.json

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -369,6 +369,7 @@
369369
"area": "intelligentapps",
370370
"topics": [
371371
["AI Toolkit Overview", "/docs/intelligentapps/overview"],
372+
["Getting Started", "/docs/intelligentapps/gettingstarted"], ["AI Toolkit Copilot tools", "/docs/intelligentapps/copilot-tools"],
372373
["Models", "/docs/intelligentapps/models"],
373374
["Playground", "/docs/intelligentapps/playground"],
374375
["Agent Builder", "/docs/intelligentapps/agentbuilder"],

0 commit comments

Comments
 (0)