You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/intelligentapps/copilot-tools.md
+35-29Lines changed: 35 additions & 29 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,14 +1,14 @@
1
1
---
2
2
ContentId: fb94d678-70e5-49e9-9192-a1294a2bc14d
3
3
DateApproved: 10/28/2025
4
-
MetaDescription: Get Started using the AI Toolkit Copilot tools to streamline and enhance the development of AI Agent Applications.
4
+
MetaDescription: Get started using the AI Toolkit Copilot tools to streamline and enhance the development of AI agent applications.
5
5
---
6
6
# Use AI Toolkit Copilot tools for AI agent development
7
7
8
-
The AI Toolkit Copilot tools help you build AI Agent applications faster. These tools give you ready-made features, templates, and best practices. You can create smart applications that use AI more quickly.
8
+
The AI Toolkit Copilot tools help you build AI agent applications faster. These tools give you ready-made features, templates, and best practices. You can create smart applications that use AI more quickly.
9
9
10
10
> [!NOTE]
11
-
> The AI Toolkit Copilot tools use the VS Code [Language Model Tool API](https://code.visualstudio.com/api/extension-guides/ai/tools). These tools extend a large language model (LLM) with domain-specific features in chat. In agent mode, VS Code can automatically use these tools to handle user prompts and perform tasks.
11
+
> The AI Toolkit Copilot tools use the VS Code [Language Model Tool API](/api/extension-guides/ai/tools.md). These tools extend a large language model (LLM) with domain-specific features in chat. In agent mode, VS Code can automatically use these tools to handle user prompts and perform tasks.
12
12
13
13
The AI Toolkit Copilot tools include four main tools:
14
14
@@ -19,47 +19,49 @@ The AI Toolkit Copilot tools include four main tools:
19
19
20
20
## Prerequisites
21
21
22
-
1.[Visual Studio Code](https://code.visualstudio.com/) - Latest version to support MCP Server development.
22
+
1.[Visual Studio Code](/download) - Latest version to support MCP Server development.
23
23
1.[GitHub Copilot](https://marketplace.visualstudio.com/items?itemName=GitHub.copilot) Visual Studio Code extension
24
24
1.[GitHub Copilot Chat](https://marketplace.visualstudio.com/items?itemName=GitHub.copilot-chat) Visual Studio Code extension
25
25
1.[AI Toolkit](https://marketplace.visualstudio.com/items?itemName=ms-ai.vscode-ai-toolkit) Visual Studio Code extension
26
26
27
27
## Using Copilot tools in AI Toolkit
28
28
29
-
After installing the prerequisites, you can use the tools AI Toolkit provides in agent mode:
29
+
After installing the prerequisites, you can use the tools AI Toolkit provides when using agents in chat:
30
30
31
-
1. Open the Chat view (`Ctrl+Alt+I`), and select Agent mode from the dropdown.
31
+
1. Open the Chat view `kb(workbench.action.chat.open)`, and select **Agent** from the dropdown.
32
32
33
33
1. Select the **Tools** button to view the list of available tools.
34
+
34
35
Optionally, select or deselect the tools you want to use. You can search tools by typing in the search box.
36
+
35
37
36
38
37
39
## Agent Code Gen tool
38
40
39
-
The **Agent Code Gen** tool helps developers create agent code more easily. Use this tool to quickly make code snippets and templates that work well for AI agents. This approach makes development faster and ensures your code follows best practices for AI agent development.
41
+
The Agent Code Gen tool helps developers create agent code more easily. Use this tool to quickly make code snippets and templates that work well for AI agents. This approach makes development faster and ensures your code follows best practices for AI agent development.
40
42
41
-
### Key Features of Agent Code Gen tool
43
+
### Key features of Agent Code Gen tool
42
44
43
-
The **Agent Code Gen** tool has several important features:
45
+
The Agent Code Gen tool has several important features:
44
46
45
-
-**Intelligent Agent Code Generation:** The tool creates agent code based on what you need.
46
-
-**Default Framework Selection:** If you don't choose a framework, the tool picks Microsoft Agent Framework SDK for you.
47
+
-**Intelligent agent code generation:** The tool creates agent code based on what you need.
48
+
-**Default framework selection:** If you don't choose a framework, the tool picks Microsoft Agent Framework SDK for you.
47
49
48
50
Example requirement:
49
51
50
52
```text
51
53
Create an AI app that helps me to manage travel queries.
52
54
```
53
55
54
-
- **Integrated Model Guidance:** The tool uses the **AI Model Guide** to give you model details while building agents. It picks **gpt4.1** as the default model unless you choose another.
56
+
- **Integrated model guidance:** The tool uses the **AI Model Guide** to give you model details while building agents. It picks **GPT4.1** as the default model unless you choose another.
55
57
56
58
Example requirement:
57
59
58
60
```text
59
61
Create an AI app to manage travel queries, use Azure AI Foundry models.
60
62
```
61
63
62
-
- **Various Agent Framework functionality support:** The tool supports many features like function calling, MCP, and streaming responses.
64
+
- **Various agent framework functionality support:** The tool supports many features like function calling, MCP, and streaming responses.
63
65
64
66
Example requirement:
65
67
@@ -78,21 +80,21 @@ The **Agent Code Gen** tool has several important features:
78
80
- "Email Assistant": drafts responses for legitimate emails (if not spam).
79
81
```
80
82
81
-
## AI Model Guide Tool
83
+
## AI Model Guide tool
82
84
83
85
The AI Model Guide tool helps developers pick the best AI models for their apps. It recommends Azure AI Foundry and GitHub models, including the latest and most popular ones. The tool provides details like input types, context length, cost, and metrics (quality, speed, safety). It also explains how to connect to models, such as GitHub endpoints and tokens.
84
86
85
87
This tool supports:
86
88
87
-
-Basic model recommendation:
89
+
-Basic model recommendation:
88
90
89
91
Example information prompt:
90
92
91
93
```text
92
94
Which models are specifically designed for reasoning or math tasks?
93
95
```
94
96
95
-
For this example, Copilot gathers model information from this tool and recommends o-series models for reasoning/math tasks.
97
+
For this example, Copilot gathers model information from this tool and recommends o-series models for reasoning or math tasks.
96
98
97
99
- Working together with the Code Gen tool to provide model selection during agent code generation:
98
100
@@ -102,7 +104,7 @@ This tool supports:
102
104
Create a quick demo AI Chat app
103
105
```
104
106
105
-
For this example, Copilot selects a model like the free GitHub gpt-4.1 for the chat app.
107
+
For this example, Copilot selects a model like the free GitHub GPT-4.1 for the chat app.
106
108
107
109
- Model selection based on specific requirements:
108
110
@@ -112,37 +114,40 @@ This tool supports:
112
114
Create an AI app to manage travel queries using a cheap and fast azure model.
113
115
```
114
116
115
-
For this example, Copilot selects a model like Azure AI Foundry gpt-4.1-mini model.
117
+
For this example, Copilot selects a model like Azure AI Foundry GPT-4.1-mini model.
116
118
117
-
## Evaluation Code Gen Tool
119
+
## Evaluation Code Gen tool
118
120
119
-
The Evaluation Code Gen Tool helps you add evaluation to your AI apps or agents. It uses a Plan tool to gather details and prepare assets before generating code.
121
+
The Evaluation Code Gen tool helps you add evaluation to your AI apps or agents. It uses a Plan tool to gather details and prepare assets before generating code.
120
122
121
-
### Key Features of the Evaluation Code Gen Tool
123
+
### Key features of the Evaluation Code Gen tool
122
124
123
-
The Evaluation Code Gen Tool has four main features:
125
+
The Evaluation Code Gen tool has four main features:
124
126
125
-
- **Analysis and Metric Suggestion:** This feature reviews your AI app and suggests the best tests.
126
-
- **Synthetic Query Generation:** This feature creates test questions based on your testing goals.
127
-
- **Batch Application Execution:** This feature runs your app multiple times with test questions and collects results.
128
-
- **Evaluation Code Generation:** This feature generates test code using the Azure AI Eval SDK.
127
+
- **Analysis and metric suggestion:** Reviews your AI app and suggests the best tests.
128
+
- **Synthetic query generation:** Creates test questions based on your testing goals.
129
+
- **Batch application execution:** Runs your app multiple times with test questions and collects results.
130
+
- **Evaluation code generation:** Generates test code using the Azure AI Eval SDK.
129
131
130
-
These tools are helpful for everyone. New developers get guidance on tests and tools. Experienced developers save time. The Plan Tool finds your test files or asks where they are, making it easy to add testing to your app.
132
+
These tools are helpful regardless of your skill level. New developers get guidance on tests and tools, and experienced developers can save time. The Plan tool finds your test files or asks where they are, making it easy to add testing to your app.
131
133
132
134
Example requirement prompts:
133
135
134
136
- Example 1:
137
+
135
138
```text
136
139
Create an evaluation for my AI travel assistant application that assesses response accuracy and user satisfaction.
137
140
```
141
+
138
142
- Example 2:
143
+
139
144
```text
140
145
Measure the tool call accuracy of the agent.
141
146
```
142
147
143
-
## Tracing Code Gen Tool
148
+
## Tracing Code Gen tool
144
149
145
-
The **Tracing Code Gen** tool shares best practices for adding tracing to AI apps. It helps developers monitor and debug AI agents and workflows with ease.
150
+
The Tracing Code Gen tool shares best practices for adding tracing to AI apps. It helps developers monitor and debug AI agents and workflows with ease.
146
151
This tool supports local tracing for these languages and SDKs:
0 commit comments