Skip to content

Commit e390864

Browse files
palashgomaxvp
andauthored
[AI Gateway] Update changelog (#26728)
* [AI Gateway] Update changelog * chore: update ai-gateway release notes/partials codeowners * update codeowners * edit unified billing --------- Co-authored-by: Max Phillips <mphillips@cloudflare.com>
1 parent 96bf977 commit e390864

File tree

3 files changed

+95
-26
lines changed

3 files changed

+95
-26
lines changed

.github/CODEOWNERS

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -24,8 +24,9 @@
2424
/src/content/docs/workers-ai/ @rita3ko @craigsdennis @markdembo @mchenco @cloudflare/pcx-technical-writing
2525
/src/content/docs/vectorize/ @elithrar @vy-ton @sejoker @mchenco @cloudflare/pcx-technical-writing
2626
/src/content/partials/vectorize/ @elithrar @mchenco @sejoker @cloudflare/pcx-technical-writing
27+
/src/content/partials/ai-gateway/ @abhishekkankani @palashgo @thebongy @roerohan @kathayl @mchenco @cloudflare/pcx-technical-writing
2728
/src/content/release-notes/workers-ai.yaml @kathayl @mchenco @cloudflare/pcx-technical-writing
28-
/src/content/release-notes/ai-gateway.yaml @kathayl @mchenco @cloudflare/pcx-technical-writing
29+
/src/content/release-notes/ai-gateway.yaml @abhishekkankani @palashgo @thebongy @roerohan @kathayl @mchenco @cloudflare/pcx-technical-writing
2930
/src/content/release-notes/vectorize.yaml @elithrar @mchenco @sejoker @cloudflare/pcx-technical-writing
3031
/src/content/docs/ai-search/ @rita3ko @irvinebroque @aninibread @cloudflare/pcx-technical-writing
3132

Lines changed: 35 additions & 23 deletions
Original file line numberDiff line numberDiff line change
@@ -1,46 +1,57 @@
1-
21
---
32
pcx_content_type: configuration
43
title: Unified Billing
54
sidebar:
65
order: 1
6+
group:
7+
badge: Beta
78
head: []
89
description: Use the Cloudflare billing to pay for and authenticate your inference requests.
910
---
1011

11-
:::caution
12-
Unified Billing is in closed beta. Request for access.
13-
:::
12+
import { DashButton } from "~/components";
13+
14+
Unified Billing allows users to connect to various AI providers (such as OpenAI, Anthropic, and Google AI Studio) and receive a single Cloudflare bill. To use Unified Billing, you must purchase and load credits into your Cloudflare account in the Cloudflare dashboard, which you can then spend with AI Gateway.
15+
16+
## Pre-requisites
1417

15-
Unified Billing allows users to connect to various AI providers (e.g. OpenAI, Anthropic) and receive a single Cloudflare bill. To use Unified Billing, users must purchase and load credits into their Cloudflare account, via the Dashboard, which can then be spent via the AI Gateway.
18+
- Ensure your Cloudflare account has [sufficient credits loaded](#load-credits).
19+
- Ensure you have [authenticated](/ai-gateway/configuration/authentication/) your AI Gateway.
1620

21+
## Load credits
1722

18-
### Load credits
23+
To load credits for AI Gateway:
1924

20-
- Navigate to [AI Gateway](https://dash.cloudflare.com/?to=/:account/ai/ai-gateway) on Cloudflare dashboard
21-
- The "Credits Available" card on the top right shows how many AI gateway credits you have on your account currently.
22-
- Click "Manage" to navigate to the new billing page
23-
- If you don't have a payment method already on your account, you will be prompted to "Add a payment method to purchase credits" on top of page.
24-
- Once you have a card added, you will be able to do a credit top up on your account by clicking "Top-up credits", and then adding the required amount on the next popup.
25+
1. In the Cloudflare dashboard, go to the **AI Gateway** page.
2526

27+
<DashButton url="/?to=/:account/ai/ai-gateway" />
28+
29+
The **Credits Available** card on the top right shows how many AI gateway credits you have on your account currently.
30+
31+
2. In **Credits Available**, select **Manage**.
32+
3. If your account does not have an available payment method, AI Gateway will prompt you to add a payment method to purchase credits. Add a payment method.
33+
4. Select **Top-up credits**.
34+
5. Add the amount of credits you want to purchase, then select **Confirm and pay**.
2635

2736
### Auto-top up
2837

29-
- Navigate to [AI Gateway](https://dash.cloudflare.com/?to=/:account/ai/ai-gateway) on Cloudflare dashboard
30-
- Click "Manage" on the "Credits Available" card on the top right to navigate to the new billing page
31-
- Click the "Setup auto top-up credits" option on the dashboard, and set up a threshold and a recharge amount for auto topup.
38+
You can configure AI Gateway to automatically replenish your credits when they fall below a certain threshold. To configure auto top-up:
39+
40+
1. In the Cloudflare dashboard, go to the **AI Gateway** page.
3241

33-
When your balance falls below the given threshold, we will automatically apply the auto topup on your account.
42+
<DashButton url="/?to=/:account/ai/ai-gateway" />
3443

35-
### Using Unified Billing
44+
2. In **Credits Available**, select **Manage**.
45+
3. Select **Setup auto top-up credits**.
46+
4. Choose a threshold and a recharge amount for auto top-up.
3647

37-
#### Pre-requisites
48+
When your balance falls below the set threshold, AI Gateway will automatically apply the auto top-up amount to your account.
3849

39-
- Ensure your gateway is [authenticated](/ai-gateway/configuration/authentication/).
50+
## Use Unified Billing
4051

41-
Call any supported provider without passing any API Key. The request will automatically use Cloudflare's key and deduct credits from your account.
52+
Call any supported provider without passing an API Key. The request will automatically use Cloudflare's key and deduct credits from your account.
4253

43-
Example with Unified API:
54+
For example, you can use the Unified API:
4455

4556
```bash
4657
curl -X POST https://gateway.ai.cloudflare.com/v1/{account_id}/{gateway_id}/compat/chat/completions \
@@ -57,15 +68,16 @@ curl -X POST https://gateway.ai.cloudflare.com/v1/{account_id}/{gateway_id}/comp
5768
}'
5869
```
5970

60-
### Spend limit
71+
### Spend limits
6172

6273
Set spend limits to prevent unexpected charges on your loaded credits. You can define daily, weekly, or monthly limits. When a limit is reached, the AI Gateway automatically stops processing requests until the period resets or you increase the limit.
6374

75+
### Supported providers
6476

65-
### Supported Providers
77+
Unified Billing supports the following AI providers:
6678

6779
- [OpenAI](/ai-gateway/usage/providers/openai/)
6880
- [Anthropic](/ai-gateway/usage/providers/anthropic/)
6981
- [Google AI Studio](/ai-gateway/usage/providers/google-ai-studio/)
7082
- [xAI](/ai-gateway/usage/providers/grok/)
71-
- [Groq](/ai-gateway/usage/providers/groq/)
83+
- [Groq](/ai-gateway/usage/providers/groq/)

src/content/release-notes/ai-gateway.yaml

Lines changed: 58 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -3,14 +3,70 @@ link: "/ai-gateway/changelog/"
33
productName: AI Gateway
44
productLink: "/ai-gateway/"
55
entries:
6+
# - publish_date: "2025-11-25"
7+
# description: |-
8+
# New easy to use [utility](/ai-gateway/integrations/utility/) for simplified AI Gateway integration. Drop `useAIGateway({ binding: env.AI })` anwhere in any worker project and AI requests will be automatically routed through AI Gateway.
9+
- publish_date: "2025-11-21"
10+
description: |-
11+
Unified Billing now supports opt-in Zero Data Retention. This ensures supported upstream AI providers (eg [OpenAI ZDR](https://platform.openai.com/docs/guides/your-data#zero-data-retention)) do not retain request and response data.
12+
- publish_date: "2025-11-14"
13+
description: |-
14+
- Supports adding OpenAI compatible [Custom Providers](/ai-gateway/configuration/custom/) for inferencing with AI providers that are not natively supported by AI Gateway
15+
- Cost and usage tracking for voice models
16+
- You can now use Workers AI via AI Gateway with no additional configuration. Previously, this required generating / passing additional Workers AI tokens.
17+
- publish_date: "2025-11-06"
18+
title: Unified Billing
19+
description: |-
20+
- [Unified Billing](/ai-gateway/features/unified-billing/) is now in open beta. Connect multiple AI providers (e.g. OpenAI, Anthropic) without any additional setup and pay through a single Cloudflare invoice. To use it, purchase credits in the Cloudflare Dashboard and spend them across providers via AI Gateway.
21+
- publish_date: "2025-11-03"
22+
description: |-
23+
New supported providers
24+
- [Baseten](/ai-gateway/usage/providers/baseten/)
25+
- [Ideogram](/ai-gateway/usage/providers/ideogram/)
26+
- [Deepgram](/ai-gateway/usage/providers/deepgram/)
27+
28+
- publish_date: "2025-10-29"
29+
description: |-
30+
- Add support for pipecat model on Workers AI
31+
- Fix OpenAI realtime websocket authentication.
32+
- publish_date: "2025-10-24"
33+
description: |-
34+
- Added cost tracking and observability support for async video generation requests for OpenAI Sora 2 and Google AI Studio Veo 3.
35+
- `cf-aig-eventId` and `cf-aig-log-id` headers are now returned on all requests including failed requests
36+
- publish_date: "2025-10-14"
37+
description: The Model playground is now available in the AI Gateway Cloudflare Dashboard, allowing you to request and compare model behaviour across all models supported by AI Gateway.
38+
- publish_date: "2025-10-07"
39+
description: |-
40+
- Add support for [Deepgram on Workers AI](/ai-gateway/usage/websockets-api/realtime-api/#deepgram-workers-ai) using Websocket transport.
41+
- Added [Parallel](/ai-gateway/usage/providers/parallel/) as a provider.
42+
- publish_date: "2025-09-24"
43+
title: OTEL Tracing
44+
description: |-
45+
Added OpenTelemetry (OTEL) tracing export for better observability and debugging of AI Gateway requests.
46+
47+
- publish_date: "2025-09-21"
48+
description: |-
49+
- Added support for [Fal AI](/ai-gateway/usage/providers/fal/) provider.
50+
- You can now set up custom Stripe usage reporting, and report usage and costs for your users directly to Stripe from AI Gateway.
51+
- Fixed incorrectly geoblocked requests for certain regions.
52+
53+
- publish_date: "2025-09-19"
54+
description: |-
55+
- New API endpoint (`/compat/v1/models`) for listing available models along with their costs.
56+
- Unified API now supports Google Vertex AI providers and all their models.
57+
- BYOK support for requests using WebSocket transport.
58+
- publish_date: "2025-08-28"
59+
title: Data Loss Prevention
60+
description: |-
61+
[Data loss prevention](/ai-gateway/features/dlp/) capabilities are now available to scan both incoming prompts and outgoing AI responses for sensitive information, ensuring your AI applications maintain security and compliance standards.
662
- publish_date: "2025-08-25"
763
title: Dynamic routing
864
description: |-
9-
Introduced [Dynamic routing](/ai-gateway/routing/dynamic-routing/) to help manage AI provider interactions effectively, ensuring your applications remain responsive and reliable.
65+
Introduced [Dynamic routing](/ai-gateway/routing/dynamic-routing/) that lets you visually or via JSON define flexible request flows that segment users, enforce quotas, and choose models with fallbacks—without changing application code.
1066
- publish_date: "2025-08-21"
1167
title: Bring your own keys (BYOK)
1268
description: |-
13-
Introduced [Bring your own keys (BYOK)](/ai-gateway/configuration/byok/) allowing you to save your ai provider keys directly in the AI Gateway dashboard.
69+
Introduced [Bring your own keys (BYOK)](/ai-gateway/configuration/bring-your-own-keys/) allowing you to save your AI provider keys securely with Cloudflare Secret Store and manage them through the Cloudflare dashboard.
1470
- publish_date: "2025-06-18"
1571
title: New GA providers
1672
description: |-

0 commit comments

Comments
 (0)