Skip to content

Commit a93ac96

Browse files
authored
Merge pull request #4369 from ClickHouse/Blargian-patch-343485
Bug fix: update _clickpipes_faq.md
2 parents f0e42d4 + 88aa810 commit a93ac96

File tree

1 file changed

+145
-0
lines changed

1 file changed

+145
-0
lines changed
Lines changed: 145 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,145 @@
1+
import Image from '@theme/IdealImage';
2+
import clickpipesPricingFaq1 from '@site/static/images/cloud/manage/jan2025_faq/external_clickpipes_pricing_faq_1.png';
3+
import clickpipesPricingFaq2 from '@site/static/images/cloud/manage/jan2025_faq/external_clickpipes_pricing_faq_2.png';
4+
import clickpipesPricingFaq3 from '@site/static/images/cloud/manage/jan2025_faq/external_clickpipes_pricing_faq_3.png';
5+
6+
<details>
7+
8+
<summary>Why are we introducing a pricing model for ClickPipes now?</summary>
9+
10+
We decided to initially launch ClickPipes for free with the idea to gather
11+
feedback, refine features, and ensure it meets user needs.
12+
As the GA platform has grown, it has effectively stood the test of time by
13+
moving trillions of rows. Introducing a pricing model allows us to continue
14+
improving the service, maintaining the infrastructure, and providing dedicated
15+
support and new connectors.
16+
17+
</details>
18+
19+
<details>
20+
21+
<summary>What are ClickPipes replicas?</summary>
22+
23+
ClickPipes ingests data from remote data sources via a dedicated infrastructure
24+
that runs and scales independently of the ClickHouse Cloud service.
25+
For this reason, it uses dedicated compute replicas.
26+
The diagrams below show a simplified architecture.
27+
28+
For streaming ClickPipes, ClickPipes replicas access the remote data sources (e.g., a Kafka broker),
29+
pull the data, process and ingest it into the destination ClickHouse service.
30+
31+
<Image img={clickpipesPricingFaq1} size="lg" alt="ClickPipes Replicas - Streaming ClickPipes" border force/>
32+
33+
In the case of object storage ClickPipes,
34+
the ClickPipes replica orchestrates the data loading task
35+
(identifying files to copy, maintaining the state, and moving partitions),
36+
while the data is pulled directly from the ClickHouse service.
37+
38+
<Image img={clickpipesPricingFaq2} size="lg" alt="ClickPipes Replicas - Object Storage ClickPipes" border force/>
39+
40+
</details>
41+
42+
<details>
43+
44+
<summary>What's the default number of replicas and their size?</summary>
45+
46+
Each ClickPipe defaults to 1 replica that's provided with 2 GiB of RAM and 0.5 vCPU.
47+
This corresponds to **0.25** ClickHouse compute units (1 unit = 8 GiB RAM, 2 vCPUs).
48+
49+
</details>
50+
51+
<details>
52+
53+
<summary>Can ClickPipes replicas be scaled?</summary>
54+
55+
Yes, ClickPipes for streaming can be scaled both horizontally and vertically.
56+
Horizontal scaling adds more replicas to increase throughput, while vertical scaling increases the resources (CPU and RAM) allocated to each replica to handle more intensive workloads.
57+
This can be configured during ClickPipe creation, or at any other point under **Settings** -> **Advanced Settings** -> **Scaling**.
58+
59+
</details>
60+
61+
<details>
62+
63+
<summary>How many ClickPipes replicas do I need?</summary>
64+
65+
It depends on the workload throughput and latency requirements.
66+
We recommend starting with the default value of 1 replica, measuring your latency, and adding replicas if needed.
67+
Keep in mind that for Kafka ClickPipes, you also have to scale the Kafka broker partitions accordingly.
68+
The scaling controls are available under "settings" for each streaming ClickPipe.
69+
70+
<Image img={clickpipesPricingFaq3} size="lg" alt="ClickPipes Replicas - How many ClickPipes replicas do I need?" border force/>
71+
72+
</details>
73+
74+
<details>
75+
76+
<summary>What does the ClickPipes pricing structure look like?</summary>
77+
78+
It consists of two dimensions:
79+
- **Compute**: Price per unit per hour
80+
Compute represents the cost of running the ClickPipes replica pods whether they actively ingest data or not.
81+
It applies to all ClickPipes types.
82+
- **Ingested data**: per GB pricing
83+
The ingested data rate applies to all streaming ClickPipes
84+
(Kafka, Confluent, Amazon MSK, Amazon Kinesis, Redpanda, WarpStream,
85+
Azure Event Hubs) for the data transferred via the replica pods.
86+
The ingested data size (GB) is charged based on bytes received from the source (uncompressed or compressed).
87+
88+
</details>
89+
90+
<details>
91+
92+
<summary>What are the ClickPipes public prices?</summary>
93+
94+
- Compute: \$0.20 per unit per hour ($0.05 per replica per hour)
95+
- Ingested data: $0.04 per GB
96+
97+
</details>
98+
99+
<details>
100+
101+
<summary>How does it look in an illustrative example?</summary>
102+
103+
For example, ingesting 1 TB of data over 24 hours using the Kafka connector using a single replica (0.25 compute unit) costs:
104+
105+
$$
106+
(0.25 \times 0.20 \times 24) + (0.04 \times 1000) = \$41.2
107+
$$
108+
<br/>
109+
110+
For object storage connectors (S3 and GCS),
111+
only the ClickPipes compute cost is incurred since the ClickPipes pod is not processing data
112+
but only orchestrating the transfer which is operated by the underlying ClickHouse service:
113+
114+
$$
115+
0.25 \times 0,20 \times 24 = \$1.2
116+
$$
117+
118+
</details>
119+
120+
<details>
121+
122+
<summary>When does the new pricing model take effect?</summary>
123+
124+
The new pricing model takes effect for all organizations created after January 27th, 2025.
125+
126+
</details>
127+
128+
<details>
129+
130+
<summary>What happens to current users?</summary>
131+
132+
Existing users will have a **60-day grace period** where the ClickPipes service continues to be offered for free.
133+
Billing will automatically start for ClickPipes for existing users on **March 24th, 2025.**
134+
135+
</details>
136+
137+
<details>
138+
139+
<summary>How does ClickPipes pricing compare to the market?</summary>
140+
141+
The philosophy behind ClickPipes pricing is
142+
to cover the operating costs of the platform while offering an easy and reliable way to move data to ClickHouse Cloud.
143+
From that angle, our market analysis revealed that we are positioned competitively.
144+
145+
</details>

0 commit comments

Comments
 (0)