|
| 1 | +import Image from '@theme/IdealImage'; |
| 2 | +import clickpipesPricingFaq1 from '@site/static/images/cloud/manage/jan2025_faq/external_clickpipes_pricing_faq_1.png'; |
| 3 | +import clickpipesPricingFaq2 from '@site/static/images/cloud/manage/jan2025_faq/external_clickpipes_pricing_faq_2.png'; |
| 4 | +import clickpipesPricingFaq3 from '@site/static/images/cloud/manage/jan2025_faq/external_clickpipes_pricing_faq_3.png'; |
| 5 | + |
| 6 | +<details> |
| 7 | + |
| 8 | +<summary>Why are we introducing a pricing model for ClickPipes now?</summary> |
| 9 | + |
| 10 | +We decided to initially launch ClickPipes for free with the idea to gather |
| 11 | +feedback, refine features, and ensure it meets user needs. |
| 12 | +As the GA platform has grown, it has effectively stood the test of time by |
| 13 | +moving trillions of rows. Introducing a pricing model allows us to continue |
| 14 | +improving the service, maintaining the infrastructure, and providing dedicated |
| 15 | +support and new connectors. |
| 16 | + |
| 17 | +</details> |
| 18 | + |
| 19 | +<details> |
| 20 | + |
| 21 | +<summary>What are ClickPipes replicas?</summary> |
| 22 | + |
| 23 | +ClickPipes ingests data from remote data sources via a dedicated infrastructure |
| 24 | +that runs and scales independently of the ClickHouse Cloud service. |
| 25 | +For this reason, it uses dedicated compute replicas. |
| 26 | +The diagrams below show a simplified architecture. |
| 27 | + |
| 28 | +For streaming ClickPipes, ClickPipes replicas access the remote data sources (e.g., a Kafka broker), |
| 29 | +pull the data, process and ingest it into the destination ClickHouse service. |
| 30 | + |
| 31 | +<Image img={clickpipesPricingFaq1} size="lg" alt="ClickPipes Replicas - Streaming ClickPipes" border force/> |
| 32 | + |
| 33 | +In the case of object storage ClickPipes, |
| 34 | +the ClickPipes replica orchestrates the data loading task |
| 35 | +(identifying files to copy, maintaining the state, and moving partitions), |
| 36 | +while the data is pulled directly from the ClickHouse service. |
| 37 | + |
| 38 | +<Image img={clickpipesPricingFaq2} size="lg" alt="ClickPipes Replicas - Object Storage ClickPipes" border force/> |
| 39 | + |
| 40 | +</details> |
| 41 | + |
| 42 | +<details> |
| 43 | + |
| 44 | +<summary>What's the default number of replicas and their size?</summary> |
| 45 | + |
| 46 | +Each ClickPipe defaults to 1 replica that's provided with 2 GiB of RAM and 0.5 vCPU. |
| 47 | +This corresponds to **0.25** ClickHouse compute units (1 unit = 8 GiB RAM, 2 vCPUs). |
| 48 | + |
| 49 | +</details> |
| 50 | + |
| 51 | +<details> |
| 52 | + |
| 53 | +<summary>Can ClickPipes replicas be scaled?</summary> |
| 54 | + |
| 55 | +Yes, ClickPipes for streaming can be scaled both horizontally and vertically. |
| 56 | +Horizontal scaling adds more replicas to increase throughput, while vertical scaling increases the resources (CPU and RAM) allocated to each replica to handle more intensive workloads. |
| 57 | +This can be configured during ClickPipe creation, or at any other point under **Settings** -> **Advanced Settings** -> **Scaling**. |
| 58 | + |
| 59 | +</details> |
| 60 | + |
| 61 | +<details> |
| 62 | + |
| 63 | +<summary>How many ClickPipes replicas do I need?</summary> |
| 64 | + |
| 65 | +It depends on the workload throughput and latency requirements. |
| 66 | +We recommend starting with the default value of 1 replica, measuring your latency, and adding replicas if needed. |
| 67 | +Keep in mind that for Kafka ClickPipes, you also have to scale the Kafka broker partitions accordingly. |
| 68 | +The scaling controls are available under "settings" for each streaming ClickPipe. |
| 69 | + |
| 70 | +<Image img={clickpipesPricingFaq3} size="lg" alt="ClickPipes Replicas - How many ClickPipes replicas do I need?" border force/> |
| 71 | + |
| 72 | +</details> |
| 73 | + |
| 74 | +<details> |
| 75 | + |
| 76 | +<summary>What does the ClickPipes pricing structure look like?</summary> |
| 77 | + |
| 78 | +It consists of two dimensions: |
| 79 | +- **Compute**: Price per unit per hour |
| 80 | + Compute represents the cost of running the ClickPipes replica pods whether they actively ingest data or not. |
| 81 | + It applies to all ClickPipes types. |
| 82 | +- **Ingested data**: per GB pricing |
| 83 | + The ingested data rate applies to all streaming ClickPipes |
| 84 | + (Kafka, Confluent, Amazon MSK, Amazon Kinesis, Redpanda, WarpStream, |
| 85 | + Azure Event Hubs) for the data transferred via the replica pods. |
| 86 | + The ingested data size (GB) is charged based on bytes received from the source (uncompressed or compressed). |
| 87 | + |
| 88 | +</details> |
| 89 | + |
| 90 | +<details> |
| 91 | + |
| 92 | +<summary>What are the ClickPipes public prices?</summary> |
| 93 | + |
| 94 | +- Compute: \$0.20 per unit per hour ($0.05 per replica per hour) |
| 95 | +- Ingested data: $0.04 per GB |
| 96 | + |
| 97 | +</details> |
| 98 | + |
| 99 | +<details> |
| 100 | + |
| 101 | +<summary>How does it look in an illustrative example?</summary> |
| 102 | + |
| 103 | +For example, ingesting 1 TB of data over 24 hours using the Kafka connector using a single replica (0.25 compute unit) costs: |
| 104 | + |
| 105 | +$$ |
| 106 | +(0.25 \times 0.20 \times 24) + (0.04 \times 1000) = \$41.2 |
| 107 | +$$ |
| 108 | +<br/> |
| 109 | + |
| 110 | +For object storage connectors (S3 and GCS), |
| 111 | +only the ClickPipes compute cost is incurred since the ClickPipes pod is not processing data |
| 112 | +but only orchestrating the transfer which is operated by the underlying ClickHouse service: |
| 113 | + |
| 114 | +$$ |
| 115 | +0.25 \times 0,20 \times 24 = \$1.2 |
| 116 | +$$ |
| 117 | + |
| 118 | +</details> |
| 119 | + |
| 120 | +<details> |
| 121 | + |
| 122 | +<summary>When does the new pricing model take effect?</summary> |
| 123 | + |
| 124 | +The new pricing model takes effect for all organizations created after January 27th, 2025. |
| 125 | + |
| 126 | +</details> |
| 127 | + |
| 128 | +<details> |
| 129 | + |
| 130 | +<summary>What happens to current users?</summary> |
| 131 | + |
| 132 | +Existing users will have a **60-day grace period** where the ClickPipes service continues to be offered for free. |
| 133 | +Billing will automatically start for ClickPipes for existing users on **March 24th, 2025.** |
| 134 | + |
| 135 | +</details> |
| 136 | + |
| 137 | +<details> |
| 138 | + |
| 139 | +<summary>How does ClickPipes pricing compare to the market?</summary> |
| 140 | + |
| 141 | +The philosophy behind ClickPipes pricing is |
| 142 | +to cover the operating costs of the platform while offering an easy and reliable way to move data to ClickHouse Cloud. |
| 143 | +From that angle, our market analysis revealed that we are positioned competitively. |
| 144 | + |
| 145 | +</details> |
0 commit comments