Skip to content

Commit d7196a4

Browse files
authored
Merge pull request #4453 from ClickHouse/tp/clickpipes-advanced-settings
Add clickpipes advanced settings docs
2 parents 8e377ee + 0dcdd04 commit d7196a4

File tree

2 files changed

+9
-0
lines changed

2 files changed

+9
-0
lines changed

docs/integrations/data-ingestion/clickpipes/index.md

Lines changed: 9 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -21,6 +21,7 @@ import Mongodbsvg from '@site/static/images/integrations/logos/mongodb.svg';
2121
import redpanda_logo from '@site/static/images/integrations/logos/logo_redpanda.png';
2222
import clickpipes_stack from '@site/static/images/integrations/data-ingestion/clickpipes/clickpipes_stack.png';
2323
import cp_custom_role from '@site/static/images/integrations/data-ingestion/clickpipes/cp_custom_role.png';
24+
import cp_advanced_settings from '@site/static/images/integrations/data-ingestion/clickpipes/cp_advanced_settings.png';
2425
import Image from '@theme/IdealImage';
2526

2627
# Integrating with ClickHouse Cloud
@@ -81,6 +82,14 @@ Steps:
8182

8283
<Image img={cp_custom_role} alt="Assign a custom role" size="lg" border/>
8384

85+
## Adjusting ClickPipes advanced settings {#clickpipes-advanced-settings}
86+
ClickPipes provides sensible defaults that cover the requirements of most use cases. If your use case requires additional fine-tuning, you can adjust the following settings:
87+
88+
- **Streaming max insert wait time**: Configures the maximum wait period before inserting data into the ClickHouse cluster. Applies to streaming ClickPipes (e.g., Kafka, Kinesis).
89+
- **Object storage polling interval**: Configures how frequently ClickPipes checks object storage for new data. Applies to object storage ClickPipes (e.g., S3, GCS).
90+
91+
<Image img={cp_advanced_settings} alt="Advanced settings for ClickPipes" size="lg" border/>
92+
8493
## Error reporting {#error-reporting}
8594
ClickPipes will store errors in two separate tables depending on the type of error encountered during the ingestion process.
8695
### Record Errors {#record-errors}
73.7 KB
Loading

0 commit comments

Comments
 (0)