Skip to content

Conversation

@chenzl25
Copy link
Collaborator

Position delete writer overhaul:

  • Replaced the stale stub with a real PositionDeleteFileWriter built on RollingFileWriter, so positional deletes are written as proper Parquet files with correct Arrow schema, partition metadata, and
    CurrentFileStatus.
  • Added a small Arrow batch builder helper plus partition-aware close logic to tag returned DataFiles as PositionDeletes.
  • Introduced async unit tests for both unpartitioned and partitioned scenarios that round-trip through a Parquet writer and reuse check_parquet_data_file for verification.

@chenzl25 chenzl25 requested a review from Li0k November 13, 2025 08:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants