Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
50 commits
Select commit Hold shift + click to select a range
856597b
feat(writer): Add clustered and fanout writer (#1735)
CTTY Oct 17, 2025
826d98f
feat(catalog): impl builder for SqlCatalog (#1666)
335g Oct 17, 2025
fa07ec6
fix: fix read parquert file when schema change (#1750)
chenzl25 Oct 17, 2025
5c6907a
Concentrated Storage trait, need to fix a lot
CTTY Sep 12, 2025
9a27198
pure storage, fixed compile issues
CTTY Sep 17, 2025
535de90
fmt is good
CTTY Sep 17, 2025
901db63
builder, registry, split by schemes
CTTY Oct 17, 2025
e5516b8
Cleanup OpenDALStorage enum
CTTY Oct 17, 2025
f065f8b
clean up
CTTY Oct 17, 2025
3b161ed
minor
CTTY Oct 17, 2025
9b5c1aa
encapsulate input and output file better
CTTY Oct 17, 2025
f0bd0ab
add with_registry
CTTY Oct 17, 2025
463c545
minor
CTTY Oct 17, 2025
96fe4a0
minor
CTTY Oct 17, 2025
cf6998e
Pass scheme strings cleanly
CTTY Oct 18, 2025
a46f947
daily fmt fix
CTTY Oct 18, 2025
790e025
docs: Fix broken orbstack and podman links in CONTRIBUTING.md (#1757)
petern48 Oct 18, 2025
12f2060
optimize tests
CTTY Oct 18, 2025
1ae79f8
fmt fix
CTTY Oct 18, 2025
1543554
Merge branch 'main' into ctty/storage-trait
CTTY Oct 18, 2025
b7d7937
minor
CTTY Oct 18, 2025
c2b5c83
minor againnnn
CTTY Oct 18, 2025
2861dab
chore(deps): Bump tokio from 1.47.1 to 1.48.0 (#1763)
dependabot[bot] Oct 19, 2025
1244acd
chore(deps): Bump backon from 1.5.2 to 1.6.0 (#1762)
dependabot[bot] Oct 19, 2025
d33f3bb
fix: global eq delete matching should apply to only strictly older fi…
amogh-jahagirdar Oct 20, 2025
777d9dc
chore(deps): Bump apache/skywalking-eyes from 0.7.0 to 0.8.0 (#1760)
dependabot[bot] Oct 21, 2025
4d20ff0
chore(deps): Bump rust_decimal from 1.38.0 to 1.39.0 (#1761)
dependabot[bot] Oct 21, 2025
b3b5afe
feat(datafusion): implement the project node to add the partition col…
fvaleye Oct 21, 2025
3aa7ade
fix: snapshot was producing empty summary (#1767)
imor Oct 22, 2025
915778e
docs: Add examples for PartitioningWriter (#1754)
CTTY Oct 22, 2025
406d416
feat(sqllogictest): Add support for iceberg datafusion sqllogictest i…
lliangyu-lin Oct 24, 2025
ddbcae4
fix(build): Pin home version after merging #1764 (#1783)
mbutrovich Oct 24, 2025
104a016
minor: Update Cargo.lock to add home (#1785)
CTTY Oct 27, 2025
1691419
chore(deps): Bump aws-sdk-s3tables from 1.40.0 to 1.41.0 (#1790)
dependabot[bot] Oct 27, 2025
0141385
chore(deps): Bump rand from 0.8.5 to 0.9.2 (#1789)
dependabot[bot] Oct 27, 2025
f1b1ddf
chore(deps): Bump actions/download-artifact from 5 to 6 (#1788)
dependabot[bot] Oct 27, 2025
044b45b
chore(deps): Bump actions/upload-artifact from 4 to 5 (#1787)
dependabot[bot] Oct 27, 2025
cd60057
fix(reader): filter row groups when FileScanTask contains byte ranges…
mbutrovich Oct 27, 2025
0a06c3e
refactor(arrow,datafusion): Reuse PartitionValueCalculator in RecordB…
CTTY Oct 28, 2025
127eeb8
feat: Update Datafusion to v49 (#1704)
DerGut Oct 28, 2025
16ddd0e
deps: unpin pydantic (#1793)
kevinjqliu Oct 28, 2025
b20a255
feat(reader): Add Date32 support to RecordBatchTransformer create_col…
mbutrovich Oct 28, 2025
87acf3c
feat(catalog): Implement update_table for S3TablesCatalog (#1594)
CTTY Oct 28, 2025
4a6ea15
feat: Update Datafusion to v50 (#1728)
DerGut Oct 28, 2025
a76e738
ci: Migrate to uv for python (#1796)
Xuanwo Oct 29, 2025
3cb18e7
ci: Relax msrv check thanks to rust 2024 (#1795)
Xuanwo Oct 29, 2025
f10c0ab
ci: Don't dismiss stale review to make contribution easier (#1799)
Xuanwo Oct 29, 2025
b2c41fc
Merge branch 'main' into ctty/storage-trait
CTTY Oct 29, 2025
d3d3127
add Makefile to bindings/python (#1800)
kevinjqliu Oct 29, 2025
569736e
Merge branch 'main' into ctty/storage-trait
CTTY Oct 29, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .asf.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -40,7 +40,7 @@ github:

required_pull_request_reviews:
required_approving_review_count: 1
dismiss_stale_reviews: true
dismiss_stale_reviews: false

required_linear_history: true
del_branch_on_merge: true
Expand Down
31 changes: 23 additions & 8 deletions .github/workflows/bindings_python_ci.yml
Original file line number Diff line number Diff line change
Expand Up @@ -56,17 +56,21 @@ jobs:
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v5
- uses: astral-sh/setup-uv@v6
with:
version: "0.9.3"
enable-cache: true
- name: Install tools
run: |
pip install ruff
uv tool install ruff
- name: Check format
working-directory: "bindings/python"
run: |
ruff format . --diff
uvx ruff format . --diff
- name: Check style
working-directory: "bindings/python"
run: |
ruff check .
uvx ruff check .

test:
runs-on: ${{ matrix.os }}
Expand All @@ -80,17 +84,28 @@ jobs:
- uses: actions/checkout@v5
- uses: actions/setup-python@v6
with:
python-version: 3.9
python-version: 3.12
- uses: PyO3/maturin-action@v1
with:
working-directory: "bindings/python"
command: build
args: --out dist --sdist
- uses: astral-sh/setup-uv@v6
with:
version: "0.9.3"
enable-cache: true
- name: Sync dependencies
working-directory: "bindings/python"
shell: bash
run: |
make install
- name: Install built wheel
working-directory: "bindings/python"
shell: bash
run: |
uv pip install --reinstall dist/pyiceberg_core-*.whl
- name: Run tests
working-directory: "bindings/python"
shell: bash
run: |
set -e
pip install hatch==1.12.0
hatch run dev:pip install dist/pyiceberg_core-*.whl --force-reinstall
hatch run dev:test
make test
14 changes: 13 additions & 1 deletion .github/workflows/ci.yml
Original file line number Diff line number Diff line change
Expand Up @@ -58,7 +58,7 @@ jobs:
uses: ./.github/actions/setup-builder

- name: Check License Header
uses: apache/skywalking-eyes/header@v0.7.0
uses: apache/skywalking-eyes/header@v0.8.0

- name: Check toml format
run: make check-toml
Expand Down Expand Up @@ -89,6 +89,18 @@ jobs:
- macos-latest
- windows-latest
steps:
- name: Maximize build space (Ubuntu)
if: matrix.os == 'ubuntu-latest'
uses: easimon/maximize-build-space@master
with:
remove-dotnet: "true"
remove-android: "true"
remove-haskell: "true"
remove-codeql: "true"
remove-docker-images: "true"
root-reserve-mb: 10240
temp-reserve-mb: 10240

- uses: actions/checkout@v5

- name: Setup Rust toolchain
Expand Down
6 changes: 3 additions & 3 deletions .github/workflows/release_python.yml
Original file line number Diff line number Diff line change
Expand Up @@ -107,7 +107,7 @@ jobs:
command: sdist
args: -o dist
- name: Upload sdist
uses: actions/upload-artifact@v4
uses: actions/upload-artifact@v5
with:
name: wheels-sdist
path: bindings/python/dist
Expand Down Expand Up @@ -159,7 +159,7 @@ jobs:
command: build
args: --release -o dist
- name: Upload wheels
uses: actions/upload-artifact@v4
uses: actions/upload-artifact@v5
with:
name: wheels-${{ matrix.os }}-${{ matrix.target }}
path: bindings/python/dist
Expand All @@ -178,7 +178,7 @@ jobs:

steps:
- name: Download all the dists
uses: actions/download-artifact@v5
uses: actions/download-artifact@v6
with:
pattern: wheels-*
merge-multiple: true
Expand Down
6 changes: 3 additions & 3 deletions .github/workflows/release_python_nightly.yml
Original file line number Diff line number Diff line change
Expand Up @@ -56,7 +56,7 @@ jobs:
args: -o dist

- name: Upload sdist
uses: actions/upload-artifact@v4
uses: actions/upload-artifact@v5
with:
name: wheels-sdist
path: bindings/python/dist
Expand Down Expand Up @@ -102,7 +102,7 @@ jobs:
args: --release -o dist

- name: Upload wheels
uses: actions/upload-artifact@v4
uses: actions/upload-artifact@v5
with:
name: wheels-${{ matrix.os }}-${{ matrix.target }}
path: bindings/python/dist
Expand All @@ -120,7 +120,7 @@ jobs:

steps:
- name: Download all the dists
uses: actions/download-artifact@v5
uses: actions/download-artifact@v6
with:
pattern: wheels-*
merge-multiple: true
Expand Down
19 changes: 10 additions & 9 deletions .licenserc.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -21,16 +21,17 @@ header:
copyright-owner: Apache Software Foundation

paths-ignore:
- 'LICENSE'
- 'NOTICE'
- '.gitattributes'
- '**/*.json'
- "LICENSE"
- "NOTICE"
- ".gitattributes"
- "**/*.json"
# Generated content by mdbook
- 'website/book'
- "website/book"
# Generated content by scripts
- '**/DEPENDENCIES.*.tsv'
- "**/DEPENDENCIES.*.tsv"
# Release distributions
- 'dist/*'
- 'Cargo.lock'
- '.github/PULL_REQUEST_TEMPLATE.md'
- "dist/*"
- "Cargo.lock"
- "bindings/python/uv.lock"
- ".github/PULL_REQUEST_TEMPLATE.md"
comment: on-failure
4 changes: 2 additions & 2 deletions CONTRIBUTING.md
Original file line number Diff line number Diff line change
Expand Up @@ -103,8 +103,8 @@ cargo 1.69.0 (6e9a83356 2023-04-12)

Currently, iceberg-rust uses Docker to set up environment for integration tests. Native Docker has some limitations, please check (https://github.com/apache/iceberg-rust/pull/748). Please use Orbstack or Podman.

For MacOS users, you can install [OrbStack as a docker alternative](reference/orbstack.md).
For Podman users, refer to [Using Podman instead of Docker](reference/podman.md)
For MacOS users, you can install [OrbStack as a docker alternative](website/src/reference/orbstack.md).
For Podman users, refer to [Using Podman instead of Docker](website/src/reference/podman.md)

## Build

Expand Down
Loading
Loading