Skip to content

Conversation

@geruh
Copy link
Owner

@geruh geruh commented Nov 4, 2025

Rationale for this change

Are these changes tested?

Are there any user-facing changes?

Anton-Tarazi and others added 15 commits November 2, 2025 16:34
<!--
Thanks for opening a pull request!
-->

<!-- In the case this PR will resolve an issue, please replace
${GITHUB_ISSUE_ID} below with the actual Github issue id. -->
<!-- Closes #${GITHUB_ISSUE_ID} -->

Resolves apache#2673

# Rationale for this change

`_SnapshotProducer._summary()` copies the metadata for _every_ added /
deleted DataFile. This is pretty expensive. Instead we just copy it once
at the beginning of the function and use the same value each DataFile.

On my data, which overwrites a few million rows at a time, I saw the
time for `table.overwrite` go from ~20 seconds to ~6 seconds.

## Are these changes tested?

Yes, existing unit / integration tests

## Are there any user-facing changes?

Just faster writes :)

<!-- In the case of user-facing changes, please add the changelog label.
-->
# Rationale for this change

Nightly build has been failing for some time since dropping support
[python 3.9
support.](https://github.com/apache/iceberg-python/pull/2554/files#diff-edbf927c810f310a669913604ffe71ffaecea1b9ef73f137f9d469491ea1c3d9L72)
That PR included a change that dropped the upper bound of the python
version.

```
-        CIBW_PROJECT_REQUIRES_PYTHON: ">=3.9,<3.13"
+        CIBW_PROJECT_REQUIRES_PYTHON: ">=3.10"
```


That made cibuildwheel try Python 3.14 and sometimes the free-threaded
*t builds. Those are part of the PEP 703 effort to allow Python without
the GIL. Therefore, the avro related code would throw a message breaking
the build and I don't think this has been evaluated yet. So this change
adds `CIBW_SKIP: "cp3*t-*" ` to skip free-threaded ABIs for now, and we
can continue building on new regular CPythons while avoiding PEP 703
no-GIL builds.

Bulld failures:
-
https://github.com/apache/iceberg-python/actions/workflows/nightly-pypi-build.yml

```
   ../venv-test-arm64/lib/python3.14t/site-packages/_pytest/assertion/rewrite.py:178: in exec_module
      exec(co, module.__dict__)
  /Users/runner/work/iceberg-python/iceberg-python/tests/avro/test_decoder.py:29: in <module>
      from pyiceberg.avro.decoder_fast import CythonBinaryDecoder
  E   RuntimeWarning: The global interpreter lock (GIL) has been enabled to load module 'pyiceberg.avro.decoder_fast', which has not declared that it can run safely without the GIL. To override this behavior and keep the GIL disabled (at your own risk), run with PYTHON_GIL=0 or -Xgil=0.
  =========================== short test summary info ============================
  ERROR ../../../../../../../../../Users/runner/work/iceberg-python/iceberg-python/tests/avro/test_decoder.py - RuntimeWarning: The global interpreter lock (GIL) has been enabled to load module 'pyiceberg.avro.decoder_fast', which has not declared that it can run safely without the GIL. To override this behavior and keep the GIL disabled (at your own risk), run with PYTHON_GIL=0 or -Xgil=0.
  !!!!!!!!!!!!!!!!!!!! Interrupted: 1 error during collection !!!!!!!!!!!!!!!!!!!!
  =============================== 1 error in 0.13s ===============================

```

## Are these changes tested?
Yes

## Are there any user-facing changes?
No
… pressure (apache#2671)

# Rationale for this change

When writing to partitioned tables, there is a large memory spike when
the partitions are computed because we `.combine_chunks()` on the new
partitioned arrow tables and we materialize the entire list of
partitions before writing data files.

This PR switches the partition computation to a generator to avoid
materializing all the partitions in memory at once, reducing the memory
overhead of writing to partitioned tables.

## Are these changes tested?

No new tests. The tests using this method were updated to consume the
generator as a list.

However, in my personal use case, I am using
`pa.total_allocated_bytes()` to determine memory allocation before and
after the write and see the following across 5 writes of ~128 MB:

| Run | Original Impl (Before Write) | Original Impl (After Write) |
Iters (Before Write) | Iters (After Write) |
|---|---|---|---|---|
| 1 | 29.31 MB | 151.62 MB | 28.38 MB | 30.40 MB |
| 2 | 27.74 MB | 151.62 MB | 28.85 MB | 30.36 MB |
| 3 | 28.81 MB | 151.62 MB | 28.52 MB | 31.29 MB |
| 4 | 28.71 MB | 151.62 MB | 29.27 MB | 30.64 MB |
| 5 | 28.60 MB | 151.61 MB | 28.29 MB | 31.11 MB |

This scales with the size of the write: if I want to write a 3 GB arrow
table to a partitioned table, I need at least 6 GB RAM.

## Are there any user-facing changes?

No.
Closes apache#2672

  # Rationale for this change

When performing column projection on partitioned tables with schema
evolution, PyIceberg incorrectly uses the projected schema (containing
only selected columns) instead
of the full table schema when building partition types in
`_get_column_projection_values()`. This causes `ValueError: Could not
find field with id: X` when:

  1. Reading from partitioned Iceberg tables
2. Using column projection (selecting specific columns, not `SELECT *`)
  3. Selected columns do NOT include the partition field(s)
4. The table has undergone schema evolution (fields added/removed after
initial creation)
5. Reading files that are missing some of the selected columns (written
before schema evolution)

The root cause is where
`partition_spec.partition_type(projected_schema)` fails because the
projected schema may be missing fields that
  exist in the partition specification.

The fix passes the full table schema from
`ArrowScan._table_metadata.schema()` through `_task_to_record_batches()`
to `_get_column_projection_values()`, ensuring all fields are available
when building partition accessors.

  ## Are these changes tested?

Yes. Added a test
`test_partition_column_projection_with_schema_evolution` that:
  - Creates a partitioned table with initial schema
  - Writes data with the initial schema
  - Evolves the schema by adding a new column
  - Writes data with the evolved schema
  - Performs column projection that excludes the partition field

  ## Are there any user-facing changes?

  No. Only internal helpers are changed
Bumps [huggingface-hub](https://github.com/huggingface/huggingface_hub)
from 1.0.0 to 1.0.1.
<details>
<summary>Release notes</summary>
<p><em>Sourced from <a
href="https://github.com/huggingface/huggingface_hub/releases">huggingface-hub's
releases</a>.</em></p>
<blockquote>
<h2>[v1.0.1] Remove <code>aiohttp</code> from extra dependencies</h2>
<p>In <code>huggingface_hub</code> v1.0 release, we've removed our
dependency on <code>aiohttp</code> to replace it with <code>httpx</code>
but we forgot to remove it from the
<code>huggingface_hub[inference]</code> extra dependencies in
<code>setup.py</code>. This patch release removes it, making the
<code>inference</code> extra removed as well.</p>
<p>The internal method <code>_import_aiohttp</code> being unused, it has
been removed as well.</p>
<ul>
<li>Remove aiohttp dependency by <a
href="https://github.com/Wauplin"><code>@​Wauplin</code></a> in <a
href="https://redirect.github.com/huggingface/huggingface_hub/issues/3488">#3488</a></li>
</ul>
<p><strong>Full Changelog</strong>: <a
href="https://github.com/huggingface/huggingface_hub/compare/v1.0.0...v1.0.1">https://github.com/huggingface/huggingface_hub/compare/v1.0.0...v1.0.1</a></p>
</blockquote>
</details>
<details>
<summary>Commits</summary>
<ul>
<li><a
href="https://github.com/huggingface/huggingface_hub/commit/c8b9350621d44f231b95f086fa0d92769846825c"><code>c8b9350</code></a>
Release: v1.0.1</li>
<li><a
href="https://github.com/huggingface/huggingface_hub/commit/675e461d1861756f660b0c25c189c7b8e96d0eae"><code>675e461</code></a>
Remove aiohttp dependency (<a
href="https://redirect.github.com/huggingface/huggingface_hub/issues/3488">#3488</a>)</li>
<li>See full diff in <a
href="https://github.com/huggingface/huggingface_hub/compare/v1.0.0...v1.0.1">compare
view</a></li>
</ul>
</details>
<br />


[![Dependabot compatibility
score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=huggingface-hub&package-manager=pip&previous-version=1.0.0&new-version=1.0.1)](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores)

Dependabot will resolve any conflicts with this PR as long as you don't
alter it yourself. You can also trigger a rebase manually by commenting
`@dependabot rebase`.

[//]: # (dependabot-automerge-start)
[//]: # (dependabot-automerge-end)

---

<details>
<summary>Dependabot commands and options</summary>
<br />

You can trigger Dependabot actions by commenting on this PR:
- `@dependabot rebase` will rebase this PR
- `@dependabot recreate` will recreate this PR, overwriting any edits
that have been made to it
- `@dependabot merge` will merge this PR after your CI passes on it
- `@dependabot squash and merge` will squash and merge this PR after
your CI passes on it
- `@dependabot cancel merge` will cancel a previously requested merge
and block automerging
- `@dependabot reopen` will reopen this PR if it is closed
- `@dependabot close` will close this PR and stop Dependabot recreating
it. You can achieve the same result by closing it manually
- `@dependabot show <dependency name> ignore conditions` will show all
of the ignore conditions of the specified dependency
- `@dependabot ignore this major version` will close this PR and stop
Dependabot creating any more for this major version (unless you reopen
the PR or upgrade to it yourself)
- `@dependabot ignore this minor version` will close this PR and stop
Dependabot creating any more for this minor version (unless you reopen
the PR or upgrade to it yourself)
- `@dependabot ignore this dependency` will close this PR and stop
Dependabot creating any more for this dependency (unless you reopen the
PR or upgrade to it yourself)


</details>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Bumps [mkdocs-material](https://github.com/squidfunk/mkdocs-material)
from 9.6.22 to 9.6.23.
<details>
<summary>Release notes</summary>
<p><em>Sourced from <a
href="https://github.com/squidfunk/mkdocs-material/releases">mkdocs-material's
releases</a>.</em></p>
<blockquote>
<h2>mkdocs-material-9.6.23</h2>
<ul>
<li>Updated Burmese translation</li>
</ul>
</blockquote>
</details>
<details>
<summary>Changelog</summary>
<p><em>Sourced from <a
href="https://github.com/squidfunk/mkdocs-material/blob/master/CHANGELOG">mkdocs-material's
changelog</a>.</em></p>
<blockquote>
<p>mkdocs-material-9.6.23 (2025-11-01)</p>
<ul>
<li>Updated Burmese translation</li>
</ul>
<p>mkdocs-material-9.6.22 (2025-10-15)</p>
<ul>
<li>Updated Georgian translation</li>
</ul>
<p>mkdocs-material-9.6.21 (2025-09-30)</p>
<ul>
<li>Updated Serbian translations</li>
<li>Fixed <a
href="https://redirect.github.com/squidfunk/mkdocs-material/issues/8458">#8458</a>:
Temporary pin of click dependency</li>
</ul>
<p>mkdocs-material-9.6.20 (2025-09-15)</p>
<ul>
<li>Fixed <a
href="https://redirect.github.com/squidfunk/mkdocs-material/issues/8446">#8446</a>:
Deprecation warning as of Python 3.14 in Emoji extension</li>
<li>Fixed <a
href="https://redirect.github.com/squidfunk/mkdocs-material/issues/8440">#8440</a>:
<code>&amp;</code> character not escaped in search highlighting</li>
<li>Fixed <a
href="https://redirect.github.com/squidfunk/mkdocs-material/issues/8439">#8439</a>:
FontAwesome icons color not set in social cards (regression)</li>
</ul>
<p>mkdocs-material-9.6.19 (2025-09-07)</p>
<ul>
<li>Added support for Python 3.14</li>
<li>Updated Bahasa Malaysia translations</li>
</ul>
<p>mkdocs-material-9.6.18 (2025-08-22)</p>
<ul>
<li>Updated Azerbaijani translations</li>
<li>Fixed last compat issues with [minijinja], now 100% compatible</li>
</ul>
<p>mkdocs-material-9.6.17 (2025-08-15)</p>
<ul>
<li>Fixed <a
href="https://redirect.github.com/squidfunk/mkdocs-material/issues/8396">#8396</a>:
Videos do not autoplay when inside a content tab</li>
<li>Fixed <a
href="https://redirect.github.com/squidfunk/mkdocs-material/issues/8394">#8394</a>:
Stroke width not effective in Mermaid.js diagrams</li>
<li>Fixed disappearing version selector when hiding page title</li>
</ul>
<p>mkdocs-material-9.6.16 (2025-07-26)</p>
<ul>
<li>Fixed <a
href="https://redirect.github.com/squidfunk/mkdocs-material/issues/8349">#8349</a>:
Info plugin doesn't correctly detect virtualenv in some cases</li>
<li>Fixed <a
href="https://redirect.github.com/squidfunk/mkdocs-material/issues/8334">#8334</a>:
Find-in-page detects matches in hidden search result list</li>
</ul>
<p>mkdocs-material-9.6.15 (2025-07-01)</p>
<ul>
<li>Updated Mongolian translations</li>
<li>Improved semantic markup of &quot;edit this page&quot; button</li>
<li>Improved info plugin virtual environment resolution</li>
<li>Fixed <a
href="https://redirect.github.com/squidfunk/mkdocs-material/issues/8291">#8291</a>:
Large font size setting throws of breakpoints in JavaScript</li>
</ul>
<p>mkdocs-material-9.6.14 (2025-05-13)</p>
<ul>
<li>Fixed <a
href="https://redirect.github.com/squidfunk/mkdocs-material/issues/8215">#8215</a>:
Social plugin crashes when CairoSVG is updated to 2.8</li>
</ul>
<!-- raw HTML omitted -->
</blockquote>
<p>... (truncated)</p>
</details>
<details>
<summary>Commits</summary>
<ul>
<li><a
href="https://github.com/squidfunk/mkdocs-material/commit/54c7b79315b5ef5620efe16a1473d3368c8b8f52"><code>54c7b79</code></a>
Prepare 9.6.23 release</li>
<li><a
href="https://github.com/squidfunk/mkdocs-material/commit/f0dbcb5b66aa5060eef3ebce04d241686505887c"><code>f0dbcb5</code></a>
Disabled dependabot</li>
<li><a
href="https://github.com/squidfunk/mkdocs-material/commit/53d15f854d0479f01378023926e06a5cc857e28f"><code>53d15f8</code></a>
Updated dependencies</li>
<li><a
href="https://github.com/squidfunk/mkdocs-material/commit/d9e4f7139274bb70743a076da8b80a898b1a1c14"><code>d9e4f71</code></a>
Updated Burmese translations</li>
<li>See full diff in <a
href="https://github.com/squidfunk/mkdocs-material/compare/9.6.22...9.6.23">compare
view</a></li>
</ul>
</details>
<br />


[![Dependabot compatibility
score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=mkdocs-material&package-manager=pip&previous-version=9.6.22&new-version=9.6.23)](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores)

Dependabot will resolve any conflicts with this PR as long as you don't
alter it yourself. You can also trigger a rebase manually by commenting
`@dependabot rebase`.

[//]: # (dependabot-automerge-start)
[//]: # (dependabot-automerge-end)

---

<details>
<summary>Dependabot commands and options</summary>
<br />

You can trigger Dependabot actions by commenting on this PR:
- `@dependabot rebase` will rebase this PR
- `@dependabot recreate` will recreate this PR, overwriting any edits
that have been made to it
- `@dependabot merge` will merge this PR after your CI passes on it
- `@dependabot squash and merge` will squash and merge this PR after
your CI passes on it
- `@dependabot cancel merge` will cancel a previously requested merge
and block automerging
- `@dependabot reopen` will reopen this PR if it is closed
- `@dependabot close` will close this PR and stop Dependabot recreating
it. You can achieve the same result by closing it manually
- `@dependabot show <dependency name> ignore conditions` will show all
of the ignore conditions of the specified dependency
- `@dependabot ignore this major version` will close this PR and stop
Dependabot creating any more for this major version (unless you reopen
the PR or upgrade to it yourself)
- `@dependabot ignore this minor version` will close this PR and stop
Dependabot creating any more for this minor version (unless you reopen
the PR or upgrade to it yourself)
- `@dependabot ignore this dependency` will close this PR and stop
Dependabot creating any more for this dependency (unless you reopen the
PR or upgrade to it yourself)


</details>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Bumps [boto3](https://github.com/boto/boto3) from 1.40.49 to 1.40.61.
<details>
<summary>Commits</summary>
<ul>
<li><a
href="https://github.com/boto/boto3/commit/0c22806c6b2d3d6c2116130d62b10b0a4584b338"><code>0c22806</code></a>
Merge branch 'release-1.40.61'</li>
<li><a
href="https://github.com/boto/boto3/commit/bead59b7786cc460fdafaa11e3ac01462a8409bc"><code>bead59b</code></a>
Bumping version to 1.40.61</li>
<li><a
href="https://github.com/boto/boto3/commit/198c314654ea0f890f51c2aacfb0222c467b0de7"><code>198c314</code></a>
Add changelog entries from botocore</li>
<li><a
href="https://github.com/boto/boto3/commit/da0b18a8348583e0e3d6ca4b67f74df1cde0010d"><code>da0b18a</code></a>
Merge branch 'release-1.40.60'</li>
<li><a
href="https://github.com/boto/boto3/commit/fbeebebca3ab2f08840d8b2df0476440b457ccae"><code>fbeebeb</code></a>
Merge branch 'release-1.40.60' into develop</li>
<li><a
href="https://github.com/boto/boto3/commit/54b724b61fbd3b037c3445515bb079a37afde520"><code>54b724b</code></a>
Bumping version to 1.40.60</li>
<li><a
href="https://github.com/boto/boto3/commit/9dc2aeebcf531477d0961f6600bd5f05c72cad75"><code>9dc2aee</code></a>
Add changelog entries from botocore</li>
<li><a
href="https://github.com/boto/boto3/commit/87655ba1d2462c0593a760a04cee24a48f4244e7"><code>87655ba</code></a>
Test 3.14-dev to 3.14 (<a
href="https://redirect.github.com/boto/boto3/issues/4647">#4647</a>)</li>
<li><a
href="https://github.com/boto/boto3/commit/0681062f2a7af84c777941f0efc74d5d9fb4ee05"><code>0681062</code></a>
Bump github/codeql-action from 4.30.8 to 4.31.0 (<a
href="https://redirect.github.com/boto/boto3/issues/4649">#4649</a>)</li>
<li><a
href="https://github.com/boto/boto3/commit/ba90489143614a5dc23ed373b1e4a32379b8762e"><code>ba90489</code></a>
Merge branch 'release-1.40.59'</li>
<li>Additional commits viewable in <a
href="https://github.com/boto/boto3/compare/1.40.49...1.40.61">compare
view</a></li>
</ul>
</details>
<br />


[![Dependabot compatibility
score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=boto3&package-manager=pip&previous-version=1.40.49&new-version=1.40.61)](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores)

Dependabot will resolve any conflicts with this PR as long as you don't
alter it yourself. You can also trigger a rebase manually by commenting
`@dependabot rebase`.

[//]: # (dependabot-automerge-start)
[//]: # (dependabot-automerge-end)

---

<details>
<summary>Dependabot commands and options</summary>
<br />

You can trigger Dependabot actions by commenting on this PR:
- `@dependabot rebase` will rebase this PR
- `@dependabot recreate` will recreate this PR, overwriting any edits
that have been made to it
- `@dependabot merge` will merge this PR after your CI passes on it
- `@dependabot squash and merge` will squash and merge this PR after
your CI passes on it
- `@dependabot cancel merge` will cancel a previously requested merge
and block automerging
- `@dependabot reopen` will reopen this PR if it is closed
- `@dependabot close` will close this PR and stop Dependabot recreating
it. You can achieve the same result by closing it manually
- `@dependabot show <dependency name> ignore conditions` will show all
of the ignore conditions of the specified dependency
- `@dependabot ignore this major version` will close this PR and stop
Dependabot creating any more for this major version (unless you reopen
the PR or upgrade to it yourself)
- `@dependabot ignore this minor version` will close this PR and stop
Dependabot creating any more for this minor version (unless you reopen
the PR or upgrade to it yourself)
- `@dependabot ignore this dependency` will close this PR and stop
Dependabot creating any more for this dependency (unless you reopen the
PR or upgrade to it yourself)


</details>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Bumps [daft](https://github.com/Eventual-Inc/Daft) from 0.6.7 to 0.6.8.
<details>
<summary>Release notes</summary>
<p><em>Sourced from <a
href="https://github.com/Eventual-Inc/Daft/releases">daft's
releases</a>.</em></p>
<blockquote>
<h2>v0.6.8</h2>
<h2>What's Changed 🚀</h2>
<h2>✨ Features</h2>
<ul>
<li>feat: Allow images in prompt <a
href="https://github.com/colin-ho"><code>@​colin-ho</code></a> (<a
href="https://redirect.github.com/Eventual-Inc/Daft/issues/5466">#5466</a>)</li>
<li>feat: add pre-existence checks for lance_data_sink <a
href="https://github.com/huleilei"><code>@​huleilei</code></a> (<a
href="https://redirect.github.com/Eventual-Inc/Daft/issues/5381">#5381</a>)</li>
<li>feat: Support setting <code>actor_udf_ready_timeout</code> via Env
<a href="https://github.com/plotor"><code>@​plotor</code></a> (<a
href="https://redirect.github.com/Eventual-Inc/Daft/issues/5426">#5426</a>)</li>
<li>feat: retryable udfs <a
href="https://github.com/universalmind303"><code>@​universalmind303</code></a>
(<a
href="https://redirect.github.com/Eventual-Inc/Daft/issues/5392">#5392</a>)</li>
<li>feat: Add a Bigtable data sink <a
href="https://github.com/desmondcheongzx"><code>@​desmondcheongzx</code></a>
(<a
href="https://redirect.github.com/Eventual-Inc/Daft/issues/5431">#5431</a>)</li>
<li>feat: classify_image expression <a
href="https://github.com/universalmind303"><code>@​universalmind303</code></a>
(<a
href="https://redirect.github.com/Eventual-Inc/Daft/issues/5428">#5428</a>)</li>
<li>feat: Add support for Metrics tab in quickstart Ray dashboard <a
href="https://github.com/jeevb"><code>@​jeevb</code></a> (<a
href="https://redirect.github.com/Eventual-Inc/Daft/issues/5429">#5429</a>)</li>
<li>feat(lance): distributed FTS index creation via Daft UDF with
fragment-level parallelism <a
href="https://github.com/huleilei"><code>@​huleilei</code></a> (<a
href="https://redirect.github.com/Eventual-Inc/Daft/issues/5236">#5236</a>)</li>
<li>feat: add mimetype detection for daft.file <a
href="https://github.com/universalmind303"><code>@​universalmind303</code></a>
(<a
href="https://redirect.github.com/Eventual-Inc/Daft/issues/5411">#5411</a>)</li>
</ul>
<h2>🐛 Bug Fixes</h2>
<ul>
<li>fix: report a more reasonable error message when select * from
&lt;some_keywords&gt; <a
href="https://github.com/VOID001"><code>@​VOID001</code></a> (<a
href="https://redirect.github.com/Eventual-Inc/Daft/issues/5440">#5440</a>)</li>
<li>fix: Fix async udf with <code>use_process</code> <a
href="https://github.com/colin-ho"><code>@​colin-ho</code></a> (<a
href="https://redirect.github.com/Eventual-Inc/Daft/issues/5457">#5457</a>)</li>
<li>fix: Drop table error in current active session <a
href="https://github.com/plotor"><code>@​plotor</code></a> (<a
href="https://redirect.github.com/Eventual-Inc/Daft/issues/5439">#5439</a>)</li>
<li>fix: add retry on &quot;unable to open file&quot; <a
href="https://github.com/kevinzwang"><code>@​kevinzwang</code></a> (<a
href="https://redirect.github.com/Eventual-Inc/Daft/issues/5442">#5442</a>)</li>
<li>fix: Allow publishing quickstart helm chart to GHCR <a
href="https://github.com/jeevb"><code>@​jeevb</code></a> (<a
href="https://redirect.github.com/Eventual-Inc/Daft/issues/5437">#5437</a>)</li>
<li>fix: convert num_rows to int when query count(*) from clickhouse <a
href="https://github.com/dujl"><code>@​dujl</code></a> (<a
href="https://redirect.github.com/Eventual-Inc/Daft/issues/5421">#5421</a>)</li>
<li>fix: Actually clone the repo before publishing quickstart helm chart
<a href="https://github.com/jeevb"><code>@​jeevb</code></a> (<a
href="https://redirect.github.com/Eventual-Inc/Daft/issues/5433">#5433</a>)</li>
<li>fix: file reads for huggingface <a
href="https://github.com/universalmind303"><code>@​universalmind303</code></a>
(<a
href="https://redirect.github.com/Eventual-Inc/Daft/issues/5427">#5427</a>)</li>
<li>fix: Make benchmarking Ray cluster setup commands idempotent <a
href="https://github.com/jeevb"><code>@​jeevb</code></a> (<a
href="https://redirect.github.com/Eventual-Inc/Daft/issues/5425">#5425</a>)</li>
<li>fix(lance): correct limit pushdown semantics with filters <a
href="https://github.com/huleilei"><code>@​huleilei</code></a> (<a
href="https://redirect.github.com/Eventual-Inc/Daft/issues/5408">#5408</a>)</li>
</ul>
<h2>🚀 Performance</h2>
<ul>
<li>perf: Call async udfs asynchronously <a
href="https://github.com/colin-ho"><code>@​colin-ho</code></a> (<a
href="https://redirect.github.com/Eventual-Inc/Daft/issues/5451">#5451</a>)</li>
<li>perf: Elide shuffle for window if already partitioned <a
href="https://github.com/colin-ho"><code>@​colin-ho</code></a> (<a
href="https://redirect.github.com/Eventual-Inc/Daft/issues/5450">#5450</a>)</li>
<li>perf: defer allocation when creating series from literals <a
href="https://github.com/universalmind303"><code>@​universalmind303</code></a>
(<a
href="https://redirect.github.com/Eventual-Inc/Daft/issues/5391">#5391</a>)</li>
<li>perf: Double workers per udf actor handle <a
href="https://github.com/colin-ho"><code>@​colin-ho</code></a> (<a
href="https://redirect.github.com/Eventual-Inc/Daft/issues/5415">#5415</a>)</li>
</ul>
<h2>♻️ Refactor</h2>
<ul>
<li>refactor: Make helper function for calling async python functions
from rust <a
href="https://github.com/colin-ho"><code>@​colin-ho</code></a> (<a
href="https://redirect.github.com/Eventual-Inc/Daft/issues/5432">#5432</a>)</li>
<li>refactor: combine sentence_transformers + transformers, and clean up
… <a
href="https://github.com/universalmind303"><code>@​universalmind303</code></a>
(<a
href="https://redirect.github.com/Eventual-Inc/Daft/issues/5422">#5422</a>)</li>
</ul>
<h2>📖 Documentation</h2>
<ul>
<li>docs: adds ai functions, ai providers, contributing, and docstrings
with nav <a
href="https://github.com/everettVT"><code>@​everettVT</code></a> (<a
href="https://redirect.github.com/Eventual-Inc/Daft/issues/5438">#5438</a>)</li>
<li>docs: warning for Common Crawl dataset API instability <a
href="https://github.com/malcolmgreaves"><code>@​malcolmgreaves</code></a>
(<a
href="https://redirect.github.com/Eventual-Inc/Daft/issues/5436">#5436</a>)</li>
<li>docs: update the example to access S3-compatible services <a
href="https://github.com/huleilei"><code>@​huleilei</code></a> (<a
href="https://redirect.github.com/Eventual-Inc/Daft/issues/5405">#5405</a>)</li>
<li>docs(connectors): add connector page for Lance format <a
href="https://github.com/huleilei"><code>@​huleilei</code></a> (<a
href="https://redirect.github.com/Eventual-Inc/Daft/issues/5397">#5397</a>)</li>
</ul>
<p><strong>Full Changelog</strong>: <a
href="https://github.com/Eventual-Inc/Daft/compare/v0.6.7...v0.6.8">https://github.com/Eventual-Inc/Daft/compare/v0.6.7...v0.6.8</a></p>
</blockquote>
</details>
<details>
<summary>Commits</summary>
<ul>
<li><a
href="https://github.com/Eventual-Inc/Daft/commit/5025c941f28b9b406d3de3161e13fac6ee34b1d1"><code>5025c94</code></a>
feat: Allow images in prompt (<a
href="https://redirect.github.com/Eventual-Inc/Daft/issues/5466">#5466</a>)</li>
<li><a
href="https://github.com/Eventual-Inc/Daft/commit/9615c5f535850ade12d8e962b42947dd8e87ebf0"><code>9615c5f</code></a>
fix: report a more reasonable error message when select * from
&lt;some_keywords...</li>
<li><a
href="https://github.com/Eventual-Inc/Daft/commit/c7411de93e21542b0d183059a367f5534cc2205b"><code>c7411de</code></a>
feat: add pre-existence checks for lance_data_sink (<a
href="https://redirect.github.com/Eventual-Inc/Daft/issues/5381">#5381</a>)</li>
<li><a
href="https://github.com/Eventual-Inc/Daft/commit/156096505531d5846be345005334e6ac10ef4db6"><code>1560965</code></a>
fix: Fix async udf with <code>use_process</code> (<a
href="https://redirect.github.com/Eventual-Inc/Daft/issues/5457">#5457</a>)</li>
<li><a
href="https://github.com/Eventual-Inc/Daft/commit/668fd5b983326c9194c00db84d902dcb59ff6c6c"><code>668fd5b</code></a>
docs: adds ai functions, ai providers, contributing, and docstrings with
nav ...</li>
<li><a
href="https://github.com/Eventual-Inc/Daft/commit/04550a227edd327a32a990c7eeba6738c3829a85"><code>04550a2</code></a>
perf: Call async udfs asynchronously (<a
href="https://redirect.github.com/Eventual-Inc/Daft/issues/5451">#5451</a>)</li>
<li><a
href="https://github.com/Eventual-Inc/Daft/commit/a4142c9536a7b50664c230652ee06dacb5929588"><code>a4142c9</code></a>
perf: Elide shuffle for window if already partitioned (<a
href="https://redirect.github.com/Eventual-Inc/Daft/issues/5450">#5450</a>)</li>
<li><a
href="https://github.com/Eventual-Inc/Daft/commit/b7f90c067458fad4bb94ac5d29af74634a933243"><code>b7f90c0</code></a>
fix: Drop table error in current active session (<a
href="https://redirect.github.com/Eventual-Inc/Daft/issues/5439">#5439</a>)</li>
<li><a
href="https://github.com/Eventual-Inc/Daft/commit/a3872321cbe95b03166eae9d860461eb9c111127"><code>a387232</code></a>
feat: Support setting <code>actor_udf_ready_timeout</code> via Env (<a
href="https://redirect.github.com/Eventual-Inc/Daft/issues/5426">#5426</a>)</li>
<li><a
href="https://github.com/Eventual-Inc/Daft/commit/a880db9cc6eeb754fff9ffbeddb7952a20f79085"><code>a880db9</code></a>
fix: add retry on &quot;unable to open file&quot; (<a
href="https://redirect.github.com/Eventual-Inc/Daft/issues/5442">#5442</a>)</li>
<li>Additional commits viewable in <a
href="https://github.com/Eventual-Inc/Daft/compare/v0.6.7...v0.6.8">compare
view</a></li>
</ul>
</details>
<br />


[![Dependabot compatibility
score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=daft&package-manager=pip&previous-version=0.6.7&new-version=0.6.8)](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores)

Dependabot will resolve any conflicts with this PR as long as you don't
alter it yourself. You can also trigger a rebase manually by commenting
`@dependabot rebase`.

[//]: # (dependabot-automerge-start)
[//]: # (dependabot-automerge-end)

---

<details>
<summary>Dependabot commands and options</summary>
<br />

You can trigger Dependabot actions by commenting on this PR:
- `@dependabot rebase` will rebase this PR
- `@dependabot recreate` will recreate this PR, overwriting any edits
that have been made to it
- `@dependabot merge` will merge this PR after your CI passes on it
- `@dependabot squash and merge` will squash and merge this PR after
your CI passes on it
- `@dependabot cancel merge` will cancel a previously requested merge
and block automerging
- `@dependabot reopen` will reopen this PR if it is closed
- `@dependabot close` will close this PR and stop Dependabot recreating
it. You can achieve the same result by closing it manually
- `@dependabot show <dependency name> ignore conditions` will show all
of the ignore conditions of the specified dependency
- `@dependabot ignore this major version` will close this PR and stop
Dependabot creating any more for this major version (unless you reopen
the PR or upgrade to it yourself)
- `@dependabot ignore this minor version` will close this PR and stop
Dependabot creating any more for this minor version (unless you reopen
the PR or upgrade to it yourself)
- `@dependabot ignore this dependency` will close this PR and stop
Dependabot creating any more for this dependency (unless you reopen the
PR or upgrade to it yourself)


</details>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Bumps [polars](https://github.com/pola-rs/polars) from 1.34.0 to 1.35.1.
<details>
<summary>Release notes</summary>
<p><em>Sourced from <a
href="https://github.com/pola-rs/polars/releases">polars's
releases</a>.</em></p>
<blockquote>
<h2>Python Polars 1.35.1</h2>
<h2>🚀 Performance improvements</h2>
<ul>
<li>Don't recompute full rolling moment window when NaNs/nulls leave the
window (<a
href="https://redirect.github.com/pola-rs/polars/issues/25078">#25078</a>)</li>
<li>Skip filtering scan IR if no paths were filtered (<a
href="https://redirect.github.com/pola-rs/polars/issues/25037">#25037</a>)</li>
<li>Optimize ipc stream read performance (<a
href="https://redirect.github.com/pola-rs/polars/issues/24671">#24671</a>)</li>
</ul>
<h2>✨ Enhancements</h2>
<ul>
<li>Support BYTE_ARRAY backed Decimals in Parquet (<a
href="https://redirect.github.com/pola-rs/polars/issues/25076">#25076</a>)</li>
<li>Allow <code>glimpse</code> to return a <code>DataFrame</code> (<a
href="https://redirect.github.com/pola-rs/polars/issues/24803">#24803</a>)</li>
<li>Add <code>allow_empty</code> flag to <code>item</code> (<a
href="https://redirect.github.com/pola-rs/polars/issues/25048">#25048</a>)</li>
</ul>
<h2>🐞 Bug fixes</h2>
<ul>
<li>The <code>SQL</code> interface should use logical, not bitwise,
behaviour for unary &quot;NOT&quot; operator (<a
href="https://redirect.github.com/pola-rs/polars/issues/25091">#25091</a>)</li>
<li>Fix panic if scan predicate produces 0 length mask (<a
href="https://redirect.github.com/pola-rs/polars/issues/25089">#25089</a>)</li>
<li>Ensure SQL table alias resolution checks against CTE aliases on
fallback (<a
href="https://redirect.github.com/pola-rs/polars/issues/25071">#25071</a>)</li>
<li>Panic in <code>group_by_dynamic</code> with <code>group_by</code>
and multiple chunks (<a
href="https://redirect.github.com/pola-rs/polars/issues/25075">#25075</a>)</li>
<li>Minor improvement to internal <code>is_pycapsule</code> utility
function (<a
href="https://redirect.github.com/pola-rs/polars/issues/25073">#25073</a>)</li>
<li>Fix panic when using struct field as join key (<a
href="https://redirect.github.com/pola-rs/polars/issues/25059">#25059</a>)</li>
<li>Allow broadcast in <code>group_by</code> for <code>ApplyExpr</code>
and <code>BinaryExpr</code> (<a
href="https://redirect.github.com/pola-rs/polars/issues/25053">#25053</a>)</li>
<li>Fix field metadata for nested categorical PyCapsule export (<a
href="https://redirect.github.com/pola-rs/polars/issues/25052">#25052</a>)</li>
<li>Block predicate pushdown when <code>group_by</code> key values are
changed (<a
href="https://redirect.github.com/pola-rs/polars/issues/25032">#25032</a>)</li>
<li>Group-By aggregation problems caused by <code>AmortSeries</code> (<a
href="https://redirect.github.com/pola-rs/polars/issues/25043">#25043</a>)</li>
<li>Don't push down predicates passed inserted cache nodes (<a
href="https://redirect.github.com/pola-rs/polars/issues/25042">#25042</a>)</li>
<li>Allow for negative time in <code>group_by_dynamic</code> iterator
(<a
href="https://redirect.github.com/pola-rs/polars/issues/25041">#25041</a>)</li>
</ul>
<h2>📖 Documentation</h2>
<ul>
<li>Fix typo in public dataset URL (<a
href="https://redirect.github.com/pola-rs/polars/issues/25044">#25044</a>)</li>
</ul>
<h2>🛠️ Other improvements</h2>
<ul>
<li>Disable recursive CSPE for now (<a
href="https://redirect.github.com/pola-rs/polars/issues/25085">#25085</a>)</li>
<li>Change group length mismatch error to <code>ShapeError</code> (<a
href="https://redirect.github.com/pola-rs/polars/issues/25004">#25004</a>)</li>
<li>Update toolchain (<a
href="https://redirect.github.com/pola-rs/polars/issues/25007">#25007</a>)</li>
</ul>
<p>Thank you to all our contributors for making this release possible!
<a href="https://github.com/Kevin-Patyk"><code>@​Kevin-Patyk</code></a>,
<a href="https://github.com/Liyixin95"><code>@​Liyixin95</code></a>, <a
href="https://github.com/alexander-beedie"><code>@​alexander-beedie</code></a>,
<a
href="https://github.com/coastalwhite"><code>@​coastalwhite</code></a>,
<a href="https://github.com/kdn36"><code>@​kdn36</code></a>, <a
href="https://github.com/nameexhaustion"><code>@​nameexhaustion</code></a>,
<a href="https://github.com/orlp"><code>@​orlp</code></a>, <a
href="https://github.com/r-brink"><code>@​r-brink</code></a>, <a
href="https://github.com/ritchie46"><code>@​ritchie46</code></a> and <a
href="https://github.com/stijnherfst"><code>@​stijnherfst</code></a></p>
<h2>Python Polars 1.35.0</h2>
<h2>🏆 Highlights</h2>
<ul>
<li>Stabilize decimal (<a
href="https://redirect.github.com/pola-rs/polars/issues/25020">#25020</a>)</li>
</ul>
<h2>🚀 Performance improvements</h2>
<ul>
<li>Bump foldhash to 0.2.0 and hashbrown to 0.16.0 (<a
href="https://redirect.github.com/pola-rs/polars/issues/25014">#25014</a>)</li>
<li>Lower <code>unique</code> to native group-by and speed up
<code>n_unique</code> in group-by context (<a
href="https://redirect.github.com/pola-rs/polars/issues/24976">#24976</a>)</li>
</ul>
<!-- raw HTML omitted -->
</blockquote>
<p>... (truncated)</p>
</details>
<details>
<summary>Commits</summary>
<ul>
<li><a
href="https://github.com/pola-rs/polars/commit/a99ad3495d0b4bb71a956eb3ab5e23595df756db"><code>a99ad34</code></a>
fix: The <code>SQL</code> interface should use logical, not bitwise,
behaviour for unary...</li>
<li><a
href="https://github.com/pola-rs/polars/commit/84a0feea2790c6d2ed5be2661409230c1ba9eb00"><code>84a0fee</code></a>
Python Polars 1.35.1 (<a
href="https://redirect.github.com/pola-rs/polars/issues/25090">#25090</a>)</li>
<li><a
href="https://github.com/pola-rs/polars/commit/b9e313641cd7546d4f29ed93dde0cd3b74e799c2"><code>b9e3136</code></a>
refactor(rust): Remove old join projection pushdown logic (<a
href="https://redirect.github.com/pola-rs/polars/issues/25088">#25088</a>)</li>
<li><a
href="https://github.com/pola-rs/polars/commit/7b423b6d6d8074826ef950c33a6931f78bc4d952"><code>7b423b6</code></a>
fix: Fix panic if scan predicate produces 0 length mask (<a
href="https://redirect.github.com/pola-rs/polars/issues/25089">#25089</a>)</li>
<li><a
href="https://github.com/pola-rs/polars/commit/ce396f450cc261c7b34bd7f00408fc9152eb6d35"><code>ce396f4</code></a>
refactor: Disable recursive CSPE for now (<a
href="https://redirect.github.com/pola-rs/polars/issues/25085">#25085</a>)</li>
<li><a
href="https://github.com/pola-rs/polars/commit/5ae1a1cdd18cce54891104522a531d730e02ade4"><code>5ae1a1c</code></a>
perf: Don't recompute full rolling moment window when NaNs/nulls leave
the wi...</li>
<li><a
href="https://github.com/pola-rs/polars/commit/209d833a7d96ae9092e91abc1af2522c79c96fcd"><code>209d833</code></a>
refactor(rust): Remove unused row-count (<a
href="https://redirect.github.com/pola-rs/polars/issues/25080">#25080</a>)</li>
<li><a
href="https://github.com/pola-rs/polars/commit/29b85ea16b562c9cda7d377eea6015148f201921"><code>29b85ea</code></a>
chore(rust): Add <code>proptest</code> strategies for Series logical
types (<a
href="https://redirect.github.com/pola-rs/polars/issues/24849">#24849</a>)</li>
<li><a
href="https://github.com/pola-rs/polars/commit/92f67cac2affb6b3d766f601e938ec1b53bc9476"><code>92f67ca</code></a>
fix: Ensure SQL table alias resolution checks against CTE aliases on
fallback...</li>
<li><a
href="https://github.com/pola-rs/polars/commit/0c5518a0d058f6f3cae6b8d60c2d236e226f12c1"><code>0c5518a</code></a>
refactor(rust): Add stateful <code>EwmCov</code> kernel (<a
href="https://redirect.github.com/pola-rs/polars/issues/25065">#25065</a>)</li>
<li>Additional commits viewable in <a
href="https://github.com/pola-rs/polars/compare/py-1.34.0...py-1.35.1">compare
view</a></li>
</ul>
</details>
<br />


[![Dependabot compatibility
score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=polars&package-manager=pip&previous-version=1.34.0&new-version=1.35.1)](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores)

Dependabot will resolve any conflicts with this PR as long as you don't
alter it yourself. You can also trigger a rebase manually by commenting
`@dependabot rebase`.

[//]: # (dependabot-automerge-start)
[//]: # (dependabot-automerge-end)

---

<details>
<summary>Dependabot commands and options</summary>
<br />

You can trigger Dependabot actions by commenting on this PR:
- `@dependabot rebase` will rebase this PR
- `@dependabot recreate` will recreate this PR, overwriting any edits
that have been made to it
- `@dependabot merge` will merge this PR after your CI passes on it
- `@dependabot squash and merge` will squash and merge this PR after
your CI passes on it
- `@dependabot cancel merge` will cancel a previously requested merge
and block automerging
- `@dependabot reopen` will reopen this PR if it is closed
- `@dependabot close` will close this PR and stop Dependabot recreating
it. You can achieve the same result by closing it manually
- `@dependabot show <dependency name> ignore conditions` will show all
of the ignore conditions of the specified dependency
- `@dependabot ignore this major version` will close this PR and stop
Dependabot creating any more for this major version (unless you reopen
the PR or upgrade to it yourself)
- `@dependabot ignore this minor version` will close this PR and stop
Dependabot creating any more for this minor version (unless you reopen
the PR or upgrade to it yourself)
- `@dependabot ignore this dependency` will close this PR and stop
Dependabot creating any more for this dependency (unless you reopen the
PR or upgrade to it yourself)


</details>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Bumps [moto](https://github.com/getmoto/moto) from 5.1.15 to 5.1.16.
<details>
<summary>Changelog</summary>
<p><em>Sourced from <a
href="https://github.com/getmoto/moto/blob/master/CHANGELOG.md">moto's
changelog</a>.</em></p>
<blockquote>
<h2>5.1.16</h2>
<p>Docker Digest for 5.1.16:
<em>sha256:f78c8e0370cabe2516395f351fb27e1df1aa6dc2d728d6de16d5dfbc9ccf595d</em></p>
<pre><code>General:
* Removed support for the RoboMaker and QLDB, now that AWS has also
deprecated these services
<p>New Services:<br />
* S3Vectors:<br />
* create_vector_bucket()<br />
* delete_vector_bucket()<br />
* get_vector_bucket()<br />
* list_vector_buckets()</p>
<p>New Methods:<br />
* Glue:<br />
* create_security_configuration()<br />
* delete_security_configuration()<br />
* get_security_configuration()<br />
* get_security_configurations()</p>
<pre><code>* FSx:
    * create_backup()
    * delete_backup()
    * list_tags_for_resource()

* VPCLattice:
    * get_service()
    * get_service_network()
    * list_services()
    * list_service_networks()
    * list_tags_for_resource()
    * tag_resource()
    * untag_resource()
</code></pre>
<p>Miscellaneous:<br />
* ACM: list_certificates() now supports the 'keyTypes'-filter<br />
* APIGateway: get_stage() now supports stages that are URL encoded, like
'$default'<br />
* DynamoDB now supports the WarmThroughput parameter on Tables and
Indexes<br />
* DynamoDB: execute_statement() now supports querying indexes (both GSI
and LSI)<br />
* EC2: create_volume() now supports the MultiAttachEnabled-parameter<br
/>
* EC2: modify_volume() now supports the parameters Iops, Throughput and
MultiAttachEnabled<br />
* ElastiCache: create_cache_cluster() now validates that the mandatory
parameter CacheNodeType is provided<br />
* ELBv2: describe_listener_certificates() now returns the
IsDefault-field<br />
* Glue: create_connection() now supports the parameters
ConnectionProperties, SparkProperties, AthenaProperties and
PythonProperties<br />
* ResourceGroupsTaggingAPI: get_resources() now supports FSx resource
types (Backups and FileSystems)<br />
* ResourceGroupsTaggingAPI: get_resources() now supports VPCLattice
resource types (Services and Service Networks)<br />
* ResourceGroupsTaggingAPI: untag_resources() now supports RDS resource
types<br />
* S3: put_object_tagging() now throws MethodNotAllowed when trying to
tag a DeleteMarker<br />
* SSM: get_parameters_by_path() now validates that the
maxResults-parameter is 10 at most<br />
</code></pre></p>
</blockquote>
</details>
<details>
<summary>Commits</summary>
<ul>
<li><a
href="https://github.com/getmoto/moto/commit/dc8ec8beb62c6067e751788a935dacc58b2b5162"><code>dc8ec8b</code></a>
Pre-Release: Up Version Number</li>
<li><a
href="https://github.com/getmoto/moto/commit/e230201ca01de4ddbd1cb16dfe2ac6f0719c71ce"><code>e230201</code></a>
Prep release 5.1.16 (<a
href="https://redirect.github.com/getmoto/moto/issues/9436">#9436</a>)</li>
<li><a
href="https://github.com/getmoto/moto/commit/882728066bb430a2afa84753ab164df1738812c5"><code>8827280</code></a>
chore: update SSM default parameters (<a
href="https://redirect.github.com/getmoto/moto/issues/9434">#9434</a>)</li>
<li><a
href="https://github.com/getmoto/moto/commit/53e19f156c6f26bd2fe6a88a26a5493f42a40a24"><code>53e19f1</code></a>
chore: update EC2 Instance Types (<a
href="https://redirect.github.com/getmoto/moto/issues/9433">#9433</a>)</li>
<li><a
href="https://github.com/getmoto/moto/commit/3c033d7c7abeccd09337a059bc327c9d51084c28"><code>3c033d7</code></a>
chore: update EC2 Instance Offerings (<a
href="https://redirect.github.com/getmoto/moto/issues/9432">#9432</a>)</li>
<li><a
href="https://github.com/getmoto/moto/commit/f709dd93dd6592012f1ff288f5432ba12674f1cc"><code>f709dd9</code></a>
chore: update EMR Instance Types (<a
href="https://redirect.github.com/getmoto/moto/issues/9431">#9431</a>)</li>
<li><a
href="https://github.com/getmoto/moto/commit/ba75ce6e1e8a46966e66ca748970f57c9fefdf82"><code>ba75ce6</code></a>
Bump the go-deps group in /other_langs/tests_go with 6 updates (<a
href="https://redirect.github.com/getmoto/moto/issues/9430">#9430</a>)</li>
<li><a
href="https://github.com/getmoto/moto/commit/e1a3dffa441a1985753d40615c1b2872fb9b8294"><code>e1a3dff</code></a>
Bump software.amazon.awssdk:bom (<a
href="https://redirect.github.com/getmoto/moto/issues/9429">#9429</a>)</li>
<li><a
href="https://github.com/getmoto/moto/commit/4c65b6c65fa5e9596bb5d35cd292da75f1564ef4"><code>4c65b6c</code></a>
ManagedBlockChain: Use serialization framework for responses (<a
href="https://redirect.github.com/getmoto/moto/issues/9428">#9428</a>)</li>
<li><a
href="https://github.com/getmoto/moto/commit/69e618a759d868406ec5f099ad8117d581fe3861"><code>69e618a</code></a>
chore: update SSM default AMI's (<a
href="https://redirect.github.com/getmoto/moto/issues/9426">#9426</a>)</li>
<li>Additional commits viewable in <a
href="https://github.com/getmoto/moto/compare/5.1.15...5.1.16">compare
view</a></li>
</ul>
</details>
<br />


[![Dependabot compatibility
score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=moto&package-manager=pip&previous-version=5.1.15&new-version=5.1.16)](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores)

Dependabot will resolve any conflicts with this PR as long as you don't
alter it yourself. You can also trigger a rebase manually by commenting
`@dependabot rebase`.

[//]: # (dependabot-automerge-start)
[//]: # (dependabot-automerge-end)

---

<details>
<summary>Dependabot commands and options</summary>
<br />

You can trigger Dependabot actions by commenting on this PR:
- `@dependabot rebase` will rebase this PR
- `@dependabot recreate` will recreate this PR, overwriting any edits
that have been made to it
- `@dependabot merge` will merge this PR after your CI passes on it
- `@dependabot squash and merge` will squash and merge this PR after
your CI passes on it
- `@dependabot cancel merge` will cancel a previously requested merge
and block automerging
- `@dependabot reopen` will reopen this PR if it is closed
- `@dependabot close` will close this PR and stop Dependabot recreating
it. You can achieve the same result by closing it manually
- `@dependabot show <dependency name> ignore conditions` will show all
of the ignore conditions of the specified dependency
- `@dependabot ignore this major version` will close this PR and stop
Dependabot creating any more for this major version (unless you reopen
the PR or upgrade to it yourself)
- `@dependabot ignore this minor version` will close this PR and stop
Dependabot creating any more for this minor version (unless you reopen
the PR or upgrade to it yourself)
- `@dependabot ignore this dependency` will close this PR and stop
Dependabot creating any more for this dependency (unless you reopen the
PR or upgrade to it yourself)


</details>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Bumps [mypy-boto3-glue](https://github.com/youtype/mypy_boto3_builder)
from 1.40.50 to 1.40.63.
<details>
<summary>Release notes</summary>
<p><em>Sourced from <a
href="https://github.com/youtype/mypy_boto3_builder/releases">mypy-boto3-glue's
releases</a>.</em></p>
<blockquote>
<h2>8.8.0 - Python 3.8 runtime is back</h2>
<h3>Changed</h3>
<ul>
<li><code>[services]</code> <code>install_requires</code> section is
calculated based on dependencies in use, so
<code>typing-extensions</code> version is set properly</li>
<li><code>[all]</code> Replaced <code>typing</code> imports with
<code>collections.abc</code> with a fallback to <code>typing</code> for
Python &lt;3.9</li>
<li><code>[all]</code> Added aliases for <code>builtins.list</code>,
<code>builtins.set</code>, <code>builtins.dict</code>, and
<code>builtins.type</code>, so Python 3.8 runtime should work as
expected again (reported by <a
href="https://github.com/YHallouard"><code>@​YHallouard</code></a> in <a
href="https://redirect.github.com/youtype/mypy_boto3_builder/issues/340">#340</a>
and <a
href="https://github.com/Omri-Ben-Yair"><code>@​Omri-Ben-Yair</code></a>
in <a
href="https://redirect.github.com/youtype/mypy_boto3_builder/issues/336">#336</a>)</li>
<li><code>[all]</code> Unions use the same type annotations as the rest
of the structures due to proper fallbacks</li>
</ul>
<h3>Fixed</h3>
<ul>
<li><code>[services]</code> Universal input/output shapes were not
replaced properly in service subresources</li>
<li><code>[docs]</code> Simplified doc links rendering for services</li>
<li><code>[services]</code> Cleaned up unnecessary imports in
<code>client.pyi</code></li>
<li><code>[builder]</code> Import records with fallback are always
rendered</li>
</ul>
</blockquote>
</details>
<details>
<summary>Commits</summary>
<ul>
<li>See full diff in <a
href="https://github.com/youtype/mypy_boto3_builder/commits">compare
view</a></li>
</ul>
</details>
<br />


[![Dependabot compatibility
score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=mypy-boto3-glue&package-manager=pip&previous-version=1.40.50&new-version=1.40.63)](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores)

Dependabot will resolve any conflicts with this PR as long as you don't
alter it yourself. You can also trigger a rebase manually by commenting
`@dependabot rebase`.

[//]: # (dependabot-automerge-start)
[//]: # (dependabot-automerge-end)

---

<details>
<summary>Dependabot commands and options</summary>
<br />

You can trigger Dependabot actions by commenting on this PR:
- `@dependabot rebase` will rebase this PR
- `@dependabot recreate` will recreate this PR, overwriting any edits
that have been made to it
- `@dependabot merge` will merge this PR after your CI passes on it
- `@dependabot squash and merge` will squash and merge this PR after
your CI passes on it
- `@dependabot cancel merge` will cancel a previously requested merge
and block automerging
- `@dependabot reopen` will reopen this PR if it is closed
- `@dependabot close` will close this PR and stop Dependabot recreating
it. You can achieve the same result by closing it manually
- `@dependabot show <dependency name> ignore conditions` will show all
of the ignore conditions of the specified dependency
- `@dependabot ignore this major version` will close this PR and stop
Dependabot creating any more for this major version (unless you reopen
the PR or upgrade to it yourself)
- `@dependabot ignore this minor version` will close this PR and stop
Dependabot creating any more for this minor version (unless you reopen
the PR or upgrade to it yourself)
- `@dependabot ignore this dependency` will close this PR and stop
Dependabot creating any more for this dependency (unless you reopen the
PR or upgrade to it yourself)


</details>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Bumps
[google-auth](https://github.com/googleapis/google-auth-library-python)
from 2.41.1 to 2.42.1.
<details>
<summary>Release notes</summary>
<p><em>Sourced from <a
href="https://github.com/googleapis/google-auth-library-python/releases">google-auth's
releases</a>.</em></p>
<blockquote>
<h2>v2.42.1</h2>
<h2><a
href="https://github.com/googleapis/google-auth-library-python/compare/v2.42.0...v2.42.1">2.42.1</a>
(2025-10-30)</h2>
<h3>Bug Fixes</h3>
<ul>
<li>Catch ValueError for json.loads() (<a
href="https://redirect.github.com/googleapis/google-auth-library-python/issues/1842">#1842</a>)
(<a
href="https://github.com/googleapis/google-auth-library-python/commit/b074cad460589633adfc6744c01726ae86f2aa2b">b074cad</a>)</li>
</ul>
<h2>v2.42.0</h2>
<h2><a
href="https://github.com/googleapis/google-auth-library-python/compare/v2.41.1...v2.42.0">2.42.0</a>
(2025-10-24)</h2>
<h3>Features</h3>
<ul>
<li>Add trust boundary support for external accounts. (<a
href="https://redirect.github.com/googleapis/google-auth-library-python/issues/1809">#1809</a>)
(<a
href="https://github.com/googleapis/google-auth-library-python/commit/36ecb1d65883477d27faf9c2281fc289659b9903">36ecb1d</a>)</li>
</ul>
<h3>Bug Fixes</h3>
<ul>
<li>Read scopes from ADC json for impersoanted cred (<a
href="https://redirect.github.com/googleapis/google-auth-library-python/issues/1820">#1820</a>)
(<a
href="https://github.com/googleapis/google-auth-library-python/commit/62c0fc82a3625542381f85c698595446fc99ddae">62c0fc8</a>)</li>
</ul>
</blockquote>
</details>
<details>
<summary>Changelog</summary>
<p><em>Sourced from <a
href="https://github.com/googleapis/google-auth-library-python/blob/main/CHANGELOG.md">google-auth's
changelog</a>.</em></p>
<blockquote>
<h2><a
href="https://github.com/googleapis/google-auth-library-python/compare/v2.42.0...v2.42.1">2.42.1</a>
(2025-10-30)</h2>
<h3>Bug Fixes</h3>
<ul>
<li>Catch ValueError for json.loads() (<a
href="https://redirect.github.com/googleapis/google-auth-library-python/issues/1842">#1842</a>)
(<a
href="https://github.com/googleapis/google-auth-library-python/commit/b074cad460589633adfc6744c01726ae86f2aa2b">b074cad</a>)</li>
</ul>
<h2><a
href="https://github.com/googleapis/google-auth-library-python/compare/v2.41.1...v2.42.0">2.42.0</a>
(2025-10-24)</h2>
<h3>Features</h3>
<ul>
<li>Add trust boundary support for external accounts. (<a
href="https://redirect.github.com/googleapis/google-auth-library-python/issues/1809">#1809</a>)
(<a
href="https://github.com/googleapis/google-auth-library-python/commit/36ecb1d65883477d27faf9c2281fc289659b9903">36ecb1d</a>)</li>
</ul>
<h3>Bug Fixes</h3>
<ul>
<li>Read scopes from ADC json for impersoanted cred (<a
href="https://redirect.github.com/googleapis/google-auth-library-python/issues/1820">#1820</a>)
(<a
href="https://github.com/googleapis/google-auth-library-python/commit/62c0fc82a3625542381f85c698595446fc99ddae">62c0fc8</a>)</li>
</ul>
</blockquote>
</details>
<details>
<summary>Commits</summary>
<ul>
<li><a
href="https://github.com/googleapis/google-auth-library-python/commit/5d1b862db2b23b4b7ae7d243f6dbb23165636bd5"><code>5d1b862</code></a>
chore(main): release 2.42.1 (<a
href="https://redirect.github.com/googleapis/google-auth-library-python/issues/1853">#1853</a>)</li>
<li><a
href="https://github.com/googleapis/google-auth-library-python/commit/b074cad460589633adfc6744c01726ae86f2aa2b"><code>b074cad</code></a>
fix: catch ValueError for json.loads() (<a
href="https://redirect.github.com/googleapis/google-auth-library-python/issues/1842">#1842</a>)</li>
<li><a
href="https://github.com/googleapis/google-auth-library-python/commit/cb62f5727854965e108c4e1790c4f9f9306fe3ce"><code>cb62f57</code></a>
chore: secret update (<a
href="https://redirect.github.com/googleapis/google-auth-library-python/issues/1851">#1851</a>)</li>
<li><a
href="https://github.com/googleapis/google-auth-library-python/commit/2f8826d3226a3df7dfdd5898c91ea15ee21d1bd0"><code>2f8826d</code></a>
chore(main): release 2.42.0 (<a
href="https://redirect.github.com/googleapis/google-auth-library-python/issues/1819">#1819</a>)</li>
<li><a
href="https://github.com/googleapis/google-auth-library-python/commit/aca34b5ca521398be7bb99543a32302bc40ca234"><code>aca34b5</code></a>
chore: secret update (<a
href="https://redirect.github.com/googleapis/google-auth-library-python/issues/1847">#1847</a>)</li>
<li><a
href="https://github.com/googleapis/google-auth-library-python/commit/62c0fc82a3625542381f85c698595446fc99ddae"><code>62c0fc8</code></a>
fix: Read scopes from ADC json for impersoanted cred (<a
href="https://redirect.github.com/googleapis/google-auth-library-python/issues/1820">#1820</a>)</li>
<li><a
href="https://github.com/googleapis/google-auth-library-python/commit/36ecb1d65883477d27faf9c2281fc289659b9903"><code>36ecb1d</code></a>
feat: Add trust boundary support for external accounts. (<a
href="https://redirect.github.com/googleapis/google-auth-library-python/issues/1809">#1809</a>)</li>
<li><a
href="https://github.com/googleapis/google-auth-library-python/commit/10823c2feb700075cd9d2e895ca60a1fa0d4d912"><code>10823c2</code></a>
chore: secret update (<a
href="https://redirect.github.com/googleapis/google-auth-library-python/issues/1818">#1818</a>)</li>
<li><a
href="https://github.com/googleapis/google-auth-library-python/commit/e16d70b750e469d59e89ebc8969b6a74a97ae365"><code>e16d70b</code></a>
test: Add tests to cover deprecation and suppression (<a
href="https://redirect.github.com/googleapis/google-auth-library-python/issues/1817">#1817</a>)</li>
<li>See full diff in <a
href="https://github.com/googleapis/google-auth-library-python/compare/v2.41.1...v2.42.1">compare
view</a></li>
</ul>
</details>
<br />


[![Dependabot compatibility
score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=google-auth&package-manager=pip&previous-version=2.41.1&new-version=2.42.1)](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores)

Dependabot will resolve any conflicts with this PR as long as you don't
alter it yourself. You can also trigger a rebase manually by commenting
`@dependabot rebase`.

[//]: # (dependabot-automerge-start)
[//]: # (dependabot-automerge-end)

---

<details>
<summary>Dependabot commands and options</summary>
<br />

You can trigger Dependabot actions by commenting on this PR:
- `@dependabot rebase` will rebase this PR
- `@dependabot recreate` will recreate this PR, overwriting any edits
that have been made to it
- `@dependabot merge` will merge this PR after your CI passes on it
- `@dependabot squash and merge` will squash and merge this PR after
your CI passes on it
- `@dependabot cancel merge` will cancel a previously requested merge
and block automerging
- `@dependabot reopen` will reopen this PR if it is closed
- `@dependabot close` will close this PR and stop Dependabot recreating
it. You can achieve the same result by closing it manually
- `@dependabot show <dependency name> ignore conditions` will show all
of the ignore conditions of the specified dependency
- `@dependabot ignore this major version` will close this PR and stop
Dependabot creating any more for this major version (unless you reopen
the PR or upgrade to it yourself)
- `@dependabot ignore this minor version` will close this PR and stop
Dependabot creating any more for this minor version (unless you reopen
the PR or upgrade to it yourself)
- `@dependabot ignore this dependency` will close this PR and stop
Dependabot creating any more for this dependency (unless you reopen the
PR or upgrade to it yourself)


</details>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants