-
Notifications
You must be signed in to change notification settings - Fork 28.9k
Pull requests: apache/spark
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
[WIP] Introducing OffsetMap to enable Named Streaming Sources
SQL
STRUCTURED STREAMING
#53123
opened Nov 18, 2025 by
ericm-db
Loading…
[SPARK-54392][SS] Optimize JVM-Python communication for TWS initial state
CORE
PYTHON
SQL
STRUCTURED STREAMING
#53122
opened Nov 18, 2025 by
nyaapa
Loading…
[SPARK-54412][TEST] Cleanup (drop) view created in identifier-clause.sql golden file
SQL
#53121
opened Nov 18, 2025 by
vrozov
Loading…
[SPARK-54410][SQL] Support Variant Logical Type Annotation on parquet reads
SQL
#53120
opened Nov 18, 2025 by
harshmotw-db
Loading…
[SPARK-51771][SQL][FOLLOWUP] Rename currentVersion to version in DSv2 Table
SQL
#53118
opened Nov 18, 2025 by
aokolnychyi
Loading…
[SPARK-47086][SPARK-48022][BUILD][CORE][WEBUI] Upgrade Jetty to 12.1.4, Jersey to 3.1.11 and Servlet to 6.0
BUILD
CORE
DSTREAM
SPARK SHELL
SQL
STRUCTURED STREAMING
WEB UI
YARN
#53116
opened Nov 18, 2025 by
sarutak
Loading…
[SPARK-53924][SPARK-54157][SQL][FOLLOWUP] Fix error formatting for incompatible table metadata checks
SQL
#53115
opened Nov 18, 2025 by
aokolnychyi
Loading…
[SPARK-44571][SQL][FOLLOWUP][DOCS] Update Scaladoc of
MergeSubplans
SQL
#53114
opened Nov 18, 2025 by
peter-toth
Loading…
[SPARK-54397][PYTHON] Make
UserDefinedType hashable
ML
PYTHON
SQL
#53113
opened Nov 18, 2025 by
zhengruifeng
Loading…
[SPARK-54395][SHUFFLE] RemoteBlockPushResolver class repeatedly initializes ObjectMapper
CORE
#53110
opened Nov 18, 2025 by
CuiYanxiang
Loading…
[SPARK-54375][CONNECT][TESTS][FOLLOWUP] Make
PythonPipelineSuite perform a default check for PythonTestDepsChecker.isConnectDepsAvailable
CONNECT
SQL
#53106
opened Nov 18, 2025 by
LuciferYang
Loading…
[SPARK-54388][SS] Introduce StatePartitionReader that scan raw bytes for Single ColFamily
SQL
#53104
opened Nov 18, 2025 by
zifeif2
Loading…
[DO_NOT_MERGE][SPARK-54390][SS] Fix JSON Deserialize in StreamingQueryListenerBus
SQL
STRUCTURED STREAMING
#53102
opened Nov 17, 2025 by
dylanwong250
Loading…
[SPARK-54389] [SS] Fix RocksDB State Store Invalid Stamp error when task is marked as failed during initialization
CORE
SQL
STRUCTURED STREAMING
#53101
opened Nov 17, 2025 by
liviazhu
Loading…
[SPARK-54386][SQL][CONNECT][CLIENT]. Fix for potential deadlock in the JavaEncoderSuite, caus…
CONNECT
SQL
#53100
opened Nov 17, 2025 by
ahshahid
Loading…
Refactor PythonException so it can take errorClass with sqlstate
CONNECT
CORE
PYTHON
SQL
#53099
opened Nov 17, 2025 by
gaogaotiantian
•
Draft
[SPARK-46166][PS] Implementation of pandas.DataFrame.any with axis=1
PANDAS API ON SPARK
PYTHON
#53096
opened Nov 17, 2025 by
devin-petersohn
Loading…
[SPARK-54358][SDP][FOLLOWUP] Code clarity followups
SQL
#53089
opened Nov 17, 2025 by
sryza
Loading…
[SPARK-54373][UI] Enlarge the SVG viewBox attribute of Job DAG initialization
WEB UI
#53087
opened Nov 17, 2025 by
yaooqinn
Loading…
[SPARK-54305][SQL][PYTHON] Add admission control support to Python DataSource streaming API
DOCS
EXAMPLES
PYTHON
SQL
STRUCTURED STREAMING
#53085
opened Nov 16, 2025 by
jiteshsoni
Loading…
[SPARK-54367][Connect]Propagate close() from SessionState to CatalogPlugins to prevent leak
CONNECT
SQL
#53078
opened Nov 15, 2025 by
MonkeyCanCode
Loading…
[WIP][SPARK-54250][PYTHON][INFRA] fix
pypy packages in docker files
BUILD
#53075
opened Nov 14, 2025 by
bjornjorgensen
•
Draft
Previous Next
ProTip!
no:milestone will show everything without a milestone.