All pull requests

Pull requests

• [SPARK-60650][PS] Fix named size aggregation in pandas API on Spark

  #59981·adiranjan25 opened Oct 31, 2026·

  ·

• [SPARK-60188][4.X][PYTHON] Warn on unknown transpiler names in pyTranspilers

  #59980·holdenk opened Oct 31, 2026Contributor·

  ·

• [SPARK-60150][4.X][SQL] Normalize float grouping keys in filters pushed below Aggregate

  #59979·holdenk opened Oct 31, 2026Contributor·

  ·

• [SPARK-58628][4.X][SQL] Transpiler: skip null guards for is-not-None-narrowed parameters

  #59978·holdenk opened Oct 31, 2026Contributor·

  ·

• [SPARK-60769][SQL] Read Maven resolution settings from session configuration

  #59977·qianlan717 opened Oct 31, 2026Contributor·

  ·

• [SPARK-60767][PYTHON] Flush Python worker init responses for initialization timing

  #59976·Spenserrrr opened Oct 30, 2026Contributor·

  ·
  1

• [SPARK-59546][4.X][SQL] Avoid per-row exceptions when inferring TimeType in JSON, CSV, and XML

  #59975·holdenk opened Oct 30, 2026Contributor·

  ·

• [SPARK-60768][SQL] Skip nested schema pruning in DSv2 column pruning when no nested field is requested

  #59974·yhuang-db opened Oct 30, 2026Contributor·

  ·

• [SPARK-48710][FOLLOWUP][PYTHON][DOCS][3.5] Document the NumPy upper bound in the installation guide

  #59973·huashi-st opened Oct 30, 2026·

  ·

• [SPARK-60766][SQL] Prune nested fields through dynamic array indices and map keys

  #59972·sunchao opened Oct 30, 2026Member·

  ·
  8

• [SPARK-60764][SQL] Do not embed constraint text in the generated code of DSv2 CheckInvariant

  #59971·dongjoon-hyun opened Oct 30, 2026Member·

  ·

• [SPARK-60763][DOCS] Add migration note for the V2 scan grouping change in Spark 4.2

  #59970·rekbun opened Oct 30, 2026·

  ·

• [SPARK-60762][SQL] Pass ScalaUDF error message parameters to generated code as references

  #59969·dongjoon-hyun opened Oct 30, 2026Member·

  ·

• [SPARK-60760][SQL] Use constant names for lambda variable references in higher-order function codegen

  #59968·dongjoon-hyun opened Oct 30, 2026Member·

  ·
  1

• [SPARK-60761][CONNECT][PYTHON] Allow an empty dict in Spark Connect DataFrame.withColumns

  #59967·hzmsh opened Oct 30, 2026Contributor·

  ·
  1

• [SPARK-60759][SQL] Avoid O(N^2) driver accumulator merge in SQLAppSta…

  #59966·luoyuqinlaura opened Oct 30, 2026·

  ·

• [SPARK-60757][SQL] Do not apply a writer's session settings to the generation expression of a generated column

  #59965·dongjoon-hyun opened Oct 30, 2026Member·

  ·
  1

• [SPARK-60756][SQL] Skip forced kvstore write in SQLAppStatusListener.…

  #59964·luoyuqinlaura opened Oct 30, 2026·

  ·

• [SPARK-60755][SQL] Fix codegen compilation failure of element_at and array index when the result is not nullable

  #59963·dongjoon-hyun opened Oct 30, 2026Member·

  ·
  2

• [SPARK-60754][SQL] Classify JDBC write failures with SQLSTATE

  #59962·linhongliu-db opened Oct 30, 2026Contributor·

  ·
  8

• [SPARK-60753][SQL] Read the columns of native data sources from their Arrow buffers, and their decimals as longs

  #59961·gengliangwang opened Oct 30, 2026Member·

  ·
  16

• [SPARK-60770][SQL][SS] Add more AvailableNow SQL test coverage

  #59960·siying opened Oct 30, 2026Contributor·

  ·

• [SPARK-60748][SQL] Extract shared CREATE VIEW analysis helpers

  #59959·vladanvasi-db opened Oct 30, 2026Contributor·

  ·
  4

• [SPARK-60747][SQL] Add SQL golden tests for persistent CREATE VIEW

  #59958·vladanvasi-db opened Oct 30, 2026Contributor·

  ·
  6

• [SPARK-60744][SQL] Read the right side once with a cursor in the sort-merge ASOF join

  #59957·LukaZdravic opened Oct 30, 2026Contributor·

  ·
  1