Commits

Branch selector

master

User selector

All users

All time

Commit history

Commits on Jan 19, 2025

• [SPARK-50882][SQL][TESTS] Skip `TPCDSCollationQueryTestSuite.q22-v2.7` test in GitHub Action CI

  Show description for 404bc2e
  dongjoon-hyun

  committed
  404bc2e

  Copy full SHA for 404bc2e

Commits on Jan 18, 2025

• [SPARK-50739][SQL][FOLLOW] Simplify ResolveRecursiveCTESuite with dsl

  Show description for 66dd7dd
  

  cloud-fan

  authored and

  dongjoon-hyun

  committed
  66dd7dd

  Copy full SHA for 66dd7dd

• [SPARK-50861][BUILD] Upgrade dropwizard metrics to 4.2.30

  Show description for 6b491bc
  

  panbingkun

  authored and

  dongjoon-hyun

  committed
  6b491bc

  Copy full SHA for 6b491bc

• [SPARK-50872][SQL][UI] Makes ToPrettyString expression not affect UI presentation

  Show description for c3f6c58
  

  yaooqinn

  authored and

  dongjoon-hyun

  committed
  c3f6c58

  Copy full SHA for c3f6c58

• [SPARK-50885][BUILD] Change to use `SbtPomKeys` to obtain `io.grpc.version` in `SparkBuild.scala`

  Show description for b104db9
  

  LuciferYang

  authored and

  dongjoon-hyun

  committed
  b104db9

  Copy full SHA for b104db9

• [SPARK-50808][CORE] Fix issue in writeAll with mixed types not getting written properly

  Show description for 98d9968
  

  Mridul Muralidharan

  committed
  98d9968

  Copy full SHA for 98d9968

• [SPARK-50868][BUILD] Upgrade `scalafmt` to 3.8.5

  Show description for 8b12bbb
  

  panbingkun

  authored and

  LuciferYang

  committed
  8b12bbb

  Copy full SHA for 8b12bbb

• [SPARK-50874][ML][PYTHON][CONNECT] Support `LinearRegression` on connect

  Show description for 93e56c2
  zhengruifeng

  committed
  93e56c2

  Copy full SHA for 93e56c2

• [SPARK-50869][ML][CONNECT][PYTHON] Support evaluators on ML Connet

  Show description for ef363b6
  

  wbo4958

  authored and

  zhengruifeng

  committed
  ef363b6

  Copy full SHA for ef363b6

Commits on Jan 17, 2025

• [SPARK-50652][SS] Add checks to RocksDB V2 backward compatibility

  Show description for 205e382
  

  WweiL

  authored and

  HeartSaVioR

  committed
  205e382

  Copy full SHA for 205e382

• [SPARK-49014][BUILD][DOCS][FOLLOWUP] Synchronize the Avro version in `SparkBuild.scala/docs/comments to` 1.12.0

  Show description for 3ef529b
  

  LuciferYang

  authored and

  dongjoon-hyun

  committed
  3ef529b

  Copy full SHA for 3ef529b

• [SPARK-50871][BUILD] Upgrade `scala-parallel-collections` to 1.2.0

  Show description for 4e47023
  

  LuciferYang

  authored and

  dongjoon-hyun

  committed
  4e47023

  Copy full SHA for 4e47023

• [SPARK-50739][SQL] Recursive CTE. Analyzer changes to unravel and resolve the recursion components

  Show description for 3b114af
  

  nemanjapetr-db

  authored and

  cloud-fan

  committed
  3b114af

  Copy full SHA for 3b114af

• [SPARK-50851][ML][CONNECT][PYTHON] Express ML params with `proto.Expression.Literal`

  Show description for 2721a50
  zhengruifeng

  committed
  2721a50

  Copy full SHA for 2721a50

• [MINOR][CORE] Fix compilation warnings in `UnsafeInMemorySorter.java`

  Show description for 10dd350
  LuciferYang

  committed
  10dd350

  Copy full SHA for 10dd350

• [SPARK-50866][INFRA] Limit GHA job execution time to up to 2 hours

  Show description for 3b0ac45
  dongjoon-hyun

  committed
  3b0ac45

  Copy full SHA for 3b0ac45

• [SPARK-50867][PYTHON][TESTS] Move `search_jar` and `SPARK_HOME` to `sqlutils.py`

  Show description for 3a12038
  zhengruifeng

  committed
  3a12038

  Copy full SHA for 3a12038

• [SPARK-50863][PYTHON][ML][TESTS] Skip slow pytorch tests

  Show description for c81fa33
  

  zhengruifeng

  authored and

  dongjoon-hyun

  committed
  c81fa33

  Copy full SHA for c81fa33

• [SPARK-50263][CONNECT] Replace `System.currentTimeMillis` with `System.nanoTime`

  Show description for 371ae03
  

  changgyoopark-db

  authored and

  HyukjinKwon

  committed
  371ae03

  Copy full SHA for 371ae03

• [SPARK-50618][SS][SQL] Make DataFrameReader and DataStreamReader leverage the analyzer more

  Show description for 3892db7
  

  Burak Yavuz

  authored and

  cloud-fan

  committed
  3892db7

  Copy full SHA for 3892db7

• [SPARK-50860][INFRA] Clarify Exclusion of Doc-Only Updates from User-Facing Changes

  Show description for 5fa6dbc
  

  gengliangwang

  authored and

  HyukjinKwon

  committed
  5fa6dbc

  Copy full SHA for 5fa6dbc

• [SPARK-50859][BUILD] Upgrade AWS SDK v2 to 2.25.53

  Show description for baf13fb
  dongjoon-hyun

  committed
  baf13fb

  Copy full SHA for baf13fb

• [SPARK-50714][SQL][SS] Enable schema evolution for TransformWithState when Avro encoding is used

  Show description for 41aa0b5
  

  ericm-db

  authored and

  HeartSaVioR

  committed
  41aa0b5

  Copy full SHA for 41aa0b5

Commits on Jan 16, 2025

• [SPARK-50852][INFRA] Add Java 21 Daily GitHub Action job for `branch-4.0`

  Show description for 11d758f
  dongjoon-hyun

  committed
  11d758f

  Copy full SHA for 11d758f

• [SPARK-50829][SQL] Add flag to disable session collation by default

  Show description for e2cff22
  

  stefankandic

  authored and

  MaxGekk

  committed
  e2cff22

  Copy full SHA for e2cff22

• [SPARK-50633][INFRA][FOLLOWUP] Let CODECOV_TOKEN transfer to build_and_test.yml

  Show description for ffb3156
  

  panbingkun

  authored and

  dongjoon-hyun

  committed
  ffb3156

  Copy full SHA for ffb3156

• [SPARK-46934][SQL][FOLLOWUP] Handle Special Characters for HMS

  Show description for 523ff15
  

  yaooqinn

  authored and

  dongjoon-hyun

  committed
  523ff15

  Copy full SHA for 523ff15

• [SPARK-50831][SQL] Enable trimming collation by default

  Show description for 96adcc4
  

  stevomitric

  authored and

  MaxGekk

  committed
  96adcc4

  Copy full SHA for 96adcc4

• [SPARK-50827][ML][CONNECT] Support plugin

  Show description for 86804f6
  

  wbo4958

  authored and

  grundprinzip

  committed
  86804f6

  Copy full SHA for 86804f6

• [SPARK-50795][SQL] Store timestamp as `long` type in `describe` LinkedHashMap

  Show description for 8bbec5d
  

  asl3

  and

  cloud-fan

  committed
  8bbec5d

  Copy full SHA for 8bbec5d

• [SPARK-50830][SQL] Return single-pass result as the dual run analysis result

  Show description for 6ebed5b
  

  mihailoale-db

  authored and

  cloud-fan

  committed
  6ebed5b

  Copy full SHA for 6ebed5b

• [SPARK-50825][ML][PYTHON][CONNECT] Support Tree Classifiers in ML Connect

  Show description for d12bb23
  zhengruifeng

  committed
  d12bb23

  Copy full SHA for d12bb23

• [SPARK-49907][ML][CONNECT][FOLLOW-UP] Move pyspark.ml.remote to pyspark.ml.connect

  Show description for 97241eb
  

  HyukjinKwon

  and

  wbo4958

  committed
  97241eb

  Copy full SHA for 97241eb

• [SPARK-50792][SQL] Format binary data as a binary literal in JDBC

  Show description for 813591f
  

  sunxiaoguang

  authored and

  cloud-fan

  committed
  813591f

  Copy full SHA for 813591f

• [SPARK-50768][SQL][CORE][FOLLOW-UP] Apply TaskContext.createResourceUninterruptibly() to risky resource creations

  Show description for 9b32334
  

  Ngone51

  authored and

  dongjoon-hyun

  committed
  9b32334

  Copy full SHA for 9b32334