Commits

Breadcrumbs

History for

onmaster

User selector

All users

All time

Commit history

Commits on Jan 18, 2025

• [SPARK-50874][ML][PYTHON][CONNECT] Support `LinearRegression` on connect

  Show description for 93e56c2
  zhengruifeng

  committed
  93e56c2View commit details

  Copy full SHA for 93e56c2

  View code at this pointBrowse repository at this point

• [SPARK-50869][ML][CONNECT][PYTHON] Support evaluators on ML Connet

  Show description for ef363b6
  

  wbo4958

  authored and

  zhengruifeng

  committed
  ef363b6View commit details

  Copy full SHA for ef363b6

  View code at this pointBrowse repository at this point

Commits on Jan 17, 2025

• [SPARK-50851][ML][CONNECT][PYTHON] Express ML params with `proto.Expression.Literal`

  Show description for 2721a50
  zhengruifeng

  committed
  2721a50View commit details

  Copy full SHA for 2721a50

  View code at this pointBrowse repository at this point

• [SPARK-50867][PYTHON][TESTS] Move `search_jar` and `SPARK_HOME` to `sqlutils.py`

  Show description for 3a12038
  zhengruifeng

  committed
  3a12038View commit details

  Copy full SHA for 3a12038

  View code at this pointBrowse repository at this point

• [SPARK-50863][PYTHON][ML][TESTS] Skip slow pytorch tests

  Show description for c81fa33
  

  zhengruifeng

  authored and

  dongjoon-hyun

  committed
  c81fa33View commit details

  Copy full SHA for c81fa33

  View code at this pointBrowse repository at this point

• [SPARK-50714][SQL][SS] Enable schema evolution for TransformWithState when Avro encoding is used

  Show description for 41aa0b5
  

  ericm-db

  authored and

  HeartSaVioR

  committed
  41aa0b5View commit details

  Copy full SHA for 41aa0b5

  View code at this pointBrowse repository at this point

Commits on Jan 16, 2025

• [SPARK-50825][ML][PYTHON][CONNECT] Support Tree Classifiers in ML Connect

  Show description for d12bb23
  zhengruifeng

  committed
  d12bb23View commit details

  Copy full SHA for d12bb23

  View code at this pointBrowse repository at this point

• [SPARK-49907][ML][CONNECT][FOLLOW-UP] Move pyspark.ml.remote to pyspark.ml.connect

  Show description for 97241eb
  

  HyukjinKwon

  and

  wbo4958

  committed
  97241ebView commit details

  Copy full SHA for 97241eb

  View code at this pointBrowse repository at this point

• [SPARK-49907][ML][CONNECT][FOLLOW-UP] Add ml connect related packages into PyPI packages

  Show description for dff46cf
  HyukjinKwon

  committed
  dff46cfView commit details

  Copy full SHA for dff46cf

  View code at this pointBrowse repository at this point

Commits on Jan 15, 2025

• [SPARK-50822][BUILD] Setting version to 4.1.0-SNAPSHOT

  Show description for 9714645
  

  dongjoon-hyun

  authored and

  cloud-fan

  committed
  9714645View commit details

  Copy full SHA for 9714645

  View code at this pointBrowse repository at this point

• [SPARK-50828][PYTHON][ML][CONNECT] Deprecate `pyspark.ml.connect`

  Show description for 973db21
  zhengruifeng

  committed
  973db21View commit details

  Copy full SHA for 973db21

  View code at this pointBrowse repository at this point

• [SPARK-50815][PYTHON][SQL] Fix bug where passing null Variants in createDataFrame causes it to fail and add Variant support in createDataFrame in Spark Connect

  Show description for 39bb2d8
  

  harshmotw-db

  authored and

  cloud-fan

  committed
  39bb2d8View commit details

  Copy full SHA for 39bb2d8

  View code at this pointBrowse repository at this point

• [SPARK-49907][ML][CONNECT][FOLLOWUP] Remove unused `expressions.proto` import

  Show description for 1517315
  dongjoon-hyun

  committed
  1517315View commit details

  Copy full SHA for 1517315

  View code at this pointBrowse repository at this point

• [SPARK-50824][PYTHON] Avoid importing optional Python packages for checking

  Show description for 7e1248a
  HyukjinKwon

  committed
  7e1248aView commit details

  Copy full SHA for 7e1248a

  View code at this pointBrowse repository at this point

• [SPARK-50821][PYTHON] Upgrade Py4J from 0.10.9.8 to 0.10.9.9

  Show description for d792865
  HyukjinKwon

  committed
  d792865View commit details

  Copy full SHA for d792865

  View code at this pointBrowse repository at this point

• [SPARK-50823][PYTHON] Upgrade cloudpickle from 3.1.0 to 3.1.1

  Show description for d2ecfd7
  HyukjinKwon

  committed
  d2ecfd7View commit details

  Copy full SHA for d2ecfd7

  View code at this pointBrowse repository at this point

• [SPARK-50818][PYTHON] Replace `has_numpy` with `have_numpy`

  Show description for f223b8d
  zhengruifeng

  committed
  f223b8dView commit details

  Copy full SHA for f223b8d

  View code at this pointBrowse repository at this point

Commits on Jan 14, 2025

• [SPARK-49907][ML][CONNECT] Support spark.ml on Connect

  Show description for fafe43c
  

  wbo4958

  authored and

  zhengruifeng

  committed
  fafe43cView commit details

  Copy full SHA for fafe43c

  View code at this pointBrowse repository at this point

• [SPARK-50790][PYTHON] Implement parse json in pyspark

  Show description for 3c7f5e2
  

  gene-db

  authored and

  HyukjinKwon

  committed
  3c7f5e2View commit details

  Copy full SHA for 3c7f5e2

  View code at this pointBrowse repository at this point

• [SPARK-48809][PYTHON][DOCS] Reimplemented `spark version drop down` of the `PySpark doc site` and fix bug

  Show description for 94a31bd
  

  panbingkun

  authored and

  HyukjinKwon

  committed
  94a31bdView commit details

  Copy full SHA for 94a31bd

  View code at this pointBrowse repository at this point

• [MINOR][DOCS] Fix the examples of createDataFrame

  Show description for ebe39f6
  

  zhengruifeng

  authored and

  dongjoon-hyun

  committed
  ebe39f6View commit details

  Copy full SHA for ebe39f6

  View code at this pointBrowse repository at this point

• [SPARK-50601][SQL] Support withColumns / withColumnsRenamed in subqueries

  Show description for 2273139
  ueshin

  committed
  2273139View commit details

  Copy full SHA for 2273139

  View code at this pointBrowse repository at this point

• [SPARK-50392][PYTHON][FOLLOWUP] Move `import`s into methods to fix `connect-only` builds

  Show description for 313e824
  

  ueshin

  authored and

  dongjoon-hyun

  committed
  313e824View commit details

  Copy full SHA for 313e824

  View code at this pointBrowse repository at this point

Commits on Jan 10, 2025

• [MINOR][DOCS] Add new dataframe methods to API references

  Show description for 3c831eb
  zhengruifeng

  committed
  3c831ebView commit details

  Copy full SHA for 3c831eb

  View code at this pointBrowse repository at this point

• [SPARK-50719][PYTHON] Support `interruptOperation` for PySpark

  Show description for fe3d3ae
  

  itholic

  authored and

  zhengruifeng

  committed
  fe3d3aeView commit details

  Copy full SHA for fe3d3ae

  View code at this pointBrowse repository at this point

• [SPARK-50778][PYTHON] Add metadataColumn to PySpark DataFrame

  Show description for e638f6d
  

  ueshin

  authored and

  zhengruifeng

  committed
  e638f6dView commit details

  Copy full SHA for e638f6d

  View code at this pointBrowse repository at this point

Commits on Jan 9, 2025

• [SPARK-50764][PYTHON] Refine the docstring of xpath related methods

  Show description for 0123a5e
  

  drexler-sky

  authored and

  HyukjinKwon

  committed
  0123a5eView commit details

  Copy full SHA for 0123a5e

  View code at this pointBrowse repository at this point

• [SPARK-50685][PYTHON][FOLLOW-UP] Improve Py4J performance by leveraging getattr

  Show description for cb093e6
  HyukjinKwon

  committed
  cb093e6View commit details

  Copy full SHA for cb093e6

  View code at this pointBrowse repository at this point

Commits on Jan 8, 2025

• [SPARK-50752][PYTHON][SQL] Introduce configs for tuning Python UDF without Arrow

  Show description for afb4f82
  

  HeartSaVioR

  authored and

  HyukjinKwon

  committed
  afb4f82View commit details

  Copy full SHA for afb4f82

  View code at this pointBrowse repository at this point

Commits on Jan 7, 2025

• [MINOR][PYTHON][TESTS] Restore daily coverage build

  Show description for e68b98a
  zhengruifeng

  committed
  e68b98aView commit details

  Copy full SHA for e68b98a

  View code at this pointBrowse repository at this point

• [SPARK-50392][PYTHON] DataFrame conversion to table argument in Spark Classic

  Show description for e24e7b4
  xinrong-meng

  committed
  e24e7b4View commit details

  Copy full SHA for e24e7b4

  View code at this pointBrowse repository at this point

Commits on Jan 6, 2025

• [SPARK-50694][SQL] Support renames in subqueries

  Show description for d44fd2b
  ueshin

  committed
  d44fd2bView commit details

  Copy full SHA for d44fd2b

  View code at this pointBrowse repository at this point

• [SPARK-50357][PYTHON] Support Interrupt(Tag|All) APIs for PySpark

  Show description for 459483a
  itholic

  committed
  459483aView commit details

  Copy full SHA for 459483a

  View code at this pointBrowse repository at this point

• [SPARK-48459][FOLLOWUP][MINOR] Cleanup unused global variable

  Show description for 56284bf
  

  itholic

  authored and

  HyukjinKwon

  committed
  56284bfView commit details

  Copy full SHA for 56284bf

  View code at this pointBrowse repository at this point

• [SPARK-50703][PYTHON] Refine the docstring of regexp_replace, regexp_substr, and regexp_instr

  Show description for b613b22
  

  drexlersky

  authored and

  zhengruifeng

  committed
  b613b22View commit details

  Copy full SHA for b613b22

  View code at this pointBrowse repository at this point