Commits

Branch selector

 master

User selector

BryanCutler

Datepicker

All time

Commit History

Commits on Jan 10, 2020

• [SPARK-29748][PYTHON][SQL] Remove Row field sorting in PySpark for version 3.6+

  Show description for f372d1c
  BryanCutler

  committed
  f372d1c

  Copy full SHA for f372d1c

Commits on Nov 15, 2019

• [SPARK-29376][SQL][PYTHON] Upgrade Apache Arrow to version 0.15.1

  Show description for 65a189c
  

  BryanCutler

  authored and

  HyukjinKwon

  committed
  65a189c

  Copy full SHA for 65a189c

Commits on Oct 11, 2019

• [SPARK-29402][PYTHON][TESTS] Added tests for grouped map pandas_udf with window

  Show description for beb8d2f
  BryanCutler

  committed
  beb8d2f

  Copy full SHA for beb8d2f

• [SPARK-29367][DOC] Add compatibility note for Arrow 0.15.0 to SQL guide

  Show description for 6390f02
  

  BryanCutler

  authored and

  HyukjinKwon

  committed
  6390f02

  Copy full SHA for 6390f02

Commits on Jun 26, 2019

• [SPARK-27992][PYTHON] Allow Python to join with connection thread to propagate errors

  Show description for c277afb
  BryanCutler

  committed
  c277afb

  Copy full SHA for c277afb

Commits on Jun 22, 2019

• [SPARK-28128][PYTHON][SQL] Pandas Grouped UDFs skip empty partitions

  Show description for 5ad1053
  

  BryanCutler

  authored and

  HyukjinKwon

  committed
  5ad1053

  Copy full SHA for 5ad1053

Commits on Jun 18, 2019

• [SPARK-28041][PYTHON] Increase minimum supported Pandas to 0.23.2

  Show description for 90f8039
  

  BryanCutler

  authored and

  HyukjinKwon

  committed
  90f8039

  Copy full SHA for 90f8039

Commits on May 7, 2019

• [SPARK-23961][SPARK-27548][PYTHON] Fix error when toLocalIterator goes out of scope and properly raise errors from worker

  Show description for 5e79ae3
  BryanCutler

  committed
  5e79ae3

  Copy full SHA for 5e79ae3

Commits on Apr 22, 2019

• [SPARK-27276][PYTHON][SQL] Increase minimum version of pyarrow to 0.12.1 and remove prior workarounds

  Show description for d36cce1
  

  BryanCutler

  authored and

  HyukjinKwon

  committed
  d36cce1

  Copy full SHA for d36cce1

Commits on Apr 9, 2019

• [SPARK-27387][PYTHON][TESTS] Replace sqlutils.assertPandasEqual with Pandas assert_frame_equals

  Show description for f62f44f
  

  BryanCutler

  authored and

  HyukjinKwon

  committed
  f62f44f

  Copy full SHA for f62f44f

Commits on Mar 21, 2019

• [SPARK-27163][PYTHON] Cleanup and consolidate Pandas UDF functionality

  Show description for be08b41
  

  BryanCutler

  authored and

  HyukjinKwon

  committed
  be08b41

  Copy full SHA for be08b41

Commits on Mar 7, 2019

• [SPARK-23836][PYTHON] Add support for StructType return in Scalar Pandas UDF

  Show description for ddc2052
  BryanCutler

  committed
  ddc2052

  Copy full SHA for ddc2052

Commits on Jan 29, 2019

• [SPARK-26566][PYTHON][SQL] Upgrade Apache Arrow to version 0.12.0

  Show description for 16990f9
  

  BryanCutler

  authored and

  HyukjinKwon

  committed
  16990f9

  Copy full SHA for 16990f9

Commits on Dec 6, 2018

• [SPARK-25274][PYTHON][SQL] In toPandas with Arrow send un-ordered record batches to improve performance

  Show description for ecaa495
  BryanCutler

  committed
  ecaa495

  Copy full SHA for ecaa495

Commits on Nov 18, 2018

• [SPARK-26033][PYTHON][TESTS] Break large ml/tests.py file into smaller files

  Show description for 034ae30
  

  BryanCutler

  authored and

  HyukjinKwon

  committed
  034ae30

  Copy full SHA for 034ae30

Commits on Nov 16, 2018

• [SPARK-26034][PYTHON][TESTS] Break large mllib/tests.py file into smaller files

  Show description for a2fc48c
  

  BryanCutler

  authored and

  HyukjinKwon

  committed
  a2fc48c

  Copy full SHA for a2fc48c

Commits on Sep 20, 2018

• [SPARK-25471][PYTHON][TEST] Fix pyspark-sql test error when using Python 3.6 and Pandas 0.23

  Show description for 90e3955
  

  BryanCutler

  authored and

  HyukjinKwon

  committed
  90e3955

  Copy full SHA for 90e3955

Commits on Aug 29, 2018

• [SPARK-23030][SQL][PYTHON] Use Arrow stream format for creating from and collecting Pandas DataFrames

  Show description for 82c18c2
  

  BryanCutler

  authored and

  HyukjinKwon

  committed
  82c18c2

  Copy full SHA for 82c18c2

Commits on Aug 18, 2018

• [SPARK-23555][PYTHON] Add BinaryType support for Arrow in Python

  Show description for 10f2b6f
  BryanCutler

  committed
  10f2b6f

  Copy full SHA for 10f2b6f

Commits on Aug 15, 2018

• [SPARK-23874][SQL][PYTHON] Upgrade Apache Arrow to 0.10.0

  Show description for ed075e1
  BryanCutler

  committed
  ed075e1

  Copy full SHA for ed075e1

Commits on Jun 26, 2018

• [SPARK-24324][PYTHON][FOLLOWUP] Grouped Map positional conf should have deprecation note

  Show description for d48803b
  BryanCutler

  committed
  d48803b

  Copy full SHA for d48803b

Commits on Jun 24, 2018

• [SPARK-24324][PYTHON] Pandas Grouped Map UDF should assign result columns by name

  Show description for a5849ad
  

  BryanCutler

  authored and

  HyukjinKwon

  committed
  a5849ad

  Copy full SHA for a5849ad

Commits on Jun 1, 2018

• [SPARK-24444][DOCS][PYTHON] Improve Pandas UDF docs to explain column assignment

  Show description for b2d0226
  

  BryanCutler

  authored and

  HyukjinKwon

  committed
  b2d0226

  Copy full SHA for b2d0226

Commits on May 28, 2018

• [SPARK-24392][PYTHON] Label pandas_udf as Experimental

  Show description for fa2ae9d
  

  BryanCutler

  authored and

  HyukjinKwon

  committed
  fa2ae9d

  Copy full SHA for fa2ae9d

Commits on Apr 2, 2018

• [SPARK-15009][PYTHON][FOLLOWUP] Add default param checks for CountVectorizerModel

  Show description for 44a9f8e
  BryanCutler

  committed
  44a9f8e

  Copy full SHA for 44a9f8e

Commits on Mar 28, 2018

• [SPARK-23699][PYTHON][SQL] Raise same type of error caught with Arrow enabled

  Show description for ed72bad
  BryanCutler

  committed
  ed72bad

  Copy full SHA for ed72bad

Commits on Mar 26, 2018

• [SPARK-23700][PYTHON] Cleanup imports in pyspark.sql

  Show description for a9350d7
  

  BryanCutler

  authored and

  HyukjinKwon

  committed
  a9350d7

  Copy full SHA for a9350d7

Commits on Mar 23, 2018

• [SPARK-21685][PYTHON][ML] PySpark Params isSet state should not change after transform

  Show description for cb43bbe
  

  BryanCutler

  authored and

  holdenk

  committed
  cb43bbe

  Copy full SHA for cb43bbe

Commits on Mar 16, 2018

• [SPARK-15009][PYTHON][ML] Construct a CountVectorizerModel from a vocabulary list

  Show description for 8a72734
  

  BryanCutler

  authored and

  holdenk

  committed
  8a72734

  Copy full SHA for 8a72734

Commits on Mar 8, 2018

• [SPARK-23159][PYTHON] Update cloudpickle to v0.4.3

  Show description for 9bb239c
  

  BryanCutler

  authored and

  HyukjinKwon

  committed
  9bb239c

  Copy full SHA for 9bb239c

Commits on Jan 30, 2018

• [SPARK-22221][SQL][FOLLOWUP] Externalize spark.sql.execution.arrow.maxRecordsPerBatch

  Show description for f235df6
  

  BryanCutler

  authored and

  gatorsmile

  committed
  f235df6

  Copy full SHA for f235df6

Commits on Jan 29, 2018

• [SPARK-22221][DOCS] Adding User Documentation for Arrow

  Show description for 0d60b32
  

  BryanCutler

  authored and

  gatorsmile

  committed
  0d60b32

  Copy full SHA for 0d60b32

Commits on Jan 25, 2018

• [SPARK-23163][DOC][PYTHON] Sync ML Python API with Scala

  Show description for 39ee2ac
  

  BryanCutler

  authored and

  Felix Cheung

  committed
  39ee2ac

  Copy full SHA for 39ee2ac

Commits on Jan 17, 2018

• [MINOR] Fix typos in ML scaladocs

  Show description for 7823d43
  

  BryanCutler

  authored and

  srowen

  committed
  7823d43

  Copy full SHA for 7823d43

Commits on Jan 10, 2018

• [SPARK-23009][PYTHON] Fix for non-str col names to createDataFrame from Pandas

  Show description for e599837
  

  BryanCutler

  authored and

  HyukjinKwon

  committed
  e599837

  Copy full SHA for e599837

Pagination

Previous

Next