Commits

Branch selector

 master

User selector

HeartSaVioR

Datepicker

All time

Commit History

Commits on Jan 10, 2020

• [SPARK-29779][CORE] Compact old event log files and cleanup

  Show description for 7fb17f5
  

  HeartSaVioR

  authored and

  Marcelo Vanzin

  committed
  7fb17f5

  Copy full SHA for 7fb17f5

• [SPARK-30480][PYSPARK][TESTS] Fix 'test_memory_limit' on pyspark test

  Show description for afd70a0
  

  HeartSaVioR

  authored and

  HyukjinKwon

  committed
  afd70a0

  Copy full SHA for afd70a0

Commits on Jan 8, 2020

• [SPARK-30281][SS] Consider partitioned/recursive option while verifying archive path on FileStreamSource

  Show description for bd7510b
  

  HeartSaVioR

  authored and

  Marcelo Vanzin

  committed
  bd7510b

  Copy full SHA for bd7510b

Commits on Jan 6, 2020

• [SPARK-30313][CORE] Ensure EndpointRef is available MasterWebUI/WorkerPage

  Show description for 895e572
  

  HeartSaVioR

  authored and

  Marcelo Vanzin

  committed
  895e572

  Copy full SHA for 895e572

Commits on Jan 2, 2020

• [SPARK-26560][SQL] Spark should be able to run Hive UDF using jar regardless of current thread context classloader

  Show description for 5d870ef
  

  2 peopleauthored and

  cloud-fan

  committed
  5d870ef

  Copy full SHA for 5d870ef

Commits on Dec 31, 2019

• [SPARK-30336][SQL][SS] Move Kafka consumer-related classes to its own package

  Show description for 319ccd5
  

  HeartSaVioR

  authored and

  srowen

  committed
  319ccd5

  Copy full SHA for 319ccd5

Commits on Dec 30, 2019

• [SPARK-29348][SQL][FOLLOWUP] Fix slight bug on streaming example for Dataset.observe

  Show description for e054a0a
  

  HeartSaVioR

  authored and

  HyukjinKwon

  committed
  e054a0a

  Copy full SHA for e054a0a

• [SPARK-30348][SPARK-27510][CORE][TEST] Fix flaky test failure on "MasterSuite.: Master should avoid ..."

  Show description for 8092d63
  

  HeartSaVioR

  authored and

  cloud-fan

  committed
  8092d63

  Copy full SHA for 8092d63

Commits on Dec 27, 2019

• [SPARK-30345][SQL] Fix intermittent test failure (ConnectException) on ThriftServerQueryTestSuite/ThriftServerWithSparkContextSuite

  Show description for 7adf886
  

  HeartSaVioR

  authored and

  cloud-fan

  committed
  7adf886

  Copy full SHA for 7adf886

Commits on Dec 26, 2019

• [MINOR][SQL][SS] Remove TODO comments as var in case class is discouraged but worth breaking it

  Show description for 481fb63
  

  HeartSaVioR

  authored and

  HyukjinKwon

  committed
  481fb63

  Copy full SHA for 481fb63

Commits on Dec 24, 2019

• [SPARK-28144][SPARK-29294][SS][FOLLOWUP] Use SystemTime defined in Kafka Time interface

  Show description for 2164243
  

  HeartSaVioR

  authored and

  HyukjinKwon

  committed
  2164243

  Copy full SHA for 2164243

Commits on Dec 23, 2019

• [SPARK-21869][SS] Revise Kafka producer pool to implement 'expire' correctly

  Show description for 7bff2db
  

  HeartSaVioR

  authored and

  Marcelo Vanzin

  committed
  7bff2db

  Copy full SHA for 7bff2db

Commits on Dec 21, 2019

• [SPARK-28144][SPARK-29294][SS] Upgrade Kafka to 2.4.0

  Show description for 8384ff4
  

  HeartSaVioR

  authored and

  dongjoon-hyun

  committed
  8384ff4

  Copy full SHA for 8384ff4

Commits on Dec 19, 2019

• [SPARK-29450][SS] Measure the number of output rows for streaming aggregation with append mode

  Show description for ab87bfd
  

  HeartSaVioR

  authored and

  HyukjinKwon

  committed
  ab87bfd

  Copy full SHA for ab87bfd

Commits on Dec 13, 2019

• [SPARK-30227][SQL] Add close() on DataWriter interface

  Show description for 94eb665
  

  HeartSaVioR

  authored and

  cloud-fan

  committed
  94eb665

  Copy full SHA for 94eb665

Commits on Dec 11, 2019

• [MINOR][SS][DOC] Fix the ss-kafka doc for availability of 'minPartitions' option

  Show description for e39bb4c
  

  HeartSaVioR

  authored and

  dongjoon-hyun

  committed
  e39bb4c

  Copy full SHA for e39bb4c

Commits on Dec 9, 2019

• [SPARK-30159][SQL][FOLLOWUP] Fix lint-java via removing unnecessary imports

  Show description for 538b8d1
  

  HeartSaVioR

  authored and

  dongjoon-hyun

  committed
  538b8d1

  Copy full SHA for 538b8d1

Commits on Dec 6, 2019

• [SPARK-29953][SS] Don't clean up source files for FileStreamSource if the files belong to the output of FileStreamSink

  Show description for 25431d7
  

  HeartSaVioR

  authored and

  zsxwing

  committed
  25431d7

  Copy full SHA for 25431d7

Commits on Dec 2, 2019

• [SPARK-30075][CORE][TESTS] Fix the hashCode implementation of ArrayKeyIndexType correctly

  Show description for e04a634
  

  HeartSaVioR

  authored and

  srowen

  committed
  e04a634

  Copy full SHA for e04a634

• [MINOR][SS] Add implementation note on overriding serialize/deserialize in HDFSMetadataLog methods' scaladoc

  Show description for 54edaee
  

  2 peopleauthored and

  srowen

  committed
  54edaee

  Copy full SHA for 54edaee

Commits on Nov 27, 2019

• Revert "[SPARK-26081][SPARK-29999]"

  Show description for 5b628f8
  

  HeartSaVioR

  authored and

  gengliangwang

  committed
  5b628f8

  Copy full SHA for 5b628f8

Commits on Nov 24, 2019

• [SPARK-29999][SS] Handle FileStreamSink metadata correctly for empty partition

  Show description for 0d3d46d
  

  HeartSaVioR

  authored and

  dongjoon-hyun

  committed
  0d3d46d

  Copy full SHA for 0d3d46d

Commits on Nov 11, 2019

• [SPARK-29755][CORE] Provide @JsonDeserialize for Option[Long] in LogInfo & AttemptInfoWrapper

  Show description for df08e90
  

  HeartSaVioR

  authored and

  Marcelo Vanzin

  committed
  df08e90

  Copy full SHA for df08e90

• [SPARK-26154][SS] Streaming left/right outer join should not return outer nulls for already matched rows

  Show description for c941362
  

  HeartSaVioR

  authored and

  Marcelo Vanzin

  committed
  c941362

  Copy full SHA for c941362

Commits on Nov 7, 2019

• [SPARK-29635][SS] Extract base test suites between Kafka micro-batch sink and Kafka continuous sink

  Show description for 252ecd3
  

  HeartSaVioR

  authored and

  Marcelo Vanzin

  committed
  252ecd3

  Copy full SHA for 252ecd3

Commits on Nov 6, 2019

• [SPARK-29642][SS] Change the element type of underlying array to UnsafeRow for ContinuousRecordEndpoint

  Show description for 782992c
  

  HeartSaVioR

  authored and

  Marcelo Vanzin

  committed
  782992c

  Copy full SHA for 782992c

Commits on Nov 4, 2019

• [SPARK-20568][SS] Provide option to clean up completed files in streaming query

  Show description for ba2bc4b
  

  HeartSaVioR

  authored and

  Marcelo Vanzin

  committed
  ba2bc4b

  Copy full SHA for ba2bc4b

Commits on Oct 31, 2019

• [SPARK-29604][SQL][FOLLOWUP][test-hadoop3.2] Let SparkSQLEnvSuite to be run in dedicated JVM

  Show description for 121510c
  

  HeartSaVioR

  authored and

  dongjoon-hyun

  committed
  121510c

  Copy full SHA for 121510c

Commits on Oct 30, 2019

• [SPARK-29604][SQL] Force initialize SessionState before initializing HiveClient in SparkSQLEnv

  Show description for 44a27bd
  

  HeartSaVioR

  authored and

  dongjoon-hyun

  committed
  44a27bd

  Copy full SHA for 44a27bd

Commits on Oct 29, 2019

• [SPARK-28158][SQL][FOLLOWUP] HiveUserDefinedTypeSuite: don't use RandomDataGenerator to create row for UDT backed by ArrayType

  Show description for fb80dfe
  

  HeartSaVioR

  authored and

  cloud-fan

  committed
  fb80dfe

  Copy full SHA for fb80dfe

Commits on Oct 28, 2019

• [SPARK-29509][SQL][SS] Deduplicate codes from Kafka data source

  Show description for 762db39
  

  HeartSaVioR

  authored and

  Marcelo Vanzin

  committed
  762db39

  Copy full SHA for 762db39

Commits on Oct 25, 2019

• [SPARK-29461][SQL] Measure the number of records being updated for JDBC writer

  Show description for cfbdd9d
  

  HeartSaVioR

  authored and

  maropu

  committed
  cfbdd9d

  Copy full SHA for cfbdd9d

Commits on Oct 23, 2019

• [SPARK-29503][SQL] Remove conversion CreateNamedStruct to CreateNamedStructUnsafe

  Show description for bfbf282
  

  HeartSaVioR

  authored and

  cloud-fan

  committed
  bfbf282

  Copy full SHA for bfbf282

Commits on Oct 17, 2019

• [SPARK-28869][CORE] Roll over event log files

  Show description for 100fc58
  

  HeartSaVioR

  authored and

  Marcelo Vanzin

  committed
  100fc58

  Copy full SHA for 100fc58

Commits on Oct 3, 2019

• [SPARK-29322][CORE] Enable closeFrameOnFlush on ZstdOutputStream for event log file

  Show description for e44d191
  

  HeartSaVioR

  authored and

  dongjoon-hyun

  committed
  e44d191

  Copy full SHA for e44d191

Pagination

Previous

Next