Commits

Commit history

1. Commits on Oct 12, 2026

   • fix: use Spark-compatible shuffle for wide decimal hash keys (#6005)

     Show description for 019f3be
     

     sunchao

     and

     andygrove

     authored
     019f3beView commit details

     Copy full SHA for 019f3be

     Browse repository at this point

   • test: fail Comet tests when a native plan mislabels a timestamp's timezone (#6868)

     Show description for 66e0c70
     andygrove

     authored
     66e0c70View commit details

     Copy full SHA for 66e0c70

     Browse repository at this point

   • fix: keep one row per key in a native PartialMerge that runs short of memory (#6867)

     Show description for 46f6311
     andygrove

     authored
     46f6311View commit details

     Copy full SHA for 46f6311

     Browse repository at this point

   • test: migrate required-child hash regressions to SQL fixtures (#6864)

     rich7420

     authored
     71ae228View commit details

     Copy full SHA for 71ae228

     Browse repository at this point
2. Commits on Oct 11, 2026

   • fix: preserve CASE WHEN struct field names from the first THEN branch (#6827)

     Show description for cf66738
     pingzh

     authored
     cf66738View commit details

     Copy full SHA for cf66738

     Browse repository at this point

   • fix: accept all BMP Unicode decimal digits in cast(string as decimal) (#6841)

     Show description for 512d05f
     viirya

     authored
     512d05fView commit details

     Copy full SHA for 512d05f

     Browse repository at this point

   • fix: fall back from native V2 scans when the plan reads input_file_name (#6754)

     Show description for 79dd56f
     zhangfengcdt

     authored
     79dd56fView commit details

     Copy full SHA for 79dd56f

     Browse repository at this point

   • fix: resolve Azure ABFS authentication through Hadoop and keep ambient credentials out (#6059)

     Show description for d8d37fc
     dwsmith1983

     authored
     d8d37fcView commit details

     Copy full SHA for d8d37fc

     Browse repository at this point

   • perf: presize collections and reuse buffers in native loops (#6861)

     Show description for 6296625
     comphead

     authored
     6296625View commit details

     Copy full SHA for 6296625

     Browse repository at this point

   • perf: read shuffle blocks in 64 KiB pieces instead of through `Channels.newChannel` (#6805)

     Show description for 0691bd3
     comphead

     authored
     0691bd3View commit details

     Copy full SHA for 0691bd3

     Browse repository at this point

   • chore: re-enable unused-parameter warnings in strict profile (#6846)

     rich7420

     authored
     7321b42View commit details

     Copy full SHA for 7321b42

     Browse repository at this point

   • feat: add lz4 as an opt-in codec for Comet's in-memory cache (#6859)

     Show description for afa477f
     andygrove

     authored
     afa477fView commit details

     Copy full SHA for afa477f

     Browse repository at this point

   • perf: generate the columnar-to-row projection once per executor instead of per partition (#6858)

     Show description for 6a5a607
     andygrove

     authored
     6a5a607View commit details

     Copy full SHA for 6a5a607

     Browse repository at this point

   • test: count the partitions and batches the native cache scan reads (#6836)

     Show description for 8081c7c
     andygrove

     authored
     8081c7cView commit details

     Copy full SHA for 8081c7c

     Browse repository at this point

   • docs: list the S3A settings the Iceberg native-write gate ignores (#6828)

     Show description for 9a7b1c1
     andygrove

     authored
     9a7b1c1View commit details

     Copy full SHA for 9a7b1c1

     Browse repository at this point

   • feat: filter decoded probe batches before intermediate joins (#6433)

     Show description for 19b0dd2
     sunchao

     authored
     19b0dd2View commit details

     Copy full SHA for 19b0dd2

     Browse repository at this point

   • perf: integral sequence optimisation (#6833)

     Show description for 50d73b3
     nat-openai

     authored
     50d73b3View commit details

     Copy full SHA for 50d73b3

     Browse repository at this point

   • fix: match Spark percentile ordering for negative NaNs (#6829)

     rich7420

     authored
     52a3a33View commit details

     Copy full SHA for 52a3a33

     Browse repository at this point

   • test: cover container field ids next to INT96 timestamps in the native Parquet scan (#6862)

     Show description for d735166
     dwsmith1983

     authored
     d735166View commit details

     Copy full SHA for d735166

     Browse repository at this point

   • test: move bit_count boundary coverage to SQL fixtures (#6655)

     rich7420

     authored
     9e13649View commit details

     Copy full SHA for 9e13649

     Browse repository at this point

   • fix: check native UDF types at registration and explain planning-time evaluation (#6777)

     Show description for 78b0eb0
     andygrove

     authored
     78b0eb0View commit details

     Copy full SHA for 78b0eb0

     Browse repository at this point
3. Commits on Oct 10, 2026

   • deps: bump to datafusion 55.2.0 (#6766)

     andygrove

     authored
     1e5297fView commit details

     Copy full SHA for 1e5297f

     Browse repository at this point

   • perf: skip DecimalPrecision.promote's rewrite when there is no decimal arithmetic (#5216)

     Show description for a56db5a
     andygrove

     authored
     a56db5aView commit details

     Copy full SHA for a56db5a

     Browse repository at this point

   • perf: bulk-append long nullable primitive arrays in SparkUnsafeArray conversion (#6824)

     Show description for e846847
     

     3 peopleauthored
     e846847View commit details

     Copy full SHA for e846847

     Browse repository at this point

   • fix: retry a native acquire that Spark failed after dropping the task's entry (#6310)

     Show description for c1e00e7
     dwsmith1983

     authored
     c1e00e7View commit details

     Copy full SHA for c1e00e7

     Browse repository at this point

   • refactor: remove unused cast compatibility flag (#6135)

     Show description for e7e7198
     

     3 peopleauthored
     e7e7198View commit details

     Copy full SHA for e7e7198

     Browse repository at this point

   • refactor: move the plan entry point logic into core functions (#6695)

     Show description for b94d52f
     viirya

     authored
     b94d52fView commit details

     Copy full SHA for b94d52f

     Browse repository at this point

   • fix: run InsertIntoHadoopFsRelationCommand's post-write steps in the Spark 3.x native writer (#6821)

     Show description for dc880d6
     

     viirya

     and

     Isaac

     authored
     dc880d6View commit details

     Copy full SHA for dc880d6

     Browse repository at this point

   • fix: don't let S3A committer, delete and read defaults block native Iceberg writes (#6808)

     Show description for a3b297c
     andygrove

     authored
     a3b297cView commit details

     Copy full SHA for a3b297c

     Browse repository at this point
4. Commits on Oct 9, 2026

   • feat: run array_contains on float elements natively with Spark's equa… (#6599)

     Show description for bfacc43
     

     zhangfengcdt

     and

     andygrove

     authored
     bfacc43View commit details

     Copy full SHA for bfacc43

     Browse repository at this point

   • feat: enable Comet's in-memory cache by default (#5634)

     Show description for c118b35
     

     andygrove

     and

     test

     authored
     c118b35View commit details

     Copy full SHA for c118b35

     Browse repository at this point

   • feat: run nullable nested float sort keys natively in strict floating-point mode (#6735)

     Show description for 1e2d783
     andygrove

     authored
     1e2d783View commit details

     Copy full SHA for 1e2d783

     Browse repository at this point

   • fix: truncate per-row date_trunc formats with the literal-format kernel (#6354)

     Show description for 6960a48
     andygrove

     authored
     6960a48View commit details

     Copy full SHA for 6960a48

     Browse repository at this point

   • perf: run Spark's null guard for a Scala UDF inside the codegen kernel (#6715)

     Show description for a2ace46
     andygrove

     authored
     a2ace46View commit details

     Copy full SHA for a2ace46

     Browse repository at this point

   • test: drain the listener bus before registering Iceberg test listeners (#6809)

     Show description for 00a4b42
     

     viirya

     and

     Isaac

     authored
     00a4b42View commit details

     Copy full SHA for 00a4b42

     Browse repository at this point