Overview

You can find the release summary in the documentation.

The PySail Python package is available on PyPI.

What's Changed

• chore: revert the pin of hatch version and resolve ruff warnings by @lonless9 in #1090
• fix: assertion message by @YichiZhang0613 in #1098
• feat: make it possible to pass customised k8s labels to sail workers by @zemin-piao in #1103
• feat: support OpenTelemetry exporter and distributed tracing by @linhr in #1097
• deps(cargo): bump serde_with from 3.16.0 to 3.16.1 in the all group by @dependabot[bot] in #1101
• deps(npm): bump the all group with 4 updates by @dependabot[bot] in #1100
• deps(cargo): bump the breaking group with 2 updates by @dependabot[bot] in #1102
• refactor: invert dependency for data source registration by @lonless9 in #1099
• feat: new functions in datafusion 51 by @davidlghellin in #1106
• feat: query execution tracing by @linhr in #1104
• fix: handle Timestamp & TimestampNTZ Writes for Delta Lake by @lonless9 in #1095
• fix: resolve partition column mismatches and validate specs during writes by @lonless9 in #1108
• deps(cargo): bump the all group with 3 updates by @dependabot[bot] in #1112
• deps(npm): bump the all group with 6 updates by @dependabot[bot] in #1113
• fix: refine shuffle consumption planning by @linhr in #1111
• feat: add PySpark function scanner & sail coverage by @keen85 in #1075
• refactor: use arrow take_record_batch by @gstvg in #1115
• feat: explain statement rework by @lonless9 in #1110
• feat: report execution metrics by @linhr in #1116
• fix: partition handling under column mapping for Delta Lake by @lonless9 in #1109
• fix: improve conflict checking and retries for concurrent Delta creation and blind appending by @lonless9 in #1117
• chore: address clippy 1.92.0 warnings by @lonless9 in #1118
• fix: ensure single partition input for GlobalLimitExec by @lonless9 in #1121
• chore: prepare v0.4.4 by @shehabgamin in #1120

New Contributors

• @YichiZhang0613 made their first contribution in #1098
• @keen85 made their first contribution in #1075
• @gstvg made their first contribution in #1115

Full Changelog: v0.4.3...v0.4.4