Skip to content

Releases: redpanda-data/redpanda

v25.3.2

12 Dec 04:53
5126a59

Choose a tag to compare

Features

  • Rpk can now generate a dashboard for monitoring Redpanda Serverless clusters via rpk generate grafana-dashboard --dashboard serverless. by @nicolaferraro in #28894
  • #28931 [UX-746] rpk shadow (cloud): add failure reason by @r-vasquez

Bug Fixes

  • Attempt to fail over a topic that isn't being Shadowed now returns a 404 rather than a 409 by @michael-redpanda in #28742
  • Fix an issue where an unhandled exception in archival could lead to an input_stream asserting in its destructor. by @oleiman in #28924
  • Fixed a bug where if a user updates a Shadow Link with the same password the password set at timestamp was cleared. Now if they use the same password, the timestamp is kept at its previous value by @michael-redpanda in #28863
  • Fixed a rare bug that causes timequeries against partitions using tiered storage to incorrectly return no result when the partition's local log is empty but retains an active segment. by @wdberkeley in #28871
  • Fixes a bug in which a segment could be incorrectly marked as having finished self compaction during a race with a log shutdown by @WillemKauf in #28799
  • #28853 Avoids runaway replicators after topics got deleted. Additionally improve some observability related to shadow requests. by @bharathv in #28869
  • schema_registry/swagger: Fix type for version in GET /compatibility/subjects/{subject}/versions/{version} by @BenPope in #28766
    Markdown
  • #28596 [CORE-14647] ct: Take max applied epoch into account by @Lazin
  • #28621 tx_gateway: do not log error on shutdown by @mmaslankaprv
  • #28681 [CORE-13776] Handle rpk.describe_group racing with __consumer_offsets creation by @dotnwat
  • #28694 [CORE-14665] security/audit: Fix stuck misconfigured state by @IoannisRP
  • #28755 cluster: fix topic label aggregation on restart by @ballard26
  • #28808 Recovery throttler fix by @bashtanov
  • #28827 [CORE-8225] cloud_storage_clients/abs: Drop showonly=files when using a delimiter by @wdberkeley
  • #28888 [CORE-14922] test: ignore expired cert log lines by @dotnwat
  • #28909 shadowing/tests/verifier: use unique_id suffix for group names by @bharathv
  • #28910 [CORE-14907] Fix overflow in coordinated recovery throttling by @bashtanov
  • #28940 when lowering recovery rate with recoveries in flight don't wait for available bytes to converge by @bashtanov

Improvements

  • Adds support for SASL/PLAIN authentication for Shadow Linking by @michael-redpanda in #28942
  • Aliases the following enum variants: by @michael-redpanda in #28876
    • ACLPattern.ACL_PATTERN_PREFIX to ACLPattern.ACL_PATTERN_PREFIXED
    • PatternType.PATTERN_TYPE_PREFIXED to PatternType.PATTERN_TYPE_PREFIX
  • Fixes a vulnerability in aioboto3 by pinning the urllib3 dependency. by @tyson-redpanda in #28919
  • Minor improvements to http client for better connection reuse in certain edge cases. by @nvartolomei in #28822
  • The message printed by rpk config export is now written to stderr instead of stdout, preventing it from interfering with the exported configuration when stdout is used as the output destination. i.e. rpk config export --all -f /dev/stdout by @simon0191 in #28761
  • The restart is no longer required if the cloud storage auth token is invalidated. by @Lazin in #28712
  • Updated default console image version in rpk container commands to v3.3.0 by @vbotbuildovich in #28638
  • fix shard placement table race condition by @joe-redpanda in #28675
  • partitions with an in-flight move and original replica quorum loss will now be reported as immutable by @joe-redpanda in #28687
  • rpk cluster config set: Poll operation status before returning by @paulzhang97 in #28794
  • rpk shadow is now supported in Redpanda Cloud by @r-vasquez in #28917
  • #28849 http: Add TCP keepalive to http APIs by @StephanDollberg
  • #28673 admin: Store decommission_status partitions in a chunked array by @wdberkeley
  • #28752 bazel: remove kafka/server dep from txn_reader by @rockwotj
  • #28790 [CORE-7351] Improve chances of finding a scrubber hit by @dotnwat
  • #28813 bazel: Update seastar ref by @StephanDollberg
  • #28914 Add Shadow Link information to metrics by @michael-redpanda

Full Changelog: v25.3.1...v25.3.2

v25.2.12

05 Dec 21:11
3a34ed9

Choose a tag to compare

Bug Fixes

  • Addresses an issue if the OIDC service fails to communicate with the IdP causing the prevention of controller leadership election by @michael-redpanda in #28612
  • Fix a rare bug where adjacent segment merging in tiered storage fails with Candidate creation error: candidate creation error: failed to seek end offset which could result in degraded tiered storage read performance. by @nvartolomei in #28625
  • #28256 Adding RedpandaRoles as part of whole cluster recovery. Prior to this change, roles were saved in the snapshot but not restored as part of the recovery process. This change adds that missing logic and extends the tests to validate the flow. by @nguyen-andrew in #28267
  • #28559 Fixes a bug in XML parsing for S3 and ABS clients which could lead to partial reads of XML responses by @WillemKauf in #28564
  • PR #28756 [v25.2.x] cluster: fix topic label aggregation on restart by @ballard26
  • PR #28841 [v25.2.x] http: Add TCP keepalive to http APIs by @StephanDollberg
  • PR #27502 [v25.2.x] pp/reply: handle sleep_aborted exception by @mmaslankaprv
  • PR #28607 [v25.2.x] [CORE-14678] - Lower logger severity for invalid buffer size in kafka server by @michael-redpanda
  • PR #28714 [v25.2.x][CORE-14665] security/audit: Fix stuck misconfigured state by @IoannisRP
  • fix shard placement table race condition by @joe-redpanda in #28676

Improvements

  • partitions with an in-flight move and original replica quorum loss will now be reported as immutable by @joe-redpanda in #28689
  • PR #28479 [v25.2.x] CORE-13739 Update schema registry to use chunked_vector by @nguyen-andrew
  • PR #28493 [v25.2.x] r/admin: Update security report by @IoannisRP
  • PR #28672 [v25.2.x] admin: Store decommission_status partitions in a chunked array by @wdberkeley

Full Changelog: v25.2.11...v25.2.12

v25.3.1

19 Nov 20:29
9cd8d8c

Choose a tag to compare

Features

  • Shadow Linking, for built-in Disaster Recovery, by @michael-redpanda in #27349 and others
  • Support for GCP BigLake Metastore as an Iceberg REST Catalog for Iceberg Topics, by @nvartolomei in #27251
  • Schema Registry now supports IMPORT mode for schema migration, by @pgellert in #27010
  • Connected Client Monitoring
    • Added a cluster connections list command by @graham-rp in #28157
    • Implement cluster-wide API endpoints for monitoring client connections by @pgellert in #28137, and others
  • KIP-937 (improved message timestamp validation)
    • Support message.timestamp.{before/after}.max.ms, by @WillemKauf in #27419
    • Adds a new cluster config kafka_produce_batch_validation which controls the level of timestamp validation performed on batches in the redpanda produce path, by @WillemKauf in #27529
  • KIP-516 (topic identifiers) by @BenPope in #26968
  • KIP-709 (fetch the offsets of multiple consumer groups in a single request) by @BenPope in #27794
  • Iceberg: Redpanda now supports protobuf Struct fields in Iceberg tables. A Struct field will be translated into a string column, and its value with be the JSON serialization of the Struct value. by @wdberkeley in #26930
  • Iceberg: Adds a configurable DLQ table suffix to support Iceberg catalogs/query engines that don't allow tilde characters and hence the default <topic name>~dlq format for DLQs. by @nvartolomei in #28242
  • Iceberg: support schema merging, gracefully retaining information about historical columns. by @nvartolomei in #27202
  • Introduces a 'security report' API GET /v1/security/report (Admin API) for monitoring the status of enabled security features by @IoannisRP in #27173
  • Ability to repair clusters that have lost controller quorum through a controller 'force reconfigure' API by @joe-redpanda in #27995
  • Export of consumer group information via rpk group describe ... --formatted json as json or yaml using the --formatted flag. by @alextreichler in #27647
  • Control the global upper bound on message size via kafka_max_message_size_upper_limit cluster property. This property can be used to limit the max value of the max.message.bytes topic property. by @ballard26 in #27997
  • Introduce a new "sasl_mechanisms_override" configuration that allows per-listener configuration of available sasl mechanisms. by @IoannisRP in #27458
  • Enterprise features "core_balancing_continuous" and "partition_autobalancing_mode" will be turned on by default on a new cluster or when any Enterprise license is applied. by @IoannisRP in #27824

v25.2.11

13 Nov 13:28
ab36b32

Choose a tag to compare

Features

  • rpk now prompts the user when creating a profile and the cluster has both private and public networking enabled. by @chapmanc in #28239
  • rpk: Added serverless private networking support to rpk cloud cluster select and rpk profile create. by @chapmanc in #28239

Bug Fixes

  • Do not wait for EOF from OIDC server on TLS connection shutdown. by @pgellert in #28452
  • Fix double-counting in tiered storage cache operations metrics. by @nvartolomei in #28441
  • Fixes a race in http client during shutdown by @rockwotj in #28443
  • Prevent a very narrow race condition in the partition_balancer_backend. by @WillemKauf in #28475
  • rpk: Fix host selection when using --host <index in address config>. Previously it would always choose the first address. by @nvartolomei in #28194

Improvements

  • kafka/server: Fix a memory leak when the keytab cannot be found. by @BenPope in #28453
  • kafka/server: Fix a memory leak when the keytab cannot be found. by @BenPope in #28474
  • kafka/server: Fix rare uncaught exceptional future on connection shutdown by @BenPope in #28456

Full Changelog: v25.2.10...v25.2.11

v25.2.10

25 Oct 16:22
43db978

Choose a tag to compare

Bug Fixes

  • Fixes a heap-use-after-free that could trigger during a race between cloud storage IO and the broker shutting down. by @andrwng in #28182
  • #28112 Correct a sequencing error in tiered storage archiver teardown that could cause unchecked optional access. by @oleiman in #28115
  • #28138 Datalake: When using Iceberg with value_schema_latest, ensure iceberg_latest_schema_cache_ttl_ms is respected for subject lookup. by @nvartolomei in #28148 ## Improvements
  • Iceberg: Introduce and translate redpanda.datalake.Date protobuf type to Iceberg date. by @nvartolomei in #28136
  • #28120 Log updated topic properties via alter-config by @daisukebe in #28122

Full Changelog: v25.2.9...v25.2.10

v25.2.9

10 Oct 17:25
8fe2a9c

Choose a tag to compare

Bug Fixes

  • Fix a bug where DeleteRecords would be reverted if offset falls in spillover region of Tiered Storage. by @nvartolomei in #27977
  • PR #27959 [v25.2.x] tree-wide: UB fixes (MANUAL BACKPORT) by @WillemKauf
  • PR #27978 [v25.2.x] iceberg: log spec and schema when failing to resolve by @nvartolomei

Full Changelog: v25.2.8...v25.2.9

v25.2.8

07 Oct 13:39
f30149e

Choose a tag to compare

Features

  • Introduce new "sasl_mechanisms_override" configuration that allows per-listener controls over the sasl mechanisms. by @IoannisRP in #27833

Bug Fixes

Improvements

  • Simplified partition balancer disk usage limits by consolidating soft and hard thresholds into a single configurable setting. storage_space_alert_free_threshold_percent is no longer used for partition balancer decisions. by @bharathv in #27862
  • Stabilizes DisablingPartitionsTest by @joe-redpanda in #27780
  • PR #27836 [v25.2.x] k/group: replaced use of std::vector with chunked_vector by @mmaslankaprv
  • PR #27854 [v25.2.x] kafka/server: keep const ref alive on the stack in futurized function by @rockwotj
  • PR #27880 [v25.2.x] c/tx: fix begin of transactions without a fence batch by @bharathv
  • PR #27889 [v25.2.x] [CORE-13370] archival: Fence spillover command by @Lazin
  • PR #27896 [v25.2.x] iceberg: json schema: accept more chars in date-time format by @nvartolomei
  • PR #27908 [v25.2.x] [CORE-13754] Make disk_log_impl::adjacent_merge_compact() pass by value (MANUAL BACKPORT) by @WillemKauf
  • PR #27924 [v25.2.x] c/producer_state: fix missing placeholder in log line by @bharathv

Full Changelog: v25.2.7...v25.2.8

v25.1.12

03 Oct 10:21
463f6ad

Choose a tag to compare

Bug Fixes

  • Fixes a bug in Redpanda Iceberg manifest deserialization that would cause Redpanda to fail to commit new Iceberg files following an external operation that wrote manifests with the lower_bounds field. by @andrwng in #27519
  • Fixes a bug where concurrent log level setting requests could lead to a situation where the logger ended up expiring to the incorrect log level. by @pgellert in #27567
  • Prevent oversized allocations when the kafka logger is at trace level by @rockwotj in #27816
  • Redpanda will now properly clean up discarded on-disk files on certain error cases in the Iceberg topics write path. by @andrwng in #27766

Improvements

  • Allows waiting for collection to complete when running a remote-bundle by @JFlath in #27399
  • Pandaproxy: Allow more parallel requests per user when HTTP basic authentication is enabled by @pgellert in #27820
  • Prevents an oversized allocation in raft heartbeats. by @WillemKauf in #27777
  • Prevents an oversized allocation in the partition balancing subsystem. by @WillemKauf in #27761
  • Redpanda will now log less frequently to warn about using the default Iceberg partition spec with ÅWS Glue. by @andrwng in #27744
  • Redpanda will now log trace-level messages about failed requests to the Iceberg REST catalog. by @andrwng in #27744

Full Changelog: v25.1.11...v25.1.12

v25.2.7

01 Oct 11:25
98a59de

Choose a tag to compare

Improvements

Full Changelog: v25.2.6...v25.2.7

v25.2.6

30 Sep 13:44
e75d1e2

Choose a tag to compare

Bug Fixes

  • Fix a small bug where metrics registrations could hang around briefly after a partition is stopped. by @oleiman in #27768
  • Redpanda will now properly clean up discarded on-disk files on certain error cases in the Iceberg topics write path. by @andrwng in #27765
  • #27344 Fixed an issue with metrics being registered twice when using an Iceberg REST catalog. by @wdberkeley in #27688
  • #27731 Iceberg/JSON Schema: Fix a bug where we would fail to parse integers when schema indicates number (floating point). by @nvartolomei in #27735

Improvements

  • Log cluster configuration updates by @daisukebe in #27730
  • Prevents an oversized allocation in raft heartbeats. by @WillemKauf in #27776
  • Prevents an oversized allocation in the partition balancing subsystem. by @WillemKauf in #27760
  • Redpanda will now log less frequently to warn about using the default Iceberg partition spec with ÅWS Glue. by @andrwng in #27743
  • Redpanda will now log trace-level messages about failed requests to the Iceberg REST catalog. by @andrwng in #27743
  • Via the Kafka API, Credentials of superusers are permitted to be altered or removed only by an authenticated superuser. by @IoannisRP in #27702

Full Changelog: v25.2.5...v25.2.6