Skip to content

"Invalid checksum provided" error on replication #21534

@almorr

Description

@almorr

Two nodes installation with a site replication between them failed on replication on some buckets with an error "Invalid checksum provided" after upgrade to RELEASE 2025-07-23

Current Behavior

replication doesn't work. A logs:

minio[498235]: API: SYSTEM.replication
minio[498235]: Time: 07:06:00 UTC 08/22/2025
minio[498235]: DeploymentID: 008e516e-xxxx-xxxx-xxxx-f7976759ff2b
minio[498235]: Error: unable to replicate for object b-int-xxx/in/2025-08-21-074609_complete_baseline/1_2_3_14/xxxxxx_xxxx_xxxx.pdf(ff0b6012-31bd-4e02-b8fb-db9693975f22) to target https:/xxxxxxx:9000: Invalid checksum provided. (*fmt.wrapError)
minio[498235]: 4: internal/logger/logger.go:271:logger.LogIf()
minio[498235]: 3: cmd/logging.go:16:cmd.replLogIf()
minio[498235]: 2: cmd/bucket-replication.go:1629:cmd.ReplicateObjectInfo.replicateAll()
minio[498235]: 1: cmd/bucket-replication.go:1115:cmd.replicateObject.func2()

Possible Solution

Downgrading to RELEASE 2025-06-13 solved my issue

Your Environment

  • minio version RELEASE.2025-07-23T15-54-02Z (commit-id=7ced9663e6a791fef9dc6be798ff24cda9c730ac)

  • Two nodes with a site replication

  • mc admin info xxxx
    Version: 2025-07-23T15:54:02Z
    Network: 1/1 OK
    Drives: 1/1 OK
    Pool: 1

┌──────┬────────────────────────┬─────────────────────┬──────────────┐
│ Pool │ Drives Usage │ Erasure stripe size │ Erasure sets │
│ 1st │ 15.0% (total: 500 GiB) │ 1 │ 1 │
└──────┴────────────────────────┴─────────────────────┴──────────────┘

Replication status since 1 day
Replicated: 2,949 objects (3.0 GiB)
Received: 563,438 objects (88 GiB)
Queued: ● 0 objects, (0 B) (avg: 0 objects, 614 B; max: 1 objects, 60 KiB)
Workers: 0 (avg: 0; max 0)
Transfer Rate: 0 B/s (avg: 1.5 MB/s; max 238 MB/s)
Latency: 1ms (avg: 1ms; max 33ms)
Link: ● online (total downtime: 25 seconds)
Errors: 0 in last 1 minute; 0 in last 1hr; 2,620 since uptime

  • Operating System and version Red Hat Enterprise Linux release 8.10 (Ootpa)
  • Linux 4.18.0-553.60.1.el8_10.x86_64 Full restructure in accordance with #1 SMP Fri Jun 27 05:59:19 EDT 2025 x86_64 x86_64 x86_64 GNU/Linux

Metadata

Metadata

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions