Skip to content

Fix: Passing wrong Zarr store that caused metadata consolidation error in upload_dataset() #90

Merged
lmtroper merged 1 commit into
mainfrom
fix/zarr-upload-consolidating-metadata-error
Apr 4, 2024
Merged

Fix: Passing wrong Zarr store that caused metadata consolidation error in upload_dataset() #90
lmtroper merged 1 commit into
mainfrom
fix/zarr-upload-consolidating-metadata-error

Conversation

@lmtroper

@lmtroper lmtroper commented Apr 4, 2024

Copy link
Copy Markdown
Contributor

Changelogs

When consolidating the metadata locally, we were passing different stores which was throwing the error memoryview: a bytes-like object is required, not 'dict'. The fix was to append another .store when consolidating the metadata.

E.g., dataset.zarr_root.store => <zarr.storage.ConsolidatedMetadataStore object at 0x13ddfaba0>
dataset.zarr_root.store.store => <zarr.storage.DirectoryStore object at 0x13d900980>

@lmtroper lmtroper added the fix Annotates any PR that fixes bugs label Apr 4, 2024
@lmtroper lmtroper requested a review from cwognum April 4, 2024 14:25

@cwognum cwognum left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good find! Thanks @lmtroper !

@lmtroper lmtroper merged commit 86cec36 into main Apr 4, 2024
@lmtroper lmtroper deleted the fix/zarr-upload-consolidating-metadata-error branch April 26, 2024 19:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

fix Annotates any PR that fixes bugs

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants