Skip to content

Daily tile archive backup#16

Merged
weaverba137 merged 13 commits into
mainfrom
daily-archive-backup
Dec 3, 2024
Merged

Daily tile archive backup#16
weaverba137 merged 13 commits into
mainfrom
daily-archive-backup

Conversation

@weaverba137

@weaverba137 weaverba137 commented Nov 5, 2024

Copy link
Copy Markdown
Member

This PR

  • Closes backup daily/tiles/archive directories desiBackup#26.
  • Closes desi_archive_tilenight make checksums desispec#1762.
  • Adds a script, desi_daily_archive.sh. It is designed to checksum and backup daily/tiles/archive asynchronously. The detailed procedure is as follows:
    • The script would be activated daily or weekly as an scron job.
    • It searches daily/tiles/archive for TILEID/ARCHIVEDATE that do not contain a checksum file.
    • If it does find a checksum file, the TILEID/ARCHIVEDATE is skipped.
    • For TILEID/ARCHIVEDATE without a checksum file, it creates a batch script for the xfer queue that will create the checksum file(s) and then htar backup TILEID/ARCHIVEDATE.
      • The script can deal with directories with or without a logs/ directory.
    • After examining all of daily/tiles/archive, it submits a job to the workflow queue which will in turn submit the individual TILEID/ARCHIVEDATE jobs created in the step above.

I have already created and started submitting jobs to back up the existing directories. I recommend waiting for that initial backlog to complete before merging.

@weaverba137 weaverba137 requested a review from sbailey November 5, 2024 22:13
@weaverba137 weaverba137 self-assigned this Nov 5, 2024
@weaverba137

weaverba137 commented Nov 8, 2024

Copy link
Copy Markdown
Member Author

@sbailey, please review when you get a chance. I suggest adding a scron job as outlined below. I assumed a daily job, but we can discuss that (@daily = 00:00 UTC).

###### Find and submit backup jobs for ${DESI_SPECTRO_REDUX}/daily/tiles/archive.
#SCRON --account=desi
#SCRON --qos=cron
#SCRON --time=00:30:00
#SCRON --job-name=scron_desi_daily_archive
#SCRON --output=/global/cfs/cdirs/desicollab/users/desi/scron/logs/%x-%j.out
#SCRON --open-mode=append
#SCRON --mail-type=FAIL
#SCRON --mail-user=XXXXXXX
@daily /bin/bash -lc "source /global/common/software/desi/desi_environment.sh main && module load desida/main && desi_daily_archive.sh"

sbailey
sbailey reviewed Nov 19, 2024
View reviewed changes
Comment thread bin/desi_daily_archive.sh Outdated
Comment thread bin/desi_daily_archive.sh Outdated
Comment thread bin/desi_daily_archive.sh
sbailey
sbailey reviewed Nov 19, 2024
View reviewed changes
Comment thread bin/desi_daily_archive.sh
@weaverba137

weaverba137 commented Dec 3, 2024

Copy link
Copy Markdown
Member Author

@sbailey, I think this is ready for a final review, although I would like to do one more test today. As a bonus, we're caught up to effectively yesterday on backups of these files.

@sbailey

sbailey commented Dec 3, 2024

Copy link
Copy Markdown
Contributor

Looks good, merge when ready

@weaverba137 weaverba137 merged commit 834daf3 into main Dec 3, 2024
@weaverba137 weaverba137 deleted the daily-archive-backup branch December 3, 2024 20:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@sbailey sbailey sbailey approved these changes

Assignees

@weaverba137 weaverba137

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

desi_archive_tilenight make checksums backup daily/tiles/archive directories

2 participants

@weaverba137 @sbailey