Scripts may be installed on instrumentation/acquisition computers for regular/systematic backups to local server. They are also useful for subsequent processing (such as submission to cluster for calculations, NWB conversion prep)
This is work in progress. If you have additional scripts that may be useful in processing (automatic calculations, file transfer, etc), and wish to share with U19 consortium, please contact: drinehart@ucsd.edu.
-
GitHub clone USArhythms pipeline to a local directory (e.g.,
C:\experiments_nwb
). -
Install SyncBackPro and load the
data_sync.sps
settings in the application. -
Modify settings in SyncBackPro for:
- Backup configuration
- Email notification destination
- Location of local data acquisition directories
a. Ensure the local server where files will be stored has correct permissions and is mapped in Windows.
b. Verify which parsing script will be run before/after transfer.
c. Edit (using a text editor)
launch.bat
orlaunch_remote.bat
to run the correct parsing command, as appropriate.- Note:
launch.bat
example runs a MATLAB script on the acquisition computer. - N.B.
launch_remote_py.bat
runstrigger.py
(see additional notes in README-trigger.md). - N.B.2
launch_remote_ps.bat
runstrigger.ps1
(see additional notes in README-trigger_ps.md).
- README-ssh_windows_linux.md to setup password-less SSH from Windows to Linux
In example above where post-acquisition will occur, ensure script exists (Matlab or python).
This step should include any formatting/analysis required after acquisition as well as meta-data extraction into NWB recordings files (Excel/csv)
Example bash script for launching server-side scripts: post-acquisition/post-acquire.sh
- Nightly transfer of data from acquisition computer to local storage computer
- Email notification of transferred files
- Ability to integrate with other applications (compute/interim calcs, appending to lab notebook/database, conversion to NWB format)
[Issue Tracker] (https://github.com/USArhythms/pipeline/issues)
[Source Code] (https://github.com/USArhythms/pipeline)
If you are having issues or questions; or have code to contribute, please let me know. Duane Rinehart drinehart[at]ucsd.edu
The project is licensed under the MIT license.
Last update: 13-DEC-2024