GWS Tools

Upload to CEDA

When the instrument scientist has created files in the processing folder ready to be archived on CEDA, a script is available that uses checksit to check the formatting of the files, before moving them into the upload folder from where they will be moved to the CEDA system. This script can be used on one file, multiple files, or an entire directory:

cd /gws/pw/j07/ncas_obs_vol1/scripts/transfer_to_upload
./transfer-to-upload /gws/pw/j07/ncas_obs_vol1/iao/processing/ncas-aws-10/20010101_longterm

where /gws/pw/j07/ncas_obs_vol1/iao/processing/ncas-aws-10/20010101_longterm is a directory that has netCDF files in structured within yyyy/mm folders as described in the processing folder section, and could be replaced by a file or a space-separated list of files. The absolute path to the directory with the data files must be given, not a relative path from the current working directory.

Public HTML

A public HTML space is available online, for the purpose of sharing small files from the group workspace, such as log files, small data files that need to be quickly shared, or latest plots of data. Note that this space is NOT intended for hosting websites or building tools and applications. See this article from JASMIN for more details. It also should NOT be used for sharing data that is intended for long-term archive. Please ensure these are uploaded to CEDA as noted above.

GitHub

All instruments have three separate GitHub repositories within the NCASUK GitHub organisation. These take the form

instrument-software
instrument-tools
instrument-additionaldata

where instrument is the unique name given to each NCAS instrument. These repositories are ready to use on JASMIN in the software, tools, and additional data folders. Each instrument scientist will need to have their own GitHub account and let the NCAS IT team know which instrument repositories they require access to.

checksit

An installation of checksit is available on JASMIN. checksit is a compliance checker being designed to check data from NCAS instruments meets the format required by the relevant NCAS data standard. More information on the NCAS data standards can be found on the NCAS Data Activity documentation. This installation of checksit is used in the tools that send data to the CEDA arrivals area. checksit can be used by anyone on JASMIN by using:

/apps/jasmin/community/checksit/checksit check /path/to/my.file

More information about this install can be found on the JASMIN help docs.