Add GLORYS12V1 CMORizer#4525
Conversation
|
Data is being processed on Levante, will include a path from where to copy the data to the obs data pool once it is finished! |
|
Cmorized dataset can be copied to the obs pool on Levante from: |
@jlenh: I tried to copy the data, but do not have access to your account (b381312). Could you either move the data somewhere where I can access it, or change the accessing rights? Ta! |
My bad, if you can try again now ? (you might have to log in and out of your session on Levante) |
|
Thanks @jlenh, access to the files works now. Unfortunately, we currently do not have the disk space to copy the new files. If I am not mistaken then the new files are about 2.7 TB. At the moment, we only have about 1 TB of storage left in our project. Since the data pool option requested about a year ago takes took long for this, we thought about moving some of the RAWOBS into the tape archive to free some disk space. Once the tape archive is available again, we can look into this option. For the time being, you would need to "touch" the files on scratch every few days to prevent them from being deleted automatically. Currently, data life time on scratch is 14 days since the last file access. |
|
Thanks Axel, I see! I have moved the files to another folder from another project not on scratch for now, we can move these once there is space again for the data pool. |
Description
This PR adds a cmorizer for the GLORYS dataset (monthly variables only), the CMEMS global ocean eddy-resolving (1/12° horizontal resolution, 50 vertical levels) reanalysis product: https://data.marine.copernicus.eu/product/GLOBAL_MULTIYEAR_PHY_001_030/description.
A specific downloader class is also created to handle datasets that are accessible on the Copernicus Marine Service Data Store. To this extent, a new dependency is added, namely the
copernicusmarinepackage (link) that allows to fetch and download through an API the datasets available on the CMS Data Store.Before you get started
Checklist
It is the responsibility of the author to make sure the pull request is ready to review. The icons indicate whether the item will be subject to the 🛠 Technical or 🧪 Scientific review.
New or updated data reformatting script
To help with the number of pull requests: