Skip to content

Add GLORYS12V1 CMORizer#4525

Open
jlenh wants to merge 9 commits into
mainfrom
cmoriser_glorys12v1
Open

Add GLORYS12V1 CMORizer#4525
jlenh wants to merge 9 commits into
mainfrom
cmoriser_glorys12v1

Conversation

@jlenh

@jlenh jlenh commented Jul 1, 2026

Copy link
Copy Markdown
Contributor

Description

This PR adds a cmorizer for the GLORYS dataset (monthly variables only), the CMEMS global ocean eddy-resolving (1/12° horizontal resolution, 50 vertical levels) reanalysis product: https://data.marine.copernicus.eu/product/GLOBAL_MULTIYEAR_PHY_001_030/description.

A specific downloader class is also created to handle datasets that are accessible on the Copernicus Marine Service Data Store. To this extent, a new dependency is added, namely the copernicusmarine package (link) that allows to fetch and download through an API the datasets available on the CMS Data Store.


Before you get started

Checklist

It is the responsibility of the author to make sure the pull request is ready to review. The icons indicate whether the item will be subject to the 🛠 Technical or 🧪 Scientific review.

New or updated data reformatting script


To help with the number of pull requests:

@jlenh

jlenh commented Jul 1, 2026

Copy link
Copy Markdown
Contributor Author

Data is being processed on Levante, will include a path from where to copy the data to the obs data pool once it is finished!

@jlenh jlenh marked this pull request as draft July 6, 2026 09:28
@jlenh jlenh marked this pull request as ready for review July 6, 2026 13:12
@jlenh

jlenh commented Jul 6, 2026

Copy link
Copy Markdown
Contributor Author

Cmorized dataset can be copied to the obs pool on Levante from: /scratch/b/b381312/data/esmvaltool/esmvaltool_output/data_formatting_20260701_164735/Tier2/GLORYS12V1/

@hb326

hb326 commented Jul 6, 2026

Copy link
Copy Markdown
Contributor

Cmorized dataset can be copied to the obs pool on Levante from: /scratch/b/b381312/data/esmvaltool/esmvaltool_output/data_formatting_20260701_164735/Tier2/GLORYS12V1/

@jlenh: I tried to copy the data, but do not have access to your account (b381312). Could you either move the data somewhere where I can access it, or change the accessing rights? Ta!

@jlenh

jlenh commented Jul 6, 2026

Copy link
Copy Markdown
Contributor Author

Cmorized dataset can be copied to the obs pool on Levante from: /scratch/b/b381312/data/esmvaltool/esmvaltool_output/data_formatting_20260701_164735/Tier2/GLORYS12V1/

@jlenh: I tried to copy the data, but do not have access to your account (b381312). Could you either move the data somewhere where I can access it, or change the accessing rights? Ta!

My bad, if you can try again now ? (you might have to log in and out of your session on Levante)

@axel-lauer

Copy link
Copy Markdown
Contributor

Thanks @jlenh, access to the files works now. Unfortunately, we currently do not have the disk space to copy the new files. If I am not mistaken then the new files are about 2.7 TB. At the moment, we only have about 1 TB of storage left in our project. Since the data pool option requested about a year ago takes took long for this, we thought about moving some of the RAWOBS into the tape archive to free some disk space.

Once the tape archive is available again, we can look into this option. For the time being, you would need to "touch" the files on scratch every few days to prevent them from being deleted automatically. Currently, data life time on scratch is 14 days since the last file access.

@jlenh

jlenh commented Jul 6, 2026

Copy link
Copy Markdown
Contributor Author

Thanks Axel, I see! I have moved the files to another folder from another project not on scratch for now, we can move these once there is space again for the data pool.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

New cmoriser for the GLORYS dataset

3 participants