BISMG:SarahS/cordex

Example of parallel download with lftp
lftp sftp://sm_helix_sftp:goh5Thogh0thieVo@bi.nsc.liu.se:22 -e ' mirror -c --parallel=5 --verbose /helix/TUC/EC-EARTH3-HR/rcp85/day/atmos /group_workspaces/jasmin2/mohc_shared/users/sarahshannon/helix/EC-EARTH3-HR' This uses 5 streams

How to download bias corrected HELIX data from SMHI
lftp sftp://sm_helix_sftp:goh5Thogh0thieVo@bi.nsc.liu.se:22 -e 'mirror --verbose -c /helix/TUC/EC-EARTH3-HR/rcp85/day/atmos/huss /scratch/glacio1/ggsrs/jules/input/forcing/helix/BIAS-CORR-EC-EARTH3-HR/rcp85/day/atmos/huss'

To have a look at what HELIX data is there
sftp sm_helix_sftp@bi.nsc.liu.se

goh5Thogh0thieVo

cd /helix/SMHI/EC-EARTH3-HR/rcp85/day/atmos

Exit sftp and download daily data variable by variable. For example tas is

lftp sftp://sm_helix_sftp:goh5Thogh0thieVo@bi.nsc.liu.se:22 -e 'mirror --verbose -c /helix/SMHI/EC-EARTH3-HR/rcp85/day/atmos/tas /bluepeta/ggsrs/jules/input/forcing/helix/EC-EARTH3-HR/rcp85/day/atmos/tas'

How to download and process CORDEX data for use by JULES
For EUROPE

The data notes are listed here http://www.euro-cordex.net/EURO-CORDEX-Data.2613.0.html

Create an account with ESGF to allow access from any of these nodes

email s.shannon@exeter.ac.uk

user sarahshannon

p/s GiveMeData0

OPENID https://esg-dn1.nsc.liu.se/esgf-idp/openid/sarahshannon

Search all nodes for daily ERAINT (evaluation data) at 0.1 resolution. This corresponds to EUR 11 (native uneven grid) or EUR 11i (re gridded fixed grid) in the filename.

Found data on http://esgf-data.dkrz.de/ data node. Could not find the fixed resolution data 11i for daily ERAINT but it should be OK to used native grid which is unevenly spaced.

Here is a link to the filename description http://cordex.dmi.dk/joomla/images/CORDEX/cordex_archive_specifications.pdf

Search on http://esgf-data.dkrz.de/ for
 * project:CORDEX
 * experiment:evaluation
 * time frequency:day
 * domain:EUR-11
 * variable tas

Temperature data is bundled into 6 files with filename like this. tas_EUR-11_ECMWF-ERAINT_evaluation_r1i1p1_DMI-HIRHAM5_v1_day_19890101-19901231.nc

Download the wget shell script and put on /bluepeta/ggsrs/JULES_Forcing/cordex/EUR-11. chmod u+x wget*.sh and run. This will download the data

Other variables to download are

rsds SW down Wm-2

rlds LW down wm-2

prsn snowfall flux kgm-2s-1

pr precipitation kgm-2s-1

ps surface air pressure Pa

sfcWind near surface wind speed ms-1

huss near surface specific humidity kg kg-1

sftlf land area fraction (not in daily folder but that's ok it doesn't change)

orog surface altitude

Note the files are in netCDF4 and ferret, ncdump and xconv can't seem to read them.

CORDEX file format
e.g. tas_SAM-44i_MPI-M-MPI-ESM-LR_rcp85_r1i1p1_SMHI-RCA4_v3_mon_200601-201012.nc

Variable, Domain, Resolution, GCM, scenario, realisation, RCM, time, frequency, begin year, end year .nc

The ensemble members with different initial states are usually called realizations. Initialisation method and physics details may also have an influence. Physics details may be parameterisation constants, for example. In the CMIP5 project, ensemble members are named in the rip-nomenclature, r for realization, i for initialisation and p for physics, followed by an integer, e.g. r1i1p1.

CORDEX data for Chile (SAM domain)
Search data node https://esg-dn1.nsc.liu.se/search/esgf-liu/