Introduce initial validation script#707
Open
alexolinhager wants to merge 1 commit intoMPAS-Dev:masterfrom
Open
Introduce initial validation script#707alexolinhager wants to merge 1 commit intoMPAS-Dev:masterfrom
alexolinhager wants to merge 1 commit intoMPAS-Dev:masterfrom
Conversation
Initial script for validation MALI ocean TF extrapolation parameterizations using historical CTD casts.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This PR introduces a new tool to validate Greenland ocean thermal forcing parameterizations using historical CTD casts. The script takes a MALI output file and calculates a Willmott model skill score of TF profiles at every cell/month where CTD data exists. If multiple casts align with the same cell in a given month, then the casts are averaged together before calculating a skill score. Currently, the script calculates two separate skill scores, an average skill score for cells with originally defined ocean cells (
orig3dOceanMask=1) and an average of all extrapolated ocean cells. (Note that the MALI thermal forcing parameterization alters ALL ocean cells, so this script must be run on a simulation withconfig_extrap_sill_blocking = falseandconfig_TF_iceberg_melt = falseto calculate a skill score for the unaltered ocean forcing dataset).Example usage:
python validate_mali_extrap.py --maliDiag output.2002.nc --HadleyDir HadleyEN4.2.2 --geojson UummannaqDisko.geojson --maliForcing ecco_to_mali_remapped.1to10km_r01_20251030.ncwhere
maliDiagis the MALI output file,HadleyDirpoints to the location of the directory containing the Hadley EN4.2.2 dataset to validate against,geojsonis a geojson file delineating the geographic boundary to use for validation, andmaliForcingis the input MALI ocean forcing file.As of now, Hadley EN4.2.2 is the only validation dataset supported, although others should eventually be incorporated (see https://e3sm.atlassian.net/wiki/spaces/FAN/pages/5908889649/Uummannaq+Disko+Bay+Regional+Ocean+Evaluation). All relevant CTD datasets are stored at:
/global/cfs/cdirs/fanssie/standard_datasets/UummanaqDisko_datasets/CTD_validationTo do:
Incorporate other CTD datasets into validation, starting with Bartholomaus et al. (2016)
Filter out unreliable CTD casts/data
Calculate correlation between MALI/ECCO and CTD grounding line and depth-averaged thermal forcing – Frontal ablation may not care about full profile accuracy.
Time-lagged cross-correlations between Barthomaus et al. (2016) mooring CTD time series and extrapolated MALI/ECCO thermal forcing at similar depths/locations.
Create plots for above analysis