Release history

Version 1.3

This version was released March 10, 2024.

New metrics and diagrams

• -m nnsec shows the normalized Nash-Sutcliffe efficiency coefficient
• -m kge shows the Kling-Gupta efficiency index
• -m spread to show the spread between two quantiles
• -m quantilecoverage to measure fraction of observations within quantile bands
• -m quantile to plot specific forecast quantiles
• -m threshold to plot specific threshold probabilities
• -m murphy to show a Murphy diagram
• -m bsdecomp to show a Brier score decomposition diagram

Updated metrics and diagrams

• -m obsfcst now allows -q to plot quantiles together with obs and fcst
• -m fss now allows -x leadtime to plot fractions skill score in time

New plotting options

• -af sets which fields are shown in annotation
• -afs sets the font size of the annotation
• -gc sets the color of the grid lines
• -gs sets the style of the grid lines
• -gw sets the width of the grid lines

New data manipulation options

• -T, -Tagg, and -Tx aggregates observations and forecasts across time or leadtimes

Version 1.2

This version was released June 19, 2021.

• Uses cartopy instead of matplotlib Basemap for map generation. Basemap is deprecated and not developed anymore.
• -proj is no longer supported
• -m spread to show the spread between two quantiles

Version 1.1

This version was released October 2, 2019.

New features

• Added python 3.7 support (thanks to @tommz9)
• Support for reading OpenDAP files, meaning that verif can read files directly from a remote server supporting OpenDAP (for example thredds).
• Read arbitrary fields (such as pre-computed CRPS) from file
• Added helper scripts to convert ensemble data to probabilistic information.
• Added axes: -x leadtimeday, -x timeofday, -x dayofyear, -x monthofyear, -x dayofmonth, -x day
• Added -a to annotate graphs (put text next to each data point)
• Added -x obs and -x fcst to plot scores as a function of observed or forecasted value
• Allow subsetting of forecasts initialized at certain times of the day (-tod)
• Added -type rank, -type impact, and -type mapimpact
• Added -obsrange to subset based on observed values
• Accept vector input for -ms and -lw
• Allow quantiles and threshold fields to be used as fcst or obs.
• -m diff can be used to show the difference in aggregated statistics.
• Added -m ratio to show the ratio of aggregated statistics.

Changes to command-line options

• -ls no longer accepts marker specification, e.g. o-. Markers must be specified separately using -ma (e.g. -ls - -ma o).

New metrics/diagrams

• -m bssrel Brier skill score, reliability component
• -m bssres Brier skill score, resolution component
• -m autocorr to show autocorrelation of error in space or time
• -m diff to show difference in aggregated statistics
• -m fss to show fractions skill score
• -m pithistslope to show slope of the pit histogram
• -m pithistshape to show the shape of the pit histogram (e.g. U-shape)
• -m ratio to show ratio of aggregated statistics

Changes to metrics

• Renamed -m pitdev to -m pithistdev

Version 1.0

There are several changes to version 1. If you have prepared input files that worked with v0.4, then they should still work with v1.0.

However, several command-line options have changed as well as the definition of some metrics.

Changes to command-line options

• -x date has been changed to -x time
• -llrange has been changed to -latrange and -lonrange
• -x locationLat has been changed to -x lat
• -x locationLon has been changed to -x lon
• -x locationElev has been changed to -x elev
• -x locationId has been changed to -x location (replacing the old -x location)
• -ct has been changed to -agg
• -d start end has been changed to -d start:end or any other way to represent a list of numbers in Verif
• -sat has been changed to -maptype sat to allow for other types of map layers

Changes to metrics

• -m bias now means (fcst - obs), which is a more conventional than (obs - fcst).
• -m ef now shows fraction not percent

New metrics

• -m alphaindex
• -m performance
• -m discrimination
• -m dscore
• -m leps
• -m nsec

New Features

• Added a new Netcdf-based input format
• Allow forecasts to be initialized at times other than 00 UTC
• -ls to specify line styles
• -maptype to specify background map
• -xticklabels to set x-axis tick labels
• -xticks to set x-axis tick positions
• -yticklabels to set y-axis tick labels
• -yticks to set y-axis tick positions
• -type csv to output comma-separated values
• -aspect to set the aspect ratio of the axes
• -x week to aggregate data by week
• -lx to remove location ids
• -q to specify quantiles (in -m invreliability for example)

Version 0.4

New metrics

• -m alphaindex
• -m performance
• -m discrimination
• -m dscore
• -m leps
• -m nsec

New features

• Added -cmap to specify colormap
• Added -elevrange
• Added -lc to specify line colours
• Added -legloc to specify legend location
• Added -logx and -logy to logx logarithmic axes
• Added -sat to show satellite image on maps
• Added -simple to ask for a simpler diagram, when possible
• Better handling of legend entries

Version 0.3

New features

• Added -x month and -x year
• Added -m meteo
• Added -m roc
• Added -m economicvalue
• Added -m quantilescore
• Better date support:
  • Dates can be parsed in -xlim
  • Nicer date labels on the x-axis
• Prefer 3h, 6h, 12h, 24h gridline increments