Problems with binary pattern measures for flood model evaluation

As the calibration and evaluation of flood inundation models are a prerequisite for their successful application, there is a clear need to ensure that the performance measures that quantify how well models match the available observations are fit for purpose. This paper evaluates the binary pattern performance measures that are frequently used to compare flood inundation models with observations of flood extent. This evaluation considers whether these measures are able to calibrate and evaluate model predictions in a credible and consistent way, i.e. identifying the underlying model behaviour for a number of different purposes such as comparing models of floods of different magnitudes or on different catchments. Through theoretical examples, it is shown that the binary pattern measures are not consistent for floods of different sizes, such that for the same vertical error in water level, a model of a flood of large magnitude appears to perform better than a model of a smaller magnitude flood. Further, the commonly used Critical Success Index (usually referred to as F<2 >) is biased in favour of overprediction of the flood extent, and is also biased towards correctly predicting areas of the domain with smaller topographic gradients. Consequently, it is recommended that future studies consider carefully the implications of reporting conclusions using these performance measures. Additionally, future research should consider whether a more robust and consistent analysis could be achieved by using elevation comparison methods instead.

Smithland Locks and Dam, Ohio River : Hydraulic model investigation /

"Prepared for U.S. Army Engineer District, Nashville and U.S. Army Engineer District, Louisville."

Olmsted Lock Outlet, Ohio River : hydraulic model investigation /

Cover title.

Gila River flood control : letter from the Secretary of the Interior transmitting, pursuant to law a report on flood control of the Gila River in Graham County, Arizona /

Mode of access: Internet.

Geomorphic changes on the Mississippi River flood plain at Miller City, Illinois, as a result of the flood of 1993 /

Mode of access: Internet.

Physical and chemical data on sediments deposited in the Missouri and the Mississippi River flood plains during the July through August 1993 flood /

Mode of access: Internet.

Report on Columbia River flood control operations; 1959 flood.

Cover title.

Extent and frequency of inundation of Millstone River flood plain in Somerset County, New Jersey,

Open-file report [no. 4]

Extrinsic forcing of plant ecosystems in a large igneous province : The Columbia River flood basalt province, Washington State, USA

Peer reviewed