Development of a common set of methods and protocols for assessing and communicating uncertainties

Daniel Wallach, Mike Rivington


This reports sets out an outline approach to create definitions of uncertainty and how it might be classified. This is not a prescriptive approach rather it should be seen as a starting point from which further development can be made by consensus with CropM partners and across MACSUR Themes. We propose both a numerical quantification of uncertainty and text based classification scheme. The rational is to be able to both establish the terms and definitions in quantifying the impact of uncertainty on model estimates and have a scheme to enable identification of connectivity between types and sources of uncertainty. The aim is to establish a common set of terms and structure within which they operate that can be used to guide work within CropM. 

Full Text:



Funtowicz, S.O. and Ravetz, J.R. (1990). Uncertainty and Quality in Science for Policy. Kluwer Academic Publishers, Dordrecht, Germany.

Gabbert, S., van Ittersum, M., Kroeze, C., Stalpers, S., Ewert, F. and Alkan Olsson, J. (2010). Uncertainty analysis in integrated assessment: the users’ perspective. Regional Environmental Change 10, 131-143.

Harremoës, P., 2003. The role of uncertainty in application of integrated urban water modeling. In: Proceedings of the International IMUG Conference, Tilburg, 23-25 April 2003.

Manning M (2003) The difficulty of communicating uncertainty. Editorial comment. Climate Change 61:9–16

Metselaar, K. (1999, February 2). Auditing predictive models: a case study in crop growth. WAU Dissertation no. 2570.

Norton, J.P., Brown, J.D. and Mysiak, J. (2006). To what extent, and how, might uncertainty be defined? Comments engendered by “Defining uncertainty: a conceptual basis for uncertainty management in model-based decision support”: Walker et al., Integrated Assessment 4: 1, 2003. The Integrated Assessment Journal 6, 83-88.

Palosuo T., K.C. Kersebaum, C. Angulo et al., 2011. Simulation of winter wheat yield and its variability in different climates of Europe: A comparison of eight crop growth models. Eur. J. Agron. 35, 103-114.

Refsgaard JC, van der Sluijs JP, Hojberg AL, Vanrolleghem PA (2007) Uncertainty in the environmental modeling process—a framework and guidance. Environmental Modelling and Software 22, 1543–1556.

Walker W.E. et al (2003). Defining Uncertainty A Conceptual Basis for Uncertainty Management in Model-Based Decision Support. Integrated Assessment 4, 5-17.

Wallach, D. (2011). Crop model calibration: A statistical perspective. Agronomy Journal, 103, 1144–1151.

Wallach, D., Keussayan, N., Brun, F., Lacroix, B., & Bergez, J. (2008). Assessing the uncertainty when using a model to compare irrigation strategies. Agronomy Journal, 104, 1274–1283. doi:10.2134/agronj2012.0038

Previous issues and volumes can be found in the 'Archives' section.

You can refer to a paper published in this series in the following format Author (2013) Title. FACCE MACSUR Reports 2: D-C1.3, where "D-C1.3" is the article ID en lieu of page range.