Posted on 1 Comment

Structured Expert Judgment

Quantifying uncertainty or trying to make predictions on subject for which there is an evident lack of data can be challenging. Hence turning into experts seems reasonable, given the consideration that these may not agree on their judgments. The Structured Experts Judgment Method or Cooke’s Method, named after Roger Cooke who formulated such methodology, aims at treating experts judgment as scientific data in a methodologically transparent way. Structured judgment method may pursue three goals according to Cooke & Gossens (2008):

  • Census. Represent the general opinion of a community
  • Political consensus. Here opinions from different stakeholders want to be represented in the final decision
  • Rational consensus. Refers to a group decision process. Here a set of conditions is necessary in order to ensure its reliability:
    • Accountability. All data are open to peer review.
    • Empirical control. Quantitative experts assessment is subjected to quality controls
    • Neutrality. Experts should not be conditioned on their final opinions.
    • Fairness. Experts are not pre-judged.

Structured Expert Judgment is therefore a quantitative methodology which tries to bridge between subjective data and predictions by measuring the uncertainty behind such data. While the method of course assess experts’ expertise, nevertheless an interesting reading on the election of “good” versus “bad” experts from a qualitative point of view is provided by Gläser & Laudel (2009).

Courses on Structured Expert Judgment


Cooke, R. M., & Goossens, L. L. H. J. (2008). TU Delft expert judgment data base. Reliability Engineering & System Safety, 93(5), 657–674.

Gläser, J., & Laudel, G. (2009). On Interviewing “Good” and “Bad” Experts. In A. Bogner, B. Littig, & W. Menz (Eds.), Interviewing Experts (pp. 117–137). Palgrave Macmillan UK.

1 thought on “Structured Expert Judgment

  1. […] Applying Structured Expert Judgment I had to conduct an actual elicitation with experts. Structured Expert Judgment is designed for and implemented in areas in which there is an evident lack of data and hence, we are […]

Leave a Reply

Your email address will not be published. Required fields are marked *