Step 3 - Inform the social choice problem

Method:
In this step, the EJO tries to identify and mobilise information and tools to represent the system, from the social choice problem to the actors, issues and scenarios.

a. First you gather all types of information available and useful to represent the social choice problem. This information can be in the form of texts, pictures, maps, or even models of processes and systems.

At this stage, you must have a lot of relevant information if you started filling part 2 of the Outline document “Relevant data for the analysis of the conflict and its impacts”.  This information will feed WP11.

b. Then you structure the information and start building indicators that will inform judgement in the evaluation phase (next step). Indicators are units of information with specific qualities.

 

Indicators

The quality of evaluation relies on its capacity to produce information that is meaningful for the stakeholders, but that has also certain qualities, such as being synthetic and measurable.

Definition

An indicator is a unit of information that gives us information capable of showing significant differences between scenarios or options, on specific issues, and in the eyes of specific actors.

Quality of indicators

According to the UNDPCSD (Department for Policy Coordination and Sustainable Development of the United Nations) framework, some the key qualities of indicators are the following:

  • Be scientifically acknowledged, relevant and transparent.
  • Be indicative, useful and realistic.
  • Be sensitive (to differences in conditions) but robust.
  • Be general, not case or location specific.

The first condition (scientifically acknowledge) however is subject to interpretation, at the age of uncertainty and plurality of valuation languages. Indicators can reflect the variety of valuation languages and of stakeholders’ points of view.

An indicator can use one of the following scales:

  • Nominal: Yes or No (presence or absence of a given criteria)
  • Ordinal: 1 to 5, 1 to 10… Or: first, second, third…
  • Cardinal: quantitative information, measure. Real numbers.

A set of indicators should:

  • Scan all for dimensions of sustainable development
  • Have a limited number of indicators. You have to expect however a few dozens of indicators in your set.

Approaches in building indicators

There is a variety of way to define indicators, answering to different objectives and different assumptions about the nature of reality and science.

Top-down approaches

  • Expert driven: environment, economics, etc.
  • Derived from official accounting categories

Bottom-up approaches

  • Participatory methods: focus groups, citizen
  • Social constructivism

 

DPSIR: example of an environmental assessment framework useful in building indicators

One of the frameworks developed in environmental assessment is the DPSIR framework (analysis of Driving forces, Pressures, State of the environment, Impacts, Responses) (see graphic 4 below). Sustainability assessment has a broader view, particularly on the social and economic issues, but the DPSIR framework can be a good start for situations where the state of the environment is a major driver. Remember that ecosystems and human systems have different drivers and relevant information types.
 

How to start:

Which ever approach you choose, you can organise information gathered by performance issues, and as relevant to one or more scenarios, using once again the matrix in table 1. Break down the information to a list of candidate indicators, i.e. units of information that can express significant differences on the scenarios/options, covering the issues selected in step 2.

Advice from REEDS:

REEDS can help with structuring the information, especially in stage (b), when you will be elaborating indicators and building an indicator kiosk. Building quality indicators is often a delicate task, for which a scientific and experienced insight can be useful. We will help you make methodological choices, and structure information.

Output:

It is important to inform here how the catalogue of indicators was built; which difficulties and/or discussions arose, how they were solved, what were the conclusions. A list of indicators can be attached as support materials (fruits), though they will be most useful at the next step. This list can be elaborated with the KerBabel Indicator Kiosk (KIK), in which case this can be documented in the tools provided by REEDS. The REEDS EJOLT team will provide you the necessary instructions and guidebooks for this.