DG ECHO has prepared detailed guidance on the use of this indicator (see below). To determine the indicator’s value, it recommends the following steps:
1) Design a representative sample of the project beneficiaries. ECHO requires you to ensure that the sample adequately represents the community subgroups (in terms of gender, age, disability and diversity). At the same time, it acknowledges that having a stratified sample representing all the subgroups might be too demanding and therefore considers random sampling as an acceptable option (while recommending that the margin of error for any sub-group should not be more than 10 percentage points).
2) Include eight mandatory and seven follow-up questions recommended by ECHO in your post-distribution monitoring (or any other) questionnaire. They relate to the four core elements of protection mainstreaming:
- Prioritize safety & dignity, and avoid causing harm (marked as “SDH” in ECHO's guidance)
- Meaningful Access (“MEA”)
- Accountability (“ACC”)
- Participation and empowerment (“PEM”)
The mandatory and follow-up questions, including answer options, are provided in ECHO's guidance. ECHO allows the partners to slightly rephrase the questions to make them easier to understand in the local context; however, their meaning must stay the same. Since several of the questions are incorrectly phrased in a leading manner (e.g. “Are you satisfied with the assistance provided?”), IndiKit recommends rephrasing them so that they do not lead the respondent to a certain answer (e.g. “To what extent were you satisfied with the assistance provided?”).
3) Conduct individual interviews with the project beneficiaries, following the sampling strategy designed in point 1. As ECHO highlights, the indicator's value is not what matters the most. The key focus is on identifying any protection-related issues across the four assessed core principles of protection mainstreaming throughout the project. Therefore, the enumerators need to pay maximum attention to the follow-up questions, as they allow you to understand why people did not feel safe and what measures need to be taken.
4) To calculate the indicator’s value, the ECHO guidance recommends that for each question you:
- sum up the number of respondents who chose “YES COMPLETELY" and "MOSTLY YES” for all questions except the question MEA 2; for MEA 2, sum up the number of respondents who chose “NOT REALLY” and “NOT AT ALL”; then
- divide this number by the total number of responses to the question, excluding people where the option “NO ANSWER” was selected; then
- multiply the resulting number by 100 to convert it to a percentage.
- Next, calculate the average of the percentages for the eight mandatory questions to get the final value of the indicator.
5) It is recommended that in addition to reporting on the overall value of the indicator, you also:
- report individually on the percentage of respondents who provided positive answers to the eight mandatory questions
- disaggregate this by the key subgroups (e.g. based on gender, age group, disability), so that you can identify whether any of the subgroups faced more protection issues than others
- report on the key protection risks that you identified and on the corrective measures that were taken (to do so, you can take advantage of ECHO's Excel template provided in the guidance)