Since the OECD-DAC’s new criteria came out two years ago, so many organisations have ended up redoing their methods and approaches in alignment with it. While the criteria are much better than the version it replaced, it’s still wanting. My biggest challenge with it is the fact that it was written from the perspective of a well-resourced organisation in a rich country, and that therefore affects its biases and limitations. I had some thoughts on how to make the criteria participatory, which I have been adding to my methodologies that call for an adaptation of these Criteria.
[Currently, the criteria are relevance, effectiveness, impact, coherence, efficiency, and sustainability]
Involve research participants in the evaluation process
Fairly obvious but a gap nonetheless – involve partners, participants, marginalised groups, anyone outside the traditional nexus of power, in the design and implementation of the evaluation. This might involve using methods such as focus groups or community-based participatory research to gather input and feedback from the research participants.
Use a range of data sources
Another way is to use a range of data sources to gather information about the program or intervention. This might include using both quantitative and qualitative data, and gathering data from a variety of sources such as surveys, interviews, focus groups, or case studies. Use a combination to also help you triangulate findings across your methodology and regularly review the accuracy of data collected.
Focus on the perspectives and experiences of the research participants
It is important to ensure that the evaluation reflects the perspectives and experiences of the research participants and to give them a voice in the evaluation process. This might involve using research methods that are more collaborative and less hierarchical and using data collection techniques that allow the research participants to share their experiences and insights.
Use a participatory evaluation approach
Another way to make the evaluation more participatory is to use a participatory evaluation approach, such as feminist participatory action research or community-based participatory research. These approaches prioritize the needs and perspectives of the research participants and seek to empower them to participate in the evaluation process actively.
