Evaluation

Evaluate and Adapt
Evaluation

Purpose

Evaluate available data from monitoring and other sources to inform adaptive management, assess a strategy’s impact, influence key actors, and contribute to the evidence base.

Products

Evaluation analysis results
Communication products (white papers, scientific publications, annual reports)

Using the plan that you created when you defined your measures, you will need to evaluate your progress periodically to make sure that your strategy is on track. Because CbD 2.0 asks for results at scale, including through systems change, evaluation methodologies that have been used for biodiversity conservation metrics may not be enough. As we increasingly seek to change behaviors and policies through networks, social movements, strengthening public will and influencing others, we will need new ways to measure our success. Fortunately, there are a myriad of tools that have been developed in sectors outside conservation that can be used towards this end.

Show All

Evaluate data from monitoring and other sources.

The monitoring and evaluation plan specifies indicators and threshold values that can be used to determine whether progress is on track, adaptive management thresholds are required, or there are unintended impacts to people.

Tools You Can Use

Developmental evaluation toolkit from Spark Policy Institute

While Developmental Evaluation does not replace formative or summative evaluations, it is a powerful tool to for understanding the effectiveness of innovative strategies and adapting those strategies as they are being implemented in unpredictable environments. This toolkit, developed by Spark Policy Institute and enriched by an ever-increasing community of experienced evaluators and change agents, provides practical tools to help novice-to-experienced social innovators enhance their understanding and practice of DE. They include frameworks, methods, learning techniques, tips, and more.

External Resources

Webinar on Evaluating Conservation Projects and Programs

Webinar on the why, when, and how of evaluation that can help programs of all sizes to strengthen their evaluative culture and practice.

Read More

The analyst matters.

Ensure analyses are conducted by qualified experts.
Timeliness matters.

When evaluations aren’t conducted on schedule, they typically fail to inform adaptive management and miss opportunities to influence key audiences.
Look for the unexpected.

Unexpected impacts may not have had an indicator identified. Look at raw data for outliers and unexpected results and consult the individuals directly involved in data collection about their observations. Such anecdotal evidence may indicate the need to update monitoring approaches based on unanticipated complications.

Generate communication products.

Data were collected and analyzed to convey information to specific audiences. Ensure this information is communicated by creating communication products tailored to your audiences, recognizing that one communication product may work effectively with multiple audiences. White papers, one-page fact sheets, annual reports, and peer-reviewed publications are all legitimate communication products, depending on the audience. Be considerate of different languages and whether or not in-person meetings are needed.

Tools You Can Use

Data as a tool for change

With the right approaches and practices, data can help inform decisions and amplify impact thus better enabling us to get to that meaningful change. This toolkit from Spark Policy Institute is designed to help you determine which questions to ask in order to get the data you need and how to use data to take action.

Peer-reviewed publications are the gold standard.

When the goal is to influence others, peer-reviewed publications generally provide the greatest credibility. Even for non-scientific audiences that may not be inclined to read a scientific publication, the fact that research has been peer-reviewed and published generates confidence in the expertise of your organization or team.
Don’t overstate your case.

The level of rigor of your monitoring design will determine the certainty of statements that can be supported by your analysis (Table 5). You can only attribute an outcome to your program activities if you implemented a rigorous monitoring and evaluation plan.

Minimum Standard Questions

Was the monitoring data that you collected evaluated by a qualified analyst in a timely manner?
Were communication products developed for key audiences?

Evaluation

Evaluate data from monitoring and other sources.

The analyst matters.

Timeliness matters.

Look for the unexpected.

Generate communication products.

Peer-reviewed publications are the gold standard.

Don’t overstate your case.

Submit a Comment