SUMMARY
We prioritized the results-based management approach to develop the evaluation plan for the SSEI. Based on the project goal, we have developed a performance measurement framework (PMF), an evaluation matrix, an activity tracking table, and a suite of data-gathering tools (post and follow-up evaluation surveys, interview guides, etc.) to help the team collect relevant data throughout the implementation of the project.
To monitor and evaluate the SSEI project, we used a combination of the Kirkpatrick model and the OECD/CAD criteria. As a result, the evaluation is undertaken according to six criteria (Relevance, Effectiveness, Reaction/usefulness, Learning/Knowledge, Practice/Behaviour, and Impact). In addition, we prioritized a counterfactual analysis approach to evaluate the impact of the SSEI project. We considered the clients from clusters A and B as the experimental group and those from cluster C as the control group. With the data collected via the data gathering tools developed as part of this M&E plan, the counterfactual analysis allows us to identify if the support provided to the different clusters has a significant impact on the ability of clients to find a job.
Project Details
- Category: Capacity BuildingEvaluation and Learning (MEL) System and Final EvaluationMonitoring
- Client: World Skills Employment Centre
- Location: Canada-Ottawa
- Skills: Results-based Management, Community-Based Approach, Quantitative and Qualitative Data Analysis, Counterfactual analysis approach, and OECD/DAC Evaluation Criteria.
- Start and End date: March 2022 to March 2023
- Language: English