POSITION :Consultant - Mid Term Evaluation of STEER Project

Purpose and Scope of the Evaluation

After three years of implementation, STEER will conduct a mid-term evaluation of the project in order to assess its progress against outcomes, and will evaluate management and coordination process.

The goal of the evaluation isto assess both the processes, strategies and outcomes of the project, collect robust evidence, document lessons learnt to inform necessary course direction.

This mid-term evaluation will cover all aspects of project implementation including institutional, administrative, organizational and technical aspects – aspects which may have an impact on the performance of the project.

To ensure objectivity and credibility the mid-term evaluation will be led by an external consultant who has made no prior commitment or contribution to the Project.   The evaluation is expected to take place between February and March, 2017.

Specific Objectives

More specifically, this evaluation will explore the following key evaluation questions and develop recommendations based on the findings:

1. Evaluate the extent to which the STEER project has met its stated objectives, including meeting goals and outcome indicators for child and household well-being, economic, nutrition, and parenting outcomes, and systems strengthening.
2. Evaluate the effectiveness of STEER community case workers (CCW) in delivering home services.
3. Evaluate the effectiveness of the Village Savings and Loan Associations (VSLA) approach in increasing household savings and investment.
4. Measure the current levels of household savings and food security in the households with OVCs
5. Evaluate how STEER has contributed to caregivers’ ability to care for OVC through increasing household savings and food security. (This should be via DIFFERENT mechanisms from the VSLA approach that is being measured above)
6. Evaluate whether and how STEER’s organization development strategies have improved the visibility and viability of our partner organizations.
7. Document project achievements, best practices, and lessons learned (i.e. what worked well and why and what did not work and why).
8. Recommend improvements for STEER’s long-term strategies for OVC programs, focusing on project management, achieving quality, accountability and to replicate similar approach in other states in Nigeria. What can be done differently to achieve more effectiveness, efficiency, Sustainability and impact?

Scope of the Mid-Term Evaluation

The following evaluation criteria is based on the OECD-DAC principles for evaluation of development assistance; the following questions will be used to undertake the evaluation study. The final midterm evaluation report will be expected to respond to all the questions mentioned below: 

Relevance

• To what extent were the objectives of the STEER project valid in response to the needs of the community in the project target areas?
• Have the planned programme activities and outputs been consistent with the progress on overall goal and objectives?
• Have the planned programme activities and outputs been consistent with the intended impacts and effects on the improved livelihoods of OVC and their caregivers/households?

Effectiveness:

• To what extent are the objectives likely to be achieved by the end of the project and also could underlying reasons leading to achievements and key bottlenecks that contributed to delays be identified?
• To what extent did the services provided cause changes to household economy, stability and improved welfare? What factors were responsible for these changes?
• How was learning from various forums incorporated into supportive supervision of civil society organisation partners?
• How effective were the various project activities to improve household welfare and livelihood for OVC?

• How well did the project team engage with different stakeholders and partner organisations to achieve effectiveness and sustainability of project activities?

Efficiency:

• How efficient (timeliness, cost-effectiveness) was the project in achieving the desired project outcomes?
• Were project objectives and activities achieved on time on the STEER Project?
• Have the most efficient approach/(es) been used to achieve project Outcomes and Outputs (as compared to alternative approaches)

Impact:

• What real difference has implementation of the project activities made in the lives of the beneficiaries?
• What were the key lasting changes achieved by the project particularly for Caregivers and OVC?
• Did the training of Community Volunteers lead to changes in practice and improvement in the quality of care the caregivers were provided, what evidence do we have and what evidence can we gather to demonstrate this?

Coherence:

• To what extent have our interventions been coordinated with the efforts of different stakeholders including Child Protection Committees (CPCs), VSLA groups?
• What internal coordination problems did the project team face and how were they addressed?
• What was the project level biggest achievement to demonstrate effective coordination? How can we improve coordination?

 Sustainability

• To what extent can the benefits of the STEER project for beneficiaries continue after the project funding ceases?
• To what extent can the stakeholders be able to continue with implementation of the project activities?

Desired Methodology

While the evaluation design will be left at the discretion of the consultant, we anticipate that the proposed evaluation activities may include, but not be restricted to, a combination of some of the following methods:

• Interviews with project staff;
• Review of project documentation;
• Review of project logic (proposal);
• Review of monitoring and other process documentation such as annual and self-assessment reports;
• Collection of information from participating agencies
• Interviews with several actors/stakeholders of the project, including (but not limited to) partners, SCUS, SCI management, and others as agreed;

Outputs and Deliverables

The following specific outputs are expected –

• An Inception report
• Data collection tools, including whether any existing tools from other organizations will be adapted or used.
• All data collected (both raw and aggregated) on USB Drive. The data sets should be in an appropriate format (SPSS, Excel, and Word) and should be submitted together with the final evaluation report
• All qualitative data (paper and electronic), analysis results should be submitted along with the final report; these should include the type of qualitative data to be collected and what software will be used to analyze such data
• A draft evaluation report
• A Final draft evaluation report including community case studies and recommendations to STEER.
• PowerPoint presentation, summarizing the key findings from the evaluation submitted together with the final evaluation report. This will be expected latest two weeks after end of data analysis.
• Document project achievements, best practices, and lessons learnt (i.e. what worked well and why and what did not work and why).

Submission of Response

To be considered for award of contract under this Terms of Reference (ToR), please provide a detailed description of respondent’s capabilities, experience, and qualifications relevant to the work described in this ToR. Following receipt of your application, Save The Children will send out a Request for Proposal (RFP) to select shortlisted applicants for full proposal.

Qualification and Experience

• Extensive experience in evaluation of projects working in the development sector
• Experience with knowledge management and organizational change processes
• Extensive experience in Health, OVC or Child Protection programming in a developing country
• A minimum of 15 years’ experience in administering surveys, conducting qualitative and quantitative analysis, collecting data and producing quality baseline and end line reports preferably for international non-profit organizations.
• A master’s degree in relevant social sciences or health
• Applicants with Country Director, Chief of Party or similar level of capacity is highly preferred.