Contract type: Short-term consultancy
Programme/Team: V2P Project, Governance team
Period: 25 days
- The overall goal of V2P is: ‘Improved social, economic and political well-being and better quality services’ across Anambra State by the end of 2015.
- The specific outcome of this programme, which directly targets 48 communities across 12 LGAs in Anambra State, is: ‘Communities are effectively holding duty bearers to account, leading to improved responsiveness and service delivery, supported by evidence-based learning and advocacy’.
Purpose of the Evaluation
- The Project has been implemented for two and a half years (July 2013- January 2016).The overall objective of the end of project evaluation is to generate knowledge from the project intervention and project experience, access processes and achievement made in order to draw lesson through collaboration with project principals and partners. This evaluation is being conducted as an end of the project evaluation and will focus at the entire implementation period.
- The evaluation is intended to capture effectively, lessons learnt and provide information on the nature, extent and where possible, the effect of the Voice to the people project in the lives of the targeted groups, communities and community members. The emphasis on lessons learnt speaks to the issue of understanding what has and what has not worked as a guide for future planning.
- To assess the progress made towards achieving the project outcomes and outputs based on the current log frame, proposal, monitoring data and other project documents as well as any unexpected outcomes as a result of the project interventions.
- To review the relevance, efficiency, effectiveness and sustainability of project approaches and strategies used in project implementation at the local, state and national context.
- To ascertain any changes in community voice and government response and how these may be linked to improved good governance and quality service delivery systems that may be attributed and/or linked to project interventions; and how these improvements have benefited poor, marginalized and vulnerable/special groups (women/men and/persons living with disabilities.
- To ascertain the increase in women’s representation and leadership, with clear degrees of attribution that may be possible to the programme interventions such as GEADOR, elections training and mentoring
- To determine as far as possible the degree to which power relations have shifted in target areas as a result of the interventions and in particular the role of programmatic use of power analysis in strategic planning, choices and review.
- To identify key learning from innovation and sharing learning elements of the programme, how this has enhanced civil society and opportunity for new ideas to be developed.
- To report on any unintended outcomes and learnings (positive or negative) that have been realised and make appropriate recommendations.
Scope of Evaluation
The evaluation will look at the following areas: Project management; project activities; reflection of Christian Aid engagement and partnerships with the V2P partners and partnerships with other development partners such as SAVI and SPARC. It will address the results achieved, the partnerships established, as well as issues of capacity and approach.
a) The Evaluation Questions: The following key questions will guide the end of project evaluation;
i). Relevance – Assess the design and focus of the project
- To what extent did the Project achieve its overall objectives?
- What and how much progress has been made towards achieving the overall outputs and outcomes of the project (including contributing factors and constraints)?
- To what extent were the results (impacts, outcomes and outputs) achieved?
- Were the inputs and strategies identified, and were they realistic, appropriate and adequate to achieve the results?
- Was the project relevant to the identified needs?
ii). Effectiveness- Describe the management processes/approaches and their appropriateness in supporting delivery
- Was the project effective in delivering desired/planned results?
- To what extent did the Project’s M&E mechanism contribute in meeting project results?
- How effective were the strategies and tools used in the implementation of the project?
- How effective has the project been in responding to the needs of the beneficiaries, and what results were achieved?
- What value has the project management structure provided that contributed to realization of results?
- Based on findings proffer/suggest future intervention strategies?
- How has project activity implementation used existing community/government structures to deliver results?
- Of what benefit has networking and collaboration approaches been used to achieve results in project implementation?
iii). Efficiency – Of Project Implementation
- Was the process of achieving results efficient? Specifically did the actual or expected results (outputs and outcomes) justify the costs incurred? Were the resources effectively utilized?
- Did project activities overlap and duplicate other similar interventions (funded nationally and/or by other donors? Are there more efficient ways and means of delivering more and better results (outputs and outcomes) with the available inputs?
- Could a different approach have produced better results?
- How efficient were the management and accountability structures of the project?
- How did the project financial management processes and procedures affect project implementation?
- What are the strengths, weaknesses, opportunities and threats of the project’s implementation process?
- How has the project been able to ensure increase in both the representation and participation of marginalised groups (PWDs/Women/Youths) in decision-making processes and government responsiveness to their demands, claims and priorities?
- To what extent are the benefits of the projects likely to be sustained over time, after the completion of this project?
- What is the likelihood of continuation and sustainability of project outcomes and benefits after completion of the project?
- How effective were the exit strategies, and approaches to phase out assistance provided by the project including contributing factors and constraints?
- Describe key factors that will require attention in order to improve prospects of sustainability of Project outcomes and the potential for replication of the approach?
- How were capacities strengthened at the individual and organizational level (including contributing factors and constraints)?
- Describe the main lessons that have emerged?
- What are the recommendations for similar support in future?
(Note: The recommendations should provide comprehensive proposals for future interventions based on the current evaluation findings).
Methodology for Evaluation
- Christian Aid Monitoring and Evaluation Officer shall guide and oversee the overall direction of the consultancy. The evaluation will provide quantitative and qualitative data through the following methods:
- Desk study and review of all relevant project documentation including project documents (proposal document), project progress reports- annual/quarterly project reports, reports of the project steering committee, monitoring assessment reports, trip reports etc, current data collection tools to obtain quantitative and qualitative information taking into account the gender dynamics, Country Programme and V2P Project Theory of Change, project log frame and V2P Case studies/stories of change.
- In depth interviews to gather primary data from key stakeholders using a structured methodology.
- Focus Group discussions with project beneficiaries and other stakeholders.
- Key Informant Interviews with relevant stakeholders.
- Community meetings
- Observations (field visits)
Specific Responsibilities of the consultant
- Take the lead in defining and ensuring an agreeable methodology for this process with adequate consideration of the context.
- Review project documents and/or develop data collection tools for the evaluation process and present them for review by Christian Aid/partners.
- Identify potential methods, approaches and techniques for data gathering and analysis.
- Participate in the identification and training of the data collection team including enumerators, supervisors and FGD facilitators.
- Participate in and supervise data collection and ensure accuracy and quality assurance in the evaluation process
- Conduct data entry, data cleaning, and data analysis of key indicators disaggregated by gender with accompanying graphs/charts
- Present the findings to CA, implementing partners and other stakeholders.
- Organize feedback settings with institutions supported by the project including COMEN, GEADOR and I-WIG/Idiakacho
- Visit to partners offices to share in progress and lessons learnt
- Compile final reports in line with the guidelines set out below and submit data collection materials, a soft copy of the report and analysis outputs in a CD.
Duration of the Evaluation
- The evaluation is expected to start on 11th January 2016 to 12th February 2016 for an estimated duration of 25 working days.
- This will include desk reviews, field work – interviews and report writing.