ERGF Midline Evaluation Consultant at Mercy Corps Nigeria

We are recruiting to fill the position below:

Job Title: ERGF Midline Evaluation Consultant

Location: Kaduna
Employment Type: Contract

Introduction

• The purpose of this scope of work is to outline the responsibilities and deliverables for a consultant to conduct a Mid-term Evaluation for the ERGF (Empowering Resilient Ginger Farmers) Program.
• The ERGF is a three-year (October 2022 – March 2025) program funded by the Ekaterra Tea MSO USA LLC, implemented by Mercy Corps Nigeria through the market system development approach to connect 6000 farmers in Kaduna state to resources, training, and inputs, foster improved linkages between ginger farmers, and financial institutions, markets, and set-up and support savings groups to build longer-term financial capacity, increased productivity and resiliency.
• The ERGF Program operates in the 4 Local Government Areas (Kachia, Sanga, Jema’a, and Jaba) of Kaduna State.
• The program's overall goal is that ginger farmers, especially females and their families in Kaduna State would have increased ginger productivity, increased incomes, and built longer-term financial stability and resilience.

Objectives:
The following are the specific objectives:

• Ginger farmers develop increased knowledge of resilient agricultural practices.
• Increased productivity and income of ginger farmers through increased application of resilient agricultural practices and market linkages.
• Improved knowledge on the Return on Investment (ROI) for resilient agricultural practices and their scalability.
• Ginger Farmers is connected to financial tools to support investment in their businesses.

Purpose of the Evaluation
Rationale of the evaluation:

• Mercy Corps is committed to measuring the program’s performance through monitoring and progress monitoring of the set outcomes while assessing achievements and results at the program's mid-term and end-term. Mercy Corps wants to ensure that outcome monitoring, reviews, and evaluations are timely, of good quality, and useful for program improvement and is keen to collate evidence on the impacts of its programs and document lessons learned for improvement.
• The main purpose of the mid-term evaluation is to assess Programs progress towards the outcomes and long-term goals and ensure that challenges and results are monitored, communicated and acted upon in a timely and efficient and result based manner. The Evaluation is also intended to identify challenges, opportunities and lessons learned and makes recommendations that the donor, Mercy Corps, the Program team and partners will use to improve implementation of this and other Programs and programs.
• Thus, the ERGF mid-term evaluation (MTE), serves as a critical checkpoint to assess the progress, relevant, effectiveness, efficiency, and challenges faced in implementing the Program having spent about 37% LOP.
• This evaluation also provides an opportunity to make necessary adjustments and recommendations to ensure the Program's success in achieving its objectives. MTE is carried out during the implementation of the program and shall indicate whether it is necessary to redirect and make corrections before the ex-post evaluation, or for the next programming period. It will focus on assessing the ongoing activities (output + outcome), and strategies of the Program to identify areas for improvement and make necessary adjustments where needed.
• This is also a good opportunity to test whether current monitoring and evaluation arrangements will be adequate to demonstrate results by the end of the Program. It will test the veracity of the Results Framework and the Logical Framework to inform the programme implementation team on the status of planned milestones based on observed results.

Objectives

• The MTE objective is to evaluate progress and effectiveness of ERGF Program i.e if the Program and expected KPIs are on track and if the Program is on track to realizing the intended outcomes.

• The MTE will be used to identify which indicators are being delivered according to the plan, which are being exceeded and whether any activities are falling behind and reasons. It is also important to assess whether the achievements are till date are on course to achieve the intended outcome/impact.
• The MTE will also check whether outputs are being delivered in the most efficient and effective way i.e. whether Program management and communication arrangements are efficient, and whether the outputs are likely to lead to intended outcomes or if a different strategy is required.

The specific objectives of this mid-term evaluation are:

• To assess the relevance of the ERGF strategic and tactical approaches to the ginger farmers and the context of operation.
• To assess the program’s relevance, efficiency and effectiveness.
• Identifying promising areas for ERGF’s focus through its remaining period of performance and address any areas of concern that can contribute to strengthening the remainder part of the program including recommendations and lessons learnt.
• To ensure accountability for results to the program actors (donors) stakeholders and participants.

Scope and Methodology of the Midline Survey:

• The overall scope of work for this assignment entails conducting a comprehensive assessment of all the program components and achievements so far, creating an accurate and comprehensive picture of the project implementation, generating findings on evaluation criteria and documenting good practices.
• Good practice should be defined as: “strategies, approaches and/or activities that have been shown through research and evaluation to be effective, efficient, sustainable and/or transferable, and to reliably lead to a desired result.
• The scope will involve reviewing existing program documents, literature, reports, and databases and assessment while providing recommendation and lessons learned.
• The evaluation is expected to cover the program period from October 2022 till date.

The following elements should guide the design and implementation of this Midline survey:

• The study should consciously adopt a mixed research methods consisting of a desk review of existing literature, quantitative and Qualitative data collection approaches consisting of Household survey and key informant interviews (KIIs), Focus Group Discussions (FGDs) approaches that are gender sensitive. The methodology will seek to reveal and understand not only the “what” and the “how”, but also to place more emphasis on exploring the “why”?
• A purposive and stratified random sampling method should be employed to reduce biasedness.
• The scope of the study must be consistent with the budget and timeline available.
• The data collection has to be done using the Commcare platform and specific tools used to assure quality and reliability of the data collected.
• Upon contracting, the indicator performance plan and other related documents shall be made available to the consultant.
• The evaluation should use a structured questionnaire for the quantitative survey and a question guide to collect the qualitative primary data. A total of 16 FGDs will be conducted (4 per LGA) consisting of 10 participants per cluster between the age of 15-50 and above and disaggregated by male and female.
• A total of 30 KIIs should be conducted which will target but not limited to cluster or cooperative leads, partners and other stakeholders.
• A household survey that targets a total sample size of 600 in the 4 LGAs.

Midline Evaluation design:

• The evaluation will be conducted following the Mercy Corps evaluation standards.
• This will be in line with the results-based approach, focusing on identifying and analyzing results from key questions related to the evaluation criteria and the achievement of the outcomes/ objectives of the program using the indicators in the logical framework of the program.
• While the MTE will be formative in assessing the progress to date and lessons learnt, the evaluation design will consider the Program in relation to the Organization for Economic Co-operation and Development (OECD) Development Assistance Committee (DAC) evaluation criteria: effectiveness, efficiency, relevance, sustainability, and impact.
• This will also track Program deliverables for the output and activity to date verses the progress made till this date.
• This is necessary to track the Program direction.
• The nature and scope of this evaluation required a combination of quantitative (HHs structured questionnaire) and qualitative (FGD, KII) evaluation design. In sum, a matrix of progress toward result will be presented.

Key Evaluation Questions:
The consultant will consider the following during the evaluation:
Relevance, strategic fit, and validity of design:

• To what extent has the ERGF program addressed the primary needs and priorities of ginger farmers?
• How has the intervention promoted community and market systems participants’ behaviours/practices appropriate for their cultural, economic, ecological, and rural livelihood contexts?
• How has the program accurately identified and targeted the vulnerable ginger farmers and other agricultural entrepreneurs including women, youth, and other vulnerable groups as per their needs in ginger farming?
• Has the design clearly defined outcomes, outputs and performance indicators with baselines and targets? Was the Program design and implementation approach valid, and realistic?
• Did the Program design include an integrated and appropriate strategy for sustainability?.

Effectiveness:

• Based on Program monitoring data and achievement of indicator targets, to what extent has each of the expected Program sub-objectives and their related outputs been achieved according to the work plan or are likely to be achieved?
• Has the Program successfully built or strengthened an enabling environment (systems, policies, people's attitudes, etc.)?
• Which have been the main contributing and challenging factors towards Program’s success in attaining its targets?
• What, if any, unintended results of the Program have been identified or perceived?
• Are the available technical and financial resources adequate to fulfil the Program’s plans? If not, what other kind of resources may be required?
• How effectively has the Program management and relevant stakeholders monitored Program performance and results? how effective is the monitoring and evaluation system?
• Is relevant information systematically collected and collated? Is the data disaggregated by sex (and by other relevant characteristics if relevant)?
• Has the Program created good relationships and cooperation with relevant stakeholders such as government authorities and other relevant stakeholders including donor to implement the Program or achieve Program results and address bottle necks?
• Which practices, technologies and other good agronomic practices have participants been more/less inclined/able to adopt, and why?
• Are the specific challenges faced by women in the ginger farming sector effectively addressed by the program?.

Efficiency:

• How has the program improved the efficiency and value for money of its services and product deliveries for the participants?
• To what extent has good practices or efficient solutions for meeting holistic needs of the value chain actors replicated?
• Are there more cost-effective methods or efficient approaches that could be employed to achieve the same or better results?
• How efficiently have resources (human resources, time, expertise, funds etc.) been allocated and used to provide the necessary support and to achieve the broader Program objectives?
• To what extent are the Program’s activities/operations in line with the schedule of activities as defined by the Program team and original (and subsequent) work plans?
• To what extent are the disbursements and Program expenditures in line with expected budgetary plans? Why?

Sustainability:

• To what extent have the beneficiaries benefited from the Program activities? Has the Program changed their lives in any meaningful way?
• What promoted community level practices are most likely to be practiced?
• What processes have been undertaken to improve the capacity of community and local institutions or strengthen an enabling environment (laws, systems, policies, people's skills, attitudes etc.)?
• What factors hinder or facilitate ginger farmers’ capacity scale up? With specific focus on women?
• Is the program strategy and management steering towards impact and sustainability? To what extent are Program activities attaining sustainability and identify steps that can be taken to enhance the sustainability of Program components and objectives
• Lessons learned: What good practices can be learned from the Program that can be applied in the next phase and to similar future Programs? What should have been different, and should be avoided in the next phase of the Program.

Description of Deliverables:

• The evaluation will be carried out through a desk review and field visit to the Program site in the 4 Local government Areas (Kachia, Jemaa, Sanga, and Jaba), Kaduna state and consultations with donor, implementing partners, beneficiaries and other key stakeholders.
• The Mid-term study will include four key phases: contracting, design of the inception report, data collection, and data analysis/report writing. The consultant will review input by all stakeholders and team involved.
• The draft evaluation report will be shared with the Mercy Corps Program Performance and Quality team and Program Manager, a request for comments will be made within a specified time (not more than 3 working days).
• The consultant will apply a variety of evaluation techniques – desk review, meetings with stakeholders, focus group discussions, field visits, informed judgment, and scoring, ranking or rating techniques. Specifically, the methodology will include the overall design strategy and approach to answer the evaluation questions and provide a plan for collecting and analyzing the data.

The consultant will be responsible for the following tasks:

• Review Program documents and relevant literature to gain an understanding of the Program and its objectives.
• Develop an Inception Report
• Develop a comprehensive survey questionnaire based on the Program's indicators and objectives.
• Conduct field visits to Program sites and administer the survey questionnaire to Program beneficiaries and stakeholders.
• Collect and analyze quantitative and qualitative data from the survey responses.
• Prepare a detailed report presenting findings, analysis, and recommendations.
• Present the findings to the Program team and other stakeholders.

Deliverables:
The consultant will be expected to deliver the following:

• A survey questionnaire that is comprehensive, relevant, and aligned with the Program's indicators and objectives.
• Data collection tools, including electronic data collection forms (Commcare) and guidelines for field data collection.
• Training for data collectors in the 4 LGAs (Jemaa, Kachia, Jaba and Sanga) and data collection.
• Data collection activities in the program locations as well as partners’ locations.
• A report presenting the survey findings, including data analysis, key findings, recommendations, and implications for the Program.
• PowerPoint slides summarizing the survey findings and present to the team.

Timeframe / Schedule:

• The Mid-Term Assessment should be completed within a maximum of 20 working days.
• The consultant should submit the detailed breakdown of the assessment timetable based on the following major activities as a guideline or suggestion.

Consultant Qualifications and Expertise

• Educational Qualification: A minimum of a Master's Degree in Agricultural Economics, Development Studies, Economics, Social Sciences or a related field.
• Professional Experience: Extensive experience (at least 5 years) in conducting research and analysis in the agricultural sector, particularly in market systems development and value chain analysis. Proven track record of successfully leading similar assessments or studies related to agricultural input markets.
• Technical Skills: Proficiency in conducting literature reviews, data analysis, and market assessments. Strong analytical skills to identify trends, challenges, and opportunities within agricultural interventions. Familiar with qualitative and quantitative research methods, including surveys, interviews, and focus group discussions. Ability to develop comprehensive reports with actionable recommendations for stakeholders.
• Communication and Reporting Skills: Excellent communication and interpersonal skills to facilitate interviews, surveys, and focus group discussions. Proficient in report writing and presentation skills
• Project Management skills: Strong project management skills to oversee the entire research process from inception to final deliverables. Ability to develop work plans, manage timelines, and coordinate fieldwork activities. Attention to detail and ability to adhere to project deadlines and budgets.
• Language Proficiency: Proficiency in English and Hausa is required, and/or knowledge of local languages spoken in the Southern part of Kaduna State would be an advantage for effective.

Communication with stakeholders:

• Ethical Standards: Commited to upholding ethical standards in research, including obtaining informed consent, ensuring confidentiality, and respecting the rights and dignity of research participants.

Selection Criteria:

The Consultant Reporting Structure:

• The Mid-term Assessment will be managed by the ERGF Monitoring and Evaluation Program lead with close collaboration with Mercy Corps Program Performance and Quality Team.
• A more exact consultative and decision-making management structure with clear roles and responsibilities will be determined during the inception phase of the study.

Budget:

• A detailed budget outlining the costs associated with the training program will be developed.
• This may include the costs for trainer fees, training materials, venue rental, participant refreshments

Payment terms:

Application Closing Date
10th September, 2024.

How to Apply
Interested and qualified candidates should send their detail Proposal, and CV to: ng-quotations@mercycorps.org using the Job Title as the subject of the mail, e.g "ERGF Midline Evaluation Consultant"

Note

• The duration of the assignment begins when the consultant signs onto the consultancy.

Application:
Applicants should send in their training plan and proposal capturing the below information:

• Name of organization, Name and contact of focal person, office address, Registration type and Number of the company and description of what the company does.
• Consultant(s) profile/CV, including details of academic and/or professional history
• Evidence of similar work conducted.
• Concept note of not more than five pages with previous experience in related activity
• Budget summary of total cost
• Program activity against a timeline (workplan) - based on activity proposed.

Diversity, Equity& Inclusion:

• Achieving our mission begins with how we build our team and work together. Through our commitment to enriching our organization with people of different origins, beliefs, backgrounds, and ways of thinking, we are better able to leverage the collective power of our teams and solve the world’s most complex challenges.
• We strive for a culture of trust and respect, where everyone contributes their perspectives and authentic selves, reaches their potential as individuals and teams, and collaborates to do the best work of their lives.
• We recognize that diversity and inclusion is a journey, and we are committed to learning, listening and evolving to become more diverse, equitable and inclusive than we are today.

Equal Employment Opportunity:

• We are committed to providing an environment of respect and psychological safety where equal employment opportunities are available to all.
• We do not engage in or tolerate discrimination on the basis of race, color, gender identity, gender expression, religion, age, sexual orientation, national or ethnic origin, disability (including HIV/AIDS status), marital status, military veteran status or any other protected group in the locations where we work.

Safeguarding & Ethics:

• Mercy Corps team members are expected to support all efforts toward accountability, specifically to our stakeholders and to international standards guiding international relief and development work, while actively engaging communities as equal partners in the design, monitoring and evaluation of our field Programs.
• Team members are expected to conduct themselves in a professional manner and respect local laws, customs and MC's policies, procedures, and values at all times and in all in-country venues.