Job Description
Consultant Endline Study and Final Evaluation CBCCA
OBJECTIVES
Endline Study Objective
To conduct an endline evaluation of the Community-Based Climate Change Adaptation (CBCCA) Programme in accordance with the OECD‑DAC evaluation criteria by comparing endline findings with baseline results and generating evidence‑based conclusions and lessons to inform accountability, learning, and future programming.
Specific Purpose
a) To assess changes in the project’s indicators, including beneficiaries’ knowledge, attitudes, and practices related to climate change across baseline, midline, and endline phases. This includes the use of climate and weather information, adaptive behaviours, community‑led climate actions, and perceptions of climate adaptation policies at village, sub‑district, and district levels.
b) To examine the relevance and coherence of the programme in relation to the needs and priorities of target communities and schools, including alignment with local and national climate adaptation frameworks and consistency with other interventions by Save the Children, government entities, and relevant actors.
c) To assess the effectiveness and efficiency of programme implementation in achieving intended outcomes, including timeliness, partner coordination, resource utilization, and perceived appropriateness of programme services across different population groups.
d) To evaluate programme reach, inclusion, and beneficiary satisfaction, with particular attention to children, women, and other vulnerable or marginalized groups, including gender sensitivity across programme design, implementation, and outcomes.
e) To assess the programme’s contribution to changes in climate resilience at community and school levels, including intended and unintended effects and key mechanisms influencing results.
f) To assess the sustainability and potential for scale‑up of the programme by examining the likelihood that results and capacities will be sustained beyond the project period and identifying conditions that enable replication or expansion.
METHODOLOGY
1. Research Design and Sampling
The endline evaluation will use a mixed‑methods approach combining quantitative and qualitative methods to assess programme performance against OECD‑DAC evaluation. Quantitative methods will measure changes over time, while qualitative methods will explore implementation processes, contextual factors, and beneficiary experiences. Endline findings will be compared with baseline and midline data to assess progress and trends.
Quantitative data collection will focus on Knowledge, Attitude, and Practice (KAP) related to climate change adaptation using structured questionnaires. Qualitative methods will be used to assess aspects not captured through surveys, including relevance, coherence, efficiency, inclusion, impact pathways, and sustainability. Data triangulation will be applied to strengthen the validity of findings.
2. Study Area
The study will be conducted in Bandung District, West Java, covering 10 villages across three sub‑districts: Baleendah, Ibun, and Rancaekek. These areas are vulnerable to hydrometeorological disasters, particularly flooding, and are the implementation locations of the CBCCA programme.
3. Quantitative Survey
Cluster and purposive sampling will be applied, targeting programme beneficiaries in the 10 project villages. With a population of 6,592, a 5% margin of error, and a 95% confidence level, the sample size is 364, rounded to 400 respondents to ensure comparability with baseline and midline studies. Target groups include village apparatus/champions, farmer groups, community members, and students, with gender balance and inclusion of vulnerable groups ensured.
4. Data Collection Tools and Analysis
Data will be collected using a digital questionnaire through Kobo Toolkit, covering socio‑demographic characteristics and KAP related to climate change adaptation. The questionnaire will be piloted and validated by Save the Children Indonesia.
Quantitative data will be analysed using statistical software (SPSS), applying descriptive statistics and Chi‑Square tests with a significance level of p ≤ 0.05. Qualitative data will be collected through FGDs and KIIs with community members, teachers, programme staff, and district‑level stakeholders, and analysed thematically. Final details will be confirmed in the inception report.
EXPECTED ACTIVITIES AND DELIVERABLES
The evaluation deliverables and indicative timelines (subject to the evaluation commencement date) are outlined below. The Endline Team Lead will promptly inform the CBCCA Project Manager and REALM Coordinator of any risks or issues that may affect timely delivery.
Expected deliverables of the Evaluation Consultant:
Inception Report and Workplan: 5 January 2026
Finalised Instruments/Data Collection Tools, including Consent Forms: 9 January 2026
Ethical Submission: 12 January 2026
Enumerator Training Completed: 14 January 2026
Finalised Quantitative and Qualitative Raw Data (Data Collection Report): 27 January 2026
First Draft Evaluation Report: 6 February 2026
Final Evaluation Report (Bahasa Indonesia and English): 14 February 2026
Final Evaluation Results Dissemination: 14 February 2026
REPORTING AND GOVERNANCE
The Endline evaluation will be overseen by a Steering Committee that holds final decision‑making authority on key aspects of the evaluation, including scope, methodology, analysis, and reporting. The Committee will review and approve all major deliverables—such as the inception report, data collection tools, draft findings, and the final Endline report—to ensure alignment with programme objectives, donor requirements, and evaluation quality standards.
ENDLINE & FINAL EVALUATION STUDY TEAM
To be considered, the Endline and Final Evaluation study team must collectively demonstrate the following skills, expertise, and experience:
Designing and conducting baseline, midline, endline, and final evaluation studies using KAP surveys and other quantitative and qualitative methods.
Conducting research and/or evaluations in the field of Child Protection, particularly related to climate change issues.
Leading socio‑economic research, evaluations, or consultancy work in Indonesia with strong sensitivity to local context and culture, including child rights, gender equality, ethnicity, religion, minority groups, and other relevant factors.
Conducting ethical and inclusive research and/or evaluations involving children, including the use of child participatory approaches.
Conducting ethical and inclusive research and/or evaluations involving marginalized, deprived, and/or vulnerable groups in culturally appropriate and sensitive ways.
Managing and coordinating diverse stakeholders, including government, non‑government, community‑based, and academic institutions.
Strong report writing and presentation skills.
There is a high expectation that:
Members (or a proportion) of the Endline and Evaluation study team have a proven track record of working together.
A Team Leader will be appointed with sufficient seniority and experience to lead complex evaluation projects and guide the team toward shared objectives.
The team is able to commit to the project requirements and has adequate skilled resources available throughout the evaluation period.
The team demonstrates flexibility and adaptability to accommodate changes during project implementation.
SELECTION CRITERIA
Essential Criteria
Understanding of Requirements and Proposal
Demonstrate a clear understanding of the study requirements and present a proposed approach to conducting the research. The proposal will be assessed based on the robustness, appropriateness (actionable, sensitive, and responsible), and suitability of the methodology to meet the study objectives.
Demonstrate understanding of the required deliverables and activities by:
a) Describing the proposed project management approach and proven track record of delivering projects on time and within budget.
b) Providing a project plan with an indicative timeline and clearly defined roles and responsibilities of team members.
Capability Criteria
Demonstrated Experience
Demonstrate experience and a strong track record in conducting medium‑scale baseline, midline, endline, and evaluation studies using mixed methods (qualitative and quantitative data collection and analysis).
Demonstrate experience and a proven track record in conducting research and/or baseline, midline, endline, or evaluation studies in the field of Child Protection, particularly in relation to climate change issues.
Demonstrate experience and a strong track record of leading socio‑economic research, evaluations, or consultancy work in Indonesia that is sensitive to local context and culture, particularly with regard to child rights, gender equality, ethnicity, religion, minority groups, and other relevant factors.
Demonstrate experience and a proven track record in conducting ethical, inclusive, and participatory research and/or evaluations involving:
a) children; and
b) marginalized, deprived, and/or vulnerable groups.
Bidder Capacity
Describe the Project Lead’s experience in coordinating consultancy work, research, and/or evaluations of similar scale, including managing a diverse team of specialists.
Nominate the key personnel and resource pool responsible for delivering the contract. The response will be assessed on whether the skills and experience of the nominated personnel adequately cover all required areas of expertise, and ...