Oxfam is seeking a consultant or consultancy firm to complete a Final Evaluation for the Community Based Climate Change Adaptation Program.  The Terms of Reference  below lists the details of the assignment.  Interested applicants should submit an application by email to Joe Freach at joef@oxfam.org.au by close of  business on Wednesday, December 3rd 2014.  All applications must include a brief cover letter, current CV listing relevant work experience, and a quote/proposal conforming to the Key Terms and Conditions in the TOR below.

COMMUNITY-BASED CLIMATE CHANGE ADAPTATION PROGRAM IN TIMOR-LESTE FINAL EVALUATION

Responsible to:                 Joe Freach, Program Manager

Accountable to:                Sharon Alder, Program Director

1.     BACKGROUND

Timor-Leste is vulnerable to climate change due to the reliance on rain fed agriculture, the limited adaptive capacity of the population and limited capacity of government and non- government actors to support adaptation measures. Climate change is a relatively new concept in Timor-Leste and Climate Change Adaptation (CCA) is a new field of work. Due to the diverse terrain including a range of agro-ecological zones and diverse communities, which include a range of cultural practices and language groups, climate change impacts are spatially variable and require a localised approach to CCA that incorporates local knowledge and builds upon traditional practices.

 

Oxfam, Caritas Australia and Catholic Relief Services are currently working in a Consortium to implement the Community-based Climate Change Adaptation Program in Timor-Leste (the CCA Program), supported by the Australian Department of Foreign Affairs and Trade (DFAT). This program builds upon the previous climate change adaptation program which ran from June 2010 to March 2012 (CCA Phase I). The first phase focused on awareness raising and the undertaking of a large-scale participatory climate change analysis and CCA planning process that led to the development of Community Action Plans (CAPs). The second phase of the program aims to review and improve the implementation of the CAPs in order to demonstrate practical adaptation strategies that promote community resilience to climate change impacts.

 

The goal of the program is ‘Increased resilience of vulnerable communities to climate-related risks and shocks’. The specific objectives of the program are:

  1. Improved community capacity to plan climate change adaptation measures
  2. Increased community-level knowledge and practice of strategies that promote climate change adaptation and food security
  3. Increased capacity of local non-government and government stakeholders to plan and support community-based climate change adaptation (CBCCA).

The program has been implemented for 2.5 years; from July 2012 to December 2014, and covers 23 sucos in four districts (Covalima, Bacau, Viqueque and Oecusse) to support 15 local partners and 121 community groups.  The joint program supports increasing the resilience of communities by increasing understanding and knowledge of climate change and its impacts, supporting the implementation of climate-resilient livelihood measures at the community level, by promoting more diversified and more environmentally sustainable farming practices, improved natural resource management, more inclusive planning and management systems, improved linkages to district level support, and sharing of program lessons.

2.     PURPOSE AND OBJECTIVES

As part of the program Monitoring, Evaluation and Learning (MEL) Framework, in order to determine the achievements of the program, and to inform the process of mainstreaming suitable activities into broader programs, a final evaluation is being commissioned by the project’s consortium partners.

 

The overall purpose of the final evaluation is to evaluate the performance of the Community-Based Climate Change Adaptation (CBCCA) Program in Timor-Leste; including assessing the approach used, the degree to which the program has been successful in achieving intended objectives and outcomes as well as any broader impacts, and to identify lessons learned.

 

The specific objectives of the evaluation are:

  1. To evaluate the achievements of the program in relation to intended objectives and outcomes, as well as broader impact on increasing resilience to climate-related risks and shocks.
  2. To evaluate the approach used in the program, including the consortium and partnership approach, and the overall implementation.
  3. To identify and document lessons learned and recommendations to inform the continuation of successful activities in wider programs.

3.     SCOPE

The evaluation is expected to cover the work period of Phase 2 (July 2012 – December 2014) of the Climate Change Adaptation Program in Timor-Leste. It will evaluate the effectiveness of the program, including achievement of objectives and outcomes, as well as impact.   It should also identity strengths and weaknesses in the implementation of the project by identifying factors that have facilitated or impeded the achievements of the program objectives and outputs. In addition, the evaluation should also provide recommendations and lessons learned to assist on defining future directions for the program.  Any forthcoming donor requirements regarding the final evaluation may also be included in the scope of the assignment.

 

4.     KEY QUESTIONS

The following provides a guide to the questions to be addressed as follows:

 

Impact

  • How has the program contributed to the increased resilience of women, men, girls and boys to climate related risks and shocks?

 

Effectiveness

  • What have been the positive or negative changes in the lives of the target groups (men and women) to date; and to what extent are these likely to be sustained after the program?
  • To what extent has the program achieved its objectives and outcomes, of:

o   Increased community capacity to plan CCA measures; including women and men’s:

  • Awareness of climate change risks and impacts
  • Awareness of CCA measures that address the needs of vulnerable groups
  • Awareness of, and linkages to, external support for the implementation of their CCA strategies and plans

o   Increased community-level knowledge and practice of strategies that promote CCA and food security; including women and men farmers’:

  • Knowledge and experience in implementing more sustainable natural resource management, farming practices, and/or livelihood strategies based on climate change analysis

o   Increased capacity of local non-government and government stakeholders to plan and support community-based CCA; including:

  • Partner staff knowledge of climate change and community-based CCA, and capacity to assist communities to implement key aspects of the CAPs
  • Local government departments and authorities’ awareness of climate change and CCA concepts, and ability to support implementation of CAPs
  • Has the project promoted greater equity between women and men, boys and girls, and other groups?

Relevance

  • Are the types of community-based adaptation activities carried out most appropriate to the needs of Timor communities (including the different needs of women and men, people with disabilities, other community members or vulnerable groups) in addressing climate change issues?
  • How is the project supporting women to build their capacity to, and implement activities that support their adaption to climate change risk and shocks
  • How has the project supported communities and other stakeholders understanding and use of weather and climate related information to inform their decision making on project activities?

 

Partnership

  • How were partners involved in the management and decision making in the program?
  • Did partners feel that the level of involvement was appropriate and sufficient?
  • Was there effective coordination between different stakeholders (including government and consortium NGO/CBO partners)
  • How effective has the partnership model been in achieving the outcomes, and what were the benefits and challenges of this model?
  • What were the benefits and challenges of the consortium approach?

 

Accountability

  • How have community members, partners and other stakeholders guided the implementation of the project including preparation of community action plans, risks assessment, exchange of practices, learning processes and technical inputs?

 

Efficiency and cost effectiveness

  • How have the resources been utilised to implement the plan, including decisions regarding the appropriate mix of human and financial resources; and
  • Based on the above are the projects considered cost-effective? Why?

 

Sustainability issues

  • How well did the project activities build on existing community capacities, and what factors are in place to support communities to continue with community-based adaptation?
  • To what extent have program partners and stakeholders integrated climate change adaptation into their ongoing plans or programs?
  • What can be done to promote sustainability of the project achievements (economic, financial, social and organisational)?

 

Learning

  • What are the key lessons learned from the program?
  • How have lessons learned been used to improve outcomes during the lifetime of the program?
  • What strategies could be replicated, scaled up or incorporated into ongoing rural development programming?

 

5.     METHODOLOGY

The review will use a combination of the following methods:

 

  • Conduct a desk review of key documents, including project documents, monitoring reports, project inception report, minutes of consortium meetings/workshop/meetings, progress reports (six-monthly), the program midterm review, monitoring tools and other internal documents including financial reports and relevant correspondence;
  • Review specific monitoring and evaluation products prepared by the project, including the program impact survey, MEL data, publications, other materials and reports;
  • Conduct individual/group consultations with the project and consortium team;
  • Carry out consultations with men and women community stakeholders
  • Conduct 2-3 field visits to demonstration sites[1], community-based organizations and project beneficiaries (men and women) as well as visit physical outputs of the project; and
  • Present initial findings and key recommendations at a participatory workshop for analysis and development of recommendations with program and consortium staff.

The evaluator is expected to follow Oxfam Australia’s Research Ethics Guidelines. Full transparency should be taken into account in the data collection and report preparation.

 

Key stakeholder interviews will be negotiated with the Oxfam staff and include:

 

  1. Consortium members: Oxfam, Caritas Australia and Catholic Relief Services
  2. Local partners involved in implementing the project
  3. Local Government

6.     OUTPUTS

The final output of the evaluation will be a Final Evaluation Report of a maximum length of 20 pages excluding cover and appendices.

7.     TIMELINES & COMPLETION DATE

The consultancy is expected to be completed by 30 January 2015.  A sample implementation schedule is as follows:

Jan-Feb 2015 Week 1 Week 2 Week 3 Week 4
Desk Study 5 days
Field trip, including travelling days 5 days
Preliminary findings presented 1 day
Reporting: analyse data and 1st draft 4 days 2 days
Finalization 1 day

8.     REQUIRED KNOWLEDGE & EXPERIENCE

  • Extensive knowledge of Monitoring, Evaluation and Learning (MEL) theory and practice.
  • Experience evaluating international development programs.  Experience as a lead evaluator and/or evaluating Climate Change Adaptation programs is considered to be an asset.
  • Demonstrable knowledge and understanding of Climate Change Adaptation as it applies to international development programming.
  • Ability to produce high quality evaluative reports in English.
  • Excellent written and oral communication skills in English.  Ability to communicate in Tetum is considered an asset.
  • Previous work experience in Timor-Leste is a strong asset.
  • Payment will be on submission of Tax Invoice on delivery against milestones.
  • Quotes and/or tenders should respond to this terms of reference; outlining the proposed approach and methodology for the consultancy, and be inclusive of all costs in relation to international travel, meals, accommodation and other expenses related to the assignment
  • All equipment and materials, required for the assignment are to be provided by the contractor except where otherwise indicated in the Terms or Reference above
  • Oxfam Australia may request written evidence of necessary coverage in relation to insurance (including workers’ compensation), superannuation and taxation prior to commencement of the assignment

9.     KEY TERMS & CONDITIONS

[1] A program impact survey report will be made available to the consultant.  This report documents the findings of a survey completed in November 2014 which documents program impacts based on data collected from program beneficiaries, local government, and local partner organizations in all four districts.

 

The Community Based Climate Change Adaptation Program is funded by the Australian Government.