Independent consultant to conduct an external evaluation of
the Psychosocial Recovery and Development in East Timor (PRADET)
The Asia Foundation (the Foundation) is implementing an ending violence against women program in Timor-Leste under a Grant Agreement with the Australian Department of Foreign Affairs and Trade. The program’s goal is to reduce the proportion of women who have experienced violence, and to better meet the needs of women and children affected by violence. The objective is to improve outcomes for women in prevention, support services, and access to justice by improving capacity in key ministries, reducing levels of violence, improving services, and strengthening judicial processes serving the needs of women survivors of violence.
Under the access to justice pillar, the program is providing core funding support and accompaniment to Psychosocial Recovery and Development in East Timor (PRADET) to to support activities for Fatin Hakmatek’s “safe place” operation at the National Hospital Guido Valadares in Dili, at Oecusse referral hospital, Maliana referral hospital, Suai referral hospital and Baucau referral hospital.. This activity is expected to contribute to improving the well-being and recovery of women and children victims of violence, as well as provide corroborating evidence for their cases in the formal justice system. PRADET currently has three programs: Fatin Hakmatek (safe place), PAMM (mental health assistance program), PDAJJ (peace, democracy and juvenile justice). Further background information regarding PRADET is at Annex A.
These terms of reference address the requirements for an external evaluation of PRADET’s program activities from January 2013 until present. The evaluation will not review PRADET’s financial management systems and governance practices as these have been reviewed by an independent financial audit.
The Asia Foundation is looking for a consultant to:
1. Assess the quality of PRADET’s activities in the following areas:
a) assistance to victims of domestic violence, sexual assault and child abuse through the five Fatin Hakmateks (Dili, Baucau, Maliana, Suai and Oecusse),
b) assistance to people with intellectual disabilities and mental illness through the PAMM program,
c) support to victims of trafficking
d) support to prisoners
e) personal development course
f) community training
g) advocacy and outreach
2. Assess the impact of PRADET’s activities against stated objectives/desired outcomes.
3. Review the efficiency of PRADET’s current organisational structure and management of its program activities.
4. Produce a detailed evaluation report with key findings and recommendations for PRADET’s future programming, over the next five year period.
5. Facilitate one workshop with all PRADET staff to introduce the evaluation findings and recommendations.
1. External assessment of quality and impact
The evaluation will review the quality (referring to international guidelines where relevant) and impact of PRADET’s activities divided by the following program areas:
• Assistance to victims of domestic violence, sexual assault and child abuse through the five Fatin Hakmateks (Dili, Baucau, Maliana, Suai and Oecusse)
Fatin Hakmatek (safe-place) provides victims of domestic violence, sexual assault and child abuse with safety, counselling, medical treatment and forensic documentation of injuries, with ongoing care and referral to appropriate services. Four of the Fatin Hakmateks are located in purpose built buildings at the referral hospitals (Dili, Oecusse, Suai, Maliana). The Fatin Hakmatek Baucau is located at the ALFeLa office until the Baucau referral hospital is complete. In 2014 the Fatin Hakmateks served a total of 515 new clients.
PRADET has conducted training for doctors and mid-wives to conduct the medical forensic examination. 32 doctors and mid-wives have now been accredited by the National Health Sciences Institute (INS) to conduct medical forensic examinations and complete the Medical Forensic Protocol which provides corroborating evidence for victim’s testimony in court.
• assistance to people with intellectual disabilities and mental illness through the PAMM program
Community based response service to reduce the personal, collective, social and economic impact of traumatic mental disorders.
• support to victims of trafficking
PRADET provides a shelter to provide temporary safe accommodation, counselling and health care for people who have been trafficked to Timor-Leste.
• support to prisoners
Provides a support service to youth in prison and communities at risk of becoming involved in violence.
• personal development course
The personal development course supports individuals to learn strategies and develop skills that will assist them to develop and maintain healthy relationships and engage in healthy behaviors. The Personal Development Course manual, includes providing training and support for individuals to enhance their interpersonal skills, strengthen their ability to effectively regulate and manage emotions, encourage the utilization of conflict resolution strategies, learn to use proactive relaxation and regulation techniques, manage their consumption of drugs and alcohol, and develop ways of expressing their needs effectively through non-violent communication strategies.
• community training
PDAJJ provides training to community members about the role and effect of alcohol
It is expected that the evaluation will not be able to assess the quality of all activities delivered by PRADET from January 2013 to present, therefore a sample from each program area should be selected to inform a general assessment. The assessment should involve interviews with external stakeholders, such as health sector actors, international donors, NGOs, government agencies and policy-makers/legislators.
In assessing the impact of PRADET’s activities, the evaluation will first define the objectives/desired outcomes of these activities, referring to both program documents (such as funding agreements with donors) and PRADET’s articulation of the broader objectives and desired outcomes (such as through interviews with PRADET and referencing PRADET’s strategic plan). Some key questions to be answered are:
a. Were PRADET’s activities delivered to a high-quality? If not, what were the factors effecting the delivery of these activities?
b. What has been the impact of the activities (for each program)?
c. To what extent did the activities achieve the stated objectives/desired outcomes?
d. Were there any unexpected outcomes?
2. Review the efficiency of PRADET’s organisational structure and management
This will involve reviewing the current division of PRADET into the following units: Fatin Hakmatek, PAMM, PDAJJ, and Management, Finance and Administration Unit.
The key question to the answered is whether the current organisational structure best reflects the reality of PRADET’s day-to-day work, and whether changes should be made in order to improve the division of human resources, maximise expertise and efficiency, and respond to future priorities. Provide recommendations regarding the overall sustainability of existing programs and units.
3. Evaluation report
The report will explain the key findings from the evaluation and make recommendations for PRADET’s future programming, over the next five year period. The report must contain a summary of the methodology used in conducting the evaluation, including a list of people interviewed and information analysed. The report must be written in English.
4. Workshop with PRADET on evaluation findings and recommendations
The purpose of this workshop is to present the findings and recommendations to all PRADET staff and the PRADET Board and provide an opportunity for discussion and feedback before finalisation of the evaluation report.
The evaluation will use both quantitative and qualitative methods to assess PRADET’s program activities from January 2013 until present. The consultant will work closely with PRADET and the Asia Foundation to identify the key questions to guide the assessment.
At a minimum, the consultant is expected to:
• Interview key PRADET staff, particularly the Director, Program Manager, Coordinators and international advisers.
• Interview at least 10 external stakeholders regarding their views on the quality and impact of PRADET’s activities, the efficiency of its current organisational structure and any recommendations.
• Analyse a sample of PRADET’s work – training materials, narrative reports to donors, anonymized case files, client planning.
• Analyse data regarding the impact of community training and outreach activities (such as pre/post training questionnaires, brochures).
• Review relevant program documents (monitoring forms, funding agreements, progress reports, client statistics and previous evaluation reports).
• Provide regular feedback to PRADET management and the Asia Foundation on the progress of the evaluation.
1. A workplan for the evaluation
2. Evaluation report – written in English, no more than 25 pages. The report should be written in an accessible manner, presenting information in a way that is useful to non-native English speakers. The report should outline the methodology used in conducting the evaluation, and list the people interviewed and data analysed.
3. One workshop with PRADET to discuss the key findings and recommendations
All documents will be provided to PRADET and the Asia Foundation in soft copy.
The Consultant will be supervised by Sophia Cason, the Organisational Strengthening Coordinator and Access to Justice Coordinator, the Asia Foundation.
REQUIRED QUALIFICATIONS AND EXPERIENCE
• A university degree (preferably a Masters) in a relevant discipline (health, social work, social science, international development)
• A minimum of five years professional experience in a relevant field
• Previous experience in implementing and/or evaluating development programs in the area of mental health, ending violence against women, child protection, human rights or governance
• Demonstrated understanding of the health and/or social services sector in Timor-Leste
• Demonstrated understanding of evaluation tools, methodology and reporting
• Excellent analytical, communication and report writing skills, and
• Working level understanding of Tetum.
CORE SKILLS AND ATTRIBUTES
• A personal commitment to promoting human rights and gender equality, and to modelling personal behaviours consistent with program focus
• Demonstrated ability to work effectively in a cross-cultural setting
• A commitment to working respectfully and collaboratively with individuals and organisations at a range of levels, and
• Strong oral and written communication skills.
EXPRESSION OF INTEREST
Expressions of interest must be submitted no later than 5pm Friday 25 September 2015 containing the following information:
• Cover letter outlining prior relevant experience and contact details of two referees
• Curriculum Vitae
Applications should be submitted to Dian Wahyu Saputri – email firstname.lastname@example.org.
Questions regarding this TOR may be directed to Sophia Cason, OIS and Access to Justice Coordinator, the Asia Foundation Timor-Leste. Email: email@example.com