1. General information
1.1 . About Handicap International – Humanity & Inclusion
Handicap International (HI) is an independent and impartial aid and development organization working in situations of poverty and exclusion, conflict and disaster. We work alongside people with disabilities and vulnerable people to help meet their essential needs, improve their living conditions and promote respect for their dignity and fundamental rights.
Our vision: Outraged at the injustice faced by people with disabilities and vulnerable populations, we aspire to a world of solidarity and inclusion, enriched by our differences, where everyone can live in dignity.
Our mission: HI is an independent and impartial aid organization working in situations of poverty and exclusion, conflict and disaster. We work alongside people with disabilities and vulnerable populations, taking action and bearing witness in order to respond to their essential needs, improve their living conditions and promote respect for their dignity and fundamental rights.
1.2 About Humanity & Inclusion in the country/region
HI is currently implementing several programs in Tripoli, Misrata and Benghazi, supporting vulnerable persons and their communities. Activities include provision of comprehensive rehabilitation services including physical therapy and psychosocial support, provision of assistive & mobility devices as per needed; capacity building of local actors, technical support and donations of materials and equipment to health and mental health partners.
The project related to this evaluation, HI has been implementing it since early 2019 for three years under the title ‘Action for Mental Health Assistance in Libya’ (AMAL) as part of wider initiatives to improve the access and quality of health care services in Libya. Implemented in partnership with the Libyan Ministry of Health and a Tunisian NGO, the overall objective of the project is to allow the most vulnerable people in Libya from host communities, those internally displaced and returnees and migrants, suffering from mental health disorders/psychosocial disabilities to regain or to preserve good mental health by accessing quality interventions at community level, primary health care level, and secondary and tertiary level.
From July 2020, HI also started a one-year project in partnership with UNDP, which aims to enhance the development of a culture of peace, cooperation and responsibility – with a focus on youth (male and female) – through improved provision of MHPSS services at community level. This project will strongly rely on Libyan Civil Society Organizations.
2. Context of the evaluation
2.1 Presentation of the project to be evaluated
Project title : Action for Mental Health Assistance in Libya (AMAL)
Implementation dates : December 2018 – December 2021
Location/Areas of intervention : Tripoli, Benghazi, and Misrata
Operating Partners :Project is implemented through an implementing partner based in Tunis and HI directly.
• The final beneficiaries of this action are children, adolescents and adults with mental health disorders/psychosocial disabilities living in the three major cities of Libya – Tripoli, Benghazi and Misrata – and their caregivers, including all status of persons: host community members, IDPs, returnees, refugees and migrants. Due to social stigma, difficulty of access and lack of MHPSS services in Libya at all levels of service delivery (community, primary, secondary and tertiary level) the needs of these people are largely uncovered. Target groups of the action.
• People with mental health disorders/psychosocial disabilities (final beneficiaries) through the implementation of actions at the community level: awareness campaigns and sessions on the most common mental health disorders and access to mental health care to tackle the issue of stigma; direct provision of services at community level such as home visits, individual and group sessions on psychoeducation, low-intensity psychological interventions (such as Problem Management + (PM+); Group Interpersonal Therapy (ITP) for depression, developed by WHO), parenting skills trainings, peer to peer groups. Based on HI current projects, special attention will be paid to provide access to MHPSS to people with functional limitations and to integrate physical and psychosocial rehabilitation. Victims of explosive hazards are also a target group for HI in Libya, linking its current Mine Action activities in the provision of victim assistance services.
• Health professionals (junior and senior, non-specialized and specialized), through a capacity building component: psychosocial workers, nurses, family doctors/GPs, psychologists and psychiatrists. All these professionals, either newly graduated or already active within public health facilities (Primary Health Care Units, Primary Health Care Centres, MHPSS departments of General Hospitals, MHPSS Specialized Hospitals), will benefit from training provided by IP and HI on clinical and community intervention in mental health.
• The Ministry of Health (the Directorate of Primary Health Care Services, the Directorate of Hospital Services, the Directorate of International Cooperation and the Directorate of Nursing and of Human Resources, the Mental Health Department of the National Centre for Disease Control under the umbrella of the Ministry of Health, local departments of the Ministry of Health in Greater Benghazi and Tripoli, selected services (PHC Units, PHC Centers), MH departments of General Hospitals, MH Specialized Hospitals). Selected public health facilities will benefit from increased technical capacities of their staff (see target group above), but also from better working procedures, referral pathways, and guidelines regarding care of people with mental health disorders/psychosocial disabilities.
2 pre-identified CSOs technical support to implement their.
Main objectives and expected results of the project
the overall objective of the project is to allow the most vulnerable people in Libya from host communities, those internally displaced and returnees and migrants, suffering from mental health disorders/psychosocial disabilities to regain or to preserve good mental health by accessing quality interventions at community level, primary health care level, and secondary and tertiary level.
- To ensure the emergence of a community-based development process, i.e. the development of local networks, structures for promoting health, prevention actions, local government policy;
- To build organizations’ capacities (of professionals and of people with disabilities);
- To implement and/or strengthen social inclusion and equal opportunities policy.
With the following results to achieve the above:
Output 1.1: Access to MH services for people suffering from mental health disorders/psychosocial disabilities is improved
Output 1.2: People suffering from mental health disorders/psychosocial disabilities preserve their mental health and increase their coping mechanisms thanks to interventions involving MHPSS professionals.
Output 1.3: Awareness and prevention regarding mental health disorders in children, adolescents and adults are increased and stigma is reduced in order to better prevent mental health disorders/psychosocial disabilities, detect people suffering from mental health disorders/psychosocial disabilities, and facilitate their access to care and their inclusion and participation in society
Output 2.1: Libyan health professionals are trained and upskilled to improve the delivery of MHPSS services
Output 2.2: The quality of MHPSS services delivered at community, primary, secondary care level in selected project locations and facilities is improved
Output 3.1: 2 CSOs are supported by HI to improve their technical capacity to respond to mental health
1. Objectives of the evaluation
3.1 Overall objectives and expectations of the evaluation
The main purpose of the evaluation is to provide HI with an overall independent, qualitative assessment of DG-NEAR -funded project achievements compared with its objectives at the end of the intervention in Libya. The second objective is the identification, formulation and presentation of the lessons learned that could be of interest and use to HI and other stakeholders to make the positive impacts of the project more sustainable. It shall also highlight the accountability of all project stakeholders, and participation of local communities. Furthermore, this exercise will provide a set of best practices, lessons learned and recommendations for future interventions for continuous improvement of HI programming as per HI Project Quality Framework.
3.2 Specific objectives
The specific objectives are as follow:
- To provide a comprehensive understanding of project outcomes and effects of the action on the direct beneficiaries, indirect beneficiaries, partners and other organizations HI collaborates, and other collaborators within the target area within and beyond the frame of planned indicators
- Assess the activities through the scope of the selected criteria of HI Project Quality Framework
- · To formulate the recommendations for all project stakeholders that will contribute to future sustainability of the actions launched and their positive impacts
Draw lessons learned from the project for HI to be used in the future for similar projects.
- Evaluation methodology
The evaluator will propose an approach based on participatory evaluation techniques and tools. A strong participatory dimension is expected to guarantee the ownership of the results by the different project stakeholders.
The evaluation will be conducted by an external evaluator with the support of the Project and Operations Managers, as well as the MHPSS technical Specialist based on a set of defined criteria in order to guarantee that the evaluative exercise can be conducted in a qualitative and independent manner.
4.1 Collection methodology
The evaluator should use a combination of methodologies relying on internal and external sources, based on semi-qualitative data collection.
5. Expected deliverables and proposed schedule
- An inception report refining / specifying the proposed methodology for answering the evaluation questions and an action plan. This inception report will have to be validated by the Steering Committee.
- A presentation document presenting the first results, conclusions and recommendations, to be presented to the Steering Committee.
- A final report of approximately 20-30 pages maximum.
- A summary of 5 pages ;
5.2. Evaluation schedule
It is expected that the overall duration of the evaluation exercise will of a maximum of 7 weeks, up to the validation of the final evaluation. Depending on the current access restrictions and due to the security, the evaluation will be done remotely.
Key steps of the evaluation schedule will include:
- Initial briefings with HI management at Libya coordination level (and in the field, if access is granted).
- Development of data collection tools in close collaboration with the Libya Operations Team .
- Agreement on schedule with specific dates with the Libya Operations Team.
- Submission and approval of an inception report including data collection tools.
- Data Collection (whether partially/fully remotely, or not) .
- Submission of preliminary findings with the Libya Operations Teams and key HI management members. The preliminary findings will be shared with all relevant stakeholders, as advised by the Libya Team .
- Submission of draft report ;
- Incorporating stakeholders’ feedback in draft report.
- Final draft submission and validation by the Operations Teams.
6.1. Expertise sought from the evaluator
The selection of the evaluator will be based on the consideration of a set of criteria, which will be determined by the Steering Committee, which could include:
• A solid and diversified experience in humanitarian programming; (35%).
• Previous experience in evaluation of multi-sectorial projects or projects promoting an integrated approach of response to needs (previous experience of evaluating EU-funded projects would be an asset); (20%).
• Technical background in any of the technical sectors of the project is considered a strong asset; (15%).
• Full working knowledge of English and excellent report writing; (10%).
• Fully conversant with the principles and working methods of project cycle management. (20%).
How to apply:
Required documents for submission:
- A curriculum vitae (training, experience in the areas mentioned above, lists of key publications)
- References (3 of previous evaluation)
- A letter of motivation
- About the evaluation proposal:
- A methodological proposal to conduct the full study including, a minima:
- A time schedule, detailing clearly activities for implementation, realization, monitoring and finalization of the evaluation
- A financial proposal including, a minima, details of consultancy fees and operational costs of the survey / research (travel, accommodation, per diem investigators, interpreters’ pay, software…).
The complete application files must be sent by e-mail address: (email@example.com ) before 31stof October 2021, 20:00 (GMT) with the mention in the subject line: “AMAL Final Evaluation”.