Terms of Reference for the Mid-Term Evaluation of the Accountability
and Fulfilment for Older Persons to Raise their Dignity (AFFORD II)
Programme
Background
HelpAge International (www.helpage.org) is the secretariat to the HelpAge Global
Network, which brings together a wide range of organisations and individuals
working together to ensure that older people lead dignified, active, healthy and
secure lives. HelpAge International’s secretariat is based in London, UK but works
in 41 countries across the world. HelpAge has more than 30 years of experience
working with and for older people. The organization has been designated the
global focal point on ageing by the Inter-Agency Standing Committee and UN
OCHA.
HelpAge International is managing a 5-year (2017 to 2021) multi-country
Accountability and Fulfilment for Older Persons to Raise their Dignity
(AFFORD II) Programme, a social protection programme which is funded by
the Irish Aid. The AFFORD II programme is being implemented in 5 countries,
namely; Ethiopia, Malawi, Mozambique, Tanzania and Ireland.
The goal of the AFFORD II programme is for older women and men in 4 targeted
African countries to lead a more dignified, secure and resilient lives. It is
understood that social protection is one means to contribute to this goal, and
undeniably one of the main components of AFFORD II programme. Accountability,
empowerment and other policy areas are other means in support of the goal.
Within the AFFORD II programme, social protection is the system consisting of
policies, mechanisms and actions by which Governments and other players in the
programme locations provide regular income in the form of social cash transfers
to older women and men as human right to protect them against age-specific and
other risks and contingencies which threaten their well-being and security in old
age.
Project rationale
The last decade has seen a dramatic increase in the number of countries working
to expand their social protection systems in the Sub-Saharan countries. This
includes the expansion of schemes providing income security for older persons
such as universal pension schemes.
The programme has four outcome objectives namely:
1
Older women and men in the targeted countries, including the most
marginalised, benefit from increased access to nationally appropriate, inclusive
and effective social protection systems (Access)
National social and health protection policies, public governance systems and
structures at all levels are more responsive and accountable to older women
and men's rights and needs (Accountability)
Societies, communities and individuals, including in Ireland, demonstrate more
supportive attitudes towards older women and men in the targeted countries
and the wider Global South (Public Engagement)
Civil Societies and their networks, communities in Ethiopia, Tanzania, Malawi
and Mozambique demonstrate more supportive attitudes and actions to
promote the voices of older men and women in attainment of their rights and
entitlements (Voice)
Programme partners
1. Ethiopia: Ethiopia HelpAge Country Office, Ethiopia Elderly and Pensioners
Association (EEPNA)
2. Malawi: Malawi Network of Elder Persons Organizations (MANEPO)
3. Mozambique: Mozambique HelAge Country Office; APITE (Tete); ACIDECO
(Manhica) and Anglican Church (Maputo and Xai Xai)
4. Tanzania: Tanzania HelpAge Country Office; JUWAZA II (Zanzibar) and
KIWWAUTA (Mbeya)
5. Ireland: Age Action Ireland (Dublin)
Key stakeholders
1. Ministries of Labour and Social Affairs (both at National and Regional levels)
2. Ministries of Finance and Economic Development
3. Older Persons Associations (OPAs)
4. International Labour Organisation (ILO)
5. Donor Group for PSNP and Irish Aid as funder of the AFFORD II Programme
Purpose and scope of the mid-term evaluation
The purpose of this mid-term evaluation is to check if the intervention and
expected programme outcome is on track and to make recommendations on how
best to meet objectives in the remaining project period. The mid-term evaluation
will be used to identify which outputs are being delivered according to the plan,
which are being exceeded and whether any activities are falling behind and
reasons. It is also important to assess whether the achievements till date are on
course to achieve the intended outcome/impact. The mid-term evaluation will also
check whether outputs are being delivered in the most efficient and effective way-
i.e. whether programme management and communication arrangements are
efficient, and whether the outputs are likely to lead to intended outcomes or if a
2
different strategy is required. By this, the mid-term evaluation will provide a view
on whether the intended objectives and activities are still relevant (e.g. as a result
of changes in the context or availability of new information). This is also a good
opportunity to test whether current monitoring and evaluation arrangements will
be adequate to demonstrate results by the end of the project. It will test the
veracity of the Results Framework and the Logical Framework to inform the
programme implementation team on the status of planned milestones based on
observed results.
This mid-term evaluation will be restricted to the implementing countries and will
not be expected the measure intended project impact. However, by understanding
the project status, it is expected that potential impacts will be highlighted. Key to
this, the mid-term evaluation will be as participatory as possible with key partners
playing key roles to ensure a high degree of ownership, accountability and
transparency.
While OECD-DAC criteria can be used as a guide, this TORs is focused on providing
information against the key questions needed to support intervention for the
remaining period. However, key evaluation criteria will cover, effectiveness,
efficiency, co-ordination and linkages, sustainability and economy.
The specific objectives of the mid-term evaluation
The specific objectives of this mid-term evaluation are:
A. Assess the extent to which the AFFORD II programme objectives and core
activities are relevant to the targeted beneficiaries including the coherence in
line with wider social protection issues in the region, policies, programmes and
priorities in the 4 countries. This will be done by assessing the level of
achievement of the expected results as outlined in the logical framework and
results framework;
B. Assess the approach taken by the programme and the extent to which the
activities are delivering attainment of the intended objectives of the AFFORD
II programme, the alignment of the activities with the AFFORD II results, which
are, (i) contributing to strengthen the national social protection systems and
programmes; (ii) demand of social protection entitlements and rights of older
persons; (iii) community based structures (older persons’ associations/older
citizens monitoring groups) in forming effective platforms for advocating the
rights and entitlements of older persons to social protection systems and
programmes;
C. Assess the level of efficiency of the AFFORD II Programme compared to the
inputs;
D. Assess the quality of the services provided by the community based structures
(older persons’ associations/older citizens monitoring group) at the community
level and linkages with different administrative structures;
3
E. Document programmatic challenges, lessons learnt and key recommendations
for programme improvement;
F. Assess the extent to which the programme has ensured gender mainstreaming
in programme approaches;
G. Assess the way older women and men were part of the project cycle and to
which results;
H. Identify any innovations used by the programme in achievement of results.
Mid Term Evaluation Methodology
a. Technique/ Data Tools
The Mid-Term Evaluation will be mainly qualitative with triangulation of data from
all possible sources. A set of broad Mid-Term Evaluation questions with relevant
sub-questions, will be formulated with a view to provide information about the
extent to which programme’s objectives/results have been achieved so far.
Quantitative data (e.g. on outputs and outcomes achieved to date) will be sourced
primarily from the information provided in the monitoring reports including the
result-based framework and annual reports.
The firm/consultant will suggest a rigorous methodology that will be able to
provide the project management with robust information based on the objectives
sought.
To guide the process, the suggested methodology is expected to be making use
of both qualitative and quantitative methods to answer the evaluation questions.
The methodology will also be expected to reveal and understand not only the
“what” and the “how”, but also to place more emphasis on exploring the “why”?
The firm/consultant will have a list of themes, questions and evaluation tools.
The approach should be able to ensure a broad outreach of stakeholders involved,
allow for cross-validation of the findings as the Mid-Term evaluation progress and,
equally important, eventually contribute to a higher buy-in of the Mid-Term
Evaluation findings by all stakeholders involved.
b. Principal tools will include:
i. Focus Group Discussions with vulnerable older men and women, Older
Citizen Monitoring Groups (OCMGs), Older People Associations (OPAs) (at
the district level). It is recommended that a group of 8-10 older people
will inform these discussions. A set of FGD guideline questions will be
designed to guide the discussions. This will follow inspirational spirits of
older persons to ensure that they are given a participatory platform that
they can use to exchange their opinion and thoughts about certain matters
in the programme.
ii. One-on-one interviews with key informants from the government,
HelpAge’s partners/affiliates, HelpAge Programme staffs among other
stakeholders. A set of generic interview schedules/checklists will be
drafted.
4
iii. Desk-based document review of programme documents. Special
attention will be paid to the following documents among others;
programme proposal narrative, budgets, expenditure reports, Monitoring
and Evaluation framework, progress reports, field visit reports among
other key documents. The evaluators will refer to reports against the
Results Framework, including 2017 and 2018 annual reports, to obtain
quantitative data on progress against outcomes and outputs.
The Mid-Term Evaluation will also look at the linkages between the public
engagement work in Ireland and the programme work in Africa.
Major tasks and deliverables of the mid-term evaluation
Deliverables under this consultancy will include the following:
1. An inception report: The firm/consultant will share the inception report that
details the study design (rationale, methodology), data collection tools, and
a detailed work plan within 5 days of engagement, to be approved by
HelpAge International (Social Protection Regional Programme Manager and
Research Evaluation and Learning Regional Programme Manager)
2. Data collection tools: Develop the data collection tools and have them
approved by HelpAge International and partners before data collection,
analysis, interpretation
3. Draft Evaluation report: The firm/consultant will prepare a draft evaluation
report with details of findings, recommendations and lessons learnt for
review by HelpAge International.
4. Validation workshop: Hold a validation workshop/meeting with relevant
HelpAge programme staff.
5. Final Evaluation report: The firm/consultant will share a final evaluation
report after incorporating the comments from HelpAge. This will be both in
electronic and hard copy (MS Word document, PowerPoint slides).
6. Data sets: Firm/Consultant will deliver all the data sets to HelpAge.
Timeframe
The duration of the assignment will be agreed upon signing the mid-term
evaluation contract. This evaluation study will begin in the month of August 2019,
however preliminary works may begin earlier such as development of the tools
and review of the final evaluation study design.
The final report incorporating feedback from HelpAge will be submitted 10 days
after presentation of the preliminary findings.
Costs
The firm/consultant is advised to submit an itemized budget for the assignment
based on the understanding of these Terms of Reference and the current market
rates. Where need be, HelpAge will engage the consultant to an agreeable budget.
5
HelpAge will cover for the firm/consultant’s air tickets on economy class to the
four countries (Malawi, Mozambique, Ethiopia and Tanzania), accommodation on
bed and breakfast plus airport transfers and in-country logistics including field
activities. All other costs shall be borne directly by the firm/consultant.
Payment will be based on submission of deliverables that are satisfactory to
HelpAge as agreed upon after discussion with HelpAge in the inception meeting.
The payments will only be made when the deliverables have been assessed by the
HelpAge team to be of good quality. Taxation laws will apply on the overall
consultancy fee.
The following payments will be paid to the firm/consultant using an agreed mode
of payment.
20% of the contract value after approval of the inception report
80% of the contract value after approval of Final Report and submission of
all data sets
Ethics, Safeguarding and Code of Conduct
As the firm/consultant will be working on behalf of HelpAge and will be required
to sign and adhere to the Safeguarding Policy and ethical guidelines.
The firm/consultant will make clear to all participating stakeholders of all ages that
they are under no obligation to participate in the exercise and that it is purely
voluntary. All participants will be assured that there will be no negative
consequences if they choose not to participate.
The firm/consultant must obtain informed consent from all participants. The
firm/consultant must receive prior permission for taking and use of visual still/
moving images for specific purposes.
The firm/consultant will assure the participants the anonymity, confidentiality and
will assure the visual data is protected and used for agreed purpose only. As
regards the documentation, the title rights, copyrights and all other rights of
whatever nature in any materials used or generated under the provisions of this
consultancy will exclusively be vested with HelpAge International.
Qualifications, skills and experience required
1. Post-graduate degree in Social Sciences, Statistics and related field;
2. Minimum of 10 years’ relevant professional experience in social sciences,
social protection and research;
3. Strong background and experience in data collection and analysis;
4. Proven experience in undertaking evaluation/research or leading
evaluation/research teams, with outstanding skills in qualitative and
quantitative research and data analysis using relevant software such as
STATA, CSPro or SPSS;
6
5. Technical expertise in evaluating social protection, social accountability,
advocacy and rights programmes; and ability to draw strong and valid
conclusions;
6. Excellent communication and report writing skills.
7. Firm/Consultant with Associates in the programme locations will be an
added advantage;
8. An Evaluation team conversant in one or more of the following languages;
Portuguese, Swahili, Amharic and Chichewa will be an added advantage;
Submitting expressions of interest
How to apply
Applicants are asked to submit their expressions of interest by emailing their CV
and a cover letter, outlining how they meet the skills set out in the terms of
reference. All interested Individuals/firms are requested to email their CV to:
Hr.Africa@helpage.org by Friday 19th July 2019.
