Terms of Reference for a Consultant: Mid Term Evaluation for Building Resilient Learners, Teachers and Education Systems in South Sudan and Uganda
Oxfam is an international confederation of 20 affiliates networked together in more than 90 countries committed to ridding the world of poverty and injustice. To achieve this, we support local projects in developing countries, we lobby governments and companies to consider the interests of the poorest people and we campaign to involve citizens in our work. We implement our programs by working with local NGO partners and civil society organizations and engaging with private sector and governments. Oxfam has been implementing both humanitarian and development programs in Uganda since 1960.
About the Project
Resilient Learners, Teachers and Education Systems in South Sudan and Uganda is a four year project funded by the European Union through ‘Building Resilience in Crisis through Education’ (BRICE). The project is implemented in a consortium of both national and global partners. Oxfam IBIS is leading a consortium composing of two other affiliates: Oxfam Novib and Oxfam GB. In South Sudan the partners include Oxfam in South Sudan, AVSI Foundation in South Sudan and Community Development Initiative (CDI). In Uganda partners are: Oxfam in Uganda, Uganda National Teachers Union (UNATU), Forum for African Women Educationalist Uganda (FAWEU), Luigi Giussani Institute of Higher Education (LGIHE)), and AVSI Foundation in Uganda. The global partners are Education International (EI), Columbia Global Center(CGC),Oxfam Novib and with INEE as an associated partner. The Consortium Partners are coordinated by the Project Management Unit (PMU), sitting in the offices of Oxfam in Uganda, with National Coordinators in Oxfam in Uganda and South Sudan..
The purpose of the project is to build quality, sustainable and resilient educational opportunities for refugee and displaced children as well as children in the host communities in South Sudan and Uganda. The primary aim is to improve access to quality primary education for learners between the ages of 6 – 25 years in both non-formal and formal education systems to build resilience in their life skills in terms of playing an active citizenship role, prevent conflict/s and learn technical skills to lead a productive life. This will be achieved through the Accelerated Learning Program model for learners and by improving the skills of teachers to support the target learners by addressing the capacity needs for teacher professional development of primary level school teachers.
In South Sudan the project is being implemented in 18 Alternative Learning Program (ALP) centers spread within the states of Torit/Imatong, Kapoeta, and Jubek/greater Juba. While In Uganda, the project is being implemented in the South Sudanese Refugees settlement of Palabek, Lamwo district. The project targets 03 Accelerated Education Program (AEP) schools and 21 other formal primary schools.
The overall objective of the project is to contribute to improved access and completion of safe quality education for learners in fragile and crisis-affected environments.
The specific objectives (outcomes)
- Improved resilience of learners and teachers in targeted areas in South Sudan and Uganda
- Improved resilience of education systems in Uganda and South Sudan
- Learners in targeted areas in Uganda and South Sudan have improved social, cognitive, and emotional learning outcomes
- Safer and better quality teaching and learning in formal and alternative educational systems in targeted areas in Uganda and South Sudan
- Improved school management and quality data collection and management
- Policies and programmes in favour of displaced/refugee/host populations and teachers supported by stronger evidence base
The purpose of the Midterm Evaluation
The primarily purpose of this midterm evaluation is for learning, documentation and accountability both upward and downward. Thus, all stakeholders will use the learning to adjust the program where needed (to be more relevant in achieving the objectives), and/or to improve coherence and effectiveness.
The consultant will endeavour to assess how the project is being implemented, progress towards achieving the project expected outcomes and results achieved. It will also document the appropriateness of the project design and lessons learned in order to improve implementation and quality of results.
Specific Objectives of the Mid-Term Evaluation
- Examine the ways the project is working (implementation process) and the extent to which they are supportive of the project to deliver project results.
- To assess the relevance of the project towards target beneficiaries. The extent to which project intervention conform to the needs and priorities of target groups taking into account the nexus between humanitarian and development work.
- To assess project effectiveness. The extent to which project objectives are achieved at the results level? Have benefits reached the target group as intended? Are benefits distributed fairly and across target groups?
- To assess project Efficiency. The extent to which the costs of project intervention are justified by its results, taking alternatives into account?
- To measure the likely sustainability of the outcomes realized. Whether the positive outcomes of the project and the flow of benefits are likely to continue after the end of the project support (such as policy, dialogue, coordination).
- Identify key lessons and propose practical recommendations for the remaining period of the project.
Scope of Work
The midterm evaluation will cover the two countries of Uganda and S. Sudan. In Uganda it shall be conducted in Lamwo district where there are three AEP centers in and outside Palabek refugee settlement. In S. Sudan the exercise shall cover Torit/Imatong state, Kapoeta state, and Jubek state/ greater Juba. where there are eighteen ALP centers. In addition the consultant will be required to arrange skype meetings with the global consortium partners.
- Analyze progress against indicators and targets as elaborated in the project log frame and MEAL plan, particularly on three tasks of AEP/ALP, TEPD and working as a consortium.
- Analyze thoroughly activities that contribute to resilient education systems (Teacher professional Development, school based data collection and management, safety in and around schools, and education policies, etc.).
- Analyzing the extent to which the project has enabled access to education among refugees, IDPs and host communities and to accommodate disadvantaged learners and their needs e.g. pregnant girls and child mothers.
- Review if the psychosocial support (PSS) in the project is consistent across the project. The extent to which it is consistent with PSS approaches within education in the emergency context.
- Clarify programme situational context and identify barriers/challenges that have affected project progress to date.
- Examine the ways the PMU and consortium partner are managing and implementing the project, what the project needs to do more, better or differently or the things the project is not doing but should do, and how the project can be improved in realistic ways.
- Explore how effective the project is at meeting the gendered needs (and other specific vulnerabilities) of learners, and any learning on ways to better reach refugee/IDP female learners.
- Identify lessons learned including cross-border learning, good practices and success/impact stories to inform implementation approaches and strategies.
- To analyze project budget performance. The focus is the measure the extent to which funds are consistent with the activity implementation.
- Make clear recommendations of what needs to be done going forward – more focus on improving quality of implementation and ensuring sustainability
The consultant is expected to suggest a sound methodology, describing the design and approaches to be used and provide the rationale for the choice of each approach. Broadly, a mix of qualitative and quantitative methods to collect data on outcome indicators are required. Overall, the methodology section should cover details of the design and approaches, sample size determination, sampling, data collection methods/instruments, data analysis techniques, plan for dissemination of study findings and considerations for quality assurance during research. The methodology should ensure adequate consultation with the project consortium partners and providing feedback at all stages of the mid-term evaluation.
- Prepare inception report to define and clarify the procedures, process and methods of conducting the midterm evaluation. The report should be submitted to PMU for review and approval before moving ahead with the next steps.
- Review project proposal, annual work plans, Monitoring Evaluation Accountability and Learning Framework, baseline report, annual budgets, and annual reports and other relevant documents to provide the information required in the specific objectives.
- Develop and test data collection tools specifically for capturing outcome parameters. The consultant shall also be required to use the project MEAL tools or use the data collected through the MEAL system.
- Analyze how partners are confident and using the tools and are they useful
- Debriefing meetings with partner and main stakeholders in South Sudan and Uganda respectively, and one overall PMU, following data collection.
- Prepare draft report for review and approval by the PMU
- Prepare and make presentations for the consortium for the purpose of validating the report and disseminating the findings
- Prepare final report with clear recommendations for improvements going forward and any other relevant task to facilitate quality midterm evaluation
- An inception report detailing a study methodology, implementation plan and data collection tools
- A set of data collection tools
- A draft report
- Presentation of findings
- Final report-The format for the final report will include: a standard cover page; executive summary; introduction inclusive of study objectives, study methods and limitations; study findings, conclusions and recommendations
- A clean data set and transcriptions for the study be submitted over to Oxfam at the end of the study
Timeframe and estimated working days
The task is expected to take thirty days (30) including dissemination to stakeholders.
Qualification and experience of the consultant/team
The consultancy firm or a team of consultants must;
- Must have strong knowledge on education programs including TEPD and preferably with alternative education in Uganda and South Sudan
- They should have skills in planning and carrying out midterm evaluations and surveys as well as performance measurement (especially quantitative and qualitative measurements).
- Should have skills and experience in monitoring and evaluation
- Must have experienced in education and socio-economic research, including in survey design, sampling, data management and analysis Strong research background, with demonstrable experience in conducting baseline studies, mid-term and end term evaluation
- The consultant should have conducted at least three similar assignments and provide references for these assignments
- Demonstrate understanding the ways of working in consortia
- Strong analytical skills
- Excellent report writing and good communication skills in English
Criteria for Evaluation of proposals
The criteria include but not limited to the following;
- Understanding the ways of working in consortia
- Skills and experience in monitoring and evaluation
- Cost of the mid-term evaluation activities and budget frugality.
- Sound methodology
- Experienced in education and socio-economic research,
- Experience in qualitative and quantitative methodology including in survey design, sampling, data management and analysis
- Experience in conducting baseline studies, mid-term and end term evaluation
The selected consultant will propose and agree with Oxfam on the report format. However, Oxfam expects a concise report of 15 - 20 pages excluding annexes.
Supervision/management of the assignment
The evaluation will be supervised by the Project Manager with technical support from Oxfam in Uganda's Programme Quality and Learning Coordinator and the global Project Coordinator in Oxfam IBIS.
The consultant will be paid according to Oxfam’s payment schedule/standards as shall be stipulated in the contract.
How to apply
A consultant shall submit a proposal which should includes;
- Cover letter: A short (maximum two pages) letter expressing his/her interest and related experience;
- Technical Proposal (maximum eight pages) and A financial proposal
Applications should include three references and two writing samples of similar previous products
Interested applicants must submit their proposal with all required documents in a sealed envelope to the following physical address on or before 17:00 Hrs on 23rd March, 2020.
Plot No. 3459, Tank Hill Rd, Muyenga
P.O. Box 6228, Kampala, Uganda
Or through email to Ugandalogistics@oxfam.org