Terms of Reference for Mid Term Evaluation for the Building, Resilient Learners, Teachers and Education Systems in South Sudan and Uganda

About Oxfam

Oxfam is an international confederation of 20 affiliates networked together in more than 90 countries committed to ridding the world of poverty and injustice. To achieve this, we support local projects in developing countries, we lobby governments and companies to consider the interests of the poorest people and we campaign to involve citizens in our work. We implement our programs by working with local NGO partners and civil society organizations and engaging with private sector and governments. Oxfam has been in Uganda since 1960

About the Project

Resilient Learners, Teachers and Education Systems in South Sudan and Uganda is a four year project funded by the European Union through ‘Building Resilience in Crisis through Education’ (BRICE). The project is implemented in a consortium of both national and global partners. Oxfam IBIS is leading a consortium composing of two other affiliates: Oxfam Novib and Oxfam GB. In South Sudan the partners include Oxfam in South Sudan, AVSI Foundation in South Sudan and Community Development Initiative (CDI). In Uganda partners are: Oxfam in Uganda, Uganda National Teachers Union (UNATU), Forum for African Women Educationalist Uganda (FAWEU), Luigi Giussani Institute of Higher Education (LGIHE)), and AVSI Foundation in Uganda. The global partners are Education International (EI), Columbia Global Center(CGC),Oxfam Novib and with INEE as an associated partner. The Consortium Partners are coordinated by the Project Management Unit (PMU), sitting in the offices of Oxfam in Uganda, with National Coordinators in Oxfam in Uganda and South Sudan..

The purpose of the project is to build quality, sustainable and resilient educational opportunities for refugee and displaced children as well as children in the host communities in South Sudan and Uganda. The primary aim is to improve access to quality primary education for learners between the ages of 6 – 25 years in both non-formal and formal education systems to build resilience in their life skills in terms of playing an active citizenship role, prevent conflict/s and learn technical skills to lead a productive life. This will be achieved through the Accelerated Learning Program model for learners and by improving the skills of teachers to support the target learners by addressing the capacity needs for teacher professional development of primary level school teachers.

In South Sudan the project is being implemented in 18 Alternative Learning Program (ALP) centers spread within the states of Torit/Imatong, Kapoeta, and Jubek/greater Juba. While In Uganda, the project is being implemented in the South Sudanese Refugees settlement of Palabek, Lamwo district for both refugees and host community . The project targets 03 Accelerated Education Program (AEP) schools and 21 other formal primary schools.

Project Objectives

The overall objective of the project is to contribute to improved access and completion of safe quality education for learners in fragile and crisis-affected environments.

The specific objectives (outcomes) are:

  1. Improved resilience of learners and teachers in targeted areas in South Sudan and Uganda
  2. Improved resilience of education systems in Uganda and South Sudan

The intermediary outcomes are:

1.1 Learners in targeted areas in Uganda and South Sudan have improved social, cognitive, and emotional learning outcomes

1.2 Safer and better quality teaching and learning in formal and alternative educational systems in targeted areas in Uganda and South Sudan

2.1 Improved school management and quality data collection and management

2.2 Policies and programmes in favour of displaced/refugee/host populations and teachers supported by stronger evidence base

The purpose of the Midterm Evaluation

The purpose of the midterm evaluation is to assess project progress to determine the extent to which project outcomes have been realized. The results from the study will guide all stakeholders to take corrective actions and make adjusts where applicable to their activities to make them more relevant/effective in achieving the intended objectives and/or outcomes.

The consultant shall endeavour to assess how the project is being implemented, progress towards achieving the project expected outcomes, results achieved and the adaptability of the project to the COVID 19 pandemic. It will also document the appropriateness of the project design and lessons learned in order to improve implementation and quality of results.

Specific Objectives of the Mid-Term Evaluation

  1. Examine the ways the project is working (implementation process) and the extent to which they are supportive of the project to deliver project results.
  2. To assess project effectiveness. The extent to which project objectives are achieved at the results level? Have benefits reached the target group as intended? Are benefits distributed fairly and across target groups?
  3. To assess project Efficiency. The extent to which the costs of project intervention are justified by its results, taking alternatives into account
  4. To measure if the project is achieving the intended outcomes on resilience and system change and what is the likely sustainability of these outcomes
  5. Examine the enabling and hindering factors during project implementation
  6. Identify key lessons and propose practical recommendations for the remaining period of the project

Scope of Work

Geographical scope

The midterm evaluation will cover project activities in the two countries where the project is directly implemented- Uganda and South Sudan. In Uganda it shall cover activities implemented in and outside Palabek refugee settlement Lamwo district. The exercise shall review activities being implemented by five partners, viz Oxfam in Uganda, Uganda National Teachers Union (UNATU), Forum for African Women Educationalist Uganda (FAWEU), Luigi Giussani Institute of Higher Education (LGIHE)), and AVSI Foundation in Uganda.

In South Sudan the exercise shall review activities implemented by AVSI South Sudan in Torit/Imatong state, Community Development Initiative (CDI) in Kapoeta state, and Oxfam South Sudan in Jubek state/greater Juba. In addition the consultant will be required to arrange skype meetings with the global consortium partners to cover global and regional activities.

Technical Scope

  1. Analyze project progress against indicators and targets as elaborated in the project log frame and MEAL plan
  2. Updating the logical framework indicator values as required by the baseline report in relation to the log frame. In addition recommend additional indicators or any changes to the log frame where appliable.
  3. Examine the project governance structure (including project task teams – AEP/ALP, TEPD and Advocacy) and consortium ways of working, identify what is working and what is not working and provide recommendations.
  4. Review the project adaptability to the COVID 19 pandemic with a specific focus on ALP/AEP, TEPD and Advocacy and to which extent the established ways of working facilitated the COVID 19 response and make recommendations where applicable
  5. Review and document in which ways the project addresses gender issues and norms and make recommendations for how this work can be taken forward in a coherent manner
  6. Identify and document lessons learnt including cross-border learning, good practices and success/impact stories to inform implementation approaches and strategies.
  7. To analyze project budget performance. The focus is to measure the extent to which funds are consistent with the activity implementation.
  8. Make clear recommendations on actions in Year 3 and 4 that will ensure sustainability of the project outcomes after the end of the project with a focus on ALP in South Sudan and AEP in Uganda and TEPD .
  9. Explore and document how and how well the project is positioned with the humanitarian /development nexus

Study Methodology

The consultant is expected to perform a desk review of the entire project elements and use both qualitative and quantitative methods to support all findings and recommendations. The research/evaluation design should be specified and rationale for choice provided. The design should resonate with the current context riddled with COVID-19 pandemic. As part of the mixed methodology data should be collected from all consortium partners, project beneficiaries ( learners , Teachers, PTA’s, SMC’s ) and where applicable interviews with other education stakeholders such education partners, relevant government ministries etc. will be conducted. Overall, the methodology section should cover details of the design and approaches, sample size determination, sampling, data collection methods/instruments, data analysis techniques, plan for dissemination of study findings and considerations for quality assurance during research. The methodology should ensure adequate consultation with the project consortium partners and providing feedback at all stages of the mid-term evaluation.

In the design of the methodology the consultant will reflect on how to ensure analysis of the three key priority areas of the project AEP/ALP, TEPD and Advocacy which also constitute the three tasks teams in the project. In addition the consultant will consider how the UNHCR led Accelerated Education Working Group Principles can be used as a framework for analysis of the AEP/ALP parts of the project.

Key Tasks

  1. Prepare inception report to define and clarify the procedures, process and methods of conducting the midterm evaluation. The report should be submitted to PMU for review and approval before moving ahead with the next steps.
  2. Review project proposal, annual work plans, Monitoring Evaluation Accountability and Learning Framework, baseline report, annual budgets, and annual reports and other relevant documents to provide the information required in the specific objectives.
  3. Develop and test data collection tools specifically for capturing outcome parameters. The consultant shall also be required to use the project MEAL tools or use the data collected through the MEAL system.
  4. Debriefing meetings with partner and main stakeholders in South Sudan and Uganda respectively, and one overall PMU, following data collection.
  5. Prepare draft report for review and approval by the PMU
  6. Prepare and make presentations for the consortium for the purpose of validating the report and disseminating the findings
  7. Prepare final report with clear recommendations for improvements going forward
  8. Any other relevant task to facilitate quality midterm evaluation

Study Outputs/Deliverables

  1. An inception report detailing a study methodology, implementation plan and data collection tools
  2. A set of data collection Tools
  3. Updated Log frame
  4. Validation Debrief meeting to highlight findings, recommendations and changes in log frame (one for South Sudan, one for Uganda, one for PMU/Oxfam management) incl. a power point presentation
  5. A draft report with clear recommendations
  6. Final Report
  7. A clean data set and transcriptions for the study be submitted to Oxfam at the end of the study

Timeframe and estimated working days

The task is expected to take thirty days (30) working days including dissemination to stakeholders.

Qualification and experience of the consultant/team

The consultancy firm or a team of consultants must have;

  1. Proven experience in planning and carrying out remote midterm evaluations and surveys as well as performance measurement (especially quantitative and qualitative measurements).
  2. Strong knowledge on education programs including TEPD and preferably with alternative education in Uganda and South Sudan
  3. A good understanding of the South Sudan and Uganda contexts
  4. Demonstrate understanding the ways of working in consortia
  5. Excellent report writing and good communication skills in English and strong analytical skills

Criteria for Evaluation of proposals

The criteria include but not limited to the following;

  1. Skills and experience in remote monitoring and evaluation
  2. Experience in qualitative and quantitative methodology including in survey design, sampling, data management and analysis
  3. Sound methodology
  4. Experienced in education and socio-economic research
  5. Understanding the ways of working in consortia
  6. Cost of the mid-term evaluation activities and budget frugality
  7. Proficiency in English and ability to structure large amounts of quantitative and qualitative data

Report

The format for the final report will include: a standard cover page; executive summary; introduction inclusive of study objectives, study methods and limitations; study findings, conclusions and recommendations. Oxfam expects a concise report of maximum of 15 – 30 pages excluding annexes.

Supervision/management of the assignment

The evaluation will be supervised by the Project Manager with technical support from Oxfam in Uganda's Programme Quality and Learning Coordinator and the global Project Coordinator in Oxfam IBIS.

Payment

The consultant will be paid according to Oxfam’s payment schedule/standards as shall be stipulated in the contract.

How to apply

A consultant shall submit a proposal which should include:

  1. Cover letter: A short (maximum two pages) letter expressing his/her interest and related experience
  2. Technical Proposal (maximum eight pages) and A financial proposal

Applications should include three references and two writing samples of similar previous products.

Interested applicants must submit their proposal with all required documents by October 26th, 2020 to ugandalogistics@oxfam.org