Description of the goods or services required
SSA_South Africa Evaluation of the Skills for Employability Programme in South Africa
The overall objective of this assignment is to conduct a detailed evaluation of the Skills for Employability programme in South Africa (i.e. relevance, efficiency, effectiveness, sustainability and impact) for purposes of learning and replicability; provision of evidence that can be used to inform and adjust the design and implementation of the programme i.e. evidence to inform the design of a future intervention and policy level engagement.
Specifically, the supplier will
i. Assess the impact of the Skills for Employability programme at legacy and delivery levels against its outcomes and success indicators, through engagement with our partners and key stakeholders in the TVET sector
ii. Assess the suitability and quality of the M&E frameworks employed and provide sound and actionable recommendations
iii. Determine the impact on the primary audience (if any) attained by the programme
iv. Identify lessons learnt, for maximising impact through the British Council-South Africa’s Skills offer
v. Recommend actionable improvements for the programme with a particular focus on the delivery model and monitoring and evaluation systems and processes
vi. Assess the relevance of the International Skills (20 partnerships) and Leadership exchange (33) partnerships projects to the needs of the target groups as defined in each of the projects and in the results frameworks
vii. Develop case studies from International Skills partnerships (7) and Leadership exchange (5) projects.
viii. Ascertain whether a change in programme title would have an impact on how stakeholders identify the British Council in skills development.
ix. Assess the gender, socio-economic, entrepreneurial and employability focus of each International Skills partnership project.
Scope of the assignment
The supplier will be tasked with producing a Skills for Employability programme report which demonstrates impact achieved - qualitative and quantitative – against outcomes. The supplier will also undertake analysis of existing programme data provided by the British Council alongside data collected through interviews and or surveys.
The final report will:
i. Use the Skills for Employability programme results areas against which evidence will be collected to show the success of the programme including identification of problems, causes of bottlenecks in implementation, and providing specific recommendations on what to take forward/scale down on.
ii. Demonstrate qualitative and quantitative impact achieved on institutions and participants in South African (SA) and United Kingdom (UK)
iii. Include key highlights, sound examples, success stories for each of the outcomes and to illustrate impact achieved
iv. Provide a list of possible areas of work that are priorities in SA and also what sectors in the UK are world leaders
To achieve this, the supplier will be expected to:
i. Conduct desk based research and analysis of the SA skills sector and programme data provided by the British council
ii. Analyse data from telephone interviews with a sample of stakeholders (internal and external) against relevant programme outcomes (contact details for interviews to be provided by Skills for Employability management team)
iii. Conduct return on investment evaluation against the purpose, outcomes and success indicators in the Skills for Employability framework
iv. Provide expertise on improving the approach and methodology (model and M&E framework) based on the British Council’s theory of change
v. Include an exit strategy that guarantees the sustainability of International Skills partnerships collaboration and promotes a results-based approach to monitoring and evaluation, emphasising results and impacts
vi. Provide viable and actionable recommendations for further development of interventions in the skills area, based on the findings from the research and evaluation
vii. Conduct face to face visits to SA colleges that will be profiled as case studies to gather evidence and engage with participants and beneficiaries.
viii. Develop 10 case studies to be included in the final evaluation report and also used as knowledge products across out networks
The supplier will draw up specific evaluation questions that are most relevant and agree with the British Council before using them. The information generated, and assessments made will be used to engage skills development stakeholders and inform any possible scale-up, and lessons learned for future projects.
Overall, the evaluation should explore if:
i. Young people are more employable, entrepreneurial and successful because of the skills they have acquired through the programme?
ii. Institutions and organisations have implemented more effective approaches to skills and enterprise development after partnering with the British Council?
iii. Exposure to interventions through the programme has provided stakeholders with the knowledge required to support effective approaches to skills and enterprise development?
iv. New or enhanced policies and approaches foster skills, employability and enterprise?
v. Networks and partnerships in skills and enterprise enhance the international flow of information and trust, raising the UK’s profile and reputation in this field?
• A briefing session to sense-check proposed methods and study approach
• A concise report outlining the approved evaluation plan and methodology.
• Assessment tools including discussion guides and survey questions to guide British Council in ensuring that the planned assessment data and report cover all areas of evaluation study
• A debrief power-point presentation to the British Council, detailing the evaluation framework, process and preliminary findings
• A debrief power point presentation to the British Council, detailing assessment results for international skills partnership projects
• A first draft of the final report submitted to the Skills Manager for review and feedback
• A final evaluation report including a self-assessment of the progress made so far, recommendations and an executive summary. The report should include a full list of references and annexes including the evaluation framework, programme of work, list of interviewees and participants, and any background information and supporting data including sources
• An accessible case studies summary report to be published and shared across project partners and stakeholders internationally.
• Facilitate a validation workshop of up to 100 people to discuss the final product and future interventions
The supplier will produce the following by the stated deadlines:
1. Evaluation tools, framework, including methodology and a draft outline of the report –4 October 2019
2. Commence field work for evaluation – 14 October 2019
3. Draft Evaluation report – 25 November 2019
4. Final Evaluation report – 13 December 2019
5. Workshop - 3 -7 February 2019