Call For Consultancy – End Of Project Evaluation Of The Inclusive Markets for Energy Efficiency in Uganda (IMEU) Project
Location | Kampala, Uganda |
Date Posted | November 15, 2024 |
Category |
Consultancy
NGO |
Job Type |
Contract
|
Currency | UGX |
Description
Background to The Inclusive Markets for Energy Efficiency in Uganda (IMEU) project
The Inclusive Markets for Energy Efficiency in Uganda (IMEU) is a four-year project funded by the Embassy of Sweden (EoS) in Kampala, Uganda. IMEU is implemented by a consortium of 3 partners: SNV (lead), Makerere University, College of Engineering, Design, Art, and Technology (CEDAT), and Private Sector Foundation Uganda (PSFU).
The project deploys an Energy Efficient (EE) market development approach intervening at demand, supply and enabling environment for EE market as follows:
(1) Stimulating uptake of EE products and services by increasing awareness among energy users (Demand side)
(2) Targeted and contextualized derisking support to small medium enterprises (SMEs) and energy service companies (ESCOs) and Energy Service Provider Companies (ESPC) (Supply side).
(3) Strengthening institutional coordination, research and enabling environment for energy efficiency (Enabling environment).
The thematic scope of the project is agriculture (focus on agribusinesses and farmers cooperatives) and built environment (focus on households, businesses, and institutions). The project results framework and TOC is described here.
Rationale and Purpose of the Evaluation
Following its nearly three and a half years of inception and implementation (November 2021 – April 2025), IMEU will be phasing out its activities by June 2025, the five months following from July 2025 to Nov 2025 have been reserved for reporting and final closure of project. The project is now commissioning an evaluation to verify the project’s impacts/outcomes and derive the key lessons learned. A focused set of OECD/DAC criteria shall be used as the guidelines for the project final evaluation to look at the project’s relevance, efficiency, effectiveness, coherence, impact, and potential for sustainable scalability. Lessons learnt from the project will inform project partners and the donor EoS on how to integrate IMEU learnings into other ongoing or planned programs. The primary audience of this evaluation will be IMEU project consortium partners, the EoS, MEMD, as well as other relevant development partners and programs.
The project is therefore seeking an external team of evaluators or a firm to undertake the end of project evaluation to ensure an objective assessment of the project performance. Ideally, the consultancy team should demonstrate a proven track record of evaluating similar projects.
The end of project evaluation aims to achieve the following objectives:
Objective 1: Assess the project’s relevance to the needs and priorities of the project’s target groups and grantees, efficiency and effectiveness in achieving project outcomes, coherence with other relevant initiatives, intended and unintended impact of the project, and potential for sustainable scalability.
Objective 2: Draw lessons, best practices, and recommendations to inform potential future programming, local partners, and other project stakeholders.
The evaluation will utilize the Baseline, annual reports, and other relevant project documents as secondary data
Scope of the evaluation.
The project interventions are in agriculture and built environment. In agriculture, the project intervenes four value chains (Maize, Tea, Sunflower and soybean), specifically processors in the said value chains. In the built environment, the project targets businesses e.g. hotels, restaurants, and social institutions like schools, and hospitals. Over the project life, the project targets 328 businesses, 52 social institutions, 13 Energy service provider companies and 30,000 households using EE technologies and services. A detailed project results framework and TOC is described here.
In terms of geographical scope, the project intervenes in three regions i.e. Western, Northern and central. In the western region, it covers Fort Portal Tourism City, Kabarole, Kanungu, Buhweju and Bushenyi districts. In Central, the project covers Kampala metropolitan (Kampala Capital City, Mukono and Wakiso) and in the North covers Lira City, Dokolo, Oyam, Dokolo, Kole and Lira Districts.
Evaluation questions
The final evaluation questions are framed based on the OECD evaluation criteria to address object 1 above. The consultant is expected to demonstrate how the evaluation criteria and questions support learning through generating and feeding back findings and lessons learned. Below are the proposed evaluation questions, which can be reviewed/adjusted by the consultant(s) in the proposal. At the inception phase, the evaluation sub questions will be refined and agreed upon by both the consultant and the client (SNV)
Relevance: To what extent did the project’s objectives, TOC and intervention strategies address the needs and priorities of the project’s primary target group (Businesses, Social institutions and Households)?
Coherence: To what extent was the project internally and externally coherent? For example, internally coherent with other SNV projects/interventions in energy, agri-food and water? Externally coherent with other actors’ interventions in the energy sector, looking at complementarity, coordination and possible duplication?
Effectiveness: To what extent has the intervention achieved, or is expected to achieve, its objectives, and its results, including any differential results across groups? How effective have the project strategies and approaches been in achieving the expected results?
Relevance - “The extent to which the objectives of a development intervention are consistent with beneficiaries’ requirement, country needs, global priorities and partners’ and donors’ policies”.
Coherence – “The compatibility of the intervention with other interventions in a country, sector or institution”
Effectiveness - “The extent to which the development intervention’s objectives were achieved, or are expected to be achieved, taking into account their relative importance”.
Sub-questions:
Which elements of the project strategies and approaches were more effective in contributing to the (unexpected) positive changes, and which less? Which strategies and approaches contributed to (unintended) negative changes? What could have worked better and how?
Which elements of the project strategies and approaches are most successful and appropriate to be scaled up, and why?
What key internal and external factors facilitated or hindered the project’s achievements compared to the expected targets?
4. Efficiency: To what extent did the intervention deliver, or is likely to deliver, results in an economic and timely way?
Sub-questions:
Did the project convert inputs (funds, expertise, linkages, time, etc.) into outputs, outcomes and impacts in the most cost-effective way possible, as compared to feasible alternatives in the context
Are the project budgets aligned with project activities taking into account adaptive management? What kind of adjustments or changes did management make to ensure achievement of targeted activities
Was the project implemented within the agreed project timeframe considering factor outside the project’s control?
5. Impact: To what extent has the intervention generated or is expected to generate significant positive or negative, intended or unintended, higher-level effects?
Sub-questions:
What are the key positive and negative (unexpected) changes experienced by the project target groups, and to what extent are these linked to the project interventions?
What are the social, environmental and economic effects of the intervention in the long-term and for the communities as a whole?
What are the indirect, secondary and potential consequences of the intervention?
6. Sustainability: How sustainable are the project results and achievements in the medium term?
Sub-questions:
To what extent will the project’s results and achievements sustain after the intervention has ended? What is the potential for further sustainable scale up?
Which project internal and external factors (might) affect (positively or negatively) the sustainability of the project achievements? What are the potential risks and trade-offs with adopting farmers?
How is the changing context on the targeted sectors especially in the tea value chain likely to affect the sustainability of the project interventions and/or impact?
The following strategies will be reviewed: Market Development Fund, Multi-stakeholder Platform, Applied Research, Capacity Building, Gender, Equality and youth involvement, and behaviour change communication.
Efficiency- “The extent to which the intervention delivers, or is likely to deliver, results in an economic and timely way”
Impact- “The extent to which the intervention has generated or is expected to generate significant positive or negative, intended or unintended, higher-level effects.”
Sustainability - “The continuation of benefits from a development intervention after major development assistance has been completed. Probability of long-term benefits. The resilience to risk of the net benefit flows over time
To meet objective 2 above, the evaluation shall answer the questions,
What lessons, and best practices can be drawn, and recommendation made to improve the future design and implementation of related or similar projects?
Sub questions: the evaluation will answer the following sub-questions
Lessons learned:
What key lessons have emerged that could help improve future project design and implementation?
How could these lessons be applied to enhance the impact and efficiency of similar projects?
Best Practices:
Which practices fostered strong collaboration among local partners and stakeholders?
How can these collaboration practices be sustained or improved in future projects?
Which best practices have proven successful and could be scaled or replicated in similar contexts?
What adjustments might be necessary to make these practices applicable in other regions or with other stakeholders?
Recommendations
How could the lessons and best practices identified contribute to the long-term sustainability of similar projects?
What strategies are recommended to ensure continuous improvement in future programming?
The consultancy team is expected to design and facilitate a final reflection workshop to disseminate, triangulate and reflect on the evaluation findings among all the main stakeholders.
EVALUATION APPROACH AND METHODS
The final project evaluation will adopt a mixed-methods approach, integrating both qualitative and quantitative data collected from primary and secondary source.
Primary data collection will prioritize participatory and inclusive processes, ensuring engagement with diverse stakeholders. This will encompass a cross-section of key actors, including Households, youth, female and male headed, grantees, policymakers, Development partners, LGs, Academia, Financial institutions, Agro-industries, businesses, social institutions and government MDAs
A carefully developed sampling strategy will guarantee representation from varied stakeholders, with particular attention to ensuring adequate inclusion of women and youth perspectives. Data collection and analysis will adhere to a gender and age-disaggregated framework, with additional segmentation by location where applicable.
In-depth analysis will be conducted on at least six participants in the RBF, evaluating their business models, inclusivity (including linkages with cooperatives and farmers), and future viability.
Secondary data will be drawn from comprehensive desk studies encompassing relevant project documents such as reports, monitoring and supervision reports, baseline data, IMEU impact stories and case studies, national datasets and relevant external reports where applicable.
Job Description
Expected Deliverables
Final approved inception report detailing the methodology, timelines and workplan, clear sampling framework and data collection and analysis plan.
Copies of pre-tested evaluation tools developed by the consultant
Recruitment, training, and supervision of data enumerators
Draft end of project evaluation report
Stakeholder validation workshop and meeting report for the study
Complete cleaned datasets (both qualitative and quantitative)
Final report with project indicators values, infographics summary of findings and PowerPoint presentation.
Develop an abridged version (No more than 5 pages) of the evaluation report that can be used for external dissemination
Roles and responsibilities
The consultant is expected to abide to the following:
Assignment Execution: Undertake the assignment as outlined in the ToR and complete the tasks within the allocated time.
Communication and Liaison: Update project stakeholders regularly on progress and liaise with the IMEU team for information sharing and meetings with other stakeholders.
Logistics: Arrange their own means of transport and accommodation. This includes coordinating travel to and from field sites, securing appropriate lodging, and ensuring that all logistical arrangements support the efficient and effective execution of the evaluation activities.
Data and Reporting: Hand over all datasets as part of the deliverables as all data collected and reports delivered under this assignment are property of IMEU. Ensure strict data protection measures are in place, including secure storage, handling, and transfer of all collected data, in compliance with applicable data protection laws and guidelines.
Code of Conduct: Sign and observe the SNV Code of Conduct/Safeguarding policy during the evaluation process. The consultant(s) must adhere to high standards of ethical behaviour, including honesty, integrity, and respect for all participants. They should avoid any conflicts of interest, maintain professional boundaries, and ensure that all interactions are conducted in a fair and impartial manner.
Confidentiality: Guarantee the confidentiality and anonymity of participants in the evaluation process.
Cost Management: Handle all costs associated with the evaluation process.
The roles and responsibilities of IMEU shall include.
Evaluation Oversight: Assess the evaluation bids, validate the proposed evaluation design, and provide necessary advice. Manage contractual oversight.
Information: Ensure the evaluation team has access to all necessary information, including project documents.
Access and Support: Facilitate the smooth realization of the evaluation by providing logistical advice, including recommendations on suitable accommodations or locations for training field teams. Assist with the mobilization of selected respondents and ensure local support during field missions. Facilitate liaison with key stakeholders, including implementing grantees, local governments, and MDAs. Organize the validation workshop(s) as specified in the timeline.
Feedback and Reporting: Discuss and comment on reports delivered by the consultant(s) at each stage, and assist in providing feedback on the findings, conclusions, and recommendations.
Qualifications
Required Qualifications, competencies, and experience
Team composition, qualifications, and experience
The team should be a multidisciplinary team with diverse expertise and experiences in the EE subsector, data analytics, market assessments, business development, gender-responsive programming and knowledge management.
The required person(s) should possess the following qualifications:
Team Leader: Advanced degree with at least 10 years’ experience in Business Management, Engineering, Statistics, Marketing, Agribusiness, or agricultural economics. At least possess a post-graduate training in Monitoring and Evaluation. S/he MUST have demonstrated skills and experience in undertaking qualitative and quantitative research methodologies as well as participatory research. In addition, the team leader should demonstrate international and national experiences in undertaking similar assignments.
Renewable Energy and Energy Efficiency Expert: Advanced degree with at least 5 years’ experience in renewable energy and energy efficiency project implementation. S/he should demonstrate an understanding of the Energy sector and energy efficiency subsector in Uganda and knowledge and skills of energy management in the agriculture and built environment sectors.
Monitoring, Evaluation and Learning Expert: Degree in project planning, monitoring and evaluation or equivalent. Demonstrated experience of at least 5 years in undertaking baselines, midline, and end line studies of project with excellent data analysis skills.
Financial/investment specialists: Advanced degree in business management, finance, and Investments with at least 5 years’ experience. Demonstrated experience in business development and investment appraisals.
Gender specialist: Degree in Gender studies or any related field with demonstrated experience in undertaking gender surveys and developing gender action plans. S/he should possess experience of at least 5 years’ experience in gender analysis studies.
Team competencies
In addition to the above expertise and experience, the proposed team should demonstrate the following competencies.
Strong research and analytical skills
Demonstrated oral and written communication skills
Demonstrated stakeholder engagement and facilitatory skills
Evidenced qualitative and quantitative data collection and analysis skills
Good understanding of operations of a market systems development approach
Ability to undertake studies in challenging environments
Must be digital and technological savvy
Additional Information
Reporting and Supervision.
The consultant shall be directly supervised by the Project Manager, IMEU and supported by the Monitoring, Evaluation and learning Advisor for quality assurance of the evaluation study. The MEL advisor shall be assigned for the day-to-day support to the consultant and updates of the assignment.
Requisite documentation for the consultant
Company Legal registration documents (Articles of Association and Powers of Attorney)
Tax Compliance Certificate
Valid trading license
Company profile
CVs of all the proposed staff for the assignment
List of References (with valid contacts) for earlier similar tasks undertaken
Schedule and timelines
The review will be conducted within 3 months (approx. 55 working days from signing of contract) broken down as follows:
Opening Tender, proposal review and selection of the consultant (15th Dec to 6th Jan 2025). This stage entails preparatory activities for the evaluation that are undertaken by the contracting agency in this case SNV. The activities of this phase include drafting of the ToR, Approval and publication of the ToR, selection and contracting of successful consultant.
Inception Phase (7th to 21st January 2025) (14 days) - The inception phase will result in an inception report. The inception report should clearly outline the evaluation design, operationalize the evaluation questions and indicators to be used, further detail the data collection methods as well as propose a detailed time schedule. The inception report is subject of formal approval by the project PM.
Execution Phase (22nd January to 16th February 2025) (25 days) – This phase entails the execution of the evaluation plan as detailed in the Inception report. Desk research and fieldwork will provide in-depth insight in the activities of IMEU, as well as on the results achieved. Fieldwork will be carried out following the evaluation plan as presented in the inception report. In this phase the consultant will also be expected to conduct data analysis, interpretation and compile a draft evaluation report (in MS Word) including findings, conclusions and recommendations presented to the IMEU. We expect the team to follow the agreed upon timelines. Any significant change to the timeline needs approval of IMEU project manager.
Closure Phase (16th February to 2nd March) (15 days)– The key deliverable for this phase includes the final approved evaluation report. Other deliverables include participation in discussion of findings with IMEU team and other stakeholders (validation workshop), a PowerPoint with preliminary findings, a detailed final evaluation report considering all comments received from project stakeholders and complete and cleaned datasets.
Contracting and Proposed payment terms
The assignment is expected to be undertaken within 50 days. The contract shall be a fixed term with all the key activities and deliverables paid based on the value for money offering agreed during negotiation. The proposed payment terms are based on specific quality approved deliverables.
40% based on an approved inception report and study tools
40% based on an approved draft end of project evaluation report
20% based on an approved Final end of project evaluation report, PowerPoint presentation and infographics.
Evaluation Criteria
The procurement evaluation committee shall duly evaluate all technical and financial proposals as per submission deadline for the bids. This shall follow the overarching criteria below.
Aspect
1. Administrative
Compliance with legal registration and tax requirements
Weighting score - Pass/Fail
2. Technical
The technical assessment is based on understanding of TOR (20), Experience in conducting similar assignments and team competencies (20), Detailed and realistic workplan (10), Technical appropriateness and feasibility of the proposed methodology including detailed sampling procedures (30)
Weighting score - 80%
3. Financial
This is a cost-based assessment with a value for money focus
Weighting score - 20%
Applying Instructions
Application process.
Questions regarding the evaluation.
Interested parties are encouraged to submit their question via imeu@snv.org by the 25th of November 2024 and the answers will be shared with all parties by the 27th of November 2024.
Submission of proposals
Interested companies should send technical and financial proposals to SNV Netherlands Development Organization in soft copies via email: ugandatenders@snv.org. The subject should read: End of Project evaluation for IMEU project. The technical proposals should include CVs of the key personnel as well as list of similar tasks accomplished before.
Deadline for submissions
All the applications should be sent not later than 13th December 2024 at 5:00 pm. Any applications past the deadline shall not be received. Only successful applications shall be contacted.