Annual Report on Japanʼs ODA Evaluation 2018

Summary of FY2017 MOFA’s ODA Evaluation

Evaluation of Japan’s Official Development Assistance in the Economic and Social Infrastructure Sector in the Independent State of Samoa (Summary) (Partner Country-led Evaluation)

Full text available here.
https://www.mofa.go.jp/policy/oda/evaluation/FY2017/pdfs/samoa.pdf new window

Evaluators
(Evaluation Team)
Ministry of Finance of Samoa
Ministry of Foreign Affairs and Trade of Samoa
KVA Consultants Limited
Evaluation Period January 20, 2018 to March 31, 2018
Evaluation Target Independent State of Samoa

Details of the Evaluation Study

1 Purpose of Evaluation

Evaluate Japan’s ODA towards economic and social infrastructure in Samoa, aiming to utilize e other donors’ ODA efficiently and effectively.

2 Target of Evaluation

The target covers four major economic and eight social infrastructure projects implemented from 2007 to 2017.

The 12 projects, power sector expansion project, environmental forest preservation project, reconstruction of Lufilufi Hospital, improvement of urban untreated water supply schemes, and others combine to represent 92% of Japan’s ODA provided to Samoa in the specified timeframe.

3 Methodology

The evaluation is conducted in line with the following three criteria based on the Guidelines for the Partner Country-led Evaluation June 2017 by Japan’s Ministry of Foreign Affairs.

• Relevance of Policies

• Effectiveness of Results

• Appropriateness of Processes

Comprehensive desk research and literature review of key documents, reports, statistics and data made available by the Embassy of Japan, Ministry of Finance and e-research was undertaken. In addition, the preliminary findings of the desk research and literature review formed the basis of the consultations and online survey circulated to stakeholders.

Evaluation Results

1 Relevance of Policies

The relevance of policies concerning Japan’s ODA is high. All of the targeted projects implemented from 2007 to 2017 are consistent with the framework of Samoa national plan based on the Strategy for Development of Samoa and sector plan and Japan’s Development Cooperation Charter, including the priority fields stated at PALM 5, PALM 6, and PALM 7. With climate change becoming a priority area of Japan’s ODA based on the PALM Action Plan, Samoa should be able to utilize the national planning mechanism established recently in order to promote future assistance from Japan.

2 Effectiveness of Results

The effectiveness of results is high. The formation process for appropriate projects made it possible for country to achieve its national and sector-specific targets. A majority of the target projects contributed to the alleviation of delays in significant economic and social infrastructure in Samoa. Japan’s ODA flows into Samoa are large disbursements, as evidenced by the Power Sector Expansion Project (PSEP) spanning multiple sectors.

3 Appropriateness of Processes

The process to form projects was efficient. Significant improvements were observed in the public expenditure management system that moves the flow of development funds in infrastructure development. However, there is also a problem of a growing funding gap between important infrastructure sectors.

Recommendations

1 Relevance of Policies

• Strengthen of a formal planning/policy framework for establishing national development priority projects.

• Create a management plan and utilize existing systems for mobilizing resources to prioritizing climate change.

2 Effectiveness of Results

• The following matters should be considered to address the training needs across all sectors through public ministries and agencies including Samoa’s Ministry of Works Transport and Infrastructure and the Ministry of Finance.
- Encourage partnerships with key educational institutions offering certificates/degrees relevant to the sector;
- Provide increased training in critical areas such as project management and analysis, monitoring and evaluation, data management to public sector staff;
- Undertake re-orientation of work processes, instruments, procedures and systems development;
- Put in place staffing and institutional arrangements for coordination and management between sectors; and
- Focus on ICT training to match the significant shift of infrastructure to a digital-based economy.

3 Appropriateness of Processes

• Increase innovative financing mechanisms to fill the funding gap within the economic and social infrastructure sectors. Promote fiscal management that draws on improved additionality of resources from co-financing and securing highly competitive concessionary loan financing.

• Enhance joint coordination monitoring frameworks through the use of existing tools such as the Joint Policy Action Matrix (JPAM), which coordinates assistance from other countries and was developed jointly by major donors and countries including the Government of Samoa, Asian Development Bank, and World Bank, to ensure joint monitoring by all relevant agencies. Regular communication and sharing of 5-year rolling plans between Japan’s MOFA and Samoa’s MOFT will also strengthen information management for future issues. The combined impact of these measures will result in closer alignment with expected project results and achieve Samoa’s national development targets.