Annual Report on Japanʼs ODA Evaluation 2020

Summary of the FY 2019 MOFA ODA Evaluations

Evaluation of Grant Assistance for Japanese NGO Projects (Summary)

Note: This summary was made by the ODA Evaluation Division base d on the r eport provided by the evaluation team.
The full text is available here:
new window

Evaluators
(Evaluation Team)
Chief Evaluator Ryokichi Hirono
Professor Emeritus, Seikei University
Advisor Takashi Shimosawa
Professor, Shizuoka University of Art and Culture
Consultant International Development Center of Japan Inc.
Target Period FY 2016–FY 2018 in principle (FY 2010–FY 2018 for statistical analysis)
Evaluation Period Jul. 2019–Mar. 2020
Field Survey Country The Lao People's Democratic Republic and the Republic of the Union of Myanmar
A photo of a submersible bridge constructed through GANP

A submersible bridge constructed through Grant Assistance for Japanese NGO Projects (GANP). The construction technology was transferred from a Japanese NGO to local people during the project. (The picture depicts beneficiaries using the bridge.)

Background, Objectives and Scope of the Evaluation

As the Development Cooperation Charter clearly stipulates that partnerships with NGOs and civil society organizations should be strategically strengthened, partnerships with NGOs are becoming increasingly important. GANP serves as a core scheme that promotes partnerships between the Government and Japanese NGOs. The purpose of this evaluation study is to conduct a comprehensive review, evaluate the GANP from development and diplomatic viewpoints, and provide recommendations for future improvements.

Brief Summary of Evaluation Results

● Development Viewpoints

(1) Relevance of Policies

The content and direction of GANP are highly consistent with Japan's high-level ODA policies, such as the Development Cooperation Charter and the National Security Strategy, as well as with the needs of the partner countries and various international trends and global challenges, such as the Sustainable Development Goals (SDGs). They are also highly consistent with the organizational strategies and needs of NGOs that use GANP. Furthermore, since funds are provided for economic and social development projects conducted by Japanese NGOs in developing countries and regions with due respect given to the autonomy of the NGOs, it is highly appropriate for the Government of Japan to provide assistance through NGOs. (Rating: Highly Satisfactory A)

(2) Effectiveness of Results

The individual projects funded by GANP were found to have generally demonstrated a high degree of effectiveness in contributing to the priority issues and goals initially set in GANP and in producing an impact. While individual projects were thus found to have produced results to a certain degree, the contributions that they made to the relevant developing country or region as a whole were limited due to differences in the partner country's NGO acceptance policy as well as the limited number of projects funded by GANP and the budget scale of the entire GANP. (Rating: Satisfactory B)

(3) Appropriateness of Processes

The projects funded by GANP are appropriately implemented in accordance with the "GANP Application Procedure." However, given the increase in the workload at MOFA and Japan's overseas establishments as the overall amount of the budgets and the number of projects funded by GANP have increased, more efficient and standardized operations need to be applied in order to continue to implement high-quality projects under the current implementation structure. In terms of the disclosure and dissemination of information, both the NGOs and MOFA are carrying out their roles appropriately. (Rating: Satisfactory B)

Note: Ratings: Highly Satisfactory A / Satisfactory B / Partially Unsatisfactory C / Unsatisfactory D

● Diplomatic Viewpoints

(1) Diplomatic Importance

GANP as a program is of great importance to Japan's national interests. It is also highly important in various aspects that include contributing to global challenges and priorities faced by the international community and regions.

(2) Diplomatic Impact

The diplomatic impacts are limited. While projects funded by GANP contribute indirectly and over the long-term to the improvement of pro-Japan sentiment at the field level, they make only a limited contribution to Japan's economic activities and business expansion. The NGOs themselves are not necessarily aware of the diplomatic importance and impact of their activities.

Recommendations

(1) Recommendations at the Policy and Strategy Level

(1)-1 Continuous Increases in the Overall Budget for GANP and Number of Projects Funded by GANP

While GANP has generally demonstrated a high degree of effectiveness, one of its upcoming challenges is to produce results not just for individual projects, but also in a broader context. The overall budget for GANP and the number of projects funded by GANP should be further increased in order to facilitate larger developmental effects in a broader context.

(1)-2 Strengthening Strategic Thinking as a Program

While operations of GANP that respect the autonomy of NGOs and their unique values are highly commended, GANP tends to fund projects comprehensively rather than strategically. Therefore, strategies that clearly stipulate the direction of and priority issues in GANP should be documented.

(1)-3 Two-tiered Operations of GANP

Given the increased operational workloads caused by the increase in the overall budget amount and the number of projects funded by GANP, two-tiered operations should be considered. While project applications submitted by NGOs that use GANP for the first time should continue to be accepted as part of its flexible operations, the establishment of another mechanism that allows a bigger budget size for experienced NGOs that can contribute to pursuing the diplomatic policy should be considered.

(2) Recommendations at the Project Implementation Level

(2)-1 Standardization of Operations of GANP Funded Projects by Sharing Manuals

As part of efforts to reduce inconsistent responses and advice by staff members in charge of GANP at overseas establishments in relation to NGOs that apply for and/or implement GANP projects as well as to improve the operational efficiency of GANP, operation manuals on GANP and annual screening policies for GANP projects should be shared among MOFA and overseas establishments.

(2)-2 Streamlining Operations of GANP by Simplifying Procedures

Given the increased operational workloads caused by the increase in the overall budget amount and the number of projects funded by GANP, measures such as introducing multi-year contracts, simplifying the modification procedures for project plans, and outsourcing part of the operations should be considered. Analysis of any hindering and/or promoting factors of the projects should also be considered by reviewing various past reports on the GANP projects, so that the analytical findings can be utilized for prior consultations and the project screening process.

(3) Recommendations for NGOs

(3)-1 Role of "Japanese Ambassadors" to Convey Japan's ODA Philosophy and of "Social Change Agents" to Catalyze Social Change

NGOs that use GANP are expected to play the role of "Japanese Ambassadors" who convey Japan's development cooperation philosophy to local communities, while also playing the role of "Social Change Agents" who catalyze social change. NGOs should be aware of these roles and engage in activities other than GANP projects, including interactions with NGOs from other countries working in the field.

(3)-2 Self-sustaining Development Strategies

NGOs that use GANP are encouraged to develop their own strategies to be more independent entities that are not reliant on GANP as public funds, while strengthening organizational structures and fostering human resources through the use of GANP.

(3)-3 Intellectual Contributions to Global NGOs through Demonstration Experiments

In order to produce broader effects through GANP, efforts should be made to implement innovative initiatives (innovations) and to verify whether such innovations have produced the desired effects (demonstrations), seeking collaborations with business communities and academics. It is expected that such demonstrations will provide intellectual contributions to NGOs around the world.