Follow-up ODA Evaluation Results
Actions in Response to Recommendations of Evaluations in FY2023
The following are the actions in response to the recommendations raised in the six ODA evaluations conducted in FY2023.
Evaluation of Japan’s ODA to the Kingdom of Thailand
Recommendation 1: Considering New Ways of Development Cooperation for Upper-Middle-Income Countries that will Become Emerging Donor Countries
Japan has provided support, via Thailand, to its neighboring countries in addressing their social issues, leveraging on the cooperative relations and experiences with Thailand so far. By doing so, it provides support to Thailand as an emerging donor country. In addition, Japan is considering collaborative efforts with the Thailand International Cooperation Agency (TICA) and Neighbouring Countries Economic Development Cooperation Agency (NEDA), as well as reviewing support that contributes to the capacity building of these organizations.
On the other hand, Japan continues to work toward resolving the issues which Thailand is facing as a newly industrializing country, such as declining birthrates and aging society, increasing the added value of its industries, and addressing disparities between the urban and rural regions. These experiences will be leveraged in providing support to neighboring countries, as well as in addressing Japan’s social issues through accepting the volunteers dispatched from Thailand, and other initiatives.
Recommendation 2: Improving the Public Relations Approach
The Ministry of Foreign Affairs, JICA, and the local ODA Task Force have been cooperating in conducting press tours for local media and publicizing through websites and social media (Facebook, video streaming, etc.). Further reviews will be conducted on how to effectively enhance Japan’s visibility through publicity.
Furthermore, in order to ensure effective publicity that generates widespread awareness and interest, Japan puts creative effort into the selection of information disseminators, such as by seeking cooperation from influencers and other individuals of high social standing. In cooperation with the local media, efforts will be made to carry out publicity not only in Japan, but also locally.
Recommendation 3: Improving Monitoring and Evaluation of Third Country Training Program
In light of the recommendations from the country evaluation, conducting a thematic evaluations on the training programs in third countries is currently under consideration with Thailand. Efforts will be made to disseminate information through these initiatives.
Recommendation 4: Direction of Future Development Cooperation to Thailand: Strengthening Support for Better Governance
From the viewpoint of contributing to support across the region, regardless of the income level of Thailand, Japan has continued with, and is reinforcing, training for public officials that contributes to strengthening governance.
Toward the realization of good governance not only in Thailand, but across the Mekong region, Japan is considering implementing collaborative projects in cooperation with Thailand and its neighboring countries. On the other hand, full consideration is given to the intentions of Thailand and its neighboring countries, and attention paid to ensuring that the cooperative relations are of equal partners.
Evaluation of Japan’s ODA to the People’s Republic of Bangladesh
Recommendation 1: Accelerate economic growth that benefits low-income groups and all citizens, by continuing to expand and improve the quality of economic infrastructure, and supporting the upgrading and diversification of industry and employment associated with economic growth.
We will consider including the strengthening of industrial bases (diversification and adding higher value), the enhancement of urban functions and environments, and the overcoming of social vulnerabilities, among other measures, into the priority areas of Japan’s Country Development Cooperation Policy for Bangladesh, with the intention of promoting the growth of the economy as a whole, in a manner that benefits low-income groups. As for support measures to contribute to these areas, we will implement steady support within each assistance program.
Recommendation 2: Spread the results of strengthening administrative capacity and systems at the central level throughout the country by strengthening commitment and ownership in central ministries and the foundation for local deployment (systems and budgetary allowances).
In providing support for boosting the administrative capabilities of local governments, including capacity building of the central government, effective support will be provided taking the recommendation into consideration, with a view to strengthening governance and enhancing the transparency and efficiency of administrative procedures.
Recommendation 3: Scrutinize and strengthen the monitoring of project activities in the direction of contributing to gender equality at the project-formulation stage so that the activities can more actively contribute to the reduction of gender disparities through the empowerment of women. In particular, strengthen women’s empowerment in employment and governance.
Gender mainstreaming, including efforts to address gender disparity, is promoted as a cross-sectoral initiative. Basically, consideration is given to incorporating the perspective of gender mainstreaming at all stages of a project (planning, implementation, monitoring and evaluation). In addition, the utilization of past cooperation assets and identification of projects that contribute to cross-sectoral issues will be actively promoted.
Recommendation 4: It is both meaningful and possible to introduce program-level evaluation. In the actual evaluation, it would also be effective to consider sector programs in which each donor participates rather than limiting the program’s scope to cooperation programs in Japan’s “Rolling Plan.” In the future, further methodology development is desirable; for example, by creating Theory of Change (ToC) for each sector at the program planning stage, confirming the position of each project in the sector, and establishing indicators.
MOFA’s ODA Evaluation Handbook will be revised to provide an example of program-level evaluation from this Evaluation of Japan’s ODA to Bangladesh. In the ODA evaluation to be conducted by MOFA in the future (third-party evaluations), program-level evaluation is also encouraged in cases where such evaluation is feasible and meaningful. To deepen understanding among stakeholders of Theory of Change (TOC), which was recommended as a program-level evaluation tool, effort is put into further developing evaluation methods through the review of educational materials, training, and other means.
Evaluation of Japan’s ODA to the Arab Republic of Egypt
Recommendation 1: Provide continuous support to areas of Japan’s comparative advantage
In addition to the cooperation provided thus far on the “hardware” side, such as the provision of equipment and facility construction, expanding cooperation in the “software” aspect will also be taken into consideration in the future, including involvement in operation, maintenance and management, institution building, and human resource development. Furthermore, newly emerged social values and solutions will be utilized in co-creation, and Japan will continue to pursue the cooperation that leverages its knowledge and strengths so as to produce sufficient development outcomes.
Specifically, (1) with regard to Japanese-style education, “Tokkatsu” activities would be enhanced in both the aspects of quantity and quality through support for the operational systems and human resource development on Egypt’s side, in order to further expand “Tokkatsu” in a sustainable manner in the Egypt-Japan School (EJS) and regular Egyptian schools; (2) support would be provided toward strengthening academic networks between Japan and Africa in the field of science and technology innovation, with a view to developing the Egypt-Japan University of Science and Technology (E-JUST), which was ranked among the highest in Egypt, into a Center of Excellence for science and technology in whole Africa; and, (3) even after the opening of the Grand Egyptian Museum (GEM), support would be provided toward the smooth and sustainable management of GEM as a cultural heritage and tourism hub through support in both management and academic/historic site restoration aspects. In addition, Japan would consider providing support that allows the accumulation of knowledge related to historic site restoration to be utilized in third countries.
Recommendation 2: Devise ways of disclosing information
We will make efforts to disseminate and publicize information in an easy-to-understand manner to the general public by utilizing MOFA’s and JICA’s ODA web pages and social media accounts while keeping in mind the interconnections between projects under multiple schemes, such as ODA loans, grant aid, and technical cooperation for Egypt. Japan continues to take advantage of opportunities such as the 70th anniversary of Japan-Egypt development cooperation (2024) and the expected opening of the Grand Egyptian Museum (GEM), to proactively publicize details of the wide range of Japan-Egypt development cooperation, alongside other information such as the benefits to the people of Egypt and Japan, and the positive reception Japan’s development cooperation has had from local communities.
Recommendation 3: Scrutinize debt sustainability to avoid fueling foreign currency shortages
In considering the provision of ODA loans and OOF (non-ODA government funding known as “Other Official Flows”), stringent reviews will be conducted within the Government of Japan (Ministry of Finance, Ministry of Economy, Trade and Industry, Ministry of Foreign Affairs), while taking into consideration Egypt’s macroeconomic outlook including IMF’s evaluation of Egypt’s debt sustainability, as well as information on Egypt’s domestic situation from the local embassy and JICA.
Recommendation 4: Create an environment for Japanese companies to enter the Egyptian market through all-Japan support, including Other Official Flows (OOF)
While continuing to utilize information from local Japanese companies, Egyptian government officials, international donors, and other stakeholders, we as all-Japan will consider how to provide support toward improving the business environment and systems that impede the expansion of Japanese companies into the country, as well as the approach to providing the support required for private-sector development.
Specifically, Japan will regularly engage in consultations with ministers, secretaries, and other senior officials from the Government of Egypt (General Authority for Investment and Free Zones and Ministry of Planning, Development and International Cooperation) going forward, while also involving the Embassy of Japan, JICA, Japan Bank for International Cooperation (JBIC), Nippon Export and Investment Insurance (NEXI), Japan External Trade Organization (JETRO) in Egypt, and the local Japan Business Association (JBA), and continue to promote initiatives to improve the investment environment. It will refine cooperation between the relevant Japanese organizations, strive to understand the needs of Japanese companies, utilize opportunities for financial cooperation such as ODA and OOF, and put creative effort into outreach initiatives to contribute to improving the investment environment for Japanese companies.
Recommendation 5: Enhance operational flexibility so that the STEP condition is easy to use for Japanese companies and their counterparts
Based on the objectives of the STEP for leveraging the excellent technologies and knowhow of Japanese companies, Japan will consider possible ways of further improving the system.
Evaluation of Japan’s ODA to Forcibly Displaced Persons and Host Countries
Recommendation 1: Clarifying the Humanitarian-Development-Peace (HDP) Nexus for Japan and providing more strategic support
When revising the “Humanitarian Aid Policy of Japan” in the future, the direction of Japan’s Humanitarian-Development-Peace (HDP) Nexus will be better clarified. Furthermore, when reviewing the national development cooperation policies of countries that accept large numbers of refugees, considerations are given to the possibility of including goals that incorporate the HDP Nexus, and to include them when it is deemed strategically desirable to do so. If the HDP Nexus is included in the revised national development cooperation policy, follow-up actions are taken to determine if there are projects in the Rolling Plan that incorporate the HDP Nexus, and at the same time, to engage with governments and organizations that are participating in the HDP Nexus Multistakeholder Pledge. Based on the above, Japan continues to undertake reviews toward contributing to international organizations that maintain a strong awareness of the HDP Nexus in their work.
Within JICA, the Office for Peacebuilding takes the lead in establishing HDP Nexus norms and formulating assistance strategies (for example, deepening and promotion of the KAERU model), strengthens dialogue with the relevant project departments and offices, and contributes to the development of project plans at the local site. At the headquarters level, effort is made to exchange opinions and share information regularly with MOFA’s Humanitarian Assistance and Emergency Relief Division; at the local level, revitalize the ODA Task Force in the respective countries, contribute to international organizations, and produce synergistic effects with JICA projects. With regard to peace (“P”), there are future plans to review measures for strategic project formation in refugees’ home countries and in refugees’ host countries through baseline surveys by JICA and other means.
Recommendation 2: Collaboration among diverse actors to strengthen the HDP nexus, and the development of a structure for such collaboration
As there are several overlapping divisions in MOFA and JICA Headquarters that handle refugees and the HDP Nexus, Japan facilitates cooperation between diverse actors and establishes systems for such cooperation, through the renewed recognition of the responsible parties among the stakeholders. In addition, one or two countries from Africa that accept a large number of refugees from third countries will be selected, and personnel be appointed to take charge of refugee-related cases in the overseas diplomatic mission and JICA office in these countries.
JICA dispatches, or plans to dispatch advisors to assist refugees and displaced persons and promote the Nexus in multiple countries to contribute to strengthening cooperation at the local level.
Recommendation 3: Timely and flexible operations of cooperation modalities
Japan continues to review the utilization of funds such as the United Nations’ Country-Based Pooled Funds (CBPF) and Central Emergency Response Fund (CERF), with a view to facilitating flexible contributions.
In providing assistance, etc. through NGOs, Japan continues to conduct reviews on the approach to system operation, based on recommendations related to the period and budget.
In JICA, examples that enable swift and effective assistance have been confirmed so far. These are achieved by utilizing various schemes for cooperative aspects that contribute to assisting refugees and displaced persons in existing cases. Japan continues to consider swift implementation methods.
Recommendation 4: Emphasis on livelihood support
From the perspective of the HDP Nexus, consideration is given to projects that support the livelihoods of refugees and contribute to strengthening their resilience. In addressing protracted refugee crises, supporting capacity building for refugees themselves and securing their livelihoods help to reduce the burden on the host countries, while at the same time, nurture human resources who contribute to the recovery of their home countries after they return. Therefore, JICA positions the provision of support for improving livelihoods as a highly important area of assistance. While JICA has been providing assistance to increase rice production through technology dissemination to rice farmers, the target beneficiaries including refugees, it plans to continue addressing it as a priority issue going forward.
Recommendation 5: Visualizing and publicizing Japan’s refugee assistance, especially assistance through international organizations
Efforts will be made to publicize Japan’s refugee assistance in cooperation with international organizations and Japanese NGOs, companies, and local governments that are providing assistance to refugees. JICA has produced pamphlets on refugee assistance through development (in both Japanese and English) and strives to raise awareness using such materials. It also works to boost opportunities for exchanges of opinions with private companies and NGOs.
Recommendation 6: Human resource development, appointment, and deployment related to refugee assistance and HDP nexus
When recruiting human resources for posts that are responsible for humanitarian assistance in JICA and MOFA, recruitment notices will be sent out widely to JICA, international organizations such as United Nations High Commissioner for Refugees (UNHCR) and NGOs. JICA, in cooperation with United Nations Volunteers (UNV), secures the quota for returnees of Japan Overseas Cooperation Volunteers (JOCV) in UNV. In recent years, it is strengthening efforts to dispatch personnel to fill posts related to assistance for refugees and displaced persons.
Recommendation 7: Continuing and strengthening refugee admissions in Japan
With regard to the number of refugees accepted through third-country resettlement in the future, as well as the approach to the acceptance system for refugees, reviews are conducted under the Liaison and Coordination Council for Refugee Issues. We will continue to provide attentive support through the Japanese Initiative for the future of Syrian Refugees (JISR).
Evaluation of “Japan’s Non-Project Grant Aid for Provision of Japanese Local Products for the Hashemite Kingdom of Jordan (FY2014)”
Recommendation 1: Conducting Handover Ceremony and Effective Publicity
With regard to the Economic and Social Development Programmes (formerly known as Non-Project Grant Aid) that will be implemented in future and for which multiple procurements will be carried out, it will be considered to explore the implementation of multiple handover ceremonies at each stage, for example, upon deliveries to the beneficiary organization or facility. In addition to issuing press releases to facilitate coverage by the local press after the completion of the handover ceremonies, efforts will be made to maximize the publicity effect by posting scenes from the ceremonies on the social media accounts of the embassy.
Recommendation 2: Preservation of Document Records
With regard to discussions with governments of the partner countries prior to the Exchange of Notes (E/N), there are no official records as no official documents are exchanged. For similar cases in the future, when significant changes arise in the contents of assistance, for example, efforts will be made to maintain records. The retention period of the said documents will also be reviewed, keeping in mind the implementation of ex-post evaluation. When following up on a project, efforts will be made to thoroughly record the embassy’s findings and lessons learned.
Evaluation of “Japan’s Grant Aid for the Economic and Social Development Programme for the Hashemite Kingdom of Jordan (FY2016)”
Recommendation 1: Support for Maintenance Costs
While paying attention to the points raised, we will encourage implementing organizations to establish a system, including securing operation and maintenance costs, in order to encourage partner countries to take ownership in similar projects in the future.
Recommendation 2: Review of Procurement Guidelines
Work is ongoing to update the Procurement Guidelines.