What is ODA evaluation?
Japan conducts development cooperation for developing countries, using Official Development Assistance (ODA) in order to contribute to the peace, security and prosperity of the international community.
ODA evaluation is a systematic assessment of implementation and effects of ODA.
ODA evaluation has two objectives: to improve ODA management and to strengthen public accountability. MOFA aims to enhance efficiency and effectiveness of ODA by investigating its implementation and effects and to gain public understanding and support by disseminating the evaluation results and enhancing transparency.
Structure of the Implementation Process
The Ministry of Foreign Affairs (MOFA) is responsible for planning and formulating ODA policies, while the Japan International Cooperation Agency (JICA) is responsible for implementing individual projects. MOFA and JICA collaborate on ODA evaluation by dividing their roles.
Japan has steadily conducted ODA evaluation since 1975, prior to the implementation of the Government Policy Evaluations Act (GPEA) in 2002. Japan has developed an evaluation framework in collaboration with other international ODA institutions, including the Development Assistance Committee of the Organization for Economic Co-operation and Development (OECD-DAC).
MOFA mainly evaluates ODA policy, commissioning to third-parties, e.g., external experts and/or consultants from the private sector, meanwhile JICA mainly evaluates individual projects.
MOFA also implements evaluation aiming for evaluation capacity development in developing countries.
This annual report presents mainly MOFA’s ODA evaluations except evaluations based on the GPEA.
Utilization of ODA Evaluation Results
It is important that evaluation results and recommendations obtained from ODA evaluations are utilized by MOFA and JICA. They must be reflected in future policy making and project implementation.
Stakeholders in MOFA and JICA receive evaluation results and recommendations from evaluators and propose response action plans. One year later MOFA checks the implementing status of the response actions and publicizes the results in MOFA’s ODA annual reports. Through this process, MOFA aims to improve ODA management and promote public accountability.
Evaluation Targets
MOFA’s ODA evaluation can be classified according to the focus of evaluation. In Country Assistance Evaluation, development cooperation policy for a specific developing country such as Vietnam, India, Tanzania, etc. is evaluated. In Thematic Evaluation, a specific theme such as education, health, environment, etc. is evaluated. In Aid Modality Evaluation, a specific modality such as technical cooperation, grant aid, etc. is evaluated.
Furthermore, since FY 2017, MOFA has been evaluating individual development cooperation projects implemented by MOFA.
Evaluation Viewpoints / Evaluation Criteria
MOFA’s ODA Evaluation Criteria (third-party evaluations) under Development and Diplomatic Viewpoints are as follows:
1 Evaluation from Development Viewpoints
Through ODA evaluation, MOFA examines the extent of contribution to the development in recipient countries (Development Viewpoints) and the impacts on Japan’s national interests (Diplomatic Viewpoints) achieved by Japan’s ODA.
MOFA has set the following criteria suitable for evaluating Japan’s overall ODA policy based on the OECD/DAC’s five evaluation criteria recognized internationally (relevance, effectiveness, efficiency, impact, sustainability). Under each criteria, recommended evaluation questions are provided.
Relevance of Policy
How relevant is the ODA policy to Japan’s high level policy, a partner country’s need, and international priority issues? How outstanding is Japan’s ODA among other donors?
Effectiveness of Results
What results has the ODA produced? What levels of effect and impact has it shown?
Appropriateness of Processes
How appropriate was the policy making and implementing process? Was effective donor coordination undertaken?
2 Evaluation from Diplomatic Viewpoints
Diplomatic Importance
How is Japan’s ODA important in international efforts to solve global priority issues and for Japan’s peace and prosperity and for bilateral relations?
Diplomatic Impact
How has Japan’s ODA contributed to Japan’s presence in international society, its peace and prosperity? How has Japan’s ODA enhanced bilateral relations with a partner country?