Development cooperation evaluation reports: Comprehensive evaluations

This independent evaluation assessed how Finland influences its multilateral partners and their operations in order to advance the international development agenda. The evaluation looked at the various influencing activities by the Ministry for Foreign Affairs of Finland and their effectiveness and relevance. Furthermore, the evaluation proposes ways for the Ministry to further develop these activities. The evaluation covered 23 multilateral partners of the Ministry, eight of which were assessed in more depth: The World Bank Group, UNFPA, UNICEF, WFP, UN Women, IFAD, FAO and ITC. The evaluation, started in June 2019, is based on a framework designed to decipher the multilateral influencing activities by the Ministry as well as the related results. The findings draw on an extensive document review and 174 interviews. The evaluation team also visited the headquarters of the multilateral organisations in New York, Rome and Washington DC as well as country missions to Nepal and Kenya.

Finland’s development cooperation with its long-term partner countries is planned and implemented under a Country Strategy approach, which in its present form was launched in 2012. The purpose of the country strategy evaluation launched in March 2019 was to assess the applicability and feasibility of the Country Strategy approach in fragile contexts, over the period 2012-current, given their specific challenges and requirements. The evaluation drew evidence from the experience of Country Strategies in four countries, namely Afghanistan, Myanmar, occupied Palestinian territory (oPt), Somalia and in one region, i.e. the Strategy for Development Cooperation and Humanitarian aid in response to the conflicts in Syria and Iraq was included, to draw wider findings and conclusions. Findings are expected to inform the next generation of Country Strategies.

Kehitysevaluoinnin vuosiraportissa tehdään yhteenvetoa evaluointien esiintuomista kehitysyhteistyön ja -politiikan vahvuuksista sekä kehittämiskohteista. Vuonna 2019 evaluointien teemat kietoutuivat tietojohtamisen ja kehittävän evaluoinnin ympärille. Ulkoministeriön tietoperustaista johtamista koskevan evaluoinnin lisäksi saatiin päätökseen kaksi yhteisevaluointia, ulkoministeriön ja Business Finlandin yhteisen Business with Impact (BEAM) -ohjelman kehittävä evaluointi sekä pohjoismaisessa yhteistyössä toteutettu Nordic Development Fund’in (NDF) evaluointi. Lisäksi yksikön evaluointien puitesopimuksen kautta tuettiin evaluoinnin toteuttamista maatalous-, maaseutukehitys- ja metsäsektorin kehityshankkeista (ARDF) Afrikan ja Lähi-idän osastolla sekä evaluointia Nepalin maaseudun vesivarojen hallinnointihankkeesta Aasian ja Amerikan osastolla. Koko ministeriön evaluointitoiminnan kehittämiseksi sekä evaluointien käytettävyyden ja hyödyllisyyden parantamiseksi Suomi käynnisti yhdessä Irlannin ja Sveitsin vertaisarvion toistensa evaluointitoiminnoista. Siitä ja yksikön muusta ajankohtaisesta kehittämistyöstä kerrotaan tarkemmin raportissa.

The developmental evaluation of the Business with Impact - BEAM programme started in September 2015 and has continued through the whole the programme, until the end of 2019. The purpose of the BEAM programme is to assist Finnish companies and other actors in using innovations to address global development challenges, by converting such innovations into successful and sustainable business, both in Finland and developing countries. The developmental evaluation approach supports the programme management throughout the programme period, provides immediate feedback on the effectiveness of different approaches, and promotes strategic learning within the programme.

This evaluation supports the Ministry for Foreign Affairs (MFA) in developing its management of results-related information and knowledge in order to strengthen evidence-informed learning and decision-making at all levels and in all channels of its development policy and cooperation. It explores management and decision-making processes from the learning perspective: How the MFA is able to collect, utilise, learn and inform decisions through documented and tacitly held results information and knowledge.

Kehitysevaluoinnin vuosiraportissa tehdään yhteenvetoa evaluointien esiintuomista kehitysyhteistyön ja -politiikan vahvuuksista sekä kehittämiskohteista. Viime vuonna toteutetut laajat evaluoinnit kohdistuivat mielenkiintoisiin ja ajankohtaisiin mutta samalla haastaviin kehityspolitiikan ja -yhteistyön kysymyksiin. Evaluointien aiheina olivat tyttöjen ja naisten oikeuksien edistäminen Suomen kehityspolitiikassa, pakolais- ja muuttoliikekysymykset sekä hanke- ja ohjelma-arviointien metaevaluointi. Lisäksi tehtiin evaluoitavuusselvitys ihmisoikeusperustaisuudesta ja jatkettiin ulkoministeriön ja Business Finlandin yhteistä Business with Impact (BEAM) -ohjelman kehittävää evaluointia.

The Development Evaluation Unit of the Ministry for Foreign Affairs (MFA) commissioned an evaluation on forced displacement and development policy. The purpose of the evaluation was to increase awareness and knowledge of the concept of forced displacement and the links between humanitarian assistance and development objectives, and help to integrate these concepts into the practices in the MFA. The evaluation looked at how coherently Finland’s development policy and its targets relating to forced displacement have been implemented and how the coherence could be enhanced in development policy and cooperation.

The purpose of this review was to assess the evaluability of Finland’s Human Rights Based Approach (HRBA) implementation and to inform the design of an upcoming evaluation on the implementa¬tion of a HRBA in Finland’s development policy and cooperation between 2012 and 2018. The Ministry for Foreign Affairs of Finland (MFA) commissioned the review.

The Government of Finland has had a longstanding commitment to promoting the rights and status of women and girls and supporting gender equality. In order to have knowledge and lessons on the results on the ground the Ministry for Foreign Affairs of Finland (MFA) decided to carry out an evaluation on women’s and girls’ rights and gender equality. The overarching purpose of the evaluation was to learn from good practices. The evaluation thus searched for gender changes and the mechanism contributing to these changes.

Meta-evaluation of project and programme evaluations in 2015-2017

Kehitysevaluoinnin vuosiraportti

Evaluation on Programme-base Support to Civil Society Organizations – Part 3

Developmental Evaluation of Business with Impact (BEAM) Programme

Evaluation on Programme-based Support through Finnish Civil Society Organizations – part 2

Impact evaluability assessment and meta-analysis of Finland’s support to women and girls and gender equality

Kehitysevaluoinnin vuosiraportti 2016

Meta-evaluation of Project and Programme Evaluations in 2014-2015

A study of the Private Sector Cooperation and Development Evaluation (in Finnish language)

Ulkoministeriö evaluoi kaikki ohjelmatukea saavat 22 järjestöä kolmessa osassa. Tässä ensimmäisessä eva­luoinnissa arvioitiin kuuden järjestön, Crisis Mana­gement Initiativen, Felmin, Reilu kaupan, Suomen pakolaisavun, Taksvärkin ja WWF Suomen kehitys-yhteistyöohjelmien onnistumista.

Finland’s Aid for Trade (AFT) projects in the past years have produced results and contributed to impact in specific sectors, in which Finland has competitive advantages and can bring added value, says just published evaluation report.

Evaluation of Finland’s Development Cooperation Country Strategies and Country Strategy Modality.

Tulosjohtamista pitää kehittää edelleen. Tasa-arvon edistäminen koulutuksen avulla on Suomen vahvuus. Kahdenvälinen yhteistyö on tarkoituksenmukaista ja tuottaa usein myös tuloksia – mutta tiedämmekö tarpeeksi pitkän aikavälin vaikutuksista? Nämä ovat juuri julkaistun kehitysevaluoinnin vuosiraportin 2015 keskeisiä viestejä.

Evaluation of Finland's humanitarian mine action. The first part is an analysis of documents covering Finland's humanitarian mine action in 1991–2009. The actual evaluation is presented in the second part. It deals with the support granted for humanitarian mine action in 2010–2015, and case studies of Cambodia and Angola.

The objective of the evaluation was to obtain independent and impartial information about how Finnish development cooperation has supported the rights of persons with disabilities especially in education. The evaluation also sought to find out how the rights of persons with disabilities and the human rights based approach (HRBA) have materialised in development cooperation in general.

The meta-evaluation assessed the quality of evaluation reports and their Terms of Reference (TORs), Finland’s development co-operation, and evaluation management and capacity development services of the Ministry for Foreign Affairs of Finland (MFA).

Kuluva vuosi 2015 on julistettu evaluoinnin kansainväliseksi teemavuodeksi. Evaluoinnin teemavuoden kunniaksi ulkoasiainministeriön kehitysevaluoinnin yksikkö (EVA-11) järjestää useita evaluointia ja erityisesti evaluointikulttuuria edistäviä tilaisuuksia. Samalla paneudumme evaluointitoimen kehittämiseen entistä systemaattisemmin osana kehityspolitiikan ja -yhteistyön kokonaisuutta.

Kenya is one of Finland’s long-term partner countries in development cooperation.The purpose of this evaluation is to analyse this relationship as it unfolded in 2007–2013, and to offer recommendations for its future in ways that reflect the evolution of Kenya’s and Finland’s development cooperation circumstances and policies. Findings and recommendations are based on extensive document review and interviews in both countries.

Evaluation: Finland’s Development Policy Programmes from a Results-Based Management Point of View 2003–2013. It finds that the Ministry for Foreign Affairs still lacks a comprehensive approach to Result-based Management (RBM) at the corporate level and that future policy implementation should be guided by a longterm strategic plan that is underpinned by a comprehensive Strategic Results Framework.

Meta-Evaluation of Decentralised Evaluations in 2010 and 2011.

Evaluointiraportti: Bi-Annual report 2009-2010 of Development Evaluation

Evaluation of Finland’s contribution to building inclusive peace in Nepal

A Finnish perspective on Nordic influence in multilateral organizations.

The evaluation assessed Finnish support to local governance and decentralisation. It examined the North-South Local Government Cooperation Programme (NSLGCP) of the Association of Regional and Local Authorities of Finland and 10 other programmes.

The objective of this evaluation is to assess how the Finnish Concessional Credit Scheme has contributed in 2002-2009 to poverty alleviation, achieved sustainable concrete results and also its shortcomings. Evaluation is based on project documentation; publically available documents; internal reviews and evaluations; interviews with select stakeholders and field visit to Vietnam.

The study explores links between Finnish development policy and cooperation programming with Tanzania since 2002. Key factors were identified with reference to 14 evaluation criteria.

The evaluation scores highly on most evaluation criteria, but requires a review to identify ways to address climate change adaptation in a participatory and effective way.

Finland är en av de viktiga leverantörerna av JPOs till multilaterala organisationer och den största bland de nordiska bidragsgivarna. Programmet administreras produktivt och relativt effektivt, men den långsiktiga påverkan är mindre. Som redskap för att skapa erfarna utvecklingsutövare är programmet väldigt effektivt.

This policy brief is based on an evaluation of Finland’s development cooperation with Nepal, Nicaragua and Tanzania over the last decade.

The subject of the evaluation is the training given by the Finnish Institute for Verification of the Chemical Weapons Convention (VERIFIN) in promotion of the Chemical Weapons Convention.

Vuonna 2005 hyväksytty Pariisin julistus avun tuloksellisuudesta on merkittävä kansainvälinen sopimus ja uudistusohjelma – siihen huipentuvat usean vuosikymmenen yritykset parantaa avun laatua ja sen vaikutuksia kehitykseen. Tämä raportti on riippumaton kokonaisvaltainen evaluaatio näistä pyrkimyksistä parantaa kansainvälisen avun tuloksellisuutta, ennen kaikkea vuodesta 2005 alkaen.

This evaluation looks at the implementation of a results-based approach in Finland’s development cooperation. Results-based management uses performance information for improved decision-making. Although widely referred to in the documents of the Ministry for Foreign Affairs of Finland (MFA), there is no formal policy and strategy for working in this way.