How effective is the UN’s development support?
Max-Otto Baumann
This blog post presents insights from my ongoing research on the UN’s development work at the country level. It is based on a review of 28 UN country program evaluations of four individual entities (UNDP, UNICEF, UNFPA, UN Women).
Halfway into the 2030 Agenda, with progress on several Sustainable Development Goals (SDG) stalling, is a good moment to ask about the effectiveness of the UN’s development support. With an annual spending of approximately USD20 billion, the UN’s development arm can, if effective, be an important tool for member states to mitigate global challenges around equality, conflict, and planetary boundaries.
Yet, the UN’s organisational performance for development effectiveness has received comparably little attention.
The 2018 reform of the UN’s development system has focused on system-wide coherence, but not on the performance of individual entities.
This blog post presents insights from my ongoing research on the UN’s development work at the country level. It is based on a review of 28 UN country program evaluations of four individual entities (UNDP, UNICEF, UNFPA, UN Women). The selection of evaluations was broadly matched to where the UN allocates its development resources: the evaluations cover all five regions, but with a focus on Africa and UNDP.
An alternative to glossy and often quantified self-reporting, these evaluations offer relatively raw and direct, though perhaps incomplete, glimpses of the UN’s organisational performance for effectiveness.
One particular noteworthy take-away is the indispensable normative role UN entities play at the country level. Around the world, UN field offices help initiate and shape hundreds of national laws, budgets and agendas every year. Without that, national legislation on SDG-relevant issues would probably be much less aligned with global normative frameworks.
Generally speaking, the evaluations convey an image of the UN being most effective when it works coherently across sectors, applies long-term perspectives, brings together relevant stakeholders, provides a platform for civil society, and speaks directly to governments based on evidence.
However, the reality appears to be often far from this ideal.
The most common and arguably worrisome deficit found in my analysis is that UN development work lacks an orientation towards sustainability and effects at national level – the kind of change that moves the needle on SDG progress.
A UNDP evaluation, for instance, notes that “only 50 percent of project documents addressed scale-up or replication approaches for innovative projects, and many through a generic paragraph”. Field offices often operate without sound theories of change that causally link support activities to national effects, and which can serve as a tool to monitor progress and engage host governments on larger issues.
Instead, field offices often pursue a multitude of small-scale work that does not add up to sustainable effects. As a finding from a UN Women evaluation notes: “Though these interventions were found successful, they are of a relatively small size and at best improve the lives of a few hundred to a few thousand women to some extent. Replication and scaling up have not been planned and large-scale replication of such pilots would be very expensive.”
Another recurrent theme is short-termism, which manifests itself in a focus on achieving quick and tangible results where a more comprehensive, long-term approach is needed. Such activities are typically driven by opportunities (donor funding, government demands). Short-termism and poor theories of change go hand in hand with a lack of integrated approaches, another frequently mentioned deficit.
This also affects the approach to partnerships. UN field offices’ partnerships were criticised in some evaluations for being driven by resource interests (who can contribute resources? who can spend them appropriately?) rather than by a consideration of the key stakeholders that need to be involved in reform coalitions.
Knowledge management constitutes another deficit. While UNDP emphasises its “thought leadership”, and while UN field offices do publish a lot on selected issues, the internal management and utilisation of knowledge is often criticised for being severely underdeveloped or entirely absent, as interventions end without lessons learned on what’s working, or for high-level policy advice.
Lastly, evaluations point out that monitoring tends to focus on activities rather than effects, which leaves field offices unable to adjust approaches. As an example, a field office will probably know how many people participated in a training, but not whether and to what extent the training achieved its purpose.
The common denominator of these deficits is “projectitis”, an organisational style characterised by decentralised, ad-hoc responses that are insufficiently integrated with, or informed by, the policies, purposes and overarching responsibilities of the organisation.
It is noteworthy that these deficits were found most frequently in UNDP evaluations. However, UNDP’s evaluations also stand out for the analytical rigour and critical attitude applied. Evaluations from the other three UN entities, and in particular UNFPA, often do little more than recount activities, oblivious to questions of sustainable effect. This inconsistent quality of evaluation raises a question as to the importance given to evaluations, or effectiveness for that matter, by UN entities and member states who govern them.
So, how can effectiveness become top priority?
Some humility is in order when judging the efforts of practitioners to promote sustainable development.
Development support is a notoriously difficult thing, everywhere. Yet, some UN-specific factors that appear to hinder organisational performance for effectiveness can be pointed out.
First, the principle of strict demand orientation as set by the UN General Assembly contributes to making UN entities responsive to host governments, but not responsible with regard to mandates and mission.
Second, the donor practice of earmarked funding has a similar effect of turning UN entities into service providers, maximised for efficiency, rather than being globally inspired agents for change.
Last but not least, UN entities, competing for resources, have themselves been too willing to embrace short-termism and “projectitis”, arguing that more resources equals more effects. Better institutional safeguards against opportunistic behaviour are needed. Rather than the size and growth of the budget, performance towards mandates and effects should distinguish a UN entity.
The following country program evaluations were analysed for this review – UNDP: Armenia 2019, Botswana 2020, Guatemala 2018, Madagascar 2018, Namibia 2016, Nigeria 2021, Pakistan 2016, South Sudan 2021, Timor-Leste 2018, Vietnam 2020; UN Women: Albania 2021, Brazil 2021, Cambodia 2021, Cameroon 2017, Palestine 2017, Tanzania 2017; UNFPA: Caribbean 2021, Libya 2022, Kyrgyzstan 2016, Malawi 2018, Liberia 2017, Philippines 2018; UNICEF: Angola 2018, Ethiopia 2019, Jamaica 2019, Lebanon 2017, Philippines 2017, Serbia 2019.
Max-Otto Baumann is a political scientist and researcher at the German Institute of Development and Sustainability (IDOS).
You must be logged in to post a comment.