The Role and Effectiveness of Development Assistance: Lessons from World Bank Experience

 

A Research Paper from the Development Economics Vice Presidency of the World Bank

This paper was prepared under the direction of Nicholas Stern, Chief Economist and Senior Vice President Development Economics (DEC); and Ian Goldin, Director of Development Policy. Halsey Rogers, a Senior Economist, was the lead author. Many other staff from across the Bank contributed. Sections 4 and 5 draw heavily on the experience of the Operations Evaluation Department; the interpretation of the material is the responsibility of DEC. The paper was presented at the United Nations International Conference Financing for Development held in Monterrey, Mexico, on March 18-22, 2002. It is available online at http://econ.worldbank.org/. Comments and questions may be sent to research@worldbank.org.

THE WORLD BANK
Washington, D.C.

 

Acronyms

AERC

African Economic Research Consortium

AIDS

Acquired Immune Deficiency Syndrome

CAE

Country Assistance Evaluations

CAS

Country Assistance Strategy

CDF

Comprehensive Development Framework

CGAP

Consultative Group to Assist the Poor

CGIAR

Consultative Group for International Agricultural Research

CIS

Commonwealth of Independent States

CPIA

Country Policy and Institutional Assessments

DGF

Development Grant Facility

EBRD

European Bank for Reconstruction and Development

ECA

Europe and Central Asia

EIB

European Investment Bank

ERR

Economic Rate of Return

EU

European Union

GDP

Gross Domestic Product

GNP

Gross National Product

HIAL

Higher Impact Adjustment Lending

HIPC

Heavily Indebted Poor Countries

IBRD

International Bank for Reconstruction and Development

IDA

International Development Association

IFC

International Finance Corporation

IFPRI

International Food Policy Research Institute

LICUS

Low Income Countries under Stress

MDG

Millennium Development Goals

MIGA

Multilateral Investment Guarantee Agency

NGO

Non-Governmental Organization

OCP

Onchocerciasis Control Program

ODA

Official Development Assistance

OECD

Organisation for Economic Co-operation and Development

OED

Operations Evaluation Department

OEG

Operations Evaluation Group

OEU

Operations Evaluation Unit

OPCS

Operations Policy and Country Services Unit

PRSP

Poverty Reduction Strategy Paper

QACU

Quality Assurance and Compliance Unit

QAG

Quality Assurance Group

SME

Small and Medium Enterprises

SSA

Sub-Saharan Africa

SSP

Sector Strategy Paper

STD

Sexually Transmitted Diseases

TB

Tuberculosis

TFP

Total Factor Productivity

UN

United Nations

UNDP

United Nations Development Program

WHO

World Health Organization

 

Executive Summary

Foreign aid is increasingly a catalyst for change, and is helping to create conditions in which poor people are able to raise their incomes and to live longer, healthier, and more productive lives. The past 50 years have seen remarkable successes, as well as failures, in development assistance. Better policies in developing countries, together with improved allocation of aid since the end of the Cold War, imply that aid is more effective today at reducing poverty than ever before.

Yet much of the developing world saw little progress over the past several decades, and in some places, such as parts of Sub-Saharan Africa, living standards declined. Moreover, huge challenges remain, such as reversing the Acquired Immune Deficiency Syndrome (AIDS) and malaria epidemics, and finding ways to spur growth and empower poor people in countries with weak institutions, governance, and policies. An estimated 1.2 billion people subsist on under $1 per day, and the majority of the developing world’s population lives on less than $2 per day. (Dollar amounts in this paper are U.S. unless otherwise noted.) Moreover, the world’s population will increase by 2 billion in the next 30 years, with almost all of the growth coming in developing countries. How effective the development community is in helping poor societies respond to these challenges will depend on continued learning and on improvements in the allocation, design, and delivery of foreign aid.

This study, The Role and Effectiveness of Development Assistance: Lessons from World Bank Experience, takes a broad view of the relationship between development experience and official development assistance (ODA) over the past 50 years, with particular emphasis on the World Bank’s experience in recent decades. This report finds that progress in improving well-being has been rapid, if uneven, and that--notwithstanding some significant shortcomings and failures--ODA has often helped to underpin and support success and is becoming more effective in doing so.

The complexity of social and economic change means that the impact of aid cannot be separated easily from other factors. Developing countries themselves bear most of the burdens of development, and rightly claim credit when development succeeds. Assistance works best and can only be sustained when the recipients are strongly committed to development and in charge of the process. In addition, successful projects that draw on foreign assistance in their early stages may later become self-sustaining and serve as models for replication elsewhere, but without any foreign involvement at all. For these and other reasons, the positive impact of ODA can be very large. Nevertheless, identifying cause and effect and attributing outcomes to particular actions is often difficult; furthermore, any excessive attempt to claim credit for the successes of foreign aid can devalue the idea and practice of partnership.

To tackle these analytical problems, this study draws on a variety of types of evidence. We first survey the rapid but uneven progress over the past 50 years and the sources of development success (Sections 1 and 2). Looking more closely at the role of aid, we then considers cross-country statistical analysis (Section 3) and various types of evidence on the impact of the project, program, and sector lending of the World Bank (Section 4). We conclude with a discussion of global initiatives. Country examples and insights from country case studies are included throughout the text. Overall, the study presents persuasive evidence that foreign assistance is an increasingly effective tool for reducing poverty and building a more inclusive world. It also recognizes that there are failures as well as successes, and that we can and should learn from both.

Rapid but uneven development progress

In recent decades, development progress has taken place at unprecedented rates, not only in advanced economies but also in the poorer regions and countries of the world:

Driving much (though not all) of this progress in income poverty has been an acceleration in economic growth rates in the developing world.

This progress on health, education, and income is not accidental. Governments, with the support of the development community and nongovernmental organizations (NGOs), have accelerated growth and poverty reduction by improving their policies, institutions, and governance, and through well-designed projects and programs.

These are just a few examples. More systematic evidence presented below and in greater detail in the full paper supports the case that good policies and external support have been the key to progress.

But progress has not been uniform.

Some regions and countries have grown very slowly or declined in recent decades.

The challenge is to extend to all regions and countries the progress that has already improved the well-being of so many people. To do so, the development community must learn from past failures, as well as understand the origins of the successes. Like aid recipients, who have often followed weak policies or allowed institutions to deteriorate, donors also have made mistakes that slowed development.

From these cases and others, donors have drawn lessons, and are now showing greater selectivity in lending, shifting resources toward governance and institutions, emphasizing ownership, and making room for diverse responses to local needs. These new approaches and procedures have begun to pay off. However, it is clear that there is still much to learn: for example, on the question of how best to catalyze and support reforms and institution-building in countries with very weak policies, institutions, and governance.

Understanding the sources of development outcomes

The development community has been learning about what development means and how to achieve it.

The understanding of development has evolved. It is now widely accepted that poverty reduction efforts should address poverty in all its dimensions--not only lack of income, but also the lack of health and education, vulnerability to shocks, and the lack of control over their lives that poor people suffer. This understanding of poverty in some cases implies different approaches than in the past--for example, an increased focus on public service delivery to vulnerable groups, as well as greater attention to early disclosure of information that poor people can use. This multidimensionality of poverty is embodied in the Millennium Development Goals (MDGs) adopted by heads of state at a United Nations summit in 2000.

Knowledge about what works and what does not work has also improved. Experience has shown that neither the central planning approach followed by many countries in the 1950s and 1960s, nor the minimal-government free-market approach advocated by many people in the 1980s and early 1990s, will achieve these goals. Most effective approaches to development will be led by the private sector, but with effective government to provide the governance framework, facilitation or provision of physical infrastructure, human capital investments, and social cohesion necessary for growth and poverty reduction. Institutional development has too often been neglected in past policy discussions, but is now recognized to be essential to sustained poverty reduction.

While a number of key principles for effective development are clear, there is no single road to follow. Countries must devise their own strategies and approaches, appropriate for their own country circumstances and goals.

We have improved our understanding of the main sources of growth and poverty reduction, although there is still much to learn.

Experience and analysis show that countries reduce poverty fastest when they put in place two pillars of development:

Understanding of economic growth and its causes has improved. We now understand that creating an investment climate that sustains growth requires progress in a number of areas: macroeconomic stability and trade openness; governance and institutions (including a good education system, an effective legal and judicial system, a professional bureaucracy, a strong and well-regulated financial sector, and vigorous competition); and adequate infrastructure.

This improved understanding does not mean that all growth challenges have been solved. One major issue is the appropriate sequencing and selection of policy and institutional reforms. No poor country has the capacity to move forward with equal vigor on all these fronts at once, so it will be important for the country, with external support, to focus on identifying and grappling with the main obstacles to growth. A second challenge is consistency: many countries manage to achieve growth spurts of several years, but find it very difficult to achieve the two or three decades of consistent growth necessary for sustained poverty reduction.

Poverty reduction depends heavily on sustained economic growth. On average across countries, income distribution does not worsen during periods of economic growth, so that on average the incomes of poor people rise at a similar rate to those of wealthier people. Countries that grew rapidly in the 1990s--such as China, India, Vietnam, and Uganda--managed to reduce the share of their people in absolute poverty by 5 to 8 percent per year.

While growth is essential, it is also important to recognize that these are just averages, and that there is a good deal of variation across countries, regions, and groups. Countries can accelerate their reduction of income poverty by acting to ensure that poor people have the tools necessary to participate in growth; in other words, they can promote pro-poor growth. Of special importance here are health and education, as they also have a direct impact by reducing poverty in key non-income dimensions. Other services that equip poor people to participate include infrastructure and financial services, which often fail to reach them. Furthermore, participation of poor people in the decisions that most affect their lives--for example, parental involvement in school management, or participation by beneficiaries in project design--is a key part of fostering the involvement of poor people in the growth process.

Policies and investments aimed directly at reducing non-income dimensions of poverty can be highly effective. Countries can accelerate health and education progress far beyond what would result simply from economic growth. Without targeted measures, economic growth only slowly improves health and education. On the other hand, progress on these dimensions can serve as a major stimulus to growth.

Globally, we see the powerful effects of policy in the dramatic reductions in infant mortality, which has fallen steadily at each level of income as a result of improvements in technology, knowledge, and policies and institutions. For example, the average country with $8,000 per capita income in 1950 (measured in 1995 dollars) would have had an infant mortality rate of 45 per 1,000 live births; by 1995, an average country at the same income level would have had an infant mortality rate of just 15 per 100 live births, a reduction of two-thirds.

Many countries have acted on advances in understanding and knowledge by improving policies and institutions, often with strong results.

The development progress that we have seen in many countries can be attributed primarily to actions by the countries themselves: specifically, improving the investment climate and investing in people.

Macroeconomic stability and openness have improved throughout the developing world over the past two decades. The median inflation rate of developing countries was cut in half between 1982 and 1997, from about 15 to 7 percent. Average tariff rates have also declined sharply in all developing regions. In South Asia, for example, the unweighted average tariff fell from about 65 percent in 1980-85 to about 30 percent in 1996-98; and in Latin America and the Caribbean, from about 30 percent to under 15 percent.

A group of countries that has integrated most quickly with the global economy--thanks to greater openness and improved investment climates--has grown very rapidly. This group that showed the strongest advances in trade integration, accounting for some 3 billion of the developing world’s 5 billion people, saw per-capita incomes increase by a remarkable 5 percent per year in the 1990s. Even with fast-growing China excluded, the average was 3.5 percent. By comparison, per-capita growth in the high-income economies was only 2 percent. Integration, it should be stressed, is not about applying a simplistic liberalization formula. Both China and India are part of this group because of their rapid trade growth and strong movement toward more open markets, even though their economies are not among the most open in the developing world in terms of import liberalization.

Complementary actions by rich countries are essential. One key area is in trade policy. Trade protection in the rich countries, particularly in agriculture and textiles, blocks the exports and undermines the competitiveness of many countries. Poor countries bear the brunt of this protection, as they face tariffs twice as high on average as those applied to the products of rich countries. Protection greatly reduces the growth rewards to reform in poor countries.

Yet too many countries have lagged and some have declined.

The economic decline in much of Sub-Saharan Africa stems in part from events beyond African countries’ control, including large and persistent declines in the prices of commodities that they export and high country risk perceptions that deter investment. But many African countries compounded the external problems by failing to promote good policies and institutions. Although policies have improved sharply in recent years, governance and institutions remain a major challenge in most of these countries.

Countries that have not grown rapidly--in Africa and elsewhere--have often failed to make progress on key features of the investment climate. For example, they may have achieved macroeconomic stability but not social stability; or they may have lowered trade barriers but not built the basic infrastructure necessary for international trade; some have done none of these things. As we have learned from experience, macroeconomic stabilization and liberalization are important steps, but they are not generally enough by themselves to promote lasting development.

Nevertheless, there are countries in which the rewards to reform have been far less than predicted. These countries have made many of the reforms advocated by external parties, but have either seen little growth response or have not seen growth translate into rapid poverty reduction. In some cases, geographic challenges have hindered growth; in other cases, a history of poor policies has led investors to doubt the permanence of recent improvements. In such cases, the development community should work to help sustain these reforms and increase their returns.

The role of development assistance: Country examples and cross-country evidence

Development assistance encompasses both financial and non-financial instruments that are aimed at supporting the recipient country’s efforts to accelerate growth and reduce poverty.

Resource transfer is an important part of development assistance, and the quantitative analysis in this section will focus largely on assessing its effects. But finance is only one of the instruments used to support development, and in some situations, it is not even the most useful one. Development assistance also includes analysis, advice, and capacity-building. Many of the country boxes in this paper highlight the importance of these nonlending tools, especially in situations--such as early in a reform era--when finance is not likely to contribute to poverty reduction. The mixture of instruments to be used in any particular country depends on the specifics of that country’s needs and capacity.

Attempts to assess the contributions of external assistance face inherent difficulties. Dealing with them requires the use of a variety of types of evidence.

Really successful development assistance will have effects that reverberate far beyond the confines of the project itself, either because the ideas in the project are replicated elsewhere, or because the intervention has helped institutionalize new approaches. Levels of development assistance are small relative to other financial flows and to the scale of the challenge at hand. Development aid totaled about $54 billion in 2000; this was only one-third as much as foreign direct investment in developing countries ($167 billion), which itself was only a small fraction of total investment (nearly $1.5 trillion). This underscores the point that when aid makes a major difference in the fight against poverty, it does so through demonstration effects or improvements in institutions, not simply through resource transfer.

Furthermore, successful development strategies and actions generally depend on strong country ownership, as well as good partnership among donors; both make it difficult, and even counterproductive, for any external actor to claim full credit for a reform or project. For these reasons, this paper makes use of several types of evidence--cross-country statistical analysis, program and project evaluations, case studies, and analyses of global programs--in trying to assess the role and effectiveness of development assistance.

Because each country is unique, the role of aid can be understood best through careful analysis of individual countries. In the body of this paper, detailed country examples are included in each section. In the interests of brevity, this executive summary presents some snapshots of aid in action at the country level before proceeding to the cross-country statistical analysis.

Uganda, Mozambique, China, Vietnam, India, and Poland are all examples of countries where, within the past two decades, policy and institutional reforms have sparked rapid development. In all cases, the country and its government have been the prime movers for reform. Development assistance from many sources supported these transformations. The examples below highlight the ways in which the World Bank assisted in reform and development, while recognizing that countries themselves are responsible for their achievements and that the Bank is only one among many development partners.

These six country provide recent examples of Bank-supported progress, but the past 50 years of development experience also provide examples--such as the Republic of Korea and Botswana--that illustrate how effective aid can be in supporting reform. Korea, for example, progressed from borrowing from the International Development Association (IDA), the Bank’s soft-loan facility for the poorest countries, to borrowing from the International Bank for Reconstruction and Development (IBRD), the lending arm for middle-income countries, and finally to borrowing solely in private markets. Korea is also an example of a country that, with donor support, built both pillars of development: it invested heavily in education and human development while also greatly improving the environment for growth and entrepreneurship.

It is important to note that impressive development results do not depend on reaching all goals simultaneously. Each of the countries listed here continues to face major development challenges, whether in governance or institution-building or capacity development. However, these examples show just how strong the returns can be to moving in the right direction, and how important it is to help countries that are committed to making this movement. Of course, the World Bank has also been involved in many countries, particularly in Sub-Saharan Africa, where results have been less impressive. Its role is to be a long-term partner, working consistently to support countries through challenging circumstances.

Cross-country statistical evidence confirms that the positive role of assistance extends well beyond these country-specific examples. Development assistance has, in general, accelerated growth and poverty reduction, and its poverty-reduction impact has increased over time.

The statistical evidence shows that large-scale financial aid can generally be used effectively for poverty reduction, where reasonably good policies are in place. The World Bank and other donors have acted on these findings by tailoring support to local needs and circumstances. Thus the balance of support has moved toward providing large-scale aid to those that can use it well, and focusing on knowledge and capacity-building support in other countries.

By this criterion, donor financial assistance is targeted far more effectively at poverty reduction than it was a decade ago. At that time, Cold War geopolitics was still exercising a heavy influence on aid allocations, and too many recipient economies were poorly run, often suffering from excessive state intervention in economic activity and poor governance.

As a result, the poverty-reduction effectiveness per dollar of overall ODA has grown rapidly.

Yet despite the improvement in aid effectiveness, donor countries did not respond with an increase in aid flows; instead, aid levels fell.

World Bank assistance is efficient at reducing poverty.

IDA funds are relatively well focused on poor countries that have shown they can use aid effectively.

As a result, an additional $1 billion allocated in the same way as existing IDA funds in 1997-98 would, by this measure, have lifted an additional 434,000 people permanently out of poverty. This means that IDA is not only 60 percent more efficient than it was in 1990, but also 50 percent more efficient than overall ODA. Again, the effect on numbers crossing the $1 per day poverty line is just one effect of additional IDA funding. IBRD (nonconcessional) lending also goes primarily to countries with good policies and institutions.

Well-targeted aid (such as IDA funding) helps to attract private investment, by improving the investment climate. As a result, it has very high overall returns.

Well-designed adjustment lending to countries committed to reform is generally effective in accelerating poverty reduction.

Adjustment lending was developed as a necessary corrective, after distorted macroeconomic environments had been shown to undermine the effectiveness of project-level assistance. Early experience with adjustment lending was uneven and revealed problems: lending was not sufficiently selective, with too much money going to countries with poor reform and implementation records, and the design and implementation paid insufficient attention to social costs, institutions, and the dynamics of reform. Since then, adjustment lending has improved in targeting and design. It is now generally an effective way of providing strong reform support in countries with adequate policy and institutional frameworks. By the 1990s, adjustment lending was earning higher internal Bank evaluation ratings (as judged by the independent Operations Evaluation Department) than investment lending. And attention to the distributive impact of reforms has improved, although further learning is still necessary.

One broad lesson from experience is that reform does not usually succeed without strong local ownership; this lesson has provided the impetus for the Poverty Reduction Strategy Paper (PRSP) process.

At the society-wide level, early evidence suggests that the PRSP process is increasing both ownership (through participatory discussion of reform alternatives) and poverty focus of development programs in low-income countries. Although it is too early to gauge outcomes on the ground, full PRSPs are so far associated with a 20-percent increase in spending in poverty-related areas. A similar shift in the balance of spending is associated with the Highly Indebted Poor Country (HIPC) debt relief programs developed since the mid-1990s and led by the World Bank and International Monetary Fund (IMF).

World Bank effectiveness at the program/sector/project level

Measured results show that the Bank’s actions have been broadly successful in promoting higher productivity and human development, especially over the past decade.

Bank operations have served in general to increase the economic productivity of borrowers. The minimum economic rate of return (ERR) expected from Bank-financed projects is 10 percent. Although there is considerable variation and there have been failures, actual results have been substantially better, reaching an average of 16 percent in the 1980s and rising to 25 percent in the 1990s. Bank operations also make a difference in the areas of health and education.

The Bank is the world’s largest external funder of education, having provided a cumulative $30 billion for education projects. It also is the world’s largest external funder of health programs, with new commitments of $1.3 billion a year for health, nutrition, and population projects. These projects had significant results in themselves and were often replicated outside of the original project area. Although it is not possible to quantify this overall effect, country experiences are indicative. In China, for example, a project in the late 1990s helped raise the proportion of households using iodized salt from 40 to 89 percent, reducing iodine deficiency in targeted age groups from 13 to 3 percent. Ultimately, this will result in average gains of 10 to 15 points in children’s IQ levels in affected communities. In Mali, a project in the early 1990s raised the share of children fully vaccinated from 0 to 24 percent. And beyond these direct effects, economic growth supported by the Bank often indirectly improves social indicators, although countries need to strengthen this link by prioritizing health and education for poor people.

Bank lending generally encourages good economic performance. Reviews of adjustment lending show that in the 1990s, it supported governments in maintaining their efforts in social areas and in poverty focus. Developing countries receiving Bank adjustment lending in 1990-97 maintained and even increased social expenditures, on average, more frequently than countries without such lending.

The outcomes of Bank lending have improved steadily. Project outcomes have improved sharply over the past decade. Despite the growing complexity and more demanding nature of its development agenda, the Bank has increased its share of projects rated as satisfactory from well below 60 percent in the late 1980s to above 80 percent today.

The Bank has increased its effectiveness by incorporating lessons from experience.

These improvements in outcomes come as a result of attempts to learn from experience and adapt to changing circumstances. In part due to increases in private capital flows and changing government priorities, as well as due to changing understanding of the Bank’s role, the Bank has shifted the sectoral composition of its lending. It has shifted resources away from direct infrastructure lending (which fell from three-quarters of Bank lending in the 1960s to one-third in the 1990s) and toward the social sectors (now one-fifth of the total). This shift has been made possible in part by the increased role of the private sector in some areas of infrastructure; in those areas, the Bank now focuses its efforts on facilitating the environment for improvements in infrastructure, including through regulatory reform.

The Bank has also increased both the quantity and quality of policy-based lending. As a result of greater selectivity, adjustment operations achieved their objectives in more than 80 percent of cases in the 1990s--up from 60 percent in the 1980s--and the share with a poverty focus rose sharply. The same shift towards social spending has occurred in the programs associated with debt relief for HIPC; indeed, this is a principal goal of these programs.

Other improvements include:

The Bank is seeking to build on its experience and adapt approaches as necessary.

Development is a risky business. To develop ideas, the Bank has to take some risks, and some failures are inevitable. What is essential is to learn from those failures. The Bank has done so: for example, by launching a successful Higher Impact Adjustment Lending (HIAL) initiative in Africa in 1995 to improve design and country selection in line with lessons from evaluation; and by changing its approach to the power sector in Africa.

The Bank builds on success by scaling up initiatives that work, such as the high-return dairy cooperative program (Operation Flood) in India. This vast organization grew out of a single, small cooperative society. By 1996, 10 million farmer-members were supplying an average of 11,000 metric tons of milk per day through 55,000 village cooperative societies, and this program and associated policy changes increased the annual growth rate of Indian dairy production from 0.7 to 4.2 percent. In this case, external support from the Bank and others helped to encourage government policy changes that grew out of a homegrown initiative.

The Bank in the late 1990s strengthened its approach to managing by results, and also moved strongly to increase the sharing of knowledge. In both areas, there has been progress, but there remains considerable room for further improvement.

Effectiveness of global programs

Global interventions are an important complement to country assistance.

Global development challenges--such as the spread of infectious diseases, the challenge of building an international trade and financial architecture, loss of biodiversity, deforestation, and climate change--cannot be handled solely by individual countries and therefore require multilateral action. Such action is typically most effective when linked to country efforts. The Bank has contributed actively to these global programs, through financing, through advocacy, and through alignment with its country programs. Two examples illustrate the far-reaching potential and very large returns of such global initiatives.

In recent years, the obvious need for such programs and their strong potential led the Bank to become involved in a growing number of global actions. This in turn led to a greater awareness of the need to maintain focus and tighten priorities. Since 2000, the Bank has moved to make its global programs more strategic by establishing a small number of priority areas for action. This focus has helped increase the resources available for high-priority programs, such as combating AIDS and preventing conflict.

Executive Summary conclusion

Well-allocated foreign aid has been an effective means of supporting poor countries and poor people in their efforts to improve their lives; and with improved allocation and better design and delivery of assistance, aid is more effective today than ever before.

The international development community has recognized that assistance is most effective when recipient countries are the primary drivers of their own reforms and institutional development. Financial aid benefits most the countries that have shown they can use it well. Advice and capacity-building comprise an important complement, especially in the poorest countries and in those that do not have the capacity to absorb significant financial transfers. Advice is often more acceptable and credible when linked to resource transfer.

Since the end of the Cold War, there has been a strong shift in the direction of better allocation of aid, and better tailoring of assistance to country needs and circumstances. Improvement in allocation and the increase in the number of poor countries that are putting in place the governance, institutions, and policies to promote rapid, market-driven, pro-poor growth mean that aid is more effective today than ever before. Yet in the past 10 years, a period when many rich countries experienced remarkable growth, aid allocations have fallen. In inflation-adjusted terms, aid to poor countries was some 7 percent less in 2001 than in 1990. The past record of development progress, and the great efforts the developing countries are now making to develop themselves, provide the evidence that additional aid resources could be used effectively to reduce global poverty.

 

Introduction

Research staff in the Development Economics Vice Presidency of the World Bank prepared this paper for the United Nations International Conference on Financing for Development held in Monterrey, Mexico, on March 18-22, 2002.1 It has an ambitious purpose: to analyze in reasonably concise form the changing roles and effectiveness of development assistance during the past 50 years, with particular attention to the past two decades and to the experience of the World Bank. Such a paper cannot possibly be comprehensive. Rather, the authors attempt to describe broadly how the goals and forms of development assistance have changed over time. They conclude that as a result of these changes and, perhaps more important, of improvements in the policies, institutions, and governance of developing countries, aid is more effective at reducing poverty today than ever before.

The past 50 years have taught the international development community--developing countries, donors, and the international financial institutions--a great deal about development and poverty reduction. We now understand better what the goals of development should be and how to attain them. We have learned from both successes and mistakes, in particular about markets, governments, and institutions, and how they interact. This learning--a common and ongoing effort of the entire development community--has led to improved development performance overall and at the World Bank in particular.

At the same time, there is much that we still do not know. Perhaps most important, we do not understand fully how to help improve institutions and governance, especially in the poorest countries where the needs are greatest. And we are still learning how best to deal with pressing cross-border issues that threaten development, such as disease, environmental problems, and political instability.

In recent decades, development has progressed at historically unprecedented rates.2

For all the political, economic, and social disruptions of the second half of the twentieth century, it was also a period of unprecedented progress in living standards worldwide. Better technology, policies, and institutions not only spurred rapid growth in the advanced economies, they also made possible substantial improvements in the lives of poor people throughout much of the developing world. Progress has been uneven, to be sure. Yet key indicators of well-being testify to striking progress overall.

It is impossible to identify with precision the contributions of development assistance to this progress. There is no single agreed approach to doing so, and such assessments face difficulties inherent to the process of assisting a country to develop.

There are various reasons why assessing the contributions of development assistance is inherently difficult. First, responsibility for development progress will always lie primarily with the developing country itself. No outside donor is able, or indeed has the right, to compel a country to follow policies likely to promote development. Nor would it have the local knowledge necessary to do so even if it had the influence. Country ownership of the reform program and development strategy is essential. That is, as the evidence in following sections will show, the country must be committed to and involved in shaping development strategies and projects.

This country ownership is one of several factors making it impossible to assess with any precision the effects of development assistance. If the country takes the lead in reform and institution-building, then by definition the external actor--whether a bilateral donor or a multilateral like the World Bank--plays only a supporting role and should not claim too much of the credit. As discussed in Section 3, other factors also make attribution difficult: the need for partnership across donors, as well as the tendency for the most effective projects to have benefits that extend far beyond the narrow confines of the project itself.

Moreover, levels of development assistance are small relative to other financial flows and to the scale of the challenge at hand. Development aid totaled about $54 billion in 2000; this was only one-third as much as foreign direct investment in developing countries ($167 billion), which itself was only a small fraction of total investment (nearly $1.5 trillion). Similarly, although the World Bank is the world’s largest external provider of assistance in the education sector, it typically provides less than $2 billion in direct assistance for education each year.5 By comparison, annual public spending on education in the developing world totals more than $250 billion. Given this discrepancy in scale, even if the World Bank were to greatly increase its lending in the sector, its effectiveness would have to come primarily through catalyzing institutional development and policy change in education, rather than through resource transfer alone.

This means that the direct effects of assistance (for example, in terms of income increases or reductions in mortality) will often be swamped by other factors. Successful development assistance necessarily will have effects that reverberate far beyond the confines of the project itself--either because the ideas are replicated elsewhere, or because the intervention helped to institutionalize new approaches. Yet when the positive effects of aid do spill beyond the bounds of the specific project or policy intervention, the effects become much harder to measure.

But while no single type of evidence is definitive, and while there have been problems and disappointments, the evidence suggests that on balance development assistance has contributed strongly to development progress.

Despite these analytic limitations, there is strong evidence that outside assistance is often a powerful force for growth and poverty reduction, provided that the recipient country is committed to using outside resources well. This paper assembles several types of evidence supporting this conclusion. Each of these approaches has methodological problems, and none of them is above challenge. Nevertheless, all four provide evidence that assistance has made a difference, and together they provide a basis for optimism:

These positive results have depended heavily on learning. The World Bank and other development agencies have adapted their approaches over time, in response not only to changed circumstances but also to lessons learned through experience, research, and evaluation. Some of these are lessons from successes, such as those listed above. But the Bank has also learned from failures. For example, it has learned that project lending in poor policy environments typically has much lower returns than in countries with good policies, and that loan conditionality does not alter the policies of recipient countries that are not already committed to change for their own reasons.

This paper focuses on lessons learned and the results that development assistance has already achieved. This is not to suggest there is nothing left to learn. To the contrary, there is much that the global development community and the Bank still do not know. For example, we know too little about how to help countries improve governance and how to support the creation of effective institutions. We also know too little about how to spark reform and growth in the poorest-performing, low-income countries--those that have been mired in a cycle of poor institutions and policies, economic stagnation, and often conflict. The development community recognizes that existing modes of aid and development cooperation have not worked well in these environments. The World Bank, like other development organizations, is now investigating fresh approaches to helping the desperately poor people in these countries.6

Continued learning and knowledge are essential to scaling up the fight against poverty.

Despite the progress made in the past 50 years, an immense poverty challenge remains. Some 1.2 billion people still live on less than $1 per day, and the challenge will grow as the population of the developing world increases by another 2 billion in the next 30 years. To address a challenge of these dimensions, aid will need to have effects far beyond the value of the money alone. This means that aid must build the frameworks for private economic activity and social improvements--ensuring that its effects go far beyond any individual project--and it must contribute to greater capacity and greater knowledge. Continued learning is essential to these aims.

 

1 The Meaning of Development and the Role of Policy, Institutions, and Markets

This section provides a brief overview of changes in the way we think about Development--what development means, and what approaches will best achieve it.

Ideas about policies and institutions, as well as the policies and institutions themselves, drive development. So understanding how those ideas have evolved, and how they can be changed, is crucial to understanding how we can contribute more effectively to development.

Development thinking has evolved continually over the past 50 years. In response to the lessons of experience and analysis, development practitioners have adapted their approaches to promoting development, and even the goals of development work. We have learned that strategies that seemed obvious to many at some point--for example, both the heavily statist and minimal-government free-market approaches--have had to be reconsidered and changed as part of a continuous learning process. This is one reason why a careful and measured look at experience is so important.

1.1 Objectives for development and development assistance

Early postwar aid was focused on reconstruction of the war-torn economies of Europe and Japan--a task that it contributed to with considerable success.7 For example, five of the World Bank’s first six loans went to countries of Western Europe, and the first four were explicitly for reconstruction. The poor countries of the world were not the first priority, and the focus was on raising production and income, rather than on broader notions of development.

With rapid progress in post-war reconstruction, development assistance began to focus instead on raising incomes in what came to be called the developing world. At first, the goal was largely confined to raising aggregate national incomes. With the recognition that population growth rates vary sharply, so that aggregate income did not necessarily give a clear picture of changes in living standards, attention turned to per capita incomes. Soon, however, with increased understanding of issues related to income distribution, simply raising average per capita incomes also was recognized as too limited a goal. By the 1960s and 1970s attention focused on the twin problems of growth and income distribution, and increasingly on the basic needs of poor people. Reduction of income poverty became a greater priority within the international financial institutions, as well as for governments.

In recent years, the goals of development have come to embrace the elimination of poverty in all its dimensions--income poverty, illiteracy, poor health, insecurity of income, and powerlessness. A consensus is emerging around the view that development means increasing the control that poor people have over their lives, through education, health, and greater participation, as well as income gains. This view comes not only from the testimony of poor people themselves, but also from advances in conceptual thinking about development.8 It is clear that the various dimensions of poverty are related, and income growth generally leads to strong progress against the non-income dimensions of poverty as well. It is also clear that direct action to improve these other dimensions can accelerate the reduction of both income and non-income poverty.

In summary, the objectives of development have evolved in response to changing circumstances and a deeper understanding of poverty. This evolution has made development assistance more complex and challenging. At the same time, it has focused the development community’s attention on our essential mission: making it possible for poor people to improve their lives.

1.2 Approaches to development: The roles of states, markets, and institutions 9

The development community’s understanding of the most effective way to achieve development objectives has also evolved over time, with the accumulation of evidence and experience. Approaches that appeared at the time to be both correct and obvious have been undermined by experience and closer analysis; in the same way, our current ideas will no doubt give way to others as experience accumulates and thinking evolves. This surely reminds us to beware of simplistic solutions or "silver bullets." Perhaps the most important question on which our understanding has deepened over the past decades is this: what are the respective roles of governments and markets in spurring development, and how do institutions fit into the picture? At the risk of oversimplification, we can identify at least three major phases in the evolution of our answers to these questions.

In practice, we recognize that there is a continuum of approaches, both in developed and developing countries, and that the phases described here do not match precisely the evolution of thinking in any particular region. Instead, they are intended to capture the broad shifts in the thinking of the development community and development practitioners. It is also the case that successful countries throughout this period have seen both state and market play positive roles. With those caveats, this broad-brush portrait can nevertheless provide a useful context for a discussion of development assistance, by suggesting where that assistance is most likely to be effective.

Statist and import-substitution period

The 1950s and 1960s were a period of great confidence in government. Development practitioners and thinkers trusted government both for its intentions and for its ability to make economic progress happen, whether in the richer or poorer countries. Development thinking focused on market failures, which were especially prevalent in developing countries and seemed to provide a strong rationale for state intervention. The private sector was thought to be too uncoordinated, too poorly developed, and too focused on private interests to allow it to serve as the locomotive for growth. And in Africa, newly independent countries searched for a post-colonial model of development and a strengthened leadership role for the national state. In many countries around the world, the confidence in government was reflected in the heavy role of central planning and in the relatively closed (import substitution) trade policy.

This state-led approach had some initial development successes. Leading economies of Latin America, where state economic management did not completely crowd out the private sector, grew rapidly for decades under the import-substitution model. And even in some "tiger economies" of East Asia, industry managed to grow and become more productive behind high trade barriers, thanks to otherwise good economic management. Nevertheless, the costs of state economic control became clearer over time. State planners were not omniscient: they could not possibly acquire all the information needed to make decisions that reflected both efficiency considerations and people’s differing preferences.

Worse, governments revealed themselves to be collections of interests rather than disinterested and benevolent "social planners." Even had they been effective in their role as social planners, government officials would not have been able to create the entrepreneurial dynamism essential for sustained development and change. Behind protective barriers, firms in many countries (for example, India and Mexico, to name just two) became less efficient as they focused on obtaining government favors rather than improving productivity. Finally, fiscal and macro instability rose with the oil price shocks of the 1970s and early 1980s, contributing to the debt crisis and revealing the weaknesses in the statist model.

Free-market reaction

As a result of the disappointment with the state-led approach, the 1980s and early 1990s saw a strong reaction that stressed the primacy of markets in development. This reaction was a necessary corrective in many ways: it refocused attention on production efficiency and market signals, and it inspired the move to lower trade barriers as a means of spurring productivity. Macro stability and balanced fiscal accounts were seen as fundamental building blocks for development and became early priorities for reform. This period saw substantial improvements in both macro stability and openness through much of the developing world.

At the same time, this school of development thinking also failed to address key points. Once countries began to achieve macro stability and greater openness, it became clear that these were necessary but not sufficient for growth. In particular, the free-market view tended to neglect the institutional foundations of effective private markets. The importance of institutions was underscored by major shifts: the economic decline in the countries of the former Soviet Union; the continued growth in China, a country that moved forward with market-oriented reforms without excessive disruption of institutional foundations; and, later in the 1990s, the financial crisis in East Asia, to which institutional weaknesses contributed heavily. Furthermore, even as it performed a useful service by spotlighting government failure, the free-market reaction had minimized very real problems of market failure that are prevalent in the developing world. As a result, growth performance fell short of expectations in many parts of the developing world.

Deeper understanding of complementarities and role of institutions

Recent years have seen a greater recognition in the policy debate of the complementarities between markets and governments. Clearly, experience shows that the private market economy must be the engine of growth; but it shows also that a vibrant private sector depends on well-functioning state institutions to build a good investment climate and deliver basic services competently.

This view of complementarities draws heavily on what we have learned in the past two to three decades in the more successful cases of income growth, such as East Asia and Chile. It also draws on learning from the transition process in the former Soviet Union, where a lack of institutional development combined with excessively optimistic expectations led to extremely disappointing development outcomes and demonstrated clearly the importance of a sound state in providing the environment for growth. The role of institutions has come through more strongly than it did in earlier views of development, and particularly than it did in the policy debate in the 1980s and early 1990s. As Section 2.3 shows, countries that have combined institutional improvements with market-oriented policy reforms and greater engagement with the world economy saw their per capita incomes grow in the 1990s at the very rapid pace of 5 percent per year.

Continued learning

This understanding of states, markets, and institutions has strong conceptual foundations, and it is based also in experience with what works in development. There is a strong and growing consensus about the value of such an approach. Nevertheless, there is much that the development community has yet to learn. The World Bank is committed to continued learning and to constant improvements in our overall approach to development. For example, while institutions have now taken a central role in the World Bank’s strategic approach to development, we are keenly aware that we know far too little about just how to build them.10

1.3 Summary

We have learned a great deal about what development means and how, broadly, to achieve it.

Our understanding of what development means has evolved. Poverty reduction efforts should address poverty in all its dimensions--lack of income, but also the lack of health and education, the vulnerability to shocks, and the lack of control over their lives that poor people suffer. This multidimensionality of poverty reduction is embodied in the Millennium Development Goals.

We have also learned more about the most effective broad model for development:

 

2 Sources of Growth and Poverty Reduction

The development community has learned much about the sources of growth and poverty reduction.

Development depends on two pillars, which together support sustained growth and poverty reduction:

Many countries have built up these two pillars in recent decades and have seen the rewards: rapid growth and poverty reduction. Although too many other countries continue to fall behind economically, a majority of the developing world’s population lives in countries that have grown rapidly and are closing the gap with the rich countries. Even the countries that have stagnated economically have, for the most part, seen material improvements in social indicators, such as health and education measures.

Development assistance has helped accelerate this progress. It aims at helping countries build both pillars: improving the investment climate (through building the factors that contribute to investment and growth), and empowering people (through education, health, and social protection). Section 2 explicates the context for development assistance, by laying out in greater detail the channels through which assistance can affect growth--that is, the factors that give rise to growth and poverty reduction. It also summarizes the success and failure of countries at generating growth. Sections 3 through 5 below show that these efforts have had large rewards.

2.1 What drives the growth of GDP and productivity?

Approaches: Understanding sources of growth 11

To increase incomes, countries need to improve one or both of two fronts:

In practice, virtually all sustained growth processes involve some combination of factor accumulation and increased productivity, with the respective shares of the two varying across countries and time periods. In any event, the real world usually defies a clean breakdown into these two factors: the question of how effectively inputs are used enters not just into productivity, but also into the accumulation of capital. Many development interventions are aimed at accelerating both factor accumulation and productivity growth.

Our understanding of the sources of growth of GDP and productivity is based on several types of research: cross-country regressions, growth decompositions, case studies, and microeconomic studies of the sources of productivity growth. All these approaches have their shortcomings. For example, regressions and growth decompositions are ways of assembling statistically aggregate indicators and trying to identify the most important explanatory factors. Yet while these methods reveal associations between statistical variables, they cannot prove that one factor causes another. Moreover, they place excessive emphasis on a simplistic aggregate production function model of accumulation and production. Much of the growth comes from reallocation of resources to more dynamic sectors; from different ways of organizing productive activity; and from intensification of entrepreneurship. None of these are illuminated by the aggregate production function approach.

The results from country case studies do not suffer from these weaknesses, but they may be too country-specific to provide lessons by themselves for other countries. Nevertheless, together these methods sketch out a good picture of what matters in spurring overall income growth. While no single variable stands up as a determinant of growth in all analyses of growth processes, certain factors appear to be particularly important; these are discussed below.

Broadly, it is clear that private-sector growth is essential to long-term development. While the state can have some success in financing or inducing factor accumulation over the medium term, it is far less successful at inducing productivity growth when it takes a lead role in the economy. Even when a state-dominated economy manages large quantities of investment, the quality of that investment is often low. Moreover, employment provides the main long-term route out of poverty, but the vast majority of the world’s poor workers are employed in the private sector, not the public sector. Moreover, few of these private-sector jobs are in large firms; most of the world’s poorest people work in small firms, most notably small farms. For these reasons, any development strategy must have at its core a focus on building a good climate for private-sector investment, productivity, and employment creation by all firms, small and large.

Given this background, which factors most affect long-term economic growth and poverty reduction? Although different analysts will have somewhat different lists, most would agree on many of the factors listed below. One way to organize these factors is to group them in terms of the major elements of the investment climate that are amenable to direct action by governments: macro factors such as macroeconomic stability and trade openness; governance and institutions, including basic service delivery in education; and infrastructure. Geography is an additional factor that cannot be directly influenced by policy but can have important effects on growth and development.

Macro factors--macroeconomic stability and openness--are important drivers of growth.

Macroeconomic stability

Unstable fiscal accounts and high inflation undermine the private sector by reducing predictability and discouraging investment.12 The slowing of growth rates in much of the developing world after the 1960s and early 1970s stemmed in part from macroeconomic instability, which reduced confidence in government and in its ability to maintain a stable climate for productivity, jobs, and growth. While macro stability on its own is not enough to jumpstart growth and development, it is generally a prerequisite for sustained progress.

International trade and investment 13

There remains some debate about the degree of trade liberalization that is advisable for poorer developing countries--debate fueled by the observation that open domestic markets were not a precondition for rapid growth in the East Asian tigers, nor indeed historically in much of Europe and North America. Yet it is also clear that most recent periods of rapid growth have also been periods of increased engagement with the international economy. In the 1990s, for example, developing countries that had fast export growth also had, on average, 1 percent higher annual growth in GDP than those with slow export growth; in the 1980s, the difference was even greater.14 The domestic investment climate and the actions of the domestic private sector are the key drivers of development, but international engagement can play an important complementary role. Even in historically closed economies such as China, which was far from completely open during the early reform period, high growth was fueled in part by increased access to international capital and markets. Where local conditions for entrepreneurship and growth are good, exposure to international competition increases the productivity of domestic firms and lowers input costs for downstream users, while foreign direct investment brings with it new production and process technologies, organizational capacity-building, and marketing networks.

Micro and structural factors--governance, education, and other elements of the investment climate--also play a big role in generating growth.

Physical capital investment

Many of the early analyses in the empirical growth literature found that the level of investment in physical capital plays a role in determining growth rates.15 But subsequent empirical research, together with the anecdotal experience of countries that achieved high investment rates but slow productivity growth (such as the Soviet Union), has shifted attention from quantity to quality and productivity of investment. Factor accumulation by itself leaves much to be explained in growth regressions, and the evidence is that total factor productivity growth--which captures quality improvement--explains a major share of most episodes of long-term economic growth.16 The lesson is that we need to focus on the investment climate: the constellation of underlying factors causing growth of productive investment.17

Human capital investment through education and health

It is widely thought that an educated and healthy workforce also contributes to growth, with widespread basic education (primary and secondary) being especially important.18 Not all empirical analyses find such an effect. One reason that the effects of education have been hard to pin down empirically is that the quality of education matters as much as the quantity, and yet we are much better at measuring quantity than quality. Another reason is that, like physical capital, human capital may be relatively unproductive from a societal standpoint if a weak investment climate inhibits development.19 But while the case is not fully established empirically, strong basic education and reasonable levels of health have been a precursor to many development successes, and recent analyses suggest strongly that additional education does indeed spur development in the typical country. Finally, as discussed below, the evidence on the substantial returns to education at the microeconomic level is unambiguous: education lifts people out of poverty, raising their earnings by some 5 to 10 percent per year of schooling.

Sound institutions, governance, and rule of law

Stable and effective government institutions, respect for property rights, equal treatment under the law, the absence of bureaucratic harassment, a lack of corruption, and protection from organized crime all matter for growth. Investment and productivity depend on predictability, which in turn hinges on confidence that government will not act opportunistically or capriciously. The "soft infrastructure" of an effective legal and judicial system is critical, whether for achieving economic growth, empowerment of poor people, or security. Good governance also reduces the costs faced by producers. Sound supervision and regulation of financial institutions decreases the costs of capital to businesses and contributes greatly to macroeconomic stability. Indeed, it has been argued that institutional quality and governance are the underlying variables that drive all of the other growth-enhancing factors.20

Competition

Vibrant competition is important in spurring productivity growth. Interventions that increase the extent of the market, including good domestic infrastructure, reduce costs and improve the selection of goods and services by widening the number of competitors. The dynamic effects of such changes, which work through the increased productivity growth they spur, may greatly exceed the one-time benefits to consumers of accessing goods from new suppliers at lower prices.21 Competitive pressures can come through various means. Openness to imports is often the most effective source of competition--and the one that requires least administrative capacity on the part of government--but other important sources have included well-functioning competition authorities and government-mandated "export tournaments."22 Ensuring that firms can both enter and exit markets is also an important element of competition.

Infrastructure

Physical infrastructure also matters a great deal in terms of both investment climate and empowerment. Transportation and communications infrastructure connect markets and people, both domestically and internationally.23 Better infrastructure thus diminishes the effects of geography, reducing costs to producers and improving the reach of government and private services for consumers. In Sri Lanka, for example, the arrival of telephone service in rural areas increased farmers’ share of the price crops sold in the capital city from 50-60 percent to 80-90 percent.24 In Peru, households with access to modern infrastructure (water, sanitation, electricity, and telecommunications) had income growth about 45 percent higher than households without these services.25 Availability of affordable and reliable energy supplies is another important spur to production, while good water and sewage infrastructure improves health and environmental outcomes. How government can best provide infrastructure, or facilitate its provision by the private sector, is a key question for development assistance, as are the questions of the prioritization and sequencing of infrastructure investment.

Geography

Geography seriously impedes growth for some countries, making development much more difficult.26 If a country is landlocked, mountainous, and surrounded by poor neighbors, or if its population centers are in remote areas, it may encounter additional difficulties in developing domestic markets of efficient size, engaging in international trade, or acquiring technology from abroad. In such cases, it will be especially important to build effective infrastructure links, to improve transportation and communications both domestically and internationally. Regional integration and trade-creating customs unions may also be important in overcoming geographic barriers. Ecological fragility is another geography-linked barrier to development: ecological stresses may most directly affect poor people, and these stresses too require specific policy and institutional responses.

Putting these factors together to spur sustained growth is a challenge: it requires proper sequencing and selection of reforms, as well as consistency over time, neither of which is easy to achieve.

Although our understanding of the importance of these factors has grown over time, to put them together in a way that yields sustained growth remains a daunting challenge. One major challenge for governments is to decide where to focus their efforts as they strive to make the conditions for growth as favorable as possible. Strategies have to be determined in each country context, but it is clear that administrative capacities of low-income governments are typically so limited that an assessment of where they should be focused is essential: the government simply cannot push ahead effectively on all fronts at once. At the same time, sequencing is necessary. It is by now widely recognized that the East Asian financial crisis of 1997-98, which exacted a substantial cost in poverty and lost output, stemmed in no small measure from financial and capital-market liberalization that proceeded before the appropriate regulatory safeguards were in place. But while some sequencing problems are easier to identify, finding the best sequencing of steps in a particular country context is a great challenge, and it remains an area where our knowledge needs to expand further.

Another major challenge is sustaining growth. Rapid growth episodes of a few years or a decade are not uncommon. For example, countries that successfully emerge from civil war often experience relatively rapid economic rebounds for several years.27 What has been much less common is sustained rapid growth over a period of decades, which is what is necessary to eliminate absolute poverty.28

The need for consistency underlines the importance of attaining sustained productivity growth. Only a portion of growth is driven by increases in physical and human-capital intensity of production, which can be difficult to sustain over long periods. Countries also need rapid growth in productivity.

2.2 What factors drive poverty reduction?

The World Bank and its partners--United Nations agencies, bilateral donors, and governments--have committed to a common set of poverty-reduction results, including the Millennium Development Goals agreed to by governments at major conferences in the 1990s. The goals are accompanied by numerical targets expressed in terms of changes between 1990 and 2015: reducing the share of people living in poverty worldwide by half; reducing infant and child mortality by two-thirds; reducing maternal mortality by three-quarters and improving access to reproductive health services; and halting the increase in incidence of communicable diseases (AIDS, malaria, TB) and reducing malnutrition. What do we know about the factors underlying the reduction of poverty, in both its income and social dimensions?29

Growth and poverty reduction

Economic growth is essential for sustained progress on poverty reduction. Countries that have reduced income poverty the most are those that have grown the fastest, and poverty has grown fastest in countries that have stagnated economically. Between 1992 and 1998, for example, the share of the population in poverty fell an average of 5 to 8 percent annually in fast-growing Uganda, India, Vietnam, and China.30 In Nigeria, by contrast, per capita consumption fell 16 percent between 1992 and 1996, and the poverty share increased by half, from 43 percent to 66 percent of the population.31

Income distribution and poverty reduction

Some have expressed fear that growth alone cannot be relied upon to result in significant poverty reduction in developing countries. Evidence shows that income distribution has not changed on average in periods of growth in the typical country, and that therefore overall growth has meant that the incomes of the poor have increased (again, on average) proportionately. In China, inequality did increase with reform; but the increase in inequality was an inevitable feature of the improvement in the incentive structure, which led to growth and poverty reduction. Indeed, growth was so strong that poverty fell sharply despite worsening income distribution. In other cases--Uganda, for example--income distribution improved at least modestly with reforms and growth.32

Nevertheless, it is the case that countries with better income distribution see growth translate into faster poverty reduction. At the same rate of GDP growth, a country with highly equal distribution (that is, one with a Gini coefficient of 0.30) will see poverty fall twice as fast as a highly unequal country (Gini of 0.60).33 In addition, the evidence suggests that greater inequality of important assets, such as land and education, may retard society-wide growth.

It is also the case that groups of poor people will experience reform and growth differently. A large increase in the income of one group may be offset by a smaller increase or even decline in the income of another group.34 This underlines the importance of ensuring that there is adequate social protection in place as a complement to structural adjustment measures. Social protection helps build broader support for action, and it enables individuals to take risks involved in entrepreneurship. And social protection is not just an instrument for achieving growth: it also targets poverty directly, by reducing the income vulnerability that poor people identify as one of the defining elements of a life in poverty.35

Determinants of improved social indicators

Once we recognize that poverty is about more than income, we see that there are other determinants of poverty reduction beyond growth. Social indicators--health and education--improved far faster in the twentieth century than we would have expected, given the rate of income growth. Most countries have made major progress in increasing educational attainment and health outcomes by targeting these goals directly, and by applying new knowledge and technologies, rather than just waiting for the effects of income growth to improve these indicators. At every level of income, infant mortality fell sharply during the twentieth century. For example, a typical country with per-capita income of $8,000 in 1950 (measured in 1995 dollars) would have had, on average, an infant mortality rate of 45 per 1,000 live births. By 1970, a country at the same real income level would typically have had an infant mortality rate of only 30 per 1,000; by 1995, only 15 per 1,000.36 Similar reductions occurred all along the income spectrum, including in the poorest countries.

The improvements in social indicators are remarkable by historical standards. As noted in the preface, life expectancy in developing countries increased by 20 years over a period of only 40 years, as it shot from the mid-40s to the mid-60s. By comparison, it probably took millennia to improve life expectancy from the mid-20s to the mid-40s. Literacy improvements have also been remarkable: whereas in 1970 nearly two out of every four adults were illiterate, now it is only one out of every four.

These advances in education and health have greatly improved the welfare of individuals and families. Not only are education and health valuable in themselves, but they also increase income-earning capacity. Where macroeconomic analyses of the growth effects of education have been somewhat ambiguous, the microeconomic evidence of the returns to education is overwhelming and robust. Each additional year of education increases the average individual worker’s wages by at least 5 to 10 percent.37

These trends make it clear that public policy matters. Government has a role not only in ensuring delivery of good basic services in health and education, but also in ensuring that technology and knowledge spread widely through the economy. The dramatic improvement in life expectancy at a given income level is attributable to environmental changes and is the result of public health actions. The control of diarrheal diseases, including the development of oral rehydration therapy to reduce child mortality, is one example; the education of women was an important component of these efforts. Smallpox eradication, made possible through a combination of advances in public health research and effective program management, is another example of a successful twentieth century public health effort.

Bangladesh (see Box 2.1) provides an excellent example of a country that has expanded educational access and improved neonatal and reproductive health dramatically and unexpectedly in a short time. Growth has not been rapid, although it has increased in each decade since independence, and Bangladesh has suffered from weak governance. However, because Bangladesh has taken targeted steps to achieve health and educational goals and has provided a framework for dynamic NGOs to fight poverty, the country has achieved much in a short time. As the box explains, the World Bank and other donors provided important analytical and financial support.

Similarly, Mexico has achieved substantial improvements in the educational attainment and health of its poor citizens through its Progresa program, which it launched on its own, without donor support (see Box 2.2). The program has been so successful that it is being emulated in a number of other countries, with Bank advisory and financial support. A third major example, discussed in Section 5, is the Onchocerciasis Control Program, which has virtually eliminated riverblindness in 11 countries of West Africa.

2.3 Within this picture of strong development at the global level, we find divergent country experiences with growth and poverty reduction.

Within the overall picture of global development progress, the experiences of various developing regions and countries have differed sharply. Some countries have grown very rapidly, others hardly at

Box 2.1. Improving Health through Direct Action in Bangladesh

Bangladesh, one of the poorest, most densely populated countries in the world, has made remarkable progress in improving the health and education of its people since its independence in 1971. It has done so thanks to a partnership between the government, donors, and other partners, with local nongovernmental organizations (NGOs) playing a central driving role throughout the period. Since it established its office in Bangladesh in 1972, the World Bank has also contributed strongly to these efforts.

Over the past thirty years, Bangladesh has seen infant mortality drop from about 140 to 71 per 1,000 live births, and is the only one among the world’s 20 poorest countries to record a sustained reduction in birth rates over the past twenty years. The country has also achieved outstanding progress in basic education, with most children now attending primary school and nearly a third attending secondary school. Progress in girls’ education stands out: the proportion of primary school students who are girls increased from 37 percent in 1980 to virtual parity with boys in 1995. Girls’ enrollment as a percentage of total secondary enrollment has increased dramatically from 34 percent in 1990 to 48 percent in 1997.

The World Bank's dialogue with Bangladesh on health and population issues began in 1973, when the Bank helped mobilize support from six cofinanciers for a project. Since then, additional donors have been engaged in follow-up projects, each of which has almost doubled the amount of money invested. A series of World Bank Population and Health projects over the years have led to a marked increase in the use of contraceptives and decreases in infant mortality in Bangladesh. At the close of the Population and Health IV project (a $180 million implemented between 1991 and 1998), Bangladesh was nearing complete national coverage of family planning and limited primary health care services by community health workers.

In education, the World Bank has funded 14 projects in Bangladesh worth $691 million, covering technical, vocational, primary, and female education. Projects have supported low-cost school construction, strengthening teacher training, improving the design of textbooks, and revamping the curriculum. They have emphasized a role for communities to support schools in their villages. With the large increases in the number of children in school, recent projects have focused on enhancing the quality of learning.

In 1993, the World Bank financed a groundbreaking Female Secondary School Assistance Project, which was aimed at increasing female enrollment and completion. The project supported a government program to provide stipends and cover all school-related costs for girls. The program the project supported resulted in large increases in female enrollments, delays in the age of marriage, a higher number of single-child families, improved birth spacing, and more females employed with higher incomes.

The World Bank is continuing its work in health and education. Current education projects are helping to improve quality of primary education and provide opportunities to newly literate adults, and a second Female Secondary School Assistance project is in the pipeline. In health, the Bank is playing a lead role in helping to coordinate donors in the government's sector-wide approach to health and population development.

 

Box 2.2. Mexico’s Homegrown Program Helps Poor People Invest in Schooling and Health

Starting in 1996, and working without direct involvement from international agencies, the Mexican government designed and successfully implemented Progresa, a program to provide immediate financial transfers to the rural poor that at the same time promotes investment in children’s human capital via increased schooling and improved health and nutrition status. Progresa provides cash transfers (grants) to poor rural families conditional on keeping children in school and providing them with basic preventive health care and nutrition. A key feature of the program is the provision of the transfer to mothers, a mechanism designed to ensure that the money is invested in children and which also serves to empower women in rural communities. In 2001, Progresa accounted for just 2.3 percent of the government’s social expenditures, or 0.2 percent of GDP. Impressive results (during 1996-1999) from external evaluation (carried out by IFPRI) make it clear that the program is reaching its intended beneficiaries:

  • Progresa provided benefits to 2.6 million poor rural families (or over half of rural families) in 2000. In 2001, the program is expected to cover 3.2 million families in more than 55,000 communities with high poverty rates throughout 2,200 rural municipalities of the country.
  • Education grants are supporting schooling for 3.6 million poor children (2.3 million at the primary level and 1.3 million at secondary level). Nutrition and health grants are benefiting 1.6 million children aged 0-5 years of age, and 0.8 million pregnant and lactating women, respectively.

And Progresa is achieving results by increasing educational attainment and improving health:

  • It raised secondary enrollment rates by 8 percent for girls and 5 percent for boys, and slightly increased the already high primary enrollment rates. It is estimated that children’s educational achievement has increased by about 10 percent, which would represent an increase in their future earnings of over 8 percent.
  • It increased prenatal care in the first trimester of pregnancy in 8 percent of cases, and decreased the incidence of disease among children under 5 by 12 percent among program participants. Progresa achieved a comparable decline in the probability of malnutrition among children aged 12 to 36 months.

Similar programs for conditional cash transfers to poor families, linked to participation in education (and, in many cases, health) programs are now being implemented widely in Latin America and the Caribbean, including Brazil, Colombia, and Jamaica, as well as in Turkey.

all in recent decades. Figure 2.1 provides an illustration of this, graphing median per-capita incomes from 1970 to 2000 for two groups of developing countries--ten of the fastest- and ten of the slowest-growing countries.38 The divergence over that period has been extraordinary: while the median "high group" country has nearly quadrupled the average income of its people over 30 years, the slow-growing countries now find their people some 40 percent poorer on average than they were at the start of the period. Comparisons of individual countries make the same point: The Republic of Korea had a lower nominal GDP per capita than Ghana in 1960 ($155 versus $180). However, because of Korea’s growth, its average nominal income is now 35 times that of Ghana--even though Ghana is not among the world’s slowest-growing economies.

The excellent health achievements also hide regional and country divergences. Like income growth, improvements in health status and life expectancy have not been equally distributed. The health status and life expectancy of the poorest nations lag behind the rest of the world, and within countries, the health of the poor is worse than that of the rest of the population. Poverty is the most important underlying cause of preventable death, disease, and disability; and there is growing recognition that poor health, malnutrition, and large family size are key determinants of poverty.39

The overall picture for the developing world of course lies in between these two groups, but in strongly positive territory. Since 1965, the per-capita GDP of the developing world as a whole has increased by an average of 2.2 percent per year, more than doubling the income of the average developing-country resident. Again, this is a huge change by historical standards.40 And since 1990, developing countries have on average grown faster in per capita terms than the richer countries. Given the good policies that developing countries have been putting in place, we should expect this catch-up to continue.

Successful historical cases

The development success of countries of East Asia, starting with the "tiger economies" of Japan, Korea, Taiwan province of China, Hong Kong (China), and Singapore, is widely known and does not need to be recapitulated in detail here.41 But there are developing countries outside of East Asia, such as Botswana, that also have a consistent record of growth and poverty reduction over several decades. And other countries that are now high-income, such as Portugal and Ireland, achieved this status by growing more rapidly than other OECD countries over the past several decades.

More recent successes

A substantial number of countries, with a very large share of the developing world’s population, have grown very rapidly and reduced poverty in the last two decades. One group of 24 countries that sharply increased the trade intensity of their economies since the 1970s has seen per capita incomes increase by an average of 5 percent per year in the 1990s. These countries are home to 3 billion of the developing world’s 5 billion people, and such rapid growth in relatively large countries is responsible for the global progress in reducing absolute poverty. (For comparison, the rich countries grew at just 2 percent per year.) Even with fast-growing China excluded, per capita incomes in the remaining countries--such as Mexico, Thailand, Hungary, and Indonesia--grew an average of 3.5 percent per year. By historical standards, this is a very rapid growth pace, fast enough to double incomes in just two decades.42

Policy reforms and institution-building have driven much of this growth. Greater integration with international markets was one factor, but by no means the only one, or even necessarily the most important. In most cases, growth came only with improvements in the broader investment climate: macro stability as well as greater openness, but also better governance, institutions, and infrastructure. (Box 2.3 discusses the World Bank supportive role in reforms that spurred rapid growth in India, and the role of external assistance in that country’s growth and development.)

Indeed, the 1980s and 1990s were periods of major policy reforms throughout the developing world. We can see this clearly, for example, in the areas of macro stability and openness. The median inflation rate of developing countries was cut in half between 1982 and 1997, from about 15 to 7 percent. In low-income countries, the improvements were even greater. More important, at the end of the 1990s only 5 percent of developing countries had inflation above 10 percent. Average tariff rates have also declined sharply in all developing regions. In South Asia, for example, the unweighted average fell from about 65 percent in 1980-85 to 30 percent in 1996-98; in Latin American and the Caribbean, from 30 percent to under 15 percent. Tariff averages are an imperfect measure of openness, but there have been even greater declines in the black-market exchange-rate premium, which is an indicator of macroeconomic instability as well as of the restrictiveness of the trade regime.43

Aid indicators of success

Another way of gauging development success is to look at the numbers of graduates from the World Bank’s soft- and hard-loan windows (IDA lending at concessional terms and IBRD lending at nonconcessional terms, respectively). We are not suggesting here or elsewhere that the Bank alone was responsible for these improvements; on the contrary, the Bank has, at best, supported countries’ own efforts and those of others. Twenty-three countries have seen their incomes increase to the point that they could graduate from IDA and remain IDA graduates, borrowing only from IBRD at nonconcessional terms. (A few others graduated from IDA but later had to return, because their economic performance had worsened and their creditworthiness for IBRD lending became limited.) In addition, 26 countries have graduated from IBRD. This includes Korea, which had started as a low-income IDA borrower but graduated from IBRD lending in 1994.44 About ten IBRD-eligible countries have developed to the extent that they have gained broad, though volatile, access to international capital markets. Most of these countries have stopped borrowing from the Bank for extended periods in which they have had good access to commercial financing, but continue to value Bank support during periods in which they are buffeted by external shocks. They also continue to draw on the Bank for advisory and other non-financial services.

Lagging countries

Not all countries have been this successful. Indeed, the number of countries that have grown slowly or stagnated over the past two decades is larger than the group of rapid integrators listed above, although the total population of these poor-performing countries is less than that of the more successful countries.45 Most notably, Sub-Saharan Africa as a region saw no increase in its per-capita incomes between 1965 and 1999, even with improved performance in the 1990s. And although Africa did make steady progress on health and education indicators over much of that period, despite the lack of income growth, the progress in increasing life expectancy has been reversed by the AIDS epidemic in many countries, as well as by malaria and tuberculosis.46

The economic decline in much of Sub-Saharan Africa stems in part from events beyond African countries’ control, including large and persistent declines in the prices of their export commodities. For example, non-oil exporters in Africa (other than South Africa) lost a cumulative 120 percent of their GDP between 1970 and 1997 as a result of changes in import and export prices. In addition,

Box 2.3. The World Bank’s Role in India: Support for Policy Reforms, Analysis, and Demonstration Projects

India throughout the 1960s and 1970s was weakly integrated into the international economy, and internally it relied heavily on physical planning and licensing. As a result, its rates of economic growth and poverty reduction were unimpressive. Though its growth accelerated in the 1980s, the growth was based largely on unsustainable public spending and foreign borrowing. This led to a fiscal and balance of payments crisis and a new, reformist government in 1991. The IMF and the World Bank helped the government to design and implement fiscal and trade reforms to stabilize and open up the economy. The work of the Bank has been of particular significance in India’s decentralization over the last half-decade, which has required the World Bank to work more and more closely with state, local, and municipal governments. The Bank opted to focus its advice and finance on several key reforming states to ensure that fiscal and structural reforms work well, lead to growth, poverty reduction, and improved social indicators, and have powerful demonstration effects for lagging states. Probably the Bank's most influential work in India has been in the social and agricultural sectors, but the Bank has also provided timely advice and financial assistance for power sector reforms in several Indian states. In the early 1990s, the Bank was an early proponent of restructuring and privatization as the solution to the chronic bankruptcy, inefficiency, and shortages that characterize India's power sector. Now the Bank is working with a half-dozen states on power sector restructuring, with the support of the central government and other partners.

In addition to its policy-based work, the World Bank supports small-scale projects with high demonstration effects. For example, we launched a land reclamation project in Uttar Pradesh in 1993 that, to date, has involved more than 85,000 families and has reversed the alkaline salts degradation of 47,000 hectares. The benefits go well beyond reclaimed land: previously landless families have received land titles (jointly, in the name of the wife as well as husband), farmers have learned new sustainable techniques, women have been empowered through self-help groups that operate small credit and saving schemes, and family incomes have increased by almost 50 percent. The project model is so successful that the government of Uttar Pradesh plans to follow it in all future sodic land reclamation. Similar stories could be told about innovative work undertaken in close collaboration with the Bank, and subsequently mainstreamed by the Government of India, in sectors as diverse as elementary education and rural water supply. In elementary education, the District Primary Education Program--initiated in 1995 with support from the Bank and a consortium of donors, and covering 15 of the country’s 29 states--has now been extended across the country by the government through its new Education for All program. In rural water supply, the Indian government adopted in 1998 a new demand-driven, community-based policy, which was very much influenced by Bank pilot projects. Twenty percent of central government funds are now allocated to states implementing sectoral reforms which are designed in ways which reflect the Bank’s direction of supportive efforts.

When the government has been committed to reform, World Bank analytical work, together with that of others, has played an influential supporting role. The Bank’s timely analytical work on trade policies helped the government in the late 1980s and early 1990s, as it began to dismantle the highly protectionist regime then in place. More recently, the Bank has been collaborating with the Confederation of Indian Industries on a survey of private firms to assess India’s investment climate in terms of bottlenecks, corruption, harassment, and infrastructure weaknesses. The results of this work have already been widely disseminated and quoted in the press, and have added momentum to the government’s efforts to dismantle the planning apparatus in India, particularly at the state level. Recent work in health and pensions is having a similar impact on policy debate.

Africa has faced geographic challenges and protected export markets, as well as many investors’ reluctance to change their risk perceptions of the continent.

However, it is not only external factors that explain Africa’s weak performance. Numerous shortcomings in domestic governance, weaknesses in institutions, and misdirected policies and investments have also contributed. Too many African countries have suffered from an investment climate that has not proven conducive to growth and productivity.47

In many of the lagging countries, there are now encouraging signs of progress. Over the past decade, and especially in the past five years, Sub-Saharan Africa has achieved very significant improvements in macroeconomic stability and governance, including widespread democratization. For example, the median inflation rate has fallen from 12 percent in 1990 to 4 percent in 2000. In 1990, 15 countries had negative growth rates, and only 17 countries had growth rates greater than 3 percent. By 2000, only 8 countries had negative growth rates, while 22 had growth rates greater than 3 percent. Perhaps most remarkable among these improvements is the peaceful transition from apartheid to democracy in South Africa and that country’s transition from hyperinflation to macro stability.

The New Partnership for African Development (NEPAD), proposed by several governments in the region, reflects a welcome recognition of the importance of domestic responsibility. It calls for a partnership in which domestic reforms will be supported by increased external assistance, including debt relief and in reductions in protectionist trade policies in rich countries. The Bank, along with many others, welcomed this partnership and is committed to working with African leaders and other partners in ensuring that the next decade does indeed see a broad-based turnaround in Africa’s disappointing development record.

The mixed experience of transition

In Eastern Europe and the former Soviet Union, the experience of transition from a centrally planned to a market economy has varied greatly across countries.48 Every country went through a "transition recession" before output began to recover, but the depth and length of those recessions differed. Countries in Eastern Europe--helped by prior experience of markets and nationhood, and buoyed by the prospect of accession to the European Union--more quickly followed policies to downsize unprofitable enterprises and encourage rapid entry of new firms. This policy package led to deep recessions, but these economies began to recover after several years of decline, and output exceeded its pre-transition levels by 2000. Today, the countries of Central Europe and the Baltics have made considerable progress with market-oriented reforms, to the point where they are poised for early accession to the European Union. (See Box 2.4 for a discussion of the transformation in a top-performing transition country, Poland.)

In contrast, the countries of the former Soviet Union experienced a prolonged recession, much deeper than the Great Depression. The severity of the recession stemmed from various factors. The dissolution of the Soviet Union, where industrialization had been based on cheap energy and subsidized transport, disrupted production and trade relationships. CIS countries also lacked any recent memory of market economies, and in a number of cases, they suffered from war and civil strife. With the exception of the Baltics, where output recovered rapidly despite the deep initial recession, vested private interests captured the state in most CIS countries early in the transition. The CIS also failed to stop fiscal and financial leakage to unprofitable enterprises and to discipline managers by developing and strengthening institutions of corporate governance. The result was large-scale corruption that undermined confidence in reforms. These countries also failed to put in place policies that would encourage new firms that can create wealth and contribute to economic growth.

Box 2.4. Development Assistance and the Successful Transition in Poland

Poland's transition performance has been excellent, both in comparison with other transition economies and in its own right. Poland was the first country to emerge from the transition recession, posting positive growth beginning in 1992. It has since maintained the highest average GDP growth rate of the non-post-conflict ECA transition economies, with growth averaging 3.7 percent from 1990 to 2001. In 1995, it became a member of OECD, and is today positioned for accession to the EU.

As in other country cases surveyed in this paper, the impetus for reform came from Poland’s government and people, and many partners were involved in providing support. Of these partners, the World Bank was an important player in the early phases of Poland’s transition process, providing strong and effective advisory and financial support during the critical early stages of the economic transformation. The Bank was involved in all key areas of the systemic reform program: supporting Poland's reentry into the world economy through trade liberalization, stabilization of the economy, strengthening the currency and balance of payments, disposing of nonviable enterprises and restructuring those with a future, softening the negative impacts of reforms on vulnerable groups, creating the institutional and legal framework for a market economy, handing over control of the economy from the planners to the market, reducing the burden of controls and monopolies, encouraging the growth of private sector business, and mobilizing and coordination other donor assistance. Bank analytical work, complemented by the dissemination activities of the Economic Development Institute (precursor of the World Bank Institute), was influential in fostering better understanding and acceptance of market-oriented policies in Poland.

The Bank was also an important contributor to reforms at the sectoral level. Bank support was significant in securing exceptional levels of debt reduction and in restoring Poland’s creditworthiness. The Bank was also deeply involved in assisting to upgrade the country infrastructure in power, energy, transport, and telecommunications; introducing new ideas, technology and production methods; and in opening the door for private sector participation. Together with the IFC, the Bank helped to set up twinning arrangements that provided valuable in modernizing several Polish banks. In agriculture, the Bank's leadership helped to coordinate the efforts of various donors and gave reform in this sector a major impetus. Across sectors, the Bank's involvement helped put in place good management practices, transparent public procurement procedures, and strong environmental protection measures.

One class of interventions that did not work very well during the early period was the support the Bank tried to provide for restructuring of enterprises through credit lines. Polish banks were not equipped to handle them, and they were quickly surpassed by the development of domestic credit flows. These projects were cancelled, with substantial undisbursed balances, when they were clearly no longer necessary.

Poland deserves tremendous credit for being a front-runner in what was essentially new territory, and taking what were at the time regarded as huge risks, including making its currency convertible, lowering trade barriers, and hardening enterprise budgets while increasing competition. Nevertheless, while the overall record is overwhelmingly positive, Poland's growth has slowed sharply in the last two years. The country still faces a formidable agenda of reforms if it is to consolidate its major achievements of the past and benefit fully from EU accession. This agenda includes managing its fiscal deficit, restructuring public expenditure, reforming agriculture, completing the downsizing and restructuring of "old" industries, reinvigorating privatization, and completing reforms in health and education.

Such measures include combating crime, both organized and otherwise; dealing with corruption; implementing legal and judicial reform to ensure secure property rights, streamlined business licensing and registration requirements; and building a tax system that encourages compliance rather than growth of a shadow economy. (Box 2.5 discusses governance challenges more generally, and the role of the World Bank in helping countries to address them over the past several years.)

Given the dangers described here, some of the early external policy advice appears, with hindsight, to have been simplistic: it concentrated too heavily on improving policies, and too little on building institutions. Furthermore, early expectations concerning the time it would take to complete the transition process turn out to have been highly optimistic. As a result of all these problems, it was not until after 1998 that the CIS countries as a group began to witness a recovery. (Recovery had

Box 2.5. Helping Countries to Fight Corruption

Far from being the grease that oils an economy, corruption has a devastating economic and social impact. Corruption cripples development, threatens the rule of law, and challenges the institutional foundation for economic growth. Poor people are hit hardest, as they are most in need of services that protect physical safety and the security of assets and contracts, and provide health and education. They are least able to pay the cost of bribes and misappropriated public expenditure. World Bank research from Romania, for example, shows that low-income households are forced to spend more than 10 percent of their household income on bribes, compared with about 2 percent for high-income households. And corruption has a chilling effect on entrepreneurship, by similarly disadvantaging the small firms where poor people are most likely to work. Bank research in Ecuador and Peru finds that small firms pay 8 to 9 percent of their monthly revenue in bribes, compared with about 1 to 2 percent for large firms. (For an extensive bibliography of research findings on governance, corruption, and development, see Annex 5 of World Bank 2000d.) Corruption also undermines investor confidence, reduces aid effectiveness, and undermines both political and grassroots support for donor assistance. Ultimately it erodes the legitimacy of the state, in some cases resulting in a complete breakdown of law and order.

Until the mid-1990s, the Bank considered corruption as a political or sovereignty issue that was too sensitive to touch. Although the Bank has always safeguarded the integrity of its own operations and had started addressing the need for institutional strengthening in client countries by the mid-1980s, only a decade later did consensus grow around the view that corruption would have to be tackled explicitly by a development organization with poverty reduction as its central mandate. Nongovernmental organizations such as Transparency International (founded in 1993) helped to raise awareness of the problem, laying the groundwork for a shift in policy.

Leading this emerging consensus, the World Bank’s President vowed in 1996, in his address at the Annual Meetings of the Bank and IMF, to fight the "cancer of corruption." Since then, the Bank has been committed to helping countries that request assistance in curbing corruption. The Bank does not seek to police corruption after the fact, but to work on the governance and public sector institutional reforms that can help inhibit it before it starts. The Bank’s multi-pronged approach includes: increasing political accountability, strengthening civil society participation, creating a competitive private sector, ensuring restraints on power, and improving public sector management. At base, the Bank’s assistance remains contingent on credible commitment by country authorities to that agenda.

Since 1997 the Bank has learned and achieved much in this difficult area, and has expanded its partnerships with other organizations and donors. It has launched hundreds of lending, analytical, and capacity-building activities in over 95 countries. In Indonesia, for instance, impetus was provided by the upheavals of the last decade, which explicitly showed the dramatic and corrosive impact of corruption on economic and development achievements. Among other measures, the Bank is now supporting a multi-donor Indonesian-led Partnership for Governance Reforms to build a government, private sector, and civil society coalition for reform. In Guatemala, the Bank is building on long-standing programs of public sector institutional reform to support governance improvements, for example in public financial accountability. In Uganda, expenditure tracking surveys revealed that between 1991-1995, on average less than 30 percent of non-wage expenditure allocations to schools were reaching their intended target, indicating massive leakage of funds. The government responded to this result by working on disbursement procedures and informing communities directly of disbursements. Receipts reported in the 2000 survey had risen to over 90 percent of disbursements.

started in many of the individual countries earlier.) As recovery has begun, however, these countries have grown more rapidly than Eastern Europe during the period 1999 through 2001.

2.4 Summary

We have learned much about the overall sources of growth and poverty reduction.

Countries have acted on this knowledge by improving policies and institutions, often with very positive growth results.

However, development has been far from universal, and the roots of slow growth and decline can typically be traced to a bad climate for investment and productivity.

 

3 Cross-Country Evidence on the Effectiveness of Assistance

Sections 1 and 2 have shown that rapid growth and development are possible, and that the development community has learned much about the policies and institutions needed for growth and poverty reduction--even if important gaps in our knowledge remain. Sections 3 through 5 focus on how best to promote improvements in policies and institutions from outside. Have external actors, particularly the World Bank, been successful in helping to foster development? What broad lessons emerge about ways to enhance the effectiveness of aid?

Before analyzing the effects of development assistance, it is worthwhile to summarize the ways in which external agents can contribute to development. Development assistance encompasses both financial and non-financial instruments used in support of a country’s own growth and poverty-reduction efforts. Resource transfer is an important part of development assistance, and the quantitative analysis in this section will focus largely on the effects of lending operations. But finance is only one of the instruments used to support development, and in some situations, it is not even the most useful one. Development assistance also includes analysis, advice, and capacity-building, either packaged with lending or on their own. Many of the country boxes in this paper highlight the importance of these nonlending tools, especially in environments--such as early in a reform era--when finance is not likely to contribute to poverty reduction. The mixture of instruments to be used in any particular country depends on the specifics of that country’s needs and capacity.

As discussed in the Executive Summary, any attempt to assess the effectiveness of development Assistance--and in particular of a single institution, such as the World Bank--confronts inherent analytical difficulties. The complexity of social and economic change means that the impact of aid cannot be separated easily from other factors. Because successful development requires country ownership, outside agents are unlikely to be the prime movers of development. Indeed, where they are central to the process, the sustainability of reform efforts may be in doubt. Even where external actors are clearly important, they will be most effective working in partnership with other external and internal partners, which makes it difficult to give credit or blame to any single institution. Finally, the need to "scale up"--to ensure that assistance is replicated or institutionalized, so that it has effects far beyond the boundaries of the specific intervention--means that even identifying the outcomes of a particular intervention is difficult.

To address these difficulties, we draw on as many types of evidence as possible. This section begins with the big-picture question of how to allocate and deliver large-scale financial assistance, drawing heavily on evidence from cross-country regressions. This type of analysis allows us to identify statistical correlations between aid flows and policy, on the one hand, and growth and poverty reduction on the other. Country cases (in boxes throughout this paper) and project evaluations (in Sections 4 and 5) complement the cross-country analysis by showing that results on the ground are consistent with the macro evidence.

3.1 Aid has a strongly positive effect on development--and this effect has grown in recent years, thanks to improved allocation and design.

At the economy-wide level, the evidence suggests strongly that aid promotes development, if the aid is provided under the right circumstances and with the right design. ODA in general has historically delivered substantial poverty reduction, and the poverty-reducing impact of ODA has increased in the past decade due to improved design and allocation. Empirical studies have shown that:

The evidence on the effectiveness of aid has at times been ambiguous--but this is because early research failed to distinguish between different types of aid and recipients.

When all aid is lumped together, some analyses have found no clear relationship between aid and growth or poverty reduction.49 But not all aid is aimed directly at poverty reduction, nor has aid always been provided in ways that will maximize growth. Moreover, because aid is often provided to help countries cope with external shocks, even if aid is reasonably well-designed and allocated--and thus effective in helping the poor--the positive impact of such aid may be obscured by the magnitude of the shocks.

Disaster relief, for example, is not aimed directly at long-term poverty reduction, and thus it is no surprise that such aid is not correlated with that result.50 However, it does achieve its goal of helping to avert famine or assisting countries to recover from natural disasters. Similarly, large amounts of aid were directed at supporting the transition in Eastern Europe and Central Asia (ECA), for both political and economic reasons. There, the mandate in the early 1990s was explicitly to help transform these countries into market economies, rather than to focus directly on reducing poverty. More recently, as Box 3.1 explains, the World Bank has played an important role in the international effort to

Box 3.1. The World Bank in the Balkans: Development Assistance for Reconstruction and Stabilization

When the military conflict in Kosovo occurred in March 1999, the international community quickly recognized the potential economic dislocation for the region and the need for a coordinated response, not only in Kosovo but also in neighboring countries affected by the large influx of refugees, trade disruptions, and the collapse of investment. At that time, the G7 Finance Ministers requested that the World Bank and the European Commission lead the coordination effort of all bilateral and multilateral aid to the Balkans.

In response to this mandate, the World Bank played a key role in the reconstruction and development of South Eastern Europe, through:

  • direct financial assistance--$600 million on average to the region, reaching $1 billion in the immediate aftermath of the Kosovo conflict;
  • provision of advice on economic recovery and transition, institutional development, social policies, and design of regional development projects; and
  • guidance of overall donor assistance, including assessment of financing needs and priorities for external financing.

The value of the Bank’s contribution has been in its ability to deploy rapidly in response to change, developing in collaboration with its many partners a coherent view of economic and social development needs--beyond emergency and reconstruction--and thus facilitate the interventions of other donors:

  • Based on the experience gained in other conflict-affected regions such as Bosnia and Herzegovina and the West Bank and Gaza, the Bank worked In Kosovo and more recently in Yugoslavia from the beginning with many international and local organizations to build strong institutions and introduce market reforms, in order to ensure sustainable development beyond physical reconstruction.
  • To support economic cooperation and integration, the World Bank worked in close partnership with the European Commission, the European Investment Bank (EIB), and the EBRD to develop (a) a $2 billion Quick Start Package of regional projects and programs, and (b) sectoral strategies and a financing mechanism for priority projects to implement these strategies.
  • Following the change in government in Yugoslavia in October 2000, the World Bank provided policy advice and technical assistance for the development of the government’s Economic Recovery and Transition Program, which outlined a comprehensive reform agenda, assessed financing needs and priorities, and provided the foundation for coordinating donor assistance to Yugoslavia.

It is difficult to assess the impact on the ground of the Bank’s and its partners’ many interventions, as only two and a half years have passed since the crisis. However, there are some early indications of what specific projects have achieved:

  • The Kosovo Community Development Project benefited some 183,000 community members over the last two years through infrastructure microprojects in water supply, school rehabilitation, attention to sewage systems, and road building and maintenance, as well as social services projects and special training programs.
  • To relieve Albania’s immediate budgetary pressures from the massive inflow of refugees from Kosovo, the Bank processed and disbursed within 30 days a Public Expenditure Support Credit ($30 million).
  • A post-conflict grant to FYR Macedonia ($2 million) addressed the needs of refugee children and youth and those of the hosting communities. The grant has reached 5,000 families through an Early Child Development network of mothers in disadvantaged communities inhabited by ethnic minorities or mixed groups. An additional 13,000 youth at risk have been reached through activities promoting social cohesion.
  • An Emergency Economic Recovery Credit to FYR Macedonia ($15 million plus $25 million in cofinancing from the Netherlands, approved in December 2001) is helping to finance the budget on a noninflationary basis and ease the foreign exchange constraint on the private sector, at a critical time after the crisis and while development aid had not yet resumed.

On a macro level, significant financial and technical resources have been mobilized in support of the region, regional cooperation has significantly improved, and the region as a whole has resumed growth:

  • Over $6 billion of aid per year have been mobilized, on average, between 1999 and 2001 for the seven countries of the region.
  • Intra-regional trade has increased since 1999, not only in value but also as a share of total foreign trade, and a region-wide memorandum on free trade has been agreed.
  • Growth in the region rebounded, from about 2 percent in 1999 to over 4 percent on average in 2001, with the exception of Macedonia.

Regional tensions have not been fully overcome, as evidenced especially by developments in Macedonia, but the coordinated regional program has helped to lessen those tensions.

promote peace and stability in the Balkans--a mission that is essential to poverty reduction, but not identical. Much aid during the Cold War was provided for military-oriented reasons, rather than developmental ones. In all of these cases, the lending--whether it is for transition or disaster relief or post-conflict stabilization--can help to build the foundations for poverty reduction, but the effects may appear only after a long lag. The end of the Cold War and the progress in transition have made possible a more direct targeting of aid to poverty reduction.

Beyond noting that aid with different goals has different results, research has also found that it is important to distinguish among the different environments in recipient countries. Aid to countries with relatively good policies and institutions has very different effects than aid to countries with worse policies and institutions. (Section 3.1 will address how best to assist the latter group of countries, given that large-scale aid is typically not effective in these environments.)

Finally, the returns to aid will often be difficult to gauge because of the circumstances in which it is provided. Some developmentally successful countries, such as Korea in 1998, have received large aid inflows during periods of economic setbacks--creating a misleading statistical correlation between aid and poor economic outcomes. Natural disasters will produce a similar correlation. In both cases, analysis of the proper counterfactual would often show that, relative to what would have happened otherwise, aid has contributed to better outcomes.

Research shows that ODA reduces poverty and spurs growth substantially when it goes to developing countries that have reasonably good policies and institutions.51

Experience and analysis have shown that it is generally not enough for donors simply to design projects well. In poor overall policy and institutional environments, the payoffs to flows of large-scale financial aid are on average very small. But where the environment is at least moderately good, then aid typically has large payoffs, as the remainder of this section will explain.52

Why would the overall environment matter so much in determining the effectiveness of ODA? The first reason is very straightforward: policies and institutions affect project quality. For example, a major reason for the dramatic decline in measured World Bank project outcomes in the 1970s and 1980s was the deterioration in policy quality and governance in many borrowing countries. No matter how well designed, a project can easily be undermined by high levels of macroeconomic volatility or of government corruption.

The second reason is more subtle. Even if a project does seem to succeed--based on narrow measures of economic returns and attainment of project objectives--the actual marginal contribution of aid funneled through that project may be small or even negative. This is because government resources are often largely fungible: money can be moved relatively easily from one intended use to another.53 Thus if donors choose to finance a primary education project, displacing local money that would have been used for education, that local money could then be shifted to less productive purposes, such as military spending. In a country with poor public expenditure management, the displaced money could even be diverted to the personal uses of corrupt officials. In this case, the indirect but very real effect of aid could be to promote corruption.

Overall donor financial assistance is targeted far more effectively at poverty reduction than it was a decade ago.

During the 1990s, overall aid allocation shifted in favor of countries with good policies. Aid is always driven by a variety of factors--poverty reduction goals among them, to be sure, but also geopolitical considerations, former colonial ties, human rights concerns, and other factors. During the Cold War, factors unrelated to poverty were especially important in driving aid allocations. This can be illustrated by both example and quantitative evidence:

Since the end of the Cold War, and increasingly through the 1990s, donor countries and other aid agencies have reallocated assistance in ways that strengthened poverty reduction.

It was not only waning geopolitical concerns, but also a more extensive knowledge base and greater transparency that have contributed to this shift. Research into aid effectiveness undermined both polar positions about aid: that aid was always effective or that aid was never effective. This knowledge helped to focus attention on the key question of whether the right countries were receiving aid. The continuing challenge is to keep development aid focused on poverty reduction and to improve its effectiveness.

Despite the improvement in aid targeting and effectiveness, donor countries have not responded with an increase in ODA flows; in fact, those flows decreased during the past decade.

Aid flows dropped substantially over the 1990s in real terms, and by 2000 stood at about 7 percent less than the 1990 level. With the growth in incomes in the rich countries over that period, aid levels expressed as a share of donors’ GNP fell even more sharply--from 0.33 percent in 1990 to 0.22 percent in 2000. By the end of this period, aid accounted for less than 1 percent of donor countries’ total government expenditure.56

World Bank assistance has on average been well targeted at poverty reduction.

Like other types of ODA, IDA was affected by pressures to lend to countries for reasons not directly connected with poverty reduction, particularly during the Cold War. Nevertheless, the evidence suggests that IDA lending was less affected than overall ODA. We can see this in the statistics on the relationship between poverty, policy, and IDA. Even in 1990, much more IDA went to the good-policy countries ($4.7 per capita) than to the poor-policy countries ($2 per capita). And IDA was already more than four times as responsive to policy improvements than ODA was (in that a 1-point improvement in policy on the Bank’s rating scale led to a 36 percent increase in aid per capita).

By the late 1990s, IDA allocation had improved substantially even from this good base. Good policy countries now received $6.5 per capita, compared with $2.3 per capita in poor-policy countries. Or, to express it in terms of marginal efficiency of poverty reduction, an additional $1 billion allocated like average IDA would lift 434,000 people out of poverty. This means that IDA is about 60 percent more efficient than it was in 1990, and 50 percent more efficient than overall ODA.57

High IDA repayment rates are also consistent with the view that the aid is going to countries that typically are able to make good use of it.

Table 3.1. IDA Overdue Payments, 1992-2001

Fiscal year

1992

1993

1994

1995

1996

1997

1998

1999

2000

2001

Amount
(US$ million)

6

15

49

43

50

57

49

102

95

82

As share of expected
repayments (percent)

1

2

6

4

5

5

4

6

5

5

Nonconcessional lending (IBRD) also goes primarily to countries with good ratings for policies and institutions. It does not typically go to countries with the highest ratings, for reasons noted above: these countries tend to have good, if volatile, access to capital markets and may not borrow from IBRD during periods of good access. Over the last 5 years (FY96-01), about 40 percent of all IBRD-eligible countries received good ratings (not including countries with the highest ratings), but these borrowers accounted for more than two-thirds of all new lending commitments.

Well-targeted aid not only reduces poverty, but also has far wider effects. Aid crowds in private investment, both domestic and foreign, by improving the investment climate.

Well-designed aid crowds in private investment, both domestic and foreign. Aid is not simply a transfer payment for the consumption of poor people, but an investment in improved policies and institutions. The best aid finances the costs of change, rather than the costs of not changing.

As a result, the investment climate improves when aid is well designed and well allocated. Research shows that IDA flows on average lead to increases in gross investment nearly twice as large as the value of the aid itself. In good policy environments, in both low- and middle-income countries, aid also increases foreign direct investment substantially--by 60 cents for each dollar of aid.

Aid spurs economy-wide growth, benefiting people of all income groups; and as a result, it has very high overall returns.

The "crowding-in" effect on investment means that the returns to aid are far higher than the poverty-reduction effects alone would suggest. Indeed, IDA has an estimated average rate of return as high as 41 percent.

China is an excellent example of a country in which aid investments in support of a country-owned development strategy helped to improve the investment climate and encourage rapid private-sector-led growth and poverty reduction (Box 3.2). But the crowding-in effects of aid extend also to smaller countries whose reforms are less well known to investors. In Mauritania, for example, aid-supported reform of telecommunications has prompted a surge of investments and economic activity (Box 3.3).

Excessive lending (including by official agencies), unfavorable shocks, and weak policies led to unsustainable levels of debt in many low-income countries, with the debt overhang contributing to poverty traps. The HIPC debt relief initiative has attempted to reduce this barrier to development.

Box 3.2. World Bank Assistance and Reform in China

China was a low-income country when it began its market-oriented reforms in the late 1970s, after 30 years of attempts at various forms of a planned economy. The World Bank’s interaction with China had a real impact in sustaining the reform momentum, as confirmed by independent analysis. It provided top Chinese policymakers with the first in-depth overall economic analysis of China’s development problems, as well as studies of key sectors in the 1980s. The Bank helped to increase the confidence and persistence of reformers, recommended some specific policies and institutions, and trained government officials in "market economy" skills (from project financing to international procurement). Bank assistance was instrumental in helping the Chinese economy engage with the outside world, both through advice on trade liberalization and exchange-rate unification, and through helping modernize Chinese ports. In short, at a time when the government was very suspicious about the outside world, the World Bank was a trusted advisor and helped lay the foundation for the private investment that has underpinned China’s success.

The result of China’s reform has been the greatest poverty reduction in history, with much of the reduction in absolute poverty taking place in rural areas. The sharp fall in rural poverty (from 34 percent of the population in 1985 to 18 percent in 1998) benefited from about 65 Bank-assisted rural development projects and associated sector work, including studies aimed specifically at identifying and addressing the changing causes of acute rural poverty. Bank partnership with China in the social sectors, most notably in a series of large-scale basic education and health projects, contributed to the steady progress made in human capital development and the striking improvements in development indicators. Bank policy advice and financial support similarly assisted China to put in place the physical infrastructure and related sectoral policies critical to national growth, particularly construction of the transport system that facilitated market integration and energy policies increasingly shaped by bold reform goals. Finally, the past decade saw major progress in the Bank’s assistance to China in formulating and pursuing a much-strengthened national environmental agenda.

In the whole range of this work--and China is the Bank’s largest client for both policy advice and investment support--the Chinese government has shown strong commitment to the Bank. A key indicator of that commitment is the strength of the China project portfolio, which has for years been one of the Bank’s best-performing portfolios.

 

Box 3.3. Making Competition Work in Infrastructure: Telecommunications Reform in Mauritania

In mid-1998, Mauritania faced several constraints as it embarked on a program of competitive and private provision of infrastructure services: relatively high country risk, a small domestic market, and a virtual absence of institutional capacity for regulating competitive utility sectors. By the end of 2001, Bank-supported reforms in telecommunications had largely overcome these constraints, laying the foundations for similar reforms in other utility sectors such as power and water. The monopoly of the state-owned telecommunications operator ended in mid-2000 when the first mobile telecommunications license was granted through a competitive tender; the tender generated proceeds of $US28 million, a record among emerging market economies. Eight months later, in February 2001, a competitive tender for privatizing the state-owned operator yielded a post-privatization enterprise value of $4065 per access line, well above the previous record for Sub-Saharan Africa as well as the world average of $2500. Competing in all segments of telecommunications services, both operators have now multiplied access lines from 20,000 at the beginning of 2000 to over 130,000 by end-2001. Furthermore, competition has accelerated investment in the sector, which in just two years (2000 and 2001) totaled more than 10 percent of GDP.

A windfall from competition has been the creation of 2000 telecommunications-related jobs in the informal sector, as over 300 microenteprises have sprung up in the main cities to sell prepaid calling cards and mobile handsets and repair telephone equipment. Similar reforms in the power sector have benefited from a significantly improved country risk as well as a well-tested instititutional framework for privatization and for regulation.

During the commodity price boom of the 1970s, many poor developing countries responded by increasing domestic expenditures. These expenditures were amplified through increases in external borrowing, including from multilateral, bilateral, and commercial sources. Both the borrowing countries and the lenders believed incorrectly that high commodity prices and export earnings would be long-lived.

When an oil-price shock and global recession hit in the late 1970s and early 1980s, the borrowing countries suddenly faced a debt service crunch. Commodity prices turned sharply against the non-oil commodity exporters, making it difficult to pay for both imports and debt service. Official lending increased to help cushion the effects of the shock, and to substitute for finance from commercial sources, which soon evaporated. Official lending and grants then continued as support for adjustment of policies to the new environment.

But in many of the highly indebted countries, the expected improvements in policy performance did not materialize, whether because of insufficient commitment by borrowers or because the design of the adjustment had not paid enough attention to social concerns. (Section 3.2 discusses the problems of spurring growth when borrowing countries are not sufficiently committed to reform.) In other cases, reforms did not lead to the expected supply and growth response. As a result, the GDP average growth rate between 1980 and 1987 of the 33 countries that were characterized in the mid-1990s as the most severely indebted low-income countries was just 1.9 percent--which translated into an income decline in per capita terms. The cumulative effect of the shock and economic decline was that a debt burden that had been very reasonable quickly became unsustainable. Between 1982 and 1992, the debt-to-export ratio of these 33 countries rose from 266 to 620 percent.60

The international community has attempted to address the problem through a variety of debt-reduction mechanisms since the late 1980s. In 1996, it went a step further, creating the Highly Indebted Poor Countries (HIPC) debt relief initiative. Box 3.4 describes briefly the design and achievements of this initiative.

Box 3.4. The Highly Indebted Poor Countries (HIPC) Debt Relief Initiative

Efforts to deepen debt relief for poor countries suffering from unsustainable debt burdens culminated in the Highly Indebted Poor Countries (HIPC) Initiative, launched in 1996. This initiative aims to increase the effectiveness of aid by helping poor countries achieve sustainable levels of debt while strengthening the link between debt relief and strong policy performance. Forty-two countries, primarily from the Sub-Saharan Africa region, are identified as eligible to receive debt relief under this initiative. In 1999 the scope of the initiative was widened to accelerate and deepen the provision of debt relief. As of December 2001, 24 countries have reached the decision point 1 (the point where debt relief is approved by the Executive Boards of the IMF and the World Bank, and interim relief begins). These countries are now receiving debt service relief that will amount to about $36 billion over time, with a $21 billion reduction in the present value of their outstanding debt stock.

For the 24 countries that have reached their decision points, HIPC alone has reduced the present value of external debt by about half. When combined with other debt reduction mechanisms, this implies a two-thirds reduction in these countries’ external indebtedness.

Not only does HIPC reduce debt overhang, but it also supports positive change toward better poverty reduction. Debt relief under the HIPC Initiative is intended for countries that are pursuing effective poverty reduction strategies, and both better public expenditure management and increased social expenditures are critical elements of this. For the countries that have reached decision points under the HIPC Initiative, the ratio of social expenditures to GDP is projected to increase from 5.8 to 6.9 percent between 1998-99 and 2001-03. The challenge is to ensure that these expenditures translate into better social-sector outcomes, and more importantly that the broader policy environment continues to improve and support growth and poverty reduction.

It is important to note that although official lending contributed to debt accumulation in these countries, and debt reductions through HIPC have generally been substantial, problem lending was only a small portion of total IDA lending. Most of the population of the low-income world is in countries that have been able to keep their debts at sustainable levels; as a result, the estimated total IDA debt forgiveness under HIPC amounts to about 13 percent of the portfolio.

The development community now recognizes that large-scale financial assistance has little effect on poverty reduction in countries with weak institutions, policies, and governance. The World Bank is working to increase its knowledge and effectiveness in this important and difficult area.

While aid effectiveness requires that large-scale financial assistance be allocated to poor countries that have demonstrated the capacity to use aid well, the international community cannot simply abandon people who live in countries that lack the policies, institutions, and governance necessary for sustained growth and for effective use of aid. Poor people in these countries are among the poorest in the world and face the greatest hurdles in improving their lives. Experience suggests that current technical assistance for capacity-building efforts, as well as the promise of greater financial assistance if policies, institutions, and governance improve, are often insufficient to enable these countries to initiate and sustain reform. A World Bank task force is now exploring new approaches for helping people and fostering change in these countries, which are sometimes known as Low Income Countries under Stress (LICUS).

Of the two or three dozen countries with the poorest institutions and policies, only a few have made major improvements in the environments for growth and poverty reduction over the past decade, in contrast to the broad improvements in policies in other developing countries. Ethiopia, Mozambique, and Uganda are unusual among LICUS countries in having achieved significant progress.61 (See Box 3.5 for a discussion of the role of Bank assistance in Mozambique.) Other LICUS countries have seen little development progress, and the performance of the Bank lending portfolio in this group has been poor: projects have failed at double the rate for other countries.

Approaches that work in the typical low-income country may not be appropriate in the LICUS, as they typically lack the basis for county leadership of reform, and traditional lending conditionality has not worked well in inducing and supporting reform. Given the weaknesses in governance and central institutions, there may at times be a role for the development community to become more directly involved in the provision of basic health and education services.

These countries vary widely in their problems and opportunities. As is the case for the better-performing countries, no single strategy will be appropriate for all of the LICUS; each country has its specific challenges and must look to its unique solutions. Nevertheless, it is useful to distinguish approaches in LICUS countries from those that will work in countries with better policies, institutions, and governance.

Box 3.5. Mozambique: From Civil War to Rapid Growth

Mozambique over the last decade has emerged as an example of successful reform, one that is perhaps less well known than others discussed in this paper. The country emerged in 1992 from a long civil war, which--together with bearing the costs of its frontline status in isolating the apartheid government in South Africa--had left the country one of the poorest in the world. GDP per capita in 1992 was only $133.

In the years following the end of the war, the World Bank helped the government to design and implement key measures in financial liberalization, exchange rate reform, trade liberalization, and privatization through a series of adjustment operations. The ensuring recovery has been impressive:

  • After growing just 0.1 percent on average over the previous decade, GDP grew at an average of 8.4 percent annually from 1993 through 2001.
  • Inflation, which had averaged 53.3 percent annually between 1993 and 1996, fell to an average of 3.3 percent in 1997-99.
  • Social indicators also improved in this better environment: the gross primary admission rate rose from 57 percent in 1995 to over 100 percent in 2000, while the repetition rate fell somewhat from 26 percent in 1995 to 23 percent in 2000.
  • Private investment, crowded in by the better policies, helped to spur this growth. For example, direct foreign investment grew some 500 percent between 1992 and 2001.
  • Export growth improved dramatically, from -6.8 percent (1980-90) to 15.1 percent (1990-00)
  • Agricultural growth was revitalized, accelerating from 1.3 percent annually (1985-92) to 9.8 percent annually (1993-01).

Other intermediate indicators show progress toward a better environment for growth and poverty reduction. Government transparency and accountability have increased: a Medium Term Expenditure Framework was introduced in 1999, and publication of quarterly budget execution reports started in 2000. Furthermore, more resources are being allocated to the social sectors: under HIPC, combined current expenditures on health and education increased by $60 million in the two years to 2000, accounting for more than 80 percent of the total increase in current spending over the period.

Not everything has gone well. Two banks that were partially privatized in the mid-1990s experienced problems owing in part to a lack of internal controls, requiring reprivatization and recapitalization. And Mozambique still faces very serious development challenges: a country-wide HIV prevalence rate of some 12 percent; a judicial and legal system in need of reform; and a tax system that yields revenues of only 12 percent of GDP, well below the average for the region. Nevertheless, the progress over 10 years has laid a good foundation for tackling these and other development problems.

3.2 In the right environments and with the right design, adjustment (or policy-based) lending has been broadly effective in spurring growth.

Laying the foundations for growth typically requires considerable structural reform of the economy. To support this process, the Bretton Woods institutions have provided structural adjustment loans for the past two decades. Adjustment lending is intended to help member countries design and implement reform programs that contribute to the creation of economic conditions that are conducive to economic growth. Adjustment lending grew out of the recognition that, as discussed in Section 3.1, the overall policy and institutional environment heavily influences the success rate of projects; and that with the oil shocks of the 1970s, the overall environment had become far less favorable to development.62 With experience, the Bank has learned to better take into account the potential distributive impacts of some aspects of structural adjustment programs. The Bank now works with borrowers to strengthen social protection mechanisms in order to ensure that poor people do not bear an unfair share of the short-term adjustment costs.

Adjustment can contribute, and often has contributed, to growth and poverty reduction.

In assessing the effectiveness of adjustment lending in spurring growth and poverty reduction, it is important to look separately at the impact of adjustment on growth and poverty reduction and the link between adjustment lending and the design and implementation of adjustment programs.

Some observers have questioned the existence of a systematic link in developing countries between significant economic reforms--or structural adjustment--and economic growth and poverty reduction.63 However, as noted above, there is strong evidence of a clear and robust link between improving economic policies and growth, and between growth and poverty reduction.64 First, economic growth in developing countries on average increases the income of poor people proportionally: that is, as noted earlier, a 1-percent increase in per-capita GDP tends on average to lead to a 1-percent increase in the incomes of the poorest quintile of the population. (It is important to stress that this is only an average, and that specific countries, regions, or groups may be left behind; adjustment design and implementation need to anticipate and respond to this variation in outcomes.)

Second, cross-country evidence shows that successfully implemented adjustment policies have tended to increase growth rates on average with little effect on income distribution. Policies such as trade openness, low inflation, moderate size of government, and strong rule of law have generally benefited the incomes of poor people as much as those of anyone else. Indeed, stabilization of high inflation has tended to benefit the poor more than others. Furthermore, since adjustment programs are often launched in times of economic crisis, their effect on growth and poverty reduction tends to be underestimated in cross-country analyses. Research simulating the effect of not adjusting as a counterfactual suggests that adjustment experiences were both better for economic growth and more equitable than not adjusting.65

Generally, these findings support the view that structural adjustment can be a powerful instrument for growth and poverty reduction, but it is equally clear that in specific country experiences the distributional impacts can be quite different from the average. This suggests the need for carefully analyzing the poverty impact of adjustment policies under local conditions, to ensure that we can support an adjustment with positive effects on poor people.

The performance of adjustment operations has been mixed, especially during the 1980s, as a result of insufficient country ownership and insufficient attention to social dimensions.

Adjustment lending helps countries to undertake reforms and smooth the transition costs associated with adjusting to economic shocks--but only if critical reforms are actually carried out. The record of World Bank adjustment lending is mixed in this regard;66 it includes both a number of success stories and a number of cases where adjustment lending was not followed by reform implementation.67

Bank reviews and studies concluded from the experience of the 1980s that country commitment is one of the most critical conditions for ensuring the success of reforms supported by adjustment lending.68 Evidence has shown that policy change is driven by the country’s own initiative, capacity, and political readiness, rather than by foreign assistance and associated loan conditionality.69 Heavy reliance on conditionality is ineffective for several reasons: it can be difficult to monitor whether a government has in fact fulfilled the conditions, particularly when external shocks muddy the picture; governments may revert to old practices as soon as the money has been disbursed; and when assessments are subjective, donors may have an incentive to emphasize progress in order to keep programs moving. Without country ownership, adjustment lending has not only failed to support reforms, but has probably contributed to their delay. For example, case studies of Côte d’Ivoire, Kenya, Tanzania, the Democratic Republic of Congo, and Nigeria all concluded that the availability of aid money in the 1980s postponed much-needed reforms.70

In practice, country commitment has often proved difficult to assess. For example, a government may be seriously committed to a reform program but subsequently find it impossible to implement key measures, sometimes for reasons not fully under the government’s control. In other cases, the government may be interested primarily in the funds, not in the reforms on which the funding is conditional. For this reason, the government’s track record--measured by the quality of the policies and institutions it has already put in place--is often a good indicator of its commitment to reform. Research has shown that in good policy and institutional environments, well-designed adjustment lending succeeds in accelerating, broadening, and deepening reforms and in enhancing their impact on growth and poverty reduction.71

Early adjustment operations also sometimes suffered from insufficient attention to the social dimensions of adjustment. As noted above, the evidence suggests that on balance poor people benefit from adjustment and reform as much as other groups.72 Nevertheless, even successful, market-friendly reforms have benefits and costs that are distributed unevenly, especially in the near term, and design and implementation of adjustment operations needs to take this factor into account.

The World Bank has applied these lessons through better targeting of adjustment loans and more selective use of conditionality.

The Bank has increasingly focused adjustment lending on borrowers with a satisfactory track record. At the same time, the Bank also supports reforms in countries where improvements in the policy environment suggest the potential for a turnaround. Judging from CPIA ratings, the strength of the link between IDA disbursements and country policy performance tripled between FY90 and FY97-98. The increasing performance-based selectivity in World Bank (IDA and IBRD) lending decisions also shows up in the share of adjustment loans to countries with above-average performance on a broad range of policies, again according to CPIA ratings. In FY95-00 that share amounted to 72 percent.

Increased country selectivity--due to learning and the post-Cold War decline in geopolitically motivated lending--led to dramatic increases in the development effectiveness of adjustment lending, as evaluated by the independent Operations Evaluation Department (OED).73 OED’s outcome ratings typically measure to what extent an operation has achieved its objectives and thus provide a good indicator for the strength of the link between adjustment lending and the implementation of the program being supported by the loans. The share of operations rated satisfactory in outcome increased from 68 percent in FY90-94 to 86 percent in FY99-00.74 In terms of lending volumes, the

Box 3.6. Vietnam and the World Bank: Learning before Lending 1

Vietnam has moved strongly to reform its economy and reduce poverty over the past dozen years, beginning when it was still politically and economically estranged from major donors and therefore unable to receive large-scale aid. The Bank began cautiously to provide advice to Vietnam in 1989, at a time when the country’s disastrous economic policies had produced a crisis of hyperinflation, falling economic activity, and mass exodus of economic migrants. Although it did not provide finance until 1993, the Bank advised the government on stabilizing the macroeconomy, opening to foreign trade and investment, and reforming property rights (through return of land to household farmers and introduction of laws for private companies and foreign direct investment).

Vietnam saw strong results from its initial reforms, and by 1993 the economy was growing rapidly in the reformed environment. At that point, infrastructure problems (ports, roads, and power) became serious bottlenecks. The Bank then began to finance projects that combined infrastructure development with policy reform to encourage private-sector participation. The Bank also helped with reform and expansion of the primary education system, which has helped ensure broad participation in Vietnam’s growth and development. Bank-designed household surveys in 1992 and 1998 demonstrate the effectiveness of reform: the poverty rate was cut from 58 to 37 percent in just six years.

Dramatic poverty reduction in Vietnam--as in China, India, Uganda, and other countries highlighted here--did not depend on getting everything right. All of these countries continue to face major development challenges, and suffer from gaps in areas of policies, institutions, and governance; none has achieved a perfectly well-functioning market economy. Their success shows that the returns to moving in the right direction can be very strong, and that development assistance can help (and has helped) countries to make that progress.

increase was even more pronounced, from 73 percent in FY90-94 to 97 percent in FY99-00. OED ratings of long-term sustainability (an assessment of resilience to risk) and of institutional development (the contribution of operations to capacity building) also increased over the same period. The share of satisfactory ratings of sustainability increased from 62 to 81 percent, and that of satisfactory ratings of institutional development increased from 44 to 71 percent (both percentages refer to the share of lending in dollar terms).

Stronger borrower ownership has contributed to more successful adjustment.

As noted above, experience with adjustment lending has been mixed, although the quality of such lending has improved over time. Adjustment lending was most successful when there was strong government involvement in the design of the program, the country had relatively good institutions, and the program extended beyond the confines of a specific Bank operation.

A good example of the latter condition is Mexico’s rural sector. In the late 1980s and early 1990s, the Bank was involved in two agricultural adjustment loans, which supported privatization and price liberalization. However, some of the most important aspects of the government's adjustment program were not financially supported by Bank lending. Rather, they came about as a result of the dialogue and analysis that were initiated with adjustment loans (such as the land reform of the ejido sector, as well as the trade and price liberalization of their major crops, maize and beans).75

This Mexico example is not unique. Other developing countries such as Vietnam (see Box 3.6) have also had strong country ownership of their reforms, and have charted their own course while making good use of international assistance (both knowledge-based and financial). But other countries have borrowed without fully accepting the conditions placed on the loans, and both reform design and implementation have suffered as a result.

3.3 Donors and recipient countries have worked to make aid more effective through the PRSP process, which stresses greater country ownership and a poverty outcomes approach.

The lesson that strong borrower ownership is essential for economy-wide reform, together with the need for improved coordination among donors and greater attention to poverty goals, led the World Bank, the International Monetary Fund, and their partners to adopt a new framework for development assistance organized around the recipient’s preparation of a Poverty Reduction Strategy Paper (PRSP).

The PRSP approach

In December 1999, the Boards of the IMF and the World Bank approved a new approach to the challenge of reducing poverty in low-income (IDA) countries, based on country-owned poverty reduction strategies that would serve as a framework for development assistance. As of December 2001, 41 countries had prepared Interim-PRSPs (I-PRSPs), and 10 countries had completed full PRSPs. The underlying goals of the PRSP process (reflecting the principles of the Comprehensive Development Framework) are to ensure broad-based country ownership of poverty reduction strategies; develop strategies that take a comprehensive, long-term perspective; focus on results that matter for the poor; and to build stronger partnerships between low-income countries and the international donor community.

Early results of the PRSP approach

After two years of implementation of the PRSP initiative, the IMF, the Bank, the PRSP teams and partners collected their experience in order to learn how to implement PRSPs most effectively. The PRSP approach, with its emphasis on country ownership and flexibility, challenges the multilaterals to change their way of working. The current review of the PRSP process reveals that there seems to be widespread agreement (among national PRSP teams, donors, and civil society organizations) on five key achievements:

Recent IMF staff analysis has compared budget allocations from 1999 (pre-PRSP) with the projected expenditure levels for 2001–02 for 32 low-income countries with active PRSP programs. The results clearly indicate that full PRSPs are associated with an increased emphasis on "pro-poor spending."77 For the first group of seven countries with full PRSPs, the increase in "poverty-reducing" spending is about 20 percent larger from 1999 to 2000-01 than for the other PRSP countries analyzed. Overall increases in such spending for the full PRSP countries, relative to 1999, has been substantial, on the order of 30 percent of the budget as a share of GDP (that is, poverty-reducing spending is projected to rise from 7.7 to 10.2 percent of GDP between 1999 (pre-PRSP) and 2001-02). While these results are encouraging, this is obviously a narrow measure of success. It is important to bear in mind that these budgetary reallocations will translate into improved poverty outcomes only if there are corresponding improvements in budget execution, service delivery, and access for the poor, and in the investment climate. It is in large measure the investment climate that will determine whether there are job opportunities to match the growth in human capital.

Participants in the PRSP review also identified areas for improvement. They noted that the task of developing a strategy that deals comprehensively with macroeconomic policy, structural and sectoral reforms, governance issues, social inclusion, and the medium-term public expenditure program is extremely complex. Targets set by countries are often overly ambitious. Policy changes and programs to reach them should be better prioritized, so as to ensure realism and to facilitate effective implementation. Setting clearer priorities will require better understanding of the impact of policy actions on the poor, improved public expenditure management systems, and a greater investment in monitoring poverty outcomes. Another challenge concerns the human development sectors, such as health and education; a recent review suggested that these sectors (including their budgetary implications) were not fully integrated with the rest of the PRSP.

Finally, the interaction among the principles of country ownership, partnerships, and results orientation also gives rise to an issue that bears special mention: the potential tension between the principle of country ownership and the need for donors to be accountable for the effective use of their resources. Inevitably, there will be some divergence in donor and country views about the right policies and about capacities for implementation. Donors are being called on to align their assistance programs to support in a coordinated manner some, if not all, aspects of countries’ PRSPs, within the institutional and capacity constraints that each donor faces. Donors--including the World Bank--as part of their contribution need to apply the lessons on pro-poor growth and to support countries to undertake the necessary reforms. This is likely to be a permanent part of development assistance, and addressing it is part of the job of donors. With the PRSP process, this is beginning to happen.

3.4 Summary

Macro-level evidence shows that development assistance has generally accelerated growth and poverty reduction, and that its poverty-reduction impact has increased over time.

World Bank assistance is, on average, well targeted at reducing poverty.

Well-targeted aid (such as IDA) crowds in private investment, by improving the investment climate. As a result, it promotes broader economic growth and has high average overall returns.

Adjustment (or policy-based) lending in the right environments--countries with reasonable policies and strong reform momentum--is effective in accelerating poverty reduction.

One lesson from experience is that reform does not usually succeed without strong local ownership and a broad-based approach, which includes a consideration of institutions, governance, and stakeholder participation--a lesson that has provided the impetus for the Poverty Reduction Strategy Paper (PRSP) process.

 

4 Effectiveness of Bank Action at the Sectoral, Program, and Project Level

The evolving understanding of development, which we have summarized in Section 1, is reflected in the changing nature of World Bank activities. Growth has been high on the Bank’s agenda throughout the period, and poverty reduction has been an explicit goal since the 1970s. Nevertheless, focal points for the Bank’s activities have evolved over the past four decades. In the 1960s, Bank activities included promoting food security; in the 1970s, addressing the energy crisis by encouraging new supplies and conservation; in the 1980s, tackling the debt crisis and promoting open trade policies; and in the 1990s, focusing more on poverty reduction and social development. Over this period the Bank has realigned its work at the sectoral and project level to focus on the quality of the policy environment and to focus on the country as the unit of account. Results have improved over the past decade as the Bank has incorporated its lessons of experience and altered its ways of doing business.

4.1 The Bank has in general achieved high rates of effectiveness at the sectoral, program, and project levels, and these have improved in the past decade, as shown by measured results.

The Bank has substantially improved outcomes on the ground in the past decade. Measurement of these outcomes is reflected in various indicators, such as economic and financial rates of return of Bank-financed projects, growth rates of GDP or sectoral output in countries and sectors supported by adjustment programs, and improvements in social indicators. More systematic tracking of the Bank’s results on the ground is being focused on the Millennium Development Goals (MDGs). CASs increasingly set out objectives and measure results on the basis of MDG indicators.

Bank operations on average enhance economic productivity.

Since 1972 the Bank has systematically collected data on project outcomes for every project it has financed and compared these outcomes with the expected results at appraisal. The result is a wealth of data showing results and trends over time by type of project, sector, and country. The older and most frequently used indicators have been the economic and financial rates of return of the projects.

The economic rate of return (ERR) is calculated for many projects, though not all: adjustment loans and projects in a number of sectors, such as education, health, and social protection, are not covered. Where they are available, the minimum ex ante economic rate of return (ERR) required of Bank-financed projects is 10 percent. Actual ex post results are considerably better. Figure 4.1 shows the average ERR in the 1990s, by sector, for disbursements in sectors for which sufficient data are available to provide a reliable analysis. The projects represented in the figure cover 47 percent of disbursements for all projects closed during 1996-2001, and 82 percent of disbursements in the sectors included in the analysis. On average, the return on these disbursements was nearly 25 percent, up from 16 percent in the 1980s.

These rates of return demonstrate the positive contribution of Bank-financed projects to increased output and productivity of borrowing countries. Bank research has shown (since about 1990) that individual project outcomes and ERRs are strongly associated with the quality of a country’s policy and institutional environment. Evaluation results confirm that the introduction of performance-based lending allocations has contributed to the increase in average ERRs for Bank projects.

The Bank’s private-sector arms--the International Finance Corporation (IFC) and the Multilateral Investment Guarantee Agency (MIGA)--also measure their economic impacts systematically. IFC’s Operations Evaluation Group (OEG) found that 63 percent of 102 real-sector projects begun in 1993-95 and evaluated near the end of that decade had ERRs in excess of 10 percent. In 65 percent of real sector projects, the ERR exceeded the financial rate of return, meaning that the benefits for customers, employees, suppliers and taxpayers were greater than the financial benefits to owners and financiers. Analogously, MIGA’s Operations Evaluation Unit (OEU) reported that as of 2000 it had issued 473 guarantees for just over $7 billion, which had facilitated investments of $36 billion; this means that each $1 of guarantee helped to generate more than $5 in investment in developing countries. While some of this investment might have occurred anyway, in a survey of MIGA clients, 73 percent reported that the guarantee was "critical" or "absolutely critical" for their firms to have made the covered investment.78

Box 4.1. Bank Promotion of Health in Poor Countries: Some Examples

Among the Bank’s many initiatives and projects to improve health are the following:

  • Lending for HIV/AIDS since 1986 has totaled nearly $1.5 billion, much of that coming after 1998. Box 4.2 shows by way of example what one well-designed Bank-supported program with strong local ownership was able to achieve over a period of several years.
  • Bank support for Mali’s Health, Population and Rural Water Project initiated in 1991 led, by the mid-1990s, to a number of gains: the percentage of children fully vaccinated rose from 0 to 24, and overall tetanus and vaccination coverage increased from 18 percent to 50 percent.
  • Bank support has helped to address iodine deficiency disorders. In China, for example, a $118 million project in the late 1990s helped raise the proportion of households with adequately iodized salt from 40 to 89 percent between 1995 and 1999, reducing the percentage of 8- to 10-year-olds with iodine deficiency from 13 to 3; ultimately, this is expected to result in average gains of 10 to 15 points in children’s IQ levels in affected communities.

Two caveats are warranted here. Taken alone, these ERRs should be used with considerable caution.

This is why it is essential to complement project-level evaluations with broader evaluations of progress at the sector or country level, as well as cross-country statistical analysis of the type presented in Section 3. Those earlier results on the effectiveness of IDA lending provide some confidence that these highly positive ERR calculations may at least be of the right magnitude.

Bank lending generally promotes improved health and education in poor countries.

The World Bank has long had projects aimed at improving health and education outcomes in developing countries. The Millennium Development Goals and the CDF/PRSP process (discussed in Sections 2 and 3) have helped raise the profile of these goals still further, so that they are now incorporated more systematically into the preparation of Bank country assistance strategies. A growing number of CASs reflect the objectives and monitor progress against them, and increased lending is going to human development sectors.

Having provided $30 billion for education projects, the Bank is the world’s largest external funder of education; it also is the world’s largest external funder of health programs, with new commitments of $1.3 billion a year for health, nutrition, and population projects. These social sector projects are achieving large, measurable improvements in human development indicators. (See Box 4.1 for examples from the health sector, and Box 4.2 for an example of AIDS prevention in Brazil.)

Box 4.2. Brazil: Proving that the HIV/AIDS Epidemic Can Be Stemmed

In the early 1990s, Brazil ranked fourth in the world in terms of reported AIDS cases. To help stem the spread of the deadly disease, the Bank in November 1993 approved $160 million for an AIDS prevention project in Brazil. The AIDS and Sexually Transmitted Diseases (STD) Control Project focused on prevention efforts, but also covered treatment and testing.

Between 1993 and 1997, the project helped 175 non-governmental organizations carry out more than 400 grassroots campaigns educating high-risk groups such as injecting drug users and sex workers about unsafe or harmful behaviors. The NGOs handed out more than 180 million condoms, raised AIDS awareness among more than 500,000 people, and trained 3,800 teachers and 32,500 students in promoting AIDS and drug abuse prevention.

Aided by another $165 million loan in 1998, the project, now in its second phase, is helping Brazil’s Ministry of Health reduce the spread of HIV/AIDS while making it possible for Brazilians with AIDS to live longer, healthier lives. The program has contributed to a 38 percent drop in the number of AIDS-related deaths since 1993. While supporting special AIDS care clinics and home-care teams to provide treatment for people living with HIV/AIDS, the second phase of the project combats the spread of AIDS and STDs by supporting a nationwide network of 177 AIDS testing and counseling centers and 800 diagnostic and treatment clinics for sexually transmitted diseases. In partnership with the National Business AIDS Council, the Bank's support has enabled 3,000 companies to provide AIDS awareness training to 3.5 million workers.

OED reviews of the health sector portfolio have found that the Bank has made important contributions to strengthening health, nutrition, and population policies and services worldwide.79 Through its support to policy reform, technical assistance, and financing, the Bank has helped expand geographical access to basic health services, sponsored valuable training for service providers, and contributed advice and other important inputs to government basic health services. The Bank has also used its lending and nonlending services to promote dialogue and policy change on a variety of key issues, including family planning, health financing, and nutrition strategies. Clients appreciate the Bank's broad strategic perspective on the sector, and the Bank has taken a growing role in donor coordination. After an initial focus on government health services, the Bank is increasingly focusing on other key issues, such as private and NGO service delivery, insurance and regulation. In recent years, the Bank also has placed greater emphasis on client ownership and beneficiary assessments in project design and supervision.

At the same time, OED raised a number of shortcomings in the Bank approach to health, such as a slowness to incorporate good institutional analysis into reform design and to focus on improving quality of service. In addition, with some notable exceptions, the Bank has not placed sufficient emphasis on addressing determinants of health that lie outside the medical care system, including behavior changes and cross-sectoral interventions. Promoting health reform required strategic and flexible approaches to support the development of the intellectual consensus and broad-based coalitions necessary for change, and the Bank is in the process of adapting its instruments to place more emphasis on learning and knowledge transfer.

Bank lending encourages good economic performance.

As Bank lending in support of structural and sector adjustment programs increased after 1980, its results were regularly assessed in several reports. The Bank’s internal reviews of the experience of the first decade concluded that, on average, countries that received adjustment lending had moderately higher growth of GDP, imports, and exports than countries that did not. Similarly, evaluations of IFC projects in the 1990s found that 60 percent contributed to overall economic growth in the country.80 For MIGA projects, nearly half had a substantial or better macroeconomic impact, effects directly related to the size of the project relative the size of the country’s economy.81

At the same time, the Bank reviews also found that: (1) failure to address the social costs of adjustment accounted for some policy reversals; (2) supply response in low-income countries (especially in Sub-Saharan Africa) was slow, and more time was required for institutional reforms; (3) there was a need for more specific and monitorable conditionality, particularly for tranche release; and (4) a more selective approach to adjustment lending and closer alignment between the Bank’s and countries’ expectations were needed.

As highlighted in reports by the Bank and NGOs, although poor people might gain on average from adjustment over the medium term, at least some poor people suffer during the adjustment period; this requires increasing attention to the allocation of public expenditures and cushioning income declines for vulnerable groups.82 A broader time perspective on the outcomes of adjustment lending, and of the major improvements in the 1990s over the previous decade, is contained in the Bank’s recent Adjustment Lending Retrospective: Final Report (World Bank 2001b), and Adjustment from Within: Lessons from the Structural Adjustment Participatory Review Initiative (World Bank 2001a), as well as in three OED reports.83 These reports document the mixed experiences of the earlier generation of adjustment operations and the improvements experienced in the 1990s (noted earlier). And they document the increased impact of successful adjustment operations on growth and, particularly, poverty reduction. For example, the share of explicitly poverty-focused adjustment operations increased from 47 percent in 1995 to 75 percent in 1999. In parallel, there has been a growing focus on social objectives: the share of conditions in adjustment loans directly supporting social sector reforms increased from 3 percent in the 1980s to 18 percent in the last three years. Finally, cross-country evidence shows that developing countries receiving adjustment lending in FY90-97 maintained and in some cases increased social expenditures, on average, more frequently than countries without such lending. An example of successful adjustment lending with positive impact on both growth and poverty alleviation is shown in Box 4.3.

Outcomes of Bank operations have been improving.

The outcomes of Bank lending are approaching their highest levels in two decades. OED’s outcome indicators are performance-related, measuring project contributions to productivity or amelioration of social dimensions of poverty, as discussed above. (The Annex of this report provides more detail about the evaluation system.) Figure 4.2 shows outcome data for nearly 30 years, a period in which standards for good performance have increased, making it more difficult for a project to earn a satisfactory rating. The figure shows a decline in performance from 1977 to 1989, followed by an improvement since then.

4.2 The Bank has adapted its strategies and projects to improve its performance.

The Bank has achieved improvements in performance over time by continually evaluating, learning, and adapting. Projects are evaluated by the independent Operations Evaluation Department, which reports directly to the Bank’s governing board (rather than through the President). In addition, there are systematic analyses of development approaches and project quality carried out by the Operations

Box 4.3. Uganda: A Successful Poverty-Focused Adjustment Program

One of the better examples of reform has been Uganda, whose story has noteworthy parallels with Vietnam (see Box 3.6). The country was estranged from Western donors prior to reforms, and it went through a period when it received little help. The new government in the mid-1980s faced a dire economic situation. Starting with advice, the Bank helped the government learn about policy reform in Ghana and other countries, and, in collaboration with multilateral and bilateral agencies, helped it design and implement key measures on fiscal adjustment, exchange rate reform, and trade liberalization. Aid and the conditionality associated with the Bank supported adjustment lending helped generate and implement policy reforms in the late 1980s and early 1990s, a period during which multilateral assistance from the Bank and other lenders was particularly important. The Bank began disbursing the first of five adjustment operations in 1991.

Since that period, Uganda has achieved a remarkable recovery from the collapse that occurred during the years of civil war, and has increased private investment, reversed capital flight, increased external trade, privatized commercial public enterprises, and--most important--reversed poverty sharply. The results have been very impressive, with poverty (defined as minimum calorie intake) declining from 56 percent in 1992-93 to 35 percent by the year 2000 (Appleton 2001).

While many factors were responsible for this impressive decline in poverty over such a short time period, it appears that the Bank adjustment operations played an important role in at least four areas:

  • The reform program supported by the adjustment operations helped lay the foundation for broad-based economic growth. Before 1990, annual GDP growth averaged 3.1 percent; after 1990, it averaged 7.2 percent. Much of this increase was due to the impact of successive adjustment programs, which helped slow down inflation, open up trade, achieve exchange rate stability, and reform the overstaffed public sector.
  • The reform program helped revitalize coffee and cotton production, on which most poor people depend. Liberalizing coffee exports and raising cotton prices helped put more income in the hands of poor rural producers. The improvement in the incomes of cash crop farmers, however, was not accompanied by similar improvements among food crop farmers. The incidence of poverty among the latter has not changed substantially and requires further attention.
  • The reform program improved the efficacy of school expenditures. One adjustment loan created a system to monitor the accountability of public funds going to primary schools and school districts.
  • The reform program helped reestablish an improved investment environment. A major factor in improving the environment for private investment was the effort to return properties to the members of the Ugandan Asian community who had been expelled from the country. This was an exceptional step that stimulated substantial investment from the returning Asian entrepreneurs.

It is important to note that the Ugandan recovery has been just that--a recovery. The economy came crashing down in the 1970s and 1980s, and Uganda spent the 1990s working to return to previously attained levels of development. The challenge now is for the country to develop well beyond the levels it reached in 1970. Doing so will require addressing serious issues of governance, as well as getting social services to function well.

Policy and Country Services unit (OPCS), the Quality Assurance Group, the Bank’s research department, and the thematic networks, all of which help to identify and learn from successes and failures. Through such learning, the Bank has made several major changes in approach that have contributed to improved outcomes over time.

As we explain below, changes in the Bank’s approach include: (1) shifts in lending towards human development, social protection, and governance; (2) the introduction of adjustment lending in the 1980s to eliminate major policy distortions; (3) moving beyond projects to adopt the country as

the main "unit of account," with Bank’s CASs and countries’ PRSPs becoming the central framework for ensuring alignment with countries and with the Bank and other external partners; (4) systematic managerial attention to operational quality; (5) tighter social and environmental standards; and (6) improved fiduciary performance. As shown below, these operational emphases have been driven by lessons of experience, new development challenges, and the growing realization that policies and institutions are keys to the effectiveness of development assistance.

Sectoral and thematic shifts

The Bank has responded to changes in its environment by reallocating its lending. Successful development, plus the growth of international capital markets, meant that emerging markets now had greater access to private finance for revenue-earning development projects, such as transportation and energy. Rather than compete with the private sector, the Bank shifted its efforts--in countries with access to alternative sources of financing--away from financing physical investments to helping countries reform sector policies and establish good regulatory frameworks. There has thus been a sharp decline in the Bank’s financing of infrastructure, from about three-fourths of Bank lending in the 1960s to about one-third in the 1990s (Figure 4.3). Within the reduced lending for infrastructure, there has been a trend toward more projects--with smaller loan amounts--aimed at helping governments to establish regulatory frameworks, address environmental issues, pilot new approaches to public sector infrastructure delivery, and design mechanisms for private participation.84

While the share of lending to the financial sector remained largely constant, the content of the Bank’s lending moved from financial intermediary lending through national development banks to supporting financial sector reform and bank restructuring.

In contrast, Bank lending for health, education, and social protection has risen steadily and now constitutes nearly one-fifth of total lending. During the 1990s, the Bank also increased lending for governance and public sector reform, private sector development, and environmental protection. As a result of these shifts, many of which are from the project to program level, Bank projects have become more relevant; but they have also become increasingly complex and demanding for both the Bank and borrower.

The IFC has complemented these shifts in recent years by aiming to crowd in private investment in sectors where private participation holds the most promise. It does this by targeting financial markets, infrastructure, and projects in the social sectors, and "frontier" regions or sectors within countries, as well as high-risk or low-income countries in recent years. In 2001, just under 70 percent of IFC approvals were in targeted sectors and over 40 percent in high-risk or low income-countries.85

Evolution of adjustment lending.

Section 3.2 has discussed in detail the evolution of adjustment (or policy-based) lending as a broad instrument of aid, but it is worth reiterating these messages briefly as an example of how the Bank has adapted its approach to improve performance. This type of lending was widely used by the Bank during the early years after World War II, but thereafter the focus shifted to investment lending. Program lending was resurrected in 1980, with the purpose of helping countries adjust their balance of payments after the 1979 oil shock. The focus soon shifted to helping countries remove obstacles to growth as they attempted to overcome the debt crisis of the 1980s. That focus was complemented in the 1990s with an explicit emphasis on poverty reduction and on avoiding adverse social impacts of adjustment. In recent years, as many countries have succeeded in removing major macroeconomic distortions and reducing excessive state intervention, adjustment lending has supported more complex institutional reforms.

The rapid expansion of adjustment lending during the 1980s, and its mixed outcomes during this period, lent great impetus to the learning process. Several OED and Bank reviews analyzed the economic and social impact of adjustment and fed back the lessons learnt into the design of adjustment operations whose results improved greatly. Adjustment operations achieved satisfactory or better outcomes about 60 percent of the time in the 1980s, and above 80 percent in the 1990s--following design improvements and increased country selectivity based on lessons of experience.86

Country focus

Along with this increased focus on the policy environment, Bank strategy moved beyond projects to adopt the country as the privileged "unit of account." Although the country had long been at the core of Bank programming, a qualitative change took place in 1990 with the introduction of the CAS. The CAS is a Bank-owned document that sets forth the Bank’s assistance program based on the country’s own vision and associated development program, the Bank's diagnosis of the country's policies, institutions, and private sector strength, and the Bank's comparative advantage, given the support provided by development partners. The CAS also sets out benchmarks for monitoring and evaluating the Bank's and the country's performance. From 1994, CASs were prepared in consultation with the government and, more recently, participation has been broadened to include NGOs, civil society, the private sector, development partners, and other stakeholders. In 1998, CASs for most countries began to be publicly disclosed. As countries increasingly formulate their visions and programs in PRSPs or other country-owned documents, CASs are expected to acquire more the character of a business plan for the Bank.

Evaluation (including self-evaluation) and borrower feedback have reinforced the country focus by assessing the impact of Bank assistance at the country level. A 1999 Client Feedback Survey found that borrower authorities gave the Bank high marks on: (1) incorporating country realities in project design, (2) technical competence, and (3) ensuring that project benefits justify the cost to the country. Key areas identified for improvement were: (1) building capacity at the community level, (2) strengthening local training and research organizations, (3) helping to strengthen the private sector, and (4) helping to strengthen and maintain sound macro and trade policies.

Enhancing quality management

Experience has demonstrated that for projects to be most successful they should focus on results, respond to client needs, be cost-effective and innovative, and build on the lessons of experience. Evaluations carried out by OED have demonstrated the importance of client commitment to projects, and of client and beneficiary participation in the design and implementation of the project for achieving satisfactory outcomes. (See Box 4.4 for an example of a successful project that incorporated these elements.)

Box 4.4. Elements of a Successful Project: Peru Rural Roads

Based on OED’s evaluation criteria, the Peru Rural Roads Project exhibited all of the criteria for successful assistance. The $264 million project was aimed at providing a well-integrated and reliable rural road system through rehabilitation and maintenance of rural roads and building key links to connect with the primary road system. It was focused on results, responsiveness to client needs, cost-effectiveness, and innovation. It contributed to partnership building and demonstrated high levels of professionalism and teamwork.

  • The project restored rural people's access to basic social services, improved the availability and affordability of rural transport services, and created entrepreneurial capacity by setting up community-based microenterprises to act as catalysts for furthering local development initiatives beyond the transport sector. The program generated about 32,300 seasonal jobs and 4,700 permanent jobs through the creation of 410 road maintenance microenterprises
  • The implementation arrangements of the project took into consideration the views of the various stakeholders. Experimentation, ownership, and trust helped create a responsive working environment where government, international donors, and beneficiaries contributed based on their comparative advantages.
  • The project successfully experimented with beneficiary participation in the selection of sub-projects and with the use of microenterprises for routine road maintenance. It established a novel framework of institutional collaboration that made the most of the strengths of each stakeholder, including the government counterpart institution, its decentralized executing units, local NGOs, and the Inter-American Development Bank.
  • Cooperation was strengthened by the receptiveness of the executing road institution to learning by doing, incorporated feedback throughout implementation, and seeking a more comprehensive response to rural poverty and community development issues.

The original project received OED’s top ratings for outcomes, sustainability, institutional development, and Bank and borrower performance. A follow-on project was given the World Bank President’s Award for Excellence.

Tighter social and environmental standards

The Bank’s "safeguard policies" cover its regulations and standards governing the treatment of Environmental Assessments, Natural Habitats, Involuntary Resettlement, Pest Management, Indigenous Peoples, Forestry, Projects on International Waterways, Cultural Property, Safety of Dams, and Projects in Disputed Areas. Management attention to the implementation of these policies has increased in recent years, both as part of the overall quality agenda and as a response to concerns raised by NGOs. For example, a Quality Assurance and Compliance Unit now monitors Bank compliance with its social and environmental safeguards, producing implementation reports for management in real time. On the IFC side, two-thirds of evaluated projects met high standards for environmental sustainability, including many of those whose profitability for their owners fell short.87

Inevitably, more rigorous implementation of these policies and compliance monitoring has been seen by some as raising the cost of doing business with the Bank and increasing risk aversion among staff and borrowers, especially with respect to the oversight of the independent Inspection Panel. There is anecdotal evidence that some managers are discouraging their staff from tackling operations involving safeguard policies, and that the safeguards have reduced the Bank’s involvement in some activities, such as sustainable forestry management and construction of major dams. But on balance the safeguard policies have improved the social and environmental quality of Bank operations and have come to be viewed as good-practice benchmarks within the development community.

Improved fiduciary performance

In recent years, the Bank has tripled the resources allocated to ensuring that its funds are used for the intended purposes. The overall quality of fiduciary performance in Bank-financed projects has improved steadily, as the Bank has introduced formal assessments of the financial management and procurement arrangements of the entities that implement individual projects. With the growing importance of nontraditional projects such as adjustment operations and debt relief, it has become clear that fiduciary assurance and achievement of development objectives depend on satisfactory performance in the management of public finances more generally. The Bank therefore has introduced country assessments of financial management and procurement, to provide it with a solid underpinning for its assistance program in each country. Results of the assessments inform the design of assistance programs, including support for measures to address weaknesses revealed by the reviews. At the same time, the Bank is working with international standard-setting organizations to develop a global set of standards for good quality public financial management.

4.3 The key to the Bank’s development effectiveness lies in its attention to both Bank and borrower performance.

The Quality Assurance Group (QAG) evaluates the quality at entry of Bank operations and the quality of Bank supervision. OED evaluates the outcomes of Bank operations and the Bank’s own performance--after projects have been completed and all loan funds have been disbursed. QAG’s indicators of quality at entry have improved, from 69 percent satisfactory or higher in 1996 to 82 percent in 2001, while OED’s have increased from 62 to 79 percent. Since quality at entry is a leading indicator, the performance of completed projects is likely to continue to improve in the next few years. Similarly, an evaluation of IFC projects also concluded that where IFC had done its job consistently well, 90 percent of projects were successful developmentally (compared to 61 percent overall).88

A theme running through this paper has been the necessity of learning from both failure and success. This section provides some additional examples of how the Bank has done so.

The Bank seeks to learn from failure.

Development is a risky business and some failures are inevitable. While performance shortfalls have many causes, it is important for the Bank to learn from them and feed that learning back into subsequent operations. Evaluation evidence confirms that when project performance has been weak, the Bank has modified its approach. For example, Bank lending for power development in Sub-Saharan Africa has been less successful than in other regions. By the early 1990s, evaluation had disclosed that power projects were not meeting their goals, especially with respect to financial sustainability. A new sector policy, introduced in 1993 and in force today, identified guiding principles for Bank support in the energy sector. The results in Africa have been impressive: between 1990 and 1994, power outages dropped from 50 to 18 hours per customer (per year), losses fell from 20 to 17 percent and the number of employees per thousand customers decreased from 10 to 7.

A similar learning from costly lessons of experience has been evident in adjustment lending. In line with evaluation lessons, the Higher Impact Adjustment Lending (HIAL) initiative introduced in the Africa Region in 1995 aimed at enhancing adjustment lending through improved country selection and better design. During FY96-98, HIAL lending to Sub-Saharan Africa (SSA) exceeded US$2 billion through 21 operations in 17 countries. An evaluation of the impacts of the program found that the HIAL group outperformed non-HIAL SSA and all non-SSA IDA countries in terms of fiscal adjustment, exchange and interest rate policy, and structural reforms. The group also achieved better results in terms of macro variables such as inflation, current account, foreign exchange reserves, growth, and debt sustainability. Fiscal adjustment was associated with both inflation reduction and growth in the HIAL group. Also, the HIAL share of poverty-focused operations was higher relative to comparators. By enhancing the flexibility of resource flows in HIAL through varied tranching arrangements, governments gained increased freedom in the timing of reforms and greater ownership of programs. A HIAL operation had about half of the number of conditions of the SSA average during 1980-93. This is consistent with HIAL's objectives of improving the effectiveness of adjustment lending by providing greater flexibility in disbursement through fewer but more specific conditions.

The Bank aims to build on success.

Sometimes, building on success means helping to spread successes across countries and regions through partnership with other development actors. The "Green Revolution," which began in South Asia in the 1970s and spread to Africa and Latin America, has led to impressive gains in production of basic food crops across the developing world, as shown in Table 4.1. Between 1970 and 1997 yields of cereals in developing countries rose more than 75 percent, coarse grains 73 percent, root crops 24 percent and pulses nearly 11 percent.89 The Bank supported this sweeping change through its lending for irrigation, rural infrastructure, and agriculture, and by mobilizing support with other donors through the Consultative Group for International Agricultural Research (described in Section 5.2 below).

Table 4.1. Yields of Major Food Crops, Developing Nations [kg/ha]: 1970-97

Period

Cerealsa

Coarse grainb

Root cropsc

Pulsesd

1970-74

1,523.8

1,114.4

9,393.5

586.6

1975-79

1,744.4

1,307.8

9,976.2

613.2

1980-84

2,056.4

1,498.0

10,472.5

616.0

1985-89

2,259.8

1,558.9

10,868.5

629.1

1990-94

2,486.5

1,753.0

11,201.5

639.4

1995-97

2,673.8

1,930.6

11,653.7

648.8

Changee

+75.47%

+73.25%

+24.06%

+10.60%

a Wheat, rice, other.
b Corn, barley, rye, oars, millet, sorghum, other.
c Potatoes, sweet potatoes, cassava, two, yams.
d Dry beans, broadbeans, dry peas, chickpeas, cowpeas, pigeon peas, lentils, other.
e Percentage change from 1970-74 to 1995-97.
Source: FAO Statistics [http://www.fao.org].

At other times building on success results in scaling up a promising initiative. For example, since March 1974 the World Bank has funded, along with the European Union and the World Food Program, five dairy development projects in India. These projects have supported Operation Flood, an all-India program begun in the 1960s to promote farmer-controlled dairy cooperatives. By 1996, 10 million farmer-members were supplying an average of 11,000 metric tons of milk per day through 55,000 village cooperative societies. This vast organization grew out of a single, small cooperative society. This external support validated government policy changes growing out of a homegrown initiative. An OED impact evaluation found that Operation Flood and the associated policy changes resulted in a spectacular increase in the growth rate of Indian dairy production, from 0.7 percent annually to over 4.2 percent.

Finally, learning from success sometimes means adapting approaches to new challenges. For example, the recognition that local stakeholder participation often is key to development effectiveness has led the Bank to support social funds, a form of lending that allows local stakeholders to determine investment decisions. This is a flexible instrument that can adapt to needs as they arise and as local community groups become aware of the potential source of funding. An OED evaluation concluded that overall this approach has been "highly effective" in delivering small-scale infrastructure efficiently, although the sustainability of service provision is still a challenge.

Country policies matter a great deal in determining outcomes and are a focus for programmatic lending and of analytical work. As discussed in Section 3, outcomes improve at the country level with increased selectivity. More ODA resources now go to countries with good policies; Figure 4.4 shows significant improvement over the short period from 1992 through 1998. Yet although the improved selectivity through the 1990s tripled the poverty-reduction effectiveness of ODA, there has not been a corresponding increase in aid levels. Instead, ODA has fallen significantly.

Despite these advances, a lot more remains to be done to improve Bank performance and development impact. Building on the improvement in performance over the 1990s, the Bank continues its efforts to enhance the development impact of its operations. Two areas where the Bank has shown weaknesses, but where progress is now being made, are managing for results and promoting knowledge sharing.

Managing for results

In the late 1990s the Bank increased is focus on results in operational work. It strengthened the systems for ensuring real-time information on the quality and quantity of its lending and nonlending service deliveries to clients, as a basis for enhanced management attention to the delivery of development inputs and outputs. It increased its attention to incorporating the lessons of evaluation into the design of new operations and to results-based monitoring and evaluation during project supervision. It also increased its attention to country outcomes in the design and implementation of its Country Assistance Strategies, recognizing the importance of country policies, institutions, and programs, as well as those of other development partners in the actual results. Work is currently underway to strengthen Bank processes and systems for measuring, monitoring, and managing for results, including through use of the Millennium Development Goals.

Sharing knowledge

The Bank has long been engaged in the dissemination of development knowledge through its research program, the World Bank Institute, and its operational programs. Building on technological advances, it can become an even more effective conduit for sharing knowledge on what works in development. Bank potential in this area is substantial given its wide-ranging research, advisory services, publishing activities, training programs, and technical assistance work. More recently, the Bank has developed innovative knowledge-sharing initiatives, such as the Development Gateway, a Web-based information portal. The Bank now needs to manage these activities for results. Stronger results-based management and innovative approaches to knowledge sharing can position the Bank to better deal with emerging global issues, as discussed in Section 5.

4.4 Summary

Measured results show that the Bank’s actions have been broadly successful, especially over the past decade.

The Bank has increased its effectiveness by incorporating lessons from past experience.

The Bank continues to build on its experience and adapt approaches as necessary.

 

5 Effectiveness of Global Interventions

5.1 Many global challenges can be handled only at an international level.

Global development challenges--such as loss of biodiversity, deforestation, climate change, and the spread of infectious diseases--cannot be handled solely by individual countries acting at the national level and therefore require multilateral action. As the number and scope of global challenges have grown, so too have the number of actors involved, creating a need for new partnerships and networks among stakeholders. Private charities have become a force in the areas of environment and health. Pharmaceutical companies have become donors to global health initiatives. Private capital flows to developing countries now dwarf official development assistance. The search for international common ground, together with a variety of formal and informal international agreements, have led to new alliances and revised roles for institutions including the Global Environment Facility, World Trade Organization, and the various UN bodies. No single actor can address all of these challenges, and efforts to address them have been growing rapidly.

According to the UN Secretary General’s office, hundreds of new programs to address issues of global scope are being created each year. Demand has increased for the World Bank to be proactive at the global level, with donors encouraging the Bank to coordinate selected global efforts. In FY2001 the Bank was involved in over 200 multi-country partnerships, of which 70 were global programs. In FY2001 the Bank spent about $30 million of its administrative budget on the activities of these global programs, provided an additional $120 million in grants from the Development Grant Facility (DGF), and disbursed another $500 million from Bank-administered trust funds.

Although multinational initiatives are required, they often must be linked to country actions. Many of the Bank’s global initiatives (see Box 5.1) address problems that have both important domestic impacts and major cross-border spillovers, such as financial contagion, the spread of AIDS, ozone depletion, and toxic pollution. Other global problems call for increasing the efficiency of resources spent at the country level through the use of science and technology available only in the richer countries or globally supported research centers, such as CGIAR. In most cases, complementary national efforts in developing countries are key to either achieving objectives of the global programs (such as biodiversity conservation, which often builds on local programs) or ensuring developing countries’ access to their benefits (such as agricultural productivity, where new crop varieties must be matched to locally adapted cultivation practices).

The Bank’s response to these global challenges has been broad and is rooted in a cooperative approach to contribute to global outcomes. Its analytical and advocacy work is helping to accelerate the international trade round for development and to promote support for programs targeted at specific diseases such as HIV/AIDS and malaria.

5.2 Many global programs have been successful.

There is broad-based support for such well-established grant programs as the Global Environment Facility, the Consultative Group for International Agricultural Research (CGIAR), and the Riverblindness Control Program. Many have achieved success, only to face new challenges.

The CGIAR, created in 1971, now includes 16 international agricultural research centers. The 8,500 CGIAR scientific staff work to produce higher-yield food crops; more productive livestock, fish, and trees; improved farming systems; better policies; and enhanced scientific capacity in developing countries. The knowledge generated by CGIAR--and the public- and private-sector organizations that work with it as partners, researchers, and advisors--has paid poor consumers handsome dividends in terms of increased output and lower food prices. More than 300 varieties of wheat and rice and more than 200 varieties of maize developed through CGIAR-supported research are being grown by farmers in developing countries. Food production has doubled, improving health and nutrition for millions. New, more environment-friendly technologies developed by CGIAR have released between 230 and 340 million hectares of land from cultivation worldwide, helping to conserve land and water resources and biodiversity. CGIAR's efforts have helped to reduce pesticide use in developing countries. For example, control of cassava pests alone has increased the value of annual production in Sub-Saharan Africa by $400 million. Yet the CGIAR must now adjust to new

Box 5.1. Global Initiatives Supported by the Bank: Some Examples

  • Developing new knowledge: Consultative Group for International Agricultural Research, Tropical Disease Research Program, support for Global Development Network and African Economic Research Consortium, leading research group on development
  • Exploiting new technologies: Global Distance Learning Network, Global Knowledge Partnership, InfoDev, Medicines for Malaria Venture, World Links
  • Building new networks for assembling and sharing knowledge: Child Labor, Global Forum for Health Research, Global Water Partnership, Program for Statistics, Program for Assessing Student Achievements, Provention Consortium
  • Involving the commercial private sector: Global Alliance for Vaccines and Immunization, International AIDS Vaccine Initiative, Roll Back Malaria
  • Bringing new approaches to private sector development: Consultative Group to Assist the Poorest, Public-Private Infrastructure Advisory Facility, Solar Development Group
  • Responding to financial crisis: Financial Sector Assessment Program, Global Corporative Governance Forum, Reports on the Observance of Standards and Codes
  • Promoting trade and financial stability: Capacity Building for Agricultural Trade Policy, Integrated Framework for Trade, Financial Sector Assessment Program
  • Responding to conflict and post-conflict situations: Post-Conflict Fund
  • Multisectoral responses: Cities Alliance, Partnership for Child Development, UNAIDS

 

Box 5.2. Riverblindness Control: Successfully Reaching a Well-Defined Target

Riverblindness or onchocerciasis, a disease widespread in Africa, causes blindness, disfigurement, and unbearable itching in its victims, and has rendered large tracts of farmland in Africa uninhabitable. The Onchocerciasis Control Program (OCP) was created in 1974 with two primary objectives. The first is to eliminate onchocerciasis as a public health problem and as an obstacle to socioeconomic development throughout an eleven-country area: Benin, Burkina Faso, Côte d'Ivoire, Ghana, Guinea, Guinea-Bissau, Mali, Niger, Senegal, Sierra Leone, and Togo. The second objective is to leave participating countries with capacity to maintain this achievement. OCP is sponsored by four agencies: the United Nations Development Program (UNDP), the Food and Agriculture Organization (FAO), the World Bank, and the World Health Organization (WHO).

OCP has now halted transmission and virtually eliminated prevalence of onchocerciasis throughout the 11-country subregion containing 35 million people. Through donations of Mectizan by its manufacturer, Merck and Co, Inc., and financial support from numerous donors, OCP is funded through its conclusion in 2002. By that time, 600,000 cases of blindness will have been prevented, 5 million years of productive labor will have been added to the 11 countries’ economies, and 16 million children born within the OCP area will have been spared any risk of contracting onchocerciasis. In addition, control operations have freed up an estimated 25 million hectares of arable land that is now experiencing spontaneous settlement. The OCP program has been hailed as one of the most successful partnerships in the history of development assistance.

More recently, OCP has been assisting beneficiary countries to safeguard this achievement. At the conclusion of OCP in the year 2002, control and monitoring activities will be maintained through a subregional multi-disease surveillance center at the OCP headquarters. The center will participate in training national epidemiologists, creating national surveillance systems, and collaborating with countries for operational research on surveillance. Currently, OCP staff, which is 97 percent African, provides technical and logistical support to participating countries to ensure that they are capable of continuing residual onchocerciasis control activities within the framework of their own national health systems.

realities. Agriculture research technology has changed, giving prominence to molecular biology and genetic approaches. More robust intellectual property rights have produced an explosion in private investment for agricultural research. These changes pose new challenges to the CGIAR size, organization, and approach.

The Riverblindness Control Program has met its objectives particularly well (see Box 5.2). Similarly, the campaign to eradicate smallpox was an international program, and an extremely successful one. In the mid-1960s, when the campaign was launched, smallpox afflicted some 15 million people a year, and it killed 2 million of them; by 1980, the disease had been eliminated.

A third example of a successful global program is the African Economic Research Consortium (AERC), which is less well known than the first two. Like the Riverblindness Control Program, the AERC is a regional program focused on addressing one of Africa’s greatest needs--strong domestic capacity for policy analysis and formulation (see Box 5.3). In this case, the international nature of the consortium has made it stronger, by allowing a critical mass of researchers and academic institutions, and by encouraging the sharing of experiences across countries.

Another more recent global intervention, the Consultative Group to Assist the Poorest (CGAP), has provided performance-based grant assistance to promote the growth of well-managed and sustainable microfinance institutions. Box 5.4 explores this approach and its successes to date. Early OED reviews of CGAP praised its focus on sustainability while also identifying some challenges in such areas as donor coordination and targeting of clients; since that time, the organization has used these evaluation results to refocus as it matured.

Box 5.3. Building Domestic Capacity for Policy Analysis in Sub-Saharan Africa

Recent development experience shows clearly that development strategies must be "owned" by the countries that implement them, not dictated by outside donors. But the ability to participate in design and decisionmaking that is necessary for ownership depends on local capacity for policy analysis. For this reason, capacity-building is an essential element of development assistance.

One capacity-building effort that has paid significant dividends is the African Economic Research Consortium (AERC), which was established in 1988 as a research institute and now covers 22 countries. Its secretariat is located in Nairobi. The AERC works to strengthen local capacity for conducting rigorous, independent inquiry into issues affecting economies in Sub-Saharan Africa.

The AERC focuses on improving economic policy through research, training, and dissemination of research findings. The AERC conducts research in-house and administers a small grants program for researchers in academia and policymaking institutions. The AERC has supported 280 research projects, and the number of participating researchers has grown from 40 to 200 since its inception. In addition, biannual meetings hosted by the consortium are among the largest gatherings of professional economists in Sub-Saharan Africa. In addition to its research program, the AERC began in 1992 to administer a two-year collaborative MA program with students and faculty from 20 universities in 15 Sub-Saharan African countries. The program has produced about 800 MA graduates so far, and 200 more students now participate in this program. Many graduates of the AERC have gone on to research and teaching posts throughout the region, and others to high-level positions in African central banks and finance ministries.

Established by six international and bilateral agencies and private foundations, including the World Bank, AERC is now funded by 15 donors, including foundations, governments, and multilaterals. It has a budget of approximately $7 million a year. One measure of the AERC’s success is that it has served as an inspiration and model for newer research networks in other regions, such as the Economic Education and Research Consortium, based in Moscow and Kiev, and the Economic Research Forum for Arab Countries, Iran, and Turkey, based in Cairo. Another measure of success is AERC’s contribution to improved policymaking in Africa. The three top economic policymakers in Côte d’Ivoire, for instance, are members of the network; and AERC research contributed significantly to the development of Poverty Reduction Strategy Papers in seven African countries (Uganda, Ethiopia, Tanzania, Ghana, Nigeria, Benin, and Kenya). Many of the African participants at the November 2001 ministerial meeting of the World Trade Organization at Doha, were AERC graduates and observers noted that the technical quality of Africa’s contribution to these discussions was substantially higher than in analogous meetings a decade or so earlier.

5.3 A major challenge, which the Bank is now addressing in collaboration with other partners, has been to improve focus and prioritization.

The number and range of global programs in which the World Bank is involved has increased rapidly over the past five years and has been accompanied by a concern that the Bank may be doing too much, too soon, and too fast. The issue is not whether the Bank should respond to these global issues, but how and to what extent. Looking ahead in their Prague Communiqué of September 2000, the Bank’s Governors endorsed a focused set of priorities for Bank global programs, and these are reflected in the criteria for possible Bank action in global public goods areas:

Using these criteria, the Bank has identified five priority areas for global public goods:

These guidelines are helping the Bank select global programs, and have led to new support for activities to combat AIDS and to prevent regional conflicts. These priorities and criteria now need to be incorporated by the Bank in a global strategy for the institution that can guide its global programs, much as--at the country level--the country assistance strategy guides its country programs. As is the case at the country level, this strategy needs to evolve in close consultation with the relevant stakeholders.

Box 5.4. CGAP: Providing Performance-Based Aid to Micro Lenders

Microfinance offers valuable lessons for improving the effectiveness of other areas of development assistance, especially those that address development of the private and financial sectors. The Consultative Group to Assist the Poorest, or CGAP--a Bank global initiative--was established in 1995 to help provide assistance to donors active in microfinance. It provides a vehicle for structured learning and dissemination of best practices on delivering financial and other services to the very poor on a sustainable basis. It also attempts to expand the resources reaching the economically active poor, and improves donor coordination for systematic financing of such programs. CGAP has provided performance-based grant support to 60 institutions in 47 countries, for a total of $27 million.

Using its grant fund, CGAP has developed an investment-style approach to grant-making that ties tranched funding to institutional needs and performance. The "dividends" or "outputs" to CGAP are the achievement of financial performance measures that will enable that microfinance institution to reach sustainability, and thus reach significant numbers of poor clients. The performance contract that accompanies CGAP's equity-like funding leaves the use of funds entirely at the discretion of management; reporting, monitoring, and continuation of disbursements are tied to the microfinance institution's fulfillment of performance thresholds at the institutional level. These thresholds are designed to lead the microfinance institution to full financial sustainability--that is, the ability to cover all costs including a commercial cost of funds. The thresholds generally step up over time and include indicators such as profitability, efficiency (cost per currency unit lent), portfolio quality, and growth (numbers of clients reached). Because most of a microfinance institution's funding is usually below market rates, achievement of full financial sustainability implies that it will generate substantial surpluses that will be retained to fund yet more services to poor clients.

CGAP's investment in Compartamos in Mexico illustrates the effect of such leverage. Compartamos works with very poor women in Mexico's most destitute regions. Its early funding consisted mainly of two large grants of $1 million from a private Mexican banker and $2 million from CGAP. Six years later, its client base has multiplied five-fold. More than half of its portfolio of 65,000 borrowers is funded not by grants, but by retained surpluses that it has generated over the period. Now the NGO has invested in a new licensed finance company that will expand the same business. About half of the investment in this finance company came from commercial sources. Under prudential norms, it can leverage the capital of its investors up to five times by selling bonds to the public. Thus, each dollar that CGAP put into Compartamos in 1995 now translates into as much as twenty dollars of microloan service to poor clients. What made this investment successful was that Compartamos kept loan repayment at very high levels and stayed on track to financial sustainability, without abandoning their social mission. Another successful CGAP client is Fondation Zakoura, the second largest microfinance institution in Morocco, which has over 35,000 active clients and has grown rapidly in recent

5.4 Summary

Many global challenges can be handled only at an international level.

Global development challenges--such as the spread of infectious diseases, the challenge of building an international trade and financial architecture, loss of biodiversity, deforestation, and climate change--cannot be handled solely by individual countries and therefore require multilateral action. Such action is typically most effective when linked to country efforts.

Many global programs have been successful, and greater focus can bring even more success.

One of the most successful programs is the Onchocersiasis Control Program, a collaborative effort of multilateral agencies, governments, NGOs, and the private sector that has eliminated the scourge of riverblindness from an 11-country region of West Africa.

Another important example is the Consultative Group for International Agricultural Research, a network of research centers that has produced more than 500 varieties of grain now planted in poor countries. CGIAR has helped increase average yields in target grains by 75 percent over three decades.

Nevertheless, the expansion of global actions in recent years has led to a recognition that more focus is necessary. The Bank has moved since 2000 to make its global programs more strategic by establishing a small number of priority areas for action; this focus has helped increase the resources available for contributing to high-priority programs, such as combating AIDS and preventing conflict.

 

6 Conclusions: Learning Lessons to Move Forward

6.1 Summary of findings

In summing up, it is worth emphasizing again the difficulty about proving cause and effect in assessing development assistance. There are several reasons for this: little advancement takes place unless reforms are fully owned by the government, so an external agent like the World Bank cannot and should not take primary credit for the typical reform; successful development assistance requires partnership with other agencies, including civil society, NGOs, and others, both domestic and external; and finally, the most effective development assistance will be catalytic, with effects that spread far beyond the original project or program.

Nevertheless, development assistance has been associated with major successes:

This paper has presented several types of analysis that bolster these conclusions about the effectiveness of development assistance. Cross-country statistical analysis shows that:

Analyses of the experiences of individual countries show that:

Analyses of individual projects showed that:

And at the global level, the Bank has contributed to successes in areas such as the Green Revolution. CGIAR, a network of research centers that the Bank helped to found, has produced more than 500 varieties of grain now planted in poor countries and has helped increase average yields in target grains by 75 percent over three decades.

There have been some failures in the development experience, and the Bank and its partners have worked to learn from these. For example:

There are major challenges remaining. The AIDS epidemic continues to cut life expectancies in Sub-Saharan Africa, undoing decades of progress. In Africa and elsewhere, external actors are struggling with the question of how best to help catalyze and support reforms in the low-income countries that have the poorest policies, institutions, and governance.

Nevertheless, lessons learned are bringing payoffs in improved country performance and better aid allocation, and the end of the Cold War has allowed better targeting of aid at poverty reduction.

6.2 Implications for meeting the Millennium Development Goals

What does this analysis imply for meeting the Millennium Development Goals? One lesson is that external resources alone will not be sufficient to ensure that global goals are met. The recipient country’s level of commitment and the quality of its policies and institutions are the primary determinants of progress. Experience and analysis have taught us that outside aid cannot substitute effectively for these factors.

But a second lesson of this paper is that when a country is committed to reform and poverty reduction, external support has real payoffs. External support can take several forms, including but not limited to aid.

One important area where rich countries can provide support is through reforms of their own trade policy. The external environment has a strong influence on the returns to reform in developing countries. Robust global growth is important, but so is reform of rich countries’ protectionist policies, which target such areas as agriculture and textiles and are thus particularly damaging to poor countries. Open market access to poor countries, combined with other trade reforms, would pull an estimated 300 million people out of absolute poverty, beyond the 600 million who would escape poverty with normal growth.90

The second area for support is through direct development assistance. The decline in aid flows over the past decade has come precisely at a time when the returns to aid has increased sharply. Section 6.1 has summarized the evidence on returns: if countries are willing to take the steps necessary to reform, then assistance in the form of capacity-building, financial assistance, and analytical support typically has large returns. With continued reform momentum and steady external support, past experience suggests strongly that we can extend and deepen the progress of the past half-century.

 

Annex Measuring the World Bank’s Development Effectiveness and Managing for Results

In 1992, a World Bank task force on portfolio management analyzed the causes of the declining effectiveness of Bank operations over the preceding decade (see Figure A.1.).91 The Bank responded with a program of action, but quality levels for completed projects reported by the independent Operations Evaluation Department (OED) continued to stagnate. In December 1995 Executive Directors pointed to the slow pace with which lessons from experience with development assistance were being reflected in new operations. The World Bank’s Senior Management then made it its highest priority to restore and enhance the quality of the Bank’s assistance and its effectiveness in helping countries reduce poverty. This meant a stronger emphasis on managing for results and evaluating the Bank’s development effectiveness. This annex presents an overview of the Bank’s evaluation methods and criteria, steps taken to address the declining performance measured by evaluation results, and the measured results of those actions.

A.1 The World Bank’s evaluation system

The World Bank has developed an increasingly rigorous system of results-based evaluation. This system is designed to both provide accountability for the use of Bank resources and to enable the Bank to build on its long experience, so that it might improve its development effectiveness. As part of its efforts to improve the effectiveness of the development system, the Bank works with client countries and collaborates with partner institutions to harmonize evaluation standards and criteria and to build evaluation capacity.

Bank evaluation is keyed to the achievement of results.

The World Bank uses an objectives-based approach to evaluating development effectiveness. This approach has three major advantages:

This system has a number of features that in combination make it unusually effective: it includes both independent evaluation and self-evaluation; it enables real-time evaluation of ongoing operations; it links to a system of organizational learning; and it uses external expertise and stakeholder participation.

The Bank has well-developed evaluation methods and criteria.

The Bank’s major evaluation work uses criteria and a methodology developed by its OED over the last 30 years. Two recent independent reviews sponsored by the Evaluation Cooperation Group, which comprises the heads of the Evaluation Offices of the Regional Development Banks and the World Bank, found that the World Bank’s evaluation methods come closest to best practice in the evaluation field. The reviews analyzed the extent to which the major evaluation criteria are appropriately defined and applied, and the methods used to do so.

OED evaluates development interventions by assessing how their results compare with their stated objectives. At the project level, this methodology focuses on the outcomes, sustainability, and the impact of Bank operations on institutional development. With different criteria, the methodology has also been extended to country, corporate, sector, thematic, and global policy evaluations.

OED evaluates outcomes by considering three factors:

Through combining these three factors, overall outcome is rated on a six-point scale, ranging from highly satisfactory to highly unsatisfactory (see Box A.1).

OED’s sustainability measure assesses the resilience to risk of net benefit flows over time by answering four questions:

The sustainability of Bank projects has been improving over time, from 48 percent likely in FY1995 through FY1998, to 57 percent likely in FY1999 and FY2000.

The institutional development impact measure evaluates the extent to which an intervention improves the ability of a country or region to make more efficient, equitable, and sustainable use of its human, financial, and natural resources. Such improvements can derive from changes in values, customs, laws and regulations, and organizational mandates. Accountability, good governance, the rule of law, and the participation of civil society and the private sector are prominent characteristics of an effective institutional environment. OED evaluates each intervention’s success in fostering such changes. Forty-three percent of projects provided substantial institutional development impact in FY2000, compared with about 30 percent in FY1995.

Box A.1. OED’s Outcome Rating Scale

Highly satisfactory: All relevant developmental objectives are (or are expected to be) achieved and/or exceeded efficiently, with no shortcomings.

Satisfactory: Most of the relevant development objectives are (or are expected to be) achieved efficiently, with only minor shortcomings.

Moderately satisfactory: Most of the major relevant objectives, on balance, are (or are expected to be) met, although significant shortcomings are observed.

Moderately unsatisfactory: Many of the major relevant objectives are not (or are not expected to be) met; major shortcomings are observed.

Unsatisfactory: Most major relevant objectives are not (or are not expected to be) met and/or most objectives are not relevant.

Highly unsatisfactory: None of the relevant objectives is (or is expected to be) met and/or objectives are not relevant.

A.2 Bank actions to address declining performance

To address the performance problems observed by the late 1980s, the Bank focused on the building blocks required for ensuring that development assistance contributes to results on the ground: the quality and delivery of operations (doing things right); the quality of country assistance strategies and sector strategies (doing the right things); effective guidance to staff through operational policies; and an allocation of administrative resources that reflects and supports a results orientation. In these efforts, the Bank uses the results of both self-evaluation 92 and independent evaluation by OED as a means of continuous learning and for holding managers accountable. While concentrating on the building blocks, the Bank is also paying attention to measuring the institution’s performance in partnering with other organizations to help countries achieve the Millennium Development Goals.

The Bank has improved the quality of operations.

To turn around the quality of operations, management has clarified accountabilities, ensured real-time feedback through a Quality Assurance Group (QAG), set targets for improvement in areas of lagging performance, and provided support to task teams. As a result, there has been a continuous improvement in the active portfolio.93 Between FY96 and FY00, quality at entry increased from less than 70 percent satisfactory to 90 percent (Figure A.2). Meanwhile, the quality of supervision rose from 63 percent satisfactory to 92 percent (Figure A.3), and the share of projects at risk fell from 34 percent to just 15 percent (Figure A.4). The Bank’s efforts to enhance effectiveness are continuing with a focus on promoting the wider use of monitoring and evaluation in Bank operations, strengthening the evaluation capacity of developing countries, and standardizing Bank processes for identifying and managing risks.

The Bank has strengthened nonlending services.

The management of the Bank’s economic and sector work (ESW) also has been strengthened in response to concerns about declining quality and coverage.94 Accountability for strategic content, delivery, costs, and quality of ESW products has been strengthened, and the Bank is closely monitoring the implementation of the ongoing ESW program. This attention has already brought about an increase in quality, with the share of products rated satisfactory or better increasing from 72 percent in FY98 to 86 percent in FY00.95

The Bank has developed operational strategies.

The Bank establishes its operational strategies through Country Assistance Strategies (CASs) and Sector Strategy Papers (SSPs). Introduced in FY91, CASs evolved into strategic documents in the mid-1990s as the Bank shifted its focus from projects to supporting countries in achieving their own vision for growth and poverty reduction. Regular CAS retrospectives were introduced to advance the process. CASs now reflect lessons learned and use the Bank’s comparative advantage as a criterion for assessing how the Bank might work most effectively with its partners in helping countries achieve their objectives.96 The latest retrospective documents quality improvements along several dimensions, notably the treatment of governance and participation, the social and political underpinnings of reform, poverty issues, and the incorporation of lessons from independent evaluation and self-evaluation. Bank management pays particular attention to weaknesses reported in the retrospective and OED’s independent CAEs--including, notably, risk analysis.

SSPs were introduced in FY97 to clarify the Bank’s role in the sectors, review lessons of experience (drawing on self-evaluation, independent evaluation, and research results produced inside and outside the Bank), identify issues, define strategic directions, and recommend actions. Management has conducted its own stocktaking of the quality of SSPs, and is taking measures to better align new SSPs with emerging corporate priorities, improve the treatment of risk, and improve the coordination of country and sector strategies.

The Bank has updated operational policies.

The Bank’s operational policies embody corporate priorities and guide the design of operations. Management’s emphasis has been on ensuring compliance with operational policies, which was crucial for moving the Bank from a culture of approval to a culture of results. Particular attention has been given to compliance with safeguard and fiduciary policies. QAG has reported that overall, 87 percent of projects were rated satisfactory or better for supervision of fiduciary and safeguard aspects in FY00, up from 82 percent in FY97. To further strengthen compliance, the Bank established a new Quality Assurance and Compliance Unit (QACU) to provide staff with authoritative, consistent, and timely advice on the application of all safeguard policies.

In the past, policies typically included a mixture of requirements and advice to staff, leading to uncertainty about implementation. Bank management therefore introduced a new framework of Operational Policies/Bank Procedures that clearly separates requirements from advice. The revision of policies is a continuous process of adding, discarding, and updating, aided by drawing on the lessons of experience. For example, the Operational Directive on adjustment lending issued in 1992 has been complemented in recent years by three Operational Memoranda with instructions to staff on adjustment operations. Lessons were distilled in a recent retrospective,97 which serves as the basis for work to revise the existing directive in the Operational Policy/Bank Procedure format. Management guides this process with a view to avoiding disruption in the work of operational staff and ensuring implementation.

The Bank has adopted performance-based resource allocation.

Retrospective analysis shows that country budgets are being more tightly linked with poverty and country performance. This reflects an increasing use of comparative and benchmarking tools at several levels of the planning process. The most widely used model relates budgets to performance, population, and poverty as the main variables. Used at the country level, it helps achieve an allocation of resources that is both fair to the country-specific situation and consistent with the corporate strategy. In addition, at the regional level, there is also an increasing reliance on regional compacts. By linking anticipated outputs explicitly with unit budget envelopes, the compacts contribute to results-based management and further unit cost-effectiveness.98

Bank management has initiated work on a budget reform starting with a review of, among other things, the criteria and processes for determining country and sector board budgets. One objective of this work is to better link resource allocation to results.

Bank outcomes have been improving.

As Figure A.1 shows, the outcomes of Bank lending are approaching their highest levels in two decades, despite more strenuous evaluation standards. From a low of 57 percent in 1989, the percentage of projects rated satisfactory by OED rose to 82 percent in 2001. Most of these gains were achieved after 1996, reflecting the actions discussed above.

A.3 Conclusions

The Bank’s evaluation and control system, which helps set the standard within the development community, is results-oriented, objective, rigorous, and comprehensive. It operates under the oversight of the Board, backed by the independent Operations Evaluation Department. It provides real-time, high-quality data that are used to manage development risks. It is linked to policymaking, organizational learning, and knowledge management, and it is in constant evolution to reflect changing corporate priorities and needs.

The evaluation and control system has contributed to the Bank’s renewal over the past five years. Overall, the development effectiveness of Bank operations has improved, and development effectiveness has been enhanced through a stronger country focus, improved responsiveness, and enhanced operational quality. Increasing demands at the country and global levels, expanding roles for capacity building and aid coordination, and the increasing complexity of operations nonetheless require that the Bank intensify its efforts to enhance its evaluation skills, instruments, processes, and relationships.

The need to demonstrate results, especially in the area of reducing poverty, requires that the World Bank, in consultation with its development assistance partners and developing country members, continue to place a high priority on enhancing its evaluation capacity. The Bank accordingly has initiated work to enhance the monitoring and evaluation of country-based poverty reduction programs, through capacity building and evaluation harmonization efforts linked to the PRSP initiative.

 

References

Appleton, Simon. 2001. "Changes in Poverty and Inequality." In Ritva Reinikka and Paul Collier, eds. Uganda’s Recovery: The Role of Farms, Firms, and Government. Washington, D.C.: World Bank.

Barro, Robert. 1991. "Economic Growth in a Cross Section of Countries." Quarterly Journal of Economics 106: 407-443.

Barro, Robert, and Xavier Sala-I-Martin. 1995. Economic Growth. New York: McGraw-Hill.

Boone, Peter. 1996. "Politics and the Effectiveness of Foreign Aid." European Economic Review 40(2): 289-329.

Canning, David, Marianne Fay, and Roberto Perotti. 1994. "Infrastructure and Growth." In Mario Baldassarri, Luigi Paganetto, and Edmund Phelps, eds. International Differences in Growth Rates: Market Globalization and Economic Areas. New York: St. Martin's Press, 113-47.

Claeson, M., C.C. Griffin, T.A. Johnston, M. McLachlan, A.L. Soucat, A. Wagstaff, and A.S. Yazbeck. 2001. "Poverty Reduction and the Health Sector." In Poverty Reduction Strategy Sourcebook. World Bank.

Chong, A., and Hentschel, J. 1999. "Bundling of Basic Services, Welfare and Structural Reform in Peru." Processed. The World Bank Group, Washington, D.C.

Collier, Paul, Shantayanan Devarajan, and David Dollar. 2001. "Measuring IDA's Effectiveness." Processed. World Bank, Washington, D.C.

Collier, Paul, and David Dollar. 2001a. "Development Effectiveness: What Have We Learnt?" Processed. Development Research Group. World Bank, Washington, D.C.

———. 2001b. "Aid, Risk and the Special Concerns of Small States." In Global States and the World Economy. Commonwealth Secretariat.

Collier, Paul, David Dollar, and Nicholas Stern. 2001. "Fifty Years of Development." In Stern and Nicholas, eds. A Strategy for Development. Washington, D.C.: World Bank.

Collier, Paul, and Jan Gunning. 1995. "War, Peace and Private Portfolios." World Development 23(2): 233-41.

Devarajan, Shantayanan, David Dollar, and Torgny Holmgren, eds. 2001. Aid and Reform in Africa. Washington, D.C.: World Bank.

Devarajan, Shantayanan, William R. Easterly, and Howard Pack. 2001. "Is Investment in Africa Too Low or Too High?" Journal of African Economies.

Dollar, David and Aart Kraay. 2001. "Growth is Good for the Poor." Policy Research Working Paper 2587. World Bank, Washington, D.C.

Dollar, David, and Jacob Svensson. 1998. "What Explains the Success or Failure of Structural Adjustment Programs?" Development Research Group. World Bank, Washington, D.C.

Dutz, Mark, and Ayden Hayri. 2000. "Does More Intense Competition Lead to Higher Growth?" Policy Research Working Paper 2320. World Bank, Washington, D.C.

Easterly, William. 2001. The Elusive Quest for Growth: Economists’ Adventures and Misadventures in the Tropics. Cambridge, Mass.: MIT Press.

Easterly, William, and Ross Levine. 2001. "It’s Not Factor Accumulation: Stylized Facts and Growth Models." Unpublished paper. World Bank, Washington, D.C.

Feizioglu, Tarhan, Vinaya Swaroop, and Min Zhu. 1998. "A Panel Data Analysis of the Fungibility of Foreign Aid." World Bank Economic Review 12(1): 29-58.

Fischer, Stanley. 1993. "The Role of Macroeconomic Factors in Growth." Journal of Monetary Economics 32(3): 485-512.

Frankel, Jeffrey, and David Romer. 1999. "Does Trade Cause Growth?" American Economic Review 89(3): 379-99.

Gallup, John Luke, Jeffrey Sachs, and Andrew Mellinger. 1999. "Geography and Economic Development." Annual Bank Conference on Economic Development 1998, 127-78. World Bank, Washington, D.C.

Hansen, Henrik, and Finn Tarp. 2000. "Aid Effectiveness Disputed." In Finn Tarp, ed. Foreign Aid and Development: Lessons Learnt and Directions for the Future. London: Routledge.

Hansen, Henrik, and Finn Tarp. 2001. "Aid and Growth Regressions." Journal of Development Economics 64: 547–570.

Hanushek, Eric, and Dongwook Kim. 1995. "Schooling, Labor Force Quality, and Economic Growth." NBER Working Paper 5399. National Bureau of Economic Research, Cambridge, Mass.

International Finance Corporation (IFC). 2001. OEG Findings (June). Washington, D.C.: International Finance Corporation.

———. 2002. Annual Review of IFC’s Evaluation Findings FY2001. Washington, D.C.: International Finance Corporation.

International Monetary Fund (IMF). 1998. External Evaluation of ESAF: Report by a Group of Independent Experts. Washington, D.C.: IMF.

International Monetary Fund and World Bank. 2002. Review of the Poverty Reduction Strategy Paper (PRSP) Approach: Early Experience with Interim PRSPs and Full PRSPs. Unpublished paper. Washington, D.C.

Jayarajah. Carl, William Branson, and Binayek Sen. 1996. Social Dimensions of Adjustment: World Bank Experience 1980-93. Operations Evaluation Study. Washington, D.C.: World Bank.

Johnson, John H., and Sulaiman Wasty. 1993. "Borrower Ownership of Adjustment Programs and the Political Economy of Reform." Discussion Paper No. 199. World Bank, Washington, D.C.

Kapur, Devesh, John P. Lewis, and Richard Webb. 1997. The World Bank: Its First Half Century. Volume 1, History. Washington, D.C.: Brookings Institution Press.

Killick, Tony. 1999. "Making Adjustment Work for the Poor." Poverty Briefing. Overseas Development Institute, London.

Krueger, Alan, and Mikael Lindahl. 1999. "Education for Growth in Sweden and the World." Swedish Economic Policy Review 6(2): 289-339.

Levine, Ross, and David Renelt. 1992. "A Sensitivity Analysis of Cross-Country Growth Regressions." American Economic Review 82(4): 942-63.

Maddison, Angus. 1995. Monitoring the World Economy. Paris: Organization for Economic Co-operation and Development.

Narayan, Deepa and Patti Petesch. 2002. Voices of the Poor: From Many Lands. Published for the World Bank. New York: Oxford University Press.

Owens, Trudy, and John Hoddinott. 1998. "Investing in Development or Investing in Relief: Quantifying the Poverty Tradeoffs using Zimbabwe Household Panel Data." Centre for the Study of African Economies. Working paper series No. WPS/99-4. Zimbabwe.

Pritchett, Lant. 2000. "Understanding Patterns of Economic Growth: Searching for Hills among Plateaus, Mountains and Plains." World Bank Economic Review 14(2): 221-50.

Ravallion, Martin. 2001. "Growth, Inequality, and Poverty: Looking Beyond Averages." World Development 29(11): 1803-15.

Ravallion, Martin, and Shaohua Chen. 1997. "What Can New Survey Data Tell Us about Recent Changes in Distribution and Poverty?" World Bank Economic Review 11(2): 357-82.

Rodrik, Dani. 2001. "Institutions, Integration, and Geography: In Search of the Deep Determinants of Economic Growth." Unpublished paper. Harvard University.

Romer, Paul. 1994. "New Goods, Old Theory, and the Welfare Costs of Trade Restrictions." Journal of Development Economics 43: 5-38.

Sachs, Jeffrey, and Andrew Warner. 1995. "Economic Reform and the Process of Global Integration." Brookings Papers on Economic Activity 0(1): 1-95.

Sahn, David, ed. 1996. Economic Reform and the Poor in Africa. Oxford: Clarendon Press.

Sen, Amartya. 1999. Development as Freedom. New York: Knopf.

Stern, Nicholas. 2001. A Strategy for Development. Washington, D.C.: World Bank.

Stewart, Frances. 1995. Adjustment and Poverty: Options and Choices. London: Routledge.

Watkins, Kevin. 1995. The OXFAM Poverty Report 1995. Oxford: OXFAM (United Kingdom and Ireland).

West, Gerald T., and Ethel I. Tarazona. 2001. Investment Insurance and Development Impact: Evaluating MIGA’s Experience. Washington, D.C.: Multilateral Investment Guarantee Agency.

World Bank. Various Years. Annual Report on Portfolio Performance (ARPP). Washington, D.C.: World Bank.

———. 1992. Effective Implementation: Key to Development Impact--Report of the World Bank’s Portfolio Management Task Force (R92-195/2/3). November 3, 1992. Washington, D.C.: World Bank.

———. 1993. The East Asian Miracle: Economic Growth and Public Policy. Washington, D.C.: World Bank.

———. 1994a. Reducing the Debt Burden of Poor Countries: A Framework for Action. Development in Practice Series. Washington, D.C.: World Bank.

———. 1994b. Structural and Sectoral Adjustment, World Bank Experience 1980-92. Operations Evaluation Department. Washington, D.C.: World Bank.

———. 1996a. Social Dimensions of Adjustment. Operations Evaluation Department. Washington, D.C.: World Bank.

———. 1996b. Agricultural Adjustment and Food Policy Reform in Mexico. Operations Evaluation Department. Washington, D.C.: World Bank.

———. 1997. China 2020: Development Challenges in the New Century. Washington, D.C.: World Bank.

———. 1998a. Assessing Aid: What Works, What Doesn’t, and Why. Washington, D.C.: World Bank.

———. 1998b. World Development Report 1998/99: Knowledge for Development. Washington, D.C.: World Bank.

———. 1999a. Country Assistance Strategies: Retrospective and Implications. (R99-228), December 7. Washington, D.C.: World Bank.

———. 1999b. Health Care in Mali: Building on Community Involvement. Operations Evaluation Department. Washington, D.C.: World Bank.

———. 1999c. Higher Impact Adjustment Lending (HIAL): Initial Evaluation. Operations Evaluation Department. Washington, D.C.: World Bank.

———. 1999d. Investing in Health, Development Effectiveness in the Health, Nutrition, Population Sector. Operations Evaluation Department. Washington, D.C.: World Bank.

———. 1999e. The World Bank Grant Program and the Consultative Group on International Agricultural Research (CGIAR). Operations Evaluation Department. Washington, D.C.: World Bank.

———. 2000a. An Analysis of Combating Iodine Deficiency: Case Studies of China, Indonesia and Madagascar. Washington, D.C.: World Bank.

———. 2000b. Can Africa Claim the 21st Century? Washington, D.C.: World Bank.

———. 2000c. Fixing ESW: Where Are We? (CODE 2000-76), July 11. Washington, D.C.: World Bank.

———. 2000d. Reforming Public Institutions and Strengthening Governance, A World Bank Strategy. Washington, D.C.: World Bank.

———. 2000e. World Development Report 2000/2001: Attacking Poverty. Washington, D.C.: World Bank.

———. 2001a. Adjustment from Within: Lessons from the Structural Adjustment Participatory Review Initiative. Prepared for the Second Global SAPRI Forum, July 30-31, Washington, D.C.

———. 2001b. Adjustment Lending Retrospective: Final Report. Washington, D.C.: World Bank.

———. 2001c. Fixing ESW: Phase II--Challenges and Net Steps in the ESW Reform Process (SecM2001-0431), June 28, 2001.

———. 2001d. Global Economic Prospects 2002: Making Trade Work for the World’s Poor. Washington, D.C.: World Bank.

———. 2001e. Quality of ESW in FY00--A QAG Assessment (CODE 2001-0033), April 2. Washington, D.C.: World Bank.

———. 2001f. World Development Report 2002: Building Institutions for Markets. Washington, D.C.: World Bank.

———. 2002a. "Estimating the Additional Aid Required to Attain the Millennium Development Goals: The World Bank’s Approach, and Comparisons with Other Approaches." Unpublished paper, Human Development Network. Washington, D.C.

———. 2002b. Globalization, Growth, and Poverty: Building an Inclusive World Economy. Washington, D.C.: World Bank.

———. 2002c. Transition: The First Ten Years. Analysis and Lessons for Eastern Europe and the Former Soviet Union. Washington, D.C.: World Bank.

 

Notes

1 | This paper was prepared under the direction of Nicholas Stern, Chief Economist and Senior Vice President Development Economics (DEC); and Ian Goldin, Director of Development Policy. Halsey Rogers, a Senior Economist, was the lead author. Sections and 5 draw heavily on the experience of the Operations Evaluation Department; the interpretation of the material is the responsibility of DEC. The research team is grateful for the contributions, comments and assistance of many people. Gregory Ingram and Patrick Grasso provided essential contributions and insights throughout the preparation of the paper. Coralie Gevers and Amy Jill Heyman made many valuable contributions. Lawrence MacDonald provided helpful editorial guidance. Others who provided inputs and comments include: Sadiq Ahmed, Martha Ainsworth, Robert J. Anderson, Caroline Anstey, Oscar Avalle, Rema Balasundaram, Amar Bhattacharya, Sara Calvo, Chiraporn Chotikabukkana, Paul Collier, Louise Cord, Deborah Danker, Angus Deaton, Shanta Devarajan, David Dollar, Eduardo Doryan, Clara Else, Bernd Esdar, Shahrokh Fardoust, Alan Gelb, Egbert Gerken, Coralie Gevers, Daniela Gressani, Amy Jill Heyman, Stephen Howes, Assaad Jabre, Asma Jahangir, Keith Jay, Olga Jonas, Homi Kharas, Ioannis Kessides, Pierre-Joseph Kingbo, Jeni Klugman, Kathie Krumm, Geoff Lamb, Patricia Laverley, Zita Lichtenberg, Johannes Linn, Kevin Lu, Frank Lysy, Callisto Madavo, Ernesto May, Pradeep Mitra, Peter Moll, Carlos Mollinedo-Trujillo, Mustapha Nabli, Govind Nair, Dorota Nowak, Anthony Ody, Douglas Pearce, Manuel Penalver, David Peretz, Guillermo Perry, Robert Picciotto, Amedee Prouvost, Oliver Rajakaruna, Maria Ramos, Mamphela Ramphele, Teja Raparla, Martin Ravallion, Ritva S. Reinikka, Joanne Salop, Jean-Louis Sarbib, Amartya Sen, Nemat Shafik, William Shaw, Veena Siddarth, Anil Sood, Joseph Stiglitz, Rebecca Sugui, Helen Sutch, Kotaro Suzumura, Svet Tintchev, Hasan Tuluy, Ko-Yung Tung, and John Underwood, as well as Ken Rogoff and his colleagues in the Research Department of the IMF. The participants at a seminar with InterAction provided very useful suggestions on the outline. Finally, while this paper, as a research paper, was not subject to clearance by the Executive Board of the World Bank, the research team would also like to thank the Executive Directors of the Bank for their excellent comments on the draft.

2 | Data are taken from the World Bank’s SIMA database and from World Bank (2002b).

3 | The quality and coverage of the household survey data used to measure poverty have improved dramatically in the last ten to fifteen years, and the Bank has played an important role in facilitating this improvement. The Bank's "$1/day" poverty estimates since 1990 have drawn fully on these new data. However, the paucity of adequate survey data back in time naturally makes estimation over longer periods more hazardous. In Globalization, Growth, and Poverty, it was estimated that the number of people living below $1/day had fallen by 200 million between 1980 and 1998. As noted in the report, that estimate had to be based on two different sources, which used different methods. Further checks using more consistent methods corroborate the earlier estimate. These estimates also suggest that without China there would have been little or no net drop in the total number of poor.

4 | More than half the world’s population still lives on less than $2 per day, an alternative poverty line close to the national line used in many countries. Nevertheless, the share living in poverty by this measure has also declined sharply over the past decade, from 62 percent to 55 percent; unlike the poverty line of $1 per day, most of this reduction is attributable to China’s rapid growth (World Bank, 2001d).

5 | The effective World Bank support for the education sector is considerably larger than this, because some broader policy-based lending includes support for education-sector reforms. Even calculated this way, however, the resources that the Bank can possibly provide in support of education are dwarfed by the needs of developing countries.

6 | Although our knowledge has already expanded significantly in this area, the World Bank has recently taken steps to accelerate its learning by establishing a Task Force on Low-Income Countries under Stress. That task force will soon be delivering its report. More details can be found in Section 3.1 of this paper.

7 | In discussions of the raison d'être of the World Bank, John Maynard Keynes envisaged the organization’s primary duty as reconstruction of war-torn economies. Between 1946–1948, the Bank had lent $497 million ($2 billion in constant 1995 US$), mostly in the form of reconstruction credits. In May 1947, France became the first loan recipient, and soon after, similar loans were approved for Denmark, Luxembourg, and the Netherlands (Kapur, Lewis, and Webb 1997, Chapter 2).

8 | World Bank (2000e), Sen (1999).

9 | Based on Stern (2001), Collier, Dollar, and Stern (2001).

10 | World Bank (2001f).

11 | This section draws on various surveys, including Barro (1991), Barro, Robert, and Xavier Sala-I-Martin. (1995), Rodrik (2001), and Easterly and Levine (2001).

12 | Fischer (1993).

13 | Sachs and Warner (1995), Frankel and Romer (1999).

14 | World Bank (2001d). Although this result is simply a correlation and does not prove causation, faster economic growth and productivity increases could be causing greater export competitiveness, rather than the other way around. The Frankel and Romer (1999) paper cited above attempts to get around this problem by looking at exogenous factors (specifically, geography) that lead to higher trade levels and then looking at differences in growth rates.

15 | Levine and Renelt (1992).

16 | Easterly and Levine (2001).

17 | Devarajan, Easterly, and Pack (2001) make this point in the African context.

18 | Krueger and Lindahl (1999), Hanushek and Kim (1995).

19 | In an environment of weak institutions, widespread corruption, or lawlessness, additional education may simply make the average worker more effective at rent-seeking or illegal activities.

20 | Rodrik (2001), World Bank (2001f).

21 | Romer (1994).

22 | Dutz and Hayri (2000) provide some evidence on the role of competition authorities in spurring productivity growth.

23 | Canning, Fay, and Perotti (1994) provide evidence on the effects of infrastructure on growth. Various studies (such as Collier and Gunning 1995) have cited poor infrastructure as a major reason for poor African economic performance.

24 | Issue paper jointly prepared by the African Development Bank, the Asian Development Bank, and the World Bank for the Third United Nations Conference on the Least Developed Countries, Infrastructure Development Session, May 2001).

25 | Chong and Hentschel (1999).

26 | Gallup, Sachs, and Mellinger (1999), World Bank (2002b).

27 | Collier and Gunning (1995).

28 | Pritchett (2000), Easterly (2001)

29 | This section draws heavily on World Bank (1998b), World Bank (2000e), Dollar and Kray (2001).

30 | World Bank (2002b).

31 | World Bank (2000b), p. 91.

32 | Ravallion (2001) analyzes the variation behind this average relationship.

33 | World Bank (2000e), p. 54.

34 | For example, a devaluation tends to benefit poor farmers producing cash crops, but the resulting price increase may hurt the urban poor, at least in the short term.

35 | World Bank (2000e), and Narayan and Petesch (2002).

36 | World Bank (1998b), p. 17.

37 | Krueger and Lindahl (1999) summarize the evidence.

38 | Note that for expositional clarity, all countries’ incomes in 1970 are indexed to a value of 100. The "high group" includes China, Botswana, the Republic of Korea, Singapore, Hong Kong (China), Thailand, Mauritius, Malaysia, Indonesia, and Egypt. The "low group" includes Chad, Haiti, Central African Republic, Venezuela, Madagascar, Zambia, Niger, Kiribati, Nicaragua, and Sierra Leone.

39 | Claeson and others (2001).

40 | In China, for example, per-capita incomes increased by less than a third in the 130 years between 1820 and 1950 (World Bank 1997, citing Maddison 1995).

41 | See, for example, World Bank (1993).

42 | World Bank (2002b).

43 | Collier, Dollar, and Stern (2001), World Bank (2002b), calculations from World Bank data.

44 | IBRD lending was resumed in 1997 and 1998 to help Korea deal with the East Asian financial crisis. In view of the subsequent rapid economic recovery and Korea’s regained access to capital markets, the Korean government and the Bank have agreed on a new phase of cooperation based on nonlending services, underpinned by a Memorandum of Understanding for a Knowledge Partnership.

45 | Of course, there is a continuum of performance, and the precise dividing line between these groups of countries is to some extent arbitrary. Nevertheless, it is clear that development progress has varied widely across countries, and policies and institutions are linked with performance.

46 | AIDS also threatens gains in education, in part due to the loss of teachers to the epidemic.

47 | World Bank (2000b).

48 | World Bank (2002c).

49 | See, for example, Boone (1996); note, however, that Hansen and Tarp (2000 and 2001) find the contrary.

50 | Owens and Hoddinott (1998).

51 | This section is based heavily on World Bank (1998a) and Collier and Dollar (2001a).

52 | Some recent analyses have confirmed the importance of aid but failed to find the strong link between aid effectiveness and policy environment shown in the research cited earlier; see, for example, Hansen and Tarp (2000 and 2001). For this reason, the numbers on aid effectiveness cited here should be taken as approximations. Nevertheless, the cross-country evidence on an aid-policy interaction is borne out strongly by case study research such as Devarajan, Dollar, and Holmgren (2001).

53 | World Bank (1998a) makes this point, providing a useful set of hypothetical examples and summarizing the empirical evidence (Chapter 3). It notes that because of fungibility, Feizioglu, Swaroop, and Zhu’s (1998) cross-sectional study of fourteen countries found that the net effect of a dollar’s worth of aid to agriculture was a slight decrease in spending on agriculture.

54 | Devarajan, Dollar, and Holmgren (2001).

55 | See Figure 4.4 of this paper.

56 | In 1997, the most recent data available, government expenditures for high-income OECD countries accounted for 29.5 percent of total GDP. Assuming that this relative level of spending continued through 2000, when their total GDP was $24.073 trillion, total government spending was 7.1 trillion. Total ODA in 2000 was $53.7 billion. So ODA as a share of government expenditures was 0.76 percent.

57 | These calculations are based on cross-country regressions that correlate aid with improvements in growth and poverty reduction, after adjusting for policy and other variables; see Collier and Dollar (2001a, 2001b) and Collier, Devarajan, and Dollar (2001) for details.

58 | The table shows overdues of over 180 days (that is, in "nonaccrual status"). As of October 2001, IDA borrower countries in nonaccrual status were Afghanistan, Côte d’Ivoire, Democratic Republic of Congo, Haiti, Myanmar, Liberia, Somalia, Sudan, and Zimbabwe.

59 | The senior status of World Bank debt clearly deserves much of the credit for high repayment rates: countries will generally not default or even be late on their Bank loans if they have other options. Nevertheless, these statistics are useful as an indication that, contrary to some perceptions, countries are generally in sufficiently good economic shape after borrowing that they are able to meet their repayment schedule.

60 | World Bank (1994a).

61 | This section is based on the upcoming World Bank report (still in draft) on the findings of the Task Force on Low-Income Countries under Stress (LICUS). It should be noted that the more successful countries did benefit from extensive support from the international community, including the World Bank; boxes in this report describe the Bank’s role in providing knowledge and then lending support (both adjustment and investment) to Uganda and Mozambique. Nevertheless, within the LICUS group, these countries were exceptional in their commitment to reform.

62 | More specifically, adjustment lending began in 1980 with the purpose of helping developing countries adjust their balance of payments after the 1979 oil-price shock. With the advent of the debt crisis in 1982, the focus of adjustment lending shifted from fiscal adjustment in response to external shocks to removing obstacles to growth, with the idea of enabling countries to grow out of debt. The focus on growth was complemented in the 1990s with an explicit emphasis on poverty reduction to ensure that the benefits of growth reached the poor and that adverse social impacts of adjustment were avoided. As many countries have already removed basic macroeconomic distortions and have liberalized markets, in recent years adjustment lending has increasingly supported more complex institutional reforms, particularly in middle-income countries. As a result, the share of policy conditions supporting trade, exchange rate, and monetary policy reforms has declined from 31 percent in FY80-88 to 12 percent in FY98-00, and the share of conditions applied to infrastructure, energy, and agriculture has declined from 22 percent to 5 percent. In contrast, over the same period the shares of conditions supporting reforms in other areas increased--from 15 percent to 24 percent in public sector management, from 28 percent to 41 percent in the financial and private sectors, and from 3 percent to 18 percent in the social sectors. Across all sectors, the reform issues supported by adjustment lending are increasingly long-term and of an institutional nature. See World Bank (2001b).

63 | See, among others, Stewart (1995), Sahn (1996), and Killick (1999).

64 | Dollar and Kraay (2001) and Ravallion and Chen (1997).

65 | World Bank (2001b).

66 | A study by OED on the adjustment lending experience of 23 countries between 1980 and 1983 reveals that adjustment programs were not successfully implemented in about a third of these countries. A similar result emerges from a study of 220 adjustment loans mostly approved in the same period. See Jayarajah, Branson, and Sen (1996) and Dollar and Svensson (1998).

67 | Examples of countries that successfully implemented reform programs with the support of adjustment lending during the 1980s and early 1990s include Ghana, Mauritius, Thailand, Korea, Argentina, and Peru. In Ghana, annual per capita income growth turned from -1.6 percent in 1961-83 to 1.4 percent in 1984-94. Annual per capita growth rates between 1980 and 1984 amounted to 4.3 percent in Mauritius, 5.3 percent in Thailand, and 6.7 percent in Korea. Argentina and Peru made failed reform attempts during the 1980s, but achieved successful reforms after 1990. Per capita growth responded: in Argentina it turned from -1.9 percent annually in the 1980s to 4.7 per year in 1990-94, and in Peru from -2.6 percent to 2.6 percent in the same periods. See Easterly (2001).

68 | See, for instance, Johnson and Wasty (1993).

69 | World Bank (1998a), International Monetary Fund (1998).

70 | Devarajan, Dollar, and Holmgren (2001).

71 | World Bank (1998a).

72 | It should be noted that different studies have come to different conclusions on this point (see World Bank 2001a for a summary), but also that the evidence that adjustment harms some poor people is fully consistent with the conclusion that on average the poor benefit from reform.

73 | World Bank (2001b).

74 | It is important to note that the current success rates are nearing the upper limit of what is desirable. A success rate of 100 percent would likely indicate that the Bank was taking too few risks; as noted in the text, development is inherently a risky business, and some potentially high-return forms of external assistance will also be high-risk.

75 | World Bank (1996b).

76 | International Monetary Fund and World Bank (2002a).

77 | Poverty-reducing spending is country-specific and follows the definition in the PRSP or the I-PRSP (interim PRSP). Data are drawn from the PRSPs themselves or from other documents (such as staff reports or decision point documents). Among poverty-reducing expenditure items that are common to the countries in the sample are primary health care spending, primary education spending, water and sanitation, roads, and rural development.

78 | West and Tarazona (2001).

79 | World Bank (1999b, 1999d, and 2000a).

80 | International Finance Corporation (2001).

81 | West and Tarazona (2001).

82 | See, for example, Watkins (1995).

83 | World Bank (1994b, 1996a, 1999c).

84 | In India, where there are decades-old fiscal problems rooted in the power sector, the Bank helps reform-minded states dismantle bankrupt State Electricity Boards, privatize generation and distribution, and put in place new pricing and regulatory policies.

85 | International Finance Corporation (2002), pp. 25 and 29.

86 | These improvements have most recently been documented in the Adjustment Lending Retrospective (World Bank 2001b). It should be noted that some observers, including NGOs, continue to raise questions about the social impacts of structural adjustment programs, arguing that the use of this average satisfactory rate does not properly capture the difficult experiences of some countries.

87 | International Finance Corporation (2002), p. 14.

88 | International Finance Corporation (2002), p. 9.

89 | World Bank (1999e).

90 | World Bank (2001d).

91 | See World Bank (1993).

92 | The World Bank uses a variety of self-evaluation tools, including self-evaluation in the context of project status reports, project completion reports, and CASs, as well as reviews by the Quality Assurance Group (QAG), and periodic retrospectives of CASs, economic and sector work (ESW), and lending produced by the Operations Policy and Country Services unit (OPCS). More broadly, the Bank's research and its ESW analyze experience with the Bank's approaches to development assistance.

93 | See World Bank (various years).

94 | See World Bank (2000c) and World Bank (2001c).

95 | See World Bank (2001e).

96 | See World Bank (1999a).

97 | See World Bank (2001b).

98 | The increase in budget for the Africa region in FY02 can illustrate how these tools complement each other. Based on an analysis of the relative poverty and performance of individual countries in this region, an additional budget was proposed. To manage this shift, this extended envelope was then embodied in the region’s compact that included an explicit increase in deliverables.