Problems With Economic Impact Analysis: Examples From Base Communities

Guest blogger Joshua Drucker discusses his new research critiquing current practices in economic impact analysis.

4 minute read

February 17, 2016, 7:00 AM PST

By JPER


Presidio San Francisco

Hank Shiffman / Shutterstock

Guest Blogger: Joshua Drucker, PhD

Economic impact analyses are prospective estimates of how an event or action will affect a regional economy. They are most often short-to-medium term estimates (from one to ten years), and are used for a variety of purposes: to promote a business development, to analyze a shift in the structure of an economy, to justify an economic development policy, or to support a grant application for intergovernmental assistance, among others. Economic impact analyses are employed by many types of actors and are a crucial tool in economic development planning.

The way in which we currently conduct and apply economic impact analyses is problematic. All of the methods commonly used for assessing economic impacts assume in important ways that the future will be like the past. Yet economic impact analyses are used most—and are most useful—when and where substantial change is occurring. This means that analysts and policymakers often rely on inaccurate or undependable information.

I illustrate this predicament in my new research, published in the Journal of Planning Education and Research, with examples of the impacts of defense industry adjustments on American military communities. These communities frequently absorb major changes in their anchor institutions, and the large size and public nature of defense establishments means that substantial effort is applied to economic development analyses in order to understand the impacts of base closure, reuse, and related public assistance.

Policy makers want and need to know what will happen to regional economies as the result of major events, whether planned or catastrophic, and what strategies can mitigate those consequences. Consultants and planners rely on a standard analytical toolbox—that includes input-output modeling, econometric modeling, and generalizing from case studies—containing instruments that extend observed associations or embody expectations about how the future will emulate the past. The failure of the future to continue from the past can distort or bias the information derived from economic impact analyses.

Roosevelt Roads Station closed in 2000s. Base closure in Puerto Rico has contributed to systemic economic problems. 

Tools like input-output models can be particularly problematic, because they fail to account for capacity constraints or for the reorganization of economic activities. For example, a study of the recent tremendous expansion of Fort Lee, near Petersburg, Virginia, could not account for existing venues being unable to meet the anticipated surge in demand for lodging, food, and entertainment services. However, by explicitly acknowledging this failing, the analysts were able to bring attention to the need for additional economic development policies for these sectors.

https://upload.wikimedia.org/wikipedia/commons/7/70/US_Army_51005_Ordnance_Colors_Uncased_at_Fort_Lee.jpg
A ceremony for an Ordnance Company at Fort Lee, VA. (Wikipedia)

Ideally, analysts and policymakers ought to understand how assumptions of continuity affect the veracity, accuracy, and reliability of the information generated from economic impact analyses in order to support making reasonable decisions. But these assumptions rarely are made explicit by analysts or in the software packages in common use, and even more infrequently are the implications assessed directly in analytical reports. Instead, the quantitative outputs produced by economic impact analyses often are conveyed with little or no sense of the uncertainty involved.

There is no magic solution. Economic impact analyses are enormously valuable in practice and there is no suitable replacement for the information they provide. Our best methods do now and will continue to require continuity assumptions. Nevertheless, there are pragmatic ways to improve both the results of economic impact analyses and the comprehension of elected officials and decision-makers. These generally rely on strategies to make models more transparent and to compare the result of conceptually different analysis. I offer a list of strategies for analysts and planners:

  1. Reduce False Precision
  2. Disaggregate Impacts by Category
  3. Triangulate through Multiple Methods
  4. Make Comparisons
  5. Build and Explain Different Scenarios

In the article in the Journal of Planning Education and Research, each of these is illustrated with examples from military communities.

By focusing on conveying more nuanced interpretations of both the products and limitations of the methods, planners can lead in becoming better purveyors and consumers of economic impact analyses. These approaches are less cut-and-dry, but ultimately will provide a richer view of the complexities that decision makers should consider when planning for community economic resilience after a base reorganization or other economic shock.

For a link to the PDF of the Article: Drucker, Joshua. 2015. Economic impact analysis amid rapid change: Challenges, strategies, and examples from defense communities. Journal of Planning Education and Research.

Dr. Joshua Drucker is Assistant Professor of economic development and planning at University of Illinois - Chicago, in the College of Urban Planning and Public Affairs


JPER

In this new series, Journal of Planning Education and Research (JPER) articles will be made available to Planetizen readers subscription free for 30 days. This is possible through collaboration between SAGE Publications and the Association of Collegiate Schools of Planning. JPER is currently edited by Clinton Andrews and Frank Popper of the Edward J. Bloustein School of Planning and Public Policy at Rutgers University. The managing editor is Karen Lowrie ([email protected]).

Follow JPER on Twitter: @JPER7

portrait of professional woman

I love the variety of courses, many practical, and all richly illustrated. They have inspired many ideas that I've applied in practice, and in my own teaching. Mary G., Urban Planner

I love the variety of courses, many practical, and all richly illustrated. They have inspired many ideas that I've applied in practice, and in my own teaching.

Mary G., Urban Planner

Get top-rated, practical training

Bird's eye view of manufactured home park.

Manufactured Crisis: Losing the Nation’s Largest Source of Unsubsidized Affordable Housing

Manufactured housing communities have long been an affordable housing option for millions of people living in the U.S., but that affordability is disappearing rapidly. How did we get here?

March 25, 2025 - Shelterforce

U-Haul truck on road with blurred grassy roadside in background.

Americans May Be Stuck — But Why?

Americans are moving a lot less than they once did, and that is a problem. While Yoni Applebaum, in his highly-publicized article Stuck, gets the reasons badly wrong, it's still important to ask: why are we moving so much less than before?

March 27, 2025 - Alan Mallach

Rusty abandoned oil well and equipment with prickly pear cactus next to it in West Texas.

Using Old Oil and Gas Wells for Green Energy Storage

Penn State researchers have found that repurposing abandoned oil and gas wells for geothermal-assisted compressed-air energy storage can boost efficiency, reduce environmental risks, and support clean energy and job transitions.

March 31, 2025 - Pennsylvania State University

Aerial view of schoolyard in Oakland, California with newly planted trees, sports courts, and playground equipment.

Greening Oakland’s School Grounds

With help from community partners like the Trust for Public Land, Oakland Unified School District is turning barren, asphalt-covered schoolyards into vibrant, green spaces that support outdoor learning, play, and student well-being.

3 hours ago - FacilitiesNet

Power lines at golden hour with downtown Los Angeles in far background.

California Governor Suspends CEQA Reviews for Utilities in Fire Areas

Utility restoration efforts in areas affected by the January wildfires in Los Angeles will be exempt from environmental regulations to speed up the rebuilding of essential infrastructure.

4 hours ago - Los Angeles Times

Green roadside sign with white text reading "Entering Nez Perce Indian Reservation" against grassy field and blue sky.

Native American Communities Prepare to Lead on Environmental Stewardship

In the face of federal threats to public lands and conservation efforts, indigenous groups continue to model nature-centered conservation efforts.

5 hours ago - The Conversation