Michael Giberson
In general, in public policy analysis, you’d like to judge ultimate success or failure of a program by its net results, by actual benefits less the costs involved in achieving those benefits. Admittedly sometimes benefits are hard to measure, but ultimately the point of a policy change is to bring about some improvement in something somewhere. Ultimately it would be nice, once a program is done, to try to find and measure that improvement.
What we often get instead, however, is an attempt to infer a benefit based on the expenditures on the program: how much money was spent, how many people were employed, how many miles of ditches were dug, and so on. This is, more or less, what we see this week from the U.S. Department of Energy in the study it commissioned from the National Renewable Energy Lab on the impact of the Section 1603 Treasury Grant Program.
The Section 1603 grants were payments made to qualifying renewable power projects in lieu of those projects claiming the Investment Tax Credit or Production Tax Credit subsidies for which the projects would have otherwise qualified for. The NREL study looked at the $9.7 billion in program spending up through November 10, 2011; by the time the program ended it’s three-year run in December 31, 2011 over $11 billion in federal funds had be committed.
The DOE asked NREL to estimate the effects of the 1603 program on jobs and economic expenditures. In NREL’s report they explicitly state that their work is an estimate of “gross jobs, earnings, and economic output.” This means that they don’t consider any private sector crowding out, any disincentives from the taxation needed to support the program, any consequences from duplication of other government incentive programs, and so on. They simply treat the federal resources as if it were manna falling from the heavens, and the jobs, capital, and industries that became involved in building renewable power plants would have otherwise sat idle. (Note that I’m not criticizing NREL in performing just a piece of the overall analysis, they just did the work that DOE asked for and paid them to do.)
But note that this is primarily a study which just measures the expenses of the program and a part of what the expenditures bought. So, it is a partial study of the costs of the Section 1603 program, and not any kind of estimate of any of the benefits of the program.
Nonetheless, in the DOE press release accompanying publication of the study, they said the study found “the program has been a huge success.” How does it justify its claim of success? By noting how much was spent, how many people were employed, and how many things were subsidized by the program.
The DOE is not the only one to claim success. At Climate Progress, Stephen Lacey’s assessment is titled, “Grant Program Supported Up To 75,000 Wind And Solar Jobs: Congress Killed It Anyway.” Lacey’s post does mention some of the construction activity might have happened even without the grants, and he observes it estimates just the gross impact (and, by implication, doesn’t reflect any negative effects due to the crowding out of unsubsidized economic activity). But along the way Lacey keeps claiming the program was a success. How does he know? Well, he summarizes from the NREL report: the government spent a lot of money, hired a lot of people, and subsidized the purchase of a lot of things.
Great, but resources consumed is not a measure of success. Any fool can spend money, but spending it well can be a challenge. Is there any evidence in the NREL report that the money was well spent?
If the answer to that question is “no,” then we can’t conclude that the program was a success.
ADDITIONAL LINKS: Reactions to the NREL report from North American Windpower, Solar Industry magazine, and Clean Technica. Rep. Ed Markey (MA) cited the report in calling for Republicans to support “revisions to the tax code that level the playing field for clean energy.”