Shale Gas Priorities? I’d Like to Use a Lifeline.

Yesterday, we released a survey of 215 shale gas development experts that found a surprising amount of agreement between experts from academia, industry, government, and environmental NGOs on what potential environmental risks due to hydraulic fracturing for natural gas are of most pressing need for attention.  Why, though, is a survey of experts a useful exercise in this policy context, and, furthermore, how do you go about sampling experts?

The shale gas boom has seemingly dropped out of the sky into the laps of policy makers and the public who until very recently had little idea what hydraulic fracturing was, and certainly did not know how to feel about its potential costs and benefits.  So, what should we do?  Some states have decided there is not enough yet known and instituted moratoriums on certain practices or indeed on all shale gas development, but far more have decided the known (or unkown) risks can be managed and are likely to be overwhelmed by the rewards.  Who should these regulators turn to when they are in the hot seat?

In his 2005 book, The Wisdom of Crowds, James Surowiecki noted that another group in the hot seat, contestants on the hit game show Who Wants to Be a Millionaire were far more successful when they polled the audience (91% correct answer) than when they phoned a friend who they thought would be an expert (65% correct). But what if you could do both? Polling a large group of experts could give you the benefit of crowds and the benefit of expertise.

Without a ready-made expert studio audience, or even a way to randomly sample the population of experts, RFF had to create our own population by searching news stories, academic literature, government hearings, conference participant lists, and recommendations of an expert about who else to contact, as well as identifying every organization, firm, and governmental body that has a prominent role in the public discussion. This gave us a pool of over 1000 experts. After eliminating those who disclaimed expert status, and extra people from organizations that elected to give a single response, just over 700 remained. Of these, 30% (215 experts) took part in our lengthy survey. Remarkably, the response rate was nearly identical across the four groups of experts (industry, environmental NGO, academic, and government experts), so we are confident that non-response bias from an institutional perspective is not a problem.

The report details how our responses came from experts representing or affiliated with nearly every big firm, headline environmental NGO, state government, federal department, and university that has played a prominent role in shale gas development.  We choose to group the experts by organization (NGOs, industry, government, and academia) because that was clearly the characteristic that mattered most—organization was a strong predictor of how many high priorities experts had, their views on boomtowns, whether government or industry should take the lead on addressing risks, and just how severe the risks of certain accidents are.  As long as group was controlled for, years of experience in oil and gas or in shale development itself as well as specific expertise or education had little to no explanatory value.

This suggests that regulators and the public, when hearing from a specific expert, should ask “who do you work for?” just as often as they ask “what do you know?” when trying to build their own panel of diverse advice.

This makes it even more surprising, however, that we found so much consensus between the four groups of experts on 12-15 specific risk pathways that are in need of more government or industry attention.  For a regulator unable to assemble her own TV studio full of shale gas experts, these risks are the ones she should keep most in mind. For more on that, see our summary report.

About Hal Gordon

Hal Gordon is a research assistant at Resources for the Future.

About Alan J. Krupnick

Alan Krupnick is director of Resources for the Future’s Center for Energy Economics and Policy and a senior fellow at RFF. As the director of CEEP, Alan works with the full complement of Center researchers to establish and carry out the Center’s research agenda.

Views expressed above are those of the author. Resources for the Future does not take institutional positions on legislative or policy questions. All information contained on Common Resources is intended for informational and educational purposes and may only be used for these purposes. Please see RFF's Terms of Use for further information.

Comments
3 Responses to “Shale Gas Priorities? I’d Like to Use a Lifeline.”
  1. John Graves says:

    Thank you for an instructive approach to the ‘consensus challenge’. You have to identify participants, isolate their comments, corelate their responses and offer an educated guess regarding your findings. Never easy.
    I find it interesting that the commentary tracks pp 176 – 196 in my book, Fracking, America’s Alternative Energy Revolution, rreasonably well. I am both gratified that we have reached similar conclusions on the important environmental issues in the frac debate, that we each are willing to share with nominal prejudice and that consensus is more valid that diatribe.
    Thank you!
    John Graves
    805-652-6948

Trackbacks
Check out what others are saying...
  1. [...] In a recent letter, Senator Wyden (D-OR) called for balanced regulations on hydraulic fracturing that protect public health and the environment, especially in terms of air and water quality. Potential risks to surface water and air quality are also highlighted as priorities in a new report by experts in RFF’s Center for Energy Economics and Policy. A key finding in the report is a high degree of consensus among experts from government agencies, industry, academia, and nongovernmental organizations about the specific environmental risks to mitigate. Read more about the survey and experts here. [...]



Leave A Comment