Error Correction and Ethics
You probably have missed it, but there is a major furor within the economics profession concerning the findings of an academic paper written by Carmen Reinhart and Kenneth Rogoff in 2010. The profession issues a torrent of papers annually, most of which remain scarcely read and massively under-appreciated. Probably deservedly so since the sole objective of most is to meet the check-box requirement of publication that dominates academia. This desperation to publish to build reputation and to demonstrate mastery of the subject to a determinedly self-referential peer group is one of the causes of the rapid decline within economics: it encourages ever more fragmentation of the subject into ever less relevant sub-disciplines, and has resulted in a near total elimination of a common understanding – or common memory – of its development.
It has also produced sloppiness.
The R-R paper has now become a cause-celebre of such sloppiness.
This would not normally be worthy of passing along to a broader audience – who cares what academic economists write after all? – were it not for the particular topic that R-R covered.
Recall that R-R wrote a very popular and useful book, published in 2009, called “This Time Is Different”, which was a long history of financial crises and the reverberation that such crises tend to have. The book is loaded with good data and reinforced the longstanding view that recoveries from recessions whose source is a financial crisis is always longer and more arduous than is recovery from a more ‘normal’ recession. It is a terrific book worth reading by anyone trying to get their arms around how we arrived where we are today.
So the R-R paper published a year later was naturally going to attract a lot of attention.
Which it did. Especially from the ranks of austerity advocates who seized on one of the paper’s major findings: notably that economies where the ratio of government debt to GDP rises above 90% appear to underperform radically. To be precise, R-R found that economies with debt ratios below that magic 90% mark tend to grow in the 3% – 4% range annually, whereas those with ratios above that mark see growth slump to a minuscule 0.1%. That’s a big difference. One that captured everyone’s attention.
Almost immediately R-R’s reputation as gurus and specialists in our crisis rocketed upward. They became near omnipresent in the financial press and other media, and their work was used to advance the cause of austerity everywhere.
There is one small problem.
R-R made a mistake. Not a small mistake. A very significant mistake.
Correct that mistake, as Robert Pollin, Michael Ash, and Thomas Herndon now have, we learn that the awful 0.1% GDP growth of countries above the magic 90% ratio is actually a more robust, if not stellar, 2.2%.
In other words the R-R conclusion, a bedrock of austerity policy in recent times, melts into thin air.
Whoops.
More than whoops: oh dear!
Ordinary people around the world have lost their jobs due to austerity policies being crammed down the throats of various economies in no small part due to the R-R paper. Regular folks have had their lives ruined. Those innocent people have the right to wonder about the skill and the ethics of any profession that wields such power and has such authority, and yet has so little control over its various representatives.
The economics profession has just arrived at a crucial ethical point.
Its theoretical underpinnings are a mess. There is no point in beating that particular dead horse any longer. The myriad obvious, deep, and yet totally accepted flaws in modern – and much past – theory are a shameful testament to the increasing separation of economics from the real world. But the subject’s influence still grows. Its better known advocates garner reputations and reward unrelated to the actual efficacy of the advice they give. They infest policy making agencies the world over.
Were the correction of R-R to have taken place in a more arcane backwater of academia it would be a subject for little comment. But this is economics. This is far from arcane. Livelihoods are at stake. It is reasonable, therefore, for society to expect more than simple correction.
It isn’t just the error that ought raise the hackles of those affected by policies relying on R-R, but it is the way in which the error stood. My speculation is that R-R allowed the error to stand because the result was to their liking. They saw the magic line appear, it confirmed their pre-existing commitment or predilection for austerity, and thus they saw no need to check their calculation. They rushed out their paper in the afterglow of the acclaim of their book, and were swept up in the glaring light of celebrity. They sought fame not rigor.
This is a clear example of the pervasive nature of political worldview muddying what appears on the surface as academic work. I have no complaint about that because I think it is unavoidable, but it ought to be explicit. Social science is a lot more social than it is science. And it is holistic in that economics is irretrievably intertwined with politics, psychology, and sociology etc. no matter what the much-splintered halls of academia would have us all believe to the contrary. To study one is to get involved in them all. So all pure economics is incomplete and is tainted with ideology whether we like it or not. But error is error. And error allowed to stand because it reinforced an ideological predisposition is a weed difficult to eradicate.
Yes, the workings of ordinary academic challenge and response have worked. And error has been revealed. A paper has been debunked.
But, and I have to keep saying this, economics is no ordinary discipline. It pontificates and influences policy. It preaches certain social structures. It gives great intellectual credence to political action. It has, therefore, outsized power. Every single year its theories are absorbed by countless students. They learn its tools. They learn its doctrines. They adopt its messaging.
It had better damn well be right if is taught without revealing its different traditions.
It is not at all proper, ethical, or appropriate that errors, even when corrected, are without further consequences. Does anyone reading this truly believe that R-R will suffer similar economic consequences to those suffered by the victims of austerity policies built upon R-R’s error? Of course not.
That, in short, is the ethical challenge economists, particularly academic economists. Refuse to grapple with.
And it is no good resorting to the old argument that the establishment and enforcement of some form of ethical standard would cloud academic freedom. Of course it would. That’s the entire point of incentives: to constrain and limit options.
For a subject that preaches the efficacy and effectiveness of incentives, economics is singularly unwilling to accept the creation of incentives for itself.
We now have a live experiment: what consequences will R-R suffer? Demotion? Loss of income? Loss of employment? Loss of reputation? What exactly will happen to discipline them? I wish none of those things on anyone. But this is economics. This is a subject that daily spreads the gospel of incentives. Of the fear that limits and modifies behavior. Of the cleansing effect of market forces that correct errors and allow us to arrive at ‘optimal’ solutions. The market, economics teaches, is the ultimate corrective mechanism. It does not suffer fools.
So why does economics?
Conelrad
April 17, 2013 @ 5:44 pm
Possibly what we see here is an effect of a 1% / 99% divide of our economy and polity: when it comes to censure of the powerful and those whose thinking serves their purposes, the attitude may be “we need to look forward as opposed to looking backwards,” as one power-holder put it. For the 99%, tough!