Social science is broken. Can we fix it?

May 16 JDN 2459349

Social science is broken. I am of course not the first to say so. The Atlantic recently published an article outlining the sorry state of scientific publishing, and several years ago Slate Star Codex published a lengthy post (with somewhat harsher language than I generally use on this blog) showing how parapsychology, despite being obviously false, can still meet the standards that most social science is expected to meet. I myself discussed the replication crisis in social science on this very blog a few years back.

I was pessimistic then about the incentives of scientific publishing be fixed any time soon, and I am even more pessimistic now.

Back then I noted that journals are often run by for-profit corporations that care more about getting attention than getting the facts right, university administrations are incompetent and top-heavy, and publish-or-perish creates cutthroat competition without providing incentives for genuinely rigorous research. But these are widely known facts, even if so few in the scientific community seem willing to face up to them.

Now I am increasingly concerned that the reason we aren’t fixing this system is that the people with the most power to fix it don’t want to. (Indeed, as I have learned more about political economy I have come to believe this more and more about all the broken institutions in the world. American democracy has its deep flaws because politicians like it that way. China’s government is corrupt because that corruption is profitable for many of China’s leaders. Et cetera.)

I know economics best, so that is where I will focus; but most of what I’m saying here would also apply to other social sciences such as sociology and psychology as well. (Indeed it was psychology that published Daryl Bem.)

Rogoff and Reinhart’s 2010 article “Growth in a Time of Debt”, which was a weak correlation-based argument to begin with, was later revealed (by an intrepid grad student! His name is Thomas Herndon.) to be based upon deep, fundamental errors. Yet the article remains published, without any notice of retraction or correction, in the American Economic Review, probably the most prestigious journal in economics (and undeniably in the vaunted “Top Five”). And the paper itself was widely used by governments around the world to justify massive austerity policies—which backfired with catastrophic consequences.

Why wouldn’t the AER remove the article from their website? Or issue a retraction? Or at least add a note on the page explaining the errors? If their primary concern were scientific truth, they would have done something like this. Their failure to do so is a silence that speaks volumes, a hound that didn’t bark in the night.

It’s rational, if incredibly selfish, for Rogoff and Reinhart themselves to not want a retraction. It was one of their most widely-cited papers. But why wouldn’t AER’s editors want to retract a paper that had been so embarrassingly debunked?

And so I came to realize: These are all people who have succeeded in the current system. Their work is valued, respected, and supported by the system of scientific publishing as it stands. If we were to radically change that system, as we would necessarily have to do in order to re-align incentives toward scientific truth, they would stand to lose, because they would suddenly be competing against other people who are not as good at satisfying the magical 0.05, but are in fact at least as good—perhaps even better—actual scientists than they are.

I know how they would respond to this criticism: I’m someone who hasn’t succeeded in the current system, so I’m biased against it. This is true, to some extent. Indeed, I take it quite seriously, because while tenured professors stand to lose prestige, they can’t really lose their jobs even if there is a sudden flood of far superior research. So in directly economic terms, we would expect the bias against the current system among grad students, adjuncts, and assistant professors to be larger than the bias in favor of the current system among tenured professors and prestigious researchers.

Yet there are other motives aside from money: Norms and social status are among the most powerful motivations human beings have, and these biases are far stronger in favor of the current system—even among grad students and junior faculty. Grad school is many things, some good, some bad; but one of them is a ritual gauntlet that indoctrinates you into the belief that working in academia is the One True Path, without which your life is a failure. If your claim is that grad students are upset at the current system because we overestimate our own qualifications and are feeling sour grapes, you need to explain our prevalence of Impostor Syndrome. By and large, grad students don’t overestimate our abilities—we underestimate them. If we think we’re as good at this as you are, that probably means we’re better. Indeed I have little doubt that Thomas Herndon is a better economist than Kenneth Rogoff will ever be.

I have additional evidence that insider bias is important here: When Paul Romer—Nobel laureate—left academia he published an utterly scathing criticism of the state of academic macroeconomics. That is, once he had escaped the incentives toward insider bias, he turned against the entire field.

Romer pulls absolutely no punches: He literally compares the standard methods of DSGE models to “phlogiston” and “gremlins”. And the paper is worth reading, because it’s obviously entirely correct. He pulls no punches and every single one lands on target. It’s also a pretty fun read, at least if you have the background knowledge to appreciate the dry in-jokes. (Much like “Transgressing the Boundaries: Toward a Transformative Hermeneutics of Quantum Gravity.” I still laugh out loud every time I read the phrase “hegemonic Zermelo-Frankel axioms”, though I realize most people would be utterly nonplussed. For the unitiated, these are the Zermelo-Frankel axioms. Can’t you just see the colonialist imperialism in sentences like “\forall x \forall y (\forall z, z \in x \iff z \in y) \implies x = y”?)

In other words, the Upton Sinclair Principle seems to be applying here: “It is difficult to get a man to understand something when his salary depends upon not understanding it.” The people with the most power to change the system of scientific publishing are journal editors and prestigious researchers, and they are the people for whom the current system is running quite swimmingly.

It’s not that good science can’t succeed in the current system—it often does. In fact, I’m willing to grant that it almost always does, eventually. When the evidence has mounted for long enough and the most adamant of the ancien regime finally retire or die, then, at last, the paradigm will shift. But this process takes literally decades longer than it should. In principle, a wrong theory can be invalidated by a single rigorous experiment. In practice, it generally takes about 30 years of experiments, most of which don’t get published, until the powers that be finally give in.

This delay has serious consequences. It means that many of the researchers working on the forefront of a new paradigm—precisely the people that the scientific community ought to be supporting most—will suffer from being unable to publish their work, get grant funding, or even get hired in the first place. It means that not only will good science take too long to win, but that much good science will never get done at all, because the people who wanted to do it couldn’t find the support they needed to do so. This means that the delay is in fact much longer than it appears: Because it took 30 years for one good idea to take hold, all the other good ideas that would have sprung from it in that time will be lost, at least until someone in the future comes up with them.

I don’t think I’ll ever forget it: At the AEA conference a few years back, I went to a luncheon celebrating Richard Thaler, one of the founders of behavioral economics, whom I regard as one of the top 5 greatest economists of the 20th century (I’m thinking something like, “Keynes > Nash > Thaler > Ramsey > Schelling”). Yes, now he is being rightfully recognized for his seminal work; he won a Nobel, and he has an endowed chair at Chicago, and he got an AEA luncheon in his honor among many other accolades. But it was not always so. Someone speaking at the luncheon offhandedly remarked something like, “Did we think Richard would win a Nobel? Honestly most of us weren’t sure he’d get tenure.” Most of the room laughed; I had to resist the urge to scream. If Richard Thaler wasn’t certain to get tenure, then the entire system is broken. This would be like finding out that Erwin Schrodinger or Niels Bohr wasn’t sure he would get tenure in physics.

A. Gary Schilling, a renowned Wall Street economist (read: One Who Has Turned to the Dark Side), once remarked (the quote is often falsely attributed to Keynes): “markets can remain irrational a lot longer than you and I can remain solvent.” In the same spirit, I would say this: the scientific community can remain wrong a lot longer than you and I can extend our graduate fellowships and tenure clocks.

Why did we ever privatize prisons?

JDN 2457103 EDT 10:24.

Since the Reagan administration (it’s always Reagan), the United States has undergone a spree of privatization of public services, in which services that are ordinarily performed by government agencies are instead contracted out to private companies. Enormous damage to our society has been done by this sort of privatization, from healthcare to parking meters.

This process can vary in magnitude.

The weakest form, which is relatively benign, is for the government to buy specific services like food service or equipment manufacturing from companies that already provide them to consumers. There’s no particular reason for the government to make their own toothpaste or wrenches rather than buy them from corporations like Proctor & Gamble and Sears. Toothpaste is toothpaste and wrenches are wrenches.

The moderate form is for the government to contract services to specific companies that may involve government-specific features like security clearances or powerful military weapons. This is already raising a lot of problems: When Northrop-Grumman makes our stealth bombers, and Boeing builds our nuclear ICBMs, these are publicly-traded, for-profit corporations manufacturing some of the deadliest weapons ever created—weapons that could literally destroy human civilization in a matter of minutes. Markets don’t work well in the presence of externalities, and weapons by definition are almost nothing but externalities; their entire function is to cause harm—typically, death—to people without their consent. While this violence may sometimes be justified, it must never be taken lightly; and we are right to be uncomfortable with the military-industrial complex whose shareholders profit from death and destruction. (Eisenhower tried to warn us!) Still, there are some good arguments to be made for this sort of privatization, since many of these corporations already have high-tech factories and skilled engineers that they can easily repurpose, and competitive bids between different corporations can keep the price down. (Of course, with no-bid contracts that no longer applies; and it certainly hasn’t stopped us from spending nearly as much on the military as the rest of the world combined.)

What I’d really like to focus on today is the strongest form of privatization, in which basic government services are contracted out to private companies. This is what happens when you attempt to privatize soldiers, SWAT teams, and prisons—all of which the United States has done since Reagan.

I say “attempt” to privatize because in a very real sense the privatization of these services is incoherent—they are functions so basic to government that simply to do them makes you, de facto, part of the government. (Or, if done without government orders, it would be organized crime.) All you’ve really done by “privatizing” these services is reduced their transparency and accountability, as well as siphoning off a portion of the taxpayer money in the form of profits for shareholders.

The benefits of privatization, when they exist, are due to competition and consumer freedom. The foundation of a capitalist economy is the ability to say “I’ll take my business elsewhere.” (This is why the notion that a bank can sell your loan to someone else is the opposite of a free market; forcing you to write a check to someone you never made a contract with is antithetical to everything the free market stands for.) Actually the closest thing to a successful example of privatized government services is the United States Postal Service, which collects absolutely no tax income. They do borrow from the government and receive subsidies for some of their services—but so does General Motors. Frankly I think the Postal Service has a better claim to privatization than GM, which you may recall only exists today because of a massive government bailout with a net cost to the US government of $11 billion. All the Postal Service does differently is act as a tightly-regulated monopoly that provides high-quality service to everyone at low prices and pays good wages and pensions, all without siphoning profits to shareholders. (They really screwed up my mail forwarding lately, but they are still one of the best postal systems in the world.) It is in many ways the best of both worlds, the efficiency of capitalism with the humanity of socialism.

The Corrections Corporation of America, on the other hand, is the exact opposite, the worst of both worlds, the inefficiency of socialism with the inhumanity of capitalism. It is not simply corrupt but frankly inherently corrupt—there is simply no way you can have a for-profit prison system that isn’t corrupt. Maybe it can be made less corrupt or more corrupt, but the mere fact that shareholders are earning profits from incarcerating prisoners is fundamentally antithetical to a free and just society.

I really can’t stress this enough: Privatizing soldiers and prisons makes no sense at all. It doesn’t even make sense in a world of infinite identical psychopaths; nothing in neoclassical economic theory in any way supports these privatizations. Neoclassical theory is based upon the presumption of a stable government that enforces property rights, a government that provides as much service as necessary exactly at cost and is not attempting to maximize any notion of its own “profit”.

That’s ridiculous, of course—much like the neoclassical rational agent—and more recent work has been done in public choice theory about the various interest groups that act against each other in government, including lobbyists for private corporations—but public choice theory is above all a theory of government failure. It is a theory of why governments don’t work as well as we would like them to—the main question is how we can suppress the influence of special interest groups to advance the public good. Privatization of prisons means creating special interest groups where none existed, making the government less directed at the public good.

Privatizing government services is often described as “reducing the size of government”, usually interpreted in the most narrow sense to mean the tax burden. But Big Government doesn’t mean you pay 22% of GDP instead of 18% of GDP; Big Government means you can be arrested and imprisoned without trial. Even using the Heritage Foundation’s metrics, the correlation between tax burden and overall freedom is positive. Tyrannical societies don’t bother with taxes; they own the oil refineries directly (Venezuela), or print money whenever they want (Zimbabwe), or build the whole society around doing what they want (North Korea).

The incarceration rate is a much better measure of a society’s freedom than the tax rate will ever be—and the US isn’t doing so well in that regard; indeed we have by some measures the highest incarceration rate in the world. Fortunately we do considerably better when it comes to things like free speech and freedom of religion—indeed we are still above average in overall freedom. Though we do imprison more of our people than China, I’m not suggesting that China has a freer society. But why do we imprison so many people?

Well, it seems to have something to do with privatization of prisons. Indeed, there is a strong correlation between the privatization of US prisons and the enormous explosion of incarceration in the United States. In fact privatized prisons don’t even reduce the tax burden, because privatization does not decrease demand and “privatized” prisons must still be funded by taxes. Prisons do not have customers who choose between different competing companies and shop for the highest quality and lowest price—prisoners go to the prison they are assigned to and they can’t leave (which is really the whole point). Even competition at the purchase end doesn’t make much sense, since the government can’t easily transfer all the prisoners to a new company. Maybe they could transfer ownership of the prison to a different company, but even then the transition costs would be substantial, and besides, there are only a handful of prison corporations that corner most of the (so-called) market.

There is simply no economic basis for privatization of prisons. Nothing in either neoclassical theory or more modern cognitive science in any way supports the idea. So the real question is: Why did we ever privatize prisons?

Basically there is only one reason: Ideology. The post-Reagan privatization spree was not actually based on economics—it was based on economic ideology. Either because they actually believed it, or by the Upton Sinclair Principle, a large number of economists adopted a radical far-right ideology that government basically should not exist—that the more we give more power to corporations and less power to elected officials the better off we will be.

They defended this ideology on vaguely neoclassical grounds, mumbling something about markets being more efficient; but this isn’t even like cutting off the wings of the airplane because we’re assuming frictionless vacuum—it’s like cutting off the engines of the airplane because we simply hate engines and are looking for any excuse to get rid of them. There is absolutely nothing in neoclassical economic theory that says it would be efficient or really beneficial in any way to privatize prisons. It was all about taking power away from the elected government and handing it over to for-profit corporations.

This is a bit of consciousness-raising I’m trying to do: Any time you hear someone say that something should be apolitical, I want you to substitute the word undemocratic. When they say that judges shouldn’t be elected so that they can be apolitical—they mean undemocratic. When they say that the Federal Reserve should be independent of politics—they mean independent of voting. They want to take decision power away from the public at large and concentrate it more in the hands of an elite. People who say this sort of thing literally do not believe in democracy.

To be fair, there may actually be good reasons to not believe in democracy, or at least to believe that democracy should be constrained by a constitution and a system of representation. Certain rights are inalienable, regardless of what the voting public may say, which is why we need a constitution that protects those rights above all else. (In theory… there’s always the PATRIOT ACT, speaking of imprisoning people without trial.) Moreover, most people are simply not interested enough—or informed enough—to vote on every single important decision the government makes. It makes sense for us to place this daily decision-making power in the hands of an elite—but it must be an elite we choose.

And yes, people often vote irrationally. One of the central problems in the United States today is that almost half the population consistently votes against rational government and their own self-interest on the basis of a misguided obsession with banning abortion, combined with a totally nonsensical folk theory of economics in which poor people are poor because they are lazy, the government inherently destroys whatever wealth it touches, and private-sector “job creators” simply hand out jobs to other people because they have extra money lying around. Then of course there’s—let’s face it—deep-seated bigotry toward women, racial minorities, and LGBT people. (The extreme hatred toward Obama and suspicion that he isn’t really born in the US really can’t be explained any other way.) In such circumstances it may be tempting to say that we should give up on democracy and let expert technocrats take charge; but in the absence of democratic safeguards, technocracy is little more than another name for oligarchy. Maybe it’s enough that the President appoints the Federal Reserve chair and the Supreme Court? I’m not so sure. Ben Bernanke definitely handled the Second Depression better than Congress did, I’ll admit; but I’m not sure Alan Greenspan would have in his place, and given his babbling lately about returning to Bretton Woods I’m pretty sure Paul Volcker wouldn’t have. (If you don’t see what’s wrong with going back to Bretton Woods, which was basically a variant of the gold standard, you should read what Krugman has to say about the gold standard.) So basically we got lucky and our monetary quasi-tyrant was relatively benevolent and wise. (Or maybe Bernanke was better because Obama appointed him, while Reagan appointed Greenspan. Carter appointed Volcker, oddly enough; but Reagan reappointed him. It’s always Reagan.) And if you could indeed ensure that tyrants would always be benevolent and wise, tyranny would be a great system—but you can’t.

Democracy doesn’t always lead to the best outcomes, but that’s really not what it’s for. Rather, democracy is for preventing the worst outcomes—no large-scale famine has ever occurred under a mature democracy, nor has any full-scale genocide. Democracies do sometimes forcibly “relocate” populations (particularly indigenous populations, as the US did under Andrew Jackson), and we should not sugar-coat that; people are forced out of their homes and many die. It could even be considered something close to genocide. But no direct and explicit mass murder of millions has ever occurred under a democratic government—no, the Nazis were not democratically elected—and that by itself is a fully sufficient argument for democracy. It could be true that democracies are economically inefficient (they are economically efficient), unbearably corrupt (they are less corrupt), and full of ignorant idiotic hicks (they have higher average educational attainment), and democracy would still be better simply because it prevents famine and genocide. As Churchill said, “Democracy is the worst system, except for all the others.”

Indeed, I think the central reason why American democracy isn’t working well right now is that it’s not very democratic; a two-party system with a plurality “first-past-the-post” vote is literally the worst possible voting system that can still technically be considered democracy. Any worse than that and you only have one party. If we had a range voting system (which is mathematically optimal) and say a dozen parties (they have about a dozen parties in France), people would be able to express their opinions more clearly and in more detail, with less incentive for strategic voting. We probably wouldn’t have such awful turnout at that point, and after realizing that they actually had such a strong voice, maybe people would even start educating themselves about politics in order to make better decisions.

Privatizing prisons and soldiers takes us in exactly the opposite direction: It makes our government deeply less democratic, fundamentally less accountable to voters. It hands off the power of life and death to institutions whose sole purpose for existence is their own monetary gain. We should never have done it—and we must undo it as soon as we possibly can.