Slate Star Codex

Social science is broken. Can we fix it?

pnrj core principles, critique of neoclassical economics, current events, personal, science and academia , , , , , , , , , , , , ,

May 16 JDN 2459349

Social science is broken. I am of course not the first to say so. The Atlantic recently published an article outlining the sorry state of scientific publishing, and several years ago Slate Star Codex published a lengthy post (with somewhat harsher language than I generally use on this blog) showing how parapsychology, despite being obviously false, can still meet the standards that most social science is expected to meet. I myself discussed the replication crisis in social science on this very blog a few years back.

I was pessimistic then about the incentives of scientific publishing be fixed any time soon, and I am even more pessimistic now.

Back then I noted that journals are often run by for-profit corporations that care more about getting attention than getting the facts right, university administrations are incompetent and top-heavy, and publish-or-perish creates cutthroat competition without providing incentives for genuinely rigorous research. But these are widely known facts, even if so few in the scientific community seem willing to face up to them.

Now I am increasingly concerned that the reason we aren’t fixing this system is that the people with the most power to fix it don’t want to. (Indeed, as I have learned more about political economy I have come to believe this more and more about all the broken institutions in the world. American democracy has its deep flaws because politicians like it that way. China’s government is corrupt because that corruption is profitable for many of China’s leaders. Et cetera.)

I know economics best, so that is where I will focus; but most of what I’m saying here would also apply to other social sciences such as sociology and psychology as well. (Indeed it was psychology that published Daryl Bem.)

Rogoff and Reinhart’s 2010 article “Growth in a Time of Debt”, which was a weak correlation-based argument to begin with, was later revealed (by an intrepid grad student! His name is Thomas Herndon.) to be based upon deep, fundamental errors. Yet the article remains published, without any notice of retraction or correction, in the American Economic Review, probably the most prestigious journal in economics (and undeniably in the vaunted “Top Five”). And the paper itself was widely used by governments around the world to justify massive austerity policies—which backfired with catastrophic consequences.

Why wouldn’t the AER remove the article from their website? Or issue a retraction? Or at least add a note on the page explaining the errors? If their primary concern were scientific truth, they would have done something like this. Their failure to do so is a silence that speaks volumes, a hound that didn’t bark in the night.

It’s rational, if incredibly selfish, for Rogoff and Reinhart themselves to not want a retraction. It was one of their most widely-cited papers. But why wouldn’t AER’s editors want to retract a paper that had been so embarrassingly debunked?

And so I came to realize: These are all people who have succeeded in the current system. Their work is valued, respected, and supported by the system of scientific publishing as it stands. If we were to radically change that system, as we would necessarily have to do in order to re-align incentives toward scientific truth, they would stand to lose, because they would suddenly be competing against other people who are not as good at satisfying the magical 0.05, but are in fact at least as good—perhaps even better—actual scientists than they are.

I know how they would respond to this criticism: I’m someone who hasn’t succeeded in the current system, so I’m biased against it. This is true, to some extent. Indeed, I take it quite seriously, because while tenured professors stand to lose prestige, they can’t really lose their jobs even if there is a sudden flood of far superior research. So in directly economic terms, we would expect the bias against the current system among grad students, adjuncts, and assistant professors to be larger than the bias in favor of the current system among tenured professors and prestigious researchers.

Yet there are other motives aside from money: Norms and social status are among the most powerful motivations human beings have, and these biases are far stronger in favor of the current system—even among grad students and junior faculty. Grad school is many things, some good, some bad; but one of them is a ritual gauntlet that indoctrinates you into the belief that working in academia is the One True Path, without which your life is a failure. If your claim is that grad students are upset at the current system because we overestimate our own qualifications and are feeling sour grapes, you need to explain our prevalence of Impostor Syndrome. By and large, grad students don’t overestimate our abilities—we underestimate them. If we think we’re as good at this as you are, that probably means we’re better. Indeed I have little doubt that Thomas Herndon is a better economist than Kenneth Rogoff will ever be.

I have additional evidence that insider bias is important here: When Paul Romer—Nobel laureate—left academia he published an utterly scathing criticism of the state of academic macroeconomics. That is, once he had escaped the incentives toward insider bias, he turned against the entire field.

Romer pulls absolutely no punches: He literally compares the standard methods of DSGE models to “phlogiston” and “gremlins”. And the paper is worth reading, because it’s obviously entirely correct. He pulls no punches and every single one lands on target. It’s also a pretty fun read, at least if you have the background knowledge to appreciate the dry in-jokes. (Much like “Transgressing the Boundaries: Toward a Transformative Hermeneutics of Quantum Gravity.” I still laugh out loud every time I read the phrase “hegemonic Zermelo-Frankel axioms”, though I realize most people would be utterly nonplussed. For the unitiated, these are the Zermelo-Frankel axioms. Can’t you just see the colonialist imperialism in sentences like “\forall x \forall y (\forall z, z \in x \iff z \in y) \implies x = y”?)

In other words, the Upton Sinclair Principle seems to be applying here: “It is difficult to get a man to understand something when his salary depends upon not understanding it.” The people with the most power to change the system of scientific publishing are journal editors and prestigious researchers, and they are the people for whom the current system is running quite swimmingly.

It’s not that good science can’t succeed in the current system—it often does. In fact, I’m willing to grant that it almost always does, eventually. When the evidence has mounted for long enough and the most adamant of the ancien regime finally retire or die, then, at last, the paradigm will shift. But this process takes literally decades longer than it should. In principle, a wrong theory can be invalidated by a single rigorous experiment. In practice, it generally takes about 30 years of experiments, most of which don’t get published, until the powers that be finally give in.

This delay has serious consequences. It means that many of the researchers working on the forefront of a new paradigm—precisely the people that the scientific community ought to be supporting most—will suffer from being unable to publish their work, get grant funding, or even get hired in the first place. It means that not only will good science take too long to win, but that much good science will never get done at all, because the people who wanted to do it couldn’t find the support they needed to do so. This means that the delay is in fact much longer than it appears: Because it took 30 years for one good idea to take hold, all the other good ideas that would have sprung from it in that time will be lost, at least until someone in the future comes up with them.

I don’t think I’ll ever forget it: At the AEA conference a few years back, I went to a luncheon celebrating Richard Thaler, one of the founders of behavioral economics, whom I regard as one of the top 5 greatest economists of the 20th century (I’m thinking something like, “Keynes > Nash > Thaler > Ramsey > Schelling”). Yes, now he is being rightfully recognized for his seminal work; he won a Nobel, and he has an endowed chair at Chicago, and he got an AEA luncheon in his honor among many other accolades. But it was not always so. Someone speaking at the luncheon offhandedly remarked something like, “Did we think Richard would win a Nobel? Honestly most of us weren’t sure he’d get tenure.” Most of the room laughed; I had to resist the urge to scream. If Richard Thaler wasn’t certain to get tenure, then the entire system is broken. This would be like finding out that Erwin Schrodinger or Niels Bohr wasn’t sure he would get tenure in physics.

A. Gary Schilling, a renowned Wall Street economist (read: One Who Has Turned to the Dark Side), once remarked (the quote is often falsely attributed to Keynes): “markets can remain irrational a lot longer than you and I can remain solvent.” In the same spirit, I would say this: the scientific community can remain wrong a lot longer than you and I can extend our graduate fellowships and tenure clocks.

How to hurt allies and alienate people

pnrj core principles, current events, ethics, tribal paradigm , , , , , , , , , , , , , , ,

Aug 9 JDN 2459071

I’ve been wanting to write this post for awhile now, but I have been worried about the reaction I might get. Ultimately I realized that this is precisely why it needs to be written. Especially since Slate Star Codex is offline for the foreseeable future, there don’t see to be a lot of other people willing to write it.

The timing could be questioned, I suppose; when we are in the throes of a historic pandemic and brazen creeping authoritarianism, perhaps now should be the time for unconditional solidarity. But I fear that unconditional solidarity is one of the most dangerous forces in human existence: Politics is the mind-killer, arguments are soldiers, and the absolute unwillingness to question one’s own side is how we get everything from the Spanish Inquisition to Vladimir Lenin.

And since this is about not simply being mistaken but alienating allies, perhaps these desperate times are when we need the correction most: For we simply cannot afford to lose any allies right now.

“All men benefit from male violence.”

“It’s impossible to be racist against White people.”

“I hate White people.”

“Men are pigs.”

“All I want for Christmas is White genocide.”

Statements like these have two things in common: One, they are considered appropriate and acceptable to say by most of the social justice left; and two, they are harmful, alienating, and wrong.

All men benefit from male violence? You mean that male rape victims benefit from male violence? The thousands of men who are assaulted and murdered by other men—at far higher rates than women—benefit from that, do they? Did Matthew Shepard benefit from male violence?

It’s impossible to be racist against White people? Then tell me, what was it when a Black woman told me that melanin is the gateway to the soul and all White people are soulless snakes? Swap the colors, and it sounds like something only a diehard KKK member or neo-Nazi could say. If that’s not racism, what is?

The insistence that racism is “prejudice plus power” is a disingenuous redefinition of the concept precisely in an attempt to retroactively make it true that it’s impossible to be racist against White people. This is not what the word “racist” means to most people. But even if I were to allow that definition, do you think Black people never have power over White people? There are no Black managers who discriminate against their White employees, no Black teachers who abuse their White students? I’m not aware of Barack Obama discriminating against any White people, but can anyone deny that he had power? White people may have more power on average, but that doesn’t mean they have more power in every case.

What’s more, I don’t really understand what leftists think they are accomplishing by making this kind of assertion. Is it just an expression of rage, or a signal of your group identity? You’re clearly not going to convince any White person who has been discriminated against that White people never get discriminated against. You’re clearly not going to convince any man who has been brutally attacked by another man that all men benefit from male violence. It would be one thing to say that White people face less discrimination (clearly true) or that most White people don’t face discrimination (maybe true); but to say that no White people ever face discrimination is just obviously false, and will be disproved by many people’s direct experience.

Indeed, it seems quite obvious to me that this kind of talk is likely to frustrate and alienate many people who could otherwise have been allies.

The left has a counter-argument prepared for this: If you are alienated by what we say, then you were never a true ally in the first place.

The accusation seems to be that alienated allies are just fair-weather friends; but I don’t think someone is being a fair-weather friend if they stop wanting to be your friend because you abuse them. And make no mistake: Continually telling people that they are inferior and defective because of their race or gender or some other innate aspect of themselves absolutely constitutes abuse. Indeed, it’s nothing less than a mirror image of the very abuse that social justice is supposed to exist to prevent.

To be sure, there are cases where people claim to be alienated allies but were never really allies to begin with. Anyone who says “Wokeness made me a Nazi” obviously was far-right to begin with, and is just using that as an excuse. No amount of people saying “I hate White people” would justify becoming a Nazi or a KKK member. This isn’t them genuinely being alienated by the left being unfair; this is them saying “Look what you made me do” as they punch you in the face.

But I think the far more common scenario is more like this: “I want to support social justice, but every time I try to participate in leftist spaces, people attack me. They say that I’m defective because of who I am, and it hurts. They don’t seem interested in my input anyway, so I think I’ll just stay away from leftist spaces to preserve my own mental health.” These are people who broadly agree with social justice in principle, but just feel so frustrated and alienated by the movement in practice that they decide they are better off remaining on the sidelines.

Is it really so hard to understand how someone might feel that way? Why would anyone want to interact in a social space where most of the time is spent disparaging people like them? To stay in such a space, one either needs to have very strong moral convictions to sustain them against that onslaught, or needs to be masochistic or self-loathing.


Maybe it is self-loathing, actually: Liberal White people are the only group that systematically exhibits a negative in-group bias. The further left you are on the political spectrum, the more likely you are to suffer from mental illness, especially if you are male. I’ve seen some right-wing sources use this to claim that “liberalism is a mental illness”, but the far more sensible explanation is that the kind of collective guilt and self-hatred that the left inculcates in liberal White people is harmful to mental health. It may also be because concern about the injustice in the world makes your life generally harder, even though you are right to be concerned.

There really does seem to be a lot of pressure to confess and self-flagellate among White leftists. I think my favorite is the injunction to “Divest from Whiteness“; it’s beautiful because it’s utterly meaningless. If you really just meant “fight racial discrimination”, you could have said that. Better yet, you could have recommended some specific policy or belief to adopt. (“Defund the Police”, for all its flaws, is an infinitely superior slogan to “Divest from Whiteness”.) By saying it this way, you’re trying to bring in some notion that we are morally obliged to somehow stop being White—which is of course completely impossible. Frankly I think even if I got gene therapy to convert my body to a West African phenotype people would still say I was “really White”. Thus, Whiteness becomes Original Sin: A stain acquired at birth that can never be removed and must always be a source of guilt.

So let me say this in no uncertain terms:

It’s okay to be White.

It’s okay to be straight.

It’s okay to be male.

It’s wrong to be racist.

It’s wrong to be homophobic.

It’s wrong to be sexist.

No, it isn’t “covertly racist” to say that it’s okay to be White—and if you think it is, you are part of the problem here. People do not have control over what race they are born into. There is no moral failing in being a particular color, or in being descended from people who did terrible things. (And it’s not like only White people have ancestors who did terrible things!)

Yes, I know that there are White supremacist groups using the slogan “It’s okay to be White”, but you know what? Stopped Clock Principle. Reversed stupidity is not intelligence. Nazis believe many things that are wrong, but the mere fact that Nazis believe something doesn’t make it wrong. Nazis also generally believe in Darwinian evolution, and Adolf Hitler was a strict vegetarian.

I am not denying that privilege and oppression exist. But there is a clear and absolutely vital moral distinction between being a member of a group and oppressing people who are not in that group. Being White is not the same thing as being racist. Being straight is not the same thing as being homophobic. Being male is not the same thing as being sexist. Indeed, I would argue that being a member of the privileged category is not even necessary to participate in oppression—you can oppress people of your own group, or be in one underprivileged group and oppress someone in another group. Being privileged certainly makes it easier for you to support oppression and more likely that you’ll do so—but it is neither necessary nor sufficient.

Another common response is that this is just “tone policing“, that complaining about alienating rhetoric is just a way of shutting down dissent in general. No doubt this is sometimes true: One of the more effective ways of silencing someone’s argument is to convince people that it has been delivered in an overly aggressive or shrill way, thus discrediting the messenger. (This was basically the only major criticism ever leveled against New Atheism, for instance.)

But it clearly takes the notion too far to say that any kind of rhetoric is acceptable as long as it’s for the right cause. Insulting and denigrating people is never appropriate. Making people feel guilty for being born in the wrong group is never fair. Indeed, it’s not clear that one can even argue against tone policing without… tone policing. Sometimes your tone is actually inappropriate and harmful and you need to be criticized for it.

In fact, some of the people that harsh rhetoric is alienating may harbor real prejudices that need to be challenged. But they aren’t very likely to make the intense effort to challenge their own prejudices if every interaction they have with the social justice community is hostile. If we want to change someone’s mind, it helps a great deal to start by showing them compassion and respect.

I’m not saying that fighting for social justice is never going to upset people. Social change is always painful, and there are many cherished beliefs and institutions that will have to be removed in order to achieve lasting justice. So the mere fact that someone is frustrated or upset with you doesn’t necessarily mean you’ve done anything wrong. But you should at least consider that people might sometimes be upset with you for genuinely good reasons, that when they say your aggressive rhetoric is hurtful and alienating that might be because it’s actually true.

“The Patriarchy” is not a thing

pnrj core principles, current events, ethics, public policy , , , ,

Jun 28 JDN 2459030

It’s really mainly a coincidence that I am writing this post on Father’s Day; working at home and almost never going out due to the pandemic, I have become unmoored from the normal passage of time. It’s a wonder I can remember it’s Sunday. But it is at least a bit ironic, since the word “patriarchy” comes from the Latin word pater meaning “father”.

A great deal of feminist discourse references “The Patriarchy”: Examples are included as links in this sentence from a variety of different sources.

This is a problem, because “The Patriarchy” plainly does not exist.

Am I saying that patriarchy doesn’t exist? Of course not. Patriarchy plainly exists. What I’m saying is that there is no one single source “The Patriarchy“.

China and Japan are both extremely patriarchial societies. They have fought wars with one another dozens of times. Saudi Arabia and Iran are both extremely patriarchal. They hate each other and have likewise fought numerous wars.

Indeed, nearly every human society is to some degree patriarchal; and yet, somehow we seem to be in conflict with one another quite frequently. If patriarchy all stemmed from some common source “The Patriarchy”, such a result would be baffling: If we’re all following the same ruler, how can we fight each other so much? Whoever is running this conspiracy is doing a really awful job!

Yes, there are common elements between the various forms of patriarchy in different societies—otherwise, we wouldn’t recognize them all as patriarchy. But there are also substantial differences. Nearly all societies regulate how women must dress, but precisely what women are expected to wear varies a great deal. Nearly all societies put more men in positions of power than women, but the degree to which this is true runs a wide gamut.

Patriarchy is like authoritarianism, or fanaticism, or corruption; yes, obviously authoritarianism, fanaticism, and corruption exist, and are important forces in the world. But there are no such things as “The Authoritarianism”, “The Fanaticism”, or “The Corruption”. There is no single unified source of these things. Indeed, authoritarians are often at each other’s throats, fanatics fight with other fanatics all the time, and those who are corrupt have no qualms about exploiting others who are corrupt.

Is this important? Perhaps it’s just a provocative turn of phrase, and I’m being overly pedantic.

But I do think it’s important, for the following reasons.

Many feminists who use the phrase “The Patriarchy” really do seem to think that all patriarchial ideas, beliefs, norms, attitudes, and behaviors stem from some common root, as the following quotes attest:

Only “patriarchy” seems to capture the peculiar elusiveness of gendered power – the idea that it does not reside in any one site or institution, but seems spread throughout the world. Only “patriarchy” seems to express that it is felt in the way individual examples of gender inequality interact, reinforcing each other to create entire edifices of oppression.

~Charlotte Higgins, The Guardian

I’m not angry because I hate men. I’m not even angry at men. I’m angry at the system that, for the lack of a better term, most people refer to as the patriarchy.

~Anne Theriaut, The Good Men Project

Remember in “Terminator 2” how the bad terminator kept getting smashed and shattered and ripped apart, but it didn’t matter? He just kept re-emerging, rising from the ashes, as an unstoppable force. Now imagine that terminator is a vessel to keep power, wealth and status in the hands of men — that’s the patriarchy. It can feel indestructible, coming back ever stronger despite seemingly endless efforts to smash it.

~Maya Salam, The New York Times

If you imagine that there is such a thing as “The Patriarchy”, it gives you the sense that you have just one enemy to fight. It makes the world simple and comprehensible. There’s a lot of psychological appeal in that kind of worldview. But it also makes you miss a great deal of the real complexity and nuance in the world. You have reified the concept.

Such a simplistic worldview might motivate you to fight harder against patriarchy, which would be a good thing. But then again, it could actually sap your motivation, by making it seem like you have a single implacable enemy that controls the entire world and has throughout history. If there is such a thing as “The Patriarchy”, then its power must be tremendous; perhaps we have weakened its hold upon the world, but could we ever hope to completely defeat it? (I made a similar point in an old post about how acknowledging progress is vital in order to make more progress.)

Moreover, thinking that all patriarchy stems from the same source could cause you to misdiagnose problems and fail to notice solutions that would otherwise be readily available. If you go around thinking that any disparity between how men and women are treated must be the result of some global phenomenon called “The Patriarchy”, you may not think to try simple fixes like blinded auditions or revising or eliminating student evaluations. You may assume that sexism is around ever corner when often the real causes are nepotism and network effects.

Slate Star Codex made a similar point about racism in an excellent post called “Murderism”. If your view of the world is that all bad things (or even all bad things in a broad class like “racism” or “sexism”) must stem from the same source, you will be unable to analyze the real nuances of what causes problems and thus be powerless to fix them.

Yes, of course patriarchy exists; and it’s important. But it comes in many different kinds, and many difference degrees, and policies that amelioriate it in some contexts may be ineffective—or even counterproductive—in others. This is why I say that it’s dangerous to use a phrase like “The Patriarchy”—for patriarchy isn’t a thing, it’s many things.

Tithing makes quite a lot of sense

pnrj core principles, development economics, inequality, personal , , , , , , , , , ,

Dec 22 JDN 2458840

Christmas is coming soon, and it is a season of giving: Not only gifts to those we love, but also to charities that help people around the world. It’s a theme of some of our most classic Christmas stories, like A Christmas Carol. (I do have to admit: Scrooge really isn’t wrong for not wanting to give to some random charity without any chance to evaluate it. But I also get the impression he wasn’t giving a lot to evaluated charities either.) And people do really give more around this time of year: Charitable donation rates peak in November and December (though that may also have something to do with tax deductions).

Where should we give? This is not an easy question, but it’s one that we now have tools to answer: There are various independent charity evaluation agencies, like GiveWell and Charity Navigator, which can at least provide some idea of which charities are most cost-effective.

How much should we give? This question is a good deal harder.

Perhaps a perfect being would determine their own precise marginal utility of wealth, and the marginal utility of spending on every possible charity, and give of your wealth to the best possible charity up until those two marginal utilities are equal. Since $1 to UNICEF or the Against Malaria Foundation saves about 0.02 QALY, and (unless you’re a billionaire) you don’t have enough money to meaningfully affect the budget of UNICEF, you’d probably need to give until you are yourself at the UN poverty level of $1.90 per day.

I don’t know of anyone who does this. Even Peter Singer, who writes books that essentially tell us to do this, doesn’t do this. I’m not sure it’s humanly possible to do this. Indeed, I’m not even so sure that a perfect being would do it, since it would require destroying their own life and their own future potential.

How about we all give 10%? In other words, how about we tithe? Yes, it sounds arbitrary—because it is. It could just as well have been 8% or 11%. Perhaps one-tenth feels natural to a base-10 culture made of 10-fingered beings, and if we used a base-12 numeral system we’d think in terms of giving one-twelfth instead. But 10% feels reasonable to a lot of people, it has a lot of cultural support behind it already, and it has become a Schelling point for coordination on this otherwise intractable problem. We need to draw the line somewhere, and it might as well be there.

As Slate Star Codex put it:

It’s ten percent because that’s the standard decreed by Giving What We Can and the effective altruist community. Why should we believe their standard? I think we should believe it because if we reject it in favor of “No, you are a bad person unless you give all of it,” then everyone will just sit around feeling very guilty and doing nothing. But if we very clearly say “You have discharged your moral duty if you give ten percent or more,” then many people will give ten percent or more. The most important thing is having a Schelling point, and ten percent is nice, round, divinely ordained, and – crucially – the Schelling point upon which we have already settled. It is an active Schelling point. If you give ten percent, you can have your name on a nice list and get access to a secret forum on the Giving What We Can site which is actually pretty boring.

It’s ten percent because definitions were made for Man, not Man for definitions, and if we define “good person” in a way such that everyone is sitting around miserable because they can’t reach an unobtainable standard, we are stupid definition-makers. If we are smart definition-makers, we will define it in whichever way which makes it the most effective tool to convince people to give at least that much.

I think it would be also reasonable to adjust this proportion according to your household income. If you are extremely poor, give a token amount: Perhaps 1% or 2%. (As it stands, most poor people already give more than this, and most rich people give less.) If you are somewhat below the median household income, give a bit less: Perhaps 6% or 8%. (I currently give 8%; I plan to increase to 10% once I get a higher-paying job after graduation.) If you are somewhat above, give a bit more: Perhaps 12% or 15%. If you are spectacularly rich, maybe you should give as much as 25%.

Is 10% enough? Well, actually, if everyone gave, even 1% would probably be enough. The total GDP of the First World is about $40 trillion; 1% of that is $400 billion per year, which is more than enough to end world hunger. But since we know that not everyone will give, we need to adjust our standard upward so that those who do give will give enough. (There’s actually an optimization problem here which is basically equivalent to finding a monopoly’s profit-maximizing price.) And just ending world hunger probably isn’t enough; there is plenty of disease to cure, education to improve, research to do, and ecology to protect. If say a third of First World people give 10%, that would be about $1.3 trillion, which would be enough money to at least make a huge difference in all those areas.

You can decide for yourself where you think you should draw the line. But 10% is a pretty good benchmark, and above all—please, give something. If you give anything, you are probably already above average. A large proportion of people give nothing at all. (Only 24% of US tax returns include a charitable deduction—though, to be fair, a lot of us donate but don’t itemize deductions. Even once you account for that, only about 60% of US households give to charity in any given year.)