This is one of the worst wildfire seasons in American history. But it won’t be for long.

Oct 22, JDN 2458049

At least 38 people have now been killed by the wildfires that are still ongoing in California; in addition, 5700 buildings have been destroyed and 190,000 acres of land burned. The State of California keeps an updated map of all the fires that are ongoing and how well-controlled they are; it’s not a pretty sight.

While the particular details are extreme, this is not an isolated incident. This year alone, wildfires have destroyed over 8 million acres of land in the US. In 2015, that figure was 10 million acres.

Property damage for this year’s wildfires in California is estimated at over $65 billion. That’s more than what Trump recently added to the military budget, and getting close to our total spending on food stamps.

There is a very clear upward trend in the scale and intensity of wildfires just over the last 50 years, and the obvious explanation is climate change. As climate change gets worse, these numbers are projected to increase between 30% and 50% by the 2040s. We still haven’t broken the record of fire damage in 1910, but as the upward trend continues we might soon enough.

It’s important to keep the death tolls in perspective; much as with hurricanes, our evacuation protocols and first-response agencies do their jobs very well, and as a result we’ve been averaging only about 10 wildfire deaths per year over the whole United States for the last century. In a country of over 300 million people, that’s really an impressively small number. That number has also been trending upward, however, so we shouldn’t get complacent.

Climate change isn’t the only reason these fires are especially damaging. It also matters where you build houses. We have been expanding our urban sprawl into fire-prone zones, and that is putting a lot of people in danger. Since 1990, over 60% of new homes were built in “wildland-urban interface areas” that are at higher risk.

Why are we doing this? Because housing prices in urban centers are too expensive for people to live there, but that is where most of the jobs are. So people have little choice but to live in exurbs and suburbs closer to the areas where fires are worst. That’s right: The fires are destroying homes and killing people because the rent is too damn high.

We need to find a solution to this problem of soaring housing prices. And since housing is such a huge proportion of our total expenditure—we spend more on housing than we do on all government spending combined—this would have an enormous impact on our entire economy. If you compare the income of a typical American today to most of the world’s population, or even to a typical American a century ago, we should feel extremely rich, but we don’t—largely because we spend so much of it just on keeping a roof over our heads.

Real estate is also a major driver of economic inequality. Wealth inequality is highest in urban centers where homeownership is rare. The large wealth gaps between White and non-White Americans can be in large part attributed to policies that made homeownership much more difficult for non-White people. Housing value inequality and overall wealth inequality are very strongly correlated. The high inequality in housing prices is making it far more difficult for people to move from poor regions to rich regions, holding back one of the best means we had for achieving more equal incomes.

Moreover, the rise in capital income share since the 1970s is driven almost entirely by real estate, rather than actual physical capital. The top 10% richest housing communities constitute over 52% of the total housing wealth in the US.

There is a lot of debate about what exactly causes these rising housing prices. No doubt, there are many factors contributing, from migration patterns to zoning regulations to income inequality in general. In a later post, I’ll get into why I think many of the people who think they are fighting the problem are actually making it worse, and suggest some ideas for what they should be doing instead.

Statistics you should have been taught in high school, but probably weren’t

Oct 15, JDN 2458042

Today I’m trying something a little different. This post will assume a lot less background knowledge than most of the others. For some of my readers, this post will probably seem too basic, obvious, even boring. For others, it might feel like a breath of fresh air, relief at last from the overly-dense posts I am generally inclined to write out of Curse of Knowledge. Hopefully I can balance these two effects well enough to gain rather than lose readers.

Here are four core statistical concepts that I think all adults should know, necessary for functional literacy in understanding the never-ending stream of news stories about “A new study shows…” and more generally in applying social science to political decisions. In theory shese should all be taught as part of a core high school curriculum, but typically they either aren’t taught or aren’t retained once students graduate. (Really, I think we should replace one year of algebra with one semester of statistics and one semester of logic. Most people don’t actually need algebra, but they absolutely do need logic and statistics.)

  1. Mean and median

The mean and the median are quite simple concepts, and you’ve probably at least heard of them before, yet confusion between them has caused a great many misunderstandings.

Part of the problem is the word “average”. Normally, the word “average” applies to the mean—for example, a batting average, or an average speed. But in common usage the word “average” can also mean “typical” or “representative”—an average person, an average family. And in many cases, particularly when in comes to economics, the mean is in no way typical or representative.

The mean of a sample of values is just the sum of all those values, divided by the number of values. The mean of the sample {1,2,3,10,1000} is (1+2+3+10+1000)/5 = 203.2

The median of a sample of values is the middle one—order the values, choose the one in the exact center. If you have an even number, take the mean of the two values on either side. So the median of the sample {1,2,3,10,1000} is 3.

I intentionally chose an extreme example: The mean and median of these samples are completely different. But this is something that can happen in real life.

This is vital for understanding the distribution of income, because for almost all countries (and certainly for the world as a whole), the mean income is substantially higher (usually between 50% and 100% higher) than the median income. Yet the mean income is what is reported as “per capita GDP”, but the median income is a much better measure of actual standard of living.

As for the word “average”, it’s probably best to just remove it from your vocabulary. Say “mean” instead if that’s what you intend, or “median” if that’s what you’re using instead.

  1. Standard deviation and mean absolute deviation

Standard deviation is another one you’ve probably seen before.

Standard deviation is kind of a weird concept, honestly. It’s so entrenched in statistics that we’re probably stuck with it, but it’s really not a very good measure of anything intuitively interesting.

Mean absolute deviation is a much more intuitive concept, and much more robust to weird distributions (such as those of incomes and financial markets), but it isn’t as widely used by statisticians for some reason.

The standard deviation is defined as the square root of the mean of the squared differences between the individual values in sample and the mean of that sample. So for my {1,2,3,10,1000} example, the standard deviation is sqrt(((1-203.2)^2 + (2-203.2)^2 + (3-203.2)^2 + (10-203.2)^2 + (1000-203.2)^2)/5) = 398.4.

What can you infer from that figure? Not a lot, honestly. The standard deviation is bigger than the mean, so we have some sense that there’s a lot of variation in our sample. But interpreting exactly what that means is not easy.

The mean absolute deviation is much simpler: It’s the mean of the absolute value of differences between the individual values in a sample and the mean of that sample. In this case it is ((203.2-1) + (203.2-2) + (203.2-3) + (203.2-10) + (1000-203.2))/5 = 318.7.

This has a much simpler interpretation: The mean distance between each value and the mean is 318.7. On average (if we still use that word), each value is about 318.7 away from the mean of 203.2.

When you ask people to interpret a standard deviation, most of them actually reply as if you had asked them about the mean absolute deviation. They say things like “the average distance from the mean”. Only people who know statistics very well and are being very careful would actually say the true answer, “the square root of the sum of squared distances from the mean”.

But there is an even more fundamental reason to prefer the mean absolute deviation, and that is that sometimes the standard deviation doesn’t exist!

For very fat-tailed distributions, the sum that would give you the standard deviation simply fails to converge. You could say the standard deviation is infinite, or that it’s simply undefined. Either way we know it’s fat-tailed, but that’s about all. Any finite sample would have a well-defined standard deviation, but that will keep changing as your sample grows, and never converge toward anything in particular.

But usually the mean still exists, and if the mean exists, then the mean absolute deviation also exists. (In some rare cases even they fail, such as the Cauchy distribution—but actually even then there is usually a way to recover what the mean and mean absolute deviation “should have been” even though they don’t technically exist.)

  1. Standard error

The standard error is even more important for statistical inference than the standard deviation, and frankly even harder to intuitively understand.

The actual definition of the standard error is this: The standard deviation of the distribution of sample means, provided that the null hypothesis is true and the distribution is a normal distribution.

How it is usually used is something more like this: “A good guess of the margin of error on my estimates, such that I’m probably not off by more than 2 standard errors in either direction.”

You may notice that those two things aren’t the same, and don’t even seem particularly closely related. You are correct in noticing this, and I hope that you never forget it. One thing that extensive training in statistics (especially frequentist statistics) seems to do to people is to make them forget that.

In particular, the standard error strictly only applies if the value you are trying to estimate is zero, which usually means that your results aren’t interesting. (To be fair, not always; finding zero effect of minimum wage on unemployment was a big deal.) Using it as a margin of error on your actual nonzero estimates is deeply dubious, even though almost everyone does it for lack of an uncontroversial alternative.
Application of standard errors typically also relies heavily on the assumption of a normal distribution, even though plenty of real-world distributions aren’t normal and don’t even approach a normal distribution in quite large samples. The Central Limit Theorem says that the sampling distribution of the mean of any non-fat-tailed distribution will approach a normal distribution eventually as sample size increases, but it doesn’t say how large a sample needs to be to do that, nor does it apply to fat-tailed distributions.

Therefore, the standard error is really a very conservative estimate of your margin of error; it assumes essentially that the only kind of error you had was random sampling error from a normal distribution in an otherwise perfect randomized controlled experiment. All sorts of other forms of error and bias could have occurred at various stages—and typically, did—making your error estimate inherently too small.

This is why you should never believe a claim that comes from only a single study or a handful of studies. There are simply too many things that could have gone wrong. Only when there are a large number of studies, with varying methodologies, all pointing to the same core conclusion, do we really have good empirical evidence of that conclusion. This is part of why the journalistic model of “A new study shows…” is so terrible; if you really want to know what’s true, you look at large meta-analyses of dozens or hundreds of studies, not a single study that could be completely wrong.

  1. Linear regression and its limits

Finally, I come to linear regression, the workhorse of statistical social science. Almost everything in applied social science ultimately comes down to variations on linear regression.

There is the simplest kind, ordinary least-squares or OLS; but then there is two-stage least-squares 2SLS, fixed-effects regression, clustered regression, random-effects regression, heterogeneous treatment effects, and so on.
The basic idea of all regressions is extremely simple: We have an outcome Y, a variable we are interested in D, and some other variables X.

This might be an effect of education D on earnings Y, or minimum wage D on unemployment Y, or eating strawberries D on getting cancer Y. In our X variables we might include age, gender, race, or whatever seems relevant to Y but can’t be affected by D.

We then make the incredibly bold (and typically unjustifiable) assumption that all the effects are linear, and say that:

Y = A + B*D + C*X + E

A, B, and C are coefficients we estimate by fitting a straight line through the data. The last bit, E, is a random error that we allow to fill in any gaps. Then, if the standard error of B is less than half the size of B itself, we declare that our result is “statistically significant”, and we publish our paper “proving” that D has an effect on Y that is proportional to B.

No, really, that’s pretty much it. Most of the work in econometrics involves trying to find good choices of X that will make our estimates of B better. A few of the more sophisticated techniques involve breaking up this single regression into a few pieces that are regressed separately, in the hopes of removing unwanted correlations between our variable of interest D and our error term E.

What about nonlinear effects, you ask? Yeah, we don’t much talk about those.

Occasionally we might include a term for D^2:

Y = A + B1*D + B2*D^2 + C*X + E

Then, if the coefficient B2 is small enough, which is usually what happens, we say “we found no evidence of a nonlinear effect”.

Those who are a bit more sophisticated will instead report (correctly) that they have found the linear projection of the effect, rather than the effect itself; but if the effect was nonlinear enough, the linear projection might be almost meaningless. Also, if you’re too careful about the caveats on your research, nobody publishes your work, because there are plenty of other people competing with you who are willing to upsell their research as far more reliable than it actually is.

If this process seems rather underwhelming to you, that’s good. I think people being too easily impressed by linear regression is a much more widespread problem than people not having enough trust in linear regression.

Yes, it is possible to go too far the other way, and dismiss even dozens of brilliant experiments as totally useless because they used linear regression; but I don’t actually hear people doing that very often. (Maybe occasionally: The evidence that gun ownership increases suicide and homicide and that corporal punishment harms children is largely based on linear regression, but it’s also quite strong at this point, and I do still hear people denying it.)

Far more often I see people point to a single study using linear regression to prove that blueberries cure cancer or eating aspartame will kill you or yoga cures back pain or reading Harry Potter makes you hate Donald Trump or olive oil prevents Alzheimer’s or psychopaths are more likely to enjoy rap music. The more exciting and surprising a new study is, the more dubious you should be of its conclusions. If a very surprising result is unsupported by many other studies and just uses linear regression, you can probably safely ignore it.

A really good scientific study might use linear regression, but it would also be based on detailed, well-founded theory and apply a proper experimental (or at least quasi-experimental) design. It would check for confounding influences, look for nonlinear effects, and be honest that standard errors are a conservative estimate of the margin of error. Most scientific studies probably should end by saying “We don’t actually know whether this is true; we need other people to check it.” Yet sadly few do, because the publishers that have a strangle-hold on the industry prefer sexy, exciting, “significant” findings to actual careful, honest research. They’d rather you find something that isn’t there than not find anything, which goes against everything science stands for. Until that changes, all I can really tell you is to be skeptical when you read about linear regressions.

When are we going to get serious about climate change?

Oct 8, JDN 24578035

Those two storms weren’t simply natural phenomena. We had a hand in creating them.

The EPA doesn’t want to talk about the connection, and we don’t have enough statistical power to really be certain, but there is by now an overwhelming scientific consensus that global climate change will increase hurricane intensity. The only real question left is whether it is already doing so.

The good news is that global carbon emissions are no longer rising. They have been essentially static for the last few years. The bad news is that this is almost certainly too little, too late.

The US is not on track to hit our 2025 emission target; we will probably exceed it by at least 20%.

But the real problem is that the targets themselves are much too high. Most countries have pledged to drop emissions only about 8-10% below their 1990s levels.

Even with the progress we have made, we are on track to exceed the global carbon budget needed to keep warming below 2 C by the year 2040. We have been reducing emission intensity by about 0.8% per year—we need to be reducing it by at least 3% per year and preferably faster. Highly-developed nations should be switching to nuclear energy as quickly as possible; an equitable global emission target requires us to reduce our emissions by 80% by 2050.

At the current rate of improvement, we will overshoot the 2 C warming target and very likely the 3C target as well.

Why aren’t we doing better? There is of course the Tragedy of the Commons to consider: Each individual country acting in its own self-interest will continue to pollute more, as this is the cheapest and easiest way to maintain industrial development. But then if all countries do so, the result is a disaster for us all.
But this explanation is too simple. We have managed to achieve some international cooperation on this issue. The Kyoto protocol has worked; emissions among Kyoto member nations have been reduced by more than 20% below 1990 levels, far more than originally promised. The EU in particular has taken a leadership role in reducing emissions, and has a serious shot at hitting their target of 40% reduction by 2030.

That is a truly astonishing scale of cooperation; the EU has a population of over 500 million people and spans 28 nations. It would seem like doing that should get us halfway to cooperating across all nations and all the world’s people.

But there is a vital difference between the EU and the world as a whole: The tribal paradigm. Europeans certainly have their differences: The UK and France still don’t really get along, everyone’s bitter with Germany about that whole Hitler business, and as the acronym PIIGS emphasizes, the peripheral countries have never quite felt as European as the core Schengen members. But despite all this, there has been a basic sense of trans-national (meta-national?) unity among Europeans for a long time.
For one thing, today Europeans see each other as the same race. That wasn’t always the case. In Medieval times, ethnic categories were as fine as “Cornish” and “Liverpudlian”. (To be fair, there do still exist a handful of Cornish nationalists.) Starting around the 18th cenutry, Europeans began to unite under the heading of “White people”, a classification that took on particular significance during the trans-Atlantic slave trade. But even in the 19th century, “Irish” and “Sicilian” were seen as racial categories. It wasn’t until the 20th century that Europeans really began to think of themselves as one “kind of people”, and not coincidentally it was at the end of the 20th century that the European Union finally took hold.

There is another region that has had a similar sense of unification: Latin America. Again, there are conflicts: There are a lot of nasty stereotypes about Puerto Ricans among Cubans and vice-versa. But Latinos, by and large, think of each other as the same “kind of people”, distinct from both Europeans and the indigenous population of the Americas.

I don’t think it is coincidental that the lowest carbon emission intensity (carbon emissions / GDP PPP) in the world is in Latin America, followed closely by Europe.
And if you had to name right now the most ethnically divided region in the world, what would you say? The Middle East, of course. And sure enough, they have the worst carbon emission intensity. (Of course, oil is an obvious confounding variable here, likely contributing to both.)

Indeed, the countries with the lowest ethnic fractionalization ratings tend to be in Europe and Latin America, and the highest tend to be in the Middle East and Africa.

Even within the United States, political polarization seems to come with higher carbon emissions. When we think of Democrats and Republicans as different “kinds of people”, we become less willing to cooperate on finding climate policy solutions.

This is not a complete explanation, of course. China has a low fractionalization rating but a high carbon intensity, and extremely high overall carbon emissions due to their enormous population. Africa’s carbon intensity isn’t as high as you’d think just from their terrible fractionalization, especially if you exclude Nigeria which is a major oil producer.

But I think there is nonetheless a vital truth here: One of the central barriers to serious long-term solutions to climate change is the entrenchment of racial and national identity. Solving the Tragedy of the Commons requires cooperation, we will only cooperate with those we trust, and we will only trust those we consider to be the same “kind of people”.

You can even hear it in the rhetoric: If “we” (Americans) give up our carbon emissions, then “they” (China) will take advantage of us. No one seems to worry about Alabama exploiting California—certainly no Republican would—despite the fact that in real economic terms they basically do. But people in Alabama are Americans; in other words, they count as actual people. People in China don’t count. If anything, people in California are supposed to be considered less American than people in Alabama, despite the fact that vastly more Americans live in California than Alabama. This mirrors the same pattern where we urban residents are somehow “less authentic” even though we outnumber the rural by four to one.
I don’t know how to mend this tribal division; I very much wish I did. But I do know that simply ignoring it isn’t going to work. We can talk all we want about carbon taxes and cap-and-trade, but as long as most of the world’s people are divided into racial, ethnic, and national identities that they consider to be in zero-sum conflict with one another, we are never going to achieve the level of cooperation necessary for a real permanent solution to climate change.

The temperatures and the oceans rise. United we must stand, or divided we shall fall.

How can we stop rewarding psychopathy?

Oct 1, JDN 24578028

A couple of weeks ago The New York Times ran an interesting article about how entrepreneurs were often juvenile delinquents, who then often turn into white-collar criminals. They didn’t quite connect the dots, though; they talked about the relevant trait driving this behavior as “rule-breaking”, when it is probably better defined as psychopathy. People like Martin Shkreli aren’t just “rule-breakers”; they are psychopaths. While only about 1% of humans in general are psychopaths, somewhere between 3% and 4% of business executives are psychopaths. I was unable to find any specific data assessing the prevalence of psychopathy among politicians, but if you just read the Hare checklist, it’s not hard to see that psychopathic traits are overrepresented among politicians as well.

This is obviously the result of selection bias; as a society, we are systematically appointing psychopaths to positions of wealth and power. Why are we doing this? How can we stop?

One very important factor here that may be especially difficult to deal with is desire. We generally think that in a free society, people should be allowed to seek out the sort of life they want to live. But one of the reasons that psychopaths are more likely to become rich and powerful is precisely that they want it more.

To most of us, being rich is probably something we want, but not the most important thing to us. We’d accept being poor if it meant we could be happy, surrounded by friends and family who love us, and made a great contribution to society. We would like to be rich, but it’s more important that we be good people. But to many psychopaths, being rich is the one single thing they care about. All those other considerations are irrelevant.

With power, matters are even more extreme: Most people actually seem convinced that they don’t want power at all. They associate power with corruption and cruelty (because, you know, so many of the people in power are psychopaths!), and they want no part of it.

So the saying goes: “Power tends to corrupt, and absolute power corrupts absolutely.” Does it, now? Did power corrupt George Washington and Abraham Lincoln? Did it corrupt Mahatma Gandhi and Nelson Mandela? I’m not saying that any of these men were without flaws, even serious ones—but was it power that made them so? Who would they have been, and more importantly, what would they have done, if they hadn’t had power? Would the world really have been better off if Abraham Lincoln and Nelson Mandela had stayed out of politics? I don’t think so.

Part of what we need, therefore, is to convince good people that wanting power is not inherently bad. Power just means the ability to do things; it’s what you do that matters. You should want power—the power to right wrongs, mend injustices, uplift humanity’s future. Thinking that the world would be better if you were in charge not only isn’t a bad thing—it is quite likely to be true. If you are not a psychopath, then the world would probably be better off if you were in charge of it.

Of course, that depends partly on what “in charge of the world” even means; it’s not like we have a global government, after all. But even suppose you were granted the power of an absolute dictatorship over all of humanity; what would you do with that power? My guess is that you’d probably do what I would do: Start by using that power to correct the greatest injustices, then gradually cede power to a permanent global democracy. That wouldn’t just be a good thing; it would be quite literally and without a doubt the best thing that ever happened. Of course, it would be all the better if we never built such a dictatorship in the first place; but mainly that’s because of the sort of people who tend to become dictators. A benevolent dictatorship really would be a wonderful thing; the problem is that dictators almost never remain benevolent. Dictatorship is simply too enticing to psychopaths.

And what if you don’t think you’re competent enough in policy to make such decisions? Simple: You don’t make them yourself, you delegate them to responsible and trustworthy people to make them for you. Recognizing your own limitations is one of the most important differences between a typical leader and a good leader.

Desire isn’t the only factor here, however. Even though psychopaths tend to seek wealth and power with more zeal than others, there are still a lot of good people trying to seek wealth and power. We need to look very carefully at the process of how we select our leaders.

Let’s start with the private sector. How are managers chosen? Mainly, by managers above them. What criteria do they use? Mostly, they use similarity. Managers choose other managers who are “like them”—middle-aged straight White men with psychopathic tendencies.

This is something that could be rectified with regulation; we could require businesses to choose a more diverse array of managers that is more representative of the population at large. While this would no doubt trigger many complaints of “government interference” and “inefficiency”, in fact it almost certainly would increase the long-term profitability of most corporations. Study after study after study shows that increased diversity, particularly including more equal representation of women, results in better business performance. A recent MIT study found that switching from an all-male or all-female management population to a 50-50 male/female split could increase profits by as much as forty percent. The reason boards of directors aren’t including more diversity is that they ultimately care more about protecting their old boys’ club (and increasing their own compensation, of course) than they do about maximizing profits for their shareholders.

I think it would actually be entirely reasonable to include regulations about psychopathy in particular; designate certain industries (such as lobbying and finance; I would not include medicine, as psychopaths actually seem to make pretty good neurosurgeons!) as “systematically vital” and require psychopathy screening tests as part of their licensing process. This is no small matter, and definitely does represent an incursion into civil liberties; but given the enormous potential benefits, I don’t think it can be dismissed out of hand. We do license professions; why shouldn’t at least a minimal capacity for empathy and ethical behavior be part of that licensing process?

Where the civil liberty argument becomes overwhelming is in politics. I don’t think we can justify any restrictions on who should be allowed to run for office. Frankly, I think even the age limits should be struck from the Constitution; you should be allowed to run for President at 18 if you want. Requiring psychological tests for political office borders on dystopian.

That means we need to somehow reform either the campaign system, the voting system, or the behavior of voters themselves.

Of course, we should reform all three. Let’s start with the voting system itself, as that is the simplest: We should be using range voting, and we should abolish the Electoral College. Districts should be replaced by proportional representation through reweighted range voting, eliminating gerrymandering once and for all without question.

The campaign system is trickier. We could start by eliminating or tightly capping private and corporate campaign donations, and replace them with a system similar to the “Democracy Vouchers” being tested in Seattle. The basic idea is simple and beautiful: Everyone gets an equal amount of vouchers to give to whatever candidates they like, and then all the vouchers can be redeemed for campaign financing from public funds. It’s like everyone giving a donation (or monetary voting), but everyone has the same amount of “money”.

This would not solve all the problems, however. There is still an oligopoly of news media distorting our political discourse. There is still astonishingly bad journalism even in our most respected outlets, like the way the New York Times was obsessed with Comey’s letter and CNN’s wall-to-wall coverage of totally unfounded speculation about a missing airliner.

Then again, CNN’s ratings skyrocketed during that period. This shows that the problems run much deeper than a handful of bad journalists or corrupt media companies. These companies are, to a surprisingly large degree, just trying to cater to what their audience has said it wants, just “giving the people what they want”.

Our fundamental challenge, therefore, is to change what the people want. We have to somehow convince the public at large—or at least a big enough segment of the public at large—that they don’t really want TV news that spends hours telling them nothing and they don’t really want to elect the candidate who is the tallest or has the nicest hair. And we have to get them to actually change the way they behave accordingly.

When it comes to that part, I have no idea what to do. A voting population that is capable of electing Donald Trump—Electoral College nonsense notwithstanding, he won sixty million votes—is one that I honestly have no idea how to interface with at all. But we must try.

A tale of two storms

Sep 24, JDN 2458021

There were two severe storm events this past week; one you probably heard a great deal about, the other, probably not. The first was Hurricane Irma, which hit the United States and did most of its damage in Florida; the second was Typhoon Doksuri, which hit Southeast Asia and did most of its damage in Vietnam.

You might expect that this post is going to give you more bad news. Well, I have a surprise for you: The news is actually mostly good.

The death tolls from both storms were astonishingly small. The hurricane is estimated to have killed at least 84 people, while the typhoon has killed at least 26. This result is nothing less than heroism. The valiant efforts of thousands of meteorologists and emergency responders around the world has saved thousands of lives, and did so both in the wealthy United States and in impoverished Vietnam.

When I started this post, I had expected to see that the emergency response in Vietnam would be much worse, and fatalities would be far higher; I am delighted to report that nothing of the sort was the case, and Vietnam, despite their per-capita GDP PPP of under $6,000, has made emergency response a sufficiently high priority that they saved their people just about as well as Florida did.

To get a sense of what might have happened without them, consider that 1.5 million homes in Florida were leveled by the hurricane, and over 100,000 homes were damaged by the typhoon. Vietnam is a country of 94 million people. Florida has a population of 20 million. (The reason Florida determines so many elections is that it is by far the most populous swing state.) Without weather forecasting and emergency response, these death figures would have been in the tens of thousands, not the dozens.

Indeed, if you know statistics and demographics well, these figures become even more astonishing: These death rates were almost indistinguishable from statistical noise.

Vietnam’s baseline death rate is about 5.9 per 1,000, meaning that they experience about 560,000 deaths in any given year. This means that over 1500 people die in Vietnam on a normal day.

Florida’s baseline death rate is about 6.6 per 1,000, actually a bit higher than Vietnam’s, because Florida’s population skews so much toward the elderly. Therefore Florida experiences about 130,000 deaths per year, or 360 deaths on a normal day.

In both Vietnam and Florida, this makes the daily death probability for any given person about 0.0017%. A random process with a fixed probability of 0.0017% over a population of n people will result in an average of 0.0017n events, but with some variation around that number. The standard deviation is actually sqrt(p(1-p)n) = 0.004 sqrt(n). When n = 20,000,000 (Florida), this results in a standard deviation of 18. When n = 94,000,000 (Vietnam), this results in a standard deviation of 40.

This means that the 26 additional deaths in Vietnam were within one standard deviation of average! They basically are indistinguishable from statistical noise. There have been over a hundred days in Vietnam where an extra 26 people happened to die, just in the past year. Weather forecasting took what could have been a historic disaster and turned it into just another bad day.

The 84 additional deaths in Florida are over four standard deviations away from average, so they are definitely distinguishable from statistical noise—but this still means that Florida’s total death rate for the year will only tick up by 0.6%.

It is common in such tragedies to point out in grave tones that “one death is too many”, but I maintain that this is not actually moral wisdom but empty platitude. No conceivable policy is ever going to reduce death rates to zero, and the people who died of heart attacks or brain aneurysms are every bit as dead as the people who died from hurricanes or terrorist attacks. Instead of focusing on the handful of people who died because they didn’t heed warnings or simply got extraordinarily unlucky, I think we should be focusing on the thousands of people who survived because our weather forecasters and emergency responders did their jobs so exceptionally well. Of course if we can reduce the numbers even further, we should; but from where I’m sitting, our emergency response system has a lot to be proud of.

Of course, the economic damage of the storms was substantially greater. The losses in destroyed housing and infrastructure in Florida are projected at over $80 billion. Vietnam is much poorer, so there simply isn’t as much infrastructure to destroy; total damage is unlikely to exceed $10 billion. Florida’s GDP is $926 billion, so they are losing 8.6%; while Vietnam’s GDP is $220 billion, so they are still losing 4.5%. And of course the damage isn’t evenly spread across everyone; those hardest hit will lose perhaps their entire net wealth, while others will feel absolutely nothing.

But economic damage is fleeting. Indeed, if we spend the government money we should be, and take the opportunity to rebuild this infrastructure better than it was before, the long-run economic impact could be positive. Even 8.6% of GDP is less than five years of normal economic growth—and there were years in the 1950s where we did it in a single year. The 4.6% that Vietnam lost, they should make back within a year of their current economic growth.

Thank goodness.

Building a wider tent, revisited

Sep 17, JDN 2458014

At a reader’s suggestion, I am expanding upon the argument I made a few weeks ago that political coalitions are strongest when they are willing to accept some disagreement. I made that argument with numbers, which is likely to convince someone like me; but I know that many other people don’t really think that way, so it may help to provide some visuals as well.

60% of this rectangle is filled in red.

Rectangle_1

This represents the proportion of the population that agrees with you on some issue. For concreteness but to avoid making this any more political than it already is, I’m going to pick silly issues. So let’s have this first issue be about which side of the road we should drive on. Let’s say your view is that we should drive on the right. 60% of people agree that we should drive on the right. The other 40% think we should drive on the left.

Now let’s consider another issue. Let’s say this one is about putting pineapples on pizza. You, and 60% of people, agree that pineapples should not be put on pizza. The other 40% think we should put pineapples on pizza.

For now, let’s assume those two issues are independent, that someone’s opinions on driving and pizza are unrelated. Then we can fill 60% of the rectangle in blue, but it should be a perpendicular portion because the two issues aren’t related:

Rectangle_2

Those who agree with you on driving but not pizza (that would include me, by the way) are in red, those who agree with you on pizza but not driving are in blue, those who agree with you on both are in purple, and those who disagree with you on both are in white. You should already be able to see that less than half the population agrees with you on both issues, even though more than half agrees on each.

Let’s add a third issue, which we will color in green. This one can be the question of whether Star Trek is better than Star Wars. Let’s say that 60% of the population agrees with you that Star Trek is better, while 40% think that Star Wars is better. Let’s also assume that this is independent of opinions on both driving and pizza.

Rectangle_3

This is already starting to get unwieldy; there are now eight distinct regions. The white region (8) is comprised of people who disagree with you on everything. The red (6), blue (4), and green (7) regions each have people agree with you on exactly one issue. The blue-green (3), purple (2), and brown (5) regions have people agree with you on two issues. Only those in the dark-green region (1) agree with you on everything.

As you can see, the proportion of people who agree with you on all issues is fairly small, even though the majority of the population agrees with you on any given issue.

If we keep adding issues, this effect gets even stronger. I’m going to change the color-coding now to simplify things. Now, blue will indicate the people who agree with you on all issues, green the people who agree on all but one issue, yellow the people who agree on all but two issues, and red the people who disagree with you on three or more issues.

For three issues, that looks like this, which you can compare to the previous diagram:

Rectangle_4

Now let’s add a fourth issue. Let’s say 60% of people agree with you that socks should not be worn with sandals, but 40% think that socks should be worn with sandals. The blue region gets smaller:

Rectangle_5

How about a fifth issue? Let’s say 60% of people agree with you that cats are better than dogs, while 40% think that dogs are better than cats. The blue region continues to shrink:

Rectangle_6

How about a sixth issue?

Rectangle_7

And finally, a seventh issue?

Rectangle_8

Now the majority of the space is covered by red, meaning that most of the population disagrees with you on at least three issues.

To recap:

By the time there were two issues, the majority of the population disagreed with you on at least one issue.

By the time there were four issues, the majority of the population disagreed with you on at least two issues.

By the time there were seven issues, the majority of the population disagreed with you on at least three issues.

This despite the fact that the majority of the population always agrees with you on any given issue!

If you only welcomed people into your coalition who agree on every single issue (the blue region), you wouldn’t win election if there were even two issues. If you only welcomed those who disagree on at most one (blue or green), you’d stop winning if there were at least four issues. And if there were at least seven issues, you couldn’t even win by allowing those who disagree on at most two issues (blue, green, yellow).

Now, this argument very much does rely upon the different opinions being independent, which in real politics is not the case. So let’s introduce some correlations and see how this changes the result.

Suppose that once someone agrees with you about driving on the right side of the road, they are 90% likely to agree on pizza, Star Trek, sandals, and cats.

Rectangle_9
That makes things look a lot better for you; by including one level of disagreement, you could dominate every election. But notice that even in this case, if you exclude all disagreement, you will continue to lose elections.

With enough issues, even with very strong correlations you can get the same effect. Suppose there are 20 issues, and if you agree on the first one, there is a 99% chance you’ll agree on each of the others. You are still only getting about half the electorate if you don’t allow any disagreement! Due to the very high correlation, if someone disagrees with you on a few things, they usually disagree with you on many things; yet you’re still better off including some disagreement in your coalition.

Rectangle_10

Obviously, you shouldn’t include people in your coalition who actively oppose its core mission. Even if they aren’t actively trying to undermine you, at some point, the disagreement becomes so large that you’ve got to cut them loose. But in a pluralistic democracy, ideological purism is a surefire recipe for electoral failure. You need to allow at least some disagreement.

This isn’t even getting into the possibility that you might be wrong about some issues, and by including those who disagree with you, you may broaden your horizons and correct your mistakes. I’ve thus far assumed you are completely correct and in the majority on every single issue, and yet you still can’t win elections with complex policy mixes unless you include people who disagree with you.

Doug Julius, in memoriam

Sep 10, JDN 2458007

Douglas Patrick Julius

April 15, 1954 to August 31, 2017

My father died suddenly and unexpectedly from a ruptured intracranial aneurysm. I received a call that he was in the hospital Wednesday morning at 11:30 AM PDT, took the first flight to Michigan I could find, and arrived around 10:30 PM EDT. By the time I got there, my father was already unconscious and under intensive care. I stayed up all night in the hospital. My father never regained consciousness. He was declared dead at 8:30 AM on Thursday morning.

In lieu of a proper blog post this week, I decided to post the eulogy I gave at my father’s funeral this past Sunday. It follows below.

What is a soul? What is it made of? Most people imagine a soul as something immaterial, something somehow “beyond” this physical world. But at its core, a soul is simply what makes us who we are. Today we have cognitive science, and now understand the human soul better than it was understood by all the billions of people in all the thousands of years of human civilization before us. Thanks to cognitive science, we now know what the soul is made of: It is made of information.

My father wasn’t made of some mysterious substance “beyond” our physical world, but nor was hejust the molecules of his body you see here. My father was made of hopes and dreams, laughter and tears, words and ideas. He was made of James Joyce novels and Catullus poems, Spider-Man comics and Arnold Schwarzenegger movies, road trips across America, gazes over the Grand Canyon, spelunking in Carlsbad Caverns, walks on the beaches of the Gulf of Mexico and the Pacific, warm hugs, gentle smiles, sophisticated puns, obsessive organizing, and reading literally thousands of books, on everything from Celtic literature to quantum physics. (I think he knew the former a lot better than the latter, while for me, it is the reverse.)

And coffee. Lots and lots of coffee.

Most of what my father was is now gone, and I don’t think we should try to deny that. I don’t think it’s healthy—or even effective—to tell ourselves that he isn’t really gone or that he’s in some better place. Deep down we all know the loss we feel. We know the regrets we have of all the things we thought we’d get to do together, but now we know we never will. There are three that are especially painful for me: My father will never get to see my PhD diploma, never know me as “Doctor Patrick Neal Russell Julius.” My father will never get to see my wedding. And above all, my father will never get to meet his grandchildren. If I had known, I could have tried to make these things happen sooner, so that my father would get to share them with me. I thought that I had 20 years left to do all these things with my father beside me—but the reality turned out differently. And one of the best definitions of reality is this: Reality, when you stop believing in it, doesn’t go away. We grieve this loss for a reason. It hurts so much to lose my father because we know how much joy he once brought to our lives, and how much he would have if he’d been allowed to go on living. A friend of mine offered me this aphorism: Grief is the price we pay for love.

But my father is not completely gone, either. Our souls are made of information too, and there are little fragments of my father’s soul in every one of us. Every memory we have of him, every time he touched our lives, a fragment of him was downloaded into each of us, and as long as we remember him, he will not be entirely gone.

There are a few memories in particular I’d like to share with you all know—back them up in the cloud if you will—so that the essence of who my father was will live on awhile longer. Human long-term memory is stored in the form of narrative, so I thought it best if I told a few stories.

The first story is about gentleness. We were driving through New Mexico. I had moved recently to Long Beach to study for my master’s degree at CSU; after coming back to Ann Arbor for a visit, Dad had driven with me in my little Smart car all the way across the country. We planned our route to pass the Very Large Array, a gigantic assembly of radio telescopes probably best known for being featured in the film Contact, one of my favorites, based on a Carl Sagan novel I love even more. I had wanted to see it for a long time, so Dad added a few hours to our trip so we could go past it.

When we arrived at the array, we could hardly find any people around. Instead what we found were bugs—grasshoppers I think, and millions of them. Everywhere. The ground was literally covered in them; there wasn’t even any room to walk. Most people would probably have just gone ahead and walked right on top of them, crushing them as they went—but not my father. His gentleness extended even to the lowliest of creatures, and he wanted to make sure we didn’t harm any of the bugs. So he found a way for us to creep, slowly, across the desert, shooing away the bugs at each step, so that they would give us room to pass. We didn’t step on a single grasshopper that day, and I finally got the chance to touch one of the radio telescopes.

The second story is about generosity. We had just bought a baby grand piano, and my mother was learning to play it. For her birthday she had asked for a metronome. So, my father and I went out shopping to find a nice metronome. We found one that seemed perfect, but then the store offered us one that was twice the price, and as far as I can tell, not any better whatsoever. Dad asked me, “Isn’t your mother worth it?” Already a budding economist, I had to explain, “Of course, but that’s not the question. The question is, is the metronome worth it? Save the money and we’ll buy her something else too.” But that’s how Dad was: When buying things for himself, he was frugal, even miserly; several times I saw him find rare books—first editions of Joyce, folio editions of Shakespeare—that he had wanted for decades to get, then pass them up to save $100 or maybe $200. But when buying for other people, money was no object; he’d spend that same $200 buying me another video game system without a second thought. He was generous to a fault; he’d never use his credit cards all year, then max them out every Christmas. As I got older, I actually started scaling back my Christmas lists on purpose, for fear he might go broke buying me everything I had asked for. Sometimes I think I was still a little too greedy, and should have scaled them back even more. I never was able to talk him out of buying me that folding bicycle that now sits in a corner of my apartment in Irvine—at least I talked him down from the model that cost twice as much.

The third and final story is about curiosity. Dad actually taught my high school English AP class. I was originally assigned to a different class, but in that one I was completely miserable. The very first day of class was a demonstration where he asked us all to raise our hands if we expected an A. Since this was an AP class and we were all top-achieving students, most of us did. Then the teacher asked us rhetorically: “How realistic is that?” as though there were some inherent law of the universe making such an outcome impossible. I think he saw grading as a ranking, or even a race; the notion that we could all earn mastery in the subject struck him like the notion that everyone in the Indy 500 could win first place. The next day was a quiz to see how much we remembered of the summer reading. No review, no discussion, no introduction between the students and the teacher—just the quiz. It became clear that this teacher had no interest in educating us; his goal was to evaluate us. After about a week of this I asked to be transferred to a different class. They said all they had was my dad’s class, which seemed awkward to all involved, but I decided to go with that anyway.

I ended up very glad that I had. Dad’s approach to teaching was completely different: He actually wanted us to learn. He didn’t even call them “quizzes”; they were FLAIs, spelled “F-L-A-I” which stands for “Friendly Little Assessment Instrument”. The students who were used to grade-grubbing for an extra few points found his grading system aggravating, because he refused to give a precise point tally for everything (and if you asked for one, he’d make up some nonsensical number on the spot, like “52 million” or “pi”). But the rest of us found it a breath of fresh air. We could stop worrying about how many points this quiz was worth, stop cramming for the next multiple-choice scantron exam—and actually focus our efforts on reading and learning and appreciating literature. My dad didn’t use a lot of fancy gadgets or sophisticated educational techniques; a lot of the time he was just talking and writing on a chalkboard. But his unbounded intellectual curiosity was infectious. If a student showed interest in something, he’d just start talking about that for awhile, even if it didn’t seem relevant; at first students thought this meant they could waste class time by pulling him off on a tangent. But that was never really what happened; he always managed to teach us something unexpected, and usually managed to tie it back to whatever we were studying in class. Sometimes we managed to teach him something too; usually that would be something about physics from me or something about biology from Esther Alfred or Casey Boucher. My favorite class project of all time was for my dad’s class: After reading both Vladimir Nabokov’s Pale Fire and Kurt Vonnegut’s Slaughterhouse-Five, I asked if I could write my paper about Slaughterhouse-Five in the style of Pale Fire, meaning as a series of endnotes that bear some passing relevance to the text in question, but are over-interpreted to an absurd degree to the point where they end up telling a completely different story. Most teachers would probably have balked at the idea, but Dad thought it was fabulous. I don’t think he would have thought any differently if I hadn’t been his son; he simply enjoyed nurturing his student’s creativity in that way. I probably didn’t read as many books in that class as I would have in the other English AP class; but my dad’s class fanned the flames of a love of literature that the other class would have done everything it could to extinguish.

That’s about all I have. Thank you for listening, and taking the time to be here today. The world lost a very good man this week, and I know he will be sorely missed by all of us. No words can fully capture our sorrow, but there are a few in particular I think my father would have appreciated, said always on such occasions by one of his favorite authors:
So it goes.