Thomas Sowell's Poor Scholarship

Today I read some of "A Conflict of Visions" by Thomas Sowell with a particular interest in what he would say about Godwin and Burke. I was very disappointed, and was concerned about his accuracy. So, I checked up on two of his footnotes. In both cases he misrepresented the original text.

Sowell writes (page 23):
Unintentional social benefits were treated by Godwin as scarcely worthy of notice.[12]
Here is what Godwin actually says (Political Justice, Volume 1, Page 433):
Virtue requires a certain disposition and view of the mind, and does not belong to the good which may accidentally and unintentionally result from our proceeding. The creditor that, from pure hardness of disposition, should cast a man into prison who, unknown to him, was upon the point of committing some atrocious and sanguinary action, would not be virtuous but vicious. This mischief to result from the project of his debtor, was no part in his motive; the thought only of gratifying his inordinate passion.
Godwin is not arguing that unintentional social benefits are unimportant. He is arguing against the theory that all actions should be judged purely by their consequences; intentions matter and people should not be given moral credit for lucky accidents. Sowell has misrepresented Godwin.

Sowell writes (page 25):
"Nothing is good," Burke said, "but in proportion, and with reference"[20]--in short, as a trade-off.
Sowell is representing Burke as saying that nothing is good except trade-offs. Here is what Burke said with the preceding sentence included:

http://books.google.com/books?pg=PA412&lpg=PA411&dq=%22but+in+proportion+and+with+reference%22&id=72QZunsrU3EC&ots=zfowb_ZcSF#PPA411,M1
All I recommend is, that whenever the sacrifice of any subordinate point of morality, or of honour, or even of common liberal sentiment and feeling is called for, one ought to be tolerably sure that the object is worth it. Nothing is good, but in proportion and with reference.
Burke is saying that if we make a trade-off, we should be sure it's worth it. That does not mean that only trade-offs are good, it only means that we better not ignore proportion or reference. Sowell has misrepresented Burke.

Elliot Temple | Permalink | Messages (0)

Atrocious Burke Scholarship

The Portable Edmund Burke edited by Isaac Kramnick states on page xxviii of the introduction that:
Beginning in 1929 and 1930, Burke's reputation was subjected to the most serious assault on it since the radical crew of Wollstonecraft, Priestly, Paine, William Godwin, and others had finished with it one hundred and thirty-five years earlier.
This is false. Godwin did not assault Burke's reputation. Here is a well known quote by Godwin about Burke:

http://dwardmac.pitzer.edu/anarchist_archives/godwin/pj8/pj8_10.html
Whilst this sheet is in the press for the third impression, I receive the intelligence of the death of Burke, who was principally in the author's mind, while he penned the preceding sentences. In all that is most exalted in talents, I regard him as the inferior of no man that ever adorned the face of earth; and, in the long record of human genius, I can find for him very few equals. In sublety of discrimination, in magnitude of conception, in sagacity and profoundness of judgement, he was never surpassed.
This was followed with a bit of criticism; Godwin considered Burke to be one of the best men ever, but flawed. There is no way to take it as an assault on Burke's reputation. Godwin also praised Burke on several other occasions.

Elliot Temple | Permalink | Messages (0)

Bad Scholarship: Merchants of Despair by Robert Zubrin

After reading Merchants of Despair, I decided to do some fact checking and to learn about some of the topics in more detail. I started in chapter 1 about Malthus. I found serious scholarly errors. Next I skipped to material about population control and President Lyndon Johnson. Again I found serious scholarly errors. I have not fact checked the rest of the book; I did not fact check any other part and find it was OK. Topics I already knew something about (DDT, nuclear power, Julian Simon's bet about resource prices) seemed correct when I first read them. I think the book is approximately correct in general claims and has some good philosophical ideas, but it gets a lot of details wrong. Do not trust its specifics. Educate yourself by reading further books on the topics that interest you.

Below I detail some scholarly errors I found. I only checked a small amount of material to find these. If we assume the rate of errors is representative of the rest of the book, then that's really quite bad.

Malthus

Zubrin does Malthus fast and hard, and then talks about what is "Malthusian" throughout the rest of the book, relying on the early presentation of Malthus in chapter 1. In chapter 1, he provides only two Malthus quotes. After that he moves on to quoting people he identifies as Malthusians. Both Malthus quotes are misquotes. He also provides a very clear and direct paraphrase of Malthus, which he cites to two Malthus chapters. But Zubrin's story is a fantasy not backed up by his cites. This is very poor and unacceptable level of scholarly research.

First Malthus Misquote

Malthus prescribed specific policies to keep population down by raising the death rate:

[blockquote] We are bound in justice and honour to disclaim the right of the poor to support. . . . [W]e should facilitate, instead of foolishly and vainly endeavouring to impede, the operations of nature in producing this mortality; and if we dread the too frequent visitation of the horrid form of famine, we should sedulously encourage the other forms of destruction, which we compel nature to use. Instead of recommending cleanliness to the poor, we should encourage contrary habits. In our towns we should make the streets narrower, crowd more people into the houses, and court the return of the plague. In the country, we should build our villages near stagnant pools, and particularly encourage settlements in all marshy and unwholesome situations. But above all, we should reprobate specific remedies for ravaging diseases; and those benevolent, but much mistaken men, who have thought they were doing a service to mankind by projecting schemes for the total extirpation of particular disorders.[3]

Zubrin, Robert (2012-03-20). Merchants of Despair: Radical Environmentalists, Criminal Pseudo-Scientists, and the Fatal Cult of Antihumanism (New Atlantis Books) (Kindle Locations 128-136). Perseus Books Group. Kindle Edition.
Malthus' view as presented is despicable. But it's both misquoted and taken out of context.

The actual quote can be found here:

Principle of Population Bk.IV Ch.V

Principle of Population Bk.IV Ch.VIII

This is the same edition Zubrin cites, see here:

Principle of Population, Card Catalog Information

Why can it be found in two different chapters? Because Zubrin took two different Malthus quotes and combined them into one quote for his book. Then he cited it as if it was just one quote from book 4 chapter 5.

The first part of what Zubrin quotes, before the ellipsis, is actually from three chapters later. And it's edited. The bulk of the quote, starting at "[W]e should facilitate" is a correct quote in the literal sense but completely out of context and misleading. But besides being out of context, Zubrin doctored it by adding an initial sentence, from elsewhere in the book, which he also changed the wording of. This is an unacceptable distortion of the facts.

Besides moving a Malthus sentence out of context, Zubrin edited it. It actually reads (from 4.8):
As a previous step even to any considerable alteration in the present system, which would contract or stop the increase of the relief to be given, it appears to me that we are bound in justice and honour formally to disclaim the right of the poor to support.
Zubrin made the following changes:

He started mid-sentence while giving no indication of doing so.

He changed "we" to "We". This is especially misleading because immediately afterwards he uses "[W]e" to indicate the same type of change. Since he indicates it the other time, you would expect him to indicate it other times. This sort of inconsistency in quoting practices is extra misleading to the reader.

He deleted the word "formally".

He un-italicized the word "right".

These things make it a serious misquote. Plus he moved it three chapters earlier out of context. When he cited the quote, he did not cite the chapter this actually comes from, only the chapter the other part of his supposed-quote is from. This is very unscholarly.

But it gets worse. Did Malthus really want plague? No. His argument is structured like this: (I haven't read the whole book but I read enough to get the basic idea and see that Zubrin had this part wrong, you can get a lot of context from the two chapters prior to the one Zubrin quotes. 4.3 and 4.4)

What we need is moral restraint. Do not marry and have kids if you can't afford them. The poor laws are bad because they subsidize having kids you can't afford and they make promises they can't keep. What are the alternatives to moral restraint? Nothing good because of limited resources. Too big a population will lead to famine. Or if we don't want big nasty famines, then the logical consequence is we should keep people dying off regularly from plague, disease, dirtiness, crowding, malaria, etc... But Malthus is not advocating that, he's saying it's the consequences of lack of moral restraint. What he's advocating is moral restraint.

So Malthus was saying, "If we don't do what I'm suggesting, then what happens? All this bad stuff." And Zubrin has quoted that bad stuff out of context and said it's what Malthus was proposing. That's utterly wrong.

Second Malthus Misquote

In a letter to economist David Ricardo, Malthus laid out the basis for this policy: “The land in Ireland is infinitely more peopled than in England; and to give full effect to the natural resources of the country, a great part of the population should be swept from the soil.”[12]

Zubrin, Robert (2012-03-20). Merchants of Despair: Radical Environmentalists, Criminal Pseudo-Scientists, and the Fatal Cult of Antihumanism (New Atlantis Books) (Kindle Locations 189-191). Perseus Books Group. Kindle Edition.
This is commonly misquoted. Maybe Zubrin didn't know any better. He cited a secondary source for this which I haven't checked. Regardless, he's guilty of bad scholarship. He should have checked a primary source whenever he could instead of relying on secondary sources. If I can find out the truth of this one just with Google, he ought to have been able to find out too using Google, book writing skills, libraries, and his swarm of interns:
I wish to acknowledge my debt to New Atlantis interns A. Barrett Bowdre, Elias Brockman, Nathaniel J. Cochran, Jonathan Coppage, Brendan Foht, and Edward A. Rubin, who put in many weeks at the Library of Congress verifying, and where necessary correcting, every fact, quote, and footnote in this book.

Zubrin, Robert (2012-03-20). Merchants of Despair: Radical Environmentalists, Criminal Pseudo-Scientists, and the Fatal Cult of Antihumanism (New Atlantis Books) (Kindle Locations 3693-3695). Perseus Books Group. Kindle Edition.
Many weeks of work verifying "every fact, quote, and footnote"? Well, I believe they tried, but it was shoddy work that, sadly, overall, failed at its task.

This Malthus quote is edited, truncated, and taken out of context. This gives the false impression that Malthus wanted lots of people dead. "Swept from the soil" sounds like killed or at least gone. He didn't want them to live and exist anymore. Except that isn't what Malthus actually said or meant. The full quote, in context, is completely different and is part of a dry, economics discussion. It has nothing to do with genocide. But Zubrin falsely presents Malthus as genocidal using this fake quote (twice).

The full quote can easily be found with Google by any researcher (no doubt libraries have it too! e.g. the Library of Congress which Zubrin sent a bunch of interns to). I found it on these four webpages: one, two, three, four.

The most informative one actually explains the issue of this passage being misquoted:
An examination of the full text of this letter finds Malthus's intent to be far different that [sic] the one implied by the truncated wording commonly used by Mokyr and others. As a reading of the whole letter makes clear, in this correspondence Malthus was conveying his surprise that the Irish economy was not as bad as he had been led to expect. He commented earlier in the letter that "[t]hough the distress was certainly great, it was I think on the whole less than I expected." Referring particularly to the south, where he had toured through Tipperary, Waterford, Kerry, and Limerick, Malthus noted that "great marks of improvement were observable." It is in this context that Malthus undertook his observation on the Irish population that Mokyr cites. In this section of the letter, Malthus was reflection not on overpopulation and hunger, but rather on employment and wages. He noted that Ireland possesses "a population greatly in excess above the demand for labor." In this context, Malthus went on to make an economic argument concerning the distribution of labor "[t]he Land in Ireland is infinitely more peopled than in England; and to give full effect to the natural resources of the country, a great part of the this population should be swept from the soil into large manufacturing and commercial Towns."[11] In examining the unedited quotation, it is clearer why Malthus emphasized the word Land in his letter, to very explicitly contrast it to the towns mentioned in the frequently elided ending phrase. The central issue here for Malthus was not the absolute scale of the population of Ireland, but rather its concentration in agriculture rather than industry. As this example well illustrates, the tendency to misread Malthus as a Malthusian is strong, especially in the wake of the Great Hunger.[12]
I'm not sure what he means about misreading "Malthus as a Malthusian". But in any case, Zubrin lowercased the word "Land" (I'm unsure what is italicized in the original which I don't have a copy of), Zubrin omitted the context, and Zubrin incorrectly presented the quote as ending on the word "soil" without revealing that Malthus wanted to sweep them off the Land into Towns for economic reasons, rather than wanting genocide as Zubrin falsely implies. Overall, it means one thing and Zubrin misquoted it to mean something else very different.

Malthus False Summary

In short, Malthus argued that we should do whatever we can to encourage disease, and we should condemn doctors who try to find cures. In addition, everything should be done to keep the wages of working people as low as possible.[4]

Zubrin, Robert (2012-03-20). Merchants of Despair: Radical Environmentalists, Criminal Pseudo-Scientists, and the Fatal Cult of Antihumanism (New Atlantis Books) (Kindle Locations 137-138). Perseus Books Group. Kindle Edition.
And the source on that:
3 Thomas Malthus, Essay on Population, 6th ed. (London: John Murray, 1826), bk. IV, chap. 5,300–301.
4 Ibid., bk. iii, chap.7, especially 371–375; ibid., bk. iv, chap. 1.

Zubrin, Robert (2012-03-20). Merchants of Despair: Radical Environmentalists, Criminal Pseudo-Scientists, and the Fatal Cult of Antihumanism (New Atlantis Books) (Kindle Locations 3716-3718). Perseus Books Group. Kindle Edition.
So, to see if Zubrin's summary was accurate, I read those chapters (3.7 and 4.1), in the 6th edition from 1826. They are available here:

Principle of Population Bk.III Ch.VII

Principle of Population Bk.IV Ch.I

One of the problems here is it's hard to tell which text the citation is intended to cover. At first I thought it was covering both sentences. But what Zubrin says here about disease and doctors isn't in the cited chapters (3.7 and 4.1). I've now figured out the disease sentence is referring to the previous misquote (in which Malthus suggests we "court the return of the plague"). Whereas the wages sentence, which looks like it goes with the disease sentence, is actually separate and refers to a different part of the book, found in the footnote.

So far this is confusing but not actually a very big deal (though bear in mind that his summary about Malthus wanting to "encourage disease" is just as completely false as the implications of out of context quote. This is a summary only of Zubrin's total misreading of his misquote). But it gets worse. Zubrin summarized Malthus, "In addition, everything should be done to keep the wages of working people as low as possible." That is absolutely not what Malthus says in the cited chapters (3.7 and 4.1), which I read through specifically to check for this.

Zubrin provides primary source citations to give the superficial appearance of having done proper research. But he hasn't; he is misleading his reader. Books should not be traps to fool their readers!

I'd like to show you this with quotes but how do I quote Malthus to demonstrate that his text lacks the statements Zubrin says it has? Click the links and search them yourself on words like "wages", "low" or "possible". I did that in addition to reading the full chapters. Zubrin's claim about keeping wages as low as possible is just not there; Zubrin made it up and then falsely represented it as a summary of Malthus.

The closest Malthus comes is some economic arguments about how you can't make the poor rich with minimum wage laws. These bear no resemblance to Zubrin's supposed summary, but maybe Zubrin (who does not understand economics and praised minimum wage laws twice in the book) confused Malthus discussing facts of economics for Malthus trying to keep wages for the poor low. That's my best guess at what happened but there is really no excuse.

I'll try to give you a sense of what Malthus actually said when he talked about wages in 3.7 (I don't know why 4.1 was cited, it doesn't even mention wages and is irrelevant):
What I have really proposed is a very different measure. It is the gradual and very gradual abolition of the poor-laws. And the reason why I have ventured to suggest a proposition of this kind for consideration is my firm conviction, that they have lowered very decidedly the wages of the labouring classes, and made their general condition essentially worse than it would have been if these laws had never existed. [...]

To remedy the effects of this competition from the country, the artificers and manufacturers in towns have been apt to combine, with a view to keep up the price of labour, and to prevent persons from working below a certain rate. But such combinations are not only illegal, but irrational and ineffectual; and if the supply of workmen in any particular branch of trade be such as would naturally lower wages, the keeping them up forcibly must have the effect of throwing so many out of employment, as to make the expense of their support fully equal to the gain acquired by the higher wages, and thus render these higher wages in reference to the whole body perfectly futile.

It may be distinctly stated to be an absolute impossibility that all the different classes of society should be both well paid and fully employed, if the supply of labour on the whole exceed the demand; and as the poor-laws tend in the most marked manner to make the supply of labour exceed the demand for it, their effect must be, either to lower universally all wages, or, if some are kept up artificially, to throw great numbers of workmen out of employment, and thus constantly to increase the poverty and distress of the labouring classes of society.
Malthus wants to very gradually abolish the poor-laws, which he says have lowered the wages of the labouring classes and made their lives worse. His plan is to improve the lives of the workers and raise their wages by this reform! Zubrin said pretty much the opposite, that Malthus wants wages to be low; actually Malthus wants to improve wages. More generally, Malthus wasn't trying to make the poor miserable or kill them, and actually he wanted to improve their lives (by explaining moral restraint and reforming bad laws. Also by understanding resource limit, population growth and crop yield issues, about which Malthus was mistaken but not evil).

Malthus further discusses minimum wage laws, which he says are illegal, irrational and ineffectual. He tries to explain why they won't help the labourers. He basically says that if you force wages above the market rate, this causes unemployment and doesn't provide more wealth to the poor people overall as a group.

Zubrin's scholarship here was very bad and he misstated what Malthus was saying.

To clear things up about Malthus a bit more, in general, he meant well, at least according to his book (first edition preface):
If he [the author, Malthus himself] should succeed in drawing the attention of more able men, to what he conceives to be the principal difficulty in the way to the improvement of society, and should, in consequence, see this difficulty removed, even in theory, he will gladly retract his present opinions and rejoice in a conviction of his error.

Indira Gandhi

Indira Gandhi arrived in Washington in late March and met first with Secretary of State Dean Rusk, who handed her a memo requiring “a massive effort to control population growth” as a condition for food aid. Then on March 28, 1966, she met privately with the president. There is no record of their conversation, but it is evident that she capitulated completely.

Zubrin, Robert (2012-03-20). Merchants of Despair: Radical Environmentalists, Criminal Pseudo-Scientists, and the Fatal Cult of Antihumanism (New Atlantis Books) (Kindle Locations 2508-2510). Perseus Books Group. Kindle Edition.
False. Indira Gandhi was already in favor of population control before meeting with Lyndon Johnson. She did not "capitulate". Zubrin presents a false, anti-American picture in which the US pressures Indira Gandhi into semi-betraying her country accepting unwanted population control, in return for food aid (India was having a famine at this time).

Zubrin's anti-American story is based on his imagination, not historical facts. I learned this reading books which Zubrin himself cites, so you might expect him to have read them too. They clearly tell a different story, but Zubrin changed the story to make USA look worse and bias his book to have more of a "USA and other first world countries screw over the third world" slant (which is a theme throughout, with some truth to it, but apparently Zubrin is so committed to this cause that it matters to him more than facts do.)

Here's the real story:

The Coming Population Crash And Out Planet's Surprising Future, by Fred Pearce, p 60 (this is a book Zubrin cites and therefore ought to have read):
Johnson found an unexpected ally: the newly elected Indian prime minister, Nehru's daughter, Indira Gandhi. As minister of information, she had run aggressive family planning propaganda for her father. Now she wanted to do more than exhort. After the two leaders met in March 1966, Johnson reported back to Congress... [that they agreed about the population control agenda]
Since I discovered Fred Pearce is himself a poor scholar, I didn't know what to believe yet. So I checked Zubrin's source for this specific passage. It's Fatal Misconception by Matthew Connelly, p 222. Connelly backs up Pearce (and then some), while contradicting Zubrin.

Connelly says nothing about Indira Gandhi capitulating. Instead he says, p 222, "Johnson did not have to insist." Why not? Because of stuff like this, "the local USAID administrator noted that, under Gandhi and Mehta's leadership, 'more punch in very recent weeks is being added tot he Central Government's family planning program.'" Indira Gandhi was already in favor of population control without Johnson having to make her capitulate. The US didn't need to pressure her into it, she already wanted to do it to her own people.

There are more details in Connelly, p 221.
[Indira Gandhi] had wanted to donate her family's ancestral home in Allahabad so that it could become an Institute for Family Planning. As information minister, she had pressed a plan to distribute hundreds of thousands of radios across rural India to transmit family planning information. And Gandhi together with Rama Rau was also among those who had been pressuring Nayar to pay women to accept IUD insertion. [70]
After being elected, "Gandhi's interest in family planning was apparent in her first meeting with Ambassador Bowles. So too was her evident need for American help." Bowles said good relationships would require three things: 1) "peace with Pakistan" 2) "genuine and positive neutrality in the Cold War" 3) Connelly quotes his own source for this one, which says, "pragmatic economic policies ... giving high priority to agriculture, education and population planning." Connelly continues:
Gandhi replied that managing relations on this basis would be any "easy matter," promising to
"press hard on such programs as family planning." On January 25, 1966, the day after she was formally sworn into office, the Ministry of Health was renamed the Ministry of Health and Family Planning, including a separate department with its own permanent secretary and minister of state. [71]
Indira Gandhi did not implement population control measures under US pressure. She didn't capitulate. She was eager to do these things and got started right away, months prior to meeting Johnson. Zubrin misleads us in a way that contradicts his own sources.

Lyndon Johnson

Zubrin tells a story in which Johnson gets in office and then population control advocates want to get him on board with population control and have to persuade him.
To get President Johnson on board, [people showed Johnson a fraudulent study]

Zubrin, Robert (2012-03-20). Merchants of Despair: Radical Environmentalists, Criminal Pseudo-Scientists, and the Fatal Cult of Antihumanism (New Atlantis Books) (Kindle Location 2281). Perseus Books Group. Kindle Edition.
In passing the study on to Bundy, Komer commented: “Here’s a little flank attack that I think might just penetrate LBJ’s defenses . . . . It might score.”[9]

It did. Johnson bought the claptrap, including the phony mathematical results. Two months later, he declared to the United Nations that “five dollars invested in population control is worth a hundred dollars invested in economic growth.” Having succeeded in this policy coup, “Blowtorch” Komer was promoted...

Zubrin, Robert (2012-03-20). Merchants of Despair: Radical Environmentalists, Criminal Pseudo-Scientists, and the Fatal Cult of Antihumanism (New Atlantis Books) (Kindle Locations 2287-2290). Perseus Books Group. Kindle Edition.
With the Johnson administration now backing population control, Congress passed the Foreign Assistance Act in 1966...

Zubrin, Robert (2012-03-20). Merchants of Despair: Radical Environmentalists, Criminal Pseudo-Scientists, and the Fatal Cult of Antihumanism (New Atlantis Books) (Kindle Locations 2292-2293). Perseus Books Group. Kindle Edition.
Notice the date of 1966. The thing is, Johnson was already in favor of population control before this. I learned this, again, from a book Zubrin himself cites and presumably read.

The Triumph & Tragedy of Lyndon Johnson: The White House Years by Joseph A. Califano, Jr. is a primary source book. California worked in the Johnson administration and tells about it firsthand. It says, p 154:
Previous presidents had either opposed mounting government birth-control programs, finessed the issue, or gingerly approved a little research on population control. Johnson himself had waited until he was elected in his own right to unveil his position. Then, in his January 4, 1965, State of the Union message, Johnson had said, "I will seek new ways to use our knowledge to help deal with the explosion in world population and the growing scarcity in world resources."
So who needs to trick Johnson with a "flank attack" and fraudulent study? He already agreed with their basic agenda enough to advocate it in major public speeches since since at least January 1965. Zubrin presents it as a "policy coup" to trick Johnson into believing a position he'd already been advocating. That's bad historical research, apparently including not paying much attention to Zubrin's own sources.

Conclusion

As we've seen, Zubrin has multiple misquotes and factual inaccuracies in the areas I checked. I fear the rest of the book may have a similar densities of serious errors. It strains credibility that I just happened to choose the only two poorly researched parts to investigate.



UPDATE: I sent this post to Robert Zubrin, author of Merchants of Despair. This is the full text of his reply:
So you are fine with the deaths of millions of Irish and Indians, under the
administration of British Malthusians, the murder of millions of Jews and
Slavs by German Malthusians, and the myriad ongoing worldwide crimes of
other Malthusians ever since.
I guess they were all misquoted too.
Incredible.

Elliot Temple | Permalink | Messages (16)

Bad Scholarship: Population Control by Steven W. Mosher

Population Control: Real Costs, Illusory Benefits by Steven W. Mosher, p 32
Such a fate [population catastrophe], Malthus argued, could only be avoided by stern, even pitiless, measures. [...] [Things got better in the Industrial Revolution e.g. lower death rate.] Malthus proposed to undo all this:

[blockquote] All children born, beyond what would be required to keep up the population to a desired level, must necessarily perish, unless room be made for them by the deaths of grown persons.... Therefore ... we should facilitate, instead of foolishly and vainly endeavouring to impede, the operations of nature in producing this mortality; and if we dread the too frequent visitation of the horrid form of famine, we should sedulously encourage the other forms of destruction, which we compel nature to use. Instead of recommending cleanliness to the poor, we should encourage contrary habits. In our towns we should make the streets narrower, crowd more people into the houses, and court the return of the plague. In the country, we should build our villages near stagnant pools, and particularly encourage settlements in all marshy and unwholesome situations. But above all, we should reprobate [I.e. reject -- this is from Mosher] specific remedies for ravaging diseases; and those benevolent, but much mistaken men, who have thought they were doing a service to mankind by projecting schemes for the total extirpation of particular disorders.

[Back to Mosher writing] These were strange, almost diabolical, views for a member of the Christian clergy to hold.
This is completely wrong. Details to follow:

The source it gives is a secondary source, a 1977 book. Why would you quote a secondary source for a very well known and easily available Malthus book? The full text is even free online now. This Mosher book came out in 2008 so I'm pretty sure it was already free online then too.

Quoting secondary sources, instead of primary, is bad practice for any kind of scholarly book. You should always use primary sources when they are available. Mosher wants to be a scholar; he gives lots of sources and notes for his book; but he's doing it wrong.

If you trust secondary sources some of them are going to be wrong. Like Mosher himself if someone trusted him on Malthus. Or like Zubrin or like the secondary source Mosher quoted.

Another problem with citing a secondary source is I can't tell what edition of Malthus' book he's quoting from without getting the secondary source book. Either he's quoting from an edition other than the 6th, or some words have been changed.

http://www.econlib.org/library/Malthus/malPlong30.html#Bk.IV,Ch.V

The 6th edition says "All the children born" instead of "All children born" and "keep up the population to this level" instead of "keep up the population to a desired level". Other than that it's the same.

Now on to the important part: this quote is taken out of context. The chapter title is this:

"Of the Consequences of pursuing the opposite Mode."

It is the "opposite mode" that Malthus is describing in the quote. He's not advocating it. It's the opposite of what he advocates. He's saying the consequences of not doing what he advocates (which is moral restraint) will be all these horrible things.

So basically Malthus said, "Do what I suggest (moral restraint), or all this horrible stuff is going to happen." Then Mosher quotes the horrible stuff and says Malthus wanted that horrible stuff.

By moral restraint, Malthus means people shouldn't marry and have children irresponsibily. They should have enough wealth to support a child before having that child. That's his favored solution to population problems. But Mosher claims Malthus' favored solution is plague and disease, and then calls Malthus a villain. This is just plain wrong and terrible research.

Zubrin did the same thing with almost the same quote. All of Zubrin's other Malthus quotes were wrong. And it's the same for Mosher. He provides one big out of context quote then moves on, considering the issue settled. When you're going to rely on a single quote or just a couple quotes, you need to get it right! This is so bad. People want to attack "Malthusians" in their book, so they include a section on Malthus, but they don't do any reasonable research and don't understand him at all and misquote him.

Elliot Temple | Permalink | Messages (2)

Bad Scholarship: Fatal Misconception by Matthew Connelly

Fatal Misconception by Matthew Connelly:

Page 2 gives a Malthus quote which it cites to a secondary source instead of a primary source. This is bad. The following footnote, also about Malthus, cites a primary source -- the same one that first quote came from. So why doesn't the first quote cite the primary source he had access to? That makes no sense; I guess he just doesn't consider giving primary source citations a priority to care about...

Moving on we've got something really bad, page 2:
The tone of unremitting gloom [of Malthus in his essay] never lifted. "Misery and the fear of misery", were, for Malthus, "the necessary and inevitable results of the laws of nature in the present stage of man's existence." [2]
The cite directs us to the exact paragraph in an online primary source which is very nice. It is:
I am sufficiently aware that the redundant millions which I have mentioned could never have existed. It is a perfectly just observation of Mr. Godwin, that "there is a principle in human society by which population is perpetually kept down to the level of the means of subsistence." The sole question is, what is this principle? Is it some obscure and occult cause? Is it some mysterious interference of Heaven, which at a certain period strikes the men with impotence, and the women with barrenness? Or is it a cause open to our researches, within our view; a cause which has constantly been observed to operate, though with varied force, in every state in which man has been placed? Is it not misery and the fear of misery, the necessary and inevitable results of the laws of nature in the present stage of man's existence, which human institutions, so far from aggravating, have tended considerably to mitigate, though they can never remove?
The quote text is accurate but the meaning for it which Connelly conveys is wrong. If you look at the rest of the sentence which Connelly cut off without elipsis, Malthus is saying something positive: that human institutions do not aggravate misery but considerably mitigate (significantly reduce) it.

The topic of the paragraph -- the context -- is discussing the issue of what keeps the population down. Malthus proposes misery and fear of misery as the answer to the question: what keeps the population level low?

Malthus is not saying life is miserable. This isn't gloom. He's saying that this is an issue which is "open to our researches" -- we can figure out what's going on and do something about it. Then he further says how human institions reduce misery. So this isn't gloom, Connelly has simply taken the quote out of context and misread it.

This is rather bad considering the full paragraph (even the full rest of the sentence Connelly cut off with no indication) is enough context to see that Connelly has it wrong.

Elliot Temple | Permalink | Messages (2)

ARI's False Statistics

What could your share of the national debt buy? The Ayn Rand Institute says 5558 iPhones.

ARI is using $199.99 as the price of an iPhone (16gb 5s). That is not what iPhones cost. They cost $199 (not $199.99) when you sign a contract agreeing to pay more money later. "Bill Me Later" type plans are not lower prices. The actual price is $649, meaning you could buy 1712 iPhones for your share of the national debt. (Which is still a ton, so why fudge the numbers?)

ARI's purpose is to complain about the large US national debt. By pointing out how big it is in concrete terms like 49 cars per American, they hope to help people understand it better. Campaigning for smaller government is a good cause. It should have the truth on its side. But using bullshit stats ruins that. Please don't taint good causes with irresponsibly sloppy, false claims.

In a competition with only true claims allowed, ideas like capitalism, liberalism, science and reason can win. In a competition of who can tell the most appealing lies, true ideas lose their inherent advantage. If you want to help promote the truth, stick to rational competitions only. Don't sanction irrational truth-ignoring competitions based around the most shocking headlines, popularity, social status, etc...

Elliot Temple | Permalink | Messages (0)

Alex Epstein Scholarship Problem

Alex Epstein wrote:
In the US, 30 years ago the average household had 3 electronic devices—today it has 25, overwhelmingly thanks to fossil fuels.
For a source, he linked this youtube video from "Alphanr" (Alpha Natural Resources). It's titled "Did You Know" and has no description. It's 89 seconds long and packed full of factual claims including the one Epstein asserted, but lacks sources. It ends with a link to their website. Searching for "Did You Know" on the site to try to find extra details results in an error. Their site says, "Alpha is a leading global coal company and the world’s third largest metallurgical coal supplier". I doubt they have expertise at surveying household electronic device usage.

Sourcing your assertion to someone else's unsourced assertion isn't scholarship. It's how lies spread.

I've investigated this topic. Several studies have been done about electronic device usage in U.S. households. However, none of them would be acceptable sources. All the ones I found have a large methodological error. For example:
Of the 37 CE [Consumer Electronic] devices surveyed, the average U.S. household owns 24, the same number as last year, and spent $961 on consumer electronics over the past 12 months, down more than $200 from last year. The average adult individually reports spending $552 on CE in the past 12 months, down $100.
They are surveying how many devices U.S. households have from a list of 37 devices. That list is incomplete. The number of devices from the list that a household has is different than the number of consumer electronic devices the household has.

There is an additional problem here. When the surveys use a specific list of devices, they change it over time. Today we would expect smartphones to be on the list. Thirty years ago, they would not have been. Changing the list of which devices count means the surveys from different years are not comparable because they measure different lists.

When you pretend what's being measured is "(consumer) electronic devices", then it would make sense to compare studies from different years, because they appear to measure the same thing. But really one survey is about list A and another survey from another year is about list B, and calling the two lists by the same name doesn't make them the same thing. Epstein's comparison between the present and thirty years ago, using two different surveys of two different things, is a mistake.

I informed Epstein of these scholarship errors and he did not fix them. He should not repeat unsourced claims from Youtube that are presumably based on misusing the readily available invalid research. The truth matters.

Elliot Temple | Permalink | Messages (0)

Bad Scholarship by Ari Armstrong

http://www.theobjectivestandard.com/2014/06/homosexuality-bible-rational-morality/
The fact that the Bible advocates the murder of homosexuals (as well as the murder of “witches,” of those who worship other gods, of blasphemers, of children who “curse” their parents, of adulterers, and of non-virgins whose husbands hate them—among others) indicates that the Bible, far from being a guidebook for morality, is largely an absurd book of mindless and evil prohibitions and commandments rooted in nothing more than ancient superstitions.
In the original, six of those claims about the Bible saying to murder people are linked with sources. One is non-virgins:

http://www.biblegateway.com/passage/?search=Deuteronomy+22%3A13-22&version=ASV

What the Bible actually says is she needs to be a virgin when they marry. If a man hates his wife and accuses her of shameful things and says she wasn't a virgin when they married, then she is to be stoned. (Unless it was a false accusation and she actually was a virgin when they married, in which case the man is fined and has to keep her as a wife. I'm unclear on how it's to be decided whether she was a virgin or not using a garment.)

Armstrong said if a women is hated by her husband and a non-virgin (now), then the Bible advocates her murder. But the Bible actually only advocates her murder if her husband hates her and she was a non-virgin when they got married. The difference is her husband's taking of her virginity doesn't count against her.

After finding this scholarship error, I decided to check the other four claims using Armstrong's own links. The witches, children cursing parents, blasphemers, and adultery ones are accurate. The worshipping other gods one is wrong.

http://www.biblegateway.com/passage/?search=Deuteronomy+13%3A6-10&version=KJV

This Bible passage is saying if a family member or friend tries to "secretly" "entice" you to "serve other gods", then don't do it and kill him. So it's specifically about people who worship other gods and try to convert you. Armstrong misrepresented it.

To be clear, in none of these cases do I agree with the Biblical position.

Two misrepresentations of the Bible out of six references is a really bad error rate (33%). And this is basic stuff. Did Armstrong click on the links he gave, and read them? I'm not even sure. I don't think Armstrong should tell people they "must discard" a Bible he misrepresents and misunderstands.

Armstrong claims to offer Objectivism as a rational alternative to the Bible. But bad scholarship is irrational. Reason demands using methods of scholarship that are good at avoiding error and finding the truth. Armstrong linked this on twitter. I've tweeted him back informing him of the problem, and will update my post if he fixes his mistakes.

Elliot Temple | Permalink | Messages (0)

The New York Times Lying with Statistics

Tim Cook, Making Apple His Own from The New York Times:
By comparison, Microsoft says that, on average, it donates $2 million a day in software to nonprofits, and its employees have donated over $1 billion, inclusive of the corporate match, since 1983. In the last two years, Apple employees have donated $50 million, including the match.
The dishonest implication here is the Microsoft employees donate over 20 times as much money to charity, compared with Apple employees. Over $1 billion compared with $50 million. But the time periods compared are 31 years against 2 years. The per-year figures here (in millions) are over $32m/year for Microsoft against $25m/year for Apple, a much smaller difference.

A more meaningful comparison would compare the same time periods. It would also consider the number of employees of each company as well as their salaries. That would have made for better reporting.

The New York Times presents Microsoft's employee culture as being over 1900% more charitable than Apple's, but their own figures make the correct statistic 29%. By comparing absolute numbers from different time periods, they misled their audience by a factor of 65 in terms of the percent difference.

Elliot Temple | Permalink | Messages (0)

Bad Scholarship by Cato Institute

Cato tweeted a graph from their Human Progress project:



This graph is dishonest lying with statistics in several ways.

On the left, the numbers go from 200 to 800. These are millions of chinese people living in some definition of poverty. What happened to 0? They designed the graph so the change goes from above the top to bellow the bottom. A more accurate graph would show numbers from 0 up to China's population size (now around 1.35 billion). Cato cut off around 40% of the numbers on the left to make the graph look bigger, and leaving out 0 is a well known dirty trick.

On the right, it's even worse. The right side shows some kind of economic freedom number, from 1 to 10. But they numbered their graph from 0 to 6. They made the bottom actually go lower than is possible with their own metric. Why? To make the change from around 4.75 to 6 look way bigger than it is and to have it reach the top of the graph. A 6 out of 10 should not be at the very top of the graph! And the graph shouldn't go down to 0 when dealing with something that can only start at 1.

The graph title also suggests the graph has to do with economic freedom for the whole world by using the phrase "Economic Freedom of the World", but the graph is only about China (I think, going by how the two lines are both labelled as being for China only).

Overall, Cato is trying to show economic freedom going up and poverty going down. Eyeballing it, it looks to me like poverty went down more than economic freedom went up, using these metrics. Rather than discuss how correlated they are, or try to explain the right way to think about the issue, Cato created a grossly dishonest graph to mislead people. Cato is prioritizing shiny publicity over truth.

I also made a better chart so you can compare. For the data points, I eyeballed them from Cato's chart (not all of them, that's why it's smoother). Don't it super seriously as a fact about the world, I just wanted to see how it looked with the left and right axes fixed.


Elliot Temple | Permalink | Messages (0)

Reviewing Ann Coulter's Critics

In this post, I review criticisms and fact checks of Ann Coulter. Teal quotes are Coulter, yellow quotes are from critics, red is other stuff.

http://www.politifact.com/truth-o-meter/statements/2013/oct/16/ann-coulter/ann-coulter-says-no-doctors-who-went-american-medi/
"No doctors who went to an American medical school will be accepting Obamacare."
lol. I remember reading that. This site considers that "pants on fire" lying, and says:
Our experts say: "outrageous," "ridiculous," "ludicrous"
They are appealing to the authority of people who suck at reading comprehension. Sigh. It wasn't meant at a factual-literal statement. This criticism is stupid. They try to defend it:
We are sure the claim wasn't intended as a joke, because it's included in a bullet-point list of straightforward criticisms of the law.
I don't think these people are familiar with Coulter's style. Also on that list was
-- Merely to be eligible for millions of dollars in grants from the federal government under Obamacare, programs are required to meet racial, ethnic, gender, linguistic and sexual orientation quotas. (That's going to make health care MUCH better!)
Using sarcasm isn't what I consider a list of "straightforward criticisms" which couldn't include a joke. Ann (who is not alone in this) has often mixed serious points and humor. Just assuming she wasn't joking about this isn't a reasonable way to interpret her.

http://www.theblaze.com/stories/2013/12/12/lie-of-the-year-goes-to/

in a "lie of the year" contest, Coulter is given a runner up award because:
Conservative author Ann Coulter’s claim that “no doctors who went to an American medical school will be accepting Obamacare.” It received the “pants on fire” rating, the most extreme type of lie by PolitiFact’s rating.
Same issue again. I'm including this because I just clicked everything I saw on Google, I wanted to be thorough. Coulter was not making a literal-factual claim. she was making a correct point about how Obamacare screws up market incentives. BTW she explained in a column how she herself couldn't get any medical care she valued above $0 from any obamacare plan, so the half-joking quote doesn't even seem like much of an exaggeration.

http://www.politifact.com/punditfact/statements/2014/jan/27/ann-coulter/coulter-fox-news-broke-bush-drunk-driving-story-20/
Coulter said Fox News broke the story of George W. Bush’s 1976 drunk driving arrest. In terms of being the first to broadcast the story, that is correct.

...

We rate Coulter’s statement Half True.
So Coulter was correct, but they rate it "Half True". I don't get it. (They make some excuses about Fox News only broadcasting it first, but one of Fox's affiliates having done the research.)

http://www.factcheck.org/2009/08/when-philosophy-meets-politics/

This guy complains that Coulter dislikes Ezekiel Emanuel. Emanuel is an Obama health care advisor and a would-be philosopher. What is wrong with Coulter's position? He says Emanuel has been misunderstood and links to http://www.factcheck.org/2009/08/deadly-doctor/ Unfortunately the Youtube video with Coulter's comments is no longer available and he only quoted Coulter as saying, "Zeke Emanuel is on my death list."
McCaughey, a former New York lieutenant governor, claimed that Ezekiel Emanuel advocated that "medical care should be reserved for the non-disabled, not given to those ‘who are irreversibly prevented from being or becoming participating citizens.’ "
What did Emanuel actually say?
Emanuel, Hastings Center Report, 1996: Communitarians endorse civic republicanism and a growing number of liberals endorse some version of deliberative democracy. … This civic republican or deliberative democratic conception of the good provides both procedural and substantive insights for developing a just allocation of health care resources. … Substantively, it suggests services that promote the continuation of the polity – those that ensure healthy future generations, ensure development of practical reasoning skills, and ensure full and active participation by citizens in public deliberations – are to be socially guaranteed as basic. Conversely, services provided to individuals who are irreversibly prevented from being or becoming participating citizens are not basic and should not be guaranteed. An obvious example is not guaranteeing health services to patients with dementia. A less obvious example is guaranteeing neuropsychological services to ensure children with learning disabilities can read and learn to reason.
Sounds awful. For those who missed the meaning, he basically wants the government authorities to be in charge of healthcare and decide who gets what by deciding which healthcare services are "basic" (government provided at taxpayer expense) or not. So like, death panels. Emanuel's defense is:
Emanuel conceded that the article is "pretty abstract" and may be difficult to follow for those who are not academics, but he said that one should not then "take two sentences out of context."

"This is clearly not written in my own voice," he said. "I am not advocating this."

We’ll leave it to you to determine the merits of Emanuel’s philosophical observations. But the context makes it clear that Emanuel is describing the implications of a particular philosophical trend, not offering a policy prescription.
So his defense is that he was just writing about bad stuff, not advocating it? And also he's smarter than us, so we shouldn't try to use our own judgment. I'm not sold. Oh and the link to the report doesn't actually work. And I don't trust this site because it screws up the next issue really badly:
McCaughey also pushes the idea that Emanuel would want to ration care for seniors by quoting from a January 2009 article that Emanuel coauthored in The Lancet journal. Here, McCaughey says, he "explicitly defends discrimination against older patients."

What Emanuel and his two coauthors were actually writing about was how to decide which patients are to receive organ transplants, vaccines or other "very scarce medical interventions" when there are not enough to go around. The three authors advocated favoring younger patients over older patients as part of a "complete lives" decision-making system aimed at saving the most years of life using the available resources. Age would be only one factor, however. Also weighing in the "complete lives" system would be such factors as a patient’s likelihood of full recovery (prognosis) and the use of a lottery when deciding between two "roughly equal" patients.

The authors disputed the idea that this system discriminates against older people in the way that favoring one race or one sex over another would discriminate. "Treating 65-year-olds differently because of stereotypes or falsehoods would be ageist; treating them differently because they have already had more life-years is not." The authors stated that the complete lives system "empowers us to decide fairly whom to save when genuine scarcity makes saving everyone impossible."
So it's not OK to accuse him of explicitly discriminating against older patients because he has the excuse that he's doing it rationally instead of due to bigotry? Umm. No. Discrimination for any reason is discrimination. That doesn't necessarily make it bad, but it does make it discrimination. He did explicitly advocate treating old people differently due to their age. And, no, also considering other factors does not change that. If I discriminate against homosexuals unless they're white, thus considering multiple factors, that does not make it stop being discrimination.

If you want to do credible fact checking you can't attack factually accurate statements like this. I'm done with this guy.

Despite this guy being dumb, I found another copy of the report he brought up anyway, and took a look. It begins:

http://www.ncpa.org/pdfs/Where_Civic_Republicanism_and_Deliberative_Democracy_Meet.pdf
Is there a relationship between defects in our medical ethics and the reason the United States has repeatedly failed to enact universal health coverage?
This is politics disguised as academics. Read it if you can stomach it. He's a power-hungry statist authoritarian.

Oh and I found a copy of the video of what Coulter said.

http://www.huffingtonpost.com/2009/08/13/ann-coulter-ezekiel-emanu_n_258365.html

She was joking. Here's the quote:
"Totally ironically, Zeke Emanuel is on my death list. Hold the applause. I'm going to be on the death panel."
The assholes at factcheck.org didn't bother mentioning that Coulter was making a joke about personally being on Obama death panels, prefaced with "Totally ironically".

Again, factcheck.org quoted "Totally ironically, Zeke Emanuel is on my death list. Hold the applause. I'm going to be on the death panel." as "Zeke Emanuel is on my death list."

I guess misquoting was the only way they could come up with to attack Coulter.

http://www.anncoulter.blogspot.com

This site does not have permalinks for some stupid reason. Anyway in a section called "The Lies" we read:
Regarding the War On Terror, on page 5 and 6, Coulter makes the accusations that “[i]n lieu of a military response against terrorists abroad and security precautions at home, liberals wanted to get the whole thing over with and just throw conservatives in jail” and “[l]iberals hate America, they hate ‘flag-wavers,’ they hate abortion opponents, they hate all religions except Islam (post 9/11). Even Islamic terrorists don’t hate America like liberals do.”
Coulter having different political opinions than you does not make her a liar.
Two of the sources Coulter uses to arrive at these scurrilous conclusions are New York Times columns by Frank Rich and Bruce Ackerman. On page 5, Coulter writes, “New York Times columnist Frank Rich demanded that [Attorney General] Ashcroft stop monkeying around with Muslim terrorists and concentrate on anti-abortion extremists.”

REALITY: I checked the column Coulter cited and found that nowhere in the column does Rich even remotely suggest that Ashcroft curtail efforts against Islamic terrorists. In fact, I checked every post-9/11 Times column by Rich and found that Rich has not made any such demands of Ashcroft. This is one of Coulter’s lies that I e-mailed to Alan Colmes who interviewed Coulter last night (6/25/02) on Fox News’s Hannity & Colmes show. Colmes confronted Coulter with this. Coulter’s response: “that is an accurate paraphrase...” (For a transcript of Coulter and Colmes’s exchange, check the addendum at the bottom of this post).
ok let's see the addendum
Addendum: Partial transcript of Hannity & Colmes, June 25, 2002. Interview with Ann Coulter

Colmes : [ Quoting from Slander, pg. 5] ‘New York Times columnist Frank Rich demanded that [Attorney General] Ashcroft stop monkeying around with Muslim terrorists and concentrate on anti-abortion extremists.’ You referred to a particular column that Frank Rich wrote. He never said that in the column. He never said that Ashcroft should stop monkeying around. I can’t show you what he didn’t say because he didn’t say it. It wasn’t in the column.

Coulter: Yes, he did. I mean, I do know what the column says. No, I wasn’t quoting him precisely—

Colmes: I read it today.

Coulter: That is an accurate paraphrase—unlike his quotes of me, I might add, which are, I can show you how they are deceptive. But, no, he was specifically saying, here just so the viewers don’t have to go to the trouble of looking it up. He was specifically complaining that Ashcroft was not meeting with the head of Planned Parenthood when he was purporting to investigate terrorism. That is true and you can’t deny it.

Colmes: That’s not what you said—

[Hannity interrupts and begins to interview Coulter]
ok and what's the article say? "Planned Parenthood, which has been on the front lines of anthrax scares for years and has by grim necessity marshaled the medical and security expertise to combat them, has sought a meeting with the attorney general since he took office but has never been granted one."

so, Coulter was right? what's the problem? the article was complaining that Ashcroft didn't meet with planned parenthood when he was supposed to be dealing with terrorism. the article also said, "A close friend of George W. Bush, [Mr. Ridge] should have been in the administration from the get-go, and was widely rumored to be a candidate for various jobs, including the vice presidency. But after being pilloried by the right because he supports abortion rights, he got zilch. Instead of Mr. Ridge, the administration signed on the pro-life John Ashcroft". so the article really did focus on the abortion issue. and for those who don't know, Ashcroft was busy working on stuff like the patriot act. his resignation letter stated, "The objective of securing the safety of Americans from crime and terror has been achieved."

These people seem to consider anything an error if they don't like it and it involves any interpretation they disagree with. They ought to learn the difference between false factual statements and disagreeable (to them) opinion statements.

moving on to another website by the same guy

http://godlessanncoulter.blogspot.com
Now that it's been thoroughly established that Coulter engaged in plagiarism, not only in the book Godless but for her syndicated column
the link to the plagiarism info doesn't work. (there was also a second link but it went to a blog mainpage with no mention of plagiarism to be found)
I can only speculate but here's my hypothesis: Coulter is a mendacious and venal cynic who has no heart. As an educated person, she hardly believes her own bullshit
OK I guess this guy is just a political opponent of Coulter's who isn't doing objective analysis. done with him. let's google for plagiarism though, that sounds interesting.

http://www.dailykos.com/story/2006/07/07/225305/-Ann-Coulter-plagiarism-charges-overblown

i laughed out loud when i saw Daily Kos defending Ann Coulter from the plagiarism charges. the Kos article says all Coulter did is use some arguments she didn't come up with herself, which it considers "lazy" but recognizes isn't plagiarism. so it's like when I use arguments that Ayn Rand thought of – does studying Objectivism make me lazy? Kos links to details but the link doesn't work.

http://newsbusters.org/node/6307

the plagiarism accusation was made using software plagiarism checking. this kind of thing needs manual checking. also apparently the accuser didn't release his detailed evidence initially. An executive at Coulter's book publisher said, "The number of words used by our author in these snippets is so minimal that there is no requirement for attribution."

things get more fun as Coulter herself addresses the issue. Coulter says:

http://www.newshounds.us/2006/07/12/ann_coulter_responds_to_the_plagiarism_charges_and_neil_cavuto_helps_her_with_the_spin.php
You can't plagiarize the name 'George Bush.'
See? Fun issue. I laughed. and even more fun:
And if I'm plagiarizing I want to know who's saying all those awful thing about the Jersey Girls. Liberals can't really get it straight. Either I'm writing vile horrible books or I'm not writing vile horrible books.
lol
...[E]ven liberal lunatic Daily Kos says it's not plagiarism.
lol, similar to my reaction (except the "lunatic" psychiatry part).

discussing libel, Coulter says she won't sue, she's a public figure, people can and do say whatever they want about her. then:
Cavuto, interrupting:

Do you find that a touch ironic? You've blasted public figures all your life. They turn around and blast you and you can't do a lick about it.

Coulter:

I don't lie about them. I mean, we ought to have the same libel law, and I've always believed this, that Britain does and that is pure truth or falsity. Fine, put a cap on damages. Have a pure truth or falsity here but that is not what libel law is. You can say anything about a public figure.
Truth or falsity sounds like a good criterion for libel to me.

And, indeed, Ann does not lie about the people she criticizes. I've fact checked her, plus I did this big post you're reading right now. i've looked through her stuff and what her critics say. (let me spoil the ending for you: her critics are incompetent).

ok let's get back to wading through the less fun stuff.

http://www.spinsanity.org/columns/20030630.html
Misleading quotation and sourcing of claims

Coulter engages in a series of deceptive practices in quoting people and sourcing her claims. Most commonly, she distorts the authorship of articles she's citing. Throughout the book, she attributes outside book reviews, magazine profiles and op-eds to media outlets as if they were staff-written news reports, feeding the perception of bias on the part of these institutions. These include a New York Times Week in Review article by historian Richard Gid Powers cited as "According to the Times..." (p. 6); a Washington Post book review by Patricia Aufderheide described as "the Washington Post said..." (p. 97) and "The Washington Post called..." (p. 98); and a New York Times Magazine article by reporter Leslie Gelb cited as "the New York Times reported..." (p. 171). At one point, she cites a single Washington Post magazine article by journalist Orville Schell four separate ways (implying multiple stories to the casual reader), in one case calling it "a two-part, four-billion-column-inch Washington Post story" in which "the Post said..." (p. 92).
if you want the exact details of a cite, look it up. if someone is lazy, that is their own fault, not Coulter's. you can't expect Coulter to provide every detail about something you might be interested in, upfront. people who don't check cites are going to make mistakes no matter what Coulter does.

and why doesn't Spinsanity, so concerned about cites, give us links to the articles it's talking about?

in general, organizations are responsible for what they publish, so I don't see what's wrong with referring to it that way. Unless it's something like a letter to the editor.

when something like the Times' Week in Review or Magazine shares the website (same domain) and logo (their name in that iconic font) with the Times, they are choosing not to be a clearly separate entity. they should clearly separate their own stuff before demanding Coulter add words to her book about the separation.
Coulter also repeatedly cites quotations out of context from the original source material, implying that reporters reached conclusions that were actually presented by sources quoted in the piece. In one particularly dishonest case, she claims that the New York Times "reminded readers that Reagan was a 'cowboy, ready to shoot at the drop of a hat'" after the invasion of Grenada (p. 179). However, the "cowboy" quote is actually from a Reagan administration official quoted in a Week in Review story who said, ''I suppose our biggest minus from the operation is that there now is a resurgence of the caricature of Ronald Reagan, the cowboy, ready to shoot at the drop of a hat.''
Bringing something up (which the NYT did) does remind people about it. ok two strikes and we'll move on to the next article by the same website.

http://www.spinsanity.org/columns/20020713.html
Yet if readers can leave aside all of these problems (admittedly not an easy task), Coulter is actually driving at something important about the state of political debate in the media. She's right, for example, that left-leaning politicians and editorial pages sometimes mount sophisticated and unfair rhetorical campaigns against their political enemies. The example she chooses -- attacks against former Speaker of the House Newt Gingrich and his policies -- is exactly on point. She also chooses other examples to good effect, such as Rep. Charlie Rangel's equation of Gingrich's policies with those of Nazi Germany. Absurdly, though, she steadfastly refuses to admit that conservatives can be guilty of exactly the same thing -- an asymmetry so glaring that only the most partisan readers can accept it at face value.
Coulter is certainly not shy about criticizing conservatives. Anyway, what problems? apparently she wrote "sweeping judgements":
"Even Islamic terrorists don't hate America like liberals do."
"[T]he left is itching to silence conservatives once and for all."
"[I]f Americans knew what they [liberals] really believed, the public would boil them in oil."
""Principle is nothing to liberals. Winning is everything."
So basically the "problems" are Coulter's political ideas.
Another problem plaguing Slander is the deceptive way Coulter uses footnotes to lend a false sense of legitimacy to questionable points. To take one example, in her discussion of media treatment of former Sen. Bob Packwood, R-Ore., she provides a list of 10 quotes alternating between positive coverage prior to his political demise following allegations of sexual harassment, and negative coverage afterward. Coulter introduces the list with the claim that "What happened to Packwood is a stunning example of the media's power both to destroy and protect ... In the case of Packwood, the media's good dog/bad dog descriptions were applied to the exact same human being."

To the casual reader, the list must seem fairly damning. Yet if one flips to the back of the book and checks her sources, it turns out that her claim about "the media" rests on a very small sample. Rather than the 10 different articles the casual reader would assume Coulter is quoting, she relies on one article for four of the five negative quotes, a second for three of the five positive quotes, and a third for the other two positive quotes. In all, the list comes down to four articles -- thin evidence at best for the broad suggestion that coverage of Packwood proves "[t]here is no intellectual honesty whatsoever in media descriptions of politicians," which she makes two paragraphs later.
OK let me check the book. Coulter writes, "There are literally hundreds of news items using these words in connection with Bob Packwood." What words? "Maverick", "gadfly", "courage" and "political savvy". so why is spinsanity claiming Coulter cherrypicked a couple quotes and misled people about there being more, when she actually explicitly said there were hundreds? Why didn't they quote and investigate the much bigger claim?

I think because it's not an issue they can win, and they are scum. Google for "Bob Packwood" and each of the 4 terms. I got 10k hits for maverick, 6k hits for gadfly, 30k hits for courage, and 300 hits for "political savvy". they aren't all news items, but at a glance i can see some are. there's far more news sources for this than the four articles spinsanity dishonestly pretends is the whole story after dishonestly selectively quoting Coulter.

http://mediamatters.org/research/2009/01/07/coulter-compounds-falsehoods-in-point-by-point/146726

these guys are mad that Coulter described liberals defending evil with the word "praise". Coulter answered the issue, saying in part, "among the praise for the perpetrators of the hoax hate crime was a statement by the president of Duke in a baccalaureate address reprinted in the Duke magazine". the media matters folks screwed up the link Coulter provided, but i managed to find the article

https://web.archive.org/web/20030513015105/http://dukemagazine.duke.edu/dukemag/issues/070801/depgar.html
At your opening convocation in August 1997, I spoke on the theme of freedom -- the kind of freedom you might expect at Duke, and my advice on how to use it wisely. I also told you about some of the things you would need to grapple with, freely and responsibly, during your Duke years. One of those predictions was that race would surely matter in your lives. During your first semester, students hung a black doll in effigy on the quad to protest what they saw as our inhospitable environment for African Americans.
The issue is the black doll in effigy. Media Matters thinks this distorted picture of events (no mention that it was hung by a noose by lying scumbags) isn't praise because it was just saying race was relevant when it whitewashed a very nasty hoax. Media Matters refusing to understand what this kind of statement means does not make Coulter a poor scholar.

Next up, a little variety. I ran into a fact check of an attack on Coulter's scholarship. Read it if you want: http://lyingliar.com/?p=46

Moving on, this is amusing:

http://rationalwiki.org/wiki/Ann_Coulter
If you can find every single problem with American society and put them into one person, it's [Ann Coulter].
That's from "Rational Wiki". I'm not seeing how opening with this kind of hateful flaming is a rational approach. They don't bother trying to present a serious critical case against Coulter or fact checking her. Mostly they quote a bunch of things she said without comment, as if "rational" thinking means assuming your political views are too obvious to need explaining.

http://rudepundit.blogspot.com/2005/07/why-ann-coulter-is-cunt-part-1856.html
Why Ann Coulter Is a Cunt, Part 1856 - The Plagiarism Edition
You might have expected left-wing Coulter haters to be more sensitive to feminist issues, gender respect, or that kind of stuff. If you did, you were wrong. The left likes to lie about having such values far more than it wants to bother having them. And I already covered the plagiarism issue earlier.

also, speaking of obamacare, some people are mad about this:

http://www.anncoulter.com/columns/doug-graham.html

http://www.politifact.com/punditfact/statements/2014/feb/05/ann-coulter/ann-coulter-says-friends-sister-died/

first of all, dying from obamacare is different than dying of cancer. umm, sure, i know. also there's a blue shield issue.
But the claim that someone "died from Obamacare" because Blue Shield "completely just pulled out of California" is something we can fact-check.
ok and they do check it:
Like other insurers across California and the country, Blue Shield of California could no longer offer some health insurance plans because they did not include "essential health benefits" required by the Affordable Care Act.

These plans could not be grandfathered in under the new law. Blue Shield of California sent letters to 119,000 customers in September notifying them their current plans would end "but we can still have you covered in 2014." PunditFact obtained a sample cancellation letter from the company.
Sounds complaint-worthy to me.
The letters went to 57 percent of the insurer’s individual market customers, she said. For two-thirds of the people who lost their plan, the recommended option was more expensive, the Los Angeles Times reported.
hmm. since the complaints don't provide enough details about the Blue Shield, let's look up what their organization is like:

http://en.wikipedia.org/wiki/Blue_Shield_of_California
In 2006, Blue Shield agreed to a $6.5 million settlement relating to its alleged modifying of the risk tier structure of its individual and family health care plans. In 2008, the organization agreed to a settlement with the California Department of Managed Health Care to resolve allegations of improper rescission of individual health plan coverage. Blue Shield agreed to pay $3 million as a penalty. The organization reinstated coverage to 450 members whose plans had been cancelled and agreed to provide compensation for any medical debts incurred by these policyholders due to the rescission.
wikipedia's source link may be dead, but you can still find the source here: https://web.archive.org/web/20080721053636/http://ap.google.com/article/ALeqM5gDBLyPh2QHiIO7azoVYF9Q2TVRSwD9203RSG2
Two of California's biggest health insurers have agreed to collectively pay $13 million and reinstate more than 2,000 insurance policies to settle claims with the state that they illegally dropped policyholders from coverage.
so Blue Shield has a history of illegally dropping people's insurance. given that history, i think critics need to present a little research about the current events before we should trust Blue Shield.

But politifact basically says no one lost their insurance (but lots of people had their rates raised. but they all had spare money to pay higher rates?) so, ok, at this point do i know what happened? no not really. do Coulter's critics know what happened? i don't think so. if they do, why couldn't they write more convincing material with detailed factual information with good sources? and all this is because maybe Coulter exaggerated a bit when speaking on TV, not in writing? at worst she said Blue Shield pulled out of California over Obamacare when actually they just changed a bunch of stuff around and made things worse for more than a hundred thousand people? if this vague stuff is the best criticism of Coulter that anyone has, i'm not impressed.

finally there's this book, Soulless: Ann Coulter and the Right-Wing Church of Hate by Susan Estrich. ok i can respect that parody title, but let's see what it says. (In these quotes, bolding names of speakers in interviews and italics are from the book, bolding other stuff is my emphasis.)

It says if you want to see all of Coulter's errors documented, go to www.mediamatters.org [p10] but i'd already been there above, and i don't see anything about Coulter on their homepage, and when I do a search on the site for "Ann Coulter" it doesn't come up with some organized documentation of her errors as promised. This book is from 2006, but it's Estrich's own fault for linking a homepage and pretending it was a source of something specific.

Estrich isn't big on specifics:
[Coulter] makes you so angry sometimes that you become a mirror of her. That is her power. That's why people throw pies and nitpick footnotes. [p11]
When I fact checked Coulter footnotes, was I nitpicking? Was it because I hate Coulter? No. Scholarship matters! Well to me at least, not to Estrich.

Estrich is an angry person. It's a pattern:
I had to erase everything I wrote here, I got so mad. Better write nothing, my mother would have said. What can you say to hate? [p9]
And that's just in the first 11 pages. I tried to look for more anger in the index, but there isn't an index.

Estrich's book isn't about fact checking Coulter. It's about arguing with principles. That would be OK but the method is awful:
Social scientists argue, using polling data, that there is no culture war. Ann needs to create one in order to destroy the possibility that a decent progressive majority might triumph over the forces of hate. [p6]
The book has footnotes, but not for that factual claim about polling data. And note the appeal to the authority of "scientists" as an arguing method.

But the important thing is Estrich thinks there's no disagreement, no debate, Coulter is just inventing one. If Coulter would just shut up and stop spreading divisive hate, then America could be a calm, progressive (left-wing) country. Estrich wants to win by a method other than winning the debate.

"progressive" really does mean left-wing to Estrich, btw
[Coulter] asks: What does liberalism believe? (We're supposed to call ourselves progressives, by the way; it polls much better.) [p12]
now back to denying there are significant political disagreements:
What's clear to everyone except Ann is that the president [George W. Bush] has failed. The war in Iraq has failed. [p6]
Estrich claims everyone except Coulter agrees with "decent progressive" politics like that George W. Bush and the Iraq war were failures.

Coulter recognizes that people disagree and argues her case, strongly. I respect that.

Estrich denies that people disagree (except a few extremists like Coulter). Then instead of arguing for her political views, Estrich writes a book attacking an extremist for not having the "decent progressive" views Estrich is sure all the Americans who count would agree with her about.

You think Estrich doesn't really mean it? That she isn't trying to smooth over political debate so everyone can just agree with her? That she isn't trying to be the reasonable moderate most Americans already agree with, to Coulter's divisive extremism?
You look at every poll and what you find is a decent, moderate, tolerant nation, being torn apart by the divisive, polarizing, mean-spirited politics of a selfish few. You find that on the fundamental issues that are supposed to be tearing us apart, we're far more united than you think, and we're being divided for sport. [p2]
Estrich tries to frame things so everyone already agrees with her and there's no need to debate. Instead of debate, she'll just flame Coulter and anyone else who disagrees as a tiny mean-spirited divisive minority. Polarizing people and being divisive is bad – Estrich claims – unless you're attacking people like Coulter (or, I suppose, me).

Coulter is the intellectual here who argues her points. Estrich is the venom-spewing hater. Ironically Estrich keeps talking about Coulter with phrases like "venom [p5]", "rants [p6]", "forces of hate [p6]", "polarizing [p6]", "trades on hate for the fun of it [p2]", "mean-spirited [p2]", "selfish [p2]". Other than that last one, they all apply to Estrich more than to Coulter. (I'm not sure if Estrich has a self. If you don't understand this comment but want to, read The Fountainhead.)

Look at this attack:
... Ann uses God as a gimmick. [...] She admits this. ... [p7]
This is a flame which Estrich doesn't argue. It's just the sort of wordplay Coulter is frequently accused of doing (but actually Coulter has integrity and standards. She does something kind of similar but better). Coulter did not and would not admit to using God as a "gimmick". Coulter would never say that in her own words or agree with it, and didn't. Estrich has no evidence or argument to the contrary. But Estrich is twisting Coulter's position and paraphrasing to create something mean. Then the big problem comes when Estrich attributes her twist to Coulter. If Estrich wants to claim Coulter uses God as a gimmick, whatever, but claiming that Coulter agrees is over the line.

Bigger picture, Estrich hasn't written a serious fact-checking book and wouldn't claim she did. ("What's wrong with Ann, in my judgment, is not that she is sloppier than anybody else in the political world, but that she's meaner... [p11]").

Estrich has written a book of political rhetoric, but her methods begin by claiming she doesn't need to argue her point. She just assumes her reader already agrees with her, and if not then he must be a tiny minority of non-decent non-progressive people like Coulter. Because of this method, I don't have much to say about the book.

I disagree. If you (Estrich) want a rational debate, I'm open to that. Coulter and I accept that you disagree with us and are willing to argue about politics. When you are willing to analyze the issues instead of putting all your effort into saying that's unnecessary, get back to me.

You doubt Estrich means it this way? "... And why drop the last line, if not to fool us progressives? [p13]", "Since we think the Earth is actually precious, we have to protect it. [p13]", "She is turning us into cartoons [p14]". It's all about "the rest of us [p11]" against "Ann". And immediately preceding this assumption that all of her readers agree with her, Estrich accuses Coulter of "talking to her base [p13]".

So we're pretty much done here. I just wanted to show you one more thing about the book.
[From an interview] Lauer: Do you believe everything in this book—do you believe everything in the book, or do you put some things in there just to cater to your base?

[Estrich commenting] She really does believe them. This is the amazing but true part. Scary, but true.

Coulter: No, of course I believe everything. [p62]
When I saw this I thought maybe I could respect something about Estrich. Estrich admits Coulter means what she says. Except it turned out it was just a tactic to call Coulter "scary". A little later Estrich contradicts herself:
[This is another interview, and the question is whether the 9/11 widows would give up their celebrity, notoriety and money to have their husbands back. Colmes and Shwartz think it's obvious that the widows would make that trade. Coulter isn't sure and says:]

Coulter: I don't know. I can't read into their hearts. But it isn't as obvious to me as it apparently is to you.

[Estrich comments] How can you say this, Ann? How can anyone say it? Even if it's just for effect, how can you say it? [p76]
Part of Colmes' reply is "You've got to be kidding me. [p76]".

But it's not just for effect, Coulter is not kidding, she believes it. And I for one agree with her about the 9/11 widows.

Elliot Temple | Permalink | Messages (0)

Fact Checking Ann Coulter

I've encountered a lot of scholarship errors in books (and elsewhere) and learned to watch out for false claims. Even if a book gives a lot of footnotes, it can easily still be wrong. I often check the sources for claims, rather than trusting footnotes, and I've caught problems. I've written about the bad scholarship of the Cato Institute, the Ayn Rand Institute, the New York Times, Thomas Sowell, Robert Zubrin, Alex Epstein, Steven Mosher, Isaac Kramnick, Fred Pearce, Matthew Connelly, Robert McGee, and Ari Armstrong.

I didn't have to look for scholarship errors to find any of those. I just read things normally and investigated issues that stood out to me. With Coulter, I did the same thing when reading her books. I investigated several of her claims. The difference is, with everyone else I found an error within the first few issues I investigated. With Coulter, I never found an error, so I decided she was a good scholar.

But Coulter's weekly column rarely gives sources for its many factual claims. I find that uncomfortable. I was concerned I was being too trusting by reading her column and generally believing its facts. Plus, I disagree with Coulter on some important issues (like psychiatry). When you have substantial disagreements with someone, that indicates you think about the world in some different ways, so it's good to tread carefully. Perhaps she treats factual accuracy differently than I do (I know many people take it less seriously than me). So I decided to fact check Ann Coulter more thoroughly.

To be objective, I used a random method. I'd already tried checking things that stood out to me. This time I investigated 10 random footnotes from her books. For each one, I picked a book, then I selected a chapter with a random number generator, then I went to the footnotes for that chapter and selected one with a random number generator. Whatever was randomly chosen, I committed to investigate it and reach a conclusion, even if it was hard; reselecting any footnotes would compromise objectivity.

This is not a perfect approach. If 1% of Coulter's footnotes are mistaken, I could miss it. Maybe she approaches her columns with a different respect for scholarship than the books I'm checking (why?). Maybe she has mistakes with no footnote. If I missed something, please tell me (with specifics!). Leave a comment below or email me [email protected]

In my experience, I often find scholarship errors within the first three things I check for an author. Because errors are so common, I think a spot check like this is valuable. If you doubt how common errors are, I recommend you fact check some other authors. Plus, I've already read Coulter's books and checked a few claims I found suspicious, so adding random checking provides good variety and objectivity. And, while reading, I already had the opportunity to spot claims in her books that should have a footnote but don't, or notice other issues.

I checked 10 randomly selected footnotes from 5 Ann Coulter books. For each one, I present my analysis below and I score Coulter's scholarship from 0 to 5 points. Her final average score was 5, which is perfect. (I decided on the scoring system before I started.) I found no scholarship errors. Well done!

In addition to fact checking Coulter myself, I also reviewed other people's criticism and fact checking of Coulter. Click through for details; in summary, their own scholarship was terrible. Also, my friend fact checked one random Coulter cite I gave him, which was correct.

Demonic: How the Liberal Mob Is Endangering America

Cite: Chapter 12: 29. Lynn Sweet, “Dems Seek Strategy Against ‘Birthers,’ ” Chicago Sun-Times, August 5, 2009.
The Democratic National Committee called the Tea Party movement “rabid right-wing extremists” and “angry mobs.”29
(Yellow quotes are from Coulter's books, teal quotes are from her sources, red indicates other quotes.)

Here, Coulter has given two quotes. I found the article here. It has the text Coulter quoted:
The Obama-controlled Democratic National Committee is portraying its foes as on the political fringe, accusing "Republicans and their allied groups" of "inciting angry mobs," calling them "a small number of rabid right wing extremists."
The only difference is Coulter added a hyphen in "right-wing". I think that's a reasonable English style change, not a misquote.

The article's source is the author personally speaking with Democratic Senator Dick Durban and providing quotes. Good.

Score: 5/5

Cite: Chapter 15: 25. Eric Metaxas, Bonhoeffer: Pastor, Martyr, Prophet, Spy (Thomas Nelson, 2010), 170–71.
Reminiscent of France’s “Cult of Reason,” the Nazis planned to replace Christianity with the “Reich Church,” based on a 30-point plan drawn up by Nazi leader Alfred Rosenberg. Crosses were to be stripped from churches, cathedrals, and chapels and replaced by the swastika. Bibles, crucifixes, and saints would be forbidden from the altars, which would instead display a copy of Mein Kampf and a sword.25 (If they had thought of it, they might have put Christ in a jar of urine.)
I got the book. Page 170 says:
Rosenberg was an "outspoken pagan" who, during the war, developed a thirty-point program for the "National Reich Church."
Five of the thirty points are given in the book on page 171. Coulter gets everything right:
18. The National Church will clear away from its altars all crucifixes, Bibles and pictures of Saints.

19. On the altars there must be nothing but Mein Kampf (to the German nation and therefore God the most sacred book) and to the left of the altar a sword.

30. On the day of its foundation, the Christian Cross must be removed from all churches, cathedrals and chapels ... and it must be superseded by the only unconquerable symbol, the swastika.
But what about this book's source? I was worried for a second because there's no footnotes. But it does have endnotes with sources, they just go by page number and brief quotes rather than by footnote number. There are five reasonable-looking sources given for pages 170-171.

And if you search for this material on Google you get lots of hits with these points, some of which give more sources. For example:
(The Rise and Fall of the Third Reich, by William L. Shirer, p. 240 in some editions, p. 332 in others. Chapter headed "Triumph and Consolidation", subsection "The Persecution of the Christian Churches")
He even checked the page numbers for different editions! That Shirer book is actually one of Bonhoeffer's sources. Let's see if there are any Amazon reviews criticizing Shirer's scholarship. There are 16 1 star reviews out of 930 reviews. Looking through them:
This review is not of the excellent scholarly work of William Shirer but of the Kindle version of this book
The serious flaw in this book is the extremely poor editing by the publisher [for the Kindle version]
The book is excellent..a classic. There is a problem with the new audiobook service and the Kindle Fire HD.
Lots of 1 star reviews are either about problems with the e-book or the audio book. One guy wants to defend Nietzsche from charges of anti-semitism, but I didn't find his comments persuasive. Someone says Shirer's book is outdated and there is new information available, but doesn't point out specific mistakes. Someone even says:
The simple fact is if I want an anti Nazi soapbox filled with opinion and no facts, I will read a political blog or something along those lines.
Shirer's book is anti-Nazi? Fine with me. These Amazon reviews look like what you would expect for an accurate book that offends a few people. I'm giving Coulter full credit.

Score: 5/5

High Crimes and Misdemeanors: The Case Against Bill Clinton

Cite: Chapter 4: 9 John M. Broder, “Testing of a President: The Investigation,” New York Times, March 7, 1998.
Jordan told the grand jury that he personally gave the president regular progress reports on his efforts to get Lewinsky a job. He partially confirmed Clinton’s statement that Betty Currie was the one who referred Lewinsky to him. Yet he also explained that he assumed the referral was made at the president’s request.9
Here's the article.
Mr. Clinton, in his deposition, acknowledged talking to Mr. Jordan about finding a job for Ms. Lewinsky. And Mr. Jordan has told his lawyers and the grand jury that he personally kept the President up to date on his job search efforts.

...

Mr. Jordan has said that it was Mrs. Currie who referred Ms. Lewinsky to him. But his attorney, William G. Hundley, said this week that Mr. Jordan assumed that Mrs. Currie was acting at the President's behest.
The footnote does have the material for all three of Coulter's sentences, and she presented it accurately. A problem I've seen before is a section of text makes multiple claims and then gives a footnote for one of the claims. Then the other claims have no source. But Coulter did it right.

Score: 5/5

Cite: Chapter 12: 6 Investigators for the Senate Judiciary Committee, which held hearings on “Filegate” in 1996, discovered this.
This was not the sort of thing that tended to promote the appearance of innocent bungling. In addition, a six-month gap in the log used to sign out the sensitive files from the White House Security Office was never explained. One page of the looseleaf log ends on March 29, 1994, and the next page picks up again with September 21, 1994.6
I'm not very happy with this cite because it doesn't give any source to look up. But there is information online:
(e) Secret Service entry logs indicate Craig Livingstone's access to the White House residence when he had no logical reason for being there, other than perhaps to share FBI files with its occupants. Indeed, a "check out" log of FBI files from his office shows a six (6) month "gap" -- from March 29, 1994 to September 21, 1994 -- where there are no entries, reminiscent of the eighteen (18) minute gap in the Nixon tapes during Watergate. See Secret Service Entry Logs, attached as Exhibit 9.
Looks like Coulter had it right. I'm still not happy about the lack of a source I could directly check, but I'm hesitant to subtract any points when she was factually correct. To resolve this, I searched for newspaper articles from the time. If it was common knowledge, then I'll give her full credit.

LA Times:
Sen. Orrin G. Hatch (R-Utah), chairman of the Judiciary Committee, called the gap troubling and asked former White House aide D. Craig Livingstone to explain missing entries in the log between March 29, 1994, and Sept. 21, 1994.

...

"There was a period of time evidently that the log wasn't kept," Livingstone testified.
Well, OK, Livingstone admitted it himself, in Senate testimony, and it was in a major newspaper. And it's not that hard to find, even 18 years later.

Score: 5/5

Mugged: Racial Demagoguery from the Seventies to Obama

Cite: Chapter 14: 62. Mark Hosenball, “The Death-Threat Debate,” Newsweek, October 27, 2008. Available at http://www.thedailybeast.com/newsweek/2008/10/18/the-death-threat-debate.html.
The Obama campaign responded to Newsweek’s inquiries about the candidate’s lie by saying that even if the report wasn’t true, “what is true is that the tone of the rhetoric at McCain–Palin campaign events has gotten out of hand.”62
I like cites with URLs! Coulter's quote exactly matches the webpage. The source is, "An Obama campaign spokesman told NEWSWEEK". Looks good.

Score: 5/5

Cite: Chapter 15: 18. Mark Mooney, “Obama Aide Concedes ‘Dollar Bill’ Remark Referred to His Race,” ABC News, August 1, 2008. Available at http://abcnews.go.com/GMA/Politics/story?id=5495348&page=1#.T_bYV45Sbao
Maybe he’d be the first Hawaiian on a dollar bill. Apparently, there were limits to the press’s credulity and eventually, the Obama campaign admitted that, yes, the dollar bill line was about race.18
Another URL, and another correct cite. Easy one.
But Obama's chief strategist, David Axelrod, acknowledged on "Good Morning America" Friday that the candidate was referring, at least in part, to his ethnic background.

When pressed to explain the comment, Axelrod told "GMA" it meant, "He's not from central casting when it comes to candidates for president of the United States. He's new to Washington. Yes, he's African-American."
Score: 5/5

Cite: Chapter 4: 33. Jim Dwyer, “Race Victim’s Mom: I Wanted a Better Life for My Kids,” (New York) Newsday, January 8, 1992.
The only definitive proof that the paint attacks were hoaxes was that the police, the mayor and the New York Times suddenly dropped the subject, never mentioning the white-paint attacks again. Needless to say, there would be no investigation into whether the alleged victims had wasted police resources by falsely reporting a crime.

The shoe-polish hate crime had made the front page of the New York Times and the cover of New York Newsday in massive in-depth interviews with the “victims.” The Times’s story, titled “Victim of Bias Attack, 14, Wrestles with His Anger,” was 1,228 words long.32 Newsday’s account, written by the most easily fooled journalist in America, Jim Dwyer, clocked in at 1,016 words and was titled “Race Victim’s Mom: I Wanted a Better Life for My Kids.”33 The racist attack was talked about in France, Toronto, Seattle, Chicago, on the MacNeil Lehrer NewsHour, in endless stories on National Public Radio and still today, in Anna Quindlen’s living room.
I quoted a lot in this case to make the context and issue clear. This article is tough to find. The only thing Google found was from Coulter's book. Archive.org found nothing. Newsday's website search is broken. Searching for the author "Dwyer" brings up a bunch of sports articles that give an error when clicked on. Jim Dwyer may have won a Pulitzer Prize while at Newsday, but their link to his articles is broken.

But I eventually managed to find it. Coulter's cite is correct except for two punctuation changes. The version I found online has the apostrophe moved to the wrong place and has quotes around the dialog from the mother:
Race Victims' Mom: `I Wanted A Better Life For My Kids'
I don't see a meaningful problem. And the visible text of the article fits what Coulter was talking about.

Score: 5/5

Slander: Liberal Lies About the American Right

Cite: Chapter 2: 3. Editorial, Las Vegas Review-Journal, January 14, 2002.
The California Coastal Commission was forced to intervene to demand that the Hollywood left stop blocking access to the beach. Steve Hoye, former head of the Malibu Democratic Club, expressed shock at the arrogance of what he called "some of the best, most liberal people in Malibu."3
The issue here is the Hoye quote. Although the Las Vegas Review-Journal deleted the article from their website, the Internet Archive still has a copy:
"Some of the best, most liberal people in Malibu turned their backs on me over this issue," said Steve Hoye, former head of the Malibu Democratic Club and now a champion of open beaches, to the Los Angeles Times.
I think their source is this L.A. Times article. Coulter's quote is correct.

Score: 5/5

Cite: Chapter 8: 12. Jo Mannies, "Bradley Touts New Book, Ideologies; Public Trust Tops Priorities in New Appeal," St. Louis Post-Dispatch, February 9, 1996, p. 1C.
The St. Louis Post-Dispatch described Bradley's run-of-the-mill, tax-and-spend liberalism as "his cerebral approach to politics."12
The article is behind a paywall. I paid.
His personal disclosures, in the book and in interviews, are a departure for Bradley, a private man known for his prowess in basketball and his cerebral approach to politics.
Coulter's quote is correct.

Score: 5/5

Treason: Liberal Treachery from the Cold War to the War on Terrorism

Cite: Chapter 6: 78. Lawrence Van Gelder, "Harold Cammer, 86, Champion of Labor and Rights Lawyer," New York Times, October 25, 1995; William Glaberson, "F.B.I. Admits Bid to Disrupt Lawyers Guild," New York Times.
The New York Times has variously referred to the Guild as "a nation-wide organization noted for its concern with liberal causes and civil rights" and "a national lawyers organization that has long been associated with the labor movement and liberal causes."78
These articles were easy to find and the quotes are correct. Harold Cammer, 86, Champion of Labor and Rights Lawyer:
Mr. Cammer was also a founder and active member of the National Lawyers Guild, a nationwide organization noted for its concern with liberal causes and civil rights, as well as a volunteer lawyer in the civil rights movement in the South in the 1960's.
F.B.I. Admits Bid to Disrupt Lawyers Guild:
The Guild, a national lawyers organization that has long been associated with the labor movement and liberal causes, was tarred for years with charges that it was a "Communist front" organization.
Ann added a hyphen in "nation-wide". That's fine. Otherwise the quotes are exact.

Score: 5/5

Congratulations to Ann Coulter for her perfect score. It's great – and too rare – to see high quality scholarship.

EDIT: I want to be extra clear about a misconception some readers have had. Of course checking random cites is not comprehensive. First, I checked anything that stood out to me as suspicious or interesting, like I do with everyone. Other people never pass that phase 1 checking. Then for phase 2, I checked random cites for Ann Coulter as a supplement. I wanted to be extra hard on Coulter, rather than treat phase 1 checking as adequate. Coulter passed both phases, her rivals all failed in phase 1.

Elliot Temple | Permalink | Message (1)

Bad Scholarship by Wall Street Journal

The Wall Street Journal (WSJ) doesn't care about scholarship like accurate quoting. They write:
According to an abstract of the study, "for people who had positive content reduced in their News Feed, a larger percentage of words in people's status updates were negative and a smaller percentage were positive. When negativity was reduced, the opposite pattern occurred."
They link the study and the abstract doesn't say that. They made that quote up. It's a paraphrase, not a quote, but it's in quote marks. And more confusing, the ending words, "... reduced, the opposite pattern occurred.", are a quote.

It's cool that they are linking a source, but they need to learn to actually take quotes from the source, instead of fabricating them.

Instead of misquoting the study, the WSJ should have tried thinking about the study. For example:
Data from a large real-world social network, collected over a 20-y period suggests that longer-lasting moods (e.g., depression, happiness) can be transferred through networks [Fowler JH, Christakis NA (2008) BMJ 337:a2338], although the results are controversial.
The WSJ could have questioned the wisdom of letting these researchers toy with hundreds of thousands of users in order to produce a paper with a grammar error in the abstract. There should be a comma after "period". This isn't a minor point. The sentence would be confusing enough with the comma, and is harder to understand without it.

On the one hand, I wouldn't expect a publication that misquotes papers (which they could trivially copy/paste from correctly) to notice this. But on the other hand, I don't think they should report on things they don't understand.

Or here is a part of the study that maybe the WSJ would understand:
As such, it was consistent with Facebook’s Data Use Policy, to which all users agree prior to creating an account on Facebook, constituting informed consent for this research.
Instead of misquoting, the WSJ could have accurately quoted this part (it's not very hard, I used copy/paste) and questioned whether it's really "informed consent" when most of Facebook's users have never read Facebook’s Data Use Policy.

How can people give informed consent to something they haven't read? That's the sort of issue newspapers are often better at discussing.

Or maybe the WSJ could put their efforts towards useful commentary on this part, instead of lying about what the study says:
First, because News Feed content is not “directed” toward anyone, contagion could not be just the result of some specific interaction with a happy or sad partner.
The WSJ could have pointed out something interesting and useful here. They missed the opportunity to mention that this is completely false – some News Feed posts are directed at specific individuals. I rarely read Facebook, but I've seen people post stuff directed at a specific individual (this shouldn't be particularly surprising). (How many? I don't know. The study doesn't know either, they just stupidly assumed none are. Apparently Facebook is too far away from their ivory tower to ever read anyone's News Feed.)

There's so much great stuff to discuss here, but the WSJ would rather destroy their own credibility than provide useful commentary.

The WSJ did try to say something worthwhile, but they messed it up. They wrote:
The emotional changes in the research subjects was small. For instance, people who saw fewer positive posts only reduced the number of their own positive posts by a tenth of a percent.
Looking at how big an effect we're talking about is important, and helps put the study findings in context for readers. However, this is factually incorrect and not what the study says. It's bad scholarship again. The study actually said:
When positive posts were reduced in the News Feed, the percentage of positive words in people’s status updates decreased by B = −0.1% compared with control [...]
People who saw fewer positive posts reduced their own positive posting by 0.1% more than the control subjects did.

The WSJ should try hiring people who know how to read and understand studies – and who don't fabricate false quotations – if they want to report on studies.

Note: The article provides a contact email. On 2014-07-02, I explained the two clear factual errors (fabricated quote and misunderstanding of what paper said) and asked about fixing them. No reply. (I'll update my post if I receive a late reply.)

Providing a contact email implies being open to discussion and correction. It implies there is a path forward. If one isn't actually willing to make corrections, it's dishonest.

Elliot Temple | Permalink | Messages (0)

Bad Correlation Study

Here is a typical example of a bad correlation study. I've pointed out a couple flaws, which are typical.

http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3039704/
Chocolate Consumption is Inversely Associated with Prevalent Coronary Heart Disease: The National Heart, Lung, and Blood Institute Family Heart Study
These data suggest that consumption of chocolate is inversely related with prevalent CHD in a general population.
Of 4,679 individuals contacted, responses were obtained from 3,150 (67%)
So they started with a non-random sample. The two thirds of people who responded were not random.

This non-random sample they studied may have some attribute, X, much more than the general population. It may be chocolate+X interactions which offer health benefits. This is a way the study conclusions could be false.

They used a "food frequency questionnaire". So you get possibilities like: half the people reporting they didn't eat chocolate were lying (but very few of the people admitting to eating chocolate were lying). And liars overeat fat much more than non-liars, and this fat eating differential (not chocolate eating) is the cause of the study results. This is another way the study conclusions could be false.

They say they used "used generalized estimating equations", but do not provide the details. There could be an error there so that their conclusions are false.

They talk about controls:
adjusting for age, sex, family CHD risk group, energy intake, education, non-chocolate candy intake, linolenic acid intake, smoking, alcohol intake, exercise, and fruit and vegetables
As you can see, this is nothing like a complete list of every possible relevant factor. There are many things they did not control for. Some of those may have been important, so this could ruin their results.

And they don't provide details of how they controlled for these things. For example, take "education". Did they lump together high school graduates (with no college) as all having the same amount of education, without factoring in which high school they went to and how good it was? Whatever they did, there will be a level of imprecision in how they controlled for education, which may be problematic (and we don't know, because they don't tell us what they did).


This is just a small sample of the problems with studies like these.


People often reply something like, "Nothing's perfect, but aren't the studies pretty good indications anyway?" The answer is, if it's pretty good anyway, they ought to understand these weaknesses, write them down, and then write down why their results are pretty good indications anyway. Then that reasoning would be exposed to criticism. One shouldn't assume the many weaknesses of the research can be glossed over without actually writing them down, thoroughly, and writing down why it's OK, in full, and then seeing if there are criticisms of that analysis.

Elliot Temple | Permalink | Messages (0)

Leftist Lying: The Issue Is Never the Issue

From Take No Prisoners: The Battle Plan for Defeating the Left by David Horowitz, on leftist lying:
Dishonesty is endemic to the progressive cause because its radical goals cannot be admitted; the dishonesty is a cultural inheritance, instinctive and indispensable. It is no coincidence that Barack Obama, a born-and-bred leftist, is the most compulsive and brazen liar ever to occupy the White House. His true agenda is radical and unpalatable, and therefore he needs to lie about it. What other presidential candidate could have successfully explained away his close association for twenty years with an anti-American racist, Jeremiah Wright, and an anti-American terrorist, William Ayers? Who but the ignorant and the progressively blind could have believed him?

The radical sixties were something of an aberration in that its activists were uncharacteristically candid about their goals. A generation of “new leftists” was rebelling against its Stalinist parents, who had pretended to be liberals to hide their real beliefs and save their political skins. New leftists despised what they thought was the cowardice behind this camouflage. As a “New Left,” they were determined to say what they thought and blurt out their desires: “We want a revolution, and we want it now.” They were actually rather decent to warn others about what they intended. But when they revealed their goals, they set off alarms and therefore didn’t get very far.

Those who remained committed to leftist goals after the sixties learned from their experience. They learned to lie. The strategy of the lie became the new progressive gospel. It is what Alinsky’s Rules for Radicals is really about. Alinsky understood the mistake sixties radicals had made. His message at the time, and to the generations who came after, is easily summarized: Don’t telegraph your goals; infiltrate the Democratic Party and other liberal institutions and subvert them; treat moral principles as dispensable fictions; and never forget that your political agenda is not the achievement of this or that reform but political power to achieve the socialist goal. The issue is never the issue. The issue is always power—how to wring power out of the democratic process, how to turn the political process into an instrument of control, how to use that control to fundamentally transform the United States of America, which is exactly what Barack Obama, on the eve of his election, warned he would do.
I recommend the book.

Though beware, some of the scholarship is flawed. Justin brought this passage to my attention:
In the fifth year of Obama’s rule, forty-seven million Americans were on food stamps and a hundred million were receiving government handouts, while ninety-three million Americans of working age had given up on finding a job and left the work force.
The ninety-three million statistic is given without a source. I investigated a bit and I don't think it's accurate.

But I still think it's a great book.

Elliot Temple | Permalink | Message (1)

Bad Scholarship About Apple

http://stratechery.com/2015/bad-assumptions/
last quarter Apple’s revenue was downright decimated by the strengthening U.S. dollar; currency fluctuations reduced Apple’s revenue by 5% – a cool $3.73 billion dollars. That, though, is more than Google made in profit last quarter ($2.83 billion). Apple lost more money to currency fluctuations than Google makes in a quarter.
Italics in the original.

The sentence in italics uses the word "money" to refer to, at the same time, Apple's revenue and Google's profit.

I emailed the blog author, as well as John Gruber pointing out the error. If either of them corrects it, I will update this post to give them credit. Will anything be fixed or will they be added to the long list of people with bad scholarship? Let's find out!

Update: Ben Thompson of Stratechery replied to my email. He refused to fix anything and expressed that he was unhappy with me for even bringing it up. He said, "my only reason to use the two numbers is to give a sense of scale", and he thought that was obvious and unobjectionable. This is bullshit. It's not OK to call profit and revenue both "money" at the same time and italicize that misleading sentence. And he's lying to me that his "only reason" for choosing Google to compare Apple with was a sense of scale. I hope you learn a double lesson about 1) how terrible Ben Thompson is personally 2) how terrible many people are, you really have to watch out. Lots of people can seem OK if you never challenge them. But if you do challenge them, their awfulness is revealed. Don't go through life blindly assuming the best about people and leaving them untested.

Just before reading that, I saw this other bad scholarship about Apple:

http://daringfireball.net/linked/2015/01/27/zabitsky

Gruber quotes an interview with market analyist who was very negative on Apple stock. I think it's really great how the Daring Fireball blog follows up on disagreements. It's important to look at ideas in retrospect and see who was right and wrong, and why, and learn from mistakes. When predictions are made made on timescales of a few years or less, it's not that hard to hold people accountable, and yet it isn't done nearly enough.
You have a $270 price target. Is that still too pessimistic?

Zabitsky: It’s formally a one-year target, but in 3 to 6 months we’re going to see that play out. The reason I started to make noise was the rise of Samsung. If you say that now, it’s not challenged.
Apple announced spectacular earnings results yesterday. The most profitable quarter of any company ever. Despite that 5% revenue loss to foreign exchange rates mentioned above. So Zabitsky was badly wrong. That's Gruber's point.

I wanted to add that I don't think it's a coincidence that the same guy who is strongly anti-Apple, and wrong, is also very loose with scholarship. He publishes a one-year price target for Apple, then says, "But I don't really mean what I say when I publish formally. That's really my 3-6 month target, and I published it as a 1-year target because I casually lie in formal predictions."

Apple is good. Many people hate Apple because they hate the good. Their immorality has other consequences than being anti-Apple. Dishonesty is unsurprising. (And note this dishonesty is a lot more severe than the one I criticize above from pro-Apple people. The one above I think is bad but fairly normal. This one about doing formal publications and casually not meaning what you say, I think is really fucking bad.)

Elliot Temple | Permalink | Messages (0)

Jihad Watch and Pamela Geller Misquote Obama

Jihad Watch has run this headline:
Obama: Iran has “no aspiration to get a nuclear weapon” because “it would be contrary to their faith”
Pamela Geller has a similar headline:
Obama: Iran Won’t Pursue Nuclear Weapons Because It’s ‘Contrary to Their Faith’
I don't like Obama and don't normally defend him. But this is false, and scholarship comes first. Obama says enough bad things, there's no need to misrepresent what he said and take quotes out of context. It isn't helping anything. It hurts our cause to get things wrong.

The truth needs to come first, and attacking the left second. Attack them when they're actually wrong, not just as a universal policy. And pay attention to the truth so you know when they're wrong, instead of just assuming they always are. Please.

What Obama actually said was, paraphrasing: Iran claims to have no nuclear aspirations because it'd be contrary to their faith, and if Iran is telling the truth about this then they'll be happy to accept Obama's political deal.

Obama didn't say it'd be contrary to their faith for Iran to get a nuclear weapon, nor did Obama say Iran won't try to get a nuclear weapon. The Jihad Watch and Pamela Geller headlines make both of those false claims.

Obama saying Iran claims something that may or may not be true, and Obama believing it himself, are completely different.

Obama was actually careful to emphasize that it was just Iran's claim. Obama used the phrases, "And if in fact what they claim is true" and "if that is true" and "But we don’t know if that’s going to happen." Three times in one paragraph, Obama made it clear that he was talking about Iran's claims which may or may not be true. Yet Jihad Watch ignores that and lies about what Obama was saying.

Here is the full paragraph that Jihad Watch is talking about, which Jihad Watch is well aware of (they included this text at the end of their article):
And if in fact what they claim is true, which is they have no aspiration to get a nuclear weapon, that in fact, according to their Supreme Leader, it would be contrary to their faith to obtain a nuclear weapon, if that is true, there should be the possibility of getting a deal. They should be able to get to yes. But we don’t know if that’s going to happen.
As you can see, in an epic scholarship fail, Jihad Watch and Pamela Geller grossly misrepresented what Obama said.

Update: I contacted Spencer and Geller by blog comments, twitter, and email. Except Spencer's email button is broken. My blog comment made it through moderation at Jihad Watch, but at Geller's site it isn't showing up and new comments on the post have been approved after mine, so I may have been censored (to make matters more confusing, her blog software is buggy and sometimes reports a post has different numbers of comments in different places, and my comment showed up on the sidebar as a new comment even when it wasn't visible on the post and the link didn't work). Spencer and Geller were at their computers tweeting and it's been hours, and it hasn't been fixed yet. This kind of thing is urgent because most readers see posts when they are new. So after waiting, I just tweeted David Horowitz too, and let them know with the Front Page Mag contact form. Someone better care. I'm going to lose a lot of respect for them if this isn't fixed. I will update again if anything happens.

Update 2: It's the next day and nothing has improved. I think my comment on Geller's cite was censored. My comment on Jihad Watch was flamed by two people. Nothing has been fixed. This is very sad.

Update 3: I've lost hope. No error correction. Very sad. David Horowitz and associates are now on my Scholarship Watchlist. Someone should fact check them with the same format I used for Ann Coulter (and also the regular way of checking things you find suspicious).

Update 4: When reading a new article, I noticed Geller's site says this above the comments:
Comments at Atlas Shrugs are unmoderated. Posts using foul language, as well as abusive, hateful, libelous and genocidal posts, will be deleted if seen. However, if a comment remains on the site, it in no way constitutes an endorsement by Pamela Geller of the sentiments contained therein.
My blocked post did not have foul language, and it wasn't abusive or hateful, and certainly not genocidal. So what happened to it? The site policy is a lie.

Update 5: 2018-06-20

A few years later I had Robert Spencer's attention on Twitter and had a couple small, positive interactions. He was paying attention to various critics and repeatedly asked them for actual quotes to back up their negative claims about him. So I linked him to this post which explains a genuine error of his with a quote. He responded once to deny there was any error and then ignored me after that:
Sorry, those quotes look like...quotes to me, and represent the news item accurately.

Elliot Temple | Permalink | Messages (4)

Proposal to Alter Graph Misleadingly



The graph @asymco tweeted is normal enough. Focus your attention on the reply from @Spiff.

The reason some of the revenue data looks compressed on the current revenue scale is because it is. Trying to change that is trying to mislead viewers.

What @Spiff proposes is an example of How To Lie With Statistics. He's intentionally trying to make the graph look different than it normally would to meet an agenda of his and give the viewer a different impression.

His tweet may seem innocuous but it's really bad. He's a bad scholar wannabe. Stuff like this is not OK. Bar graphs for typical quantities should use a linear scale, starting at 0, unless there's a damn good reason to do otherwise. If you do something else, the bars are no longer proportional to each other in the intuitive way, so it misleads viewers.

For example, suppose the graph started with revenue at $50,000,000 instead of 0. Then all the bars would be shorter. This would make the smaller bars shorter by a large percentage, and make them look even shorter compared to the big bars. That'd be really bad! When someone looked at it and thought "this bar is twice as big as this other bar", that would no longer be a valid way of reasoning due to not starting at 0.

Or suppose the graph used a log scale like @Spiff proposed. A log scale mean the revenue would be labelled like $0, $1, $10 $100, $1000, instead of like $0, $10 million, $20 million, $30 million, etc... See how misleading that could be? What it means is, again, when someone compares the sizes of the bars he gets the wrong idea. When he thinks, "This bar is about 20% higher than the bar before it", he's being played for a fool.

Don't play people for a fool. Don't try to trick them. Don't have an agenda for how you want your graph to look and then adjust things to achieve it. Just make a simple graph that makes sense and then leave it alone and let it speak for itself. Tinkering with your graph as @Spiff proposes is dishonest (or clueless and still harmful).

Scholarship, please.

Update: @asymco says:
Share prices are frequently graphed using log scales by default. I don't condone the practice.
I'm sad to hear how common bad scholarship is. That's terrible. But I'm glad @asymco understands this and does a better job. Thumbs up to him! Here's @asymco's blog which I read regularly.

Update 2: @Spiff now agrees with my point about log scales (I think).

Update 3: Here is an example of a very bad article advocating bad use of log charts. It looks mainstream and has a tone of sharing uncontroversial knowledge.

Elliot Temple | Permalink | Messages (0)

Pamela Geller Misreports Amnesty International

So there I was trying to correct Pamela Geller's poor scholarship for the second time. Then this happened:

http://pamelageller.com/2015/03/amnesty-international-palestinians-committed-war-crimes-killed-more-palestinian-civilians-than-israel.html/



If you have difficulty reading the picture, it says I was blocked from commenting on her site. Here is the full text of what I tried to tell her about the article:
Title:
> Amnesty International: Palestinians Committed War Crimes, Killed more Palestinian civilians than Israel

Text:
> Amnesty International said Thursday that Palestinian rocket fire during the 2014 summer war in Gaza had killed more civilians in the Gaza Strip than in Israel.

These do not match. Killing more civilians "than Israel" and "than in Israel" are different things.

The title means: Palestinians killed more Palestinian civilians than the number of Palestinian civilians that Israel killed.

The text about what Amnesty said means: Palestinians killed more Palestinian civilians than the number of Israeli civilians that Palestinians killed.

Please get the story right. These kinds of details are very important.
An important and helpful comment, right? It's a big difference whether Amnesty said anything about how many civilians Israel killed, or didn't discuss that at all. Well, it turns out she blocked me from commenting after I tried to correct a previous error she made... (Which she did not fix.)

Sad.

Elliot Temple | Permalink | Messages (0)

David Deutsch's Mistaken Philosophy and Scholarship

https://twitter.com/DavidDeutschOxf/status/590279039170043904
One should study philosophy only if addressing an originally non-philosophical problem forces one to.
Stay the fuck away from philosophy unless forced.

jfc

Once upon a time, DD promised me he’d write a good book about TCS before he died – I raised the issue because he intentionally left out major important TCS type ideas from FoR and BoI. He lied to me.

also DD misquoted Popper (C&R p95 for me in paper, i checked both paper and ebook, his text does not match popper’s text. it’s chap 2, section III, near start). and dropped italics which isn’t OK either. and DD’d replaced “which arise” with “[from]” just b/c of tweet length limit. (actually just to fit italics he’d have to drop the period on the end, no problem, and the space after the colon, ugh lol. but he still should have done that)

https://twitter.com/curi42/status/590295170651791360

get an ebook and stop inserting typos into what are supposed to be exact quotes. (Popper: “philosophize”. DD supposedly quoting Popper: “philosophise”.)

DD also omitted the quote source. presumably cuz of tweet length limit. it's still his responsibility.

Elliot Temple | Permalink | Messages (0)

Elliot Temple | Permalink | Messages (0)

Bad Study Claims Lawyers are Racist

Written in Black & White

Exploring Confirmation Bias in Racialized Perceptions of Writing Skills
This is a paper about bias which claims lawyers are racist. But they don't know what bias is:
CONFIRMATION BIAS: A mental shortcut – a bias – engaged by the brain that makes one actively seek information, interpretation and memory to only observe and absorb that which affirms established beliefs while missing data that contradicts established beliefs.
Some mental shortcuts, like some shortcuts while driving, are good ideas. They can be time savers. This is a stupid definition of what a "bias" is.

Some mental shortcuts work, and are valuable. Others don't. It's important to try to figure out which are which. And an unbiased person can make a mistake evaluating whether a particular mental shortcut works well.

Shortcuts don't make one do anything. They are options but can't control you.

The idea of a bias making someone do something makes more sense than a shortcut controlling a person, but is still mistaken. One way to see it's mistaken is to consider that sometimes a person recognizes he's biased and doesn't obey the bias.

The dictionary doesn't know what a bias is either:
a tendency to believe that some people, ideas, etc., are better than others that usually results in treating some people unfairly
Is the belief rational? This definition doesn't care.

I believe Objectivism is better than most rivals one might compare it with. But some anti-Objectivists believe I treat them unfairly in discussion by not conceding that Ayn Rand is a monster.

Recognizing something is superior isn't automatically bias. Some things are superior. Bias has to do with irrationality: e.g. believing something is superior for bad reasons you are unwilling to reconsider.
The partners were originally given 4 weeks to complete the editing and rating, but we had to extend deadline to 7 weeks in order to obtain more responses.
The study changed the rules midway in order to reach different conclusions than it would have if it followed the original plan.
we deliberately inserted 22 different errors
Maybe the response rate was worse than expected because people weren't thrilled about editing an essay containing 22 deliberate errors. I wonder how realistic the errors were, and why they didn't use a real research memo. Using an artificial memo adds an extra source of error: it could be poorly designed.
Name: Thomas Meyer

Seniority: 3rd Year Associate
Alma Mater: NYU Law School
Race/Ethnicity: African American
Half the participants saw the same headings except with "Caucasian" instead of "African American". I see a danger here that people would find it strange to be told the Race/Ethnicity of the author of what they are reading, and therefore act differently than in regular life.

One possibility is some people saw this was a transparent attempt at a racism study and gave a reply to manipulate the results according to their political preference. Others might decide not to participate when they see this. It's important the participants don't know it's a racism study, but this is a big clue.

An even bigger issue here is there was no control group which received memos with no Race/Ethnicity heading. Wouldn't a control group be a good idea?
There was no significant correlation between a partner’s race/ethnicity and the differentiated patterns of errors found between the two memos. There was also no significant correlation between a partner’s gender and the differentiated patterns of errors found between the two memos.
What about the partner's political party? His age? Or a million other things.

Why are race/ethnicity and gender the two things they looked at? It's plausible that one major US political party is more racist than the other one. And it's plausible that old people are more racist than young people.
In order to create a study where we could control for enough variables to truly see the impact of confirmation bias, we did not study the potential variances that can be caused due to the intersection of race/ethnicity, gender, generational differences and other such salient identities.
How does ignoring the age of participants make the study better controlled?
The exact same memo, averaged a 3.2/5.0 rating under our hypothetical “African American” Thomas Meyer and a 4.1/5.0 rating under hypothetical “Caucasian” Thomas Meyer.
This is their main point: they claim lawyers are racist.
We undertook this study with the hypothesis that unconscious confirmation bias in a supervising lawyer’s assessment of legal writing would result in a more negative rating if that writing was submitted by an African American lawyer in comparison to the same submission by a Caucasian lawyer.
What about conscious bias? They explicitly said the race. A participant could consciously notice.
When expecting to find fewer errors, we find fewer errors. When expecting to find more errors, we find more errors. That is unconscious confirmation bias. Our evaluators unconsciously found more of the errors in the “African American” Thomas Meyer’s memo, but the final rating process was a conscious and unbiased analysis based on the number of errors found.
This is a story which isn't contradicted by their study. Many other stories also aren't contradicted by the study. Why are they concluding this particular story? For example, the evaluators could have had conscious bias. Saying it's unconscious bias is just making up a story about what happened.

Other things could be going on. Maybe the writing style of the memo was culturally white. Then the people told it had it had a white author would just read it and nothing special happens. But the people told it had a black author might notice the clash between the white style and the black author claim. This could get them to wake up and pay more attention because there was something unexpected or surprising or interesting about the memo. They could then have found more errors simply because they were more awake while reading.
When partners say that they are evaluating assignments without bias
Wait, were they asked if they were racist? Wouldn't that give away what kind of study it was? Or was that only done afterwards? Why wasn't the procedure explained?

In any case, wouldn't you expect a lot of conscious racists to lie? So people claiming they aren't racist doesn't differentiate between conscious and unconscious racists very well.

Conclusion

The paper is too light on details, and has too many errors, to make a big deal out of. If racism is a big problem, it shouldn't be that hard to do a high quality study to show it. I would expect that already to have been done, given the intense interest in this topic.

So, people claiming racism is a big problem: where is that high quality study? Link me to it or tell me why it hasn't been done yet.

Addendum

At the end of the paper there is some extra stuff like brags about how the people doing the study are biased. They get paid to teach people to be less racist. Their study is marketing for their services. Is that sad or is it amusing? I don't know. I want to point out one more error:
EXAMPLE: In one law firm where we found that minority summer associates were consistently being evaluated more negatively than their majority counterparts, we created an interruption mechanism to infuse the subjective with objective. We worked with the firm to create an Assignment Committee, comprised of 3 partners through whom certain assignments were distributed to the summer associates and through whom the summer associates submitted work back to the partners who needed the work done. When the work was evaluated, the partners evaluating the work did not know which associate had completed the work. The assignments for this process were chosen judiciously, and there was a lot of work done to ensure buy-in from all partners. At the end of the summer, every associate had at least 2 assignments that had been graded blindly. The firm then examined how the blind evaluations compared with the rest of the associate’s evaluations and found that the blind evaluations were generally more positive for minorities and women and less positive for majority men.
It could be that people give better evaluations to their friends. And it could be that of the new employees, white men have the best social skills, due to different upbringings. So they make friends with the people doing the evaluating the best, and then get the best evaluations when it's not blind. But when there's blind evaluations, the social skills are irrelevant.

This is merely a story I made up. The point is it's possible. What happened in the example could involve racism by lawyers, or not. That the study authors only think about how their material is compatible with racism happening, but don't consider and discuss the non-racist explanations that account for it, shows their own selective attention, which they would call "bias".

[I wrote this post in one hour.]

Elliot Temple | Permalink | Messages (6)

The Parable of the Vases

Ann Coulter tweeted a bunch of praise for A Review of Hive Mind: How Your Nation’s IQ Matters So Much More Than Your Own today. She told people to buy the book. And she indicated her agreement with the "parable of the vases" .

I disagree with the parable. Here it is:
The parable begins with a simplifying assumption. This is that it takes exactly two workers to make a vase: one to blow it from molten glass and another to pack it for delivery. Now suppose that two workers, A1 and A2, are highly skilled—if they are assigned to either task they are guaranteed not to break the vase. Suppose two other workers, B1 and B2, are less skilled—specifically, for either task each has a 50% probability of breaking the vase.

Now suppose you are worker A1. If you team up with A2, you produce a vase every attempt. However, if you team up with B1 or B2, then only 50% of your attempts will produce a vase. Thus, your productivity is higher when you team up with A2 than with one of the B workers. Something similar happens with the B workers. They are more productive when they are paired with an A worker than with a fellow B worker.

So far, everything I’ve said is probably pretty intuitive. But here’s what’s not so intuitive. Suppose you’re the manager of the vase company and you want to produce as many vases as possible. Are you better off by (i) pairing A1 with A2 and B1 with B2, or (ii) pairing A1 with one of the B workers and A2 with the other B worker?

If you do the math, it’s clear that the first strategy works best. Here, the team with two A workers produces a vase with 100% probability, and the team with the two B workers produces a vase with 25% probability. Thus, in expectation, the company produces 1.25 vases per time period. With the second strategy, both teams produce a vase with 50% probability. Thus, in expectation, the company produces only one vase per time period.

The example illustrates how workers’ productivity is often interdependent—specifically, how your own productivity increases when your co-workers are skilled.
This is a dirty math trick (using the prestige and authority of math to trick people about a non-math issue) and the author doesn't explain what's going on. The different results are due to different amounts of idle vase-packing labor. In one scenario, A2 sits around doing nothing half the time (a loss of .5). In the other, B2 sits around doing nothing half the time (a loss of .25). A2 sitting idle is a bigger loss. That's all it is. Both potential pairings have a total of 1.5 value. They come out to 1 or 1.25 simply based on whether .25 or .5 value is sitting idle.

This can easily be fixed by hiring more appropriate labor ratios. If you have vase packers sitting idle, hire more vase blowers. You basically want two B workers doing vase blowing for each vase packer, not 1-to-1. They will on average produce one vase per vase-blowing cycle for the packer to work on. Then everything works out OK and, basically, you get the expected results: that 50% efficient workers are worth half as much as 100% efficient workers. (That's ignoring cost of materials, transaction costs to hire more people, needing a bigger factory to fit more workers, etc. When you factor all that stuff in, then yes one 100% efficient worker is better than 2 50% efficient workers. That's not what this parable is about, though).

(This is all on the assumption that people are simply assigned one job and stick to it, and that A1 and B1 do the vase blowing and A2 and B2 do the vase packing. If the packers would simply do some extra blowing when there's nothing to pack, that would also solve the problem and ruin the parable in the same way that hiring more blowers than packers would ruin the intended result.)

It's not efficient workers working with inefficient workers that's wasteful in general. It's people sitting around doing nothing that's wasteful. The parable hides people having time spent idle which is where the entire mathematical difference is coming from.

The book reviewer is very impressed with his bad parable:
To illustrate the latter effect, Jones’s constructs an example, which I call “the parable of the vases.” In a moment I’ll explain the details of the example, but first let me briefly discuss its importance. The example has significantly affected my thinking, and it is one of the highlights of the book. I do not think it is an exaggeration to say that the parable ranks as one of the all-time great examples in economics. Although it is not quite as insightful and important as Ronald Coase’s crops-near-the-train-track example (which illustrates the efficiency of property rights), I believe it is approximately as insightful and important as: (i) Adam Smith’s pin-factory example (which illustrates the benefits of division of labor) and (ii) Friedrich Hayek’s example of an entrepreneur knowing about an unused ship (which illustrates the value of particular, versus general, knowledge).
This kind of bragging about something that's wrong and misleading is not very notable. What was notable to me was that Ann Coulter was fooled and thought it was a good point.
The example generates an even more remarkable implication. It says that, if you are a manager of a company (or the central planner of an entire economy), then your optimal strategy is to clump your best workers together on the same project rather than spreading them out amongst your less-able workers.
I actually do agree with something like this conclusion, although I don't consider it remarkable at all. But the parable of the vases is a bad argument. A good argument covering part of this issue is The Mythical Man-Month.

I'd add that this point about mixing workers applies to peers. Putting a better worker in a leadership and management role interacting with inferior workers does make sense.

So I propose that instead of bringing in lots of low skill workers here, we should encourage a few top quality Americans to emmigrate and be leaders that run the governments and major businesses of other countries.

Elliot Temple | Permalink | Messages (13)

Daring Fireball Misquotes Yankees

Apple blog Daring Fireball posted bad scholarship today:
YANKEES PRESIDENT CALLS COMCAST ‘GUTLESS’

DSLreports:
“It’s a typical gutless act by a cable carrier seeking to promote its own self-interest,” Levine told the NY Daily News. “This amounts to nothing more than a money grab. Comcast, who said it had an agreement in principle with YES, is saving millions of dollars now by not airing YES in the offseason.”
Calling one of Comcast's acts gutless is not calling Comcast gutless.

This kind of sloppiness with the facts is inexcusable. I know it's not the most serious, scholarly blog in the first place, but that's no excuse for misquoting people. And it's a news site which gets access to some Apple press conference invites and review units of new products, so it should at least not post things which are blatantly, factually false.

The false Daring Fireball title is a truncated version of the linked article's title which has the same mistake. So DSL Reports also messed up too, but that's no excuse.

I contacted Daring Fireball about the error and will update this post if it's fixed or there's a response.

Elliot Temple | Permalink | Message (1)

STD Scholarship

Scholarship for STD risks and test accuracy is extremely bad. The information on this topic is awful.

One paper on HSV IgG (herpes, many cases of which are called "cold sores") testing stood out to me because it had a good section:
Summary of Test
1. Prepare 1:51 dilutions of Calibrator(s), Controls and samples in the test set Diluent. Mix well.
2. Place 100 μl of the dilutions in the Coated Wells; reserve one well for the reagent blank.
3. Incubate at room temperature for 30 ± 5 minutes.
4. Drain wells thoroughly. Wash wells 4 times with Wash Solution and drain.
5. Place 2 drops (or 100 μl) of Conjugate in wells.
6. Incubate at room temperature for 30 ± 5 minutes.
7. Drain wells thoroughly. Wash wells 4 times with Wash Solution and drain.
8. Place 2 drops (or 100 μl) of Substrate in wells.
9. Incubate at room temperature for 30 ± 5 minutes.
10. Stop the enzyme reaction with 2 drops (or 100 μl) of Stop Reagent.
11. Read absorbance at 405 nm against reagent blank.
It's great to specify details like washing 4 times and the 5 minute error margins on incubation times.

This is much better than most "scientific" papers I've seen which do not give repeatable procedures for doing the experiment with this sort of detail. I think maybe it's because herpes testing is actually repeated a lot (to test many different people), whereas most scientific experiments are only done once or a few times.

No excuses though. All science should meet this sort of standard or higher. (Honestly it's really not that hard or amazing. This shouldn't be unusual.)

But later the paper says something awful:
A negative serological test does not exclude the possibility of past infection. Following primary HSV infection, antibody may fall to undetectable levels and then be boosted by later clinical infection with the same, or heterologous virus type. Such an occurrence may lead to incorrect interpretations of seroconversion and primary infection, or negative antibody status. [my emphasis]
Heterologous is a prestigious word meaning, basically, it's a different strain of the virus.

So they are saying something may later be boosted by infection with the same virus or a different virus. Why would you say it could be either the same or different? And why present that like it's a fancy, complex point requiring sophisticated and hard-to-read language? They are using fancy words like "heterologous" but I think they didn't really think through what they are actually trying to say. The content is confused and confusing.

And the comma after "the same" is incorrect grammar. They're trying to write in a fancy way but are getting the basics wrong. This is written to impress and intimidate people, not to communicate.

The authors are more interested in sounding like smart medical researches than actually communicating effectively.

This reminds me of a Richard Feynman story:
There was a sociologist who had written a paper for us all to read – something he had written ahead of time. I started to read the damn thing, and my eyes were coming out: I couldn’t make head nor tail of it! I figured it was because I hadn’t read any of the books on that list. I have this uneasy feeling of “I’m not adequate,” until finally I said to myself, “I’m gonna stop, and read one sentence slowly, so I can figure out what the hell it means.”

So I stopped – at random – and read the next sentence very carefully. I can’t remember it precisely, but it was very close to this: “The individual member of the social community often receives his information via visual, symbolic channels.” I went back and forth over it, and translated. You know what it means? “People read.”
Another interesting part of the paper was the data that around 70% of adults have herpes (and another roughly 15% test ambiguous, and 15% negative). This is in line with other sources I've seen. The result is that most STD testing skips herpes (unless there's a visible lesion), even though it's a common STD! Many doctors discourage blood tests for herpes. Some clinics or government run healthcare services don't do herpes blood testing at all, or refuse it to most people. People sort of act like herpes is too common to worry about, so just don't make any effort to avoid infection. No doubt this attitude contributes to so many people having herpes. (You may want to consider getting a herpes test. Herpes is contagious some of the time even if you have no visible sores.)

On a related note, many people who "get tested" for STDs don't even pay attention to which STDs they've been tested for. Lots of people are promiscuous without giving much thought to what STDs exist, what tests exist, how good the tests are, how long things take to show up on the tests with what accuracy, etc. (People are also extremely reckless about believing their partners' claims about safety. People lie to their spouses about their sexual activities, so believing someone you're hooking up with – who has to say how safe s/he is to get laid – is pretty foolish.)

Many people also think if they use a condom that is "safe sex" and they don't really have to worry about anything. This is stupid and dangerous. Using condoms doesn't make you immune or take away the value of thinking about what you're doing, researching STDs, etc. (I think one of the reasons STD information is so bad is that no one cares. People don't try to research this stuff in any kind of reasonable way. At most they just find some doctor saying don't worry about something, or assume percentages over 90 are high, and go back to their social life. For example, lots of people seem to think 97% is a high and safe accuracy for an HIV test. I'm not even joking. For fucking HIV, 97% is not something to treat as plenty safe!)

Elliot Temple | Permalink | Messages (0)

Bad iPad Screen Size Scholarship

Displaymate.com has a lengthy article which appears to look at iPads in great detail. It presents itself as a rigorous comparison which a large amount of work was put into. It gives the impression that they dealt with all the details, carefully, so you don't have to. And it presents factual information which you are intended to believe is true.

An example statement they make is,
we examine in-depth the LCD displays on the Apple iPad mini 4, the iPad Air 2, and iPad Pro based on objective Lab measurement data and criteria.
Lab measurements! They sure put a lot of work into getting everything right. Didn't they?

But people suck at dealing with details. They may well have tried hard, but they have presented false information as if it were a fact. Here's the relevant part of their fact chart:



What caught my attention was the claim that iPad Air 2 is 7.8 inches tall while iPad Pro is 7.7 inches wide. I remembered Apple saying the Air's height and Pro's width matched during a presentation about new multitasking features. (As I remember it, Apple basically said you can fit a whole iPad Air on the pro screen and then have an area left over to the side for a second app.)

So I thought, huh, Apple fudged it. I thought they'd present an exact match here, but actually it's just pretty close.

But then I noticed the number of pixels does exactly match. The Air is 2048 pixels tall. The pro is 2048 pixels wide.

And the Pixels Per Inch exactly matches too at 264.

But if you have the same number of pixels, and the same number of pixels per inch, then the number of inches should also match. The chart contradicts itself.

So how many inches is it? Assuming the pixels and pixels per inch are correct then it's: 2048/264.0 = 7.757575 repeating.

So the actual value is between the 7.7 and 7.8 inches given, and a little closer to 7.8. Both numbers should have been rounded up to 7.8 inches since that's closer.

I wouldn't mind so much if both numbers were rounded the same direction, either way. But getting the same number in two adjacent boxes on your chart, and then rounding one up and the other down, is really not OK. This is a factual error caused by a methodology error. Whatever one's policy for rounding numbers, the same policy should be used for the entire article.

I emailed the article author and will update this post if it's fixed. The article did invite comment. As usual, I understand that mistakes can happen. We'll see if he's willing to fix it. Willingness to fix mistakes, or not, is even more important than making mistakes, or not, in the first place.

Update 2015-12-03:

They replied:
You have incorrectly assumed that both displays have exactly the same 264.0 ppi in order to calculate their width and height. This is a technically weak assumption.

We used the published screen size to calculate the width and height. Both methods are subject to a round off error of the Apple published specifications, but ours is the more technically sound one because it only assumes that the displays have square pixels, which is true for all current high-end displays to very high precision.

A 2732x2048 pixel 12.9" screen is 7.74" by 10.32" which is 7.7 x 10.3 as published

A 2048x1536 pixel 9.7" screen is 7.76" by 5.82" which is 7.8 x 5.8 as published
So they did it by assumption, not lab measurement. And they did the calculation using Apple's tenths of diagonal inches number as exact, even though it's easy to guess that's rounded. Basing their numbers directly on Apple's rounded tenths of diagonal inches is not a reasonable way to end up publishing that two things which are basically the same length are a tenth of an inch apart.

The 264 PPI number from Apple is also rounded, but it could still easily be that the displays Apple gives the same PPI number for are actually made in the same way and have the same PPI. PPI is not something Apple would want to manufacture in lots of slightly different variants, they'd prefer reuse. (If Apple was fine with slightly different PPIs, you'd often see PPI numbers that are a couple apart, rather than different by at most a rounding error, but you don't see that in Apple's lineup.)

So I still think DisplayMates are mistaken and their article is unreasonable. And I think it's bad to publish seemingly contradictory numbers without saying the methodology you used so that readers can judge for themselves if it's reasonable. And they've refused to change this.

Elliot Temple | Permalink | Messages (0)

curi reads a correlation study

This is my real-time unedited (just formatting cleanup) comments on an "original research article" in Frontiers in Systems Neuroscience, "Valproate reopens critical-period learning of absolute pitch".

anonymous-1 wrote:
study says drug can help learn perfect pitch:

http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3848041/pdf/fnsys-07-00102.pdf
they claim it's double blind, but doesn't someone being able to do something he otherwise couldn't (they claim) tell him which group he's in and therefore unblind it?

> On days 8–14 of each treatment, we instructed participants to undergo an on-line training program for approximately 10 min per day. During each online training session, they observed a video, which trained associations between piano tones and proper names.

so it could actually be a drug for better boring video watching focus?

oh god they put ppl thru a bunch of junk tests to try to control for mood, depression, mania, being smart

> We counted a training session as complete if the subject both watched the full length of the video (up to within 15 s of the end) and answered the subsequent test question correctly.

did they decide those rules before they started?

> There was no significant correlation between the number of completed training sessions and performance

hahaha

> The experiment was double-blind, as neither participants, nor experimenters knew the randomization for treatment conditions. However, we did ask participants to intuit in which arm they received VPA treatment, and why they thought so. We also instructed them to write down any side effects they experienced during the experiment. Out of the 18 participants who completed the second treatment arm, 17 guessed correctly.

hahaha i told you it wasn't blind

fucking liars

they found out during the study it was not blind

then publish it as a blind study

what scumbags


i think the prior study asserting the critical period exists at all might be more interesting. at least if it's any good. b/c i find a critical period a bit intuitively surprising. like i wouldn't rly expect it

> Second, the analysis of the crossover, i.e., of the 17 participants for whom we have data from both arms, revealed an order-dependent effect of treatment. For participants who took VPA first, AP performance was significantly higher after VPA treatment than after placebo. In contrast, for participants who initially took placebo, there was no such difference. It may be that carry-over effects impeded performance on the AP task in the second treatment arm.

that's odd

> Relatedly, it needs to be noted that we did not test how long the effect of the improvement in AP perception lasted.

so they did not study learning perfect pitch. they studied doing better on certain tests while actively on drugs, but not any kind of longer term skill improvement. so the study title:

> Valproate reopens critical-period learning of absolute pitch

that's bullshit. they didn't study that.

> In sum, our study is the first to show a change in AP with any kind of drug treatment. The finding that VPA can restore plasticity in a fundamental perceptual system in adulthood provides compelling evidence that one of the modes of action for VPA in psychiatric treatment may be to facilitate reorganization and rewiring of otherwise firmly established pathways in the brain and its epigenome (Shen et al., 2008).

wow such bullshit

like it's bad enough they are claiming it creates plasticity for pitch stuff – maybe it just makes u better at pitch without plasticity? among other things – but then to start saying they found out about psychiatry... ugh
the big picture tho is this is explanationless "science". they don't know what VPA does or how it works, and they are focusing on correlations (btwn taking VPA and high scores on pitch tests) not explanations

> If confirmed by future replications, our study will provide a behavioral paradigm for the assessment of the potential of psychiatric drugs to induce plasticity. In particular, the AP task may be useful as a behavioral correlate. If further studies continue to reveal specificity of VPA to the AP task (or to tasks on which training or intervention is provided), critical information will have been garnered concerning when systemic drug treatments may safely be used to reopen neural plasticity in a specific, targeted way.

i think they are saying here that they have no idea if VPA (their drug) has anything to do with pitch, or just helps learning more generally

the intended use for approving psychiatry drugs is disturbing

Refuting the study like this took under 20 minutes. Then people discussed the point about whether the study was blind:

anonymous-1:
    How does that make it not double-blind?
curi:
    if you know what group you're in, that isn't blind.
    do you know what blind means? *confused*
anonymous-1:
    but you don't know, you guess
curi:
    they could tell which they were in
anonymous-1:
    they guessed which they were in
curi:
    so you think 17 out of 18 got it right by coincidence, and there was no unblinding information?
anonymous-1:
    still blind?
    they weren't told until after the study
    this is a standard thing in psych studies to find out whether the person can guess about placebo?
curi:
    if you can guess better than chance, then you have information about which group you're in (or ESP). that information means it's not fully blind. in this case they appear to have quite a lot of such info.
    "standard thing in psych studies" is not reassuring!!!
Justin Mallone:
    ya lol
    psych studies typically trash
anonymous-1:
    not by coincidence, by stuff like feeling the drug
curi:
    right, that makes it not blind.
anonymous-1:
    so yes no unblinding info
curi:
    feeling it is unblinding info
anonymous-1:
    you don't know for sure though
    hmmm
    why should that be considered unblinding?
curi:
    but if you know (from feeling it) better than chance, you know something about whether you have the placebo or not. you have information about it (just not PERFECT information if you don't know for SURE). so it's not fully blind. (and, again, they seem to in this case have had LOTS of info, so not close to blind)
Justin Mallone:
    doing double blind can be hard
curi:
    yeah in medical studies they sometimes use complex active placebos to try to make stuff blind
Justin Mallone:
    the fact that lots of stuff is done incompetently doesn’t lower the bar tho
curi:
    like try to find stuff that'll have the same side effects and other feelable consequences
anonymous-1:
    oh cool @ complex active placebos
    didn't know about that. makes sense

Elliot Temple | Permalink | Messages (0)

Adios America Fact Check

I fact checked Adios, America: The Left's Plan to Turn Our Country into a Third World Hellhole by Ann Coulter.

Method: I randomly selected 5 chapters. For each chapter, I selected a random endnote to check. I used a random number generator. Aftewards, I personally selected 5 more issues to check. I chose issues I thought were important like the number of illegal immigrants in the US.

I scored each issue up to 100% based on scholarship, not politics. Coulter's average score across 10 checks was: 87.5%. But that's just a quick overview. My main focus was on checking the details and explaining why she was right or wrong.

Endnote quotes are blue, quotes from the main book are green, and other quotes are yellow. Bold in quotes was added by me for emphasis.

Chapter 13, Endnote 33

32. Congressional Budget Office, “Migrants’ Remittances,” 10.

33. In surveys, 70 percent of illegal immigrants from Mexico say the money they send home is used exclusively for consumption; 96 percent say it is used for both consumption and savings. Ibid.
The majority of the money sent by immigrants to Mexico is used for “consumption”—i.e., to buy Carlos Slim’s telephone service, shop at Carlos Slim’s department stores, and eat in Carlos Slim’s restaurants.33
It was easy to find page 10 of the pdf online:



The 70% figure matches the report. This means the book text, which says "majority", is correct.

96% is the sum for either consumption only, or both consumption and savings. Coulter's wording is confusing. It sounds like she's saying 96% remit for both purposes, when actually 70% were remitting for consumption only. What she should have written, and presumably meant, is that 96% remit at least partially for consumption.

Note that Coulter says "In surveys". I appreciate that accuracy. She isn't saying this is actually true, it's just a survey result.

I wouldn't take off points for Coulter just writing in her style which isn't always literal. But I think this is an actual wording error in an endnote, not a style choice to entertain readers. However, there's no serious error which would mislead a reader about what's happening in world affairs. It's just a technical wording error in an endnote. It doesn't meet my ideal standards, but it doesn't really hurt the book either.

Score: 85%.

Chapter 3, Endnote 23

23. David North, “Lessons Learned from the Legalization Programs of the 1980s,” ILW.com, http://www.ilw.com/articles/2005,0302-north.shtm; and David S. North and Anna Mary Portz, The U.S. Alien Legalization Program (Washington, DC: TransCentury Development Associates, June 1989), 82–90.
Under the special agricultural amnesty of the 1986 bill, the INS received nearly one hundred thousand applications from “farmworker” illegal aliens living in the lush, fertile farmland of New York City. Another hundred thousand applications were mailed in directly from Mexico.23
From Coulter's link:
In the first place, IRCA’s objective was to offer legal status primarily to people who were in the United States at that time that they applied. There was a minor exception to that in that some 100,000 or so of the 3,000,000 applicants were allowed to file for SAW status at the southern border or at U.S. consulates in Mexico—but they had to claim that they had previously been in the United States doing a sufficient amount of farm work to qualify.
Many an urban resident claimed SAW status, many without justification. There were countless anecdotes of fur-coat wearing Europeans seeking SAW status in Manhattan, applicants who contended that the cotton they harvested was purple, or that cherries were dug out of the ground, or that one used a ladder to pick strawberries.
100,000 people is a "minor exception"? And the policy was to let them file from Mexico if they simply claimed to be legit? Dumb. But Coulter said the applications were "mailed" from Mexico, whereas this talks about applying at the border or a consulate.

And what about the 100,000 "farmworker[s]" applying from New York City? Let's check the cited book. It discusses some ridiculous fraud similar in spirit to what Coulter wrote. But page 83 contradicts Coulter:
there were 28,889 applications filed in New York City
That's not "some 100,000". Page 89 is also relevant:
There were some 118,000 applications filed outside the U.S., all but a handful in Mexico.
The number is right. But this says "filed", not "mailed", so I think Coulter exaggerated on that point.

The gist of what Coulter says in this part of the book is roughly accurate. There was a lot of fraud and the government did a bad job. But she wrote 100k and cited a book which says 29k. That's simply false. However, it doesn't mislead the reader. If she simply changed the number, her passage would be OK. 29k and 100k are both big numbers, so the general idea is correctly communicated. I really don't like errors, but it's only a technical error, so I'm giving half credit.

Score: 50%.

I tweeted Coulter about this error, but received no response. I'd be happy to raise Coulter's score if she acknowledged the error and corrected it for the next edition.

Chapter 2, Endnote 16

15. See, e.g., William Branigin, “INS Accused of Giving In to Politics; White House Pressure Tied to Citizen Push,” Washington Post, March 4, 1997.

16. See ibid.
A year before the 1996 presidential election, the Clinton administration undertook a major initiative to make 1 million immigrants citizens in time to vote. The White House demanded that applications be processed twelve hours a day, seven days a week. Criminal background checks were jettisoned for hundreds of thousands of applicants, resulting in citizenship being granted to at least seventy thousand immigrants with FBI criminal records and ten thousand with felony records.15 Murderers, robbers, and rapists were all made citizens so that the Democrats would have a million foreign voters on the rolls by Election Day.16
From the article:
It is not clear how many of the 180,000 immigrants whose criminal backgrounds were not checked had criminal records that would have disqualified them from being sworn in as U.S. citizens, but at least some felons have slipped through. Among them were an Ecuadoran wanted for murder and a Vietnamese immigrant who faced deportation for two felony convictions and a recent parole violation.
So that's at least one murderer, and presumably more in the other 180,000 people who didn't get a background check. No doubt that's enough people with no criminal background check to include some robbers and rapists too.
While murder has always disqualified an applicant no matter when it was committed, other serious crimes such as robbery or assault could make someone ineligible if they were committed within five years of the application.
And to make matters worse, they weren't even trying to exclude robbers and thugs who commited their major crimes 5 years ago.
The auditors also found that another 71,000 immigrants were granted citizenship despite having criminal histories on file with the FBI. Of them, about 10,800 were charged with felonies.
This article, which complains several times about Republicans, is conceding everything. Since it's a hostile article – this is what Coulter's opponents are actually willing to admit to – I'm going to accept these numbers.

180k is close enough to "hundreds of thousands". It rounds up to 200k. The 70k and 10k figures are good. The murders, robbers and rapists claim is good.

Score: 100%.

Chapter 15, Endnote 28

28. Sarah Stuteville, “Hate Crimes Inflict Fear That May Never Fade,” Seattle (WA) Times, February 27, 2015, http://www.seattletimes.com/seattle-news/crime/hate-crimes-inflict-fear-that-may-never-fade/.
They will no longer be subjected to “hate crimes and discrimination” in America—as put by Pramila Jayapal, who was born in India, but now represents Seattle in the Washington State House.28
I appreciate endnotes which provide the link to the material.
Hate crimes and discrimination comes from a lack of understanding and information about who these populations are, as well as a desire to target and other-ize people,” says Washington state Sen. Pramila Jayapal, who was founder of Hate Free Zone (now OneAmerica), an organization formed after 9/11 to address backlash against immigrant communities.
The Seattle Times is a perfectly reasonable source for quoting what someone said. Jayapal was indeed born in India.

Score: 100%.

Chapter 14, Endnote 10

9. Behar, “The Secret Life of Mahmud.”

10. Ibid.
Luckily for Mahmud, just as his tourist visa was expiring six months later, Schumer’s farmworker amnesty became law. So Mahmud submitted an application, claiming to have worked on a farm in South Carolina, despite having never left New York, except one short visit to the Michigan Islamic community.10
Happily, Coulter actually links the article in a previous endnote.
Six months after [Mahmud] Abouhalima arrived in New York, his tourist visa expired. Fortunately for him, Congress was preparing to authorize an amnesty program for more than 1 million illegal aliens who merely had to assert that they worked as migrant farmers. Abouhalima applied for amnesty in 1986, received temporary legal residence in 1988 and became a permanent resident two years after that. Through an attorney, Abouhalima now claims he worked for seven months on a farm in South Carolina. But his current wife told a TIME reporter that she can remember no travels outside the New York metropolitan area except for one trip to Michigan to visit friends. "The amnesty program was a joke," says Duke Austin, a spokesman at the Immigration and Naturalization Service. "Since documentation wasn't required, the burden was on the government to prove the aliens were not farmers. Fraud was widespread and enforcement virtually impossible."
Time reports Mahmud's own wife told a Time reporter that Mahmud's a liar. There was no checking by the government, no need for documentation. Everything Coulter writes matches her source. Looks good to me.

Score: 100%.

Selected Checking

That concludes the random endnote checks. Now I'll choose 5 major issues to look at:

How many illegals?

There were 11 million illegals in the United States as of 2005, according to everyone. Thus, for example, the pro-browning Pew Hispanic Center estimated the number of illegal aliens in the United States to be 11.1 million in March 2005.26 The Department of Homeland Security put it at 10.5 million in January 2005.27 Other estimates from the New York Times, the Center for Immigration Studies, the Urban Institute, and the Current Population Survey produced similar numbers.28
Each endnote offers a link. 26:



27:
DHS estimates that the unauthorized immigrant population in the United States numbered 11.6 million in January 2008 compared to 11.8 million in January 2007, 11.3 million in January 2006, 10.5 million in January 2005
28:
The latest estimate is that the United States has 11.5 million undocumented foreigners, and it's those immigrants — the illegal ones — who have galvanized Congress.
That last quote is from the New York Times, from 2006 not 2005. But close enough. It does reflect that the NYT thought there were "similar" to 11 million illegals in 2005.
The reason all the estimates from Pew, DHS, CIS, the Urban Institute, and the Current Population Survey are nearly identical—11 million!—is that they all use the same census data.
THE REAL NUMBER IS 30 MILLION ILLEGALS [Coulter's emphasis, it's a section title.]
There’s good reason to believe the census numbers are wrong. In 2005, two Bear Stearns analysts, Robert Justich and Betty Ng, warned clients that there was “significant evidence” that the census undercounted the illegal immigrant population by at least half.29 They estimated the number at closer to 20 million—and they were advising clients about something important: their money.

Justich and Ng discounted the census data because it relied on illegal aliens answering surveys.
29. Robert Justich and Betty Ng, “The Underground Labor Force Is Rising to the Surface,” Bear Stearns Asset Management, January 3, 2005, http://www.steinreport.com/BearStearnsStudy.pdf.
The report has some reasonable points:
The strongest evidence supporting our theory that the actual illegal population is double the consensus estimates lies within several micro trends at the community level. We see very dramatic increases in services required in communities that have become gateways for immigration.
Based on several criteria, we believe that immigration is growing significantly faster than the consensus estimates:
1. Remittances
2. Housing permits in gateway communities
3. School enrollment
4. Cross border flows
The rate of increase in remittances far exceeds the increases in Mexicans residing in the U.S. and their wage growth. Between 1995 and 2003, the official tally of Mexicans has climbed 56%, and median weekly wage has increased by 10%. Yet total remittances jumped 199% over the same period. Even considering the declining costs of money transfers, the growth of remittances remains astounding.
In New Jersey, the three gateway towns of New Brunswick, Elizabeth, and Newark exemplify this trend. According to the census, the combined population in these three towns between 1990 and 2003 grew only 5.6%, less than the 9% reported in the rest of the three corresponding counties. Yet housing permits in these three towns shot up over six-fold, while the rest of the three counties only saw a three-fold increase. More importantly, 80% of these permits were designated for multiple dwellings, so the corresponding increase in people accommodated are even greater. Official statistics state that illegal immigrants in New Jersey have jumped 110% during the same period – an estimate that is inconsistent with the housing statistics, our discussions with local realtors and the changes that we have visually observed in the demographic landscape.
“To a significant degree, high rates of immigration offset the effect of a declining number of births on school enrollment.” Administrators have been surprised that school population growth significantly exceeded earlier projections, thus creating overcrowding in many school districts.
Pulitzer Prize reporters Donald L. Barlett and James B. Steele recently reported for TIME magazine that “the number of illegal aliens flooding into the United States this year will total 3 million. It will be the largest wave since 2001 and roughly triple the number of immigrants that will come to the U.S. by legal means.” The TIME investigation, according to Mr. Barlett, relied not only on figures projected by the U.S. Border Patrol, but also on the reporter’s extensive investigations along the Mexican border at factories, local communities, and the district offices of the U.S. Border Patrol.
I don't think this is a perfect answer by any means. The Bear Stearns analysts don't have all the answers. But it's some reasonable information on the topic. Coulter herself emphasizes the topic doesn't have good enough data and statistics. For example:
YOU WILL SPEND MORE TIME TRYING TO OBTAIN BASIC CRIME STATISTICS ABOUT immigrants in America than trying to sign up for Obamacare. The facts aren’t there.
and
In just a few decades, Minnesota has gone from being approximately 99 percent German, Dutch, Finnish, Danish, and Polish to 20 percent African immigrant,7 including at least one hundred thousand Somalis.8 And that’s not counting the Somalis who have recently left the country to fight with al Qaeda and ISIS. One hundred thousand is just an estimate. We don’t know precisely how many Somalis the federal government has brought in as “refugees” because the government won’t tell us. The public can’t be trusted with the truth.
The big picture is we don't know all the numbers. Coulter's numbers make more sense than numbers she's challenging. That's good. And she doesn't overestate her case by claiming perfection with her stats.

I'd say Coulter did a good job here. She presented the reader with useful information and put it in context in reasonable way. She challenged some claims that deserved challenging and gave some alternatives to consider that are more reasonable. They're imperfect, but the main point is people should stop accepting the 11 million figure and reconsider. Coulter's right about that.

Score: 95%.

A quarter of Mexico's population?

America has already taken in more than one-quarter of Mexico’s entire population, according to the Pew Research Center’s analysis of census data.9 The United States has more Hispanics than any other country besides Mexico.10 Do we have to admit all 120 million Mexicans to prove to the New York Times that we’re not “nativist”?
9. Anna Brown and Eileen Patten, “Hispanics of Mexican Origin in the United States,” Pew Research Center Hispanic Trends Project, 2011, http://www.pewhispanic.org/2013/06/19/hispanics-of-mexican-origin-in-the-united-states-2011/. (“An estimated 33.5 million Hispanics of Mexican origin resided in the United States in 2011, according to the Census Bureau’s American Community Survey.”)
The Pew Research Center page linked does give the 33.5 million figure exactly as quoted. The population of mexico is around 120 million.

One problem is if we took in 33.5 million Mexicans, and there's 120 million in Mexico, then that's 153.5 million total, of which we have closer to a fifth (21.8%), not a quarter.

I think Coulter's point was to put 33.5 million Mexicans in context. It's over a quarter of the current population of Mexico! That's a lot! I read her comment more as a stylistic choice than strictly about math. And I don't think rounding 21.8% to 25% is very bad, it's in the right ballpark.

The one-quarter comment bothered Politifact, a group of partisan left-wingers who like to dress up their talking points as "facts". Their best counter was:
In reality, the immigration data from Pew is not nearly as neat and tidy as Coulter concludes. The Pew report attempted to count the number of people who trace their roots back to Mexico, not people who came directly from that country.

Why does that make such a difference?

Well, about two-thirds of Americans with Mexican ancestry were born in the United States. By definition, they were never part of Mexico’s population.

If they weren’t Mexican, they could not be "taken in."

The Pew definition is important, and if the numbers about Mexico don’t make it clear, let’s look at another country. We picked Ireland. In 2014, the Census Bureau said there were 34.1 million Americans with Irish roots. That’s nearly seven times Ireland’s current population.
That sounds like a pretty big error. But let's see what the Pew analysis actually says:
An estimated 33.5 million Hispanics of Mexican origin resided in the United States in 2011, according to the Census Bureau’s American Community Survey. Mexicans in this statistical profile are people who self-identified as Hispanics of Mexican origin; this means either they themselves are Mexican immigrants or they trace their family ancestry to Mexico.
They were not looking for, or counting, anyone with any Mexican ancestry or roots like Politifact claims. They were only counting people who self-identified as "Hispanics of Mexican origin". Politifact is contradicting Pew's own statement about their data (hoping no one will notice) in order to try to make Coulter look bad.

Did Coulter use loose language and exaggerate here? Yes. (Was what Politifact said worse? Yes!) But so what? You're allowed to talk loosely at times. The one quarter comment was putting things in perspective, not trying to be a rigorous analysis. There's plenty of other material in Adios America which is more rigorous and factual, and is worded to indicate that.

I would like if Coulter was a little more careful at times, but I don't see any significant problem here. I don't think it would mislead a reader in general. There's a big problem and Coulter's saying there's a big problem, which is true.

Score: 90%.

Do Illegals Honestly Answer Government Surveys?

Another part of Politifact's article looked interesting to me. And I think picking issues to look at that her enemies bring up is a good method to try some. Coulter wrote:
Justich and Ng discounted the census data because it relied on illegal aliens answering surveys. As Justich told the Wall Street Journal, “The assumption that illegal people will fill out a census form is the most ridiculous concept I have ever heard of.”30 People who have left their families, paid huge sums of money to smugglers, trekked thousands of miles, and broken American law to enter this country don’t have much incentive to fill out questionnaires from the U.S. government.

The census tried to account for the reluctance of illegal aliens to answer government surveys by adding 10 percent to their population estimate. Guess where they got 10 percent? From another survey of illegals.
But Politifact says:
In a recent report, the center wrote "It is well established that illegal aliens do respond to government surveys such as the decennial census and the Current Population Survey."
Well, they did indeed write that contradiction to Coulter. But they didn't argue it. At all. Coulter's position makes sense. This is just a "center" asserting something:
It is well established that illegal aliens do respond to government surveys such as the decennial census and the Current Population Survey. While Census Bureau surveys do not ask the foreign-born if they are legal residents of the United States, the Department of Homeland Security (DHS), former INS, the Pew Hispanic Center, and the Census Bureau have all used socio-demographic characteristics in the data to estimate the size of the illegal alien population. We follow this same approach.50
And does endnote 50 have an argument that illegals respond to government surveys? No.
To distinguish legal from illegal immigrants in the survey, this report uses citizenship status, year of arrival in the United States, age, country of birth, educational attainment, sex, receipt of welfare programs, receipt of Social Security, veteran status, and marital status. [...]
That endnote is on the topic of estimating things about the people who did fill out surveys, not on the topic of how they "established" that illegals are filling out surveys in the first place.

Rather than argue the issues, Politifact relied on judging statements by who said them:
The Center for Immigration Studies, a group that favors reduced immigration much as Coulter does, disagrees with that last point.
It's not that the Center for Immigration Studies had a good argument. Or any argument at all. Nor does Politifact have an argument. Instead, it's that the Center for Immigration Studies is asserted by Poltifact to be anti-immigration, and their point is basically "even the people who don't like immigration know Coulter is wrong". That's such an unscholarly approach that I wanted to point it out.

For the issue of Politifact attacking Coulter's argument that illegals don't fill out governement surveys, I'd say Politifact did a lot worse than just remaining silent. It showed their own flaws, not any mistake by Coulter.

Score: 100%.

How Dumb Is The Government?

That last claim Coulter made sounded interesting to me. Did the government really use a survey of illegals to try to find out whether (and at what rate) they answer surveys? Let's find out.
The census tried to account for the reluctance of illegal aliens to answer government surveys by adding 10 percent to their population estimate. Guess where they got 10 percent? From another survey of illegals. In 2001, the University of California asked Mexican-born residents of Los Angeles if they had taken the recent census. Ten percent said “no.” But almost 40 percent refused to take that survey.31
30. Carl Bialik, “In Counting Illegal Immigrants, Certain Assumptions Apply,” Wall Street Journal, May 7, 2010, http://www.wsj.com/articles/SB10001424052748704370704575228432695989918.

31. Ibid.
The cited article says what Coulter claimed:
Researchers at CIS and Pew and in the federal government use a decades-old technique that looks at the number of foreign-born people in the U.S., as counted by annual census surveys. Then they subtract the number of foreign-born people in the U.S. legally, based on immigration records and projections of deaths and outmigration. The remainder is believed to be the number of illegal immigrants.

There are several assumptions that underlie these estimates, including the figures for outmigration, which isn't tracked by the U.S. government. The biggest problem, though, is that no one really knows what proportion of illegal immigrants respond to census interviewers and how honest they are about their place of birth.

These studies presume that about 10% of illegal immigrants aren't counted by census takers. But that figure largely is based on a 2001 University of California-funded survey of 829 people born in Mexico and living in Los Angeles, in which individuals were asked, among other things, whether they responded to census interviewers a year earlier. Representatives of nearly two in five households refused to answer that survey, and those who didn't might have been more likely to skip the census count as well.
But it's just a WSJ article with no cites or links. This is the internet! Why not link to the surveys you're talking about? :( He didn't even give the name of the study, the journal, or anyone involved with it, which makes it hard to search for.

Even if I find the 2001 study and everything checks out, how would I know that the other unspecified studies presuming the 10% figuring were basing it largely on the 2001 study? To figure this out properly would require a bunch of work. Coulter or Bialik should have done this work and shared it, but they haven't. Coulter, unfortunately, seems to have just dumped responsibility on Bialik's article which makes some big claims without giving the details.

I think Coulter's right about the issue here. For example the Bear Stearns Study says:
The Census Bureau’s counting process for the migrant population has some shortcomings. According to our discussions with illegal immigrants, they avoid responding to census questionnaires. For this reason, the official estimates do not fully capture this group.
and
According to Maxine Margolis, author of An Invisible Minority: Brazilians in New York City, the discrepancies started well over a decade ago. The 1990 census, for example, recorded only 9,200 Brazilians in New York City, while the local Brazilian consulate estimated 100,000 Brazilians at that time. The Brazilian foreign office placed the number at 230,000; Dr. Margolis also noted that comparisons of the Boston Archdiocese and Brazilian consulate records with U.S. census records show a startling 10 to 1 difference.
I didn't find a paper on the 2001 survey itself, but I found Immigrant Voting in Home Country Elections which has detailed information about it.
The July 2001 Los Angeles County Mexican Immigrant Legal Status Survey (LA-MILSS) is a random sample of 456 households in which at least one person was born in Mexico and 829 foreign-born Mexicans who resided in Los Angeles County in July 2001.
Looks like the survey happened in the right place with the right number of people.
household response rate of the LA-MILSS is 62 percent.
This 38% non-response rate fits with the claim that almost two in five households refused to answer. (Note: they already are ignoring outcomes like no one was home. This is people who were there and didn't answer the questions, so the word "refused" is accurate.)
Slightly less than half (46 percent) of adult respondents admitted to residing in the United States without being a naturalized citizen, a legal permanent resident or a temporary visitor.
That's a lot!
If we apply Marcelli and Ong’s (2002) estimated 10 percent undercount rate for all foreign-born Mexicans in the 2000 Census to these two point estimates, then the estimated number of expatriate Mexicans residing in the United States who will vote in the 2006 Mexican elections if the 1996 Mexican electoral reforms remain inoperative is 1.8 to 3.1 million.15
Guess what the footnote is. Think it'll provide details of the 10% undercount? Or maybe it'll give their calculations for the 1.8-3.1 million range? No, all it does is say the government used the 10% number.
15 This estimated undercount rate was employed in the recent U.S. INS report on unauthorized immigration in the United States (U.S. Immigration and Naturalization Service 2003).
That's not useful. Although it does provide an example of the 10% figure being used, like the WSJ article claimed.

Here's another statement about the 10% undercount. It's in a paper that at least has a bunch of linked endnotes with citations written out:
During the 2000s, the two leading producers of estimates of the unauthorized foreign-born population, the Office of Immigration Statistics (OIS) and the Pew Hispanic Center (Pew), assumed that coverage error was, respectively, 10 (Hoefer, Rytina and Baker 2011
) and 13 percent (Passel and Cohn 2009) for the unauthorized foreign born, and about 2.5% for other foreign born. OIS rested its assumption about coverage error on a survey conducted in Los Angeles that was then compared to Census counts (Marcelli and Ong 2002). Pew based its assumption on the levels of enumeration error estimated for the 2000 Census, which were calculated by incorporating data from the Accuracy and Coverage Evaluation (ACE) post-enumeration surveyviii
I looked for "2000 Census coverage of foreign-born Mexicans in Los Angeles County: Implications for demographic analysis" by Marcelli and Ong. Google scholar is aware it exists. But it's not available online. It isn't just behind a paywall. There's no copy of it available. They presented it at an IRL meeting, and people cite it, but there's I see no mention of it actually being published anywhere. Here is the meeting information and the paper information:
This paper employs the 2001 Los Angeles Mexican Immigrant Legal Status Survey (LA-MILSS) data to estimate the contribution of unauthorized and Legal Mexican immigrants to the Census undercount in Los Angeles County. After estimating the number of Mexican immigrants by legal status and whether each individual was enumerated in the 2000 Census, we examine various sources of omission. Logistic regression results suggest that individual demographic characteristics, social network quality, and neighborhood characteristics help explain variation in whether a person was counted.
And that's all the information we get. This makes it hardre to blame Bialik and Coulter for not providing more cites. These guys just publish a paragraph summary online and don't bother publishing their actual details. They share their ideas in person, apparently to be cited by other people who took notes while they were talking, I guess.

Finally, I see the government is using this, as claimed:

Estimates of the Unauthorized Immigrant Population Residing in the United States: 1990 to 2000

Office of Policy and Planning
U.S. Immigration and Naturalization Service


...

About 12.6 million foreign-born persons who entered the United States from 1990 to 1999 were counted in the 2000 Census. The INS adjusted that number upward by about 850,000, primarily to account for estimated undercount in the census,4

4 The estimate of net census undercount of 10% for unauthorized residents is consistent with results reported in a paper by Enrico Marcelli, “2000 Census Coverage of Foreign-born Mexicans in Los Angeles County: Implications for Demographic Analysis,” presented at the 2000 Annual Meeting of the Population Association of America, Atlanta, GA. For lawful residents, as defined here, the rate of net census undercount was set at one fourth of the rate for unauthorized residents, or 2.5 percent. [Bold in original for headings.]
Note the 850,000 adjustment the INS used is 6.7%, not 10%, even though their footnote says 10%.

OK now let's step back. Coulter said they asked people if they answered the census, and 10% said no. But I wasn't able to find that question from the survey and the results for it. Coulter's own citation should have led me to find that, since she makes that claim in her book. That's bad.

On the other hand, she's right about the big picture: the government and others are pretty much just making stuff up instead of being scholars with facts. The quality of the work Coulter's questioning is ridiculously low. She's right to draw attention to it. The theme of her book holds up. So again I'm going to deduct some points for a technical problem (I couldn't find some of the specifics she brought up her endnotes, even after doing quite a bit of research), but Coulter hasn't said anything that would mislead a reader about the state of the world. She isn't playing loose with facts to trick anyone about anything.

Score: 70%.

Adios America?

So, will illegal immigration destroy the country? Would amnesty mean Republicans never get elected again? Are these third-worlders assimilating, or not? Are we in danger? Is this a serious enough issue to really threaten our country? Could it be Adios America!?
According to a Washington Post poll, a majority of second-generation immigrants from Mexico, Cuba, Haiti, Vietnam, and the West Indies did not refer to themselves as “Americans” and said America was not the best country in the world.22
22. William Booth, “One Nation, Indivisible: Is It History?,” Washington Post, February 22, 1998, http://www.washingtonpost.com/wp-srv/national/longterm/meltingpot/melt0222.htm.
The article says:
One study of the children of immigrants, conducted six years ago among young Haitians, Cubans, West Indians, Mexican and Vietnamese in South Florida and Southern California, suggests the parents are not alone in their concerns.

Asked by researchers Alejandro Portes and Ruben Rumbauthow how they identified themselves, most chose categories of hyphenated Americans. Few choose "American" as their identity.

Then there was this – asked if they believe the United States in the best country in the world, most of the youngsters answered: no.
Like Coulter said. But where's the details? They were harder to find because Ruben Rumbaut's name is mispelled :( I did find some paywalled stuff, but since I don't even know which one they are talking about, I didn't buy it.
when Obama won his 2012 reelection, Teixeira gloated that—as he had predicted—ethnic minorities were voting 8–2 for the Democrats, and had grown to nearly one-third of the electorate. “McGovern’s revenge only seems sweeter,” Teixeira said.19
19.Ruy Teixeira, “The Emerging Democratic Majority Turns 10,” Atlantic, November 10, 2012, http://www.theatlantic.com/politics/archive/2012/11/the-emerging-democratic-majority-turns-10/265005/.
Teixeira's article says, as claimed:
Voters in 2012 were 28 percent minority, an increase of 2 percentage points from the 2008 level and a massive 13 percentage point increased from the 1988 level of 15 percent.
(28% is a little low to be calling nearly a third.)
Minority voters backed Obama 80 percent to 18 percent in 2008 -- and did exactly the same for the president this year. His support among African-Americans was almost as overwhelming (93-6) as it was in 2008 (95-4). And his support among Hispanics (71-27) improved substantially over its 2008 level (67-31). In addition, Obama achieved historic levels of support among Asian-Americans. This year he carried them 73-26, compared to 62-35 in 2008.
What about assimilation?
Everyone seems to agree that it is Minnesotans’ responsibility to assimilate to Somali culture, not the other way around.11 The Catholic University of St. Thomas has installed Islamic prayer rooms and footbaths in order to demonstrate, according to Dean of Students Karen Lange, that the school is “diverse.” Minneapolis’s mayor, Betsy Hodges, has shown up wearing a full hijab to meetings with Somalis. (In fairness, it was “Forbid Your Daughter to Work Outside the Home” Day.) A suburban Minnesota high school has “Welcome” signs written in Somali, a Somali student group, and articles in the school newspaper about how unhappy the Somalis are.
11. See, e.g., “Mayors Seek Closure of Troubling Gaps,” Minneapolis (MN) Star Tribune, January 7, 2014. (“Changing people’s thinking about the value of every part of the city is essential to closing the income gap, achievement gap, health gap and all the other income- and race-based disparities that afflict the Twin Cities. . . . The arc of history has truly bent toward diversity and inclusivity.”)
The article indeed is a bunch of appeasement of unassimilated immigrants. It has an attitude that their problems are white people's fault, and American needs to change to make Somalis better off. For example:
The arc of history has truly bent toward diversity and inclusivity in both Minneapolis and St. Paul. Whether history’s arc can also bend more nearly toward justice and opportunity for nonwhite, nonaffluent residents is an unanswered question. Making it so may be the greatest challenge these cities face if they are to remain prosperous in the 21st century.
If we do it right, we will begin to weave our city and our neighborhoods together fully, not merely in our conversations, but in our hearts and in our minds, as well. [...]” Hodges said.
Changing people’s thinking about the value of every part of the city is essential to closing the income gap, achievement gap, health gap and all the other income- and race-based disparities that afflict the Twin Cities. It will take vigorous use of the mayoral bully pulpit to spur that change. At that task, Coleman and Hodges have begun well.
The focus here is on Americans doing something, changing their thinking, looking at the world differently, etc, rather than on saying to the immigrants, "Hey guys, you came here. If you want to make more money and be more educated, then you change. Start acting like Americans and you'll get the same results we do without our city changing anything."

With immigrants not being assimilated and voting heavily for the Democrats, America is at genuine risk. But I wasn't satisfied with the details of the second generation immigrant cite. Again I'm not questioning the book's main themes, but I would have liked better research behind Coulter's factual details.

Score: 85%.

Conclusion

Coulter's average score is 87.5%. But you should try to understand what Adios America is like, not rely on a summary number. Please judge for yourself.

Here's what I think:

Despite all the endnotes, this doesn't appear to be a book of extremely careful fact checking and research. Coulter sometimes relies on sources like newspaper articles and repeats their claims without further checking. She makes some technical errors. But I didn't find a single instance where the message of her book was mistaken, which is what I'd say matters the most.

If you liked this, check out my previous Ann Coulter fact check, and my review of her critics' scholarship.

Thank you Justin Mallone for help finding some of the information.

Elliot Temple | Permalink | Messages (3)

Stefan Molyneux is a Dishonest Hack

The Truth About Ted Cruz by Stefan Molyneux is a hit video that throws everything it can against Ted Cruz while pretty much ignoring all his merits.

It purports to be a well-sourced factual takedown relying mostly on quotes. Molyneux made a website for it with a detailed table of contents and a long list of sources with links.

One of the issues, "Texas Values", discusses the Michael Wayne Haley court case. Here's what Molyneux says:



And he has two sources for this:

The Brutalism of Ted Cruz from The New York Times, a leftist propaganda rag that hates Cruz, and which can't be trusted after getting caught in so many lies. And, second, David Brooks’ (Slightly) Unfair Attack on Ted Cruz which basically agrees with the first article.

When I google for "cruz prosecute haley" (without quotes), the articles Molyneux used come up first and sixth. What Molyneux ignored is the second google hit:

David Brooks’ Dirty Hit On Ted Cruz: How Pundits Lose Credibility

Both articles Molyneux links are light on details. But this one is a detailed scholarly refutation of the position Molynex repeated straight from the New York Times. Why did Molyneux ignore it?

Molyneux is offensively dishonest because he pretends to be a scholar. He didn't just make a video attacking Cruz. He put together a big list of sources in order to lie to people that he'd done a bunch of proper research. He hadn't. He just looked for one-sided ways to smear Cruz no matter how false they were. There's no excuse for missing the second google hit on the topic. (Which also comes up on the first page of google results for a variety of other search terms I tried.)

I also dislike the sneaky claim that Cruz was "just following orders". That is not something Cruz said, nor is it what the Cruz defender I linked at Ethics Alarms said. It's just Molyneux dishonestly trying to call Rob Garver a Cruz defender (the guy from his second source who wrote, "Yet it’s hard to argue with many of [Brooks'] conclusions."). Molyneux is pretending to give both sides of the issue, but he just attacks Cruz twice and attributes one of the attacks to Cruz defenders, while ignoring Cruz's actual defenders.

Elliot Temple | Permalink | Messages (7)

Ann Coulter's Bad Scholarship

Ann Coulter tweeted:

Professor whose statistical model predicted every election since 1912: Odds Of President Trump Range Btwn 97% & 99%-http://bit.ly/1p63RMW

After my previous positive reviews of her book scholarship, I wanted to highlight how atrocious this is. Let's look over the article:

Political Science Professor: Odds Of President Trump Range BETWEEN 97% AND 99%

The model has been correct for every election since 1912 except for the 1960 election

Ann said "every election". Did she even read the article? What a travesty.

Specifically, Norpoth predicts that Trump has a 97 percent chance of beating Hillary Clinton and a 99 percent chance of beating Bernie Sanders.

The predictions assume Trump will actually become the 2016 presidential nominee of the Republican Party.

So it doesn't predict either primary. It only predicts Trump is 97-99% to become president if you throw in the big assumption that he's literally 100% likely to win the Republican primary.

So that's two major factual errors in Ann's tweet.

Besides getting the basic facts wrong, twice, there's also the issue that the article and prediction model are utter crap.

“When I started out with this kind of display a few months ago, I thought it was sort of a joke,” the professor told the alumni audience

You know what would have been impressive? If the prediction model was published in 1911.

Instead it was worked out a few months ago and has never actually predicted anything? It's really easy to "predict" past data. It's called back-fitting and it's well known. Making a formula to fit past data is completely different than making successful predictions about the future.

(That it was back-fitting, not prediction, was predictable to me before I even clicked the article. Ann should have known better even if she literally didn't read a single word of the article.)

Norpoth, a 1974 University of Michigan Ph.D. recipient who specializes in electoral behavior alignment, said his crystal ball also shows a 61-percent chance that the Republican nominee — Trump or not — will win the 2016 presidential election.

Wait what? This is pretty incoherent. These numbers do not make sense. For this math to add up – around 98% chance for Trump to win if he's the nominee, and 61% chance for any Republican to win – requires Trump to have only around a 60% chance to be the nominee (if the other Republican candidates are somehow all around 0% likely to win the general election) or less.

I also checked out the Daily Caller's source:

Political science professor forecasts Trump as general election winner

“You think ‘This is crazy. How can anything come up with something like that?’ ” Norpoth said “But that’s exactly the kind of equation I used to predict Bill Clinton winning in ‘96, that I used to predict that George Bush would win in 2004, and, as you remember four years ago, that Obama would win in 2012.”

Note the wording, "the kind of equation". So he made up a new equation just now. He's made up other equations in the past. He keeps changing them each time, rather than re-using an equation that's ever predicted anything.

In contrast, Norpoth forecasted that a hypothetical presidential race with Ted Cruz or Marco Rubio on the Republican ticket would be a much closer race. The results showed Clinton with a 55 percent chance of winning the race against Cruz or Rubio with a 0.3 percent lead in the popular vote.

So Trump needs to have a very low chance to win the GOP primary for the math to work out. Meanwhile the prediction model saying he'll win the general election is based on him doing so well in the primaries! This is all a bunch of contradictory nonsense.


And Ann Coulter is promoting this utter nonsense on Twitter while making factual errors. This fits her recent pattern of saying anything – even stupid and dishonest things – that are on Trump's side. :(


Elliot Temple | Permalink | Messages (2)

Reddit Censorship

I tried to participate in a reddit AMA ("ask me anything") for Ann Coulter. I was immediately banned:



That's everything I said. Then:



A few minutes later the moderators changed their mind and made it a permanent ban because, apparently, I'm a "moron". (I had said nothing further.) What's moronic about doing fact checking and research regarding Ann's writing? I found a clear error in Adios America which should be fixed. Instead I get banned:


Elliot Temple | Permalink | Messages (10)

Never Trust Ari Armstrong

Ari Armstrong caught my attention because he's a writer who purports to be an Objectivist. But he's got serious quality problems – I caught him making false statements about what the Bible says. Worse, he provided source links to the passages that contradict him. That gives a false impression that he'd checked his claims properly (similar to adding footnotes to a dishonest book to make it look scholarly).

Recently he's done worse:

The article title, "Why I Will Vote for Any Democrat over Ted Cruz", encourages the destruction of America. What's he so bothered by?

In early November, Cruz, along with Mike Huckabee and Bobby Jindal, spoke at the National Religious Liberties Conference in Iowa. At that event, host Kevin Swanson openly called for the death penalty for homosexuals—albeit only after they’ve had a chance to “repent.” Another speaker at the conference distributed literature advocating the death penalty for homosexuals.

Right Wing Watch is a very biased, untrustworthy site. Nevertheless in this case they had more integrity than Ari Armstrong. Armstrong is misreporting events. His own source says:

In a closing keynote address to the conference this evening, Swanson clarified that he is not encouraging American officials to implement the death penalty for homosexuality … yet.

That's not openly calling for the death penalty for homosexuals. Let's compare. Armstrong:

Swanson openly called for the death penalty for homosexuals

And Armstrong's source:

he is not encouraging American officials to implement the death penalty for homosexuality … yet.

Armstrong is dishonest.

Thanks to Justin Mallone for helping check this.


Elliot Temple | Permalink | Messages (0)

Fake Burke Quote Attacking Godwin

I found a quote of Edmund Burke trashing William Godwin:

'Pure defecated Atheism', said Burke [of Godwin], 'the brood of that putrid carcase the French Revolution.'

I was especially interested because I'd been unable to find any other direct quote of Burke saying negative things about Godwin. People claim Burke disliked Godwin, but I have my doubts and have searched for the evidence that those people never provide.

So I tracked down the citations, and ultimately the quote is unsourced. While doing that, I found another quote of Burke trashing Godwin which also turned out to be unsourced.

I also contacted an academic expert who agreed the quote is fake.

Here's what I looked up:

The defecated atheism quote is from Godwin's Moral Philosophy: An Interpretation of William Godwin by D. H. Monro.

I originally found it in a different Godwin paper which didn't even try to source it.

Monro says it's quoted from Ford K. Brown, Life of William Godwin (London, 1926), p 155

So I got that book. It has the quote along with a footnote. The footnote states:

Edmund Burke, who is also said to have called Godwin "one of the ablest architects of ruin." (Gilfillan's Literary Portraits (First Series, Edinb. 1845), p.16.)

I found the Literary Portraits book. On page 16 it has the architect of ruin quote, unsourced. It doesn't have the defecated atheism quote at all.

It's no good to source a quote to a secondary source without following the citations back to an adequate source. That spreads myths.


Elliot Temple | Permalink | Messages (0)

Steven Crowder Fake Quote

MYTH: "Well Regulated Militia" Only? (Second Amendment History) is a video by Steven Crowder. It has quotes from America's founding fathers to argue for his pro-gun-rights position (which I agree with). Crowder put up a webpage with his references which he links in the YouTube video description. The first quote on the page is:

“I ask, Sir, what is the militia? It is the whole people. To disarm the people is the best and most effectual way to enslave them.” – George Mason

Crowder's source link is a category at a blog (not even a specific post). The relevant blog post says:

.
I ask, Sir, what is the militia? It is the whole people. To disarm the people is the best and most effectual way to enslave them.”

George Mason, Speech at the Virginia Ratifying Convention, 1788

~ ~ Grouchy ~ ~

Great, we have a source. It's from a speech at a particular convention in a particular year. It's easy to find a short transcript of the speech (second version) online which doesn't have this quote. I wanted to know where the quote was coming from, and if it was perhaps from another statement not included in those sources. I looked further and found the full book covering the convention. It doesn't contain the quote. So, I'm confident the quote is a fraud.

I didn't check the other quotes Crowder used. This is one fake quote out of just one quote checked.

The full book does have some similar statements from Mason (my emphasis):

I ask, Who are the militia? They consist now of the whole people, except a few public officers. But I cannot say who will be the militia of the future day.

and

An instance within the memory of some of this house will show us how our militia may be destroyed. Forty years ago, when the resolution of enslaving America was formed in Great Britain, the British Parliament was advised by an artful man,* who was governor of Pennsylvania, to disarm the people; that it was the best and most effectual way to enslave them; but that they should not do it openly, but weaken them, and let them sink gradually, by totally disusing and neglecting the militia. [Here Mr. Mason quoted sundry passages to this effect.] This was a most iniquitous project. Why should we not provide against the danger of having our militia, our real and natural strength, destroyed?

The fake quote is similar to two real quotes from the speech, but each part is changed. And, in the book, the two parts appear thousands of words apart, and in reverse order. So the fake quote is roughly representative of what Mason was saying, but it's not actually a quote.


Elliot Temple | Permalink | Messages (0)

Matt Levine Thinks Badly About Incentives and Economics

Matt Levine writes (bold added, links omitted):

AT&T’s acquisition of Time Warner is a vertical merger: AT&T mostly owns pipes (DirectTV, cellular networks) that bring content to consumers, while Time Warner mostly owns studios (Time Warner) and networks (HBO, the Turner networks) that produce and package that content. By combining the two, they can achieve some efficiency benefits that should work to lower prices for consumers. For instance, by combining AT&T’s data on its wireless customers with Time Warner’s advertising inventory, they can introduce more targeted ads, which “will lead to higher ad revenues that will alleviate pressure on the programing side and lower the price of video distribution to consumers,” according to Judge Leon’s opinion. In modern antitrust law, more targeted advertising is a consumer benefit. There are those who think that modern antitrust law is bad.

Against these benefits, the government argued that the combined company would have so much market power that it would actually be able to raise prices. This is an unusual argument in a vertical merger—and vertical mergers are rarely challenged—because the merger won’t make AT&T any bigger in any of the businesses it (or Time Warner) is already in. Instead, the government’s theory is that AT&T can use its Time Warner content to bully competing distributors (other cable companies, video-on-demand companies, etc.). Right now, Time Warner makes its money by signing big high-stakes deals with content distributors who want to carry its content. If they don’t reach a deal, then everyone loses: Time Warner doesn’t get paid, and the distributor’s customers get mad that they can’t watch HBO and start thinking about switching cable companies. And so in practice they generally work out a deal; long-term blackouts are very rare.

But once AT&T owns Time Warner, the government argued, its incentives will shift: If it fails to reach a deal with Comcast or whoever, then it still won’t get paid for Time Warner’s content, and Comcast’s subscribers will still get mad and think about switching providers, but now they might switch to AT&T. (To DirecTV, or to some AT&T wireless video product, etc.) Blacking out Time Warner’s networks on a competing distributor will now be good for AT&T’s distribution business, which will give Time Warner more leverage to demand higher prices for its content in those negotiations with distributors. Or that is the government’s theory, which it argued based on some intemperate public statements from AT&T, some worries from its competitors, and the expert testimony of antitrust economist Carl Shapiro.

Judge Leon didn’t buy it. He noted that an AT&T expert witness looked at previous content/distribution vertical mergers and found that “There’s absolutely no statistical basis to support the government’s claim that vertical integration in this industry leads to higher content prices.” And he noted that, even after the merger, it will be in AT&T/Time Warner’s interest to distribute Time Warner’s content as broadly as possible, so it won’t really have that much leverage to demand higher prices:

Indeed the evidence showed that there has never been, and is likely never going to be, an actual long-term blackout of Turner content. Numerous witnesses explained, and Professor Shapiro acknowledged, that a long-term blackout of Turner content, even post-merger, would cause Turner to lose more in affiliate fee and advertising revenues than the merged entity would gain. Given that, there is insufficient evidentiary basis to support Professor Shapiro’s contention that a post-merger Turner would, or even could, drive up prices by threatening distributors with long-term blackouts.

The discussion gets into some odd theory-of-the-firm moments. Several of AT&T’s witnesses were people who had negotiated these content deals at other vertically integrated cable/content companies: “Madison Bond, who has served as a lead negotiator for NBCU during the past seven years when the company has been vertically integrated with Comcast,” for instance, and several Time Warner executives who “testified similarly about their time at the company when it was vertically integrated with Time Warner Cable.” All of these witnesses said the same thing: They never used their ownership by a distributor as leverage in negotiation with other distributors.

When questioned by defense counsel about his prior negotiations on behalf of NBCU, Bond testified that he “never once took into account the interest of Comcast cable in trying to negotiate a carriage agreement.” Consideration of potential Comcast gains during an NBCU blackout “doesn’t factor at all” into his negotations, Bond continued, nor has anyone from Comcast “ever asked” him “to think about that.” Bond’s statements were similar to testimony given by Comcast’s chief negotiator, Greg Rigdon, who testified that he has never suggested, or seen a Comcast document suggesting, that NBC “should go dark on one of [Comcast’s] competitors because then [Comcast] might pick up some subscribers” or that NBCU should “hold out for a little bit more in affiliate fees because that will harm” Comcast’s competitors.

(Citations omitted.) Similarly, a Turner executive said, “I’ve been in Turner when we were a vertically integrated company and had a sister company called Time Warner Cable. And I can tell you that at no time during my tenure there did anyone ask me to consider in my negotiations and how I dealt with other distributors the outcome and impact at Time Warner Cable.”

So basically everyone with experience of negotiating these deals, who had the leverage that the government claims AT&T/Time Warner will have, said: Nah, it never even occurred to us to do that. But the government’s economist testified that of course they would have that leverage and use it. “Indeed, this opinion by Professor Shapiro runs contrary to all of the real-world testimony during the trial from those who have actually negotiated on behalf of vertically integrated companies,” wrote Judge Leon. So he asked Shapiro about it, and got this fun answer:

No, I am aware of that testimony. And so I think there’s a very serious tension between that testimony and the working assumption for antitrust economists that Professor Carlton and I share; that the company after the merger will be run to maximize their joint profits.

Isn’t that sort of lovely? An economist testified about how companies should operate. Actual operators testified about how the companies do operate. The answers were different. “There's a very serious tension,” said the economist. It is really all you could ask for in an antitrust trial: An economic theory of corporate behavior was proposed, it was confronted with the practical reality of the people actually doing the corporate behavior, and the economic theory shrugged and melted away.

Judge Leon is surely right that the tension isn’t as serious as Shapiro thinks:

That profit-maximization premise is not inconsistent, however, with the witness testimony that the identity of a programmer’s owner has not affected affiliate negotiations in real-world instances of vertical integration. Rather, as those witnesses indicated, vertically integrated corporations have previously determined that the best way to increase company wide profits is for the programming and distribution components to separately maximize their respective revenues. … In the case of programmers, that means pursuing deals “to be on all the platforms,” rather than undertaking a “series of risks” to threaten a long-term blackout.

Part of how you combine different businesses is by getting them to work together: If Time Warner is good at selling ads, and AT&T is good at mining customer data, then you smush them together so that AT&T/Time Warner will be good at selling ads based on customer data-mining, which is where the money is. But part of how you combine different businesses is by leaving them to work separately: If Time Warner’s business model is selling programming to every distributor, then changing that model so that it only sells to AT&T, just because AT&T bought it, would be a mistake. Which is which—when you should combine businesses, and when you should leave them to make their own profit-maximizing decisions—is a complicated question, and you can certainly try to answer it with game theory and economic modeling. But sometimes you can just ask companies what they actually do! It is not perfect evidence of what they should do. But it’s pretty good evidence of what they will do.

I've read lots of Money Stuff columns. I often like them. This is the worst one I've seen. People lie. People fail to introspect, especially when the results would be inconvenient.

Of course merged companies work to make an overall profit for the new, single company. Not perfectly, but there's major incentives in companies to make a profit, and these incentives do play a major role in behavior. Sure it happens that sometimes the right hand of the company doesn't talk to the left hand, and they consequently fail to maximize profits. And sure it happens that sometimes the amount of profit available from a particular optimization is too small for the coordination effort required to get it. And sure it happens that people fail to notice opportunities. None of those mean economic theory is wrong.

Why is Levine so naively credulous of some people saying things in court that they have a strong incentive to say? AT&T wouldn't have brought in someone to testify if they were going to say something else that hurt AT&T... And people saying something else would be at risk of getting themselves fired, and maybe other bad things, because they'd basically be saying they personally, and their company, was doing bad stuff that there are various laws against (anti-trust if nothing else – yes anti-trust law is extremely vague, but this seems like the kinda stuff people think that violates it, which is exactly why it was a topic of discussion in this anti-trust case).

Also the witnesses said they didn't go up to Comcast, or whoever, and say "yo, give us lots of money or we'll do a blackout cuz we don't give a damn cuz we own DirectTV" or an equivalent of that. Choosing not to use it as an aggressive talking point, and saying with full clarity what one means, is perfectly compatible with negotiating harder due to the incentives that exist. The testimony also uses careful language, e.g. a person says he didn't suggest doing it, and didn't read any documents suggesting he do it. Another guy says he wasn't asked to take something into account. There's a comment about going dark, which is different thing than using it as a background possibility to negotiate a better deal (which is what they always do, all the time, obviously – of course, if they aren't paid enough money, they will go dark, and everyone on both sides knows it).

Why doesn't Levine consider the incentives people have, and just believes them when they say they act contrary to financial incentives?

And the mathy arguments used are nonsense. Blackouts are too expensive to threaten? Umm, not exactly. Blackouts are always an implied threat in negotiations. If you don't pay us, we will not let you air our shows. Duh. After the merger, the overall cost of a blackout will be smaller for the new merged company than it was for the old company (because e.g. the blackout it benefits DirecTV, which makes up for a portion of the downside).

If no deal is $100 less bad for you than before, you negotiate harder than before and you maybe get a $50 better deal. Even if the deal is worth a million dollars, this is still true, though in that case it'd be too small a factor to worry about. But the argument wasn't "we calculated how big a factor this is, and it's too small to matter much". They didn't figure out what size factor it is. They just denied it's a factor. That's stupid and incompetent, and Levine ought to have noticed if he were competent.

Similarly, the arguments about the benefits of letting different divisions of a company operate independently effect the degree of the issue. Maybe those benefits are larger than the ability of the merged company to negotiate harder and raise prices for TV content. Maybe a lot larger, so the merged company will only pursue the much larger benefit and not concern itself with the smaller benefit that isn't fully compatible with the larger benefit. But Levine doesn't treat it like competing factors and compare their size. He uses one to try to dismiss and ignore the other. That's nonsense. Nor does Levine consider what potential future changes to the company (e.g. some reorganization, selling some other divisions off and getting smaller, whatever) might change the calculations and therefore result in the price raising behavior being economically efficient.

Also, when deciding to believe the businessmen who said "oh no, we would never act according to financial incentives – in fact, we don't even know those financial incentives exist", Levine ignored that there were also public statements by AT&T that admitted it (at least Levine himself said those statements exist, but he didn't quote any or give a source).

Is it true that the best way to maximize profits for a company is for individual divisions to maximize profits? No. You might run your company that way because doing things more optimally is too hard. But that's not the theoretical best way.

And no, Levine, no one said anything about changing the model to only sell the TV shows to AT&T. That's an especially dishonest thing to write.

To be clear: anti-trust laws are evil (which is another thing Levine is clueless about). I'm not saying that mergers should be blocked because prices for some things would be raised, nor am I claiming they actually will be raised. I'm just analyzing the quality of the arguments and thinking presented by Levine, and the big mistakes in the article are on the pro-merger side.


Elliot Temple | Permalink | Messages (3)

Bad Sam Harris Brain Scanning Research Paper

This post criticizes The Neural Correlates of Religious and Nonreligious Belief by Sam Harris, Jonas T. Kaplan, Ashley Curiel, Susan Y. Bookheimer, Marco Iacoboni, Mark S. Cohen in 2009. I wrote this as a reply on the Change My View subreddit, and made minor edits so it'd stand alone.

Once we had two groups of subjects (Christians and Nonbelievers)

Specific criteria used are not given, making this research non-reproducible. This especially concerns me because such criteria are controversial and I would expect to disagree with the study authors about some categorizations regarding which persons think about which topics in religious ways (I don't think that religious thinking is all or nothing).

Later, they admit the screening criteria were poor, and make excuses. They later admit, "the failure of our brief screening procedure to accurately assess a person's religious beliefs".

To this end we assessed subjects' general intelligence using the Weschler Abbreviated Scale of Intelligence (WASI)

It's spelled "Wechsler".

IQ tests have many problems. Here is a previous discussion where I pointed out some of the problems. http://curi.us/2056-iq

screened for psychopathology using the Brief Psychiatric Rating Scale (BPRS)

Their non-random screening, including this, dropped 44% of people. That's getting far from a representative sample of the population! And those are only of the people who met the first 5 criteria that already included two related to psychiatric issues.

There are lots of problems with psychiatric screenings. I'm not going to go into it in detail here, but see these books criticizing psychiatry: http://fallibleideas.com/books#szasz

Forty of these participated in the fMRI portion of our study, but ten were later dropped, and their data excluded from subsequent analysis, due to technical difficulties with their scans (2 subjects), or to achieve a gender balance between the two groups (1 subject), or because their responses to our experimental stimuli indicated that they did not actually meet the criteria for inclusion in our study as either nonbelievers or committed Christians (7 subjects).

Dropping those 7 people is a big problem. They were removed because their data didn't fit the expected answer patterns. IMO that should have been a learning opportunity to reconsider mistaken expectations.


Here are example stimuli from the experiment. I didn't read them all, but it looked to me like over half the groups of 4 stimuli had a flaw. Also there's a systematic bias: the Christian truths are more often non-hedged statements, while the atheists truths are more often hedged. E.g. in 19 you read "The Bible" in the Christian one and "Most of the Bible" in the atheist one, and 29 has Jesus either "literally" rising from the dead or "probably" not rising from the dead.

The Bible is free from error.

This is categorized as something that all the Christian participants should consider true. But many serious Christians do not believe this.

The Bible is free from significant error.

It's weird that they have two very similar questions.

All books provided perfectly accurate accounts of history.

Grammar error.

The Bible is full of fictional stories and contains historical errors.

This is categorized as something that all the Christian participants should consider false. But many serious Christians do believe this.

People who believe in the biblical God often do so on very good evidence.

This is categorized as something that all the Christian participants should consider true. But many serious Christians do not believe this.

It reasonable to believe in an omniscient God.

Grammar error.

Jesus Christ can’t do anything to help humanity in the 21st century.

This is supposed to be considered true by non-believers, but many non-believers (including me) consider this statement false. (Though it's vague: do they mean Jesus Christ literally and personally can help people today, or his teachings can help? I'd change my answer depending on that. It's his teachings that I think can do "anything" (more than zero) to help.)

In general, they shouldn't have used words like "anything", "all", most", "greatest" because people routinely misread those statements (misreading e.g. "all" as "most", or vice versa). And those kind of statements are so often written incorrectly and carelessly that readers, reasonably, don't expect reliable, literal precision from them.

Jesus was literally born of a virgin.

Lots of Christians don't believe this – possibly because they are more educated about their religion (not less). "Virgin" (in the sense of not having sex) is a mistranslation – he was born of a young women (which, btw, is a typical meaning of "virgin" in English).

The Biblical story of creation is basically true.

Tons of Christians aren't young Earth creationists.

Most of the Bible is inferior to modern thinking on morality and human happiness.

This is supposed to be considered true by atheists, but as an atheist I consider it vague (which modern thinking?). If I try to read it using guesses about what the author of the statement meant, I think I disagree with it. Also if I read it with a "most" before "modern thinking", then I'd judge it false.

The Biblical story of creation is purely a myth.

This is supposed to be an atheist truth, but as an atheist I consider it false (due to "purely", which I mentioned above is the kind of word they shouldn't have used because people vary in how literally they read it). It's also problematic because I think many atheists aren't adequately familiar with the Biblical story of creation.

The Christian doctrine of the Trinity is almost surely fictional.

Many atheists couldn't say what what the Trinity doctrine is. And many atheists, including me, would disagree with this due to the "almost surely fictional". I consider it fictional and would not want to hedge in that way. If the words "almost surely" were deleted then I'd agree with the statement, but I'm not comfortable with this statement as written. There were lots of statements that were supposed to be things I would agree with, but which included hedges I don't believe.

Human beings have complete control over the environment and can grow food anywhere.

This is vague. They consider it false. But we can grow food in airplanes, submarines or spaceships. Where, exactly, can't we grow food? In the middle of active volcanos? In the middle of the sun? Did they expect me to worry about suns or black holes because of taking "anywhere" literally?

The greatest human accomplishments have had nothing to do with God.

This is one of the worst ones. This is meant to be considered true by atheists. But, historically, most human accomplishments (great and small) were accomplished by religious people who often did think God was relevant (or the gods in the case of polytheists like many Greeks). Example: https://en.wikipedia.org/wiki/Religious_views_of_Isaac_Newton

It is wise to create a government that can help protect its citizens from harm.

I'm confused about why this is meant to be false for everyone. Most people agree with this, right?

Also, for 54 and 55 they accidentally swapped the Christian and Atheist truths. Since they have things categorized incorrectly and make grammar and spelling errors in what they published, I'm concerned that these 4 statements were miscategorized in the actual study.


I could go on and on. There are tons of stimuli with these kinds of problems. This is not up to the high standards required for scientific progress. And they actually excluded 7 people for not answering the questions reliably enough (over 90%) in the way the study authors expected them to answer based on the poor phone screening. And, overall, it looked to me like a lot of highly religious Christians would agree with well under 90% of the Christian truth stimuli, so I think the experimental design is bad. The researchers seem to think that e.g. if you believe in evolution you aren't a serious, religious Christian, which is incorrect. Note they failed at their own design goal that:

All statements were designed to be judged easily as “true” or “false”

Anyway, I'm not even trying to be comprehensive with the issues. There are just a lot of issues. And cites to a ton more issues, e.g. I could go through "The role of the extrapersonal brain systems in religious activity" and point out flaws with that (it's the cite on some text I particularly disagreed with). For now, I'll continue with some comments on the brain scanning aspect since I didn't get to that yet.

For both groups, and in both categories of stimuli, belief (judgments of “true” vs judgments of “false”) was associated with greater signal in the ventromedial prefrontal cortex

This is like measuring magnitudes of electric signals in different regions of CPUs while running different software. That would be a bad way to understand CPUs or software.

Actually, overall, the brain scanning stuff is hard to criticize due to the lack of substantial claims. They need to conclude something significant for me to point out how the evidence is inadequate for the conclusion. But they didn't. Big picture, the paper says more like "We did something and here's the data we got" which is true as far as it goes. They were looking for correlations and found a couple. Finding correlations is quite different than understanding and making claims about how people think. The world is packed full of non-causal correlations. Due to the lack of major claims about the brain scan correlations meaning anything, I'm done. It has quality issues and doesn't reach important conclusions.


Elliot Temple | Permalink | Message (1)

Rothbard's Bad Scholarship on Godwin and Popper

I know some bad things about Murray Rothbard (like his view that abortion is justified by the property rights of the mother against a trespasser, his belief that children are property and that parents are not obligated to feed their children, his attack on Objectivism, and his anti-semitism). But I've seen some merit in his work on economics, and I've begun reading his book An Austrian Perspective on the History of Economic Thought. I mostly like it so far, but one must be careful not to trust everything. A particularly interesting part, to me, was the discussion of Aristotle, which I thought was good. It was a lot like what Objectivists say about Aristotle. I don't know how much this is because of Rothbard's knowledge of Objectivism, and how much it's a standard non-Objectivist view. Reading about Aristotle on the Stanford Encyclopedia of Philosophy, Encyclopaedia Britannica, or Wikipedia is rather different than the Objectivist or Rothbardian interpretation. I tried to google for material on Aristotle similar to the Objectivist view, and found this page ... but I checked and the authors are Objectivists.

Here are some new Rothbard errors I've discovered (italics in quotes are added by me, unless noted):

The continual progress, onward-and-upward approach was demolished for me, and should have been for everyone, by Thomas Kuhn's famed Structure of Scientific Revolutions.[5] [italics in original]

See the replies to Kuhn by Karl Popper and by David Deutsch. (Deutsch's writing on this subject is more accessible and more general, so it's what I'd recommend first if you're interested.)

Related to Kuhn (a critic of Popper) is Rothbard's completely false hostility to Popper in The Present State of Austrian Economics:

For my purposes, I am ignoring the allegedly wide gulf between the earlier positivists with their “verifiability” criterion and the Popperites and their emphasis on “falsifiability.” For those far outside the logical empiricist camp, this dispute has more of the appearance of a family feud than of a fundamental split in epistemology. The only point of interest here is that the Popperites are more nihilistic and therefore even less satisfactory than the original positivists, who at least are allowed to “verify” rather than merely “not falsify.”

Popper is not a positivist, nor similar to one. This is totally ignorant, yet he writes about it professionally (rather than being aware of his ignorance and leaving this matter to others).

Going back to An Austrian Perspective on the History of Economic Thought, I searched it for discussion of Godwin and Burke, who are thinkers where I could readily judge the quality of Rothbard's work, offhand, from my own expertise. Burke isn't mentioned at all, which is an error in a detailed book which gives attention to many lesser known figures. (Burke is fairly well known in general, but not for his comments on economics, even though he made many of them.) Rothbard did very extensive research for this book, but somehow omitted Burke. An example of Burke's relevance, from an 1800 biography of Burke, which has been quoted in many more recent books:

[Adam] Smith, [Burke] said, told him, after they had conversed on subjects of political economy, that he was the only man, who, without communication, thought on these topics exactly as he did.

Adam Smith is a major focus of Rothbard's attention, so Burke was worth discussing at least a little.

Rothbard's treatment of Godwin was much worse. He brings up Godwin briefly in relation to Malthus and makes egregious errors:

In his Utopian belief in the perfectibility of man

The "perfectibility" of man is not a Utopian belief, it means that man can be improved without limit (without reaching an end to progress), not that man can or will reach perfection. The improvement includes both improvement of ideas and of technology. This is a major theme of Deutsch's The Beginning of Infinity, which is titled for this theme and includes Godwin in the bibliography.

William Godwin, on the other hand, was the world's first anarcho-communist, or rather, voluntary anarcho-communist. For Godwin, while a bitter critic of the coercive state, was an equally hostile critic of private property.

That's just not what Godwin says in his material on property in Political Justice.

Godwin believed, not that private property should be expropriated by force, but that individuals, fully using their reason, should voluntarily and altruistically divest themselves of all private property to any passer-by.

Rothbard doesn't provide any quote or citation for this false claim. I will, nevertheless, offer some quotes from Political Justice to refute it, from book 8 (of 8), Of Property.

Of property there are three degrees.

The first and simplest degree is that of my permanent right in those things the use of which being attributed to me, a greater sum of benefit or pleasure will result than could have arisen from their being otherwise appropriated. It is of no consequence, in this case, how I came into possession of them, the only necessary conditions being their superior usefulness to me, and that my title to them is such as is generally acquiesced in by the community in which I live. Every man is unjust who conducts himself in such a manner respecting these things as to infringe, in any degree, upon my power of using them, at the time when the using them will be of real importance to me.

It has already appeared[1] that one of the most essential of the rights of man is my right to the forbearance of others; not merely that they shall refrain from every thing that may, by direct consequence, affect my life, or the possession of my powers, but that they shall refrain from usurping upon my understanding, and shall leave me a certain equal sphere for the exercise of my private judgement. This is necessary because it is possible for them to be wrong, as well as for me to be so, because the exercise of the understanding is essential to the improvement of man, and because the pain and interruption I suffer are as real, when they infringe, in my conception only, upon what is of importance to me, as if the infringement had been, in the utmost degree, palpable. Hence it follows that no man may, in ordinary cases, make use of my apartment, furniture or garments, or of my food, in the way of barter or loan, without having first obtained my consent.

The second degree of property is the empire to which every man is entitled over the produce of his own industry, even that part of it the use of which ought not to be appropriated to himself.

Godwin didn't think people should give away their property to random people, he thought they should have property rights but sometimes, due to rational argument, give some property, as a gift, to someone who had a better use for it. I think trade should be emphasized over gifts and that Godwin wasn't a great economist, but Godwin did support private property and the free market, and was an individualist.

It is not easy to say whether misery or absurdity would be most conspicuous in a plan which should invite every man to seize upon everything he conceived himself to want.... We have already shown,[3] and shall have occasion to show more at large,[4] how pernicious the consequences would be if government were to take the whole permanently into their hands, and dispense to every man his daily bread.

Note the anti-communism.

The idea of property, or permanent empire, in those things which ought to be applied to our personal use, and still more in the produce of our industry, unavoidably suggests the idea of some species of law or practice by which it is guaranteed. Without this, property could not exist. Yet we have endeavoured to show that the maintenance of these two kinds of property is highly beneficial.

Godwin supports the protection of property.

For, let it be observed that, not only no well informed community will interfere with the quantity of any man's industry, or the disposal of its produce, but the members of every such well informed community will exert themselves to turn aside the purpose of any man who shall be inclined, to dictate to, or restrain, his neighbour in this respect.

No one should interfere with anyone's property rights, and people who try to should be stopped.

The most destructive of all excesses is that where one man shall dictate to another, or undertake to compel him to do, or refrain from doing, anything (except, as was before stated, in cases of the most indispensable urgency) otherwise than with his own consent. Hence it follows that the distribution of wealth in every community must be left to depend upon the sentiments of the individuals of that community.

What more does Rothbard want from property rights than that men use their minds in order to use their property in the way they see fit? If Godwin had his way, the result would be a capitalist dream, not a communist society.

But, if reason prove insufficient for this fundamental purpose, other means must doubtless be employed.[9] It is better that one man should suffer than that the community should be destroyed. General security is one of those indispensable preliminaries without which nothing, good or excellent can be accomplished. It is therefore right that property, with all its inequalities, such as it is sanctioned by the general sense of the members of any state, and so long as that sanction continues unvaried should be defended, if need be, by means of coercion.

Godwin, an early anarchist of sorts, who hated violence, was still willing to recommend that the government use violence in defense of property rights, even for unjust types of property that were in existence at the time (think of feudalism and serfdom kinda stuff), let alone for property rights to the product of one's industry.

The arguments however that may be offered, in favour of the protection given to inheritance and testamentary bequest, are more forcible than might at first be imagined.

Godwin defends inheritance of property, too.

The first idea of property then is a deduction from the right of private judgement; the first object of government is the preservation of this right. Without permitting to every man, to a considerable degree, the exercise of his own discretion, there can be no independence, no improvement, no virtue and no happiness. This is a privilege in the highest degree sacred; for its maintenance, no exertions and sacrifices can be too great. Thus deep is the foundation of the doctrine of property. It is, in the last resort, the palladium of all that ought to be dear to us, and must never be approached but with awe and veneration.

The view of property as being implied from the right of private judgment is the best and most correct view of the matter. Godwin is a great liberal thinker, who Rothbard doesn't appreciate. Godwin is, in this respect, more (classical) liberal than Rothbard, and closer to Objectivism which also emphasizes reason in its defense of man's rights. (Objectivism says men have one fundamental right, the right to life, and this implies "the freedom to take all the actions required by the nature of a rational being". Property rights are the implementation of this.)

And let me repeat what that last sentence says, in more modern words (palladium means source of protection, safety or preservation): Property rights should always be approached with awe and veneration, because property rights are what protect everything good. Rothbard majorly failed at scholarship.

[Godwin] was, after all, not a scholar of population theory, and he had no immediately effective reply. It took Godwin all of two decades to study the problem thoroughly and come to an effective refutation of his nemesis. In On Population (1820), Godwin came to the cogent and sensible conclusion that population growth is not a bogey, because over the decades the food supply would increase and the birth rate would fall. Science and technology, along with rational limitation of birth, would solve the problem. ["On Population" is in italics in the original]

This falsehood about Godwin needing 20 years to figure out a reply to Malthus is refuted in Godwin's book, Of Population (Rothbard got the title wrong), in the preface:

I believed, that the Essay on Population, like other erroneous and exaggerated representations of things, would soon find its own level.

In this I have been hitherto disappointed. ... Finding therefore, that whatever arguments have been produced against it by others, it still holds on its prosperous career, and has not long since appeared in the impressive array of a Fifth Edition, I cannot be contented to go out of the world, without attempting to put into a permanent form what has occurred to me on the subject. I was sometimes idle enough to suppose, that I had done my part, in producing the book that had given occasion to Mr. Malthus's Essay, and that I might safely leave the comparatively easy task, as it seemed, of demolishing the "Principle of Population," to some one of the men who have risen to maturity since I produced my most considerable performance. But I can refrain no longer. "I will also answer my part; I likewise will shew my opinion: for I am full of matter; and the spirit within me constraineth me."

Godwin didn't reply immediately because he thought he'd done enough by writing Political Justice, and that someone else could handle the much easier task of refuting Malthus' bad ideas. This had nothing to do with Godwin needing 20 years of thought or research. Godwin underestimated how influential Malthus would turn out to be, and overestimated the ability of other thinkers to address the issue.


I will keep reading Rothbard anyway. I don't think there's a superior alternative, and I do think he's better about other thinkers that he researched more, especially when their focus is more on economics (Rothbard doesn't adquately understand Godwin's thinking about reason).


Elliot Temple | Permalink | Messages (286)

Bad Scholarship on VDare

From VDare: 93% Of Democrats Think It's Important That Fewer Whites Be Elected.

The article leads with a chart, which says that 75.1% of Democrats believe that "Whites are favored". The chart repeats later in the article. Problems:

  1. The chart has no source.

  2. The author falsely claimed that he always gives sources. Actually he had to be asked the source on Twitter because he hadn't given it. The source is these CNN exit polls.

  3. To get the chart, the author did math on the CNN exit poll data. He did not show his work.

  4. I checked what math he did by asking him on Twitter, since he didn't document it. His math was wrong. Where he got 75.1%, the correct answer was 75%. He added an extra significant figure to exaggerate how good his data was. He admitted I was right, but thought the matter deserved the comment "lol" rather than saying e.g. "My mistake, I will fix it."


The chart was brought to my attention by khaaan on Twitter, who questioned its sourcing.


Elliot Temple | Permalink | Messages (19)

Taleb Is Wrong: Killing Millions Actually Is Risky

Alan Forrester writes Criticising Taleb’s Precautionary Principle Paper, quoting Nassim Nicholas Taleb (and his co-authors):

The PP states that if an action or policy has a suspected risk of causing severe harm to the public domain (such as general health or the environment), and in the absence of scientific near-certainty about the safety of the action, the burden of proof about absence of harm falls on those proposing the action. It is meant to deal with effects of absence of evidence and the incompleteness of scientific knowledge in some risky domains.

I'm quoting this as context for what I say later. As a side note, I refuted the burden of proof idea in my Yes or No Philosophy.

The purpose of the PP is to avoid a certain class of what, in probability and insurance, is called “ruin” problems [1]. A ruin problem is one where outcomes of risks have a non zero probability of resulting in unrecoverable losses.

Taleb wants us not to use GMOs – genetically modified food like Golden Rice which helps provide more food and vitamins, especially for poor foreigners.

Forrester summarizes David Deutsch in The Beginning of Infinity (BoI) criticizing the Precautionary Principle (PP):

The PP assumes that new innovations will make the world worse and so that current knowledge is basically okay and not riddled with flaws that might lead to the destruction of civilisation. But our knowledge is riddled with flaws that might destroy civilisation. Human beings are fallible so any piece of knowledge we have might be mistaken. And those mistakes can be arbitrarily large in their consequences because otherwise we would know we were right every time we made a decision above the maximum mistake size. In addition, we can be mistaken about the consequences of a decision so a mistake we think is small might turn out to be a large mistake. The only way to deal with the fact that our knowledge might be wrong is to improve our ability to invent and criticise new ideas so we can solve problems faster. Taleb doesn’t address any of these points in his paper. He doesn’t refer to BoI. Nor do any of the arguments in his paper address Deutsch’s criticisms of the PP.

Taleb's argument is a Pascal’s Wager successor. Pascal's Wager says we should believe in God because the downside of being mistaken about atheism is eternity in hell. Meanwhile the downside of being a Christian, if God doesn't exist, is finite: e.g. some wasted Church visits and prayers. Even if the odds God exists are 0.00001%, given the stakes, one should believe in God and try to get into Heaven.

Pascal's trick is to compare an infinite downside (eternity in hell) with a finite downside (decades of having a worse life). The infinitely important issue will always win unless its probability is 0%. (Ignored is the possibility of a rational, atheistic approach to life helping create life-extension medicine that results in immortality.)

A "ruin" problem is, like eternity in hell, a problem with infinite downside.

With Pascal's Wager, one can argue that God's existence shouldn't be assigned any probability. Small probability is a bad way to deal with bad explanations, bad logic, bad reasoning, unanswered criticisms, losing the argument, etc.

With Taleb's ruin problems, there is risk above 0%. They aren't myths or superstitions like God or ghosts. They are conceivable scenarios.

Taleb uses his argument like Pascal's Wager, e.g. "No matter how increased the probability of benefits, ruin as an absorbing barrier, i.e. causing extinction without further recovery, can more than cancels them out." No matter how large the finite benefits, ruin always matters more. (Minor note: Taleb should have written "cancel" not "cancels".)

It's questionable that even the total extinction of humanity, or of all intelligent life in the universe, should be assigned infinite importance rather than just very very large importance. But I'll set that question aside.

There's a simple answer to Taleb. Everything he proposes also risks ruin. There are risks of ruin either way.

Taleb proposes, in short, to slow down industrial and scientific progress. He proposes more poverty for longer. He proposes more people being blind for lack of Golden Rice – and therefore they will be inferior scientists and inventors. He proposes more people dying for lack of food, or ending up in jail for stealing food – which gets in the way of being a philosopher, businessman, economist, etc.

Delays to industrial and scientific progress are risks of "ruin". They delay the time until we're a two planet species (or two solar systems or two galaxies). Every additional day we spend with a single point of failure (one planet) is a risk. Maybe that's the day a meteor, plague, alien invasion or other risk will ruin our planet. We're in a race against ruin. The clock is ticking before the next big meteor or other ruinous threat. The faster we improve our meteor defenses, and our wealth and technology in general, the better position we're in to deal with that ruin risk or any other ruin risk that may come up. There are some dangers that we don't foresee at all; our best defense against the unknown is to have lots of knowledge, lots of control over physical reality, and other general purpose tools and resources.

Slower progress with more poverty and misery is also a ruin risk for the individuals who go blind, starve, die of aging before a technological solution is available, etc.

And greater poverty and misery in the world, with worse science, increases our risk of ruin from violence. Our ruin could come from resentment from people who want Golden Rice and feel (reasonably, IMO, but it's a risk even if they're wrong) that we're oppressing them. Civilization may be destroyed by Islam, China, Russia or some other war. The sooner everyone lives in a much nicer world (paradise by current standards), the lower our risk of war.

Civilization may be destroyed by the spread of bad ideas. The more prosperity is brought by the use of reason (e.g. science), the more people will be impressed and value reason. Accomplishments help persuade people. The sooner the safer.

Perhaps Taleb things the destruction of civilization, and another dark ages, doesn't constitute ruin because one day people may reinvent civilization. But the destruction of civilization could result in extinction. It could involve biological warfare which creates a disease capable of killing us all. It could involve nuclear and chemical warfare which kills so many, and renders so much land uninhabitable, that everyone ends up dying. It could involve new weapons technology. If GMOs could ruin us, surely a violent conflict could where people are trying to cause mass destruction on purpose. If nothing else turns out to be more effective (doubtful, IMO), people could try to create harmful GMOs on purpose as a weapon.

Slower progress isn't safe. Nothing provides any guaranteed safety against ruin. In general, rapid progress is the safest option. The status quo isn't sustainable, as Deutsch explains in the "Unsustainable" chapter of BoI.

I wonder if Taleb tried to think of ruin problems affecting his proposal for the death of more poor non-white children and many other bad outcomes (even if no such thinking made it into the paper). With Guardian headlines like Block on GM rice ‘has cost millions of lives and led to child blindness’, a reasonable person would give serious consideration to not advocating more of that happening. Does it make sense that denying nutritious food to millions is the safe, no-risk option, while using science to improve their lives is the big risk? That's not impossible, intellectually, but one should make a serious effort to think of counter-arguments. But Taleb (in the full paper) didn't. He briefly suggested maybe the downsides of no GMOs are less than some reports because they have other causes which GMOs don't solve. OK but isn't there a risk that no Golden Rice has killed and will kill millions? Nothing he said could reasonably be treated as a reason that risk is zero. So then, did he analyze whether there is any way that that really bad stuff could lead to ruin? No, all he did is say:

Most of the discussions on "saving the poor from starvation" via GMOs miss the fundamental asymmetry shown in 7.

But it's only a fundamental asymmetry if there are no ruin risks associated with having governments forcibly malnourish the poor. But Taleb (and co-authors) didn't consider or analyze that.


What do I think of ruin risks? The short term affects our long term prospects, as I've been explaining, so they generally don't involve such a big difference as Taleb believes. In general, I think the right answer will be good in the short and long term, good in the big and small picture. We can make life good now and in the future instead of needing to make big, awful sacrifices to try to create a better future. Our success and prosperity now is what will lead to and create a good future.


Disclaimer: I don’t regard this as productive intellectual discourse. A reader might get the impression that this is the sort of critical debate which is supposed to take place between thinkers. I don't think so. I don’t think Taleb is making a good-faith or productive contribution to discourse. I don’t regard him as a worthy opponent. I think he acted intellectually irresponsibly, he’s not open to discussion or learning new ideas, and the bad philosophy thinking he’s a part of is one of the world’s big ruin risks. I regard my post as similar to debunking a UFO sighting.


Elliot Temple | Permalink | Messages (8)

David Deutsch and Sarah Fitz-Claridge Publish Misquotes

This post originally focused primarily on Fitz-Claridge, but I found a bunch of scholarship errors, like misquotes, from Deutsch too. For details, see the two updates at the bottom of this post and the comments below the post which share a bunch more research about misquotes. Deutsch's lack of integrity and rationality when it comes to getting quotes right and making his books accurate also provides background context for our current conflict, which has involved Deutsch lying about me regarding a documented, factual matter. His repeated errors in his books help explain how he could make an error like that, and help clarify what kind of person he actually is. (I added this note at the top, and edited the post title, on 2021-06-23 and 2021-06-25. The original title was "Sarah Fitz-Claridge is a Terrible Intellectual".)


Sarah Fitz-Claridge (SFC) co-founded Taking Children Seriously (TCS) with David Deutsch (DD). I found an egregious misquote of Popper on the TCS website. There's no name on the specific page, but I'm familiar enough with TCS to guess that SFC wrote it. In this article, I assume SFC is the author. Regardless, it's on the official TCS website so SFC and DD are both responsible for this error, since they are the founders and they put their names on TCS.

This (falsified) quote of Popper is from "The TCS FAQ" regarding "TCS and Karl Popper" (sources: archive.org and my mirror):

The inductivist or Lamarkian approach operates with the idea of instruction from without, or from the environment. But the critical or Darwinian approach only allows instruction from within - from within the structure itself.

...I contend that there is no such thing as instruction from without the structure. We do not discover new facts or new effects by copying them, or by inferring them inductively from observation, or by any other method of instruction by the environment. We use, rather, the method of trial and the elimination of error. As Ernst Gombrich says, "making comes before matching": the active production of a new trial structure comes before its exposure to eliminating tests."

- pages 7-9, The Myth of the Framework

This quote is bizarrely falsified. I noticed the issue because it says it's from pages 7-9, but it's too short to span three pages. So I checked what Popper actually wrote.

The first paragraph is OK. For the second paragraph, here's the first sentence Popper actually wrote:

In fact, I contend that there is no such thing as instruction from without the structure, or the passive reception of a flow of information that impresses itself on our sense organs.

SFC's ellipsis removed the two words at the start, which is OK. Then where Popper had a comma, SFC changed it to a period with no indication of an edit, which is completely unacceptable. Worse, she then put additional text in the same paragraph which is not in that paragraph in the book. She took some sentences from page 9, from a different section of the book (V not IV), from partway through a completely different paragraph, and stuck them here after half a sentence from from an earlier paragraph which she quoted as being a full sentence.

This isn't even close to how quotes work. You can't just grab quotes from different places in the book and put them together to make a paragraph.

And it's even worse because she presents it as two paragraphs, so it's not like she was leaving out all paragraph breaks. Including a paragraph break makes it even more unexpected that a different paragraph break would be left out. Similarly, she used an ellipsis, which makes it much more surprising and misleading that one is missing somewhere else.

Misquoting seems to be some sort of pattern with SFC and DD. I'm currently working on a video about a misquote in The Beginning of Infinity that I found. SFC and DD are close associates with lots of similarities, e.g. they are both liars.

Immediately after the misquote, SFC writes something else really problematic:

While Popper almost always made such remarks in the context of original discovery rather than learning, the implications for education are inescapable. I should stress that applying Popper's philosophy of science to the growth of knowledge in children applies only when the children are learning science. Our position is much broader, namely that Popper's general idea of how a human being acquires knowledge – by creating it afresh through criticism and the elimination of error – applies equally to non-scientific types of knowledge such as moral knowledge, and to unconscious and inexplicit forms of knowledge. Thus we see ourselves as trying to extend Popperian epistemology into areas where, by its inner logic, it applies, but where Popper himself resolutely refused to apply it.

Popper didn't resolutely refuse to apply his ideas outside of science, nor did he think his theory of knowledge only applied to science. He made this clear repeatedly in many books. He talked about knowledge in contexts like poetry or courts, not just science. Here's an example in Conjectures and Refutations (my italics) where Popper directly says that his theory works for knowledge in general, not just science:

Although I shall confine my discussion to the growth of knowledge in science, my remarks are applicable without much change, I believe, to the growth of pre-scientific knowledge also—that is to say, to the general way in which men, and even animals, acquire new factual knowledge about the world. The method of learning by trial and error—of learning from our mistakes—seems to be fundamentally the same whether it is practised by lower or by higher animals, by chimpanzees or by men of science. My interest is not merely in the theory of scientific knowledge, but rather in the theory of knowledge in general.

Is SFC a liar who wants to praise DD and give him credit for discovering what Popper already published, or did she never actually read much Popper, or did she read it without understanding it? And what's going on with DD putting his name on egregious errors like these?

Also, in the misquote above, SFC showed Popper talking about "instruction" (education), so claiming he didn't know his ideas applied to education is bizarre. Popper also wrote in Unended Quest a quote that SFC and DD both knew about:

I dreamt of one day founding a school in which young people could learn without boredom, and would be stimulated to pose problems and discuss them; a school in which no unwanted answers to unasked questions would have to be listened to; in which one did not study for the sake of passing examinations.

Conjectures and Refutations also says:

Since there were logical reasons behind this procedure [Popper's theory that we learn by conjectures and refutations], I thought that it would apply in the field of science also

In other words, Popper had a general theory of learning first, and then applied it to science. He thought it should apply to everything including science.

And in the preface of The Logic of Scientific Discovery, Popper wrote (italics in original):

The central problem of epistemology has always been and still is the problem of the growth of knowledge. And the growth of knowledge can be studied best by studying the growth of scientific knowledge.

And later in that preface:

Although I agree that scientific knowledge is merely a development of ordinary knowledge or common-sense knowledge, I contend that the most important and most exciting problems of epistemology must remain completely invisible to those who confine themselves to analysing ordinary or common-sense knowledge or its formulation in ordinary language.

Popper wanted to study scientific knowledge in addition to ordinary knowledge, not instead of ordinary knowledge. He thought science made a great example that shouldn't be ignored. But he wasn't trying to figure out how scientists learn things as a special case. He wanted to understand the general issue of the growth of knowledge, and that's what he was trying to explain, and that's what his epistemology does explain. He didn't accidentally create a general-purpose evolutionary epistemology that says we learn by conjectures and refutations or, equivalently, by trial and error. He knew that you can come up with guesses and criticism whether you're doing science or not.

David Deutsch put his name on these errors. And the bizarre claims about Popper inflated his reputation and gave him undeserved credit. It wasn't a random or neutral error; it was heavily biased in his favor.


Update 2021-06-23: "Dec" pointed out that the same misquote is in BoI too (it's slightly different but has the same main error and is also badly wrong). So DD is even more directly responsible for making this error himself.

While I'm updating, DD wrote in BoI:

As the physicist Richard Feynman said, ‘Science is what we have learned about how to keep from fooling ourselves.’

That's a misquote. And I just found another issue. DD wrote in BoI:

As Popper put it, ‘We can let our theories die in our place.’

That's not a full sentence in the original, so that's bad. DD is making it look like a full sentence. The "we" is lowercase in the original.

"Dec" also suggested that I screwed up by not catching the error when I edited BoI. I agree that I could have done better. I was less suspicious then and BoI didn't have the pages 7-9 clue. But I was not a co-author or co-founder of the book, and it was never my job to check for that kind of issue. I helped with the book but I was not paid, I had no official duties or requirements, and the contents of the book are not my responsibility.

In general, I sent DD suggestions and then he decided what to do. The majority of my suggestions were not discussed, so in most cases I don't even know if DD made a change or not. I never went back and compared versions to see which changes he made. The only changes I know he made due to my suggestions are the ones we actually talked about. So you can imagine that I do not feel responsible for the text of the book. I made lots of suggestions that DD didn't take, and most of my suggestions were either small or non-specific (like making a conceptual point but not suggesting exact wording). I didn't write any substantial sections of text in the book. I'm not sure if even one whole sentence of mine is in the book as I wrote it. I did not choose or control what was done with the book.

And I was not tasked with checking sources or doing this sort of research. And I never edited a copy of the book containing both the misquote and the bibliography. DD sent me draft chapters, and then full book drafts, without a bibliography included. He then sent me a bibliography draft after I was done editing, when the book was almost done. He finalized the bibliography at the last minute. Two days after showing me a draft bibliography, he sent me a version that had already been copy-edited, which I did not edit.

The first bibliography draft I saw did not contain In Search of a Better World, which is where Popper wrote "Now we can let our theories die in our place." DD only added that book to the bibliography after I said it had two great chapters and suggested that he read the table of contents and consider it. I'm confident that he didn't know he needed it as a quote source.

And DD misquoted in an article he wrote: https://nautil.us/issue/7/waste/not-merely-the-finest-tv-documentary-series-ever-made

As Karl Popper put it, we humans can “let our ideas die in our place.”

No, Popper wrote "theories" not "ideas". Does DD try to quote Popper from memory!? Why does he use different wordings at different times for the same quote? Why doesn't he copy/paste it out of a book? Something's really wrong here. I'd suggest that, going forward, DD should give a source when presenting a quote. I think he should stop writing books and articles containing quotes without sources. I suggest that no one should trust any quote DD gives, anywhere, unless he gives a source and you check the source yourself. (Be careful with anyone giving an unsourced quote, but especially with people who have a track record of getting quotes wrong like DD does.)

On a related note, in 2011 DD got upset with me for questioning a Godwin quote he sent me in a private email which I couldn't find when searching the book. It turned out that he was quoting the first edition and I was searching the third edition. He hadn't given a specific source. I was right to question it and DD should have praised my scholarship instead of getting upset about being questioned. I guess it makes sense that the kind of person who gets upset about being challenged about quoting would also be the kind of person to make quoting errors. Negative emotional reactions to critical questioning are really bad for error correction.


Update 2, 2021-06-23:

I found another quoting error. The TCS website quoted Popper as writing "Lamarkian" when he actually wrote "Lamarckian". ("ck" not just "k").

I also found the misspelling posted by SFC, and still up today, on her personal website.

That page quotes differently than the TCS page, but also wrong. SFC quotes Popper as writing "flow of information which impresses itself" but in the book he wrote "that" not "which". She just wrote a different word and called it a quote.

And SFC attributes the quote to "The Myth of the Framework, pp. 8-9", but the quote starts on page 7 just like the TCS website said.

Also, DD's associate, Chiara Marletto, misquoted Popper:

https://www.edge.org/conversation/chiara-marletto-on-extinction

As Karl Popper put it, we can "let our ideas die in our place."

No, he wrote "theories" not "ideas".

These people need to learn how quote exactly instead of changing words and other details. If you don't know how to give an exact quote, don't give a quote. Stick to paraphrases until you learn what a quote is and how to do it. There's something really wrong with these people – DD and his associates – who keep making different quoting errors in different places. They aren't just copy/pasting the same error over and over. They keep separately creating different errors.


Elliot Temple | Permalink | Messages (53)

Misquotes by David Deutsch

I’ve discovered that David Deutsch (DD) is an unreliable quoter. His book The Beginning of Infinity (BoI) contains many serious quotation errors, and he has misquoted elsewhere too.

For context, DD and I were close associates for a decade. I helped with BoI for 7 years and wrote over 200 pages of comments, suggestions and edits on drafts of the book. I learned a lot from him but I trusted his scholarship too much. I promoted his books. I was wrong about him and his books in multiple ways. My mistake. I retract my previous endorsements and recommendations of DD’s books. That doesn’t mean the books are awful or shouldn’t be read, but I no longer want to promote them myself. There are good ideas mixed in, but be wary of major problems.

Misquotes in The Beginning of Infinity

Block quotes are from BoI unless otherwise stated.

I think there will certainly not be novelty, say for a thousand years. This thing cannot keep going on so that we are always going to discover more and more new laws. If we do, it will become boring that there are so many levels one underneath the other . . . We are very lucky to live in an age in which we are still making discoveries. It is like the discovery of America – you only discover it once.
The Character of Physical Law (1965)

That’s different than what Feynman wrote. DD changed the words “perpetual novelty” to “novelty”. DD also changed “keep on going” to “keep going on”. (More details.)

Behind it all is surely an idea so simple, so beautiful, that when we grasp it – in a decade, a century, or a millennium – we will all say to each other, how could it have been otherwise?
John Archibald Wheeler, Annals of the New York Academy of Sciences, 480 (1986)

What Wheeler actually wrote was "Behind it all is surely an idea so simple, so beautiful, so compelling that when–in a decade, a century, or a millennium–we grasp it, we will all say to each other, how could it have been otherwise?”. DD deleted “so compelling” and moved “we grasp it” to before the dashed part. (More details.)

As the physicist Richard Feynman said, ‘Science is what we have learned about how to keep from fooling ourselves.’

Feynman didn’t say that. It’s not even a documented quote with some changes. It seems made up with no original source or evidence.

I checked the web and some Feynman books and speeches. It’s likely that the misquote started in 2000 in the article Magical Thinking (my thanks to Justin Mallone for finding that article), which paraphrased Feynman that way without using quote marks or giving a source. Unfortunately, the wording made it sound like it was an actual quote, so I think people started spreading it as a quote. Then DD probably got the misquote from an unreliable webpage and put it in his book without trying to find a primary source or telling his readers which unreliable secondary source he used. There are now two books which give this quote and cite it to as quoted in BoI. There’s also a book which gives the quote with a footnote saying that the author was unable to find a source for the quote (then don’t put it in your book!).

Feynman said some similar ideas in Cargo Cult Science, but the wordings are different. DD didn’t take the quote from there and add one or two errors (like he did with some other quotes, where you can tell that he’s quoting a specific thing incorrectly). It’s too different to have come from that speech.

Popper wrote:

The inductivist or Lamarckian approach operates with the idea of instruction from without, or from the environment. But the critical or Darwinian approach only allows instruction from within – from within the structure itself . . .

I contend that there is no such thing as instruction from without the structure. We do not discover new facts or new effects by copying them, or by inferring them inductively from observation, or by any other method of instruction by the environment. We use, rather, the method of trial and the elimination of error. As Ernst Gombrich says, ‘making comes before matching’: the active production of a new trial structure comes before its exposure to eliminating tests.
The Myth of the Framework

DD ends the first sentence of the second paragraph with “without the structure” and then a period. Instead of a period, Popper had a comma there and continued the sentence. Then, the rest of that paragraph that DD quotes is actually from a different section of the book. DD combined sentences from different places in the book and presented them as one paragraph with no ellipsis or square brackets to indicate a modification.

And DD left out the words “In fact,” before “I contend”. DD also put an ellipsis at the end of the first paragraph when that should be a period. There are no omitted words there. The paragraph ends there and DD continues without skipping a paragraph. DD also left out Popper’s italics.

A similar misquote also appeared on the Taking Children Seriously (TCS) website (mirror). DD co-founded TCS with Sarah Fitz-Claridge and she’s my best guess at the author of that misquote, though it could have been DD. Either way, he has responsibility for what it says on the official website of the movement he co-founded (particularly for pages, like this one, with no author specified).

Judging by the similarities, the misquote in BoI was likely based on the TCS website misquote. Even when a secondary source is accurate, it’s problematic to take a secondary source quote and then edit it without checking the original. When you do that, you’re making edits without knowing the original context and wording, so you aren’t in a good enough position to judge what edits are OK.

(More details about the TCS website version of the misquote.)

Thanks to Dec for telling me that this misquote is also in BoI after I wrote about the version from the TCS website.

As the physicist Stephen Hawking put it, humans are ‘just a chemical scum on the surface of a typical planet that’s in orbit round a typical star on the outskirts of a typical galaxy’.

This quote seems to be made up based on a similar Hawking quote about “chemical scum” from the 1995 TV program (Reality on the Rocks: Beyond Our Ken by Ken Campbell (IMBD, trailer)). Interestingly, DD had quoted it correctly in The Fabric of Reality as “The human race is just a chemical scum on a moderate-sized planet, orbiting round a very average star in the outer suburb of one among a hundred billion galaxies.” I didn’t find the original video, but it’s quoted that way in various places online that aren’t based on DD’s writing. (Some sources have “around” instead of “round”, which is an understandable difference given how similar those words can sound when spoken out loud.)

It seems that DD made up this misquote for his 2005 TED talk and then based the quote in BoI on his talk. Alan Forrester checked the books The large scale structure of space-time, A Brief History of Time, The Grand Design, The Nature of Space and Time and The Universe in a Nutshell, but found that none contain the word “scum”. And I can’t find any online sources for Hawking ever saying the BoI version of the quote (whereas with the The Fabric of Reality version, I easily found other online sources).

This misquote doesn’t seem fully accidental. DD changed the quote to be more elegant and catchy by repeating “typical” three times. I’ve noticed that many of DD’s misquotes involve changing text to sound nicer.

(More details.)

[Horgan believed] that science has the ability to ‘resolve questions’ objectively […]

Horgan actually wrote “Scientists have the ability to pose questions and resolve them in a way that critics, philosophers, historians cannot.” DD changed Horgan’s words “resolve them” to “resolve questions”, which is wrong without using square brackets to indicate an edit. (More details.)

The issue of what exactly needs to be explained in an ‘appearance of design’ was first addressed by the clergyman William Paley, the finest exponent of the argument from design. In 1802, before Darwin was born, he published the following thought experiment in his book Natural Theology.

It’s unclear what, if anything, “appearance of design” is a quote from, but it’d be understandable if a reader believed it was a quote of Paley in Natural Theology. But it’s not in that book.

[Paley wrote:]

The inference we think is inevitable, that the watch must have had a maker . . . There cannot be design without a designer; contrivance without a contriver; order without choice; arrangement without anything capable of arranging; subserviency and relation to a purpose without that which could intend a purpose; means suitable to an end . . . without the end ever having been contemplated or the means accommodated to it. Arrangement, disposition of parts, subserviency of means to an end, relation of instruments to a use imply the presence of intelligence and mind.

DD changed the words “any thing” to the word “anything” and changed “an use” to “a use”. DD also quoted from both chapters 1 and 2, but presented it as single paragraph with ellipses. DD also removed a comma near the end before “imply the presence of intelligence and mind” which helped the reader understand the text. (DD edited other punctuation too, but this punctuation edit stood out to me because it’s significantly worse than the original.) (More details.)

As Hawking once put it, ‘Television sets could come out [of a naked singularity].’

Thanks to Alan Forrester for looking into this quote at my request. He was unable to find Hawking saying this. He searched the web and the following books: The large scale structure of space-time, A Brief History of Time, The Grand Design, The Nature of Space and Time and The Universe in a Nutshell.

As Hofstadter remarked, ‘In retrospect, I am quite amazed at how much genuine intelligence I was willing to accept as somehow having been implanted in the program . . . It is clear that I was willing to accept a huge amount of fluidity as achievable in this day and age simply by putting together a large bag of isolated tricks, kludges and hacks.’

Hofstadter’s actual paragraph ends with “a large bag of isolated tricks-kludges and hacks, as they say.” DD’s punctation edits changed the meaning. Hofstadter said “isolated tricks” and then gave “kludges and hacks” as a rewording of “isolated tricks”. DD changed it to a list of three things, “tricks, kludges and hacks” and made it sound like the modifier “isolated” applies to all three, whereas in the original it applied only to “tricks”. As a list, it means that all three things were put together. In the original, it says they put together tricks, and then provides the additional information that the tricks could be characterized as kludges and hacks as people (informally) say.

Thanks to Dec for bringing up this misquote.

Representative Roger Q. Mills of Texas complained in 1882, ‘I thought . . . that mathematics was a divine science. I thought that mathematics was the only science that spoke to inspiration and was infallible in its utterances [but] here is a new system of mathematics that demonstrates the truth to be false.’

This text is available in the Congressional Record. DD changed the words "by inspiration" to "to inspiration". It’s also misleading that where DD wrote “[but]”, with no ellipsis, he skipped multiple sentences and continued with text from a different paragraph.

DD likely copied this misquote from Fair Representation without telling his readers that he was trusting a secondary source without fact checking it, and without letting readers know which secondary source he was using.

Thanks to Justin Mallone for looking this up at my request.

Before Blackmore and others realized the significance of memes in human evolution, all sorts of root causes had been suggested [...] [T]here is the ‘Machiavellian hypothesis’ that human intelligence evolved in order to predict the behaviour of others, and to fool them. […] Blackmore’s ‘meme machine’ idea, that human brains evolved in order to replicate memes, must be true.

At first I read “Machiavellian hypothesis” as a quote of Blackmore from her book The Meme Machine that DD mentioned earlier and included in his bibliography. If so, it's a misquote. That phrase isn’t in her book.

But maybe “Machiavellian hypothesis” is merely meant to be the name of a hypothesis. If so, it’s the wrong name. The correct name is "Machiavellian Intelligence”, as one can find out from Blackmore’s book or Wikipedia. Blackmore has an index entry for “Machiavellian Intelligence” and cites two books with “Machiavellian Intelligence” in their title. She also writes “An influential version of social theory is the ‘Machiavellian Intelligence’ hypothesis (Byrne and Whiten 1988; Whiten and Byrne 1997).”. It appears that DD read her book, misremembered the name of the hypothesis, didn’t check it, and put quote marks around it. (More details.)

The more important fundamental laws and facts of physical science have all been discovered, and these are now so firmly established that the possibility of their ever being supplanted in consequence of new discoveries is exceedingly remote . . . Our future discoveries must be looked for in the sixth place of decimals.
Albert Michelson, address at the opening of the Ryerson Physical Laboratory, University of Chicago, 1894

The source for this, which DD didn’t specify, is the book Light Waves and Their Uses (1903) by Albert Michelson. The speaker wrote down what he said in his own book. Michelson wrote:

Many other instances might be cited, but these will suffice to justify the statement that "our future discoveries must be looked for in the sixth place of decimals."

DD incorrectly quoted this as Michelson saying “[o]ur future discoveries must be looked for in the sixth place of decimals” himself, when Michelson actually had it in quote marks and talked about that statement. Deleting quote marks within a quote is misquoting. (More details.)

For example, as I wrote in The Fabric of Reality:

Consider one particular copper atom at the tip of the nose of the statue of Sir Winston Churchill that stands in Parliament Square in London. Let me try to explain why that copper atom is there. It is because Churchill served as prime minister in the House of Commons nearby; and because his ideas and leadership contributed to the Allied victory in the Second World War; and because it is customary to honour such people by putting up statues of them; and because bronze, a traditional material for such statues, contains copper, and so on. Thus we explain a low-level physical observation – the presence of a copper atom at a particular location – through extremely high-level theories about emergent phenomena such as ideas, leadership, war and tradition.

There is no reason why there should exist, even in principle, any lower-level explanation of the presence of that copper atom than the one I have just given. Presumably a reductive ‘theory of everything’ would in principle make a low-level prediction of the probability that such a statue will exist, given the condition of (say) the solar system at some earlier date. It would also in principle describe how the statue probably got there. But such descriptions and predictions (wildly infeasible, of course) would explain nothing. They would merely describe the trajectory that each copper atom followed from the copper mine, through the smelter and the sculptor’s studio and so on . . . In fact such a prediction would have to refer to atoms all over the planet, engaged in the complex motion we call the Second World War, among other things. But even if you had the superhuman capacity to follow such lengthy predictions of the copper atom’s being there, you would still not be able to say ‘Ah yes, now I understand why they are there’. [You] would have to inquire into what it was about that configuration of atoms, and those trajectories, that gave them the propensity to deposit a copper atom at this location. Pursuing that inquiry would be a creative task, as discovering new explanations always is. You would have to discover that certain atomic configurations support emergent phenomena such as leadership and war, which are related to one another by high-level explanatory theories. Only when you knew those theories could you understand why that copper atom is where it is.

In addition to checking this using ebooks, I also compared hardback copies of both books. It’s FoR pp. 22-23 and BoI pp. 109-110.

DD quotes “understand why they are there” but the original reads “understand why it is there”. DD changed the words “it is” to “they are”.

DD quotes "Pursuing that inquiry”, but FoR says “this inquiry”. DD changed the word “this” to “that”.

DD quotes “understand why that copper atom is where it is”. DD omitted the word “fully”. The original said “understand fully why”.

DD wrote “[You]” in BoI, which is an incorrect use of square brackets. He skipped two sentences and should have used an ellipsis. And it says “You” in the original, so he shouldn’t put it in square brackets since it isn’t modified. Square brackets can only replace an ellipsis when the text in square brackets replaces/summarizes/paraphrases all the skipped text, but the word “You” doesn’t replace the skipped sentences.

The italics “why” and “what it was” are not italicized in FoR.

The ellipsis DD used in “studio and so on . . . In fact” is incorrect because the original had a period after “so on”. There should be four dots there (one for the period, and three for the ellipsis), not three dots.

DD doesn’t even quote himself accurately.

Other Misquotes

In The Fabric of Reality, DD wrote:

Mystery is part of the very concept of time that we grow up with. St Augustine, for example, said:

What then is time? If no one asks me, I know; if I wish to explain it to one who asks, I know not. (Confessions)

This quote has some word changes compared to the edition of Confessions that I checked. However, there are other English translations, so it could be an accurate quote of one of those. DD didn’t say which translation he used, which is more problematic than usual when quoting a particular translation rather than quoting something with a single, unambiguous wording that could be looked up.

DD wrote in Not Merely the Finest TV Documentary Series Ever Made:

As Karl Popper put it, we humans can “let our ideas die in our place.”

I found Popper saying something similar three times, but he didn’t use that wording. I think DD relies on his memory for this quote, instead of checking a source. He’s quoted it different ways in different places (e.g. with “theories” instead of “ideas” in Why It’s Good To Be Wrong and BoI). DD should get quotes from sources instead of putting quote marks around what he believes he remembers someone writing.

Popper said similar things in The Myth of the Framework (“By criticizing our theories we can let our theories die in our stead.”), In Search of a Better World (“Now we can let our theories die in our place.”), and Natural Selection and the Emergence of Mind (“Let our conjectures, our theories, die in our stead!”).

DD’s associate Chiara Marletto also misquoted Popper as saying "let our ideas die in our place.”.

DD’s associate Sarah Fitz-Claridge misquoted William Godwin and intentionally sanitized a quote about slavery. She gives “The condition of a … slave in the West-Indies, is in many respects preferable to that of the youthful son of a free-born European. The slave is purchased upon a view of mercantile speculation; and, when he has finished his daily portion of labour, his master concerns himself no further about him. But the watchful care of the parent is endless. The youth is never free from the danger of grating interference.”. She misquoted by changing the words "of its grating" to “of grating”. And she sanitized the 1797 quote by changing "negro-slave" into "... slave”. (I think that’s an incorrect use of an ellipsis, too.) Also, the quote is horrible because it downplays how bad slavery was, so it’s disturbing that Fitz-Claridge liked the quote enough to highlight it.

Fitz-Claridge also misquoted The Myth of the Framework. It’s some of the same Popper material misquoted in BoI and on the TCS website, but misquoted differently. This time, Fitz-Claridge changed “that” to “which” and got the page numbers wrong. (More details in the second update.)

Smaller Issues

DD frequently doesn’t give sources for quotes which makes it harder to check their accuracy. By leaving out sources, he’s asking his reader to trust him. But he made many quoting errors, so that trust would be misplaced.

DD repeatedly writes “X … Y” when X and Y are from different paragraphs or even different sections of a book. This is misleading. He also does it when X is a complete sentence, which makes it look like X is not a complete sentence.

DD frequently changes capitalization and punctuation without square brackets to indicate the change. DD capitalizes stuff to make it look like the start of a sentence when it isn’t (both at the start of a quote or after an ellipsis). DD also puts periods inside the quote marks after quoting a partial sentence, which makes it look like that was the end of the sentence when it wasn’t. DD also repeatedly puts a space then an ellipsis after a sentence ends, which should be a period then ellipsis but he changed the period to a space. So he makes stuff look like the start or end of a sentence when it isn’t, and then other times he makes stuff look like it’s not the end of a sentence when it is.

DD doesn’t appear to have a consistent policy for periods going inside or outside of quotes. E.g. I searched an electronic copy of BoI and found 188 instances of a single close quote followed by a period, and 88 instances of a period followed by a single close quote (and 3 instances of period, single close quote, and period again, which all involved a number, ellipsis, close quote, then period). DD often ends quotes with a period inside the quotation marks when the original sentence doesn’t end there, but other times he puts the period outside the quotation marks, and I don’t know why. DD is also inconsistent about italicizing quotes the same way they are in the original.

There are standard guidelines for how to do quotations, which DD violates, in addition to the larger misquote issues I presented above. For example, Working with Quotations, from Suny Empire State College, says:

Remember that when you do choose to use direct quotations, you need to retain the exact wording, spelling, capitalization, and punctuation of the original source.

DD went to both Oxford and Cambridge. I don’t think they teach lower standards than state colleges, and in any case he hasn’t followed their guidelines. For example, this Guide for authors and editors from the Oxford University Press says:

Quoted matter must reflect the original source exactly in spelling, punctuation, and capitalization. Please double-check all quotations against the sources from which you have taken them to ensure that you have copied accurately.

It must be possible for the reader to identify the work from which a quotation has been taken.

The University Of Oxford Style Guide says “Place any punctuation which does not belong to the quote outside the quotation marks (except closing punctuation if the end of the quote is also the end of the sentence).”

The Cambridge Editorial Style Guide says “A full stop is used outside the quotation mark if the quote is only part of a sentence.” and “Always source quotations”.

Taking Credit from Karl Popper

There’s another scholarship issue in DD’s books. I was horrified to discover that Karl Popper’s name is only in The Fabric of Reality (FoR) chapter 3 two times. That chapter is focused on sharing Popper’s ideas. But it doesn’t give adequate credit. In particular, the diagrams (3.1, 3.2, 3.3) are clearly based on Popper’s diagrams in Objective Knowledge, but DD never tells the reader that they’re modified from Popper. (More details.)

DD has presented himself as very humble and modest. He’s claimed multiple times to be only footnotes to Popper (which comes off as exaggerated modesty, rather than convincing his fans that it’s actually true). But DD has simultaneously misled readers to believe he accomplished much more than he did, e.g. in FoR ch. 3. This is a pattern. For example, in a 2016 paper, The logic of experimental tests, particularly of Everettian quantum theory, DD wrote:

An important consequence of this explanatory conception of science is that experimental results consistent with a theory T do not constitute support for T. That is because they are merely explicanda. A new explicandum may make a theory more problematic, but it can never solve existing problems involving a theory (except by making rival theories problematic – see Section 3). The asymmetry between refutation (tentative) and support (non-existent) in scientific methodology is better understood in this way, by regarding theories as explanations, than through Popper's (op. cit.) own argument from the logic of predictions, appealing to what has been called the ‘arrow of modus ponens’. Scientific theories are only approximately modelled as propositions, but they are precisely explanations.

This passage misleads readers into believing that DD improved on Popper by making a better argument focused on explanations instead of on the logic of predictions. Most readers would be surprised to discover that Popper made both arguments. Popper did make the logic of predictions argument (which is less important but was worth making too) but also made the other argument that DD is implying is his own original work. DD made some original contributions to epistemology, but not this one.

You can search Popper’s Conjectures and Refutations (C&R) for words like "tentative", "explanation", and "support" to see that DD is less original than he implies. Popper also covers these issues in other books. I’ll give one example from C&R:

For a scientific theory—an explanatory theory—is, if anything, an attempt to solve a scientific problem, that is to say, a problem concerned or connected with the discovery of an explanation.[6]

This clearly shows that Popper viewed scientific theories as explanatory theories. DD didn’t come up with the idea that scientific theories are explanations. The footnote at the end of that quote refers readers to more of Popper’s writing. Popper talked about explanation often. Popper also came up with the asymmetry between refutation (tentative) and support (non-existent). Popper emphasized refutation, said it was only tentative, and is also the person who challenged thousands of years of philosophical tradition by arguing that support is non-existent. Popper drew multiple major distinctions between negative and positive approaches to epistemology.

DD also gets other people to praise him while he presents himself as humble. For example, his TCS co-founder Sarah Fitz-Claridge (SFC) wrote that Popper invented a philosophy of science and that David Deutsch and his TCS philosophy had extended Popper’s epistemology to apply outside of science. (SFC probably wrote that. It’s on an official TCS page, but doesn’t specify the author, so it could have been written by DD.) That’s a major misrepresentation. Popper was seeking a general theory of knowledge, and said so, and applied it outside of science. (More details.)

DD has gotten his associates to praise him as e.g. having “the greatest mind ever”. SFC believes that DD made major improvements on Popper, and so do many of DD’s fans. I don’t believe it’s an accident that many people overestimate DD in ways similar to his co-founder who publicly promotes him. It looks like a strategy where DD plays humble while having other people say things that would sound arrogant coming from him. (More details.)

In 2012, SFC wrote to the official Fabric of Reality discussion group (archive of FoR posts) (my italics):

In my view it would be much more accurate to say that David has the greatest mind ever to have existed. His thinking is breathtakingly logical and brilliant. His ideas have changed the world and will do so even more profoundly in the future. I have never met anyone more pure, more truth-seeking and more open to criticism than David.

In 2000, SFC wrote to TCS list (my italics):

So really, people should not speak of Popper, but of Deutsch, because it was David who came up with the link between Popper's ideas and educational theory.

Note that DD has a history of secretly ghostwriting stuff which SFC then claims to be the author of. (Source: DD’s friend. He or she was friends with DD before DD turned 18 and they’re still friends now, over 50 years later. He or she had many discussions about TCS, Popper and more with DD and SFC. DD introduced me to the friend and I had some discussions with him or her.) Full disclosure: In the past, I’ve posted a few things that DD wrote, but under my own name, with his permission and approval. I did this when (as best I remember) I wanted to share something good that he told me, which I thought would benefit the world, but he didn’t want to share it himself and wouldn’t let me post it and attribute it to him or to an anonymous person, but he would let me post it under my name without attributing it to anyone. Here’s an example that I remember (I think it was the most significant, memorable instance). More often, I wrote stuff myself that was based on things DD told me, and he didn’t want credit but was happy for me to say it. At other times, DD helped edit my writing and a sentence or two of his ended up in the final version without credit (he didn’t want credit). DD had substantial influence over some of my early writing, and he also has had substantial influence over some of SFC’s writing that he didn’t fully ghostwrite.

Conclusion

I was mistaken about how good DD’s books are. They’re worse than I thought. I still think there is significant value in those books, but you can’t trust DD’s scholarship. Besides distrusting direct quotes given by DD, you should also distrust paraphrases or summaries of what other people said or thought. You have to check things yourself if you actually want to know. DD is too unreliable. And don’t use DD as a secondary source. Don’t spread quotes that DD quoted; quote directly from the original source or don’t use it. Some people are spreading his misquotes (they’ve even been repeated in books).

FYI, I don’t think DD is especially bad at quoting compared to others. Lots of books and academic articles have major errors related to quotes, paraphrases, cites or facts. But for a book to be considered great, it should do better. In the world today, you shouldn’t trust authors with quotes or facts by default. You should be suspicious by default unless an author earns more trust. Many people believe DD has earned a lot of trust (including me in the past), but they’re mistaken.

I apologize for encouraging people to respect and trust DD more than he merits. I know I played a role in that.

DD’s misquote problem also helps contextualize his recent mistreatment of me. How could a super rational, great person act like that? The answer is that he he’s actually a deeply flawed person with some good traits mixed in as special exceptions.

DD once got very upset with me for questioning a Godwin quote he sent me in a private discussion. He’d sent it without a specific source and I couldn’t find the quote by searching the book. It turned out that he’d quoted an obscure first edition but I was searching the third edition. He should have praised me for looking for errors instead of getting defensive and lashing out at me. Good scholars don’t expect to be trusted and don’t mind being questioned or challenged. Even though he didn’t misquote in that instance, DD’s irrational attitude was a warning sign that DD might be a misquoter. I failed to recognize the full problem and I didn’t go fact check his books at that time (2011).

BoI has an errata page (mirror) which documents a bunch of errors in the book. They are mostly factual errors, and the number and severity should concern readers. Despite all the misquotes in the book, there are currently no misquotes on the errata page, which says something about how little fact checking the book has been getting (there are probably a bunch of other errors that no one has found yet).

I will edit my book recommendation articles to warn people about DD’s misquotes. I will also take down the beginningofinfinity.com website that promotes BoI and put a warning there about DD’s misquotes.


Update, 2021-07-12: In a 1985 physics paper in a prestigious, peer-reviewed journal, David Deustch misquoted Alan Turing.

Update, 2021-07-13: I made two videos related to DD misquotes:

Video about the Feynman misquote: "Science is what we have learned about how to keep from fooling ourselves.". This video goes into more depth.

Video about this blog post about DD's misquotes. This video is more of a broad overview.


Elliot Temple | Permalink | Messages (27)

David Deutsch Books Unendorsement

I thought that even though David Deutsch (DD) and his fans were harassing me, his books were still good. But I hadn’t reread them for years. On review, The Beginning of Infinity contains lots of misquotes. DD’s books are a lot worse than I realized. I was horrified to discover how frequently and severely DD misquotes. I trusted DD’s ability to quote accurately and handle details reliably and correctly, but I was wrong.

Also, DD explains too little in his books. They’re too hard to learn effectively from because he doesn’t give enough depth or detail. I had trouble seeing this in the past because I had many conversations with DD which filled in the gaps for me. But even when DD’s books say something important, he often doesn’t provide enough information for a reasonable, smart person to understand it well.

DD’s books have some good parts mixed in, but, due to the serious flaws, I retract my recommendation of them. I no longer want to actively promote them.

I’m sorry. I should have caught the misquotes earlier. I was capable of finding those errors years ago. I found and wrote about other similar errors.

I was giving DD space after he left the community. I guessed (I think accurately) that he wanted to be left alone by me and I was trying to respect his wishes. I mostly stayed away from him and his work after he left. I thought continuing to recommend his books was safe, but I was wrong about that.

I only started my video series about BoI after I gave up on DD leaving me alone. I caught the Feynman misquote in chapter 1 when I first reread it for the videos. BoI misquotes Feynman:

As the physicist Richard Feynman said, ‘Science is what we have learned about how to keep from fooling ourselves.’

Then, due to the harassment, I was reviewing old information and found a Popper misquote on an old TCS webpage. Someone (“Dec”) saw my post and told me that the same Popper quote was in BoI too. That made two misquotes in BoI, which was a possible pattern. That led to checking more quotes, which led to discovering that there are tons of misquotes in BoI.

It seems that no other readers of BoI have noticed the misquoting problem yet (the errata page has factual errors but no misquotes), which I think is important information about the world. Regardless, I should have done better.

Read about the misquotes.


Elliot Temple | Permalink | Messages (0)

Elliot Temple | Permalink | Messages (0)

Deutsch Misquoted Turing

David Deutsch (DD) wrote in Quantum theory, the Church-Turing principle and the universal quantum computer (1985), p. 3:

Church (1936) and Turing (1936) conjectured ... This is called the ‘Church-Turing hypothesis’; according to Turing,

Every ‘function which would naturally be regarded as computable’ can be computed by the universal Turing machine. (1.1)

And from Deutsch's references (p. 19):

Turing, A. M. 1936 Proc. Lond. math. Soc. Ser. 2, 442, 230.

Now we'll compare with Turing's paper: On Computable Numbers, With An Application To The Entscheidungsproblem (1936), p. 230:

the computable numbers include all numbers which could naturally be regarded as computable.

Turing wrote "numbers", but DD misquoted that as "function". Turing also wrote "could" which DD misquoted as "would".

I double checked using two other copies of Turing's paper. (One and two.)

There's also a problem because Deutsch uses what appears to be an italicized block quote. You'd expect the whole block quote to be a quote of Turing, but instead it's a paraphrase. Inside the paraphrase are quotation marks surrounding the misquote of Turing that I criticized.

DD's citation is also incorrect. DD cites Turing's paper to volume 442 of the Proceedings of the London Mathematical Society, but it was actually in volume 42 not 442.

To determine what's correct, we can check how Turing himself cites it. In a correction to his paper, Turing cited himself:

Proc. London Math. Soc. (2), 42 (1936-7), 230-265.

You can also get the correct cite, with volume 42, from the Stanford Encyclopedia of Philosophy or from Wikipedia.

You can also see that the latest volume of the journal, published in 2021, is volume 122. Volume 442 is unlikely to exist for over 100 more years. And the journal's website has archives showing that the Turing article was in volume 42.

Tangentially, I hope this lowers your opinion of academic peer review. DD's paper was published in Proceedings of the Royal Society of London, a prestigious and peer-reviewed journal that started in around 1830. It has published work from many famous scientists.


Thanks to Dec for finding this misquote.

Note that DD has published a lot of misquotes.


Update 2021-07-15: Dec pointed out that a similar Turing misquote is in DD's book The Fabric of Reality:

He [Turing] conjectured that this repertoire consisted precisely of ‘every function that would naturally be regarded as computable’.

No, Turing wrote "all numbers which could" not "every function that would".

It appears that DD got this misquote from his own paper, and also modified it. There's a recurring pattern where every time DD touches a quote, there's a significant chance that he changes something. Here, he took the word "every" which was outside of quote marks in his paper and moved it inside quote marks for his book.


Update 2021-09-14: I contacted the academic publisher (proceedings of the royal society). They looked into the matter and said:

Apologies for the delay in getting back to you on this. A board member has had a look at the paper and does not think the misquote affects the outcome of the research presented in the paper. Although the error in the refences is unfortunate, we do not believe it will prevent readers from finding the correct article. Given the age of the paper we therefore do not think any further action is necessary.

I have several criticisms of this response.

They agree with me that DD misquoted and miscited.

Why won't they put up errata on their website? Is that too hard for them (they are bad at websites?) or do they actually not want to?

Errata serves several purposes. Academics working in the field could find out about the issue. People debating the issue could also refer to it – it would e.g. let a student whose professor repeated the error borrow the journal's authority to correct the professor. It's risky to correct your professor in general, but much easier with an official errata to point him to.

Is correcting professors a real issue? I think so because professors have been teaching Deutsch's error (there are some examples posted in the comments below). And they've been doing it out of context. In other words, even if the error did not affect the conclusion of Deutsch's paper, it still can affect other conclusions about other issues. So spreading the error matters, and it has in fact been taught in schools. Also, any reader of the paper may remember the Turing quote and use it for something else, and it may negatively affect the conclusion of their usage, even if it didn't affect the conclusion of Deutsch's paper. (Admittedly, some of the professors don't cite a source and might have been getting the error from Deutsch's book The Fabric of Reality where he repeated a similar error. But the fact that Deutsch put roughly the same error in his book is, IMO, an additional reason to errata it and at least do a little bit to stop the spread of the error.)

If they published an errata or other note about the error, they could also state their reasons for why they believe the paper's conclusion is unaffected. Other people could consider that reasoning and potentially disagree. This could be an area for critical thinking and truth seeking rather than an unaccountable authority pronouncing judgment for secret reasons. Even if it's no big deal in this case, their general attitude is concerning. How many other judgments do they make with no transparency? What is the nature of those judgments? Are any of those judgments mistaken? Do they gloss over many errors in papers they published? Could they be doing that partly out of bias and not wanting to draw attention to their own involvement in errors?

People expect academic science journals with peer review to have high standards and to be really picky about errors. They are not living up to this reputation. So much for their unlimited interest in truth for the sake of truth or whatever they were supposed to be doing.

They are still sharing the paper electronically and could update it there. Deutsch is still alive and available and could actually write or approve a small update, or they could do an update which is labelled as written by a journal editor not Deutsch.

How did this error happen? How did every step of the publishing process miss it? Did anyone intentionally cause or allow the error? Were any biases involved? They did no post mortem, no root cause analysis, no investigation into their peer review and editorial process, etc.

There are major causes for concern here. This errors calls into question how effective their reviewers and editors are. It also calls into question Deutsch's integrity. Maybe it was an accident but they have given no account of how it could have happened accidentally nor asked him to give one.

Do peer reviewers or editors not check quotes or cites? Should they? How widespread a problem is misquoting? How many other misquote reports do they receive, validate as correct criticism, and then bury? Might they be hiding a pattern revealing that many papers contain misquotes? Instead of hiding misquotes should they be doing something different like e.g. paying people enough money for misquote reports to make finding the misquotes worth the time and effort? If they actually wanted to find out about misquotes, and find out how big a problem it is, wouldn't they do something more like that? They could have responded to me by offering me money to find more misquotes since I've proven I can do it. That seems reasonable if they were better and more interesting in correcting errors.

Deutsch had an argument with a referree which was related to the text Deutsch misquoted:

http://www.daviddeutsch.org.uk/wp-content/uploads/2018/03/MathematiciansMisconception.pdf

But I soon found out that not everyone saw it that way. I also had referee problems. The referee of the paper in which I presented that proof insisted that Turing’s phrase “would naturally be regarded as computable” referred to mathematical naturalness – mathematical intuition – not nature.

(BTW, as a first impression, without reading Turing's paper or investigating the issue, I agree with the referree. When talking about naturally regarding something, that sounds like it's talking about what is natural or intuitive to people and their opinions, not about nature, due to what the key word "regard" means.)

Could Deutsch have intentionally misquoted in order to help win a specific logical point he was arguing about with the reviewer? Could the horrible, misleading presentation of the quote (as a block quote with an internal quote – which btw has tricked some people into thinking the whole thing is a quote) have been some kinda compromise worked out between Deutsch and the peer reviewer? Was the misquote in earlier drafts of the paper? Do they have records of what changes were made to the paper during peer review? In any case, there is some possible motive here for Deutsch falsifying the quote on purpose or just being biased and more careless in his own favor. Deutsch has a history of repeated misquotes throughout his career and most of them favor him in some way and I don't recall any that were bad for him, so it seems like whatever's going on involves bias if not actual deliberate, fully-conscious misquoting.

Seriously, how do wording errors in quotes happen accidentally? I understand typoing a letter or two when typing a quote in from a paper book or journal. But how do you just change the word? That seems more like Deutsch quotes stuff from memory – and his memory is biased in his favor (or there's selection bias – if he likes the version he remembers then he uses it, but if it's not ideal then he looks up the exact wording). Quoting from memory in your books and papers (and scripted speeches) is a serious scholarship violation that should lead to repercussions and major reputational damage. That's totally unacceptable. Another possibility, which there have also been potential indicators for, is that Deutsch changes quotes during his editing process without double checking the original. I suspect Deutsch thinks certain minor changes to quotes are OK, and maybe this somehow escalates to more major wording changes after multiple editing passes. Deutsch's editing could be like the game "telephone" where you whisper something to the guy next to you, who whispers it to the next guy, and so on. The goal is to repeat exactly what you heard. After something has been whispered a dozen times, often all the words are different and the meaning is totally changed.

In my experience, people are often willing to view things as "an accident" or "a mistake" without thinking about how exactly it happened. Some mistakes are simple like a one letter typo happening because you pressed the wrong keyboard key by accident because your finger dexterity is good but imperfect so occasionally you hit the wrong key (and then you usually notice and fix the typo, but not always). But many errors don't have such simple explanations and merit actual analysis. Changing the word "numbers" to "function" is not a typo due to flawed finger dexterity. That's bias, misremembering (while incorrectly believing quoting from memory is OK), intentionally falsifying the quote, or perhaps a horribly unreasonable editing processes that edits words within quotes similarly to how it edits words that are not within quotes. Or there are other possibilities like maybe a peer reviewer or editor caused the error and Deutsch didn't have full control over the final wording of his paper.

And how did the journal miss the error? Was it anyone's job to catch the error? Would the journal like to catch such errors in the future? And how did the error remain unnoticed in the archives for decades? Do they have a tiny readership? Do their readers not care about errors? Do their readers fail to report errors? Do their readers report errors but nothing is done? Would it make sense to hire people to review the archives for errors or should they focus on catching more errors before publication or should they just continue to not even post errata about errors and pretend nothing happened?

For more info, see my reply email to the journal:

https://curi.us/2477-academic-journals-are-unreasonable


Elliot Temple | Permalink | Messages (15)

Ayn Rand Lexicon Quote Checking

In The Ayn Rand Lexicon (book not website), Harry Binswanger wrote in the Honesty section:

Self-esteem is reliance on one’s power to think. It cannot be replaced by one’s power to deceive. The self-confidence of a scientist and the self-confidence of a con man are not interchangeable states, and do not come from the same psychological universe. The success of a man who deals with reality augments his self-confidence. The success of a con man augments his panic.

The intellectual con man has only one defense against panic: the momentary relief he finds by succeeding at further and further frauds.
[“The Comprachicos,” NL, 181.]  

The words, book and page number are correct, but the quote is from "The Age of Envy" not "The Comprachicos".

In the self-esteem section, Binswanger gives the correct cite for part of the same quote:

Self-esteem is reliance on one’s power to think. It cannot be replaced by one’s power to deceive. The self-confidence of a scientist and the self-confidence of a con man are not interchangeable states, and do not come from the same psychological universe. The success of a man who deals with reality augments his self-confidence. The success of a con man augments his panic.
[“The Age of Envy,” NL, 181.]

Justin Mallone found this error and I checked it myself too. I asked him to look into Lexicon quoting accuracy after I found multiple citation errors on the Lexicon website that weren't in the book. This is the only error he found in the book. He did find citation and formatting errors on the website. None of the errors, even on the website, are wording errors. (Note there's a second website for the Lexicon. I compared the "Automatization" page and the only difference I found was whether there were spaces around dashes or not.)

I checked 4 quotes originally and Justin checked 16 more. So the book had 1 partial citation error in 20 quotes, but the website had 5 errors in 20 quotes (counting at most one error per quote). The wordings seem to be reliable, unlike in The Beginning of Infinity, and the Lexicon book seems to be pretty reliable. It seems like a serious effort went into getting details right for the book, but the process of creating the website was sloppier and introduced many small errors.

Even the Lexicon website is much better than David Deutsch's use of quotations in The Beginning of Infinity. Deutsch frequently doesn't give sources, makes frequent changes to wordings (with no indicator of any change), changes punctuation too, and uses ellipses and square brackets incorrectly. Even worse, several of the quotes appear to be made up.


Elliot Temple | Permalink | Message (1)

Bad SEP Scholarship

The Stanford Encyclopedia of Philosophy article on Epistemology says:

others regard credences as metaphysically reducible to beliefs about probabilities (see Byrne in Brewer & Byrne 2005),

You would expect the cited source to discuss credences, metaphysics, reduction, or probabilities. It does not.

As the title, introduction and ending all make clear, Perception and Conceptual Content is about perception.

Even if it briefly mentioned the topic SEP cited it for somewhere (I didn't read all the words), the cite would still be unreasonable because SEP would be citing it for just one small part but didn't specify a particular page, quote or section. In that scenario, there would be no reasonable way to find or determine what the cite refers to.

This large error is revealing about the scholarship standards not only at the SEP but in academia in general.


Update 2021-08-21:

I emailed the authors of the article about this error when I posted this criticism, and I quickly received this response from Ram Neta:

Thanks!

I don’t know how that citation was introduced into the article, since Byrne’s paper was just published this year. Let me see if the SEP editors will let me fix this.

Sent from my iPhone

Errors are sometimes introduced by other people besides the author, but that doesn't stop them from being published or widespread :/ I'm not sure that that's what's going on here, though. See below.

And he's not even sure if the SEP editors will allow the error to be fixed! What is wrong with their publishing process!?

So, I see that the SEP article says:

First published Wed Dec 14, 2005; substantive revision Sat Apr 11, 2020

So it was revised last year, but not this year. Was Byrne's paper just published this year as claimed? That would be unexpected given the cite says it was published in 2005:

(see Byrne in Brewer & Byrne 2005)

And the bibliography has:

Brewer, Bill and Alex Byrne, 2005, “Does Perceptual Experience Have Conceptual Content?”, CDE-1: 217–250 (chapter 8). Includes:
Brewer, Bill, “Perceptual Experience Has Conceptual Content”, CDE-1: 217–230.
Byrne, Alex, “Perception and Conceptual Content”, CDE-1: 231–250.

I see that the Byrne paper has a bunch of cites, but none are from later than 2004.

Looking more, I found the book it was published in, by reading the note at the start of the SEP article bibliography:

The abbreviations CDE-1 and CDE-2 refer to Steup & Sosa 2005 and Steup, Turri, & Sosa 2013, respectively.

So the book is Contemporary Debates in Epistemology 1st Edition, which was published in 2005. And one of the authors of CDE, Steup, is also an author of the SEP article. Using "Look Inside" on the hardcover version on Amazon, I can see the table of contents and confirm that the Byrne article is in the book.

I also found that the Byrne article, in CDE-1, was in the bibliography of the SEP article in 2007:

https://web.archive.org/web/20070609171028/https://plato.stanford.edu/entries/epistemology/index.html

However, in that version of the SEP article, Byrne only comes up in the bibliography, not the text. Looking at more archived versions, I see that "(see Byrne in Brewer & Byrne 2005)" was there in May 2020 but not in Dec 2019. In Dec 2019, the word "credence" wasn't present at all in the SEP article and Neta Ram was not yet a co-author and wasn't cited at all. Steup was the only author listed then. Then in 2020, when a major revision happened, "credence" was added to the page 21 times and "Neta" was added 11 times. It seems like Steup was probably the author in 2005 and cited himself a lot. Then Neta probably did the update, added a bunch of stuff about credences, and added a bunch of cites to himself.

The full sentence with the cite error is:

The latter dispute is especially active in recent years, with some epistemologists regarding beliefs as metaphysically reducible to high credences,[5] while others regard credences as metaphysically reducible to beliefs about probabilities (see Byrne in Brewer & Byrne 2005), and still others regard beliefs and credences as related but distinct phenomena (see Kaplan 1996, Neta 2008).

You can see a new neta cite was added here in addition to the mistaken Byrne cite which goes to a source that had already been in the bibliography for 15 years and was not published this year as claimed. Maybe Byrne came out with a different paper in 2021 about credences and Neta cited the wrong paper because it was already in the bibliography? You might think that doesn't work because how would Neta have been trying to cite a 2021 paper back in 2020, as Neta pointed out in his email to me. But I found that Byrne did have a 2021 paper, but according to Google Scholar it was available online in 2019. That's not unusual. Academics often publish papers online before in print.

So it looks to me like the error was probably Neta's fault despite his attempt to deflect blame. Especially considering he was careless enough that he didn't seem to read my whole email, which was quite short, but did contain the quote "Byrne 2005" and somehow he writes back to tell me Byrne's paper was from 2021 (ignoring the 2005 cite) and that therefore he couldn't have even tried to cite it so he doesn't know what happenend, suggesting he was never trying to cite Byrne there. But he did intend to cite Byrne and was too quick to disown that while carelessly forgetting that papers get prepublished and not trying to investigate what actually happened as I did above.

Link for Byrne's paper being published in 2021: https://onlinelibrary.wiley.com/doi/10.1111/phpr.12768

And the online version I found with Google Scholar which says it's from 2019: https://philarchive.org/archive/BYRPAP-2v1

It seems like Neta rushed to reply to my email and deflect blame, and to move on without any real post mortem or investigation, and made careless statements to me, while under no actual time pressure to reply immediately. I hadn't even told him my negative blog post existed. For reference, here is the full email I wrote to Neta (also sent to Steup):

Subject: Error in SEP Epistemology article

You wrote:

https://plato.stanford.edu/entries/epistemology/index.html

others regard credences as metaphysically reducible to beliefs about probabilities (see Byrne in Brewer & Byrne 2005),

The Byrne text you cite is here:

https://web.mit.edu/abyrne/www/percepandconcepcontent.pdf

It doesn’t contain the strings “credence”, “credal”, “meta”, or “reduc”. The two instances of “proba” are not discussions of probabilities. I hope you’ll appreciate being informed about the error.

Anyway, given the careless email reply to me, you can imagine how careless citation errors get into his work. In this case, it seems like he wanted to cite a Byrne paper and then used the cite already in the bibliography even though the year was over a decade off and the title was totally different. So I can figure out what he did and what happened, but he can't or won't? You may then wonder how and why SEP chose this guy. I wonder that too. I suspect it'd be very hard to get a transparent answer from SEP and that, on a related note, the answer would be damning.

Oh and it gets way worse. The 2021 Byrne paper is relevant but the cite says:

others regard credences as metaphysically reducible to beliefs about probabilities (see Byrne in Brewer & Byrne 2005),

But Byrne doesn't think credences reduce to beliefs. He writes e.g.:

the solution—to adapt a phrase from Quine and Goodman—is to renounce credences altogether.

Those are the last words of the introduction.

A reduction in the other direction, of credence to belief, seems hopeless from the start: as was pointed out, to have credence .6 in p is not to believe anything.

and

Granted that neither credence nor belief can be reduced to the other, there is an immediate problem

and

That leaves belief monism, the thesis of this paper: “there are no such things as credences”

So in addition to citing the wrong paper because he's careless and probably shouldn't be an academic ... and answering my email incorrectly because he's careless and probably shouldn't be an academic ... the paper he intended to cite blatantly contradicts his paraphrase of it.


Update 2, 2021-08-21:

I replied by email to Neta, left Steup CCed, and added Byrne to the CC list. I again used a factual, understated style and tone. Neta replied, keeping them CCed, to say

Helpful, thanks!

Sent from my iPhone

So on the one hand it could be worse. On the other hand, he's fully failing to acknowledge how much he screwed up, that it has any significant meaning, or that I did anything special that goes beyond minor help from a random guy to an expert. He's acting kinda like I reported a typo. And that's after I find layers of error in his writing and also his initial email to me was wrong.

I don't intend to reply to Neta's response. Here's a copy what I emailed:

Ram Neta, based on your comments, I looked into it more. I think what happened is this:

Steup put the 2005 Byrne article, Perception and Conceptual Content, in the bibliography, but it wasn’t cited in the text.

In 2020, you wanted to cite Byrne’s 2021 article, Perception and Probability, which you have indicated familiarity with. That was possible because it had been available online since 2019 at https://philarchive.org/archive/BYRPAP-2v1

You accidentally cited the Byrne article that was already in the bibliography instead of the new one.

The new article is on the right topic but contradicts your statements about it. You characterize Byrne’s position like this:

regard credences as metaphysically reducible to beliefs about probabilities

But what Byrne actually says is:

the solution ... is to renounce credences altogether.

and

A reduction in the other direction, of credence to belief, seems hopeless from the start: as was pointed out, to have credence .6 in p is not to believe anything.

and

Granted that neither credence nor belief can be reduced to the other, there is an immediate problem

and

That leaves belief monism, the thesis of this paper: “there are no such things as credences”

So Byrne does not believe that credences reduce to probability beliefs.

I wonder if it could be defamation to publish, in the SEP, lies about what philosophical positions a rival philosopher from another school of thought believes and published... Imagine publishing in the SEP that Ayn Rand was a Marxist!

BTW, speaking of carelessness, Neta's CV says "ENTERIES IN REFERENCE WORKS". That isn't how you spell "entries", so maybe he's a well-suited person to have any of those.

I think a lot of people don't read what they cite, but do they not even skim it, keyword search it, read the introduction/abstract, or glance at the conclusion?


Update 3, 2021-08-21:

Alex Byrne replied:

Ram, I cannot cast the first stone -- I am sure I have made many more mistakes of this sort myself. Possibly you had not realized how implausible my view is. Elliot, thanks very much for pointing this out. (The paper appeared in PPR, by the way -- I should update the philpapers entry.)

best
Alex


Update 4, 2021-08-22:

Ram Neta wrote:

Thanks Alex: I actually never read your paper, I only recall the version you delivered at Rutgers, and that we talked about on the train afterwards. I’ll read the paper now, since obviously my memory is not to be trusted!

Sent from my iPhone

I guess that answers the thing I was wondering about yesterday: can't read or won't read? This was more of a won't/don't read – he didn't actually read the paper and then egregiously misunderstand it. I'm also not seeing signs that he misuses an assistant to create errors. I think reading something and then citing it months or years later without rereading happens too and leads to errors. I think a lot of these people are bad at skimming and text search, so they rely on memory too much. Like Neta could have web searched to find the paper he wanted to cite, and glanced at it, instead of relying on his inaccurate memories of an IRL talk. But he didn't and just thought citing to a paper based on memories of a talk is acceptable scholarly practice. And that kinda standard is OK with his university, the journals that publish him, and with the SEP.

Regarding sharing these emails: I'm just a random stranger to them, I did nothing to schmooze, establish rapport, or act friendly. All I did was tell him he was badly wrong, twice, without flaming or volunteering my opinion of him, what I think he should do about the error, or what I think the error says about him, SEP and academia. They also (I presume) made the choice not to look me up – my signature had a link and I'm easy to find with web search too. That the author of the emails I sent would have a blog – and even would blog about the errors – should not be very surprising.

I think the world should know what academia is like. It's not really hidden but it's not exactly shared either. It's kinda an open secret for people in the know, but a lot of laymen don't realize it.

They are social climbers. Neta got to write a SEP article and added tons of cites to himself, and also added cites for people he likes or wants to network with. He doesn't remember Byrne's philosophical positions but does remember meeting him IRL and sharing a train ride and a chat. Byrne has an MIT job. So he wanted to give Byrne a cite to strengthen the social connection. Cites are favors used for social networking. Not always but often.

I know Neta is admitting too much because he's not on the defensive. This is common with social climbers. They're two-faced. They try to recognize safe situations to be candid, and other situations to be guarded. They say different things on different occassions. But they're often pretty careless about it and bad at it. Too bad. It reminds me of what people will admit about how bad their romantic relationships are when they aren't defensive or guarded – but if it's a debate their tune and tone change, and they become biased and dishonest, and try to say stuff to benefit their side instead of seeking the truth objectively.


Elliot Temple | Permalink | Messages (2)

Academic Journals Are Unreasonable

I wrote the below email to the Proceedings of the Royal Society (academic journal) as a followup to the issue of Deutsch misquoting Turing. They agreed that Deutsch's quote and citation were both inaccurate, but didn't want to do anything, even post an errata, on the basis that the errors didn't affect the paper's conclusion.


Thanks for getting back to me. I have a few remaining concerns.

The quote in question was related to a disagreement when the paper was first published. Deutsch said:

http://www.daviddeutsch.org.uk/wp-content/uploads/2018/03/MathematiciansMisconception.pdf

I also had referee problems. The referee of the paper in which I presented that proof insisted that Turing’s phrase “would naturally be regarded as computable” referred to mathematical naturalness – mathematical intuition – not nature. And so what I had proved wasn’t Turing’s conjecture.

I wonder what processes were in place – from both Deutsch and referees – that could still miss that it’s a misquote, with an incorrect cite, while actively debating what that exact phrase means. That specific part of the paper got particular attention and the error was somehow missed anyway. Or perhaps the debate over that quote caused edits which introduced the error (I wonder if there are still records of what changes were made during the review process?). I suspect there’s a systems, processes and policies problem somewhere that could be improved.

Turing’s actual words being significantly different (Deutsch changed “numbers” to “function” but those are different concepts) has a meaningful chance to matter to the debate they had over what Turing meant. And Deutsch seems to agree with the referee that that debate matters to what Deutsch had and hadn’t proved, to his conclusion.

I don’t think a wording change like that can easily be explained as a random error, like a typo. I think a root cause analysis would be worthwhile, including e.g. asking Deutsch how he thinks the error happened. There could have been quoting from memory, changing quotes during editing passes, intentionally changing it to better address the referee’s objections, a change made by the referee himself (I don’t know if they are able to change any words), or something else. It’s hard to speculate but could be investigated since there are no obvious answers that make what happened reasonable. I think the results of looking into this would be relevant to many other papers at your journal and others. I’ve found that misquotes are widespread throughout the academic (and non-academic) worlds.

Also, even if the conclusion of this paper is unchanged, I think an errata would be appropriate because people have been spreading the error and using the misquote for other purposes. It's been taught to students in university courses[1]. In general, people read trusted sources like your journal, remember some parts, and then reuse stuff for other purposes. An error that doesn’t matter in one context often does matter in another context. Posting an errata on your website would help with this ongoing problem.

I also think it’d be reasonable to, along with the errata, publicly share the reasoning that the error doesn’t matter to Deutsch’s conclusion so that other people can judge for themselves.

[1] Here is an example of a Stanford course spreading the error: https://cs269q.stanford.edu/lectures/lecture1.pdf


Elliot Temple | Permalink | Messages (0)

Finding Errors in The Case Against Education by Bryan Caplan

I proposed a game on the Effective Altruism forum where people submit texts to me and I find three errors. I wrote this for that game. This is a duplicate of my EA post.

Introduction

I'm no fan of university nor academia, so I do partly agree with The Case Against Education by Bryan Caplan. I do think social climbing is a major aspect of university. (It's not just status signalling. There's also e.g. social networking.)

I'm assuming you can electronically search the book to read additional context for quotes if you want to.

Error One

For a single individual, education pays.

You only need to find one job. Spending even a year on a difficult job search, convincing one employer to give you a chance, can easily beat spending four years at university and paying tuition. If you do well at that job and get a few years of work experience, getting another job in the same industry is usually much easier.

So I disagree that education pays, under the signalling model, for a single individual. I think a difficult job search is typically more efficient than university.

This works in some industries, like software, better than others. Caplan made a universal claim so there's no need to debate how many industries this is viable in.

Another option is starting a company. That's a lot of work, but it can still easily be a better option than going to university just so you can get hired.

Suppose, as a simple model, that 99% of jobs hire based on signalling and 1% don't. If lots of people stop going to university, there's a big problem. But if you individually don't go, you can get one of the 1% of non-signalling jobs. Whereas if 3% of the population skipped university and competed for 1% of the jobs, a lot of those people would have a rough time. (McDonalds doesn't hire cashiers based on signalling – or at least not the same kind of signalling – so imagine we're only considering good jobs in certain industries so the 1% non-signalling jobs model becomes more realistic.)

When they calculate the selfish (or “private”) return to education, they focus on one benefit—the education premium—and two costs—tuition and foregone earnings.[4]

I've been reading chapter 5 trying to figure out if Caplan ever considers alternatives to university besides just entering the job market in the standard way. This is a hint that he doesn't.

Foregone earnings are not a cost of going to university. They are a benefit that should be added on to some, but not all, alternatives to university. Then univeristy should be compared to alternatives for how much benefit it gives. When doing that comparison, you should not subtract income available in some alternatives from the benefit of university. Doing that subtraction only makes sense and works out OK if you're only considering two options: university or get a job earlier. When there are only two options, taking a benfit from one and instead subtracting it from the other as an opportunity cost doesn't change the mathematical result.

See also Capitalism: A Treatise on Economics by George Reisman (one of the students of Ludwig von Mises) which criticizes opportunity costs:

Contemporary economics, in contrast, continually ignores the vital connection of income and cost with the receipt and outlay of money. It does so insofar as it propounds the doctrines of “imputed income” and “opportunity cost.”[26] The doctrine of imputed income openly and systematically avows that the absence of a cost constitutes income. The doctrine of opportunity cost, on the other hand, holds that the absence of an income constitutes a cost. Contemporary economics thus deals in nonexistent incomes and costs, which it treats as though they existed. Its formula is that money not spent is money earned, and that money not earned is money spent.

That's from the section "Critique of the Concept of Imputed Income" which is followed by the section "Critique of the Opportunity-Cost Doctrine". The book explains its point in more detail than this quote. I highly recommend Reisman's whole book to anyone who cares about economics.

Risk: I looked for discussion of alternatives besides university or entering the job market early, such as a higher effort job search or starting a business. I didn't find it, but I haven't read most of the book so I could have missed it. I primarily looked in chapter 5.

Error Two

The answer would tilt, naturally, if you had to sing Mary Poppins on a full-price Disney cruise. Unless you already planned to take this vacation, you presumably value the cruise less than the fare. Say you value the $2,000 cruise at only $800. Now, to capture the 0.1% premium, you have to fork over three hours of your time plus the $1,200 difference between the cost of the cruise and the value of the vacation.

(Bold added to quote.)

The full cost of the cruise is not just the fare. It's also the time cost of going on the cruise. It's very easy to value the cruise experience at more than the ticket price, but still not go, because you'd rather vacation somewhere else or stay home and write your book.

BTW, Caplan is certainly familiar with time costs in general (see e.g. the last sentence quoted).

Error Three

Laymen cringe when economists use a single metric—rate of return—to evaluate bonds, home insulation, and college. Hasn’t anyone ever told them money isn’t everything! The superficial response: Economists are by no means the only folks who picture education as an investment. Look at students. The Higher Education Research Institute has questioned college freshmen about their goals since the 1970s. The vast majority is openly careerist and materialist. In 2012, almost 90% called “being able to get a better job” a “very important” or “essential” reason to go to college. Being “very well-off financially” (over 80%) and “making more money” (about 75%) are almost as popular. Less than half say the same about “developing a meaningful philosophy of life.”[2] These results are especially striking because humans exaggerate their idealism and downplay their selfishness.[3] Students probably prize worldly success even more than they admit.

(Bold added.)

First, minor point, some economists have that kind of perspective about rate of return. Not all of them.

And I sympathize with the laymen. You should consider whether you want to go to university. Will you enjoy your time there? Future income isn't all that matters. Money is nice but it doesn't really buy happiness. People should think about what they want to do with their lives, in realistic ways that take money into account, but which don't focus exclusively on money. In the final quoted sentence he mentions that students (on average) probably "prize worldly success even more than they admit". I agree, but I think some of those students are making a mistake and will end up unhappy as a result. Lots of people focus their goals too much on money and never figure out how to be happy (also they end up unhappy if they don't get a bunch of money, which is a risk).

But here's the more concrete error: The survey does not actually show that students view education in terms of economic returns only. It doesn't show that students agree with Caplan.

The issue, highlighted in the first sentence, is "economists use a single metric—rate of return". Do students agree with that? In other words, do students use a single metric? A survey where e.g. 90% of them care about that metric does not mean they use it exclusively. They care about many metrics, not a single one. Caplan immediately admits that so I don't even have to look the study up. He says 'Less than half [of students surveyed] say the same [very important or essential reason to go to university] about “developing a meaningful philosophy of life.”' Let's assume less than half means a third. Caplan tries to present this like the study is backing him up and showing how students agree with him. But a third disagreeing with him on a single metric is a ton of disaagreement. If they surveyed 50 things, and 40 aren't about money, and just 10% of students thought each of those 40 mattered, then maybe around zero students would agree with Caplan about only the single metric being important (the answers aren't independent so you can't just use math to estimate this scenario btw).

Bonus Error

Self-help gurus tend to take the selfish point of view for granted. Policy wonks tend to take the social point of view for granted. Which viewpoint—selfish or social—is “correct”? Tough question. Instead of taking sides, the next two chapters sift through the evidence from both perspectives—and let the reader pick the right balance between looking out for number one and making the world a better place.

This neglects to consider the classical liberal view (which I believe, and which an economist ought to be familiar with) of the harmony of (rational) interests of society and the individual. There is no necessary conflict or tradeoff here. (I searched the whole book for "conflict", "harmony", "interests" and "classical" but didn't find this covered elsewhere.)

I do think errors of omission are important but I still didn't want to count this as one of my three errors. I was trying to find somewhat more concrete errors than just not talking about something important and relevant.

Bonus Error Two

The deeper response to laymen’s critique, though, is that economists are well aware money isn’t everything—and have an official solution. Namely: count everything people care about. The trick: For every benefit, ponder, “How much would I pay to obtain it?”

This doesn't work because lots of things people care about are incommensurable. They're in different dimensions that you can't convert between. I wrote about the general issue of taking into account multiple dimensions at once at https://forum.effectivealtruism.org/posts/K8Jvw7xjRxQz8jKgE/multi-factor-decision-making-math

A different way to look at it is that the value of X in money is wildly variable by context, not a stable number. Also how much people would pay to obtain something is wildly variable by how much money they have, not a stable number.

Potential Error

If university education correlates with higher income, that doesn't mean it causes higher income. Maybe people who are likely to get high incomes are more likely to go to university. There are also some other correlation isn't causation counter-arguments that could be made. Is this addressed in the book? I didn't find it, but I didn't look nearly enough to know whether it's covered. Actually I barely read anything about his claims that university results in higher income, which I assume are at least partly based on correlation data, but I didn't really check. So I don't know if there's an error here but I wanted to mention it. If I were to read the book more, this is something I'd look into.

Screen Recording

Want to see me look through the book and write this post? I recorded my process with sporadic verbal commentary:

https://www.youtube.com/watch?v=BQ70qzRG61Y


Elliot Temple | Permalink | Messages (0)

Critiquing an Axiology Article about Repugnant Conclusions

I proposed a game on the Effective Altruism forum where people submit texts to me and I find three errors. I wrote this for that game. This is a duplicate of my EA post. I criticize Minimalist extended very repugnant conclusions are the least repugnant by Teo Ajantaival.

Error One

Archimedean views (“Quantity can always substitute for quality”)

Let us look at comparable XVRCs for Archimedean views. (Archimedean views roughly say that “quantity can always substitute for quality”, such that, for example, a sufficient number of minor pains can always be added up to be worse than a single instance of extreme pain.)

It's ambiguous/confusing about whether by "quality" you mean different quantity sizes, as in your example (substitution between small pains and a big pain), or you actually mean qualitatively different things (e.g. substitution between pain and the thrill of skydiving).

Is the claim that 3 1lb steaks can always substitute for 1 3lb steak, or that 3 1lb pork chops can always substitute for 1 ~3lb steak? (Maybe more or less if pork is valued less or more than steak.)

The point appears to be about whether multiple things can be added together for a total value or not – can a ton of small wins ever make up for a big win? In that case, don't use the word "quality" to refer to a big win, because it invokes concepts like a qualitative difference rather than a quantitative difference.

I thought it was probably about whether a group of small things could substitute for a bigger thing but then later I read:

Lexical views deny that “quantity can always substitute for quality”; instead, they assign categorical priority to some qualities relative to others.

This seems to be about qualitative differences: some types/kinds/categories have priority over others. Pork is not the same thing as steak. Maybe steak has priority and having no steak can't be made up for with a million pork chops. This is a different issue. Whether qualitative differences exist and matter and are strict is one issue, and whether many small quantities can add together to equal a large quantity is a separate issue (though the issues are related in some ways). So I think there's some confusion or lack of clarity about this.

I didn't read linked material to try to clarify matters, except to notice that this linked paper abstract doesn't use the word "quality". I think, for this issue, the article should stand on its own OK rather than rely on supplemental literature to clarify this.

Actually, I looked again while editing, and I've now noticed that in the full paper (as linked to and hosted by PhilPapers, the same site as before), the abstract text is totally different and does use the word "quality". What is going on!? PhilPapers is broken? Also this paper, despite using the word "quality" in the abstract once (and twice in the references), does not use that word in the body, so I guess it doesn't clarify the ambiguity I was bringing up, at least not directly.

Error Two

This is a strong point in favor of minimalist views over offsetting views in population axiology, regardless of one’s theory of aggregation.

I suspect you're using an offsetting view in epistemology when making this statement concluding against offsetting views in axiology. My guess is you don't know you're doing this or see the connection between the issues.

I take a "strong point in favor" to refer to the following basic model:

We have a bunch of ideas to evaluate, compare, choose between, etc.

Each idea has points in favor and points against.

We weight and sum the points for each idea.

We look at which idea has the highest overall score and favor that.

This is an offsetting model where points in favor of an idea can offset points against that same idea. Also, in some sense, points in favor of an idea offset points in favor of rival ideas.

I think offsetting views are wrong, in both epistemology and axiology, and there's overlap in the reasons for why they're wrong, so it's problematic (though not necessarily wrong) to favor them in one field while rejecting them in another field.

Error Three

The article jumps into details without enough framing about why this matters. This is understandable for a part 4, but on the other hand you chose to link me to this rather than to part 1 and you wrote:

Every part of this series builds on the previous parts, but can also be read independently.

Since the article is supposed to be readable independently, then the article should have explained why this matters in order to work well independently.

A related issue is I think the article is mostly discussing details in a specific subfield that is confused and doesn't particularly matter – the field's premises should be challenged instead.

And another related issue is the lack of any consideration of win/win approaches, discussion of whether there are inherent conflicts of interest between rational people, etc. A lot of the article topics are related to political philosophy issues (like classical liberalism's social harmony vs. Marxism's class warfare) that have already been debated a bunch, and it'd make sense to connect claims and viewpoints to that the existing knowledge. I think imagining societies with different agents with different amounts of utility or suffering, fully out of context of imagining any particular type of society, or design or organization or guiding principles of society, is not very productive or meaningful, so it's no wonder it's gotten bogged down in abstract concerns like the very repugnant conclusion stuff with no sign of any actually useful conclusions coming up.

This is not the sort of error I primarily wanted to point out. However, the article does a lot of literature summarizing instead of making its own claims. So I noticed some errors in the summarized ideas but that's different than errors in the articles. To point out errors in an article itself, when its summarizing other ideas, I'd have to point out that it has inaccurately summarized the ideas. That requires reading the cites and comparing them to the summaries. Which I don't think would be especially useful/valuable to do. Sometimes people summarize stuff they agree with, so criticizing the content works OK. But here a lot of it was summarizing stuff the author and I both disagree with, in order to criticize it, which doesn't provide many potential targets for criticism. So that's why I went ahead and made some more indirect criticism (and included more than one point) for the third error.

But I'd suggest that @Teo Ajantaival watch my screen recording (below) which has a bunch of commentary and feedback on the article. I expect some of it will be useful and some of the criticisms I make will be relevant to him. He could maybe pick out some things I said and recognize them as criticisms of ideas he holds, whereas sometimes it was hard for me to tell what he believes because he was just summarizing other people's ideas. (When looking for criticism, consider if I'm right, does it mean you're wrong? If so, then it's a claim by me about an error, even if I'm actually mistaken.) My guess is I said some things that would work as better error claims than some of the three I actually used, but I don't know which things they are. Also, I think if we were to debate, discussing the underlying premises, and whether this sub-field even matters, would acutally be more important than discussing within-field details, so it's a good thing to bring up. I think my disagreement with the niche that the article is working within is actually more important than some of the within-niche issues.

Offsetting and Repugnance

This section is about something @Teo Ajantaival also disagrees with, so it's not an error by him. It could possibly be an error of omission if he sees this as a good point that he didn't know but would have wanted to think of but didn't. To me it looks pretty important and relevant, and problematic to just ignore like there's no issue here.

If offsetting actually works – if you're a true believer in offsetting – then you should not find the very repugnant scenario to be repugnant at all.

I'll illustrate with a comparison. I am, like most people, to a reasonable approximation, a true believer in offsetting for money. That is, $100 in my bank account fully offsets $100 of credit card debt that I will pay off before there are any interest charges. There do exist people who say credit cards are evil and you shouldn't have one even if you pay it off in full every month, but I am not one of those people. I don't think debt is very repugnant when it's offset by assets like cash.

And similarly, spreading out the assets doesn't particularly matter. A billion bank accounts with a dollar each, ignoring some adminstrative hassle details, are just as good as one bank account with a billion dollars. That money can offset a million dollars of credit card debt just fine despite being spread out.

If you really think offsetting works, then you shouldn't find it repugnant to have some negatives that are offset. If you find it repugnant, you disagree with offsetting in that case.

I disagree with offsetting suffering – one person being happy does not simply cancel out someone else being victimized – and I figure most people also disagree with suffering offsetting. I also disagree with offsetting in epistemology. Money, as a fungible commodity, is something where offsetting works especially well. Similarly, offsetting would work well for barrels of oil of a standard size and quality, although oil is harder to transport than money so location matters more.

Bonus Error by Upvoters

At a glance (I haven't read it yet as I write this section), the article looks high effort. It has ~22 upvoters but no comments, no feedback, no hints about how to get feedback next time, no engagement with its ideas. I think that's really problematic and says something bad about the community and upvoting norms. I talk about this more at the beginning of my screen recording.

Update after reading the article: I can see some more potential reasons the article got no engagement (too specialized, too hard to read if you aren't familiar with the field, not enough introductory framing of why this matters) but someone could have at least said that. Upvoting is actually misleading feedback if you have problems like that with the article.

Bonus Literature on Maximizing or Minimizing Moral Values

https://www.curi.us/1169-morality

This article, by me, is about maximizing squirrels as a moral value, and more generally about there being a lot of actions and values which are largely independent of your goal. So if it was minimizing squirrels or maximizing bison, most of the conclusions are the same.

I commented on this some in my screen recorded after the upvoters criticism, maybe 20min in.

Bonus Comments on Offsetting

(This section was written before the three errors, one of which ended up being related to this.)

Offsetting views are problematic in epistemology too, not just morality/axiology. I've been complaining about them for years. There's a huge, widespread issue where people basically ignore criticism – don't engage with it and don't give counter-arguments or solutions to the problems it raises – because it's easier to go get a bunch more positive points elsewhere to offset the criticism. Or if they already think their idea already has a ton of positive points and a significant lead, then they can basically ignore criticism without even doing anything. I commented on this verbally around 25min into the screen recording.

Screen Recording

I recorded my screen and talked while creating this. The recording has a lot of commentary that isn't written down in this post.

https://www.youtube.com/watch?v=d2T2OPSCBi4


Elliot Temple | Permalink | Messages (0)

Criticizing "Against the singularity hypothesis"

I proposed a game on the Effective Altruism forum where people submit texts to me and I find three errors. I wrote this for that game. This is a duplicate of my EA post. I criticize Against the singularity hypothesis by David Thorstad.

Introduction

FYI, I disagree with the singularity hypothesis, but primarily due to epistemology, which isn't even discussed in this article.

Error One

As low-hanging fruit is plucked, good ideas become harder to find (Bloom et al. 2020; Kortum 1997; Gordon 2016). Research productivity, understood as the amount of research input needed to produce a fixed output, falls with each subsequent discovery.

By way of illustration, the number of FDA-approved drugs per billion dollars of inflation-adjusted research expenditure decreased from over forty drugs per billion in the 1950s to less than one drug per billion in the 2000s (Scannell et al. 2012). And in the twenty years from 1971 to 1991, inflation-adjusted agricultural research expenditures in developed nations rose by over sixty percent, yet growth in crop yields per acre dropped by fifteen percent (Alston et al. 2000). The problem was not that researchers became lazy, poorly educated or overpaid. It was rather that good ideas became harder to find.

There are many other reasons for drug research progress to slow down. The healthcare industry, as well as science in general (see e.g. the replication crisis), are really broken, and some of the problems are newer. Also maybe they're putting a bunch of work into updates to existing drugs instead of new drugs.

Similarly, decreasing crop yield growths (in other words, yields are still increasing but by lower percentages) could have many other causes. And also decreasing crop yields are a different thing than a decrease in the number of new agricultural ideas that researchers come up with – it's not even the right quantity to measure to make his point. It's a proxy for the actual thing his argument relies on, and he makes no attempt to consider how good or bad of a proxy it is, and I can easily think of some reasons it wouldn't be a very good proxy.

The comment about researchers not becoming lazy, poorly educated or overpaid is an unargued assertion.

So these are bad arguments which shouldn't convince us of the author's conclusion.

Error Two

Could the problem of improving artificial agents be an exception to the rule of diminishing research productivity? That is unlikely.

Asserting something is unlikely isn't an argument. His followup is to bring up Moore's law potentially ending, not to give an actual argument.

As with the drug and agricultural research, his points are bad because singularity claims are not based on extrapolating patterns from current data, but rather on conceptual reasoning. He didn't even claim his opponents were doing that in the section formulating their position, and my pre-existing understanding of their views is they use conceptual arguments not extrapolating from existing data/patterns (there is no existing data about AGI to extrapolate from, so they use speculative arguments, which is OK).

Error Three

one cause of diminishing research productivity is the difficulty of maintaining large knowledge stocks (Jones 2009), a problem at which artificial agents excel.

You can't just assume that AGIs will be anything like current software including "AI" software like AlphaGo. You have to consider what an AGI would be like before you can even know if it'd be especially good at this or not. If the goal with AGI is in some sense to make a machine with human-like thinking, then maybe it will end up with some of the weaknesses of humans too. You can't just assume it won't. You have to envision what an AGI would be like, or what many different things it might be like that would work (narrow it down to various categories and rule some things out) before you consider the traits it'd have.

Put another way, in MIRI's conception, wouldn't mind design space include both AGIs that are good or bad at this particular category of task?

Error Four

It is an unalterable mathematical fact that an algorithm can run no more quickly than its slowest component. If nine-tenths of the component processes can be sped up, but the remaining processes cannot, then the algorithm can only be made ten times faster. This creates the opportunity for bottlenecks unless every single process can be sped up at once.

This is wrong due to "at once" at the end. It'd be fine without that. You could speed up 9 out of 10 parts, then speed up the 10th part a minute later. You don't have to speed everything up at once. I know it's just two extra words but it doesn't make sense when you stop and think about it, so I think it's important. How did it seem to make sense to the author? What was he thinking? What process created this error? This is the kind of error that's good to post mortem. (It doesn't look like any sort of typo; I think it's actually based on some sort of thought process about the topic.)

Error Five

Section 3.2 doesn't even try to consider any specific type of research an AGI would be doing and claim that good ideas would get harder to find for that and thereby slow down singularity-relevant progress.

Similarly, section 3.3 doesn't try to propose a specific bottleneck and explain how it'd get in the way of the singularity. He does bring up one specific type of algorithm – search – but doesn't say why search speed would be a constraint on reaching the singularity. Whether exponential search speed progress is needed depends on specific models of how the hardware and/or software are improving and what they're doing.

There's also a general lack of acknowledgement of, or engagement with, counter-arguments that I can easily imagine pro-singularity people making (e.g. responding to the good ideas getting harder to find point by saying some stuff about mind design space containing plenty of minds that are powerful enough for a singularity with a discontinuity, even if progress slows down later as it approaches some fundamental limits). Similarly, maybe there is something super powerful in mind design space that doesn't rely on super fast search. Whether there is, or not, seems hard to analyze, but this paper doesn't even try. (The way I'd approach it myself is indirectly via epistemology first.)

Error Six

Section 2 mixes Formulating the singularity hypothesis (the section title) with other activities. This is confusing and biasing, because we don't get to read about what the singularity hypothesis is without the author's objections and dislikes mixed in. The section is also vague on some key points (mentioned in my screen recording) such as what an order of magnitude of intelligence is.

Examples:

Sustained exponential growth is a very strong growth assumption

Here he's mixing explaining the other side's view with setting it up to attack it (as requiring a super high evidential burden due to such strong claims). He's not talking from the other side's perspective, trying to present it how they would present it (positively); he's instead focusing on highlighting traits he dislikes.

A number of commentators have raised doubts about the cogency of the concept of general intelligence (Nunn 2012; Prinz 2012), or the likelihood of artificial systems acquiring meaningful levels of general intelligence (Dreyfus 2012; Lucas 1964; Plotnitsky 2012). I have some sympathy for these worries.[4]

This isn't formulating the singularity hypothesis. It's about ways of opposing it.

These are strong claims, and they should require a correspondingly strong argument to ground them. In Section 3, I give five reasons to be skeptical of the singularity hypothesis’ growth claims.

Again this doesn't fit the section it's in.

Padding

Section 3 opens with some restatements of material from section 2 which was also in the introduction some. And look at this repetitiveness (my bolds):

Near the bottom of page 7 begins section 3.2:

3.2 Good ideas become harder to find

Below that we read:

As low-hanging fruit is plucked, good ideas become harder to find

Page 8 near the top:

It was rather that good ideas became harder to find.

Later in that paragraph:

As good ideas became harder to find

Also, page 11:

as time goes on ideas for further improvement will become harder to find.

Page 17

As time goes on ideas for further improvement will become harder to find.

Amount Read

I read to the end of section 3.3 then briefly skimmed the rest.

Screen Recording

I recorded my screen and made verbal comments while writing this:

https://www.youtube.com/watch?v=T1Wu-086frA


Update: Thorstad replied and I wrote a followup post in response: Credentialed Intellectuals Support Misquoting


Elliot Temple | Permalink | Messages (0)

Credentialed Intellectuals Support Misquoting

Summary: I criticize David Thorstad's reply to me regarding his citation errors. I summarize his supporters' credentials as evidence about problems with academia, think tanks, and the world’s current thought leaders. There's a serious problem with scholarship standards, including misquoting, among credentialed intellectuals.

Introduction

In Criticizing "Against the singularity hypothesis", I criticized the content of David Thorstad's paper. In Checking Citations from David Thorstad, I criticized quoting and citation errors in the same paper. Thorstad tweeted replies about the quoting and citation issues but didn't reply to the criticisms of his ideas.

For context, Thorstad has a philosophy PhD from Harvard and works at an Oxford think tank (source). The main reason I’m writing this is because I think it reveals a lot about what kind of world and intellectual climate we live in.

The reason I wrote about Thorstad initially was because I let people at the Effective Altruism forum submit literature (that they liked a lot) to me for criticism. I checked three quotations and their citations from the paper partly because some people at the Effective Altruism forum denied that misquotes were a widespread or common problem.

Thorstad’s Tweets

Thorstad wrote four initial tweets in a row, plus one tweet replying to a supporter.

"Is Thorstad just one bad thinker" because ... I made two typos and said one word people don't like. Seriously? https://criticalfallibilism.com/checking-citations-from-david-thorstad/

This is a misquote. It suggests that I called Thorstad a bad thinker because of three criticisms which are mischaracterized (straw manned) as two typos and a disliked word.

Here’s what I actually wrote:

Is Thorstad just one bad thinker, while most intellectuals do better? Should we blame Thorstad personally? I don’t think so. Based on doing this kind of thing many times, I think Thorstad’s mistakes are pretty normal. There’s a widespread problem related to intellectual culture and norms. The attitudes of many people need to change, not the actions of a few.

Reading Thorstad, if you figured out that I was writing a question (which isn’t very clear), you’d think my answer to the question was yes. But it wasn’t. My answer was no. I said Thorstad is not “just one bad thinker”, but Thorstad is misleading his audience to believe that I claimed Thorstad is just one bad thinker.

Thorstad misquoted my article that pointed out his misquoting problem, and this misquote substantially changed the meaning of what I said. What I was actually saying is that Thorstad’s errors are representative and illustrative of what many other scholars are like. I was denying that the problem is Thorstad personally.

I also didn’t accuse Thorstad of making two typos and saying one disliked word. That’s an egregious mischaracterization. I accused him of making three errors related to quotes and citations. I didn’t say any of the errors were typos and I didn’t think any of the errors could be explained away as merely typos.

The disliked word comment is vague but I think Thorstad means that the paper noted something, but he said they “lamented” it. As the lead in to a quote, that misrepresented the meaning of the quote. The people Thorstad was talking about expressed themselves using a neutral word. Thorstad misrepresented their neutral writing as highly negative. Thorstad is welcome to form his own opinion, but not to speak for others and abuse quotations to mislead readers about what they said.

Back to quoting Thorstad tweets:

Correction, one mistake. The year on Good isn't wrong: https://www.sciencedirect.com/science/article/abs/pii/S0065245808604180

Here, Thorstad is reiterating his error about the year that Good’s paper was published. It was 1965, but Thorstad mistakenly cited it as 1966. (This is one of the errors he mischaracterized as a typo earlier. But if he’d merely made a typo, he wouldn’t still be defending 1966 as the correct year.)

Instead of learning from my correction, Thorstad has refused to change his mind. He still thinks it’s 1966. Why? He found a modern source that says 1966 and cherrypicked that information. It looks like he really wanted to be right and get me back for accusing him of making errors, so instead of doing unbiased research to find the truth, he just found the first thing he could that backed him up and then he claimed he was right all along. (Or maybe, rather than it being bias, he just doesn’t know how to do effective research on an issue like this.) I don’t think he noticed the text “Copyright © 1965” on the page he linked, which is a hint that 1966 might be an error.

It’s contradictory to, at the same time, claim it’s not a big deal but also be defensive enough to incorrectly claim your error was actually true. If it doesn’t matter, why go find some false information to try to defend yourself with?

How can we settle this issue definitively? Previously I linked a scan of an old reprint showing the date 1965. I thought that was convincing but apparently Thorstad didn’t. I didn’t expect this point to actually be disputed or I would have given more evidence. It’s pretty easy to do a better job of looking it up now that there’s a dispute.

The Internet Archive scanned the original document. It says 1965 on the title page.

It’s one thing to make a factual mistake. It’s much worse to refuse a correction and reiterate the mistake. Even if the original mistake wasn’t a big deal, Thorstad’s reaction to it matters.

Wait a moment ... my "typo" was correcting a grammar error someone else made and not writing [sic] like a jerk!?

What is “typo” a quote of? If it’s me, it’s a misquote. If it’s of himself in his earlier tweet where he wrote “typos”, that’s odd and unclear. It seems like he’s saying that I accused him of making a typo, and using quote marks, but I didn’t say that.

This writing is ambiguous. By “and not” does Thorstad mean “without” or “instead of”?

If Thorstad means “without”, then he’s wrong. You use [sic] when you don’t make edits to fix typos, not when you do.

If Thorstad means “instead of”, then he’s presenting a false alternative. He could have made the correction using square brackets or he could have given the exact quote without writing [sic]. Those were both reasonable alternatives. His choices weren’t just using [sic] or stealth editing a quote.

Also, writing [sic] is fine and doesn’t make one a jerk. [sic] is a scholarly tool used as part of literal, accurate quoting. Having a negative attitude towards using [sic] shows a bad attitude towards quotation literalness and accuracy.

Thorstad seems to be implying/confessing that he edited the quote intentionally. He’s denying it was a typo, or in other words denying it was an accident. I believe intentionally editing quotes (without using one of the few allowed exceptions or properly indicating the edit) is an ethics violation that is against the honor codes at many universities. I actually think the written rules about quotes and cites are often reasonable. The existence of those rules is then sometimes used to deny there’s a problem with intellectual culture. Surely whatever the rules say to do is what most people do, right? Sadly, no. Systemic reform is needed so that most intellectuals actually want to follow those rules and value them instead of considering them overly pedantic.

I didn’t think it was just an accidental typo. I thought it was due to some sort of bad attitude or other problem with Thorstad’s ideas. Thorstad has confirmed that I was right.

@curi42. Sad face.

I appreciate that Thorstad tagged me. Without a notification, I wouldn’t have seen these tweets.

I don’t appreciate the “Sad face” comment, which I read as unserious and mean. There are many similar comments – in terms of both style and content – in the replies to Thorstad.

As context for Thorstad’s fifth tweet, Dan Carey replied to Thorstad:

Odd for them to be so nit-picky about citations. This is from their criticism of your piece. Arn't all of these ideas addressed explicitly in Bloom et al (2020) which u cite in their quote of u right above?

I’ve left out an uncropped phone screenshot showing mostly the Error One section of my Criticizing "Against the singularity hypothesis”. Thorstad wrote back agreeing with Carey:

I know, right? I cite my sources like a normal person

Calling me an abnormal person is a social insult. One of its purposes is to pressure me to increase my conformity. Instead of arguing that his way of using citations is good or criticizing my way, Thorstad instead calls his way normal. But calling something normal isn’t a rational argument that it’s good. And I already said Thorstad is normal in my article! He doesn’t seem to comprehend that I’m criticizing something I consider normal instead of trying to fit in and be normal myself.

My article made statements like “I think Thorstad’s mistakes are pretty normal”. My point was that there’s a widespread problem with intellectual culture, not a problem with Thorstad individually. I was saying that what’s currently normal is problematic and should be reformed. In that context, Thorstad asserted something is normal and assumed that makes it good, which is the logical fallacy called begging the question (which basically means assuming a conclusion about one of the points currently under debate, like you don’t understand that it’s being disputed).

Carey’s and Thorstad’s claim is factually false. My points in that section are not “all” addressed “explicitly” in Bloom et al (hereafter just Bloom). I’ll give one example. I said “The healthcare industry, as well as science in general (see e.g. the replication crisis), are really broken”. I text searched the Bloom paper for “crisis” and “replic” but found no discussion of the replication crisis to address my argument. I also skimmed but didn’t see it covered.

Also, even if Bloom had “explicitly” addressed “all” my points – which they didn’t – there was no way to know that from Thorstad’s writing. Thorstad cited Bloom as one of three sources for the claim “As low-hanging fruit is plucked, good ideas become harder to find”. Thorstad provided no information about Bloom addressing specific counter-arguments to a claim (about healthcare research productivity) that Thorstad brought up in a later paragraph with a different citation. In general, you need to repeat a citation each time you use it for a different purpose or else give some kind of explanatory comments.

The Credentials of Thorstad’s Audience

Intellectuals commonly tweet with their real names and state their credentials and employer in their public profiles. I want to review their credentials to show what kind of people make or side with scholarship errors. I’m leaving out their names and refutations of what they said, but if any of them wants to debate me, I can elaborate.

First I’ll share credentials of people who wrote reply tweets. None of their tweets were significantly better than Thorstad’s tweets that I analyzed above. They generally seemed similar to Thorstad although some were worse.

There’s a PhD student at the philosophy department of the London School of Economics (which was founded by Karl Popper), a grantmaker in global priorities research and international policy at Longview who has a philosophy PhD from Rutgers, an assistant professor of philosophy at University of Sheffield who is a fellow-in-residence at a Harvard center, a Ph.D. student at Pardee RAND, an associate professor at University of Pennsylvania, an employee at OpenAI and a PhD student at Oxford.

Second, here are some credentials from people who clicked the like button on Thorstad’s tweets. There’s a Harvard medical doctor PhD student, a University of Minnesota philosophy professor, an executive research coordinator at Rethink Priorities, a philosophy professor who wrote a book, a professor of mathematical statistics, two AGI safety researchers, a philosopher working at Rutgers with a PhD from Ohio State, a philosopher of science at University of Groningen, and a philosopher with a PhD from Cambridge. There’s also a philosopher at University of Bristol, whose name I recognize because he wrote a Bayesian textbook that I’ve looked at. I was trying to find a book explaining Bayesian epistemology premises and reasoning in a way I could engage in debate with, but it wasn’t suitable.

(I gathered these credentials a few months ago. Some could have changed before publication.)

Thorstad Reinforced My Point

Thorstad and the people who replied to his tweets reinforced my point (and they seem unaware of this). My point was that many scholars are OK with misquoting, which is an example of how intellectual culture in general is broken and should be reformed. The people tweeting all seem to think misquoting isn’t a big deal, and that people (like me) who consider it a big deal should be shunned. So they are examples for my claim.

The typical response I get when I criticize misquoting in general is being ignored or being told that everyone already agrees with me that misquotes are bad so there’s no point in talking about it. But the typical responses I get when I criticize specific examples of misquoting are hatred, denials that misquotes matter, etc. I’ve written various things about this including Misquoting and Scholarship Norms at EA and EA Misquoting Discussion Summary.

Rather than say his mistakes were accidents, Thorstad reiterated them. He didn’t retract his inaccurate “lamented” paraphrase. He repeated his false claim that 1966 was the true publication year. He ignored the issue that he changed the type of quotation marks used within a quote. And he implied that he edited the Chalmers quote on purpose, not as an accidental typo, because he thinks that correctly using [sic] makes one a jerk. Thorstad also agreed with a commenter falsely claiming that Bloom had answered all my arguments about a particular issue already.

Who has bad attitudes to scholarship including low standards for quotation accuracy? A lot of the problem is PhD students and people who already have PhDs. These tweeters and the people who like the tweets are (not exclusively) a bunch of graduate students, professors and think tank employees. Many of them went to or work at good universities. Thorstad got his PhD at Harvard and works at Oxford.

In articles like Ignoring “Small” Errors, EA Should Raise Its Standards and “Small” Errors, Frauds and Violences, I explained my view that dismissing errors as “small” can result in large problems like incorrect conclusions. In general, you can’t actually judge which errors are large or important until after you find solutions. In retrospect, you can see how much work they were to solve and how much difference the solution makes. But before you understand the issue, you don’t know how big a deal it is.

Also, I don’t think all small or picky points matter. I say an error is a reason an idea will fail for a goal (that someone involved has). I just think some particular errors, like misquotes, matter to goals like having productive discussions. Lots of “little” errors in discussions add up to the current, widespread problem of most discussions becoming inconclusive messes. I think higher standards for some fairly objective issues like quotation and citation accuracy (as well as logic, reading comprehension, factual accuracy and using arguments instead of insults) is relatively easily achievable and would actually help a lot.

I’m aware that some people will respond to this article by thinking I’m even more unreasonably pedantic than they thought before. I wrote this anyway because I disagree and I think I’m commenting on some important, widespread social-intellectual problems that are making society, philosophy and science worse.

Conclusion

I wrote about how misquotes and citation errors are a widespread problem. The response – primarily from credentialed intellectuals – was basically to mock me for caring about details like those. In other words, people agreed with my position that many intellectuals, like them, think inaccurate quotes and citations are OK. Credentialed intellectuals aren’t even close to as rational as the general public views them as. This is one of the factors making it really difficult to have productive discussions about intellectual issues.

While it may be tempting for many academics (who aren’t Thorstad’s Twitter buddies) to place the blame on Thorstad, I believe it’s a widespread issue and Thorstad is merely a typical example. I’ve seen similar attitudes in many other places, and I’ve failed to find better attitudes anywhere. If you know of a group with better attitudes, please tell me.

Do you disagree? I’m open to organized, serious debate following explicit methods and aimed at reaching conclusions. See my debate policy.


Elliot Temple | Permalink | Messages (0)