ProPublica is a Pulitzer Prize-winning investigative newsroom. Sign up for The Big Story newsletter to receive stories like this one in your inbox.
One reason we love the news business is that things seldom turn out as expected. In the 2020 elections, the voting process went surprisingly smoothly, with record numbers of Americans casting their ballots in new ways. The big failure of 2020, it turned out, was the political polling, which was so wrong in so many places that some people are now arguing that it’s time to spend a lot less effort trying to divine how people will vote.
I think that argument misses the point. Polls have their uses, particularly when they are used to assess broad questions about what’s on voters’ minds or which issues resonated the most. They seem much less reliable in predicting the future, and that’s OK. It means that we have to treat politics more like other subjects, in which we draw on data, interviews and our past experiences to shape coverage. The rise of the pollster as seer of all matters political is a relatively recent development, a corrective to an era when the “boys on the bus” covered politics largely by anecdote and gut instincts.
Certainly, reams will be written in the coming months and years about why the work of opinion research turned out to be way more art than science when it came to this year’s balloting. The widely predicted blue tsunami was more like a modest midsummer swell. Many state polls were remarkably wrong; Republican Sen. Susan Collins trailed in every survey of Maine voters yet won handily. The estimated 8- to 10-point Joe Biden victory will more likely be 4% or 5% in the popular vote. The call on Saturday by The Associated Press and other major news organizations that Biden won the election was based on razor-thin margins in Pennsylvania and other states that were far closer than the preelection polls had indicated.
To be fair, there were some seriously extenuating circumstances this year. Polls are based on models drawn from previous experience, and modern America has never voted during a pandemic. Nearly every state changed something about its voting process, from drive-thru voting in Texas to the states that widely expanded voting by mail. Although it’s not proven yet, it seems likely that the phenomenon of the shy (or perhaps defiant) Trump voter is real; it’s not hard to imagine supporters of a candidate whose main appeal is distrust of political elites misleading or hanging up on researchers calling to ask their presidential preference.
The debacle of 2016, in which opinion researchers universally agreed that a Hillary Clinton victory was the likeliest outcome, prompted a lot of explanation from statistics-savvy journalists. They explained how the FiveThirtyEight forecast, which gave Clinton a 2 out of 3 chance of winning, could be read as giving her a 1 in 3 chance of losing, less likely but certainly possible. In baseball, batters who get a hit 33% of the time wind up in the Hall of Fame. Unlikely events happen. People win lotteries.
Some of this year’s explanations will likely focus on what the polls got right — a comfortable popular vote edge for Biden, a solid win in the electoral college — while nodding to the ways in which 2020 smashed previous models for turnout and participation.
I take a different lesson from the foibles of polling. The most important thing we can do as we think about covering and investigating government and politics in election years is to not assume any outcome. That’s psychologically harder than it sounds, even for professional journalists. In the summer of 2016, news organizations, including ProPublica, did less than they should have on the intricacies of the Trump family businesses in part because his victory was deemed so implausible. Why devote months of hard slogging to learning about a guy who’s headed to reality television by late November?
It’s difficult for reporters and editors to shut out the polls and work to put their hearts into pursuing stories on two outcomes, only one of which will turn out to be true. (I have a friend who was assigned to write a “How Michael Dukakis Pulled Off a Stunning Victory” piece in 1988 that would run on the front page of The New York Times if the polls were wrong. He felt like he was wasting his time; George Bush’s victory proved him right.)
Still, shutting out the noise and focusing on the evidence is the best way to avoid being part of the group-think that characterizes the coverage of many nationally fascinating stories. I always try to keep in mind the events of April 19, 1995, when a truck bomber demolished the federal building in Oklahoma City. CNN and other networks were quoting experts who said the attack had all earmarks of Middle Eastern terrorism. They reminded viewers that an Islamic radical group had tried to blow up the World Trade Center in 1993 with an explosives-packed rental van. That speculation played in a nonstop loop in nearly every newsroom in America. I recall an angry argument at the Times’ Washington bureau between an editor in New York and a religion writer in Washington who adamantly refused to write a story about the ideology of the possibly Islamic terrorists.
One exception was a tiny organization, the Inter Press Service, which covered the developing world from a small room in the National Press Building and seldom turned on its television. (In fact, its reporters learned of the bombing when someone noticed footage of the smoking wreckage on a monitor in the building’s lobby.) Later that day, Inter Press was the first to focus on the possibility that the bombing had been done by far-right American extremists. One of the reporters, Jim Lobe, had been a lawyer in Seattle before becoming a journalist and was familiar with the militia movements of the Western United States. The story noted that the bombing had taken place on April 19 — the second anniversary of the deadly assault by federal authorities on the Waco, Texas, compound of a religious cult known as the Branch Davidians.
When the FBI arrested Timothy McVeigh and his motive for the attack was exactly as described, Lobe was asked how Inter Press got it right when so many others had not. It was simple, he replied. They knew generally what everyone was saying, but it didn’t make sense and so they did their own reporting.
I tracked down Lobe, a lawyer-turned-journalist, to check the details for this column. He chuckled at the memory. “We usually didn’t have CNN on at all,” he said. “I remember they had on all these commentators who said it was Islamic. It didn’t make any sense. We did the research, found out it was Patriot’s Day, talked to some people who were experts on the far right. Then, we put the story together.”
“It was just a matter of deduction. I had worked in the courts in Seattle and we had Posse Comitatus people coming regularly,” said Lobe, referring to the far-right movement of the 1980s. “It just didn’t make any sense to me that Islamists would blow up a federal building.”
In an era when polls keep getting it wrong, it feels like good advice. It’s not possible to entirely shut out what they’re saying, but it’s best to do your own critical thinking.
