Opinion polls are core to how media covers politics, but is that a good thing?

Traditional polling is being reshaped by changes in the media landscape

Opinion polls picked the wrong winner in both rounds of Brazil's recent presidential election, which was ultimately won by Luiz Inácio Lula da Silva. Photograph: Victor Moriyama/The New York Times
Opinion polls picked the wrong winner in both rounds of Brazil's recent presidential election, which was ultimately won by Luiz Inácio Lula da Silva. Photograph: Victor Moriyama/The New York Times

On Tuesday, Americans vote in midterm elections with consequences for everyone around the world. As usual, much of the campaign coverage has revolved around opinion polls, which give the Democrats a national lead of up to 11 points on the generic congressional ballot, while the party’s candidates are challenging for Senate seats in places where they usually wouldn’t have a hope.

Despite all that polling data, many remain sceptical about whether these predictions will be proved correct. Regardless, polls have been central to the coverage, as they are in most elections.

Polling has been a fixture of political journalism for almost 90 years. Its modern form dates from 1936, when George Gallup used a small but carefully chosen sample to predict Franklin Roosevelt’s landslide, humiliating the Literary Digest, whose vast survey of its own affluent readers had backed his opponent. Gallup’s results were syndicated to newspapers across the country, beginning a partnership between pollsters and the press that has lasted ever since.

But it was not until the 1970s, or in Ireland’s case the 1980s, that newspapers began to invest seriously in polls of their own. The Market Research Bureau of Ireland, founded by Jack Jones in 1962, spent years researching washing powder and air travel before turning to politics, and the Irish Times/MRBI series that began in the early 1980s became the benchmark here.

There has been no shortage of criticism of the relationship. Newspapers, it is suggested, over-dramatise results, splashing shouty headlines about tiny shifts that are within the margin of error. Polling is also blamed for “horse race” coverage that treats elections as sporting fixtures, ignoring the issues at stake. One Harvard study of the 2016 US presidential race found policy accounted for just a tenth of coverage, less than a quarter of the space devoted to who was ahead.

These criticisms are not without foundation, although research across 27 European countries suggests poll-driven coverage is most common in tight, multiparty contests, where knowing the state of play can help voters decide how to use their ballots.

Distrust of the polls themselves has also grown, with people pointing to glaring misses such as Brexit or Donald Trump’s first victory. That has been compounded by the rise of populist movements whose supporters are often underrepresented in surveys, prompting accusations of bias. Despite all this, a study of more than 200 elections in 32 countries found no evidence that polling errors were increasing.

Three elections in the past 10 days have highlighted some of these issues. In Brazil, the final surveys had incumbent president Luiz Inácio Lula da Silva ahead in the first round, which his opponent Flávio Bolsonaro edged, then gave Bolsonaro a narrow lead in the runoff, which Lula won by more than three points. Neither error was particularly large, but each picked the wrong winner.

In Israel, the final polls correctly predicted deadlock but underestimated both Likud and the Arab parties.

And in Serbia, where public polling is sparse and voters had reason to be wary of declaring opposition sympathies, surveys showing Aleksandar Vucic’s party narrowly ahead were proved completely wrong when the student-led opposition won an outright majority.

[ The Irish Times view on Serbia’s election: youthquake in BelgradeOpens in new window ]

Traditional polling is being reshaped by changes in the media industry. Falling revenues have made publishers less enthusiastic about the expensive business of high-quality polling. That has led to a move from face-to-face interviewing towards cheaper online panels, weighted to reflect the profile of the electorate.

In Ireland, Red C for the Business Post and Ireland Thinks for the Sunday Independent now alternate monthly online surveys, while The Irish Times’s face-to-face poll with Ipsos B&A appears several times a year. The methods can return somewhat different results. Red C, for example, regularly puts Fianna Fáil a few points lower than other pollsters do. But overall performance has been respectable, with final polls in 2024 largely within the margin of error. Every poll is a snapshot in time, and across volatile referendum campaigns, surveys and results have often diverged wildly.

The field has narrowed too, with titles such as the Sunday Times Irish edition no longer commissioning polls.

Elsewhere, there are signs of questionable standards. In September, an undercover investigation by Channel 4 News and the Verbatim group revealed that polls carried prominently by the Times and the Telegraph had been arranged by Reform UK figures and paid for through what they believed was an American donor’s company, without either paper being told.

In the US, a firm called Wedgewood Polls admitted last week that it had fabricated results reported by The New York Times, Newsweek and others. One Michigan Democratic candidate says a fake survey showing her in single digits drove away her donors and ended her Senate campaign.

The problem in both cases lay with news organisations failing to verify where the numbers came from and what financial incentives might have been involved. But what is even worse is that some US outlets are giving prominence to the almost completely unregulated prediction markets that have mushroomed in recent years. CNN and CNBC have partnerships with Kalshi, and Wall Street Journal owner Dow Jones with Polymarket, on undisclosed terms.

This seems a highly dubious proposition, since betting odds can be moved by anyone with deep enough pockets. The old model, in which media organisations paid for polls and stood over the results, may have had its flaws but this particular replacement looks considerably worse.

How we’re covering the US midterms

Midterms
Follow Irish Times Washington Correspondent Keith Duggan and video journalist Chris Maddaloni in the final week of the campaign as they report from key battlegrounds and gauge the mood of voters across the US.
More US midterm election coverage here.
  • Join The Irish Times on WhatsApp and stay up to date

  • Listen to the Inside Business podcast for a look at business and economics from an Irish perspective

  • Sign up to the Business Today newsletter for the latest new and commentary in your inbox