Browsing the archives for the pollsters tag.

Greece, elections 2015: How did the pollsters fare? Not too shabbily

European Politics, International Politics, Politics

In the aftermath of the momentous Greek elections, this seems worth mentioning: the Greek exit polls were fairly close to the mark, and the last pre-election polls approached the actual election results almost as closely as the exit polls.*

The latter, especially, seems impressive, not least because their performance was hardly a given. Ahead of the May 2012 elections, the pollsters entirely failed to capture the dynamic of the electorate. (Admittedly, it’s not easy to poll a watershed election which all but broke up the entire Greek party system, and they did approach the results of the June 2012 elections much more closely.)

The 2015 elections: how the pollsters did

Chart: Greece 2015 elections: Pollster performance

Click to enlarge: How closely did the last pre-election polls approach the actual election results?

This time, a Pro Rata poll which was in the field 5-6 days before the elections pegged the numbers closely enough to the actual results that it was off by an average of just 0.6% by party. Even the “worst” poll was only off by an average of 1.2% by party.

Interestingly though, to the extent that the polls in the last few days before the elections did miss the mark, there was a distinct pattern. When you calculate the average of each pollster’s final poll, it turns out to have understimated every anti-bailout party, whether on the left or right (Syriza, XA, KKE, ANEL), and overestimated every pro-bailout party on both the left and right (ND, Potami, PASOK, KIDISO). Sometimes the deviations were tiny (like a tenth of a percentage point), but it’s still a striking pattern.

In particular, the average of the final polls had the incumbent government party, New Democracy, 1.8% higher than the share of the vote it eventually received, while it had the Independent Greeks 1.1% lower.

For more data and information, read on below the fold.

Continue Reading »

Comments Off on Greece, elections 2015: How did the pollsters fare? Not too shabbily

Polling the stimulus

Economy, Politics, US Economy, US Politics

You may have seen Karl Rove opine in the WSJ that “support for the stimulus bill is falling”, and that “the more Americans learn about the bill, the less they like it.” He is certainly not the only conservative asserting that the bill is impopular.

I’m not in the super-enthusiastic category myself, if obviously for very different reasons than conservatives have for disliking it. Overall I think the bill doesn’t look bad, though my initial enthusiasm has been damped somewhat after reading, for example, Paul Krugman’s very persuasive commentary. It’s probably not enough, and maddeningly worse than it could have been; but it’s still a whole lot better than nothing, and it does have lots of good stuff in it. So far my layman’s take, which is not exactly the most interesting one.

But what does the American population think? Is Karl Rove right? Unsurprisingly, not quite. An overview of the polls that were conducted in the past two and a half weeks, and explicitly asked respondents to express an opinion for or against the bill.

There are two pollsters that have done more than one poll within this timeframe: Gallup and Rasmussen.

Gallup asked: “As you may know, Congress is considering a new economic stimulus package of at least 800 billion dollars. Do you favor or oppose Congress passing this legislation?” All three times it polled the question, it found a majority in favor, and in the last iteration, on the 10th, that majority had grown from 52% to 59%.

Rasmussen asked: “Do you favor or oppose the economic recovery package proposed by Barack Obama and the Congressional Democrats?” It found strikingly different results.

According to Rasmussen, in late January a narrow plurality of 42% was in favour; a week later the roles were reversed, with a plurality of 43% in opposition; and by the 11th a plurality of 44% was in favour again.

Three other pollsters asked a variation of the same question at some point in these last two and a half weeks.

A CBS poll queried respondents: “Would you approve or disapprove of the federal government passing an economic stimulus bill costing more than 800 billion dollars in order to try to help the economy?” They approved by 51% to 39%.

A Pew poll asked respondents: “From what you’ve read and heard, do you think [the economic stimulus plan being proposed by President Obama that may cost about $800 billion] is a good idea or a bad idea?”. It found a narrow majority of 51% saying it was a good idea; 34% thought it was a bad idea.

Continue Reading »

1 Comment

Obama’s polling compared to Kerry’s, Gore’s and Clinton’s – final day update

Politics, Presidential Elections, US Elections, US Politics

My comparison from a week and a half ago of how Obama’s polling numbers match up with Kerry’s polling in 2004, Gore’s in 2000 and Clinton’s in 1996 has surprisingly become the most visited page on this blog since. Considering the interest, I thought it would be good to provide a last-day update on how the comparison is shaping up at the end of the campaign.

There are four daily tracking polls this year that also conducted daily tracking polls in either 2000 or 2004 or both. The comparison between the races shapes up differently depending on which pollster’s numbers you look at. The best known is Gallup, and this graph compares Obama’s performance versus McCain in the Gallup poll with Kerry’s, Gore’s and Clinton’s performance against their Republican opponents:

Gallup polling: Obama vs McCain in 08 compared with Kerrys, Gores and Clintons polling

Looking good indeed; the 11-point lead Gallup showed for Obama in its final presidential estimate last night is on par with its election-day polling lead for Bill Clinton in ’96. While Clinton’s ample lead gradually eroded over the course of the last two weeks of campaigning, Obama’s held steady. Quite the difference with the nailbiters the last Gallup polls out predicted for the 2000 and 2004 races.

TIPP is a polling firm you may not have heard of; it has conducted a daily tracking poll for the Investors Business Daily this year, and for IBD and the Christian Science Monitor in earlier years. Of the seven tracking polls that were conducted on a daily basis in the last two weeks, this poll has tended to show the smallest Obama leads of all. When McCain’s chief strategist Steve Schmidt asserted, two weeks ago, that “the McCain campaign is roughly in the position where Vice President Gore was running against President Bush,” the TIPP poll was the only poll that confirmed his assertion.

Today, however, brings good news for Obama supporters: after oscillating between a 1-point and 5-point lead for Obama for two weeks, TIPP published a final estimate last night that had Obama leading by 7.2%. And that makes the comparison over the years look like this:

Continue Reading »

Comments Off on Obama’s polling compared to Kerry’s, Gore’s and Clinton’s – final day update

Polls dramatically tightening in Pennsylvania, but does it matter?

Politics, Presidential Elections, US Elections, US Politics

Here’s something to feed your jitters: three new polls on Pennsylvania, all showing Obama ahead by just 4-5%.

How should we regard them? And will the electoral fate of Pennsylvania matter in the big picture anyway? First, a rundown of the polls in question:

  • Thursday saw the release of an NBC/Mason-Dixon poll that had Obama ahead by just 4 points, 47% to 43%.

Not reassuring: The last time Mason-Dixon polled the state was in mid-September, when it had Obama ahead by 2. At the time (McCain was still riding his post-Convention bounce), that was comparable with what other pollsters were finding: six other polls conducted around the same time ranged from a tie to a 5-point Obama lead.

Possible comfort: The poll was of a mere 625 likely voters, making for a relatively high 4% margin of error.
Possible comfort: Mason-Dixon, Nate Silver pointed out, “has .. had a Republican “lean” this cycle of perhaps 2-3 points. They are quite frequently the most favorable number for John McCain in any given state.”

The Pollster.com trendlines for the state since 4 February, when Internet polls are filtered out and the trend smoothing is set to more sensitive.

Continue Reading »

1 Comment

Daily tracking polls update: “Looking OK now” edition

Politics, Presidential Elections, US Elections, US Politics
Tracking polls update, 31 October

Chart1: Daily tracking polls update, 31 October

Three days ago, I was feeling nervous about a sudden seeming lurch-let towards McCain in the daily tracking polls. This in spite of repeated posts by the experts insisting that there was no actually meaningful tightening going on, it was mostly just a question of statistical artifacts.

By this morning, Pollster.com’s status update did acknowledge that there had been some movement: “If you look at our national trend chart, we definitely show a narrower Obama margin now (5.4% as of this writing) than about a week ago.” Obama’s current national trend estimate, Mark Blumenthal explains, now stands about a point lower than his high of 50.9% a week ago, and McCain’s current estimate is slightly less than two percentage point higher than his low of 42.2% on October 12.

However, there’s still little to worry about, basically, as he points out the obvious to calm our nerves: “[T]ime is short and Obama’s lead still looks daunting. [..] Obama continues to lead on every national poll and yesterdays tracking updates show no decisive shift in either direction.”

Today’s tracking poll numbers certainly help sooth the jitters, as most actually show movement towards Obama (see Chart 1). Over the last two days, the ABC/WaPo, IBD/TIPP and Rasmussen daily trackers all have Obama’s lead back up 1 point, Zogby has it up 2, and the Gallup samples have moved back in Obama’s favour too: the regular voter and expanded likely voter samples both by 2 points and the traditional likely voter sample by no less than 5 (from 3% to 8%).

The result is that the average of all daily tracking polls has Obama’s lead back up by 1 point from +5.6% to +6.6%, after it had fallen by 2.7 points in the previous four days.

Continue Reading »

Comments Off on Daily tracking polls update: “Looking OK now” edition

Daily tracking polls update: the nervous edition

Politics, Presidential Elections, US Elections, US Politics

Is John McCain’s evil masterplan working?

I’m a bit confused about what masterplan, evil or otherwise, McCain would be implementing right now – I mean, ginning up a red scare about Obama the Socialist, really? But it wouldnt be the first time that a tack I considered wholly idiotic seems to work with American voters. (They sometimes work with Dutch voters too, for that matter – though probably not the red-baiting one.)

Either way, the daily tracking polls are showing some tightening of the race. Could be statistical noise, could be real. The movement would probably not be enough to decide the race either way, but still, the lowest estimates of Obama’s lead are getting disconcertingly close to zero:

  • Gallup has Obama’s lead down 3 points today, both in its expanded likely voter model (from 10% to 7%) and its traditional model (from 5% to a perilous 2%);
  • Rasmussen has Obama’s lead down 3 points in two days, from 8% to 5%;
  • Research 2000 has Obama’s lead down 4 points in two days, from 11% to 7%;
  • Zogby has Obama’s lead down a point today to just 4%, after it already fell from 10% to 5% the day before yesterday.
  • The IBD/TIPP poll is stubbornly stuck at a modest 3-4% Obama lead since the 22nd.

All in all, Obama’s average lead in the daily tracking polls has fallen from 8.3% three days ago to 6.0% tonight.

Chart 1: All daily tracking polls

Chart 1: All daily tracking polls

It should be said that there is one non-tracking poll that paints a seriously different picture. A Pew poll out today is showing a delirious 15-point lead for Obama among likely voters, with McCain down at just 38%. John Judis flagged that one (using the poll’s even more favourable numbers for registered voters) to tell us to “start popping the corks”.

The balance is evened out again, however, by the GWU Battleground tracking poll (which I dont include in the graphs because it’s not a daily tracking poll), which has Obama’s lead unchanged at just 3%. So count me in with his colleague Noam Scheiber, who is “still sweating” it.

For an overall picture of all national polls, check out …

Continue Reading »

3 Comments

McCain 2008 = Gore 2000? Matching the numbers from Gallup, ABC, TIPP and Zogby

Politics, Presidential Elections, US Elections, US Politics

A fair bit of attention has been paid in the blogs today to the assertion of McCain’s chief strategist Steve Schmidt that “The McCain campaign is roughly in the position where Vice President Gore was running against President Bush one week before the election of 2000.” It’s met a good dose of scepticism. The WaPo drily annotated the quote as follows:

McCain’s team dismisses the most dire polls — those showing the race nationally with a double-digit lead for Obama. Advisers believe the contest’s margin is in the five-to-seven-point range, about the same deficit, they say, that then-Vice President Al Gore faced at this time eight years ago against then-Gov. George W. Bush. (A Washington Post poll at the same point in the 2000 race showed a tie.)

NBC’s First Read similarly remarked:

[T]he NBC/WSJ poll right before the election found Bush ahead by three among likely voters (47%-44%). But our most recent poll shows Obama up [..] 11 points among likely voters (53%-42%).

In addition, Marc Ambinder points out that the margins are “way different” state-by-state: “Obama’s doing much better in 2008 than Al Gore was in 2000 in the battleground states.”

Now I had a graph up here a week or two ago charting how Obama’s current Gallup numbers compare with the lead or deficit that Kerry, Gore and Clinton faced in the previous three presidential elections. In the days since, Googlers have found this site through at least 27 permutations of searches involving some combination around Gore, Bush, polls, October, historical, 2000, elections, tracking and Gallup. So this is a good occasion to update that post and expand it, not just looking at the Gallup numbers but also those from the ABC, Zogby and TIPP daily tracking polls from 2000, 2004 and 2008.

First off, that chart from last time, based on the Gallup polling numbers from the last four elections. Here’s the update:

Continue Reading »

2 Comments

Too. Many. Daily tracking polls. Update, 22 October.

Politics, Presidential Elections, US Elections, US Politics

The last daily tracking polls update I posted was on 8 October. That’s a lot of daily tracking poll results ago. Yet the bottom line is that nothing much has changed since.

On 8 October, the three-day running average of the daily tracking polls had Obama in the lead by 7%. Today, it has him in the lead by 7.1%. And in the meantime the clock is ticking on, and the window of opportunity for McCain to still close the gap is rapidly closing (or has it already closed?).

One major thing has changed though: there are ever more of the damn things. Daily tracking polls I mean. It seems like no self-respecting pollster can do without one this year (and to think that Gallup didn’t even have one in 2004!).

In early October you already had the long-running Gallup and Rasmussen ones, the Research 2000 one (sponsored by the Daily Kos) and the poll sponsored by Hotline and the alcoholic drinks business Diageo, conducted by FD. Zogby and Reuters started their own on 7 October; Investors Business Daily and the pollster TIPP followed on 13 October, and as of last Monday, ABC and the Washington Post present one as well.

daily tracking polls

Chart 1: All daily tracking polls

If you’re keeping a graph and you were basing any kind of trendline on the average of all daily tracking polls, this – well – sucks. Because every new poll comes with its own house effect, deviating from the others in its own ways. Zogby, for example, started off showing a 2-point lead for Obama when Rasmussen, Gallup and R2000 had it at 8-11 points. Then, just as the Zogby poll had settled nearer to the average, the IBD/TIPP poll came on the market showing Obama in the lead by just 2 points, when the other pollsters had it at 4, 5, 6, 10 and 12 points, respectively. And just when Rasmussen, Zogby, IBD/TIPP and Hotline agreed on a 4-5 point Obama lead last Monday, the ABC/WaPo jumped in with its own tracking poll showing a 9-point lead.

Finally, there was Gallup, on 12 October, providing no longer just data for registered voters, but separate numbers for not just one, but two distinct “likely voter” samples as well, one encompassing a larger universe of voters than the other.

Seriously, you would be put off posting new graphs too.

Which of the three sets of Gallup numbers do you feature? How do you deal with how the ups and downs in your average reflect some new poll having been added into the mix as much as any genuine shift in the numbers? And how meaningful do any of the numbers still seem anyway, when on almost any given day the five-to-nine sets of numbers you’re looking at have Obama’s lead anywhere between 3 and 11 points? (And that’s just the daily tracking polls!)

Chart 1 above, if you click it to enlarge, shows how messy and, by implication, uncertain it all is. The pollsters are all over the map in pinpointing Obama’s lead. But saying that is also identifying the obvious commonality. Every one of the daily tracking polls has Obama in the lead, and that’s been true since 17 September, over a month ago.

How big is that lead though?

Continue Reading »

2 Comments