The Answer to the New Hampshire Primary Polling Mystery?

By: Lowell
Published On: 1/14/2008 4:27:17 PM

You might recall the experimental online poll we ran here at RK starting January 5.  Well, here are some fascinating results, courtesy of one of the poll's creators.  Believe it or not, this may explain what happened with the New Hampshire primary polling in the Democratic race.  Thoughts?

BULLITICS NH RESEARCH SAW ELECTORATE SHIFT

By:   Ricardo Rossello, PhD

It might be true, as the saying goes, that there are lies, damned lies, and statistics, but sometimes there are just the plain old facts.

Tuesday's New Hampshire primary has produced all kinds of discussions about what went wrong with polls and pundits, but at least one test measure of the granite state's electorate picked up what was happening in real time (figure 1).  From the ABC News debates Saturday night to Hillary Clinton's 'crying game' to the actually vote, there were two key points of inflections - independent movement from the Democratic primary to Republican and undecided shifts in the last 30 hours to Clinton

The alpha-version Bullitics platform, a novel mechanism to determine society's pulse, predicted the NH results and trends, observing movement in the electorate that started on Saturday, January 5th after the debate and continued 24 hours before the polls opened.


Bullitics uses a novel allocation mechanism that enables users to change their allocated percentages of answers as many times as they want.

For this prediction, the platform performed in its alpha stage, using only a small number of NH voters (276), and 6 questions (2 general, 2 Republican, 2 Democratic).  Two general questions were asked: (a) How likely are you to vote in the primary? and (b) What party affiliation best reflects your views?  On both Republican and Democratic questions, individuals were asked whom they were inclined to vote for and who was more presidential.

Based on that sample size and the questions, Bullitics was able to predict Senator Clinton's victory in the NH primary, and identified two instances where a shift was occurring. To analyze the Democratic results, tallies were taken for those who were voting either Democratic, None, or Undecided. On the Republican side, those who aligned themselves with Republican, None, or Undecided were also tallied. This type of tallying reflected the reality of a semi-open primary in NH (independents can vote anywhere).

The first tally was taken after Saturday (Jan 5th) night's debate. Before that time, Senator Obama had been steadily increasing his aggregate score after the Iowa Caucus. The changes in percentages were not significant (as Senator Obama remained consistent, Clinton only slightly increased, and Edwards slightly decreased). However, two things changed.

First, the percentage number of "Undecided" increased right after the debate. Second, a rising number of "None" and "Undecided" shifted to the Republican polling alternative. Thus, it could be concluded that the presidential debate affected the trends in public opinion by (1) enhancing uncertainty in the Democratic pool, and (2) shifting more attention to the Republican primary (relative change -- most Independents still were with the Democratic party, figure 2 ).

The second tally was taken 30 hours before the polls closed in NH, when the Undecided segment started yielding steadily to Senator Clinton (77% of the Undecided segment tracked an increase for Clinton).The momentum started changing then, most likely due to the press coverage of her "emotional" moment on TV. In the end, the Bullitics platform had Barack Obama (37%) behind Hillary Clinton (38%) at 7pm EST, the night of the primary.

The conclusion is that Obama did not lose votes to his Democratic competitors, but rather lost a segment of the independents to the Republican Party and a large portion of the "Democratic-Undecided" vote within the last 30 hours. Had pollsters been able to pick up on this trend, they would have advised Senator Obama to target either the "Independent" crowd more heavily, or concentrate on the "Democratic-Undecided" vote.

Although this is a pilot study with no gender/race differentiation, future studies will be able to consider the effects of a gender/race shift in the contest.   The beta version of this study will be able to differentiate within that context. Still, our preliminary data points more to a shift in Independent voters (None-Undecided) going to the Republican primary, and a significant gain of "Democratic-Undecided" votes by the Clinton camp, rather than Obama losing the support of his base of voters.

Bullitics has finished its alpha-stage pilot study and will introduce its beta product in 10 days.  We offer real-time changes, a better model for surveying online voters, and the best analytical tools anywhere!

Contact: ricky.rossello@gmail.com


Comments



But why did the independents shift (Teddy - 1/14/2008 4:46:37 PM)
out of the Democratic primary and into the Republican? This is something I suspected when McCain won most of the independent votes on the Republican side (they actually gave him his victory, did they not?). At the time, I figured it might be because the independents, who were going to break for Obama, decided he was far enough ahead so that they could safely vote for McCain and ensure his win on the Republican side.

Now, I am not so sure.  Did the independents shift to McCain out of conviction he should be President, rather than just to give him a boost against Huckabee and Romney?  If the shift was from conviction, will this shift to the Republican side hold in the general election as well? Are the Democrats losing the no-party moderates and independents they must have nowadays in order to win a general election, as they did in 2006? If so, what can be done to halt the shift?  



I think you might overstate the independent question (Silence Dogood - 1/14/2008 5:18:30 PM)
The memo notes that the shift was relative; independents still participated in the Democratic primary much more strongly than they did the Republican primary, so it's not something you should be too concerned about in this particular state.  As for the independents who did shift, both your suggestions are plausible, but there's not enough evidence out there to support or discredit either hypothesis (or any other).

Regardless of what happened, Dem candidates should continue to fight for the middle by appealing to populist domestic issues, moderate foreign policy issues, and continue to build up their credibility and likeability.  The recent back-and-forth by both the Obama and Clinton campaigns are likely to detract from that goal; we should hope they get back to the issues affecting the American people sooner rather than later.



My thoughts - (bullitics - 1/14/2008 5:38:57 PM)
Teddy -
Here is my layman's analysis - to the actual data I saw.  I saw a shift in independent type voters to vote for the republicans.  As anyone who saw the debate - the particular format of the two-party debate, lend itself to a unique forum for observing all candidates AND contests.  In my opinion, the democratic debate was a wash; with some pundits giving it to Edwards.  However, in the republican debate - there was one clear looser - that was Mitt Romney.  Based on this, I think people shifted because (a) they like McCain, (b) Obama looked like a shoe in (thus no need to lose that vote) and (c) the ANTI-Romney independent vote (recall the polls showed McCain and Romney in a battle).  I just think a group of independents thought the Republican Primary was a tighter race, and they wanted to make sure the guy who represented them best (historically, McCain), made it through.

To your second question of "are the democrats losing the non party vote" - I don't think so.   I just think the shift of the independents was so heavily in favor of the dems at the start of the NH race, that the shift caused significant changes in the tallies.  I don't think it's a national phenomenon, particularly now with people not trusting the "inevitability" statements of the press.  Nothing seems farfetched these days...
-R2  



Tactical voting (Hugo Estrada - 1/15/2008 3:31:04 PM)
If independents thought that Obama was going to win, they may have thought that it would be better to pick the least dangerous candidate in the Republican side, so that we would have less of a chance to get someone like Huckabee.


Fascinating... (TurnPWBlue - 1/14/2008 4:47:47 PM)
These statistics also lend credence to the criticism of media over-reliance on polling data.  It is quite possible that independent voters, assured of an Obama "victory" based on the media overhype, switched to the race they thought needed their input--McCain vs. Romney.  The facts on the ground were far different.  Clintons performance in the debate and her tearful "performance" in a New Hampshire diner were dynamically changing the landscape in ways traditional polls would not reflect.


Reply (bullitics - 1/14/2008 5:40:39 PM)
I agree.  The media had both positive and negative influences, by overhyping and by anointing.  


What's in it for Bullitics? (jsrutstein - 1/14/2008 5:09:41 PM)
Before we just believe Bullitics, we need to know whether the people behind it have a vested interest in persuading campaigns and/or media corporations that it has a better methodology to sell.

We should also resolve questions coming from the exclusive contract between big media and Edison/Mitofsky, the exit pollsters.  Edison/Mitofsky admitted it screwed up in Ohio in 2004, and they still won't release the numbers they showed the media in NH this year that caused the media to be surprised at the outcome.

We should continue to explore alternatives to machines that can be rigged.  To the extent we have to keep using them, we should at least routinely engage in random hand recounts of the results of these machines.  Finally, we should NEVER be left without a hand marked paper trail and the highest level of security over that paper.

The stakes are too high.



Um, yes? (Silence Dogood - 1/14/2008 5:22:27 PM)
"Before we just believe Bullitics, we need to know whether the people behind it have a vested interest in persuading campaigns and/or media corporations that it has a better methodology to sell."

I think it ought to go without saying that they have no interest whatsoever in persuading anyone to believe that they have a worse methodology to sell, so let's just take it for granted that they would rather you think they were more reliable and not less so.



What is it in for us. (bullitics - 1/14/2008 5:51:59 PM)
You have every right to be skeptical.  Two things that are important to note though.  This IS NOT traditional polling -- our information gives DIFFERENT information and insight that complements that of traditional polling.  Many of these will be put out there for the public to experiment/play with in 7-10 days.   NH just happened to be an example of where this type of mechanism may have been valuable to pollsters/public/campaigns et al.  Why?  Because there is a measured shift.  This shifts can be cross-checked with actual events (i.e. debates, media events);  or can be used to detect some microtrend of a particular group (you see the data and ask the question... "what is going on here?").  

Therefore, in this pilot study, we were able to see trend changes in the sample's aggregate.  On the beta version of bullitics that comes out soon, users will be able to do much more than that.  Just give it a try in a couple of days, and you can be the judge of our robust statistical analysis tools and mechanisms.



Diebold Voting Machine Problems In NH On Primary Day (Flipper - 1/14/2008 5:37:11 PM)
There is also news that there were a number of problems with the Diebold machines that a number of localities use in NH to count their ballots, especially in Hanover, Exeter, Nashua, and Manchester.  Manchester and Nashua are the two largest cities in NH.  It will be interesting to see if any problems are uncovered during the recount in NH, which begins this Wednesday, January 16, 2007.  The recount that begins this Wednesday, January 16, 2007 will be interesting as it may reveal the exact nature and extent of the problem with Diebold's machines as well as the company that services them, LHS Associates.

Here is the article:

http://www.opednews.com/articl...



The oped article gives one pause (Teddy - 1/14/2008 6:17:19 PM)
despite the continuous-poll evidence from the Bulletics poll under discussion here. That is, alternet had an article on comparing the votes (I assume the tallies are accurate) in New Hampshire from optical scan machines versus those counted by hand, and a curious statistic emerged:

Compare these vote tallies:
Clinton optical scan vote 91,717 or 52.95%
Obama optical scan vote 81,495 or 47.05% and

Clinton hand-counted vote 20,889 or 47.05%
Obama hand-counted vote 23,509 or 52.95%

Notice anything? The percentages are exactly reversed. This is precisely what would occur if the machines flipped the votes, that is, a vote for Clinton registered as being for Obama and a vote for Obama registered as being for Clinton. I am not saying the nefarious convicted felon who ran around opening and replacing memory cards in the Diebold machines during the voting (as stated in that article you linked to) did anything wrong. Actually, these very machines have been shown to have flipped votes on their own, accidentally. Nor do I want to take away anything from Senator Clinton's magnificent comeback.

What I do want to ensure is that we have no chance for unreliable or inaccurate vote counts in the rest of the primaries and in the general election. We are all becoming less and less sure of the reliability and honesty of our election system, and if we lose faith in that, our democracy is dead.    



Diebold Name Change (hereinva - 1/14/2008 7:59:57 PM)
Diebold's new name is Premier Election Solutions; guess the name "Diebold" had too many negatives attached. Premier's Vice President is a former election official from GA.

Here is a story from WDTNof Dayton OH.