Was There a "Bradley Effect?" A "Reverse Bradley Effect?" Mayyyybe.

By: Lowell
Published On: 11/6/2008 9:34:13 AM

There's been a lot of talk about a so-called "Bradley effect," in which a certain percentage of poll respondents say that they will vote for an African American, but then on election day don't actually do so. Well, we now have national and state-by-state results from this Tuesday's election, as well as the national and state-by-state poll averages from Real Clear Politics (RCP).  I put together a spreadsheet to examine the numbers, and here's what I found. (note: in many cases, these are not final results; also, there's rounding in the final results but not the RCP poll averages)

*Nationally, the RCP finally poll average indicated a 7.6-percentage-point win for Barack Obama. The actual result (not final yet, still subject to change - possibly in Obama's direction as absentee ballots are counted) was a 6.3-percentage-point margin for Barack Obama. The difference of 1.3 percentage points is not huge, but POSSIBLY indicative of a slight "Bradley effect." Of course, there could have been other factors at play as well, perhaps last-minute publicity about Barack Obama's aunt or comments about supposedly "bankrupting" the coal industry or whatever. Who knows, but again, there was a slight decrease nationally for Barack Obama from final RCP poll averages to actual results on election day, still pending final numbers (absentee ballots might favor Obama and narrow this gap?).

*In the individual states, I actually found as may cases (22 states) of Obama winning by a wider margin on election day than winning by a smaller margin (20 states).  The other 8 states rounded to zero, at least by my calculations.  

*Significant (I'm defining this as 4 points or more) advantages for McCain in the actual results over RCP final polling averages can be seen in Alaska (10.8 points), Arkansas (10.7 points), Wyoming (10.5 points), North Dakota (9.25 points), Oklahoma (7.2 points), Iowa (6.0 points), Arizona (5.1 points), Utah (4.7 points), West Virginia (4.3 points), New York (4.3 points), Louisiana (4.2 points). Was there a "Bradley Effect" in these states? I wouldn't jump to that conclusion, but the results are intriguing (note: Alaska's final election result for U.S. Senate was also FAR off from the RDC final polling average, so who knows what went on in that state).

*Significant (again, 4 points or more) advantages for Obama in the results over RCP final polling averages can be seen in Vermont (14.0 points), Rhode Island (9.0 points), New Mexico (7.6 points), Nevada (5.9 points), Massachusetts (4.7 points), Hawaii (4.2 points), and Washington (4.0 points). Was there a possible "Reverse Bradley Effect" here?  More study is necessary to determine this, but I certainly find it interesting that two of the states on this list (New Mexico and Nevada) have heavy Latino populations.

*In Virginia, the actual election results were almost identical between the election results (about 4.5 points) and RCP final polling average (4.4 points).

*The bottom line here is that there MAY have been a "Bradley Effect" in a few states, and there MAY have been a "Reverse Bradley Effect" in a few others. Nationally, I'm not seeing a big discrepancy between the final RCP average polling data and the preliminary final election results. In conclusion, the answer to all this analysis a big, whopping "mayyyyybe." :)

What are your thoughts on this?

UPDATE: On a similar note, Tim Kaine says that "Ol' Virginny is dead."  If true -- and it certainly doesn't appear to be the case with the Jeff Fredericks of the world -- would this also mean the death of the "Bradley effect" as well?


Comments



Nate Silver's projection at fivethirtyeight.com was actually spot on (ajpuckett81 - 11/6/2008 9:46:14 AM)
52.3-46.2

So that is a data point that suggests we can finally stop talking about the Bradley effect. You have no idea how sick I am of hearing about it.

I really don't know what happened in Alaska. That election seemed to be cooked in favor of Republicans by ~10% at all levels.  



Yeah, something rotten (Lowell - 11/6/2008 9:53:15 AM)
in the state of Alaska. And, as Jim Webb says, "the fish rots from the head down!"  Hello, Sarah Barracuda!  


Alaska (KCinDC - 11/6/2008 10:04:42 AM)
Yes, the Alaska effect helped Don Young win as well. See Nate Silver's post about Alaska.


About the drop from 7.3 to 6.3 (faithfull - 11/6/2008 9:53:02 AM)
At least at 538, they predicted that the election would be closer than the final polls, because thats the historical precedent when one candidate has a large lead. The red line is the actual poll spread and the yellow line is adjusted to what the actual election result would be.

FWIW, 538 also had some fighting words for RCP's methdology earlier this year.

Most of the other states are really republican states in the west, in which there may have been some "bradley affect" for all Democrats, as it looks like many of our house candidates suffered from as well. It looks like Obama benefited similarly in Dem strongholds like Vermont, Rhode Island, and Massachusetts.

The other states, Iowa, New York, and Arkansas, may be explained by the fact that there would be a large and engaged Hillary Clinton constituency in those states?

I'm hesitant to put WV in that category as well, although the Hillary-phenomenon may have had some effect. Again, this was an area where many Democrats may have supported Hillary in the primary, and she really tied herself to the state and to the region due to neccesity in the primaries. If there was a "Bradley effect" in WV you'd think we'd see similar results in VA, PA, OH, KY, and potentially TN, but that wasn't really the case. I can imagine WV is very difficult to poll, and there are probably less phones and computers per capita than elsewhere around the country.



Community Organizer Effect! (hereinva - 11/6/2008 10:31:52 AM)
Why the RNC decided to mock community organizers at their National Convention is beyond me...but glad they did cause it p.o.'d a lot of community organizers. And WOW, I think it compounded the organizing efforts for the Obama campaign.

Thank you, thank you, thank you.

 



Put the Bradley Effect To Bed (AnonymousIsAWoman - 11/6/2008 10:32:36 AM)
I'm not sure it's a Bradley effect when the discrepancies are that small.  The actual Bradley effect was that Mayor Bradley was way ahead in the polls and lost the actual election, shocking everbody.  That was a major upset.

Other factors explaining this small a difference could include simple margin of error and last minute changes that no poll could capture.  Polling is not an exact science just a snapshot of the public's opinion in the time period its taken.

BTW, the most famous upset was Truman winning. There's a famous picture of him holding up a newspaper with the headline that Dewey had won.  At that had little to do with a Bradley effect.  



I wouldn't use the Truman analogy (Lowell - 11/6/2008 11:20:36 AM)
Back in 1948, there were very few polls, and polling concluded with about 3 weeks to go because pollsters didn't believe opinions could change much in that little amount of time. Basically, polling was primitive back then and is completely different today.


Good Point (AnonymousIsAWoman - 11/6/2008 11:43:02 AM)
I realized that but the irony of the photo was too tempting.

Seriously, though, I do think any discrepancies this time were more a matter of margin of error or last minute factors than a Bradley effect. Of course, I could just be too optimistic.



And then there is the Bill Bradley effect (aznew - 11/6/2008 10:35:18 AM)
That people will not vote for you if you put them to sleep. (and I say that as someone who idolized Dollar Bill from back in the day).


The economic effect (Rebecca - 11/6/2008 10:45:53 AM)
In Ohio Union leaders overcame the racist feelings by asking their members the following question:

"Would you rather have a black friend in the White House or a white enemy?"

I call it the ecomonic effect which cancels the Bradley effect.

But wait a minute, didn't Bradley get defeated when people voted on the Diebold machines? Then later California found the company (Diebold)guilty of fraud with regard to the certification of the machines. California has since thrown out Diebold (now called Premier). Maybe we should actually call it the Diebold effect instead of the Bradley effect.



Margin of Error (aaronedge - 11/6/2008 10:59:11 AM)
Most of these polls are at least + or - 3.  So a 6 point difference from the polling result is possible.  Most of these are just float within the MoE.

Also, almost all of the states that increased for McCain were reliably red states.  Same for the Obama states that had a +4 change.  Voters just came home.  

Only Alaska had something fishy going on.  Everything else makes sense.



Regarding RCP at O+7.6 versus actual result (so far) of O+6.3 (Karla - 11/6/2008 1:41:48 PM)
I disagree with the conclusion that there is room for a nationwide Bradley effect here.  I agree with aaronedge that this is expected floating within the margin of error.

The RCP average can be no more accurate than the accuracy of the polls that went into it.  I did a quick calculation and the average error for the polls RCP used is 3.0 points.  The 1.3 point difference is well within this and is explained by statistics and not Bradley.

I dunno about the state by state results and all those 9 and 10 point outliers.  Is it a BRADLEY effect or a GOODE ("think like a bad guy") effect?  Or Alaskan Democrats too busy on their "snow machines" to pick up the phone?  Interesting that Alaska should be the highest anomoly given that the current outcome shows that Alaskans chose a convicted felon to represent them in Washington, as well as, as Nate Silver points out, a systematic up-and-down-the-ticket effect where Republicans outperformed the polls by significant margins -- 12 to 14 points.  In EACH and EVERY race from President to Senate to House.  I mean, geez.



Suggesting GOTV was pointless? (FMArouet21 - 11/6/2008 12:15:52 PM)
Nate Silver's work was awesome throughout the campaign, but I have to wonder whether there were some roiling internal dynamics beneath the data.

It would be interesting to dissect the state-by-state data (only someone like Nate Silver could do this) to try to judge the interaction of:

(1) Age, race, and income demographics

(2) "Cell phone effect" on polling

(3) Purely race-based leans

(4) Effectiveness of GOTV efforts (based on comparisons with past elections)

In the end, perhaps the "Bradley Effect" was a non-factor not because it does not exist, but because the Obama GOTV effort in swing states and the slightly underpolled cellphone users served to cancel out the "Bradley Effect," thereby creating a wash.

I'd guess that there really was about a 5 or 6 point "Bradley Effect" in many swing states, but the Obama GOTV effort was worth 2 or 3 extra points and the underpolled youth/cell phone effect (at least in some polls) was worth 2 or 3 extra points--thereby cancelling out the white racists. Increased black turnout and preference for the black candidate (raising the black Democratic vote from 88 to the 95 or 96 range) likely was worth a point or two in some states.

Note that the pollsters, such as Gallup, which tried to take into account the cellphone effect and to use expanded turnout models to take into account an increased youth vote and Democratic Party preference, overestimated Obama's final numbers by about 5 or 6 percent. That difference may very well be an accurate, though unintended, indicator of the real "Bradley Effect."

The good news: older white racists will continue to die off. Younger, more tolerant voters will continue to come of voting age. A competent Obama Administration will compel even some remaining white racists to concede that competence trumps race. The Bradley Effect will fade away. I noticed a piece yesterday on the web about George Wallace's daughter, who is an Obama supporter in Alabama and who put an Obama sticker on her car bumper during the campaign.

With four years of good governance in a time of crisis and with another good ground game, Obama should be able to muster 55 or 56 percent of the vote in 2012. With a little luck, with no more foreign military adventures, and with an economy on the upswing, Democrats could even surge to a 59 or 60 percent blowout in 2012.

It now seems likely that the GOP will conclude that it lost this election just because of the economic crisis--not because of the kind of campaign McCain/Palin (i.e., Steve Schmidt and Rick Davis) ran or because Rovian politics has outlived its era. Let's hope that the GOP keeps doing the same thing: pandering to a motley coalition of racists, bigots, xenophobes, jingoists, and science-denying know-nothings--all manipulated to serve the plutocratic agenda of an unapologetic looting class.

If the GOP concludes that it should continue to follow the the same old game plan of Karl Rove, we can look forward to many more election cycles of Democratic Party success.



Some evidence for Wilder Effect nationally : (loboforestal - 11/6/2008 12:24:59 PM)
Didn't Obama consistently perform about 2% below the polls?

( check out : http://www.pollster.com/ for the numbers )

Pollster reports Obama/McCain trend (average of all polls) as 52/44.  set Obama+McCain to 100, translates to 54/46.

Actual results was 52/46.

Obama underperformed polls by 2%.

Just about what the Wilder effect predicts.



beth el no effect (pvogel - 11/6/2008 2:01:34 PM)
Obama took the same numbers as Moran.

The  pro Obama effect negated the anti Obama effect.  {Racism works both ways.}

Great day for   us, the US, The world, everybody



Analyze the "Jewish vote" please (Teddy - 11/6/2008 5:43:06 PM)
Did the strenuous efforts of the radical right Revelationists to frighten Jewish voters into believing that Obama was bad for Israel finally come home to the Democrats? There was a vicious smear campaign going on, including inserting scurrilous CDs into newspapers (cost was several million dollars, I imagine) attempting to prove Obama was a secret Muslim and hated Israel. A counter-movement, called the Great Schlep, was started by the younger generation of Jewish voters to counter the smears, hoping to convince their Jewish grandmothers Obama weas really Okay. Do we have any in depth analysis of what happened in, say, South Florida or New Jersey that would tell us how (un)successful the smear campaign was?


As far as I know... (Lowell - 11/6/2008 5:48:40 PM)
...the Jewish vote went overwhelmingly for Obama, as expected. See here for example:

Despite the tense rift between Republican and Democratic Jews over the course of the 2008 U.S. presidential campaign, exit polls on Tuesday showed that Barack Obama received about 77 percent of the Jewish vote.

These numbers were higher even than the 2004 election, when Democratic candidate John Kerry received 74 percent of the Jewish vote. Al Gore received the highest percentage of Jewish votes in 2000, with 79 percent.

Jeremy Ben-Ami, executive director of the J Street lobby group on Tuesday called Obama's victory a sign that the campaign waged against him by Republican Jews comprised "baseless smears."

"American Jews resoundingly rejected the two-year, multimillion dollar campaign of baseless smears and fear waged against him by the right wing of our community," he said.