Join In On The Action "Register Here" To View The Forums

Already a Member Login Here

Board index Forum Index
User avatar
Dignitary
 
Posts: 1573
Joined: 19 Dec 2000, 4:40 pm

Post 03 Nov 2012, 12:36 pm

There are too many variables in elections to be making percentage predictions. Silver's model makes a certain set of assumptions and then uses statistical analysis to formulate predictions. However, social science is not like physics--human behavior is not that predictable. I do like the predictive value of using state averages--essentially when you average a bunch of polls together it takes the outlier affect out that relying on a single poll could have and taken together the state polls average seels to come close to the actual result in recent elections. Now Republicans have made the argument that there is a common error among most of the polls (that they are surveying too many Democrats) and that therefore the averaging wont help to predict the result. We'll see--it does not seem like the polls have gotten it that wrong (except for 1980 election), but it's possible
User avatar
Statesman
 
Posts: 11324
Joined: 15 Aug 2000, 8:59 am

Post 03 Nov 2012, 2:32 pm

freeman
However, social science is not like physics--human behavior is not that predictable


really? Maybe its not as predictable as figuring a ballistic path but its predicitable enough that enormous industries (marketing, advertsing, packaging etc) make companies profitable based on that predictability. Think of any others? (Safety, security, investment etc.) Its really all based on the fact that past behaviours tend to provide guidance to how people behave in the future...
You're seling Siver short. His model incorporates a lot more complexitiy than any other. He's not predicting an election national poll performance or indicators like "presidential approval". he's looking at 51 seperate electons, and analyzing polls as they go through. In the end it will depend upon the final results... And he's a true stats man. he doesn't say Obama is going to win., He says there's an 81% chance that Obama will win. (The elctoral college).
Since April, when I made my prediction based on Silver, only one state seems to be likely to change. (Florida). All the fury and noise and so little has changed.
User avatar
Ambassador
 
Posts: 21062
Joined: 15 Jun 2002, 6:53 am

Post 03 Nov 2012, 3:27 pm

rickyp wrote:freeman
However, social science is not like physics--human behavior is not that predictable


really? Maybe its not as predictable as figuring a ballistic path but its predicitable enough that enormous industries (marketing, advertsing, packaging etc) make companies profitable based on that predictability. Think of any others? (Safety, security, investment etc.) Its really all based on the fact that past behaviours tend to provide guidance to how people behave in the future...
You're seling Siver short. His model incorporates a lot more complexitiy than any other. He's not predicting an election national poll performance or indicators like "presidential approval". he's looking at 51 seperate electons, and analyzing polls as they go through. In the end it will depend upon the final results... And he's a true stats man. he doesn't say Obama is going to win., He says there's an 81% chance that Obama will win. (The elctoral college).
Since April, when I made my prediction based on Silver, only one state seems to be likely to change. (Florida). All the fury and noise and so little has changed.


Is he biased? Does he favor one poll over another? Is it all a proven formula?

The most current Public Policy Polling survey, released Saturday, has Obama up only one point, 49–48. That poll is given a weighting under Silver’s model of .95201. The PPP poll taken last weekend had Obama up five, 51–46. This poll is a week older but has a weighting of 1.15569.

The NBC/Marist Ohio poll conducted twelve days ago has a higher weighting attached to it (1.31395) than eight of the nine polls taken since. The poll from twelve days ago also, coincidentally enough, is Obama’s best recent poll in Ohio, because of a Democratic party-identification advantage of eleven points. By contrast, the Rasmussen poll from eight days later, which has a larger sample size, more recent field dates, but has an even party-identification split between Democrats and Republicans, has a weighting of .88826, lower than any other poll taken in the last nine days.


In other words, the results of "The Model" are dependent on Silver's subjective decisions on how each poll should be "weighted," i.e. how "accurate" Silver believes the poll is. After two decades in politics, I'm shocked that someone would think an almost two-week old poll is a more accurate picture of the race than a current poll from the same pollster. This isn't a model; this is an elaborate mathematical equation designed to generate what Silver "thinks" the outcome ought to be.

This was evident in Silver's predictions for the 2010 elections. While he acknowledged that the GOP was favored to win control of the House, he pegged their chances of picking up more than 60 seats at only 25%. In other words, there was a 75% probability that they would pick up less than 60 seats. They picked up 64.

Another serious problem for "The Model" is that Silver operates from a premise that state polls are, prima facie, more accurate than national polls. It is only in the last decade or so that we've had robust polling at the state and national level, so I'm not really certain we have enough data-points to back up this assumption. Yes, the presidential election is fought state-by-state, but state and national polling tends, over time, tend to move in concert. The reason a state is considered a "swing" state is that it generally matches up with the country as a whole.


So, he subjectively weights polls on what he thinks is most accurate. He was way off in 2010. There is not much history on the State polls upon which he depends. And, "swing States" are "swing States" because they tend to follow the general pattern of the country. New York is not a "swing State" because it pretty much stays blue.

Again, his ratings for the "swing States" are ridiculous. Anyone want to give me 2:1 on VA or 4:1 on Ohio?

You have blind faith.
User avatar
Dignitary
 
Posts: 3536
Joined: 02 Oct 2000, 9:01 am

Post 04 Nov 2012, 11:33 am

Doctor Fate wrote:You have blind faith.


Now isn't that the pot calling the kettle . . . oops, I thought I was just thinking that.
User avatar
Emissary
 
Posts: 3405
Joined: 12 Jun 2006, 2:01 am

Post 04 Nov 2012, 12:08 pm

I've noticed a concerted campaign in the press in recent days to try and undermine Silver and cast doubt on his predictions. I find this interesting, because it suggests a deliberate attempt on the part of Republicans (whether they're right or not isn't necessarily relevant). I'm wondering what the motivation might be. Possibly some kind of attempt to maintain the 'Mittmentum' idea right through till polling day ?

I think it's a bit silly when pollsters become the major news story. I know it's inevitable in such a close election that there's going to be a lot of analysis of the fine margins, but it gets really dull.
User avatar
Ambassador
 
Posts: 16006
Joined: 15 Apr 2004, 6:29 am

Post 04 Nov 2012, 12:20 pm

I think there's an element of shooting the messenger.

MIttmentum ended by the 23rd October, and there was a consistent position in the polls for a week before Sandy hit. Since then, there's been a noticeable shift towards Obama, although a small one. Now, that is not a popular message for people who want to hear that instead Mitt Romney is growing in popularity and will surprise everyone on Tuesday night. Even though there are loads of polls out there, and even though there are plenty of different modellers out there, Nate Silver is well known and is thought to be a liberal, so gets all the ire.

Personality-based politics is annoying enough, but personality based pollster bashing for politics?

Silver could well be wrong. But if he is, a lot of polling organisations are also wrong. If he's right, then I look forward to seeing those who have been pooh-poohing him accept it.
User avatar
Ambassador
 
Posts: 21062
Joined: 15 Jun 2002, 6:53 am

Post 04 Nov 2012, 1:23 pm

geojanes wrote:
Doctor Fate wrote:You have blind faith.


Now isn't that the pot calling the kettle . . . oops, I thought I was just thinking that.

Not at all. I'm watching polls in MN, PA, OH, and . . . MI? A poll in Michigan today shows Romney up.

I don't care about Silver, except he is the crucifix/holy water/silver bullet for liberals here, including Ricky's and freeman2. Their answer to any query is "Silver says."

Now, questioning him is . . . Heretical.

Interesting.
User avatar
Ambassador
 
Posts: 16006
Joined: 15 Apr 2004, 6:29 am

Post 04 Nov 2012, 1:59 pm

Who said it was 'Heretical' (other than you)?
User avatar
Ambassador
 
Posts: 21062
Joined: 15 Jun 2002, 6:53 am

Post 04 Nov 2012, 2:39 pm

Right. So, my choice of word is the issue? It doesn't matter what facts are raised, some here have insisted Silver is beyond questioning.

Just read this. What do you know? Silver's baseball formula also had issues. http://www2.macleans.ca/2012/11/04/tarn ... -of-stats/
User avatar
Statesman
 
Posts: 11324
Joined: 15 Aug 2000, 8:59 am

Post 04 Nov 2012, 5:19 pm

fate
Is he biased? Does he favor one poll over another? Is it all a proven formula

Linking to Breitbart off the question "Is he biased" is the height of irony.
The thing about Silver is that everything he puts into his anaylyis and his prognostication model is avalibale for review. he was amongst the first to analyze pollster bias, and try to explain it. He was among the first to analyze the differences in how pollsters screen for likelihood of voting.
And he, more than anyone, stresses that he's dealing in probablilities NOT definitive prognostications. For instacne, he still thinks that Romney could win the electoral college. Its just that the liklihood is only 15%.
Having said that, reading Silver leavens the effect any singular published poll has on how one discerns the path of the election. And he's pretty down to earth.

On Saturday he wrote
Friday’s polling should make it easy to discern why Mr. Obama has the Electoral College advantage. There were 22 polls of swing states published Friday. Of these, Mr. Obama led in 19 polls, and two showed a tie. Mitt Romney led in just one of the surveys, a Mason-Dixon poll of Florida.

To combat this evidence you want people to think he's biased. Did his bias produce those 22 polls?
User avatar
Ambassador
 
Posts: 21062
Joined: 15 Jun 2002, 6:53 am

Post 04 Nov 2012, 7:23 pm

Right, rickyp. I'm guessing you didn't bother to read anything, in particular the Macleans article?

If you had, you'd see how he botched the elections in the UK. You'd also see his dreaded PECOTA formula for baseball turned out to have more than a few flaws.

State polls may/may not be as reliable as Silver thinks. However, there are not enough votes in swing states to explain the difference between the national polls and the state polls.
User avatar
Ambassador
 
Posts: 16006
Joined: 15 Apr 2004, 6:29 am

Post 05 Nov 2012, 1:07 am

I still don't see where Silver is held up to be beyond question. Who has said that he is, DF? Quote them.
User avatar
Ambassador
 
Posts: 4991
Joined: 08 Jun 2000, 10:26 am

Post 05 Nov 2012, 5:10 am

I've heard that there are a few percent of the electorate who haven't yet made up their minds, and won't until they actually fill out their ballot. How does that get captured by these polls?
User avatar
Ambassador
 
Posts: 16006
Joined: 15 Apr 2004, 6:29 am

Post 05 Nov 2012, 6:32 am

RJ, most polls do not add up to 100%, even those that account for third parties. Hence Obama and Romney are on about 47-48% in the RCP average, leaving 5%. I doubt that third parties will get more than 2%. So, while most likely voters will have already decided, polls appear to be showing a small number of undecideds.

Some polls will be allocating undecideds based on assumptions. Those may be that they break in a consistent way with the decided vote (not necessarily the same way), previous voting patterns, party registration, etc. Some may use a 'forcing' question to get voters to pick, but even then some can not respond to it. Others may just ignore them (which is equivalent to saying they'd break in the same proportion as decided voters.
User avatar
Ambassador
 
Posts: 21062
Joined: 15 Jun 2002, 6:53 am

Post 05 Nov 2012, 7:14 am

I like this CNN poll. http://hotair.com/archives/2012/11/05/c ... ied-at-49/

Why? Because it shows Romney up by 22 with Independents. So, how do they get a tie? By giving Democrats an 11% edge in the sample. That is far better than Obama did in '08. If you believe that . . .

As for Silver, if I were to scour the archives, I'd venture to say he's been thrown down as THE expert 20x more than anyone else, probably more. Ask rickyp and freeman2 if they think he's infallible. They will come close to saying "yes." He is their security blanket, their shelter in the storm.