2:38
- ABC News
- November 8, 2024
Polls were accurate but still underestimated Trump
A modest error in his favor was enough to sweep the swing states.
But the news is not all good. While polls had a historically good year in terms of error, they had a medium-to-bad one in terms of statistical bias, which measures whether polls are missing the outcome in the same direction. By our math, state polls overestimated support for Harris by an average of 2.7 points on margin in competitive states.
That's lower than the statistical bias of the polls in 2016 and 2020, which underestimated Trump by 3.2 and 4.1 points, respectively. But it's higher than the bias in the 2000, 2004, 2008 and 2012 elections.
This is not great news for pollsters. It means they did not fully solve their problems from 2016 and 2020 of getting enough Trump supporters to take their polls . While those problems may have been abated by pollsters weighting their data more aggressively or improving their sampling designs, they are still obviously present. You can really see this if you look at the pattern of polling bias in the competitive states from 2016 to 2024:
While pollsters managed to reduce their bias in some states, especially Wisconsin, from 2020 to 2024, the pattern in the industry is still the same: Pollsters are having a hard time reaching the types of people who support Trump.
While bias in the polling industry is troubling, it is not necessarily unexpected — especially after the last few elections. And it's worth repeating that a 3-point error on the margin is indeed very small historically. Political pollsters have designed a tool that, on average, can measure public opinion among hundreds of millions of people to within 1.5 percent of its \"true\" value (converting vote margin to vote share). When you think about it that way, it's actually remarkable that polls are as accurate as they are.
After the 2020 election, a year in which America's pollsters faced their worst performance since 1980, the American Association of Public Opinion Research (the professional society for pollsters and survey researchers) issued a warning to people trying to predict election outcomes in 2022 and 2024. \"Polls are often misinterpreted as precise predictions,\" it said. \"It is important in pre-election polling to emphasize the uncertainty by contextualizing poll results relative to their precision.... Most pre-election polls lack the precision necessary to predict the outcome of semi-close contests.\"
In other words, polls are simply not up to the task of dispositively determining the result of a close race before it happens. In such a case, the margin between candidates would be too small for observers to conclude that one candidate was reliably ahead, given the inherent uncertainty in polling.
Let's put this note of caution in the context of the 2024 election. At first glance, it may seem like polls had a bad year because they pointed to a close election and Trump looks like he will cruise to a 312-226 win in the Electoral College. But as I wrote last week, because he led in the Sun Belt swing states and was tied in Pennsylvania, polls didn't really even need to underestimate Trump at all for him to win the election. And, I warned, if they underestimated him by 2 points — which would be small compared to other misses historically — he could sweep all seven swing states.
Well, it looks like that is exactly what happened. In fact, it was the modal outcome in our final forecast. AAPOR's warning is more relevant today than ever.
","canonicalUrl":"https://abcnews.com/538/2024-polls-accurate-underestimated-trump/story?id=115652118","legacySlug":"/news/story/2024-polls-accurate-underestimated-trump-115652118","noIndexNoFollow":false},"publishTime":"21:17","publishDate":"11-08-2024","updatedTime":"21:21","updatedDate":"11-08-2024","socialImage":{"alt":"Republican presidential nominee former President Donald Trump and former first lady Melania Trump at an election night watch party at the Palm Beach Convention Center, Nov. 6, 2024, in West Palm Beach, Fla.","credit":"Evan Vucci/AP","ratio":"16x9","url":"https://s.abcnews.com/images/US/donald-trump-1-ap-gmh-241107_1731001029095_hpMain_16x9_1600.jpg","width":992,"height":558},"datePublished":"11/8/2024 21:17:00 GMT","video":{"live":false,"id":115652118,"headline":"Polls were accurate but still underestimated Trump","mediaAssetTitle":"POLLS-ACCURACY-2024","description":"A modest error in his favor was enough to sweep the swing states.","duration":"2:38","posterImg":{"url":"https://s.abcnews.com/images/GMA/default-img-undefined.png","width":608,"height":342},"video":{"feed":"https://service-pkgabcnews.akamaized.net/opp/hls/abcnews/2024/11/241106_538_politicspod_clip3_,500,800,1200,1800,2500,3200,4500,.mp4.csmil/playlist.m3u8"},"playlist":["132306053","132266872","132055565"]},"relatedItems":[{"contentType":"video","date":"April 23, 2026","headline":"Trump orders Navy to 'shoot and kill' any boat laying mines in Strait of Hormuz","section":"News","slug":"/video/132306053","id":"132306053","image":{"alt":"VIDEO: Trump orders Navy to 'shoot and kill' any boat laying mines in Strait of Hormuz","credit":"ABCNews.com","ratio":"1x1","url":"https://s.abcnews.com/images/GMA/260423_gma_scott_ceasefire3_hpMain_1x1_608.jpg","width":384,"height":384},"images":{"alt":"VIDEO: Trump orders Navy to 'shoot and kill' any boat laying mines in Strait of Hormuz","credit":"ABCNews.com","crops":[{"16x9":{"small":"https://s.abcnews.com/images/GMA/260423_gma_scott_ceasefire3_hpMain_16x9_608.jpg","medium":"https://s.abcnews.com/images/GMA/260423_gma_scott_ceasefire3_hpMain_16x9_992.jpg","large":"https://s.abcnews.com/images/GMA/260423_gma_scott_ceasefire3_hpMain_16x9_1600.jpg"}},{"9x16":{"small":"https://s.abcnews.com/images/GMA/260423_gma_scott_ceasefire3_hpMain_9x16_608.jpg","medium":"https://s.abcnews.com/images/GMA/260423_gma_scott_ceasefire3_hpMain_9x16_992.jpg","large":"https://s.abcnews.com/images/GMA/260423_gma_scott_ceasefire3_hpMain_16x9_1600.jpg"}},{"1x1":{"small":"https://s.abcnews.com/images/GMA/260423_gma_scott_ceasefire3_hpMain_1x1_608.jpg","medium":"https://s.abcnews.com/images/GMA/260423_gma_scott_ceasefire3_hpMain_1x1_992.jpg","large":"https://s.abcnews.com/images/GMA/260423_gma_scott_ceasefire3_hpMain_1x1_1600.jpg"}}]}},{"contentType":"video","date":"April 22, 2026","headline":"Fallout after Fed nominee grilled on Capitol Hill","section":"News","slug":"/video/132266872","id":"132266872","image":{"alt":"VIDEO: Fallout after Fed nominee grilled on Capitol Hill","credit":"ABCNews.com","ratio":"1x1","url":"https://s.abcnews.com/images/GMA/260422_gma_schulze_fed3_713_hpMain_1x1_608.jpg","width":384,"height":384},"images":{"alt":"VIDEO: Fallout after Fed nominee grilled on Capitol Hill","credit":"ABCNews.com","crops":[{"16x9":{"small":"https://s.abcnews.com/images/GMA/260422_gma_schulze_fed3_713_hpMain_16x9_608.jpg","medium":"https://s.abcnews.com/images/GMA/260422_gma_schulze_fed3_713_hpMain_16x9_992.jpg","large":"https://s.abcnews.com/images/GMA/260422_gma_schulze_fed3_713_hpMain_16x9_1600.jpg"}},{"9x16":{"small":"https://s.abcnews.com/images/GMA/260422_gma_schulze_fed3_713_hpMain_9x16_608.jpg","medium":"https://s.abcnews.com/images/GMA/260422_gma_schulze_fed3_713_hpMain_9x16_992.jpg","large":"https://s.abcnews.com/images/GMA/260422_gma_schulze_fed3_713_hpMain_16x9_1600.jpg"}},{"1x1":{"small":"https://s.abcnews.com/images/GMA/260422_gma_schulze_fed3_713_hpMain_1x1_608.jpg","medium":"https://s.abcnews.com/images/GMA/260422_gma_schulze_fed3_713_hpMain_1x1_992.jpg","large":"https://s.abcnews.com/images/GMA/260422_gma_schulze_fed3_713_hpMain_1x1_1600.jpg"}}]}},{"contentType":"video","date":"April 15, 2026","headline":"American influencer found dead in Tanzania","section":"News","slug":"/video/132055565","id":"132055565","image":{"alt":"VIDEO: American influencer found dead in Tanzania","credit":"ABCNews.com","ratio":"1x1","url":"https://s.abcnews.com/images/GMA/260415_gma_norwood_ashlee2_732_hpMain_1x1_608.jpg","width":384,"height":384},"images":{"alt":"VIDEO: American influencer found dead in Tanzania","credit":"ABCNews.com","crops":[{"16x9":{"small":"https://s.abcnews.com/images/GMA/260415_gma_norwood_ashlee2_732_hpMain_16x9_608.jpg","medium":"https://s.abcnews.com/images/GMA/260415_gma_norwood_ashlee2_732_hpMain_16x9_992.jpg","large":"https://s.abcnews.com/images/GMA/260415_gma_norwood_ashlee2_732_hpMain_16x9_1600.jpg"}},{"9x16":{"small":"https://s.abcnews.com/images/GMA/260415_gma_norwood_ashlee2_732_hpMain_9x16_608.jpg","medium":"https://s.abcnews.com/images/GMA/260415_gma_norwood_ashlee2_732_hpMain_9x16_992.jpg","large":"https://s.abcnews.com/images/GMA/260415_gma_norwood_ashlee2_732_hpMain_16x9_1600.jpg"}},{"1x1":{"small":"https://s.abcnews.com/images/GMA/260415_gma_norwood_ashlee2_732_hpMain_1x1_608.jpg","medium":"https://s.abcnews.com/images/GMA/260415_gma_norwood_ashlee2_732_hpMain_1x1_992.jpg","large":"https://s.abcnews.com/images/GMA/260415_gma_norwood_ashlee2_732_hpMain_1x1_1600.jpg"}}]}}],"relatedContentSection":"news","schemaContent":{"name":"Polls were accurate but still underestimated Trump","description":"A modest error in his favor was enough to sweep the swing states.","duration":"2:38","uploadDate":"11-08-2024","publication":"11-08-2024","images":"https://s.abcnews.com/images/GMA/default-img-undefined.png","url":"https://service-pkgabcnews.akamaized.net/opp/hls/abcnews/2024/11/241106_538_politicspod_clip3_,500,800,1200,1800,2500,3200,4500,.mp4.csmil/playlist.m3u8","contentUrl":"https://service-pkgabcnews.akamaized.net/opp/hls/abcnews/2024/11/241106_538_politicspod_clip3_,500,800,1200,1800,2500,3200,4500,.mp4.csmil/playlist.m3u8","link":"https://www.goodmorningamerica.com/news/story/2024-polls-accurate-underestimated-trump-115652118"}},"playlist":[{"id":"132281378","contentType":"story","section":"news"},{"id":"132283010","contentType":"story","section":"news"},{"id":"132273278","contentType":"story","section":"news"},{"id":"132231169","contentType":"story","section":"news"},{"id":"132206748","contentType":"story","section":"news"},{"id":"132200241","contentType":"story","section":"news"},{"id":"132054443","contentType":"story","section":"news"},{"id":"132054798","contentType":"story","section":"news"},{"id":"132033010","contentType":"story","section":"news"},{"id":"131912713","contentType":"story","section":"news"},{"id":"131830583","contentType":"story","section":"news"},{"id":"131834976","contentType":"story","section":"news"},{"id":"131554765","contentType":"story","section":"news"},{"id":"131554815","contentType":"story","section":"news"},{"id":"131543053","contentType":"story","section":"news"},{"id":"131432442","contentType":"story","section":"news"},{"id":"131121474","contentType":"story","section":"news"},{"id":"131247079","contentType":"story","section":"news"},{"id":"131228784","contentType":"story","section":"news"},{"id":"131178806","contentType":"story","section":"news"}],"kvps":{"pgtyp":"article","lang":"en","sp":"goodmorningamerica","programmatic":"true","bundleId":"com.abcnews"}},"analytics":{"accountID":"wdgnewwdgnewgmaweb","ns":"gma","pageName":"gma:news:video","pageType":"video","globalSpecVersion":"v1.08","siteDifferentiator":"gma:site","tagID":"g_page01","userABCookie":"0","section":"news","title":"Polls were accurate but still underestimated Trump","pubTime":"16:17","pubDate":"11-08-2024","modTime":"16:21","modDate":"11-08-2024","taxonomyTags":"none","id":115652118,"editorialOtherSubjects":"","wordCount":"none","columns":"none","authors":"","authorsUnit":"none","authorsBureau":"none","subBrand":"Good Morning America","provider":"Good Morning America","videoName":"Polls were accurate but still underestimated Trump","mediaAssetTitle":"POLLS-ACCURACY-2024","videoId":115652118,"mediaOnPage":"video","legacySlug":"/news/story/2024-polls-accurate-underestimated-trump-115652118"},"taboola":{}},"request":{"headers":{},"httpVersion":"1.1","method":"GET","url":"/video/115652118","vary":{"host":"www.goodmorningamerica.com","cached":true,"path":"/video/115652118","forwarded-proto":"https","device":"desktop","userab":"0"}},"viewport":{"width":1260,"height":0},"user":{}};