← All polling upset case files
PRESIDENT · 2016Wrong leaders in selected state aggregates

2016: small state margins, consequential polling misses

A reasonably close national popular-vote estimate can coexist with consequential errors in the states that decide the presidency.

What the poll said. What the vote showed.

Selected poll / stated aggregateRecorded outcome
2016: small state margins, consequential polling missesWisconsinPoll D +5.3 → result R +0.8 · miss 6.1 ppMichiganPoll D +3.2 → result R +0.2 · miss 3.4 ppPennsylvaniaPoll D +3.2 → result R +0.7 · miss 3.9 ppR +10D +10

Original retrospective calculation: retain the latest median-fieldwork-date eligible poll per firm and race in the archive's final-14-day window, average same-date ties, and give each firm equal weight. Partisan polls retained. Dates below are selected archive fieldwork midpoints, not publication dates or final interviewing dates. These are our retrospective archive means, not contemporaneously published RCP or FiveThirtyEight polling averages. The signed errors below use independently checked FEC valid-vote totals. They are errors of a mean, not mean absolute errors of individual polls.

What did the state polls suggest?

The selected archive estimates averaged Clinton leads of 5.3 points in Wisconsin, 3.2 in Michigan and 3.2 in Pennsylvania. Each average gives one equal-weight latest eligible estimate to a firm/race, with same-date ties averaged.

These are retrospective calculations from a stated archive window, not a claim about any particular website’s contemporaneous polling average. The archive’s interview midpoint dates are not publication dates or final fieldwork dates.

What did the votes show?

The FEC totals put Trump ahead in all three states: about 0.76 point in Wisconsin, 0.22 in Michigan and 0.72 in Pennsylvania. The selected mean margins therefore overstated Democrats by roughly 6.1, 3.4 and 3.9 points, respectively.

Clinton won the national popular vote while Trump won the presidency. This is why national popular-vote accuracy and Electoral College expectations must be evaluated separately.

Why did the state polls miss?

AAPOR's 2016 investigation found evidence that late-deciding voters and failure to adjust for educational differences contributed to state misses. Those general findings do not attribute a measured percentage of any specific retrospective aggregate's error to a single cause.

Education mattered because college graduates were more likely to participate in surveys and supported Clinton more strongly. Failing to correct the imbalance could make a survey look more Democratic than the electorate. Late-deciding voters also broke toward Trump in important states. These findings concern the evidence evaluated by AAPOR, not a precise decomposition of every poll’s miss.

Does this prove voters hid support for Trump?

No universal concealment explanation was established by the AAPOR 2016 evaluation. The documented evidence about education adjustment and late choice is stronger than an assumption that every respondent concealed a preference.

Errors in related states can move together. Averaging polls reduces some random noise, but a shared selection or turnout-model problem can survive the average. The three state outcomes are not independent demonstrations of three unrelated polling failures.

What should readers change?

Treat a small state lead as uncertain. Read the interviewing period, population, weighting disclosures and likely-voter assumptions. Distinguish a measurement of current preferences from a model assigning a probability of winning the Electoral College.

Do not carry the same correction into the next election automatically. A later cycle can have a different response pattern, candidate coalition, turnout environment or direction of error.

What to carry forward

A reasonably close national popular-vote estimate can coexist with consequential errors in the states that decide the presidency.

THE EVIDENCE

Sources behind this case.

  1. AAPOR evaluation of 2016 election polls ↗Evidence on late-deciding voters and education adjustment; national versus state performance.
  2. FEC Federal Elections 2016 ↗2016 presidential electoral and popular vote state summary, printed page 6 (PDF page 11)
  3. Pinned FiveThirtyEight poll archive ↗Original retrospective calculation: retain the latest median-fieldwork-date eligible poll per firm and race in the archive's final-14-day window, average same-date ties, and give each firm equal weight. Partisan polls retained. Dates below are selected archive fieldwork midpoints, not publication dates or final interviewing dates.