How Accurate Were Polls On 2022 PA Races?
Nine of the 12 polling firms that surveyed both the Senate and gubernatorial races predicted the eventual winner.
March 14, 2023
No Comments
Nine of the 12 polling firms that surveyed both the Senate and gubernatorial races predicted the eventual winner.
Here are the moving averages for polls for Pennsylvania’s U.S. Senate seat and governor’s mansion.
Surveys conducted following debate between candidates
As expected, Senate race nearly even. Shapiro maintains edge in governor’s race.
Republican lead still within margin of error; Shapiro tops 50% again
Survey shows Dems still in control in pre-Senate debate survey
Democrats have not trailed in any survey since May.
Poll shows Republicans gaining ground with 19 days remaining
Wild and Scheller race to close to call in Muhlenberg College poll
Democratic Attorney General continues to lead surveys
You know the winners.
You know the spread.
How did the polls do in the final tally for the 2022 Pennsylvania Senate and gubernatorial races?
The folks at FiveThirtyEight say “Let’s give a big round of applause to the pollsters. Measuring public opinion is, in many ways, harder than ever — and yet, the polling industry just had one of its most successful election cycles in U.S. history. Despite a loud chorus of naysayers claiming that the polls were either underestimating Democratic support or biased yet again against Republicans, the polls were more accurate in 2022 than in any cycle since at least 1998, with almost no bias toward either party.”
In their minds, “the best way to measure a poll’s accuracy is to look at its absolute error — i.e., the difference between a poll’s margin and the actual margin of the election (between the top two finishers in the election, not the poll). For example, if a poll gave the Democratic candidate a lead of 2 percentage points, but the Republican won the election by 1 point, that poll had a 3-point error.”
So we’ll do the same.
First, a look at the U.S. Senate race won by Democrat John Fetterman over Republican Mehmet Oz and the polls over the final month.
Fetterman won 51.25 percent of the vote, while Oz captured 46.33 percent – a difference of 4.92%.
The overall average of 43 polls during the campaign gave Fetterman a +5.6 percent advantage, while the average of the last five polls showed Fetterman up +2.7 points.
Now, a look at the race for Pennsylvania governor won by Democrat Josh Shapiro over Republican Doug Mastriano and the polls over the final month.
Shapiro won 56.49 percent of the vote, while Mastriano captured 41.71 percent – a difference of 14.78%.
The overall average of 36 polls during the campaign gave Shapiro a +10.3 percent advantage, while the average of the last five polls showed Shapiro up +13.1 points.
Looking at the differences between the 12 pollsters who surveyed both races and the two outcomes:
Among the national pollsters that only surveyed one race:
Now that the exam has been turned in, what were the new and improved grades given out to the pollsters that covered PA in 2022?
A+ – Siena / New York Times
A – Beacon, Cygnal, Marist, Monmouth
A- – Emerson, Muhlenberg, Suffolk
B+ – Co/Efficient, Public Opinion Strategies, Susquehanna Polling, YouGov
B – Insider Advantage, Rasmussen, Trafalgar
C+ – SSRS
C – Survey Monkey
Pollsters with a relatively small numberof polls receive a provisional rating rather than a precise letter grade.
A/B – Echelon Insights, Fabrizio, Lee & Associates
B/C – Blueprint, Franklin & Marshall, Impact Research, Phillips Andover, RABA Research
FiveThirtyEight’s ratings are letter grades that we assign to each pollster based on historical accuracy and transparency. (You can read exactly how it calculates pollster ratings here.) They’re one of many tools you should use when deciding how much stock to place in a poll.
You know the winners.
You know the spread.
How did the polls do in the final tally for the 2022 Pennsylvania Senate and gubernatorial races?
The folks at FiveThirtyEight say “Let’s give a big round of applause to the pollsters. Measuring public opinion is, in many ways, harder than ever — and yet, the polling industry just had one of its most successful election cycles in U.S. history. Despite a loud chorus of naysayers claiming that the polls were either underestimating Democratic support or biased yet again against Republicans, the polls were more accurate in 2022 than in any cycle since at least 1998, with almost no bias toward either party.”
In their minds, “the best way to measure a poll’s accuracy is to look at its absolute error — i.e., the difference between a poll’s margin and the actual margin of the election (between the top two finishers in the election, not the poll). For example, if a poll gave the Democratic candidate a lead of 2 percentage points, but the Republican won the election by 1 point, that poll had a 3-point error.”
So we’ll do the same.
First, a look at the U.S. Senate race won by Democrat John Fetterman over Republican Mehmet Oz and the polls over the final month.
Fetterman won 51.25 percent of the vote, while Oz captured 46.33 percent – a difference of 4.92%.
The overall average of 43 polls during the campaign gave Fetterman a +5.6 percent advantage, while the average of the last five polls showed Fetterman up +2.7 points.
Now, a look at the race for Pennsylvania governor won by Democrat Josh Shapiro over Republican Doug Mastriano and the polls over the final month.
Shapiro won 56.49 percent of the vote, while Mastriano captured 41.71 percent – a difference of 14.78%.
The overall average of 36 polls during the campaign gave Shapiro a +10.3 percent advantage, while the average of the last five polls showed Shapiro up +13.1 points.
Looking at the differences between the 12 pollsters who surveyed both races and the two outcomes:
Among the national pollsters that only surveyed one race:
Now that the exam has been turned in, what were the new and improved grades given out to the pollsters that covered PA in 2022?
A+ – Siena / New York Times
A – Beacon, Cygnal, Marist, Monmouth
A- – Emerson, Muhlenberg, Suffolk
B+ – Co/Efficient, Public Opinion Strategies, Susquehanna Polling, YouGov
B – Insider Advantage, Rasmussen, Trafalgar
C+ – SSRS
C – Survey Monkey
Pollsters with a relatively small numberof polls receive a provisional rating rather than a precise letter grade.
A/B – Echelon Insights, Fabrizio, Lee & Associates
B/C – Blueprint, Franklin & Marshall, Impact Research, Phillips Andover, RABA Research
FiveThirtyEight’s ratings are letter grades that we assign to each pollster based on historical accuracy and transparency. (You can read exactly how it calculates pollster ratings here.) They’re one of many tools you should use when deciding how much stock to place in a poll.
You know the winners.
You know the spread.
How did the polls do in the final tally for the 2022 Pennsylvania Senate and gubernatorial races?
The folks at FiveThirtyEight say “Let’s give a big round of applause to the pollsters. Measuring public opinion is, in many ways, harder than ever — and yet, the polling industry just had one of its most successful election cycles in U.S. history. Despite a loud chorus of naysayers claiming that the polls were either underestimating Democratic support or biased yet again against Republicans, the polls were more accurate in 2022 than in any cycle since at least 1998, with almost no bias toward either party.”
In their minds, “the best way to measure a poll’s accuracy is to look at its absolute error — i.e., the difference between a poll’s margin and the actual margin of the election (between the top two finishers in the election, not the poll). For example, if a poll gave the Democratic candidate a lead of 2 percentage points, but the Republican won the election by 1 point, that poll had a 3-point error.”
So we’ll do the same.
First, a look at the U.S. Senate race won by Democrat John Fetterman over Republican Mehmet Oz and the polls over the final month.
Fetterman won 51.25 percent of the vote, while Oz captured 46.33 percent – a difference of 4.92%.
The overall average of 43 polls during the campaign gave Fetterman a +5.6 percent advantage, while the average of the last five polls showed Fetterman up +2.7 points.
Now, a look at the race for Pennsylvania governor won by Democrat Josh Shapiro over Republican Doug Mastriano and the polls over the final month.
Shapiro won 56.49 percent of the vote, while Mastriano captured 41.71 percent – a difference of 14.78%.
The overall average of 36 polls during the campaign gave Shapiro a +10.3 percent advantage, while the average of the last five polls showed Shapiro up +13.1 points.
Looking at the differences between the 12 pollsters who surveyed both races and the two outcomes:
Among the national pollsters that only surveyed one race:
Now that the exam has been turned in, what were the new and improved grades given out to the pollsters that covered PA in 2022?
A+ – Siena / New York Times
A – Beacon, Cygnal, Marist, Monmouth
A- – Emerson, Muhlenberg, Suffolk
B+ – Co/Efficient, Public Opinion Strategies, Susquehanna Polling, YouGov
B – Insider Advantage, Rasmussen, Trafalgar
C+ – SSRS
C – Survey Monkey
Pollsters with a relatively small numberof polls receive a provisional rating rather than a precise letter grade.
A/B – Echelon Insights, Fabrizio, Lee & Associates
B/C – Blueprint, Franklin & Marshall, Impact Research, Phillips Andover, RABA Research
FiveThirtyEight’s ratings are letter grades that we assign to each pollster based on historical accuracy and transparency. (You can read exactly how it calculates pollster ratings here.) They’re one of many tools you should use when deciding how much stock to place in a poll.
You know the winners.
You know the spread.
How did the polls do in the final tally for the 2022 Pennsylvania Senate and gubernatorial races?
The folks at FiveThirtyEight say “Let’s give a big round of applause to the pollsters. Measuring public opinion is, in many ways, harder than ever — and yet, the polling industry just had one of its most successful election cycles in U.S. history. Despite a loud chorus of naysayers claiming that the polls were either underestimating Democratic support or biased yet again against Republicans, the polls were more accurate in 2022 than in any cycle since at least 1998, with almost no bias toward either party.”
In their minds, “the best way to measure a poll’s accuracy is to look at its absolute error — i.e., the difference between a poll’s margin and the actual margin of the election (between the top two finishers in the election, not the poll). For example, if a poll gave the Democratic candidate a lead of 2 percentage points, but the Republican won the election by 1 point, that poll had a 3-point error.”
So we’ll do the same.
First, a look at the U.S. Senate race won by Democrat John Fetterman over Republican Mehmet Oz and the polls over the final month.
Fetterman won 51.25 percent of the vote, while Oz captured 46.33 percent – a difference of 4.92%.
The overall average of 43 polls during the campaign gave Fetterman a +5.6 percent advantage, while the average of the last five polls showed Fetterman up +2.7 points.
Now, a look at the race for Pennsylvania governor won by Democrat Josh Shapiro over Republican Doug Mastriano and the polls over the final month.
Shapiro won 56.49 percent of the vote, while Mastriano captured 41.71 percent – a difference of 14.78%.
The overall average of 36 polls during the campaign gave Shapiro a +10.3 percent advantage, while the average of the last five polls showed Shapiro up +13.1 points.
Looking at the differences between the 12 pollsters who surveyed both races and the two outcomes:
Among the national pollsters that only surveyed one race:
Now that the exam has been turned in, what were the new and improved grades given out to the pollsters that covered PA in 2022?
A+ – Siena / New York Times
A – Beacon, Cygnal, Marist, Monmouth
A- – Emerson, Muhlenberg, Suffolk
B+ – Co/Efficient, Public Opinion Strategies, Susquehanna Polling, YouGov
B – Insider Advantage, Rasmussen, Trafalgar
C+ – SSRS
C – Survey Monkey
Pollsters with a relatively small numberof polls receive a provisional rating rather than a precise letter grade.
A/B – Echelon Insights, Fabrizio, Lee & Associates
B/C – Blueprint, Franklin & Marshall, Impact Research, Phillips Andover, RABA Research
FiveThirtyEight’s ratings are letter grades that we assign to each pollster based on historical accuracy and transparency. (You can read exactly how it calculates pollster ratings here.) They’re one of many tools you should use when deciding how much stock to place in a poll.
Who Will Be Speaker of the PA House on February 28?
Loading ...