saskatchewan election 2016 - mainstreet research...saskatchewan election 2016 ... - quito maggi,...

14
SASKATCHEWAN ELECTION 2016

Upload: others

Post on 04-Apr-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: SASKATCHEWAN ELECTION 2016 - Mainstreet Research...SASKATCHEWAN ELECTION 2016 ... - Quito Maggi, President, Mainstreet Research. SCRIPTING DIALING DATA INTEGRITY RELEASE WEIGHTING

SASKATCHEWAN ELECTION 2016

Page 2: SASKATCHEWAN ELECTION 2016 - Mainstreet Research...SASKATCHEWAN ELECTION 2016 ... - Quito Maggi, President, Mainstreet Research. SCRIPTING DIALING DATA INTEGRITY RELEASE WEIGHTING

“Pre-election polls are expected to be accurate in their estimates of a voting tally or the share of the vote for parties and candidates in an election, especially if they

are conducted close to the election itself.”

- World Association for Social, Opinion and Market Research, ESOMAR CODE, Section 8.1

Page 3: SASKATCHEWAN ELECTION 2016 - Mainstreet Research...SASKATCHEWAN ELECTION 2016 ... - Quito Maggi, President, Mainstreet Research. SCRIPTING DIALING DATA INTEGRITY RELEASE WEIGHTING

TABLE OF CONTENTS

A Message from the President, 4Polling 101, 5

Reading Our Polls, 6-8FAQ, 9

For Media, 10What to Expect in Saskatchewan, 11

Our Record in 2015, 12

Page 4: SASKATCHEWAN ELECTION 2016 - Mainstreet Research...SASKATCHEWAN ELECTION 2016 ... - Quito Maggi, President, Mainstreet Research. SCRIPTING DIALING DATA INTEGRITY RELEASE WEIGHTING

A MESSAGE FROM THE PRESIDENT

Differentiated by its large sample sizes, Mainstreet Research has provided accurate snapshots of public opinion, having predicted a majority NDP government in Alberta, a majority Liberal government in British Columbia and a majority Liberal government in Ontario. Mainstreet has been the most accurate polling firm in several by elections and the most recent Toronto mayoral election. Most recently, Mainstreet Research was the only polling firm to correctly predict a Liberal majority government in the 2015 federal election.

Welcome to Mainstreet Research and thank you for reading our guide to Saskatchewan Polling.

As I began writing this letter, we found ourselves in the early stages of the US Presidential Primaries and although Mainstreet is a Canadian company, I follow US politics pretty closely. Last week, during the Democratic Debate between Hillary Clinton and Bernie Sanders, Clinton said that “Wall Street cannot destroy Main Street”. It is perhaps appropriate to note that the sentiment expressed by Mrs. Clinton is the origin of the name Mainstreet.

The Mainstreet name originates from a saying I have used for many years, I cannot say whether I came up with it or if someone else said it before me. The saying is as follows: “The votes are on Main Street, not on Bay Street”. Public opinion is not determined on Wall Street or

Bay Street. Money is a necessary part of politics and public administration, and it can pay for many persuasive things, but it cannot buy public sentiment.

Mainstreet Research began as a Technology company, finding technology solutions and providing data and data integration to political candidates and parties across Canada for over a decade. As we grew and evolved with emerging technologies like VOIP, SMS and GIS, we began to see that our big data approach to sampling resulted in superior results than to those of 20th century pollsters. After a number of years of extensive testing and the addition of various resources to our team, we began releasing polls for public consumption and scrutiny. Our success in correctly predicting voter behaviour across Canada at all levels of politics is a record we are proud to stand on.

Mainstreet Research continues to strive for excellence in the world of public opinion and research. Our new technologies, including Smart IVR, Chimera IVR and our mobile application, CampaignR, continue to lead while others wring their hands about decreased response rates and stampede to embrace online panel, non probability sampling (or pseudo Probability Sampling) that has led to a series of catastrophic polling failures in Canada and Europe.

We believe in probability sampling.We believe in large sample sizes.We believe in eliminating/mitigating bias in every possible way.We believe in disclosure of scripting, and including undecided responses.

Thank-you for reading our guide to our Saskatchewan Election Polls, if you have any further questions please don’t hesitate to be in touch.

- Quito Maggi, President, Mainstreet Research

Page 5: SASKATCHEWAN ELECTION 2016 - Mainstreet Research...SASKATCHEWAN ELECTION 2016 ... - Quito Maggi, President, Mainstreet Research. SCRIPTING DIALING DATA INTEGRITY RELEASE WEIGHTING

SCRIPTING

DIALING

DATA INTEGRITY

RELEASE

WEIGHTING

REPORT

The survey topic(s) is/are decided upon. Every Saskatchewan election poll includes voter intention

questions. Working with our media partners we determine additional issue questions.

The poll is scheduled and dialed. This is where you may receive a phone call from us.

All data is re-formatted and checked - this includes removing any identifying information from responses to

ensure respondent confidentiality.

The data from the poll is weighted to reflect the general population using our own proprietary formulas. You can

read more about weighting on page 8.

Tables are sent to our graphics team to create charts, we analyze the results and build a press release. Our media

partner receives the details of the poll results.

The first place the poll results appear is in the Leader Post and Star Phoenix, later the full report is uploaded to

our website.

POLLING 101 - A SIMPLIFIED TIMELINE

Page 6: SASKATCHEWAN ELECTION 2016 - Mainstreet Research...SASKATCHEWAN ELECTION 2016 ... - Quito Maggi, President, Mainstreet Research. SCRIPTING DIALING DATA INTEGRITY RELEASE WEIGHTING

A3

If a provincial election were held today which party would you support?

SASKATCHEWAN PARTY LED BY BRAD WALL NDP LED BY CAM BROTENLIBERAL PARTY LED BY DARRIN LAMOUREUXGREEN PARTY LED BY VICTOR LAUUNDECIDEDSAMPLE

18-3447%27%5%5%16%300

35-4947%28%9%2%14%337

50-6450%30%6%2%12%335

65+56%25%5%1%

13%505

Female46%32%4%3%15%834

Male53%23%9%3%13%643

SASKATCHEWAN PARTY LED BY BRAD WALL NDP LED BY CAM BROTENLIBERAL PARTY LED BY DARRIN LAMOUREUXGREEN PARTY LED BY VICTOR LAUUNDECIDEDSAMPLE

Regina41%30%5%8%17%518

Rest of SK55%24%7%1%

12%466

Saskatoon42%36%5%2%15%493

0

5

10

15

20

25

30

35

40

45

50

55

Oct 6 Jan 4 Feb 11

NDPSK Party Liberal Green UD

SK49%28%6%3%14%1477

Page 7: SASKATCHEWAN ELECTION 2016 - Mainstreet Research...SASKATCHEWAN ELECTION 2016 ... - Quito Maggi, President, Mainstreet Research. SCRIPTING DIALING DATA INTEGRITY RELEASE WEIGHTING

READING OUR REPORTS

On the previous page we’ve dropped in an actual page from one of our Saskatchewan reports. Here are some common things to look for in each of our releases.

1. Page number. Sometimes we will release the results of a poll in different parts. You’ll be able to tell if there is a companion report available by looking at the letter. For instance, if you see B4 this means there is a companion report available (the A report). Similarly if you see a C series report there are also A and B reports available.

2. Poll sponsor. Most polls you’ll see this election will be Mainstreet/Postmedia polls. These appear in the Regina Leader Post & Saskatoon Star Phoenix. If you want to be the first to read our results make sure you have a subscription to either paper. There may be polls released this election commissioned by a third party - in that instance you will see their logo prominently displayed in the upper right hand corner. We identify the sponsor of a poll on every page of a release.

3. Question asked. In most cases this is the exact wording of the question though in some cases we will condense or summarize a question with a subject heading. When you see something like; PARTY AFFILIATION VS SUPPORT FOR LNG, you’ll see a breakout table looking at Party Affiliation (1 question) with the results compared to a second question (Support for LNG). You can see the precise wording of questions on the Script page which is the third last page of a release (unless the script runs more than 1 page).

4. Sample Sizes by Demographic. These are the raw sample sizes for the poll. In this case we surveyed 300 adults between the ages of 18-34. 643 respondents were Male, 834 were female. Every poll we release is weighted - for more on how weighting affects our polls see the next page.

5. Topline numbers for the province. You can see from this column we surveyed 1,477 Saskatchewan voters. 49% are voting for the Saskatchewan party. The column should add up to 98%-102% as a result of rounding. Make sure you are reading the report vertically. In this way you can read the breakout for Regina, Saskatoon & Rest of Saskatchewan.

6. Poll dates. These are the dates the polls were conducted - not the dates the polls were released. To see previous reports go to mainstreetresearch.ca/saskatchewan-polls

Not Pictured:

7. On the front page of the report under Methodology you will see how the poll was conducted (typically IVR) the margin of error for the poll and the regional margins of error.

8. This page has the results for ‘all voters’ this includes those who are undecided. A separate page will have results for ‘Decided & Leaning Voters’ and will be labeled as such.

Page 8: SASKATCHEWAN ELECTION 2016 - Mainstreet Research...SASKATCHEWAN ELECTION 2016 ... - Quito Maggi, President, Mainstreet Research. SCRIPTING DIALING DATA INTEGRITY RELEASE WEIGHTING

READING OUR REPORTS

WEIGHTING

When we collect a sample it’s highly unlikely that it will be representative of the total population. This is where weighting comes in. For example if 40% of our sample is Male and the Male population is 50%, we will assign a greater score to Male respondents than to Female respondents to make up the difference. Every polling firm weighs their sample in their own way. Our weights are based on the 2011 Canadian Census, and we identify the weights in our Methodology statement on the front of every report.

ALL VOTERS vs DECIDED VOTERS ONLY vs DECIDED & LEANING VOTERS

In most if not all reports for Saskatchewan we will identify two sets of numbers: all voters and leaning & decided voters. In other work, including Manitoba, you will see Decided voters identified as well.

All Voters - this is exactly what it sounds like. Every response including those voters which are undecided.

Decided Voters Only - The only difference is we exclude undecided voters and re-calculate the percentages.

Decided & Leaning Voters - In addition to voters who have a firm decision, we include voters that are ‘leaning’ a certain way.

EXAMPLES

Quito is polled and responds that he is voting for the Saskatchewan Party. He will be included in all three sets of numbers as supporting the Saskatchewan Party.

David is polled and responds that he is Undecided. A follow-up question is asked, which way is he leaning? David responds he is leaning towards the NDP. He will be included in two sets of numbers: he will be included in All Voters as Undecided. He will be included in Decided and Leaning voters as NDP.

Rebecca is polled and responds she is Undecided. She is asked the follow up: which way is she leaning? She responds she is still Undecided. She will be included in one set of numbers: All voters as undecided.

COMPARING OUR WORK TO OTHER POLLING FIRMS

Most other polling firms will report either Decided or Decided & Leaning Numbers. It’s important to make sure you are comparing the right sets of numbers.

MARGINS OF ERROROur polls have a true margin of error. They are scientific because the sample is randomly selected.

Page 9: SASKATCHEWAN ELECTION 2016 - Mainstreet Research...SASKATCHEWAN ELECTION 2016 ... - Quito Maggi, President, Mainstreet Research. SCRIPTING DIALING DATA INTEGRITY RELEASE WEIGHTING

FREQUENTLY ASKED QUESTIONS

Q: Do you call cell phones for your polls?A: Yes! We call cell phones for every poll and this is listed on our methodology statement.

Q: I would like to participate in your polls can you please call me?A: We select respondents randomly so we cannot specifically include you in surveys though there is always a chance you may be called.

Q: What are the results for my riding?A: Unless we are commissioned to conduct an independent riding poll we do not release results by riding. This is because the sample per riding is too small - it would be irresponsible for us to publish such results. If you live in Saskatoon or Regina you can see a general view of the race in your city by looking at the regional breakout tables.

Q: Why does your riding poll not match the riding projection from *insert website here*?A: A riding poll is just that - an independent survey of a riding. Riding projections by poll aggregators can be useful information in some contexts but they are not polls. In some cases the results will be roughly the same - in others it won’t and that’s OK. In our opinion a riding poll is more accurate than a riding projection and some poll aggregators will take riding polls into account and adjust their numbers.

Q: How can your poll be accurate if you are only polling *insert number of people here*?A: It would be impossible to survey everyone in Saskatchewan (nor would we want to). Our telephone surveys are scientific, by using a random sample of the population we can attach a margin of error to our results. We have some of the largest sample sizes in the industry. Many other firms use smaller sample sizes than the ones we use on a local, provincial and national level. We are comfortable with our standards that have been tested in the real world.

Q: The demographic weighting used is based on a 2011 census, is this still representative of the population? A: No, it is likely not in most cases. Although we use the latest census available, we also use our proprietary weighting which adjusts for the small variances in demographics.

Q: I would like to receive your polls in advance, can you e-mail them to me?A: Unless you work for a media organization unfortunately not. The best place to read Mainstreet poll results is the Star Phoenix and Leader Post. You can always check our website to see if a new poll has been released.

Q: We don't believe your polls, we disagree with them very strongly, are you biased? A: Yes, we are biased: towards accuracy. In every election we have polled, there have been those who doubt our results during the election, but none who doubt them on election day.

Q: How do I join the Mainstreet Research team?A: We are always on the look-out for talented and creative team members. You can send us your resume and cover letter and we will keep it on file. Resumes can be sent to [email protected]. If you are a student we offer a paid summer internship every summer. Please check the jobs board of your university in the fall, we are no longer accepting applications for Summer 2016.

Page 10: SASKATCHEWAN ELECTION 2016 - Mainstreet Research...SASKATCHEWAN ELECTION 2016 ... - Quito Maggi, President, Mainstreet Research. SCRIPTING DIALING DATA INTEGRITY RELEASE WEIGHTING

FOR MEDIA

EMBARGO LIST

We are happy to send journalists of relevant news organization reports under embargo. When deciding who to accredit for our regional embargo list we consider publication schedule and the size of the media outlet. Please contact [email protected] to be included on our embargo list.

ATTRIBUTION

Please attribute ‘Mainstreet/Postmedia’ polls as such (Mainstreet Research for Postmedia, Mainstreet/Postmedia Poll etc.) and please identify the sponsor of any third party polls that are released.

INTERVIEW REQUESTS

Quito is happy to chat over the phone or in studio from Toronto/Ottawa about our poll results or the Saskatchewan election in general. To arrange an interview please e-mail [email protected]

MARGINS OF ERROR

The Canadian authority on polling, the Market Research Intelligence Association (MRIA) does not allow non probability polls (opt in online panel) to publish a margin of error. Although many publish "probability equivalent" margin of error, it is not mathematically correct to do so.

INFOGRAM

We create dynamic graphs in Infogram that can be embedded. These interactive graphs are dynamic and resize for mobile and tablet. For example our standard graph contains buttons to display the results only for Saskatoon or Regina. They are branded ‘Mainstreet/Postmedia’ at the bottom right hand corner. The Infogram code(s) will be e-mailed out the morning of a release.

SCRIBD

We will host a copy of the report on Scribd shortly after release. You can embed this document so that readers are able to access the full report. The Scribd code will be e-mailed out on the morning of a release.

COLOUR CODES

We are often asked for the colour codes we use, please see them below!

Page 11: SASKATCHEWAN ELECTION 2016 - Mainstreet Research...SASKATCHEWAN ELECTION 2016 ... - Quito Maggi, President, Mainstreet Research. SCRIPTING DIALING DATA INTEGRITY RELEASE WEIGHTING

WHAT TO EXPECT IN SASKATCHEWAN

WEEKLY RELEASES

We will covering the entire 2016 Saskatchewan Election. By the time you are reading this we will have already moved into a weekly dialing schedule. Almost all polls will be released in several parts, issue questions will be selected to compliment work for our media partners at the Star Phoenix and Leader Post.

It’s important to us that we poll the election from beginning to end. While many pundits (including us) have speculated that outcome of this election could be predetermined, it is one thing to say it and quite another to act upon it. Punditry aside, we will not prejudge the outcome of the election and the voters of Saskatchewan. That is why we have committed to poll from the beginning to the end and several times in between, and why regardless of the movement in horserace we will be looking at key issues affecting Saskatchewan residents.

PC PARTY

We have been in conversation with the PC Party of Saskatchewan who have expressed that they wish to be included in our surveys. Earlier this year we included the PC Party in a survey to gauge their level of support and to determine if they should be included in future polling.

At this time they will not be included in future polls because they did not poll outside the margin of error. These same standards have been used to determine potential inclusion of the Green Party of Alberta in our Alberta polls (they have not polled outside the margin and are presently excluded).

We continue to be open-minded about potentially including the PC Party in future polling. We will run select test dials during the campaign and some will include the PC Party and we will use a variety of metrics to assess their future inclusion. While we are understanding of their desire to be included we have clear standards for including parties and will enforce them.

FINAL POLL

We will release a final poll in the final week of the election campaign. Depending on the circumstances this may replace a weekly dial. We prefer not to release a poll immediately before Election Day but if there is significant movement will make a final release or share a final release with our media partners.

We will release a ‘post-mortem’ following the election to closely analyze the performance of our polling and the conclusions from this analysis will be incorporated into our future Saskatchewan work.

QUARTERLY POLLS

Upon the conclusion of the election we will continue to publish public polls in Saskatchewan once per quarter.

Page 12: SASKATCHEWAN ELECTION 2016 - Mainstreet Research...SASKATCHEWAN ELECTION 2016 ... - Quito Maggi, President, Mainstreet Research. SCRIPTING DIALING DATA INTEGRITY RELEASE WEIGHTING

ALBERTA

First to call the NDP Majority and the most active pollster of the Alberta Election.

CALGARY FOOTHILLS

Most Accurate Pollster of Calgary Foothills- Correctly predicted a Wildrose Victory.

SUDBURY

Most Accurate Pollster of the Sudbury by election, correctly predicted a Liberal win.

CANADA

Only Pollster to predict a Liberal Majority. Most accurate on main party numbers.

Page 13: SASKATCHEWAN ELECTION 2016 - Mainstreet Research...SASKATCHEWAN ELECTION 2016 ... - Quito Maggi, President, Mainstreet Research. SCRIPTING DIALING DATA INTEGRITY RELEASE WEIGHTING

© 2015 Mainstreet Research. All rights reserved

Mainstreet is a national public research firm. With 20 years of political experience at all three levels of government, President and CEO Quito Maggi is a respected commentator on Canadian public affairs.

Differentiated by its large sample sizes, Mainstreet Research has provided accurate snapshots of public opinion, having predicted a majority NDP government in Alberta, a majority Liberal government in British Columbia and a majority Liberal government in Ontario. Mainstreet has been the most accurate polling firm in several by elections and the most recent Toronto mayoral election. Most recently, Mainstreet was the only polling firm to correctly predict a Liberal majority government in the 2015 federal election.

CONNECT WITH US: WEBSITEmainstreetresearch.ca

TWITTER @MainStResearch

FACEBOOKfb.com/mainstresearch

Page 14: SASKATCHEWAN ELECTION 2016 - Mainstreet Research...SASKATCHEWAN ELECTION 2016 ... - Quito Maggi, President, Mainstreet Research. SCRIPTING DIALING DATA INTEGRITY RELEASE WEIGHTING

-30-