---
title: Margin Of Error | Advanis
description: Business questions are typically phrased like “Who would be interested in our new product?”, “How satisfied are our customers with our service?”, or “Who is likely to recommend our brand?” Survey research is often done to answer these questions and is typically reported out as showing the percent of people who fit into a particular category. Unless a census is completed, there
image: https://blog.advanis.net/hubfs/Imported_Blog_Media/keep_calm_and_focus_on_margin_of_error_case-ra65c1d12318e4decac822be2f55adc41_80c4n_8byvr_324.jpg
---

[![Advanis](https://blog.advanis.net/hs-fs/hubfs/raw_assets/public/Advanis_May2023/images/logo.png?width=514&height=277&name=logo.png "Advanis")](https://advanis.net/)

- [WHO WE ARE](https://advanis.net/who-we-are/)
- [SERVICES](https://advanis.net/services/)
- [PRIVATE SECTOR RESEARCH](https://advanis.net/private-sector-research/)
- [SOCIAL AND PUBLIC RESEARCH](https://advanis.net/social-and-public-research/)
- [PUBLISHED WORK](https://advanis.net/published-work/)
- [BLOG](https://blog.advanis.net/)
- [CAREERS](https://advanis.net/careers/)
- [CONTACT US](https://advanis.net/contact-us/)
- [English](https://advanis.net/) 
    - [Français(French)](https://advanis.net/fr/)

- [WHO WE ARE](https://advanis.net/who-we-are/)
- [SERVICES](https://advanis.net/services/)
- [PRIVATE SECTOR RESEARCH](https://advanis.net/private-sector-research/)
- [SOCIAL AND PUBLIC RESEARCH](https://advanis.net/social-and-public-research/)
- [PUBLISHED WORK](https://advanis.net/published-work/)
- [BLOG](https://blog.advanis.net/)
- [CAREERS](https://advanis.net/careers/)
- [CONTACT US](https://advanis.net/contact-us/)
- [English](https://advanis.net/) 
    - [Français(French)](https://advanis.net/fr/)

![Read full post: Margin Of Error](https://blog.advanis.net/hubfs/Imported_Blog_Media/keep_calm_and_focus_on_margin_of_error_case-ra65c1d12318e4decac822be2f55adc41_80c4n_8byvr_324.jpg)

# Margin Of Error

 Published by [Advanis](https://blog.advanis.net/author/advanis) on  Jun 4, 2015 10:00:00 PM

## [Margin Of Error](https://blog.advanis.net/blog/margin-error?hsLang=en)

###### 05 June 2015

[![](https://blog.advanis.net/hubfs/Imported_Blog_Media/keep_calm_and_focus_on_margin_of_error_case-ra65c1d12318e4decac822be2f55adc41_80c4n_8byvr_324.jpg)](https://blog.advanis.net/blog/margin-error?hsLang=en)

Business questions are typically phrased like “*Who would be interested in our new product?*”, “*How satisfied are our customers with our service?*”, or “*Who is likely to recommend our brand?*” Survey research is often done to answer these questions and is typically reported out as showing the percent of people who fit into a particular category. Unless a census is completed, there will be some error in the results obtained. One very important question is, how large is this error?

 There are four things that affect the margin of error:

- the level of confidence,
- the sample size,
- the score obtained, and
- the population size.

The **level of confidence** is correlated with the margin of error: the stronger the confidence you select, the larger the margin of error has to be. For example, if a survey determines that a metric’s score is 85% with a margin of error of 3% at 90% confidence, that means that if the survey were repeated a total of 100 times, 90 of the surveys would predict a value between 82% and 88% (the confidence interval) and 10 surveys would predict a value outside of this range. If we want to be 95% confident in our score rather than 90%, the margin of error has to increase so that only 5 surveys would have scores outside of the confidence interval.

Next, **sample size** affects the margin of error; the more people surveyed, the more reliable the results (i.e. the smaller the margin of error). To visualize this, consider the cases where 99 or 999 people have been surveyed and we survey 1 more person. When we go from 99 to 100 respondents, that last respondent has the potential to move the metric by up to 1%. However, the respondent who takes the sample size from 999 to 1,000 has the potential to move the metric by only 0.1%. This is why larger sample sizes yield more precise results.

You may be surprised to learn that **the score itself** will affect the margin of error. However, this isn’t all that unintuitive. If an agreement score is 95% (for example) and you survey one more person, there is a very good chance (95% in fact) that they will also agree. However, if the agreement score is only 50%, then the chance that the next person will agree is a toss-up. So, the further a score is from 50%, the higher our confidence in the value and the smaller the margin of error. Since it isn’t feasible to quote a margin of error on every number in a report, the standard practice is to state the maximum standard of error which would occur for metrics scoring 50%.

![](https://blog.advanis.net/hubfs/Imported_Blog_Media/moe.png)

Finally, **population size** can have an impact as well. Often the assumption is made that the population size is infinite. While this is never actually the case, this assumption allows for simple statistical calculations but leads to otherwise larger than actual margin of errors. With an infinite population, you could never know the exact score of a metric so there must always be some margin of error no matter how many people you survey; the next person surveyed always has the potential to change your estimate. However, with a finite population, once you have surveyed everyone (i.e. done a census), you will know the exact value and the margin of error must therefore be 0%. So, how small is small? As the table below shows, if your total population is less than 10,000, you may want to consider asking your research provider to apply small population corrections to any stat testing.

***To recap, in survey research a margin of error always exists unless a complete census is taken. The size of the error depends on the level of confidence, the sample size, the score obtained, and the population size. If your population size is less than 10,000, you should consider asking that small population size statistical corrections be applied to all statistics.***

---

![](https://blog.advanis.net/hubfs/Imported_Blog_Media/small_patrick-2.png)*[Patrick Kyba](mailto:pkyba@advanis.net)*

*is a Consultant with Advanis. Patrick plays a lead research role on projects having responsibility for survey development, survey programming and testing, development of analysis plans, data cleaning, weighting, and report writing and production. He strives to find the best reporting solution for his clients, from simple tables and graphs to complex automated online reporting or detailed custom reports.*

Tags: [Margin of Error](https://blog.advanis.net/tag/margin-of-error)

[Back to Blog](https://blog.advanis.net)

###### Search / Recherche

###### Subscribe to our blog

Get our insights blog updates right to your mailbox once per month. No spam, we promise! Your email address is always safe.

[Private Sector Newsletter](https://info.advanis.net/private-sector-newsletter?hsLang=en)

[Public Sector Newsletter](https://info.advanis.net/public-sector-newsletter?hsLang=en)

### Popular Tags

- [ABpoll (2)](https://blog.advanis.net/tag/abpoll)
- [Academics (1)](https://blog.advanis.net/tag/academics)
- [Accessibility (3)](https://blog.advanis.net/tag/accessibility)
- [Advertising (1)](https://blog.advanis.net/tag/advertising)
- [Analytics (8)](https://blog.advanis.net/tag/analytics)
- [API (1)](https://blog.advanis.net/tag/api)
- [Automation (2)](https://blog.advanis.net/tag/automation)
- [Awareness (1)](https://blog.advanis.net/tag/awareness)
- [B2B (1)](https://blog.advanis.net/tag/b2b)
- [BC Food (1)](https://blog.advanis.net/tag/bc-food)
- [Best Practices (14)](https://blog.advanis.net/tag/best-practices)
- [BOS (1)](https://blog.advanis.net/tag/bos)
- [Canada (11)](https://blog.advanis.net/tag/canada)
- [Cannabis (2)](https://blog.advanis.net/tag/cannabis)
- [Carbon Tax (1)](https://blog.advanis.net/tag/carbon-tax)
- [Case Study (8)](https://blog.advanis.net/tag/case-study)
- [CATI (14)](https://blog.advanis.net/tag/cati)
- [Choice (9)](https://blog.advanis.net/tag/choice)
- [College (1)](https://blog.advanis.net/tag/college)
- [Communications (2)](https://blog.advanis.net/tag/communications)
- [Concept Testing (2)](https://blog.advanis.net/tag/concept-testing)
- [Conference (5)](https://blog.advanis.net/tag/conference)
- [Cordcutting (1)](https://blog.advanis.net/tag/cordcutting)
- [Covid-19 (2)](https://blog.advanis.net/tag/covid-19)
- [CSAT (2)](https://blog.advanis.net/tag/csat)
- [Customer Experience (14)](https://blog.advanis.net/tag/customer-experience)
- [Customer Journey (2)](https://blog.advanis.net/tag/customer-journey)
- [Dashboards (1)](https://blog.advanis.net/tag/dashboards)
- [Data Science (2)](https://blog.advanis.net/tag/data-science)
- [demographics (1)](https://blog.advanis.net/tag/demographics)
- [Digital (1)](https://blog.advanis.net/tag/digital)
- [Digital Adoption (1)](https://blog.advanis.net/tag/digital-adoption)
- [DIY Research (2)](https://blog.advanis.net/tag/diy-research)
- [Education (1)](https://blog.advanis.net/tag/education)
- [Email Marketing (1)](https://blog.advanis.net/tag/email-marketing)
- [emotions (1)](https://blog.advanis.net/tag/emotions)
- [Enviroment (1)](https://blog.advanis.net/tag/enviroment)
- [Expectations (1)](https://blog.advanis.net/tag/expectations)
- [Finance (3)](https://blog.advanis.net/tag/finance)
- [Foresight (2)](https://blog.advanis.net/tag/foresight)
- [Freelance (1)](https://blog.advanis.net/tag/freelance)
- [Future of Work (1)](https://blog.advanis.net/tag/future-of-work)
- [Gig Economy (1)](https://blog.advanis.net/tag/gig-economy)
- [Health (3)](https://blog.advanis.net/tag/health)
- [housing (1)](https://blog.advanis.net/tag/housing)
- [Human Experience (2)](https://blog.advanis.net/tag/human-experience)
- [HX (2)](https://blog.advanis.net/tag/hx)
- [Incentives (8)](https://blog.advanis.net/tag/incentives)
- [Innovation (7)](https://blog.advanis.net/tag/innovation)
- [Insights (28)](https://blog.advanis.net/tag/insights)
- [Insurance (2)](https://blog.advanis.net/tag/insurance)
- [ISO (1)](https://blog.advanis.net/tag/iso)
- [IVR (11)](https://blog.advanis.net/tag/ivr)
- [Learning (11)](https://blog.advanis.net/tag/learning)
- [Longitudinal (1)](https://blog.advanis.net/tag/longitudinal)
- [Low Incidence Populations (2)](https://blog.advanis.net/tag/low-incidence-populations)
- [Margin of Error (1)](https://blog.advanis.net/tag/margin-of-error)
- [Market Research (36)](https://blog.advanis.net/tag/market-research)
- [Marketing (1)](https://blog.advanis.net/tag/marketing)
- [Marketing Primer (1)](https://blog.advanis.net/tag/marketing-primer)
- [Millennial (8)](https://blog.advanis.net/tag/millennial)
- [Millennials (1)](https://blog.advanis.net/tag/millennials)
- [Mobile (17)](https://blog.advanis.net/tag/mobile)
- [MRX (22)](https://blog.advanis.net/tag/mrx)
- [Municipal (1)](https://blog.advanis.net/tag/municipal)
- [newMR (1)](https://blog.advanis.net/tag/newmr)
- [NIS (1)](https://blog.advanis.net/tag/nis)
- [NPS (10)](https://blog.advanis.net/tag/nps)
- [Online Survey (9)](https://blog.advanis.net/tag/online-survey)
- [Optimization (1)](https://blog.advanis.net/tag/optimization)
- [organizational impact (1)](https://blog.advanis.net/tag/organizational-impact)
- [Persona (2)](https://blog.advanis.net/tag/persona)
- [PMOT (1)](https://blog.advanis.net/tag/pmot)
- [Police Services (2)](https://blog.advanis.net/tag/police-services)
- [Pricing (3)](https://blog.advanis.net/tag/pricing)
- [Project Management (1)](https://blog.advanis.net/tag/project-management)
- [Public Policy (4)](https://blog.advanis.net/tag/public-policy)
- [Qualitative (11)](https://blog.advanis.net/tag/qualitative)
- [Quant (2)](https://blog.advanis.net/tag/quant)
- [Quantitative (14)](https://blog.advanis.net/tag/quantitative)
- [Research (4)](https://blog.advanis.net/tag/research)
- [Response rates (4)](https://blog.advanis.net/tag/response-rates)
- [Responsive (8)](https://blog.advanis.net/tag/responsive)
- [Sampling (6)](https://blog.advanis.net/tag/sampling)
- [Security (1)](https://blog.advanis.net/tag/security)
- [Segmentation (2)](https://blog.advanis.net/tag/segmentation)
- [Social Research (7)](https://blog.advanis.net/tag/social-research)
- [Strategy (1)](https://blog.advanis.net/tag/strategy)
- [Success (6)](https://blog.advanis.net/tag/success)
- [Survey (10)](https://blog.advanis.net/tag/survey)
- [Surveying (3)](https://blog.advanis.net/tag/surveying)
- [Tips and Tricks (4)](https://blog.advanis.net/tag/tips-and-tricks)
- [Trends (13)](https://blog.advanis.net/tag/trends)
- [University (1)](https://blog.advanis.net/tag/university)
- [USA (1)](https://blog.advanis.net/tag/usa)
- [UX (1)](https://blog.advanis.net/tag/ux)
- [Virtual (1)](https://blog.advanis.net/tag/virtual)
- [WCAG (1)](https://blog.advanis.net/tag/wcag)
- [Webinar (1)](https://blog.advanis.net/tag/webinar)

See all topics

###### Latest Posts

#### [From Surge to Contraction: Analyzing Canada’s Population Growth Reversal 29 Jun, 2026](https://blog.advanis.net/analyzing-canadas-population-growth-reversal?hsLang=en)

#### [Advanis is awarded the 2026 Public Sector Impact Award, along with The City of Calgary and Ipsos 17 Jun, 2026](https://blog.advanis.net/advanis-is-awarded-the-2026-public-sector-impact-award-along-with-the-city-of-calgary-and-ipsos?hsLang=en)

#### [Navigating the Shift: How Data Unlocks Growth in Changing Markets 16 Jun, 2026](https://blog.advanis.net/navigating-the-shift-how-data-unlocks-growth-in-changing-markets?hsLang=en)

#### [Igniting B2B Insights: Conference Learnings 23 Apr, 2026](https://blog.advanis.net/igniting-b2b-insights-conference-learnings?hsLang=en)

#### [Looking Beyond: Why Cross-Industry Insights Drive True Innovation 15 Apr, 2026](https://blog.advanis.net/-why-cross-industry-insights-drive-innovation?hsLang=en)

## Related Articles

<https://blog.advanis.net/case-ivr?hsLang=en>

## [A case for IVR](https://blog.advanis.net/case-ivr?hsLang=en)

 A case for IVR 19 January 2015

[Read More](https://blog.advanis.net/case-ivr?hsLang=en)

<https://blog.advanis.net/setting-expectations-crucial-customer-satisfaction?hsLang=en>

## [Setting Expectations Crucial to Customer Satisfaction](https://blog.advanis.net/setting-expectations-crucial-customer-satisfaction?hsLang=en)

 Setting Expectations Crucial to Customer Satisfaction 03 November 2015

[Read More](https://blog.advanis.net/setting-expectations-crucial-customer-satisfaction?hsLang=en)

<https://blog.advanis.net/comparing-cati-vs-ivr-web-results?hsLang=en>

## [Comparing CATI vs. IVR-to-Web Results](https://blog.advanis.net/comparing-cati-vs-ivr-web-results?hsLang=en)

 Comparing CATI vs. IVR-to-Web Results 07 August 2020

[Read More](https://blog.advanis.net/comparing-cati-vs-ivr-web-results?hsLang=en)

#### ABOUT ADVANIS

Suite 200, Sun Life Place  
10123 99 Street  
Edmonton, AB  
T5J 3H1

#### SERVICES

- [Private Sector Expertise](https://advanis.net/private-sector-research/)
- [Social and Public Research](https://advanis.net/social-and-public-research/)
- [Quantitative Data Collection](https://advanis.net/quantitative-data-collection/)
- [Qualitative Data Collection](https://advanis.net/qualitative-research/)
- [Analytics](https://advanis.net/analytics/)

#### OUR WORK

- [Our Team](https://advanis.net/who-we-are/)
- [Published Work](https://advanis.net/published-work/)
- [Participating in a survey](https://advanis.net/participating-in-a-survey/)
- [Privacy Policy](https://advanis.net/privacy-policy/english/)
- [Information Security Policy](https://advanis.net/participating-in-a-survey/information-security-policy/)

Advanis is a member of [The Canadian Research and Insights Council (CRIC)](https://www.canadianresearchinsightscouncil.ca/), the industry association for the market / survey / insights research industry. We follow the high standards for ethical research as outlined here. Our CEO has [confirmed](https://advanis.net/participating-in-a-survey/ceo-declaration/) our ISO compliance.

© 2016-2024 Advanis - [Privacy policy](https://advanis.net/privacy-policy/english/)

<http://www.linkedin.com/company/advanis> [mailto:info@advanis.net](mailto:info@advanis.net)

- [English](https://advanis.net)
- [Français (French)](https://advanis.net/fr/)