--- title: Comparing CATI vs. IVR-to-Web Results | Advanis description: Advanis has been conducting a self-sponsored COVID-19 survey among Canadians since the end of March 2020 using an IVR-to-Web approach. As part of our efforts to continually validate the reliability of the approaches we use to collect data that inform the decisions made by our clients, we conducted a research-on-research study where the same questions were administered via image: https://blog.advanis.net/hubfs/Imported_Blog_Media/fotolia_71587395_subscription_monthly_m_2-1.jpg --- [![Advanis](https://blog.advanis.net/hs-fs/hubfs/raw_assets/public/Advanis_May2023/images/logo.png?width=514&height=277&name=logo.png "Advanis")](https://advanis.net/) - [WHO WE ARE](https://advanis.net/who-we-are/) - [SERVICES](https://advanis.net/services/) - [PRIVATE SECTOR RESEARCH](https://advanis.net/private-sector-research/) - [SOCIAL AND PUBLIC RESEARCH](https://advanis.net/social-and-public-research/) - [PUBLISHED WORK](https://advanis.net/published-work/) - [BLOG](https://blog.advanis.net/) - [CAREERS](https://advanis.net/careers/) - [CONTACT US](https://advanis.net/contact-us/) - [English](https://advanis.net/) - [Français(French)](https://advanis.net/fr/) - [WHO WE ARE](https://advanis.net/who-we-are/) - [SERVICES](https://advanis.net/services/) - [PRIVATE SECTOR RESEARCH](https://advanis.net/private-sector-research/) - [SOCIAL AND PUBLIC RESEARCH](https://advanis.net/social-and-public-research/) - [PUBLISHED WORK](https://advanis.net/published-work/) - [BLOG](https://blog.advanis.net/) - [CAREERS](https://advanis.net/careers/) - [CONTACT US](https://advanis.net/contact-us/) - [English](https://advanis.net/) - [Français(French)](https://advanis.net/fr/) ![Read full post: Comparing CATI vs. IVR-to-Web Results](https://blog.advanis.net/hubfs/Imported_Blog_Media/fotolia_71587395_subscription_monthly_m_2-1.jpg) # Comparing CATI vs. IVR-to-Web Results Published by [Advanis](https://blog.advanis.net/author/advanis) on Aug 6, 2020 10:00:00 PM ## [Comparing CATI vs. IVR-to-Web Results](https://blog.advanis.net/blog/comparing-cati-vs-ivr-web-results?hsLang=en) ###### 07 August 2020 [![](https://blog.advanis.net/hubfs/Imported_Blog_Media/fotolia_71587395_subscription_monthly_m_2-1.jpg)](https://blog.advanis.net/blog/comparing-cati-vs-ivr-web-results?hsLang=en) Advanis has been conducting a self-sponsored COVID-19 survey among Canadians since the end of March 2020 using an IVR-to-Web approach. As part of our efforts to continually validate the reliability of the approaches we use to collect data that inform the decisions made by our clients, we conducted a research-on-research study where the same questions were administered via phone (CATI) and via the IVR-to-Web approach. The surveys were conducted among adult Canadians between July 16 and 22, 2020. 819 completed surveys were collected via CATI (margin of error of ±3.4%, 19 times out of 20) and 4,677 completed surveys were collected via IVR-to-Web (margin of error of ±1.4%, 19 times out of 20). Results for both surveys were weighted by province, age, and gender to ensure that the final results were representative of Canada’s adult population. Results for both methodologies were similar when it comes to most behavioural questions (e.g. activities undertaken in the past week and mask wearing). Differences we observed between the two methodologies were consistent with previous research when comparing data collected via phone vs. online (e.g., Greene, Speizer, and Wiitala 2008, Chang and Krosnick 2009): 1. Respondents being more likely to agree with statements or indicate that statements describe them well on CATI compared to Web, potentially due to acquiescence bias being more prevalent when administering a survey with a live interviewer compared to online. Examples include: - Respondents are more likely to indicate that the following statements describe them well (% top 3 box on a 7-point scale): - I appreciate what the crisis has given me (like quiet, time with friends and family): 49% for CATI vs 43% for Web - If we social distance for a few weeks everything will get back to normal: 34% for CATI vs 22% for Web - This virus won’t affect me in any way: 27% for CATI vs 16% for Web - Respondents are more likely to indicate that their household was affected by COVID-19 (% top 3 box on a 7-point scale): 57% for CATI vs 51% for Web 2. Social desirability bias is more prevalent among those completing the survey via phone compared to those completing online, leading to an overstatement of socially desirable behaviors and attitudes and an understatement of opinions and behaviors they fear could elicit disapproval from the telephone interviewer, especially for topics of a sensitive nature. Examples include:   - Respondents are more likely to indicate that they are practicing social distancing (% top 3 box on a 7-point scale) for CATI at 87% vs 82% for Web - Respondents are more likely to somewhat or strongly support mandatory mask wearing legislation for CATI at 77% vs 73% for Web - Respondents are more likely to indicate that their mental health is good, very good, or excellent for CATI at 82% vs 78% for Web. - Respondents are less likely to indicate that the COVID-19 pandemic has impacted the mental health of their household (% top 3 box on a 7-point scale) for CATI at 28% vs 40% for Web. - Respondents are less likely to indicate that they have experienced several negative emotional effects for CATI compared to Web: - Change in the quality or the duration of your sleep: 32% for CATI vs 37% for Web - Feeling more irritable or having moments of anger that you did not have before: 32% for CATI vs 37% for Web - Loss of interest and pleasure in your day activities: 32% for CATI vs 37% for Web - Moments of great anxiety or panic: 26% for CATI vs 32% for Web In conclusion, these results, consistent with studies conducted previously, indicate that there may be certain advantages to administering surveys online, in particular when the survey covers topics that are of a sensitive nature or otherwise more likely to be subject to social desirability. That’s not to say that online surveys will always provide advantages over telephone surveys. E.g. telephone surveys have been found to provide better access to certain segments of the population than probability-based Web surveys (Keeter 2015).   *References* - Chang, Linchiat and Jon A. Krosnick (2009): “National Surveys via RDD Telephone Interviewing Versus the Internet” Public Opinion Quarterly 73: 641–678. - Greene, Jessica, Howard Speizer, and Wyndy Wiitala (2008): “Telephone and Web: Mixed‐Mode Challenge” Health Services Research 43: 230–248. - Keeter, Scott (2015): “Methods Can Matter: Where Web Surveys Produce Different Results than Phone Interviews” Pew Research Center,  [www.pewresearch.org/fact-tank/2015/05/14/where-web-surveys-produce-diffe...](http://www.pewresearch.org/fact-tank/2015/05/14/where-web-surveys-produce-different-results-than-phone-interviews/), accessed August 7, 2020. Tags: [IVR](https://blog.advanis.net/tag/ivr), [CATI](https://blog.advanis.net/tag/cati), [Automation](https://blog.advanis.net/tag/automation), [Online Survey](https://blog.advanis.net/tag/online-survey) [Back to Blog](https://blog.advanis.net) ###### Search / Recherche ###### Subscribe to our blog Get our insights blog updates right to your mailbox once per month. No spam, we promise! Your email address is always safe. [Private Sector Newsletter](https://info.advanis.net/private-sector-newsletter?hsLang=en) [Public Sector Newsletter](https://info.advanis.net/public-sector-newsletter?hsLang=en) ### Popular Tags - [ABpoll (2)](https://blog.advanis.net/tag/abpoll) - [Academics (1)](https://blog.advanis.net/tag/academics) - [Accessibility (3)](https://blog.advanis.net/tag/accessibility) - [Advertising (1)](https://blog.advanis.net/tag/advertising) - [Analytics (8)](https://blog.advanis.net/tag/analytics) - [API (1)](https://blog.advanis.net/tag/api) - [Automation (2)](https://blog.advanis.net/tag/automation) - [Awareness (1)](https://blog.advanis.net/tag/awareness) - [B2B (1)](https://blog.advanis.net/tag/b2b) - [BC Food (1)](https://blog.advanis.net/tag/bc-food) - [Best Practices (14)](https://blog.advanis.net/tag/best-practices) - [BOS (1)](https://blog.advanis.net/tag/bos) - [Canada (11)](https://blog.advanis.net/tag/canada) - [Cannabis (2)](https://blog.advanis.net/tag/cannabis) - [Carbon Tax (1)](https://blog.advanis.net/tag/carbon-tax) - [Case Study (8)](https://blog.advanis.net/tag/case-study) - [CATI (14)](https://blog.advanis.net/tag/cati) - [Choice (9)](https://blog.advanis.net/tag/choice) - [College (1)](https://blog.advanis.net/tag/college) - [Communications (2)](https://blog.advanis.net/tag/communications) - [Concept Testing (2)](https://blog.advanis.net/tag/concept-testing) - [Conference (5)](https://blog.advanis.net/tag/conference) - [Cordcutting (1)](https://blog.advanis.net/tag/cordcutting) - [Covid-19 (2)](https://blog.advanis.net/tag/covid-19) - [CSAT (2)](https://blog.advanis.net/tag/csat) - [Customer Experience (14)](https://blog.advanis.net/tag/customer-experience) - [Customer Journey (2)](https://blog.advanis.net/tag/customer-journey) - [Dashboards (1)](https://blog.advanis.net/tag/dashboards) - [Data Science (2)](https://blog.advanis.net/tag/data-science) - [demographics (1)](https://blog.advanis.net/tag/demographics) - [Digital (1)](https://blog.advanis.net/tag/digital) - [Digital Adoption (1)](https://blog.advanis.net/tag/digital-adoption) - [DIY Research (2)](https://blog.advanis.net/tag/diy-research) - [Education (1)](https://blog.advanis.net/tag/education) - [Email Marketing (1)](https://blog.advanis.net/tag/email-marketing) - [emotions (1)](https://blog.advanis.net/tag/emotions) - [Enviroment (1)](https://blog.advanis.net/tag/enviroment) - [Expectations (1)](https://blog.advanis.net/tag/expectations) - [Finance (3)](https://blog.advanis.net/tag/finance) - [Foresight (2)](https://blog.advanis.net/tag/foresight) - [Freelance (1)](https://blog.advanis.net/tag/freelance) - [Future of Work (1)](https://blog.advanis.net/tag/future-of-work) - [Gig Economy (1)](https://blog.advanis.net/tag/gig-economy) - [Health (3)](https://blog.advanis.net/tag/health) - [housing (1)](https://blog.advanis.net/tag/housing) - [Human Experience (2)](https://blog.advanis.net/tag/human-experience) - [HX (2)](https://blog.advanis.net/tag/hx) - [Incentives (8)](https://blog.advanis.net/tag/incentives) - [Innovation (7)](https://blog.advanis.net/tag/innovation) - [Insights (28)](https://blog.advanis.net/tag/insights) - [Insurance (2)](https://blog.advanis.net/tag/insurance) - [ISO (1)](https://blog.advanis.net/tag/iso) - [IVR (11)](https://blog.advanis.net/tag/ivr) - [Learning (11)](https://blog.advanis.net/tag/learning) - [Longitudinal (1)](https://blog.advanis.net/tag/longitudinal) - [Low Incidence Populations (2)](https://blog.advanis.net/tag/low-incidence-populations) - [Margin of Error (1)](https://blog.advanis.net/tag/margin-of-error) - [Market Research (36)](https://blog.advanis.net/tag/market-research) - [Marketing (1)](https://blog.advanis.net/tag/marketing) - [Marketing Primer (1)](https://blog.advanis.net/tag/marketing-primer) - [Millennial (8)](https://blog.advanis.net/tag/millennial) - [Millennials (1)](https://blog.advanis.net/tag/millennials) - [Mobile (17)](https://blog.advanis.net/tag/mobile) - [MRX (22)](https://blog.advanis.net/tag/mrx) - [Municipal (1)](https://blog.advanis.net/tag/municipal) - [newMR (1)](https://blog.advanis.net/tag/newmr) - [NIS (1)](https://blog.advanis.net/tag/nis) - [NPS (10)](https://blog.advanis.net/tag/nps) - [Online Survey (9)](https://blog.advanis.net/tag/online-survey) - [Optimization (1)](https://blog.advanis.net/tag/optimization) - [organizational impact (1)](https://blog.advanis.net/tag/organizational-impact) - [Persona (2)](https://blog.advanis.net/tag/persona) - [PMOT (1)](https://blog.advanis.net/tag/pmot) - [Police Services (2)](https://blog.advanis.net/tag/police-services) - [Pricing (3)](https://blog.advanis.net/tag/pricing) - [Project Management (1)](https://blog.advanis.net/tag/project-management) - [Public Policy (4)](https://blog.advanis.net/tag/public-policy) - [Qualitative (11)](https://blog.advanis.net/tag/qualitative) - [Quant (2)](https://blog.advanis.net/tag/quant) - [Quantitative (14)](https://blog.advanis.net/tag/quantitative) - [Research (4)](https://blog.advanis.net/tag/research) - [Response rates (4)](https://blog.advanis.net/tag/response-rates) - [Responsive (8)](https://blog.advanis.net/tag/responsive) - [Sampling (6)](https://blog.advanis.net/tag/sampling) - [Security (1)](https://blog.advanis.net/tag/security) - [Segmentation (2)](https://blog.advanis.net/tag/segmentation) - [Social Research (7)](https://blog.advanis.net/tag/social-research) - [Strategy (1)](https://blog.advanis.net/tag/strategy) - [Success (6)](https://blog.advanis.net/tag/success) - [Survey (10)](https://blog.advanis.net/tag/survey) - [Surveying (3)](https://blog.advanis.net/tag/surveying) - [Tips and Tricks (4)](https://blog.advanis.net/tag/tips-and-tricks) - [Trends (13)](https://blog.advanis.net/tag/trends) - [University (1)](https://blog.advanis.net/tag/university) - [USA (1)](https://blog.advanis.net/tag/usa) - [UX (1)](https://blog.advanis.net/tag/ux) - [Virtual (1)](https://blog.advanis.net/tag/virtual) - [WCAG (1)](https://blog.advanis.net/tag/wcag) - [Webinar (1)](https://blog.advanis.net/tag/webinar) See all topics ###### Latest Posts #### [From Surge to Contraction: Analyzing Canada’s Population Growth Reversal 29 Jun, 2026](https://blog.advanis.net/analyzing-canadas-population-growth-reversal?hsLang=en) #### [Advanis is awarded the 2026 Public Sector Impact Award, along with The City of Calgary and Ipsos 17 Jun, 2026](https://blog.advanis.net/advanis-is-awarded-the-2026-public-sector-impact-award-along-with-the-city-of-calgary-and-ipsos?hsLang=en) #### [Navigating the Shift: How Data Unlocks Growth in Changing Markets 16 Jun, 2026](https://blog.advanis.net/navigating-the-shift-how-data-unlocks-growth-in-changing-markets?hsLang=en) #### [Igniting B2B Insights: Conference Learnings 23 Apr, 2026](https://blog.advanis.net/igniting-b2b-insights-conference-learnings?hsLang=en) #### [Looking Beyond: Why Cross-Industry Insights Drive True Innovation 15 Apr, 2026](https://blog.advanis.net/-why-cross-industry-insights-drive-innovation?hsLang=en) ## Related Articles ## [The Future of Remote Work](https://blog.advanis.net/future-remote-work?hsLang=en) The Future of Remote Work 20 February 2021 [Read More](https://blog.advanis.net/future-remote-work?hsLang=en) ## [Research Trend: CATI: Mobile Numbers Essential To Reach General Population](https://blog.advanis.net/research-trend-cati-mobile-numbers-essential-reach-general-population?hsLang=en) Research Trend: CATI: Mobile Numbers Essential To Reach General Population 15 April 2014 [Read More](https://blog.advanis.net/research-trend-cati-mobile-numbers-essential-reach-general-population?hsLang=en) ## [Research Among Low Incidence / Hard to Reach Participants](https://blog.advanis.net/research-among-low-incidence-/-hard-to-reach-participants?hsLang=en) When conducting research among low incidence or other hard to research populations, special... [Read More](https://blog.advanis.net/research-among-low-incidence-/-hard-to-reach-participants?hsLang=en) #### ABOUT ADVANIS Suite 200, Sun Life Place 10123 99 Street Edmonton, AB T5J 3H1 #### SERVICES - [Private Sector Expertise](https://advanis.net/private-sector-research/) - [Social and Public Research](https://advanis.net/social-and-public-research/) - [Quantitative Data Collection](https://advanis.net/quantitative-data-collection/) - [Qualitative Data Collection](https://advanis.net/qualitative-research/) - [Analytics](https://advanis.net/analytics/) #### OUR WORK - [Our Team](https://advanis.net/who-we-are/) - [Published Work](https://advanis.net/published-work/) - [Participating in a survey](https://advanis.net/participating-in-a-survey/) - [Privacy Policy](https://advanis.net/privacy-policy/english/) - [Information Security Policy](https://advanis.net/participating-in-a-survey/information-security-policy/) Advanis is a member of [The Canadian Research and Insights Council (CRIC)](https://www.canadianresearchinsightscouncil.ca/), the industry association for the market / survey / insights research industry. We follow the high standards for ethical research as outlined here. Our CEO has [confirmed](https://advanis.net/participating-in-a-survey/ceo-declaration/) our ISO compliance. © 2016-2024 Advanis - [Privacy policy](https://advanis.net/privacy-policy/english/) [mailto:info@advanis.net](mailto:info@advanis.net) - [English](https://advanis.net) - [Français (French)](https://advanis.net/fr/)