Difficult Data: Comparing the Quality of Behavioral, Recall, and Proxy Data Across Survey Modes

Abstract:

The mode choice literature is rife with evidence on the impact of different survey modes on response rates, respondent cooperation, and data quality. However, insufficient attention has been paid to the quality of “difficult data” provided when respondents cannot choose the mode and thus cannot maximize their comfort with the survey. Here, “difficult data” correspond to questions that are burdensome for respondents to think about – e.g., very specific details on a behavior, on past events, or on the behavior of other persons. Read more

The Use of GIS Information as Auxiliary Data for Nonresponse Bias Analysis

Abstract:

The Nielsen Company, like most other market research firms, is concerned with falling response rates and the threat of nonresponse bias. The challenge in understanding and adjusting for nonresponse is always the lack of information about the non-responding cases. In recent years, researchers have considered the use of paradata, interviewer observations, and aggregate Census information to provide information about the non-responders. This study introduces and evaluates the use of a new type of GIS-based data, called POI (Points-of-Interest), as a potential auxiliary data source for nonresponse bias analysis. Read more

Should the Third Reminder be Sent? The Role of Survey Response Timing on Web Survey Results

Abstract:

Web surveys are being increasingly incorporated into national survey data collection programs in the United States because of their cost/time-efficiencies. Yet, response rates and data quality issues in web surveys remain important challenges. As a basic study designed to better understand data quality in a mixed mode national survey, this article investigates the degree to which web versus mail survey modes affect unit and item responses. Findings indicate that the web survey mode produces a lower unit response rate compared to the mail mode. However, the web mode elicits higher data quality in terms of item responses to both closed- and open-ended questions. Read more

Humanizing the Internet Cookie? Key Learnings from an Online Panel

Abstract:

The Online advertising is booming. Companies are increasingly relying on Internet cookies to target online ads to consumers and track ad exposure and website click-through rates. Cookies are also used for survey targeting of specific Internet user groups, for measuring ad effectiveness, and for political polling. Companies use the cookies they have dropped as proxies for the consumers they are ultimately trying to reach. However, this approach of humanizing cookies suffers from several measurement errors, due to cookie deletion, blocking cookies, multiple people in the household using the same browser, or one person using multiple browsers. Read more

Measuring Audience Duplication in a Cross-Media Ad Campaign Involving TV and Internet

Abstract:

The Nielsen Company (Nielsen) has extended its Campaign Ratings solution to include the measurement of cross-platform campaigns. By leveraging its industry-standard Nielsen People Meter panel and its innovative Online Campaign Ratings product, Nielsen can now quantify the unduplicated reach, frequency and GRPs for ads running on Television and Internet. Read more

Recruitment and Retention in Multi-Mode Survey Panels

Abstract:

This study builds on a previously published panel recruitment experiment (Rao, Kaminska, and McCutcheon 2010), extending that analysis to an examination of the effectiveness of pre-recruitment factors such as mode and response inducements on three post-recruitment panel participation effects: attrition rates, survey completion rates, and panel data quality. The panel recruitment experiment, conducted with the Gallup Panel, netted 1,282 households with 2,042 panel members. For these recruited members, we collected data on panel participation and retention, and use it for analysis in this study. Read more

Is Past, the Future? Resampling Past Respondents to Improve Current Response Rates

Abstract:

The Nielsen TV Ratings Diary service involves the use of a one-week TV diary survey for measuring TV ratings. While the service has been around for a while, it recently received a sampling makeover to address the diminishing coverage associated with landline random-digit dialing (RDD) surveys. Address-based sampling (ABS) replaced RDD as the sampling methodology for the diary service. Read more

Home or Work or Both? Assessing the Role of Duplication of Website Visitations Using a Online Metered Panel

Abstract:

In this study, for multiple websites, we estimate duplicated audience reach between home and work Internet access locations. By employing a probability-based matching technique, we use metered-panel based data from non-overlapping home and work panels for creating a virtual overlapping home-work panel. Read more

Catch Them When You Can: Speeders and Their Role in Online Data Quality

Abstract:

The role of panelist engagement on survey data quality in online panels has been a subject of discussion and commendation by industry and academic leaders (see Baker et. al. 2010). While there are many indicators of data quality in online surveys such as item nonresponse (Rao and Gravelle 2008) and breakoffs (Peytchev 2009; Heerwegh and Loosveldt 2006), one in particular has gained some attention in recent times: survey completion time. Read more

How Can We Believe What They Say? The Role of Missing and Validating Data in Panelists Demographic Information

Abstract:

The use of online panels (probability-based or volunteer opt-in) as a mode of data collection has become increasingly popular in market, social, psychological, and medical research (Callegaro and DiSogra 2009). The Nielsen online panel is one of the opt-in panels in the United States that is composed of respondents who voluntarily sign up (opt-in) to become members of the panel. Read more