Use features like bookmarks, note taking and highlighting while reading nonresponse in household interview surveys wiley series in survey methodology. Compare that to the next group, which represents those most like the refusers as the 5th. Bias from unit nonresponse in the measurement of income in. Nonresponse in sample surveys professor ron fricker naval postgraduate school monterey, california 1. Unit nonresponse can be a source of bias in survey estimates, and reducing unit nonresponse is an important objective of good survey practice. Source and accuracy statement for the 2018 annual social and.
Pdf nonresponse in household interview surveys semantic. A common way of classifying the many reasons for nonresponse to a survey uses three categories. When this type of household nonresponse occurs in wave 1. A comprehensive framework for both reduction of nonresponse and postsurvey adjustment for nonresponse. Nonresponse in household interview surveys is an important resource for professionals and students in survey methodologyresearch methods as well as those who use survey methods or data in business, government, and academia. Nonresponse in household interview surveys, were also performed. Provide, in one publication, basic concepts and methodologically sound procedures for designing samples for, in particular, nationallevel household surveys, emphasizing applied aspects of household sample design. The existence of interviewer effects on unit nonresponse of sampled respondents in surveys is well documented, and research increasingly focuses on interviewer attributes in the nonresponse process. Response rates lack both validity and reliability as a proxy measure of nonresponse bias.
Topics behavioral and social sciences surveys and statistics. All nhis interviews are conducted via computer assisted personal interviewing capi. Comparison of item and unit nonresponse in household. Genesysid a contract software system that identifies business telephone numbers from directory listings and uses special hardware and software to. Source of the data and accuracy of the estimates for the 2018 annual social and economic supplement splitpanel sample microdata file. In noncensus surveys, the rise in unit non response. The rest of table 1 shows the item nonresponse rates. In 2019, a separate timings dataset was added that. Nonresponse rates measured at the initial interview offer valid comparisons across different surveys because they lower the effects of some design features hypothesized to influence nonresponse e. Response rates lack validity in that there is not even a moderate correlation with nonresponse bias groves 2006. There are several types of nonresponse in the national health interview survey nhis. Many researchers create nonresponse bias because they do not pretest their invites properly. Noncontact is higher in the cps than the ceq relative to refusal probably due to a shorter interview period. This applies particularly with business surveys, where large or significant units should be targeted first.
The interviewer cannot reach the housing unit because of impassable roads, such as from a natural disaster. Assessing the effect of social integration on unit. Initial nonresponse rates in these surveys are increasing. May 09, 20 nonresponse rates and nonresponse bias in household surveys public opinion quarterly. National immunization survey guide to quality control. How to do survey nonresponse bias analyses in household and establishment surveys june 10, 2009 bureau of labor statistics conference center, rooms 2 massachusetts avenue, ne, washington, dc if you are taking metro, use the red line to union station. We analyze nonresponse to questions on financial items such as income and asset holdings in the save survey, exploiting a controlled field experiment. For the sipp panel file, two separate nonresponse weighting adjustments are made. When patterns of nonresponse either unit or item nonresponse are significantly correlated with variables of interest in a survey, then the nonresponse contributes to biased estimates of those variables and is considered nonignorable. Increasing nonresponse rates in federal surveys and potentially biased survey estimates are a growing concern, especially with regard to establishment surveys.
Data resources for testing theories of survey participation. Bias from unit nonresponse in the measurement of income. Download pdf show page numbers when patterns of nonresponse either unit or item nonresponse are significantly correlated with variables of interest in a survey, then the nonresponse contributes to biased estimates of those variables and is considered nonignorable. Approximately 51% of sipp respondents 28,046 matched to an irs tax return. Nonresponse occurs in a survey when information is not collected about an eligible sample member. The first attempts to compensate for the nonresponding households at the initial wave, and the second attempts to compensate for panel nonrespondents in households responding at the initial wave. Unit nonresponse rates rose by 312percentage points over the 1990s for six us census bureau surveys atrostic, bates, burt, and silberstein 2001. Unit nonresponse can be a source of bias in survey estimates, and reducing unit nonresponse is an important objective of. Nonresponse in household interview surveys wiley online.
In noncensus surveys, the rise in unit non response is. Item nonresponse to financial questions in household. Nonresponse components were only constructed on the atus data because subcategories of nonresponse were not available for share wave ii. Nonresponse in household interview surveys survey research. The paper ends with realistic recommendations and further steps for nonresponse reduction in the household budget sur vey in bosnia and herzegovina. One key consequence is that high nonresponse rates undermine the rationale for inference in probabilitybased surveys, which is that the respondents constitute a random selection from the target population. The following four response nonresponse categories were used. The irs file contains income variables whose composition depends on filing status. In the case of longitudinal surveys, nonresponse and sample attrition can depend on both. More specifically, the objectives of the handbook are to. A comprehensive framework for both reduction of nonresponse andpostsurvey adjustment for nonresponse this book provides guidance and support for survey statisticianswho need to develop models for postsurvey adjustment fornonresponse, and for survey designers and practitioners attemptingto reduce unit nonresponse in household interview surveys.
Nonresponse in household interview surveys wiley online books. National household education surveys program of 2016 data file users manual parent and family involvement in education survey early childhood program participation survey. We compared a broad range of neighborhood characteristics of respondents and. The focus on telephone surveys may be due to the dramatic increase in nonresponse for these surveys or perhaps because facetoface surveys still achieve relatively high levels of response. Nonresponse in household interview surveys is an important resource for professionals and students in survey methodology research methods as well as those who use survey methods or data in business, government, and academia.
How to do survey nonresponse bias analyses in household. The trends toward declining survey response rates that are documented in chapter 1 have consequences. Enter your mobile number or email address below and well send you a link to download the free kindle app. Unit nonresponse can be contrasted to item nonresponse missing data wherein the sample member responds but does not provide a usable response to a particular item or items. It is therefore essential that experienced staff are utilised in the planning and execution stage of the survey to ensure that accurate and reliable survey data is delivered within predetermined timescales and budgets. The codebook provides information on item nonresponse, that is, which questions respondents declined to answer, answered as dont know, or were skipped through. Household interview surveys tend to be both labour intensive and expensive to conduct.
Recent trends of increasing survey nonresponse rates make the question whether nonresponse is ignorable or not more salient to more researchers. Traditionally, unit nonresponses are categorised into three categories. Nonresponse rates and nonresponse bias in household surveys. We analyze nonresponse to questions on financial items such as income and asset holdings in household surveys using data from a controlled field experiment. In this study, an irs file containing irs information from april 1991 filings for the tax year 1990 was matched by social security number to the 1990 sipp panel first interview respondents. The problem of nonresponse peter lynn university of essex suggestions for further reading. Nontelephone households, nonresponse bias, mail survey, recontact. Household members refuse to participate in the survey. Pdf the impact of nonresponse rates on nonresponse bias.
Nonresponse in sample surveys professor ron fricker. Unit nonresponse when a household is not interviewed at all has been rising in most surveys. We describe the development of models for nonresponse bias and their utility, with particular emphasis on the role of response propensity modeling and its assumptions. It addresses issues critical to dealing with nonresponse in surveys, reducing nonresponse during survey data collection. As part of the save study, a representative survey conducted in germany in 2001, questions on household income and financial assets were administered using different interview modes personal interview vs. If a household member refuses to be interviewed or cannot be contacted after the nrfu enumerator has made the required number of visits or telephone calls, the enumerator must locate a. Census bureau will select a quality check, also known as integrated coverage measurement icm, sample to improve census estimates. Unlike household surveys, not all establishments contribute equally to survey estimates. A research agenda also documents the increased use of information collected in the survey process in nonresponse adjustment. If you are driving, parking is available in the union station garage.
A comprehensive framework for both reduction of nonresponse andpostsurvey adjustment for nonresponse this book provides guidance and support for survey. As part of the save study, a representative survey conducted in germany in 2001, questions on household income and financial assets were administered using different modes personal interview vs. For repeating business surveys, historical imputation rather than average imputation is. Household interview surveys nationwide data collection.
It is also a suitable supplement for courses on survey methods at the upperundergraduate and graduate levels. A followup study of the dutch victimization survey showed that persons, who are afraid to be home alone at night, are less inclined to participate in the survey. It occurs in a number of surveys of statistics netherlands. Consensus study reports published by the national academies of sciences, engineering, and medicine document the evidencebased consensus on the studys statement of task by an authoring committee of experts. Interviews cannot be taken because of serious illness or death in the household. Handbook of nonresponse in household surveys jelke. Handbook of nonresponse in household surveys is a complete guide to handling the nonresponse problem, outlining statistical methods and techniques for improving response rates and correcting response data. Groves analysis showed that there is a significant amount of variability in nonresponse bias from one estimate to another within the same survey with.
This book provides guidance and support for survey. Nonresponse in household interview surveys request pdf. The other category encompasses such reasons as language issues, poor health, and absence from home during the data collection period. Nonresponse in household interview surveys wiley series. Nonresponse in household interview surveys wiley series in survey methodology kindle edition by groves, robert m.
We examined potential nonresponse bias in a largescale, populationbased, randomdigitdialed telephone survey in california and its association with the response rate. Improving income nonresponse in the national health. Unit nonresponse rates rose by 3 to12 percentage points over the 1990s for six u. We used california health interview survey chis data and us census data and linked the two data sets at the census tract level. Nonresponse can, but need not, induce nonresponse bias in survey estimates. Unit nonresponse, or householdlevel nonresponse, occurs when no information is collected about any members of a sample nhis household. Nonresponse in household interview surveys wiley series in. Nonresponse bias in a travel survey of nontelephone households.
Many recent papers have raised the concern that this increased nonresponse has led to bias in key statistics. National immunization survey guide to quality control procedures. Nonresponse is one of the possible sources of error in surveys. Building dynamic survey cost models using survey paradata. Atus is a sample of individuals, not addresses or telephone numbers. Assessing nonresponse bias and measurement error using. Handling of household and item nonresponse in surveys rajendra p. Then you can start reading kindle books on your smartphone, tablet, or computer no kindle device required. Recent empirical findings illustrate cases when the linkage between nonresponse rates and nonresponse biases is absent. A comprehensive framework for both reduction of nonresponse and postsurvey adjustment for nonresponse this book provides guidance and support for survey statisticians who need to develop models for postsurvey adjustment for nonresponse, and for survey designers and practitioners attempting to reduce unit nonresponse in household interview surveys. Additionally, a random sample of institutional researchers drawn from a list of us colleges and universities was included to expand the breadth of research surveys represented in the project results. Unit nonresponse in household wealth surveys european central. They are a key factor in response rates for household interview surveys remaining.
Unit nonresponse, which occurs when a household in a sampling frame is not interviewed at all, has been rising in most surveys. I dont take surveys please do not contact me again. To provide readers with a detailed view of this problem, six surveys are analyzed. The highest nonresponse for both surveys was from total income questions.
The following four responsenonresponse categories were used. Pdf the influence of interviewers attitude and behaviour on. Handbook of nonresponse in household surveys download. Nonresponse rates are examined first in the 1979 survey and then in the surveys that occur at roughly fiveyear intervals 1984, 1989, 1994, 1998. Reports typically include findings, conclusions, and recommendations based on information gathered by the committee and the committees deliberations. Also available in the database are timing variables that provide information on how long it took respondents to complete the total interview and to complete individual sections. Nonresponse bias in surveys asking for legally sensitive information have been proven to be even more profound if the survey explicitly states that the government or another organization of authority is collecting the data. The data for the first 2 stages was a product of 4 different data sources. Nonresponse analysis in the household budget surveys in. Potential nonresponse bias was evaluated in 3 stages. Several studies have addressed the role of the interviewer in nonresponse.
Unweighted household nonresponse in the national health interview survey between. Comparison of item and unit nonresponse in household surveys. This section examines and quantifies the extent of missing data, formally called item nonresponse, in the nlsy79. For example, unit nonresponse rates rose by 312 percentage points over the 1990s for six u. The authors begin with an introduction to the nonresponse problem along with basic concepts and definitions. Since 1998, item nonresponse rates for an exact amount question on total family income. Genesysid a contract software system that identifies business telephone numbers from directory listings and uses special hardware and software to detect nonworking numbers.
Nonresponse bias in a travel survey of nontelephone. Source of the data the data in this microdata file are from the 2018 annual social and economic supplement asec splitpanel sample of the current population survey cps. The section on resources for researchers contains a pdf titled standard. This paper updates nonresponse trends for facetoface household surveys conducted in the united states since 2000. The first group of bars represents the combined 1st though 4th quintiles of the refusal propensity for each of the 3 surveys. A comprehensive framework for both reduction of nonresponse andpostsurvey adjustment for nonresponse. Exploring nonresponse bias in a health survey using.
151 650 748 217 1221 983 819 273 952 783 176 283 1084 22 109 1438 890 1094 230 470 551 583 348 493 87 87 1490 1503 474 885 1238 1425 1189 1027 1178 170 863 161 924 399