Determining the Optimal Number of Interview Waves in the National Crime Victimization Survey: Evaluation and Recommendations

Date

2016

Journal Title

Journal ISSN

Volume Title

Publisher

Bureau of Justice Statistics

Abstract

The National Crime Victimization Survey (NCVS) currently uses a seven-wave or timein-sample (TIS) design. That is, households are asked to participate every six months over a three year period. In an effort to maintain or reduce costs and improve data quality, the Bureau of Justice Statistics commissioned a Panel Design Study to evaluate the effects of changing the NCVS from a 7-TIS design to a 5-TIS, 4-TIS, 3-TIS, or 1-TIS design. Panel surveys need to balance the benefits of repeated measurements (e.g., bounded interview, reduced cost, increased response rates) with the drawbacks that may eventually occur (e.g., respondent fatigue, attrition, nonresponse). The optimal number of interview waves for a panel survey needs to maximize the advantages while minimizing the potential for bias due to incorporating sampling units for too many interview waves. This study used a set of simulations to mimic different panel design options for the NCVS. The simulation assumptions were constructed using NCVS data from 1999 to 2011, and included assumptions about sample sizes, costs, response rates, household replacement, type of interview, demographics, and victimization propensities. Samples were simulated with different panel designs and summary victimization propensities, and standard errors were computed for key estimates. Simulations considered cost models for potential constraints: (1) the need to keep the cost constant and (2) the need to keep the number of interviews constant across the different panel design options. In this paper, we show the impact of changing the number of panel TISs on property and violent victimization rates in terms of point estimates, variability, sample sizes, and costs, by several population characteristics. Simulation results found that a 4-TIS design is optimal for the NCVS.

Description

Keywords

research, survey, cost models, methodology, crime victimization

Citation

Berzofsky, M., & Carrillo-Garcia , I. (2016). Determining the Optimal Number of Interview Waves in the National Crime Victimization Survey: Evaluation and Recommendations. Washington, DC: Bureau of Justice Statistics.

DOI