Comparing Paper-and-Pencil and Internet Survey Methods Conducted in a Combat-Deployed Environment

The Unit Behavioral Health Needs Assessment Survey (UBHNAS) is a tool used to aid behavioral health providers in assessing the needs of service members of a military unit. Traditionally, the survey has been administered by paper-and-pencil; however, implementing the survey via the Internet may be a faster and easier way to administer the survey. There are, however, potential drawbacks to Internet survey administration, and previous studies comparing the 2 methods have yielded inconsistent findings. Using a between-subjects design with a combat-deployed military sample, the present study compared the 2 survey administration methods. Specifically, we assessed comparability for (a) psychological constructs, (b) auxiliary measures (such as completion time, frequency of missing data, and length of written comments), and (c) ratings and perceptions of the UBHNAS, and preference in methodology. The method of survey administration did not predict differences in the psychological outcome variables. However, participants in the paper-and-pencil condition reported higher rates of comfort answering questions, belief that responses would remain anonymous, and frankness and honesty in answering questions. Nevertheless, participants in both conditions preferred to take the survey via the Internet as opposed to paper-and-pencil in the future. Finally, participants in the Internet condition completed the survey faster and tended to write longer comments, although in terms of the comments being informative, there was no difference between the groups. Based on our findings, we recommend the use of the Internet for administering the UBHNAS; however, we caution that there may be tradeoffs regarding concerns about comfort, honesty, and anonymity.