Addressing methodological frailties in IT outsourcing surveys

Purpose: The aim of this paper is to review 73 survey articles relating to information technology outsourcing (ITO) published by 17 information technology journals over the 20‐year period 1991‐2010. The review focuses on seven attributes of survey methodology (i.e. information on research questions, pilot testing of the survey instrument, sampling method employed, sample size, response rate, nonresponse bias and internal validity) and ascertains the extent to which those attributes have been addressed. The main purpose of this study is to provide insights for researchers to help improve the data quality, and reliability of survey results.

Design/methodology/approach: Review of literature over the past 20 years (1991‐2010).

Findings: There is strong evidence that deficiencies in the administration of survey methods in ITO persist and that such shortcomings compromise rigour, and therefore need to be redressed.

Practical implications: Although this review is performed in an ITO context, findings are of interest and benefit to all survey researchers. The key contribution of this paper is that it provides up‐to‐date evidence regarding quality of survey research as it applies to ITO by identifying areas needing attention so that the integrity of survey research methodology can be maintained and it can continue to provide reliable findings for the advancement of knowledge.

Originality/value: This study provides an examination of literature dealing exclusively with an IT outsourcing survey. It can, however, serve as a guide for all survey researchers regarding the pitfalls in survey methodology.