HOW TO DEAL WITH INSUFFICIENT SAMPLE SIZE DUE TO NON-RESPONSE IN SURVEYS?
DOI:
https://doi.org/10.55197/qjssh.v5i2.346Keywords:
non-response, survey, sample size, populationAbstract
Surveys have become indispensable approach for gathering input from diverse people in several fields, including social research, marketing, healthcare, and public opinion polls. However, non-response in surveys is a complex issue that is impacted by a variety of factors. The aim of this study is to enhance approaches to dealing with insufficient sample size resulting from non-response in surveys. This study revealed that there are several approaches in dealing with insufficient sample size due to non-response in surveys, namely: (a) resizing the population by dividing into specific category; (b) ethical and practical constraints as justification; (c) using different sampling techniques in determining sample size; and (d) repositioning the sample of a pilot study and real study. Conclusively, the proposed approaches in this study for addressing non-response and insufficient sample sizes in surveys are anticipated to significantly influence novel methodologies in sampling techniques across a variety of populations. Additional investigation is required to assess the efficacy of several approaches in augmenting the rate of response, including reminders, follow-ups, monetary or non-monetary incentives, and utilisation of online platforms for responding.
References
Adam, A.M. (2020): Sample size determination in survey research. – Journal of Scientific Research and Reports 26(5): 90-97.
Aikens, R.C., Greaves, D., Baiocchi, M. (2020): A pilot design for observational studies: Using abundant data thoughtfully. – Statistics in Medicine 39(30): 4821-4840.
Akinrata, E.B., Ogunsemi, D.R., Akinradewo, O.F. (2019): Outcomes of unethical practices by quantity surveyors in Nigerian construction industry. – International Journal of Applied Research in Social Sciences 1(3): 84-94.
Aleshin-Guendel, S., Sadinle, M., Wakefield, J. (2021): Revisiting identifying assumptions for population size estimation. – Cornell University 58p.
Althubaiti, A. (2023): Sample size determination: A practical guide for health researchers. – Journal of General and Family Medicine 24(2): 72-78.
Amir, N., Jabeen, F., Niaz, S. (2020): A brief review of conditions, circumstances and applicability of sampling techniques in computer science domain. – IEEE 23rd International Multitopic Conference 2021: 1-6.
Andrade, C. (2020): Sample size and its importance in research. – Indian Journal of Psychological Medicine 42(1): 102-103.
Anson, J., Bartl, W., Kulczycki, A. (2019): Roots and Fruits of Population Growth and Social Structures: Demographic and Sociological Vistas. – In: J. Anson, W. Bartl, A. Kulczycki (eds.) Studies in the Sociology of Population, Springer 24p.
Bartlett, J.E., Kotrlik, J.W., Higgins, C.C. (2001): Organizational research: Determining appropriate sample size in survey research appropriate sample size in survey research. – Information Technology, Learning, and Performance Journal 19(1): 43-50.
Boldin, B., Diekmann, O., Metz, J.A.J. (2023): Population growth in discrete time: a renewal equation oriented survey. – Journal of Difference Equations and Applications 29p.
Bongaarts, J. (2020): World Family Planning 2020 Highlights. – United Nations Department of Economic and Social Affairs, Population Division World Family Planning 2020: Highlights, United Nations Publications 46p.
Chaudhuri, A. (2020): A review on issues of settling the sample-size in surveys: Two approaches-equal and varying probability sampling-crises in sensitive cases. – Calcutta Statistical Association Bulletin 72(1): 7-16.
Chuan, C.L. (2006): Sample size estimation using Krejcie and Morgan and Cohen statistical power analysis: A comparison. – Jurnal Penyelidikan IPBL 7: 78-86.
Church, A.H., Waclawski, J. (2020): Rediscovering the Art of Surveys for Organization Change. – In: W. H. Macey, A. A. Fink (eds.) Employee Surveys and Sensing: Challenges and Opportunities, Oxford University Press 16p.
Clifton, J., Fernández-Gutiérrez, M., Howlett, M. (2022): Assessing public services from the citizen perspective: what can we learn from surveys? – Journal of Economic Policy Reform 25(1): 1-8.
Coelho, I.B., Pitta, M.T., do Nascimento Silva, P.L. (2022): Combining quota and probability sub-sampling within enumeration areas to produce more reliable estimates. – Statistical Journal of the IAOS 38(4): 1399-1410.
Cohen, M.P. (2005): Sample size considerations for multilevel surveys. – International Statistical Review 73(3): 279-287.
Cole, R. (2020): Small samples due to lower-than-planned enrollment in impact evaluations: What to do? – Mathematica Policy Research 5: 1-8.
Conti, P.L., Mecatti, F., Nicolussi, F. (2022): Efficient unequal probability resampling from finite populations. – Computational Statistics & Data Analysis 167: 15p.
Cuntrera, D., Falco, V., Giambalvo, O. (2022): On the sampling size for inverse sampling. – Stats 5(4): 1130-1144.
Dickson, M.M., Grafström, A., Giuliani, D., Espa, G. (2019): Efficiency and feasibility of sampling schemes in establishment surveys. – Mathematical Population Studies 26(2): 114-122.
Dillman, D.A., Smyth, J.D., Christian, L.M. (2014): Internet, Phone, Mail, and Mixed Mode Surveys: The Tailored Design Method (4th ed.). – John Wiley & Sons Inc. 528p.
Fennell, L.A. (2021): Sizing up categories. – Theoretical Inquiries in Law 22(1): 1-30.
Finch, H., French, B.F. (2019): A comparison of estimation techniques for IRT models with small samples. – Applied Measurement in Education 32(2): 77-96.
Frankfort-Nachmias, C., Nachmias, D. (1996): Research Methods in the Social Sciences (5th ed.). – Arnold 617p.
Gay, L.R., Diehl, P.L. (1992): Research Methods for Business and Management. – Macmillan Publishing 679p.
Gideon, L. (2021): Survey Research. – In: J. Morin, C. Olsson, E.O. Atikcan (eds.) Research Methods in the Social Sciences: An A-Z of Key Concepts, Oxford University Press 336p.
Gill, J., Johnson, P., Clark, M. (2010): Research Methods for Managers. – SAGE Publications 288p.
Goodfellow, L.T. (2023): An overview of survey research. – Respiratory Care September 68(9): 1309-1313.
Guadarrama, M., Molina, I., Tillé, Y. (2019): Small area estimation methods under cut-off sampling. – Luxembourg Institute of Socio-Economic Research (LISER) Working Paper Series 27p.
Halperin, S., Heath, O. (2020): Surveys. – In: S. Halperin, O. Heath (eds.) Political Research: Methods and Practical Skills (3rd ed.), Oxford University Press 60p
Hill, R. (1998): What sample size is “enough” in internet survey research. – Interpersonal Computing and Technology 6(3-4): 1-12.
Isaac, S., Michael, W.B. (1995): Handbook in Research and Evaluation: A collection of principles, methods and strategies useful in the planning, design and evaluation of studies in education and the behavioral sciences. – Edits Pub 262p.
Jackson, E.L. (1988): Leisure Constraints: A Survey of Past Research. – Leisure Sciences 10(3): 203-215.
Johanson, G.A., Brooks, G.P. (2010): Initial scale development: Sample size for pilot studies. – Educational and Psychological Measurement 70(3): 394-400.
Karim, M., Furnaz, S., Buksh, A.R., Beg, M.A., Khan, M.S., Moiz, B. (2019): Sample size calculation in medical research. – 13th International Conference on Mathematics, Actuarial Science, Computer Science and Statistics (MACS) 5p.
Klugman, C.M. (2019): Surveys. – In: C. M. Klugman, E. G. Lamb (eds.) Research Methods in Health Humanities, Oxford Academic 10p.
Konietschke, F., Schwab, K., Pauly, M. (2021): Small sample sizes: A big data problem in high-dimensional data analysis. – Statistical Methods in Medical Research 30(3): 687-701.
Koning, A. (2020): A survey researcher’s many decisions. – In: W. R. Thompson (ed.) Oxford Research Encyclopedia of Politics, Oxford University Press 2000p.
Krejcie, R.V., Morgan, D.W. (1970): Determining sample size for research activities. – Educational and Psychological Measurement 30(3): 607-610
Lakens, D. (2022): Sample size justification. – Collabra: Psychology 8(1): 28p.
Lewis, M., Bromley, K., Sutton, C.J., McCray, G., Myers, H.L., Lancaster, G.A. (2021): Determining sample size for progression criteria for pragmatic pilot RCTs: The hypothesis test strikes back! – Pilot and Feasibility Studies 7(1): 1-14.
Li, H., Lin, H., Yip, P.S., Li, Y. (2019): Estimating population size of heterogeneous populations with large data sets and a large number of parameters. – Computational Statistics & Data Analysis 139: 34-44.
Logan, J.R., Bauer, C., Ke, J., Xu, H., Li, F. (2020): Models for small area estimation for census tracts. – Geographical Analysis 52(3): 325-350.
McNamara, J.F. (1993): Ethical guidelines in survey research. – International Journal of Educational Reform 2(1): 96-101.
Malmqvist, J., Hellberg, K., Möllås, G., Rose, R., Shevlin, M. (2019): Conducting the pilot study: A neglected part of the research process? Methodological findings supporting the importance of piloting in qualitative research studies. – International Journal of Qualitative Methods 18: 1-11.
Mastrangelo, P.M., Macey, W.H., Fink, A.A. (2020): Improving the design and interpretation of sample surveys in the workplace. – In: W. H. Macey, A. A. Fink (eds.) Employee Surveys and Sensing: Challenges and Opportunities, Oxford University Press 14p.
Mazari, I., Ruiz-Balet, D. (2021): A fragmentation phenomenon for a nonenergetic optimal control problem: Optimization of the total population size in logistic diffusive models. – SIAM Journal on Applied Mathematics 81(1): 153-172.
Menon, V., Muraleedharan, A. (2020): Internet-based surveys: relevance, methodological considerations and troubleshooting strategies. – General Psychiatry 33(5): 3p.
Muggleton, E. (2020): Pilot randomised controlled trial reporting should be focused. – Anaesthesia 75(11): 1550-1550.
Mutz, D.C., Kim, E. (2020): The progress and pitfalls of using survey experiments in political science. – In: W. R. Thompson (ed.) Oxford Research Encyclopedia of Politics, Oxford University Press 2000p.
Nandram, B., Choi, J.W., Liu, Y. (2021): Integration of nonprobability and probability samples via survey weights. – International Journal of Statistics and Probability 10(6): 1-5.
Nanjundeswaraswamy, T.S., Divakar, S. (2021): Determination of sample size and sampling methods in applied research. – Proceedings on Engineering Sciences 3(1): 25-32.
Navarrete, M.S., Adrian, C., Bachelet, V.C. (2022): Respondent-driven sampling: Advantages and disadvantages from a sampling method. – Medwave 21(11): 17p.
Nilsson, A., Bonander, C., Strömberg, U., Canivet, C., Östergren, P.O., Björk, J. (2021): Reweighting a Swedish health questionnaire survey using extensive population register and self-reported data for assessing and improving the validity of longitudinal associations. – Plos ONE 16(7): 15p.
Nishizaka, A. (2021): Partitioning a population in agreement and disagreement. – Journal of Pragmatics 172: 225-238.
Nix, J., Pickett, J.T., Baek, H., Alpert, G.P. (2019): Police research, officer surveys, and response rates. – Policing and Society 29(5): 530-550.
Olsen, R.B. (2022): Using survey data to obtain more representative site samples for impact studies. – Cornell University 16p.
Parker, P.A., Janicki, R., Holan, S.H. (2019): Unit level modeling of survey data for small area estimation under informative sampling: A comprehensive overview with extensions. – Cornell University 48p.
Peel, J., Skipworth, G. (1970): Sample size: An innovatory procedure in survey analysis. – Sociology 4(3): 385-393.
Putranto, L. S. (2019): The use of an online survey to speed up the data collection process. – IOP Conference Series: Materials Science and Engineering 508(1): 5p.
Qader, S.H., Lefebvre, V., Tatem, A.J., Pape, U., Jochem, W., Himelein, K., Ninneman, A., Wolburg, P., Nunez-Chaim, G., Bengtsson, L., Bird, T. (2020): Using gridded population and quadtree sampling units to support survey sample design in low-income settings. – International Journal of Health Geographics 19(10): 1-16.
Roberts, L.D., Allen, P.J. (2015): Exploring ethical issues associated with using online surveys in educational research. – Educational Research and Evaluation 21(2): 95-108.
Roscoe, J.T. (1975): Fundamental Research Statistics for the Behavioural Sciences (2nd ed.). – Holt Rinehart & Winston 483p.
Saigo, H. (2020): Special feature: Theory and practice of surveys. – Japanese Journal of Statistics and Data Science 3: 563-564.
Santomauro, C.M., Sanderson, P.M. (2020): From bartending interruptions to medication delivery interruptions: Managing the risks of a high-fidelity simulation study with pilot research. – Journal of Experimental Psychology: Applied 26(3): 522-537.
Serdar, C.C., Cihan, M., Yücel, D., Serdar, M.A. (2021): Sample size, power and effect size revisited: Simplified and practical approaches in pre-clinical, clinical and laboratory studies. – Biochemia Medica 31(1): 27-53.
Shang, S., Du, S., Du, S., Zhu, S. (2021): Estimating building-scale population using multi-source spatial data. – Cities 111: 13p.
Siswantining, T., Naima, M.G., Soemartojo, S.M. (2020): Estimation of variance of random effect in small area model with Spatial Empirical Best Linear Unbiased Prediction (SEBLUP). – Journal of Physics: Conference Series 1442(1): 6p.
Speklé, R.F., Widener, S.K. (2020): Insights on the use of surveys to study management control systems. – Accounting, Organizations and Society 86: 6p.
Stamatopoulos, C. (2022): A holistic view of finite populations for determining an appropriate sample size. – International Journal of Marine Science and Environment 6(1): 36-54.
Stantcheva, S. (2023): How to run surveys: A guide to creating your own identifying variation and revealing the invisible. – Annual Review of Economics 15: 205-234.
Stevens, K.B. (2023): From top to bottom: Gridded human population estimates in data-poor situations. – Revue Scientifique et Technique 42: 111-119.
Stevenson, M.A. (2021): Sample size estimation in veterinary epidemiologic research. – Frontiers in Veterinary Science 7: 16p.
Stoica, A.A., Chakraborty, A., Dey, P., Gummadi, K.P. (2019): Minimizing margin of victory for fair political and educational districting. – AAMAS 9p.
Sturgis, P., Luff, R. (2021): The demise of the survey? A research note on trends in the use of survey data in the social sciences, 1939 to 2015. – International Journal of Social Research Methodology 24(6): 691-696.
Taherdoost, H. (2017): Determining sample size; How to calculate survey sample size. – International Journal of Economics and Management Systems 2: 237-239.
Tripathi, R., Khatri, N., Mamde, A. (2020): Sample size and sampling considerations in published clinical research articles. – Journal of The Association of Physicians of India 68(3): 14-18.
Tseng, C.H., Sim, D. (2021): Sample size planning for pilot studies. – Cornell University 15p.
van de Schoot, R., Miočević, M. (eds.) (2020): Small sample size solutions: A guide for applied researchers and practitioners (1st ed.). – Routledge 284p.
Vergara-Hernández, C., Marí-DellOlmo, M., Oliveras, L., Martinez-Beneito, M.A. (2021): Taking advantage of sampling deisgns in Bayesian spatial small ares survey studies. – Cornell University 14p.
Wan, H., Yoon, J., Srikrishnan, V., Daniel, B., Judi, D. (2022): Population downscaling using high-resolution, temporally-rich US property data. – Cartography and Geographic Information Science 49(1): 18-31.
Weisberg, H.F., Krosnick, J.A., Bowen, B.D. (1989): An introduction to survey research and data analysis. – Scott, Foresman & Co. 332p.
Zacks, S. (2020): Foundation of sampling surveys. - In: S. Zacks (ed.) The Career of a Research Statistician. – Statistics for Industry, Technology, and Engineering, Birkhäuser 16p.
