A basic questionnaire in Thai
A basic questionnaire in Thai

A questionnaire is a research instrument that consists of a set of questions (or other types of prompts) for the purpose of gathering information from respondents through survey or statistical study. A research questionnaire is typically a mix of close-ended questions and open-ended questions. Open-ended, long-term questions offer the respondent the ability to elaborate on their thoughts. The Research questionnaire was developed by the Statistical Society of London in 1838.[1][2]

Although questionnaires are often designed for statistical analysis of the responses, this is not always the case.

Questionnaires have advantages over some other types of surveys in that they are cheap, do not require as much effort from the questioner as verbal or telephone surveys, and often have standardized answers that make it simple to compile data.[3] However, such standardized answers may frustrate users as the possible answers may not accurately represent their desired responses.[4] Questionnaires are also sharply limited by the fact that respondents must be able to read the questions and respond to them. Thus, for some demographic groups conducting a survey by questionnaire may not be concretely feasible.[5]

History

One of the earliest questionnaires was Dean Milles' Questionnaire of 1753.[6]

Types

A distinction can be made between questionnaires with questions that measure separate variables, and questionnaires with questions that are aggregated into either a scale or index. Questionnaires with questions that measure separate variables, could, for instance, include questions on:

Questionnaires with questions that are aggregated into either a scale or index include for instance questions that measure:

Examples

Questionnaire construction

Main article: Questionnaire construction

Question type

Usually, a questionnaire consists of a number of questions that the respondent has to answer in a set format. A distinction is made between open-ended and closed-ended questions. An open-ended question asks the respondent to formulate his own answer, whereas a closed-ended question asks the respondent to pick an answer from a given number of options. The response options for a closed-ended question should be exhaustive and mutually exclusive. Four types of response scales for closed-ended questions are distinguished:

A respondent's answer to an open-ended question is coded into a response scale afterward. An example of an open-ended question is a question where the testee has to complete a sentence (sentence completion item).[9]

Question sequence

In general, questions should flow logically from one to the next. To achieve the best response rates, questions should flow from the least sensitive to the most sensitive, from the factual and behavioural to the attitudinal, and from the more general to the more specific.[citation needed]

There typically is a flow that should be followed when constructing a questionnaire in regards to the order that the questions are asked. The order is as follows:

  1. Screens
  2. Warm-ups
  3. Transitions
  4. Skips
  5. Difficult
  6. Classification

Screens are used as a screening method to find out early whether or not someone should complete the questionnaire. Warm-ups are simple to answer, help capture interest in the survey, and may not even pertain to research objectives. Transition questions are used to make different areas flow well together. Skips include questions similar to "If yes, then answer question 3. If no, then continue to question 5." Difficult questions are towards the end because the respondent is in "response mode." Also, when completing an online questionnaire, the progress bars lets the respondent know that they are almost done so they are more willing to answer more difficult questions. Classification, or demographic question should be at the end because typically they can feel like personal questions which will make respondents uncomfortable and not willing to finish survey.[10]

Basic rules for questionnaire item construction

Multi-item scales

Labelled example of a multi-item psychometric scale as used in questionnaires[12]
Labelled example of a multi-item psychometric scale as used in questionnaires[12]

Within social science research and practice, questionnaires are most frequently used to collect quantitative data using multi-item scales with the following characteristics:[12]

Questionnaire administration modes

Main modes of questionnaire administration include:[9]

Concerns with questionnaires

While questionnaires are inexpensive, quick, and easy to analyze, often the questionnaire can have more problems than benefits. For example, unlike interviews, the people conducting the research may never know if the respondent understood the question that was being asked. Also, because the questions are so specific to what the researchers are asking, the information gained can be minimal.[13] Often, questionnaires such as the Myers-Briggs Type Indicator, give too few options to answer; respondents can answer either option but must choose only one response. Questionnaires also produce very low return rates, whether they are mail or online questionnaires. The other problem associated with return rates is that often the people who do return the questionnaire are those who have a very positive or a very negative viewpoint and want their opinion heard. The people who are most likely unbiased either way typically do not respond because it is not worth their time.

One key concern with questionnaires is that they may contain quite large measurement errors.[14] These errors can be random or systematic. Random errors are caused by unintended mistakes by respondents, interviewers, and/or coders. Systematic error can occur if there is a systematic reaction of the respondents to the scale used to formulate the survey question. Thus, the exact formulation of a survey question and its scale is crucial, since they affect the level of measurement error.[15]

Further, if the questionnaires are not collected using sound sampling techniques, often the results can be non-representative of the population—as such a good sample is critical to getting representative results based on questionnaires.[16]

See also

Further reading

Questionnaire are of different types as per Paul: 1)Structured Questionnaire. 2)Unstructured Questionnaire. 3)Open ended Questionnaire. 4)Close ended Questionnaire. 5)Mixed Questionnaire. 6)Pictorial Questionnaire.

References

  1. ^ Gault, RH (1907). "A history of the questionnaire method of research in psychology". Research in Psychology. 14 (3): 366–383. doi:10.1080/08919402.1907.10532551.
  2. ^ A copy of the instrument was published in the Journal of the Statistical Society, Volume 1, Issue 1, 1838, pages 5–13. "Fourth Annual Report of the Council of the Statistical Society of London". JSTOR i315562. ((cite journal)): Cite journal requires |journal= (help)
  3. ^ "The Roma have a much younger population". OECD Economic Surveys: Slovak Republic. 2019-02-05. doi:10.1787/d8c7c39a-en. ISBN 9789264311350. ISSN 1999-0588. S2CID 242796295.
  4. ^ "questions-answers-the-international-criminal-court-may-2010". doi:10.1163/2210-7975_hrd-0162-0046. ((cite journal)): Cite journal requires |journal= (help)
  5. ^ Rajaee Rizi, Farid; Asgarian, Fatemeh Sadat (2022-08-24). "Reliability, validity, and psychometric properties of the Persian version of the Tayside children's sleep questionnaire". Sleep and Biological Rhythms. doi:10.1007/s41105-022-00420-6. ISSN 1479-8425.
  6. ^ Fox, Adam, Parochial Queries: Printed Questionnaires and the Pursuit of Natural:Knowledge in the British Isles, 1650–1800, Edinburgh University
  7. ^ Smedts HP, de Vries JH, Rakhshandehroo M, et al. (February 2009). "High maternal vitamin E intake by diet or supplements is associated with congenital heart defects in the offspring". BJOG. 116 (3): 416–23. doi:10.1111/j.1471-0528.2008.01957.x. PMID 19187374. S2CID 22276050.
  8. ^ Hogervorst, J. G.; Schouten, L. J.; Konings, E. J.; Goldbohm, R. A.; Van Den Brandt, P. A. (2007). "A Prospective Study of Dietary Acrylamide Intake and the Risk of Endometrial, Ovarian, and Breast Cancer". Cancer Epidemiology, Biomarkers & Prevention. 16 (11): 2304–2313. doi:10.1158/1055-9965.EPI-07-0581. PMID 18006919. Retrieved 2013-02-18.
  9. ^ a b Mellenbergh, G.J. (2008). Chapter 10: Tests and Questionnaires: Construction and administration. In H.J. Adèr & G.J. Mellenbergh (Eds.) (with contributions by D.J. Hand), Advising on Research Methods: A consultant's companion (pp. 211–236). Huizen, The Netherlands: Johannes van Kessel Publishing.
  10. ^ Burns, A. C., & Bush, R. F. (2010). Marketing Research. Upper Saddle River, NJ: Pearson Education.
  11. ^ "How to Make Questionnaire". SurveyKing. Retrieved 9 April 2022.
  12. ^ a b Robinson, M. A. (2018). Using multi-item psychometric scales for research and practice in human resource management. Human Resource Management, 57(3), 739–750. https://dx.doi.org/10.1002/hrm.21852 (open-access)
  13. ^ Kaplan, R. M., & Saccuzzo, D. P. (2009). Psychological testing: Principles, applications, and issues. Belmont, CA: Wadsworth
  14. ^ Alwin, D. F. (2007). Margins of error: A study of reliability in survey measurement. Hoboken, Wiley
  15. ^ Saris, W. E. and Gallhofer, I. N. (2014). Design, evaluation, and analysis of questionnaires for survey research. Second Edition. Hoboken, Wiley.
  16. ^ Moser, Claus Adolf, and Graham Kalton. "Survey methods in social investigation." Survey methods in social investigation. 2nd Edition (1971).