Dissection of Data Collection Tool: Analysing the Effectiveness of Questionnaires in Meeting Their Research Purpose

Abstract

Questionnaire design is a critical yet underdeveloped skill in graduate research training. This study investigates the quality of student-designed questionnaires in applied linguistics research, with a specific focus on clarity, relevance, bias-free wording, logical flow, scaling and format, and reliability/validity. Through content analysis of five questionnaires produced by Master’s students at Amar Telidji University, Laghouat (Algeria). Recurring design issues were identified, including ambiguous wording, leading questions, inconsistent scales, and overlapping categories. Using a rubric-based evaluation, the study revealed that while students often demonstrate thematic relevance and logical sequencing, they frequently struggle with linguistic precision and methodological consistency. The findings highlight a persistent gap between theoretical understanding and practical application in research methods training. In response, this study proposes a six-step framework for questionnaire design that is practical, accessible, and grounded in real student work. It is intended to serve as both an instructional guide and a self-evaluation tool for novice researchers. By bridging the gap between theory and practice, the framework aims to help students produce more valid, reliable, and meaningful data collection instruments in educational research contexts