<p>The aim of the present study was to provide a comprehensive picture of what is perceived as methodological quality by published authors. In total, 243 researchers who had published quantitative studies in 10 second language journals from 2017 to 2021 answered our 41-item questionnaire asking for rankings on a 10-point Likert scale of the necessity of that area for high-quality research. Factor analysis reduced the 41 items to six factors we labeled as <i>Visual Presentation</i>, <i>Statistical Tests</i>, <i>Reporting Practices and Data Sharing</i>, <i>Sampling and Power Issues</i>, <i>Design—Data Collection</i>, and <i>Design—Control Variables</i>. Two of these factors received average scores of less than 8 points; <i>Visual Presentation</i> was ranked lowest at 6.5 and <i>Sampling and Power Issues</i> received 7.2. A comparison of the perceptions of novice (N = 51) versus experienced authors (N = 97) on each item found there was essentially no difference between the groups on intuitions of what areas made for quality research. Lastly, we conducted a path analysis as a way to weave together perceptions of disparate areas into one common structure of methodological quality but found that the surveyed authors are far from understanding research as an edifice which must consist of sound building blocks in all areas in order to create high-quality research. Ideas regarding a way to increase the attention that authors place on methodological issues are discussed and it was suggested that a quality index can be developed in order to rank articles as to their adherence to all areas of methodological importance.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Building a research paper: researcher perceptions of study quality

  • Akbar A. Jahanbakhsh,
  • Jenifer Larson-Hall

摘要

The aim of the present study was to provide a comprehensive picture of what is perceived as methodological quality by published authors. In total, 243 researchers who had published quantitative studies in 10 second language journals from 2017 to 2021 answered our 41-item questionnaire asking for rankings on a 10-point Likert scale of the necessity of that area for high-quality research. Factor analysis reduced the 41 items to six factors we labeled as Visual Presentation, Statistical Tests, Reporting Practices and Data Sharing, Sampling and Power Issues, Design—Data Collection, and Design—Control Variables. Two of these factors received average scores of less than 8 points; Visual Presentation was ranked lowest at 6.5 and Sampling and Power Issues received 7.2. A comparison of the perceptions of novice (N = 51) versus experienced authors (N = 97) on each item found there was essentially no difference between the groups on intuitions of what areas made for quality research. Lastly, we conducted a path analysis as a way to weave together perceptions of disparate areas into one common structure of methodological quality but found that the surveyed authors are far from understanding research as an edifice which must consist of sound building blocks in all areas in order to create high-quality research. Ideas regarding a way to increase the attention that authors place on methodological issues are discussed and it was suggested that a quality index can be developed in order to rank articles as to their adherence to all areas of methodological importance.