Journal of Research Methodology

Development of an Online Operation Span Task for Thai Speakers

Teeranoot Siriwittayakorn — 2024-12-27

The Operation Span Task (Ospan) is a working memory span task frequently used in linguistic research. However, the task was originally designed for English speakers, making it potentially unsuitable for Thai speakers. This study aims to develop an automated online Ospan for Thai speakers based on the task proposed by Unsworth et al. (2005). Pytoolkit was used for development as it is a free program that facilitates the implementation of online experiments. Furthermore, this software supports experiments on both computers and smartphones. The task was refined in two key areas: reducing the complexity of mathematical problems and replacing the letters to be remembered with Thai alphabets. A total of 114 Thai native speakers, aged 18 to 78, participated in this study. The results indicate that simplifying the mathematical problems did not overly reduce the task's difficulty. The average score for the Ospan was 61.23% (SD = 19.06), comparable to the findings of Unsworth et al. (2005). Temporal stability, assessed via test-retest reliability, showed a moderate correlation between the two tests (r = .652). Internal consistency analysis revealed a Cronbach’s alpha of .86, also consistent with the results reported by Unsworth et al. (2005). These findings suggest that the online Ospan developed in this study effectively reflects differences in participants' working memory capacity and is reliable.

Development of Feedback Competency Scale for Foreign Language Teachers

Thirayu Inplaeng — 2024-12-27

This research aims to 1) develop and validate the psychometric properties of a scale for evaluating the feedback competency of foreign language teachers, 2) create descriptors and establish cutoff scores for the feedback competency assessment based on the Wright Map 3) assess the feedback competency of foreign language teachers, and 4) evaluate the perceptions of these teachers regarding the feedback competency assessment. This study examines the psychometric properties using both Classical Test Theory and Item Response Theory with an initial sample of 480 participants. Descriptors and cutoff scores were formulated according to the Wright Map principles, tested on 1,612 participants. The results were analyzed for background variable differences using three-way ANOVA and descriptive statistics. Additionally, the teachers' opinions on the assessment tool were gathered and evaluated. The findings indicate that the feedback competency assessment exhibits acceptable psychometric properties and successfully identifies two high-quality cutoff scores with comprehensive descriptors. The large-scale testing revealed that the overall feedback competency of the sample was classified as "competent." Comparisons based on background variables indicated no statistically significant differences. Furthermore, the teachers' perceptions of the feedback competency assessment overall were at a high level.

Methodological Synthesis: Incorporating a Historical Paradigm into a Case Study Approach for Organizational Dynamics Research

Santi Jintamanaskoon — 2024-12-27

Epistemologically, a case study approach and archival research differ in their research traditions, including their temporal emphasis, data collection processes, and methods of interpreting and analyzing data. Whilst a case study is centered around an empirical investigation of contemporary issues and a generalization of case findings through theoretical proposition, archival research is, by contrast, concerned with uniqueness and particularity of historical narratives as a series of events unfolded. This long–held belief has wielded an enormous influence on whether researchers should adopt a case study approach or to [re-]construct an historical account as if they were sharply demarcated. However, this conventional paradigm is found to be very limited, if not problematic, for addressing complex issues in organizational dynamics e.g., an insight into a persistence and change mechanism as well as a legitimization process. To understand why and how organizations have reached their current state, including the decisions they made, the advantages of each methodology should be utilized in a complementary way. In this article, a privatization of British Railways (BR) is exemplified as practical application of methodological synthesis. The example highlights how a notion of dualism in various aspects–explanation, evidence, and temporality–can help ease methodological tensions between two different approaches. It also reveals that performance improvement does not fully capture the complexities of BR’s organizational restructuring. In fact, a legitimization process and paradoxical results are more socially and politically complex than improving organizational efficiency. In short, the article has contributed not only by discussing how the archives can be useful in fabricating an historical–institutional account of organizational dynamics but also why a case study approach in organization studies should be more concerned with its past development and change–methodological contribution to the subject area.

Determining the Appropriate Sample Size in EFL Pilot Studies

Patsawut Sukserm — 2024-12-27

Pilot studies are fundamental in the field of English as a foreign language (EFL) as they provide opportunities to evaluate and improve the research design and instruments. This review summarizes key researchers’ suggestions for determining sample size in EFL pilot studies and offers instructions for conducting pilot studies in this context. For example, a range of 10 to 30 participants is suitable for pilot studies, while 30 participants are generally sufficient for a questionnaire. Additionally, about a dozen subjects in a group are sufficient when estimating distribution parameters. Guidelines for reliability are also formulated. This review therefore enhances EFL research by providing a practical understanding of sample size recommendations and their implications in EFL settings, thereby assisting researchers in designing effective EFL pilot studies. This will increase the credibility and relevance of EFL research and contribute to the development of more comprehensive and trustworthy studies in the future.