000 05240ntm a2200337 i 4500
003 MY-KuUP
005 20260803145823.0
006 t||||fr|||| 000 0
007 ta
008 260803t20262026my a|||fr|||| 000 0 eng d
020 _aTHE0010792 (Local)
_qHardback
040 _aUMPSA
_beng
_cUMPSA
_erda
090 _aPBM .A45 2025 r Thesis
100 1 _aWan Alisa Hanis Wan Abdul Halim,
_eauthor.
245 1 0 _aInvestigating the influence of divergent rating scale designs on writing examiners’ cognitive processing and cefr band consistency in malaysian highstakes writing assessments /
_cWan Alisa Hanis Wan Abdul Halim
264 1 _aKuantan Pahang :
_bUMPSA,
_c2026
264 4 _c© 2026
300 _axvi, 182 pages :
_billustrations (some color) ;
_c30 cm.+
_e1 CD-ROM
336 _2rdacontent
_atext
337 _2rdamedia
_aunmediated
338 _2rdacarrier
_avolume
347 _2rda
_atext file
_bPDF
500 _aCenter for Modern Language
502 _aThesis (Master of Science) -- Universiti Malaysia Pahang – 2026
504 _aIncludes bibliographical reference
520 3 _aThe adoption of the Common European Framework of Reference (CEFR) in Malaysia’s education system aims to facilitate transitions between educational levels and ensure continuity in the English language curriculum. However, the varying interpretations of CEFR by examination bodies, specifically Lembaga Peperiksaan Malaysia (LPM) and Majlis Peperiksaan Malaysia (MPM), result in the structural differences in the design of rating scales produced for Malaysian writing high-stakes assessments, particularly Sijil Pelajaran Malaysia (SPM) and Malaysian University English Test (MUET). Accordingly, this study investigated the differential impact of the divergent designs of two high-stakes Malaysian writing assessments on examiner cognition and CEFR band consistency when scoring the same writing responses. A total of ten students, selected via purposive sampling, completed a writing task developed for the current study. Consequently, six written responses were chosen and rated twice, once using the SPM Bahasa Inggeris 1119/2 guided writing rating scale and once using the MUET Writing extended writing rating scale, by three expert writing examiners (WEs) who were also selected via purposive sampling. Data were obtained through (i) concurrent think-aloud protocols (CTAs), (ii) stimulated recall interviews (SRI), and (iii) CEFR band achievement. CTA data were transcribed and coded using Wolfe’s cognitive processing actions, while SRI data were transcribed and coded before being analysed on NVivo 14 software for coding and matrix analysis. Quantitative data were tabulated and analysed using IBM SPSS Statistics 27 for frequency and correlation analysis. The first finding of the study was the complex relationship between the SPM Bahasa Inggeris 1119/2 guided writing rating scale and the MUET Writing extended writing rating scale. While the design of both rating scales allowed WEs to focus on similar descriptors, with a primary focus on content and communicative aspects, the MUET Writing extended writing scale elicited a higher number of cognitive processing codes compared to the SPM 1119/2 scale. Positive correlations between scales were only observed when the same scale was used for written responses, while negative correlations were found with different scales, which reinforced the distinction in the relationship between the designs. Second, the study found five main cognitive trends when using rating scales, namely that WEs (i) used “top-to-bottom” method, (ii) experienced a greater cognitive load with a scale with wider mark range, (iii) experienced leaser cognitive load and ease with a scale with more number of descriptors, (iv) utilised prior marking experience to interpret vague descriptors, and (v) utilised own cognitive adjustment based on their internal models of good written responses to fill in non-existing descriptors. Finally, the study found a strong positive and significant relationship between CEFR band achievements awarded to the same written responses. These findings revealed that the structural differences in the design of Malaysia’s high-stakes writing rating scales led WEs to adopt different cognitive processing as a means of managing and reducing the cognitive load involved in arriving at scoring judgements. Nonetheless, the consistency in CEFR band achievement suggested that CEFR has successfully provided a flexible framework that accommodated Malaysian adaptation while maintaining continuity in the English curriculum across different educational levels. The study is significant as the study pioneers the studies on CEFR-aligned rating scales using the same student scripts, investigates Malaysian expert WEs’ cognitive processing when using divergent rating scale designs, and contributes methodologically based on the selective application of Wolfe’s cognitive categories in CTA protocols as well as the utilisation of SRI to support CTA for cognition processing analysis.
610 2 0 _aCenter for Modern Language
_xDissertations
650 0 _aUniversities and colleges
_xDissertations
650 0 _aTheses
_xDissertations
942 _2lcc
_cTHESIS
999 _c105387
_d105393