The Additional Module Computer-Aided Teaching \u2013 M\u00fcnster Questionnaire for Evaluation<\/strong> (German: M\u00fcnsteraner Fragebogen zur Evaluation \u2013 Zusatzmodul computergest\u00fctzte Lehre<\/em>; abbreviated as MFE-ZcL<\/strong>) is a specialized psychometric instrument designed to evaluate the instructional quality, pedagogical pacing, hands-on practice opportunities, and skill acquisition in computer-assisted university courses and academic seminars. Developed at the Department of Psychology at the University of M\u00fcnster (Westf\u00e4lische Wilhelms-Universit\u00e4t M\u00fcnster<\/em>) by Dr. Meinald Thielsch and colleagues, the MFE-ZcL constitutes an elective supplementary module embedded within the broader M\u00fcnster Questionnaire for Evaluation (MFE) ecosystem. While traditional Student Evaluations of Teaching (SET<\/a>) focus broadly on lecture delivery, general instructor rapport, or overarching seminar discussion, modern higher education increasingly relies on specialized digital and software-intensive curricula\u2014such as computational data analysis, statistical modeling (e.g., R, SPSS, Python), digital experimental programming, and computer-aided qualitative inquiry\u2014that require targeted evaluation metrics.<\/p>\n The MFE-ZcL comprises six standardized items: one supplementary diagnostic item assessing software instruction pacing across a 5-point bipolar categorical scale, and five core psychometric items measuring instructional clarity, pre-existing digital knowledge compatibility, autonomous computer practice opportunities, self-efficacy in independent application, and computer competence enhancement. The core five items utilize a 7-point Likert-type response format ranging from 1 ("stimme gar nicht zu" \/ "strongly disagree") to 7 ("stimme vollkommen zu" \/ "strongly agree"), accompanied by an explicit "nicht sinnvoll beantwortbar" ("cannot be meaningfully answered") option to prevent forced non-substantive responses. Psychometric investigations demonstrated strong internal consistency (Cronbach's alpha<\/a> = .84), verified unidimensionality via exploratory factor analysis accounting for 52.7% of total variance (eigenvalue = 2.64; factor loadings ranging from .57 to .80), and confirmed robust convergent validity with core teaching evaluation dimensions such as instructor didactics (r<\/em> = .79), instructional materials (r<\/em> = .74), and perceived learning gain (r<\/em> = .81), alongside an expected negative correlation with cognitive overload (r<\/em> = -.57). The instrument demonstrates high discriminant sensitivity across distinct university courses (\u03b7<\/em>\u00b2 = .52), establishing its utility for academic quality management and didactic improvement<\/span>.<\/p>\n Student Evaluations of Teaching (SET), computer-assisted instruction, higher education evaluation, pedagogical didactics, computer self-efficacy, M\u00fcnster Questionnaire for Evaluation, MFE-ZcL, digital competence, educational measurement, psychometrics, course quality assurance, instructional clarity<\/p>\n The M\u00fcnster Questionnaire for Evaluation system and its specialized supplementary modules were conceptualized, developed, and validated by researchers at the Department of Psychology, University of M\u00fcnster (Westf\u00e4lische Wilhelms-Universit\u00e4t M\u00fcnster<\/em>), Germany:<\/p>\n The primary purpose of the Additional Module Computer-Aided Teaching (MFE-ZcL) is to provide higher education institutions, faculty members, academic departments, and educational researchers with a brief, highly reliable, and empirically validated instrument to assess the specific quality dimensions of computer-aided and software-driven coursework. In contemporary university curricula\u2014particularly within empirical social sciences, psychology, data science, engineering, and the natural sciences\u2014teaching formats have fundamentally diverged from purely ex-cathedra lectures or traditional reading seminars. Students are frequently required to interact directly with complex software environments, statistical programming languages, laboratory instrumentation interfaces, and simulated data environments. Conventional Student Evaluations of Teaching (SET<\/a>) instruments routinely fail to capture these distinct didactic realities, relying on broad items regarding general speaker audibility, literature relevance, or lecture room acoustics.<\/p>\n The MFE-ZcL addresses critical educational and administrative needs:<\/p>\n The MFE-ZcL assesses student perceptions of the instructional effectiveness, self-efficacy enhancement, and technical delivery of computer-assisted teaching within higher education courses. Rather than operationalizing computer-aided teaching as a passive technological infrastructure (e.g., whether computers functioned mechanically), the construct is anchored in educational psychology as a triadic interaction between the instructor's scaffolding behavior, the student's baseline competence and experiential practice, and the resultant transfer self-efficacy.<\/p>\n The instrument captures five substantive psychological and pedagogical facets across its unidimensional core scale (Items 2 through 6), complemented by an independent bipolar didactic pacing parameter (Item 1):<\/p>\n The theoretical architecture of the MFE-ZcL is grounded in the convergence of three foundational paradigms within educational psychology, instructional design, and psychometrics:<\/p>\n The broader M\u00fcnster Questionnaire for Evaluation framework was built upon the empirical quality models synthesized by Heiner Rindermann<\/a> (1996) and Herbert W. Marsh (1984). Rindermann emphasized that university teaching quality cannot be captured through a single, undifferentiated global rating. Effective teaching comprises distinct didactic dimensions\u2014clarity of explanation, instructional pace, structuredness, active student involvement, and learning climate\u2014that exert distinct causal influences on student outcomes. Marsh's pioneering work on the Students' Evaluations of Educational Quality (SEEQ) established that teaching quality is multidimensional and that evaluations are valid when specific educational components are isolated and evaluated individually. The MFE modular framework reflects this paradigm: rather than using a sprawling, rigid survey, modularization allows targeted evaluation of specific didactic practices, such as computer-assisted laboratory execution (Grabbe, 2003; Moeck & Thielsch, 2004).<\/p>\n The specific items of the MFE-ZcL correspond directly to the tenets of Cognitive Load Theory<\/a> formulated by John Sweller and colleagues. Learning to manipulate complex digital software imposes heavy intrinsic and extraneous cognitive loads upon the learner's working memory. Extraneous cognitive load is generated by poor instructional design\u2014such as rapid, unclear explanations of mouse trajectories, terminal commands, or nested software menus. When an instructor systematically explains each procedural step comprehensibly (Item 3) and adjusts the temporal pacing (Item 1), extraneous load is reduced, freeing working memory capacity for germane cognitive load\u2014the cognitive processing devoted to schema acquisition and procedural mastery. Furthermore, cognitive skill acquisition theories (e.g., John R. Anderson's ACT-R model) posit that proceduralization requires a transition from declarative knowledge (observing the instructor) to procedural compilation through hands-on practice (Item 4).<\/p>\n Albert Bandura's (1997) construct of self-efficacy is integral to the conceptualization of the MFE-ZcL. Computer self-efficacy\u2014defined as an individual's belief in their capability to utilize a computer system to accomplish designated tasks\u2014is not merely an affective byproduct; it is a primary driver of sustained technology adoption and academic persistence. According to Bandura, self-efficacy develops through four primary sources: mastery experiences (hands-on execution, Item 4), vicarious experiences (clear modeled demonstrations by the teacher, Item 3), verbal persuasion\/guidance, and physiological\/affective states (lowered anxiety due to matched prerequisite skills, Item 2). The terminal items of the MFE-ZcL specifically evaluate whether the educational environment successfully translated instructional scaffolding into autonomous transfer capability (Item 5) and broader digital competence (Item 6).<\/p>\n The validation of the MFE-ZcL was conducted within the psychological evaluation program at the University of M\u00fcnster, adhering to established psychometric standards for construct, convergent, discriminant, and criterion-related validity.<\/p>\n As noted by Marsh (1984) and Rindermann (1996), validating instructional evaluation instruments presents methodological complexities because instructional success is influenced by student interest, prerequisite ability, and pedagogical structure. To establish construct validity, the authors evaluated convergent correlations between the MFE-ZcL scale score and established dimensions from the validated M\u00fcnster Seminar Evaluation Baseline Module (MFE-Sr<\/a>):<\/p>\n Divergent validity was corroborated through the relationship with the MFE-Sr subscale measuring Cognitive Overload \/ Excessive Demands (\u00dcberforderung<\/em>)<\/strong>. The MFE-ZcL demonstrated a strong negative correlation of r<\/em> = -.57 with student-reported cognitive overload. This finding empirically substantiates the theoretical model: high-quality computer-assisted teaching provides structured scaffolding that challenges learners productively without triggering cognitive overload or technological frustration<\/span>.<\/p>\n Furthermore, to examine whether the instrument exhibits discriminative validity<\/strong>\u2014the empirical ability to reliably differentiate between distinct courses of varying instructional quality\u2014an analysis of variance (ANOVA<\/a>) was conducted with evaluated course sections as the independent variable and the MFE-ZcL scale mean as the dependent variable. The analysis revealed highly significant, substantial differences across evaluated university courses (F<\/em> = 12.75, df<\/em> = 6, p<\/em> < .01), yielding a very large effect size of \u03b7<\/em>\u00b2 = .52 (partial eta-squared). This confirms that 52% of the variance in MFE-ZcL scores was attributable to actual course-level differences in instructional quality rather than undifferentiated halo effects or homogenous student rating biases<\/span>.<\/p>\n The internal consistency reliability of the Additional Module Computer-Aided Teaching (MFE-ZcL) was evaluated in an empirical validation study encompassing course evaluations from the Winter Semester 2010\/2011 through the Winter Semester 2011\/2012 at the University of M\u00fcnster (N<\/em> = 77 completed evaluations; 79.2% female, 20.8% male; mean age = 22.4 years, SD<\/em> = 3.7; 96.1% undergraduate psychology majors)<\/span>.<\/p>\n For the five-item core unidimensional scale (Items 2 through 6), the overall internal consistency was determined to be:<\/p>\n A reliability coefficient of .84 for a brief five-item scale demonstrates high internal consistency, comfortably exceeding the standard benchmark of .70 recommended for exploratory research and the .80 threshold required for institutional diagnostic decision-making (Nunnally & Bernstein, 1994). This level of precision confirms that the items reflect a coherent, mutually reinforcing latent construct, rendering the instrument robust for aggregated course-level and instructor-level benchmarking.<\/p>\n Corrected item-total correlations (item discrimination, r<\/em>it<\/sub>) and alpha-if-item-deleted statistics confirm that all five items contribute harmoniously to the scale's reliability:<\/p>\n No item omission leads to a meaningful increase in alpha beyond the baseline .84 (omitting Item 6 yields a marginal change to .85, but its substantive content regarding competence acquisition is essential for face and construct validity). Item discrimination values are high, with four of the five items exhibiting r<\/em>it<\/sub> values between .62 and .71, indicating excellent discriminatory power.<\/p>\n During the structural revision of the M\u00fcnster evaluation modules in the summer semester of 2010, the computer-aided teaching module underwent comprehensive psychometric refinement. Initial iterations exhibited factorial instability due to complex secondary cross-loadings on two items. Following targeted item reformulation (specifically revising Items 1 and 2), an empirical factor analysis was executed on the refined instrument.<\/p>\n The statistical suitability of the correlation matrix for factor analysis was evaluated using the Kaiser-Meyer-Olkin (KMO<\/a>) measure of sampling adequacy. The overall Measure of Sampling Adequacy (MSA) was .80, indicating meritorious suitability for latent variable modeling.<\/p>\n An exploratory principal axis factor analysis (PAF) with oblique (Promax<\/a>) rotation was conducted on the five substantive items (Items 2\u20136). Both the Kaiser-Guttman criterion (eigenvalues > 1.0) and visual inspection of the scree plot confirmed a definitive unidimensional 1-factor structure<\/span>:<\/p>\nKeywords<\/h2>\n
Authors<\/h2>\n
\n
Purpose<\/h2>\n
\n
Psychological Construct<\/h2>\n
\n
Theoretical Framework<\/h2>\n
1. Quality Assurance and Multi-Perspective Educational Evaluation<\/h3>\n
2. Cognitive Load Theory (CLT) and Procedural Skill Acquisition<\/h3>\n
3. Bandura's Social Cognitive Theory and Self-Efficacy<\/h3>\n
Validity<\/h2>\n
Convergent Validity<\/h3>\n
\n
Divergent and Discriminant Validity<\/h3>\n
Reliability<\/h2>\n
Internal Consistency (Cronbach's Alpha)<\/h3>\n
\n
Item Discrimination and Reliability If Item Deleted<\/h3>\n
\n
Factor Analysis<\/h2>\n
Sampling Adequacy and Factorability<\/h3>\n
Exploratory Factor Analysis (EFA) Results<\/h3>\n
\n