The M\u00fcnster Questionnaire for the Evaluation of Exams<\/strong> (German: M\u00fcnsteraner Fragebogen zur Evaluation von Klausuren<\/em>, abbreviated as MFE-K<\/strong>) is a specialized psychometric assessment instrument developed at the University of M\u00fcnster (Westf\u00e4lische Wilhelms-Universit\u00e4t M\u00fcnster) to evaluate the quality, didactic alignment, administrative framing, and perceived student burden associated with written university examinations. Originally designed as an extension module within the broader institutional evaluation framework ("M\u00fcnster Questionnaire for Evaluation"), the MFE-K addresses a critical systemic deficit in higher education quality assurance: while student evaluations of teaching (SET)<\/a> routinely examine lectures and seminars, examinations themselves have historically lacked standardized, empirically validated diagnostic instruments. The core instrument captures multiple facets of the examination experience across 27 items, encompassing dimensions such as exam adequacy and construction quality, alignment with lecture content, environmental and administrative conditions, individual student exam preparation, and anticipated grades or global evaluative impressions. Responses are primarily recorded using a seven-point Likert-type agreement scale ranging from 1 (stimme gar nicht zu<\/em> \/ strongly disagree) to 7 (stimme vollkommen zu<\/em> \/ strongly agree), supplemented by specific open-ended and categorical metric indicators. Psychometric investigations reveal sound internal consistency across core subscales, with Cronbach’s alpha values typically ranging between .76 and .84. Confirmatory factor analyses support multi-dimensional models capturing construct validity, and multivariate analyses demonstrate high sensitivity to between-exam differences (η<\/em>2<\/sup> = .22). The MFE-K serves as an essential empirical feedback tool for university faculties, instructional development centers, and educational researchers striving to align higher education testing with modern competency-oriented assessment principles<\/span>.<\/p>\n M\u00fcnster Questionnaire for the Evaluation of Exams, MFE-K, exam evaluation, higher education assessment, psychometrics, course evaluation, student burden, instructional quality, Klausurevaluation, academic testing quality<\/p>\n The M\u00fcnster Questionnaire for the Evaluation of Exams was developed by educational and organizational psychologists affiliated with the Department of Psychology at the Westf\u00e4lische Wilhelms-Universit\u00e4t (WWU) M\u00fcnster, in institutional collaboration with evaluation specialists:<\/p>\n The primary purpose of the MFE-K is to provide a standardized, psychometrically grounded methodology for measuring student perceptions of written summative examinations in higher education. Within modern university structures, written examinations ("Klausuren") serve as the predominant vehicle for evaluating student learning outcomes, awarding credits, and establishing academic progression criteria. Despite their central pedagogical and legal importance, examinations historically represented an unmonitored blind spot in academic quality management. While instructors frequently received feedback regarding their presentation style, course materials, or interpersonal rapport via traditional course evaluations, written exams were rarely subjected to systematic, psychometrically validated student evaluations.<\/p>\n This deficit became acute following the structural reorganization of European higher education under the Bologna Process<\/a>. The replacement of cumulative diploma degree examinations with continuous, semester-concurrent modular testing precipitated a dramatic increase in examination density. As noted by higher education didactic researchers, students faced an "explosive proliferation" of exams, producing heightened cognitive load, strategic learning behaviors, and schedule compression. The German Standing Conference of the Ministers of Education and Cultural Affairs (Kultusministerkonferenz, KMK<\/a>) explicitly highlighted an urgent mandate for action regarding the quality control, fairness, and transparency of university testing practices.<\/p>\n The MFE-K directly addresses this mandate across multiple clinical, administrative, and research domains:<\/p>\n The MFE-K evaluates the multi-dimensional construct of examination quality<\/strong> as experienced by examinees immediately post-assessment. Rather than viewing an exam solely through an objective classical test theory<\/a> lens (e.g., item difficulty index p<\/em> and point-biserial discrimination r<\/em>it<\/sub>), the MFE-K captures the ecological validity, perceived fairness, and psychological burden of the testing episode. Across its comprehensive 27-item architecture, the instrument operationalizes five key psychological and didactic dimensions:<\/p>\n This core dimension measures the perceived psychometric and didactic craftsmanship of the examination. It addresses whether test questions were formulated unambiguously, whether difficulty levels were appropriately calibrated to the instructional level, whether point weightings were fair, and whether testing times were sufficient. Crucially, it captures whether the assessment evaluated profound conceptual comprehension rather than superficial mechanical regurgitation, as well as the overall construct representativeness of the question sample.<\/p>\n Grounding itself in the educational principle of constructive alignment<\/a>, this construct assesses the concordance between the taught curriculum and the tested curriculum. It examines whether the thematic priorities established during lectures were faithfully represented in the examination items, whether content surprised students unfairly, and whether the scope of tested materials strictly mirrored the authorized course syllabus.<\/p>\n This dimension operationalizes the contextual conditions under which the test occurred. Standardized test administration requires that extraneous sources of measurement error be minimized. This subscale captures spatial factors (room acoustics, ergonomic space, ambient lighting, temperature control), invigilation decorum (maintenance of a quiet, uninterrupted setting, professional resolution of procedural queries), and the technical legibility of printed or digital exam interfaces.<\/p>\n Exam evaluations cannot be interpreted in a vacuum independent of student effort. This dimension measures the student’s self-regulated preparation intensity, total invested study hours, structured time management, and thoroughness of review. Capturing preparation allows researchers and evaluators to contextualize negative feedback: ratings from highly prepared students carry different didactic implications than those driven by procrastination or inadequate effort.<\/p>\n This dimension gathers summative global judgments and subjective cognitive projections. It captures expected academic performance, school-style global grading of the exam paper itself, and open-ended qualitative reflections (praise, substantive critique, didactic recommendations). By recording expected grades prior to actual grade dissemination, the instrument controls for retrospective grade bias (the cognitive tendency to rate an exam negatively primarily due to receiving an unsatisfactory grade).<\/p>\n The theoretical architecture of the MFE-K integrates foundational tenets from higher education didactics, psychometric test theory, cognitive load theory, and the psychology of academic achievement:<\/p>\n Following the seminal work of Heiner Rindermann (1996) on teaching evaluation in higher education, institutional evaluations serve multiple distinct functions: improving individual teaching competencies, uncovering systemic curricular weaknesses, structuring dialogue between students and faculty, informing resource allocation, and guiding educational development programs. While early university evaluations focused almost exclusively on instructional communication, Dany, Szczyrba, and Wildt (2008) highlighted that testing procedures represent an inseparable, defining component of academic instruction. Exams dictate the "hidden curriculum"; according to the testing effect and assessment-driven learning frameworks, the design, cognitive depth, and perceived fairness of examinations exert a more profound impact on how students study than the passive delivery of lecture material.<\/p>\n The MFE-K is heavily anchored in John Biggs’ theory of constructive alignment<\/a> (Biggs, 1996). Under this paradigm, effective educational systems maintain rigorous concordance between intended learning outcomes (ILOs), the teaching and learning activities (TLAs) conducted in lectures or seminars, and the assessment tasks used to gauge mastery. When exams introduce unexpected cognitive operations (e.g., asking for trivia memorization when critical thinking was taught, or demanding complex problem solving when only superficial definitions were presented), constructive alignment breaks down. The MFE-K empirically verifies whether students perceive this alignment to be intact.<\/p>\n Because higher education literature historically lacked formalized theoretical criteria for what constitutes a high-quality written university exam, Froncek and Thielsch (2011; see also Froncek, 2010) executed qualitative interview studies using Mayring’s qualitative content analysis. Conducting semi-structured interviews with both university lecturers across academic disciplines and psychology students across various semester tiers, they inductively distilled key categories of exam excellence: transparency of expectations, precision of instructional prompts, authentic problem-solving orientation, absence of arbitrary catch questions, appropriate pacing, and supportive testing environments. These empirically derived categories directly informed the operationalization and factor design of the MFE-K.<\/p>\n The validity of the MFE-K has been established across multiple validation cohorts at the Westf\u00e4lische Wilhelms-Universit\u00e4t M\u00fcnster and affiliated institutions, examining content, construct, and criterion-related validity.<\/p>\n In educational measurement, establishing content validity<\/a> for course and exam evaluations is notoriously challenging due to the historical absence of universal external quality benchmarks (Marsh, 1984). The MFE-K established content validity through rigorous multi-stage inductive-deductive construction. Initial items were derived from student council archive records, institutional course evaluation batteries, and Swiss federal technical testing guidelines (Eugster & Lutz, 2004). This initial pool underwent extensive expert reviews involving university examiners, academic commissions, and student representatives. Subsequent qualitative interview studies (Froncek & Thielsch, 2011) systematically categorized instructor and student mental models of exam quality, ensuring that every retained item directly mapped onto verified educational quality dimensions.<\/p>\n Construct validity is evidenced through iterative factor-analytic testing across successive cohorts. Early two-factor formulations demonstrated suboptimal confirmatory fit (χ<\/em>2<\/sup> = 146.46, df<\/em> = 26; TLI = .87, CFI = .91, RMSEA = .11). Subsequent refinements led to well-fitting multi-dimensional models. A three-factor confirmatory model evaluated on N<\/em> = 688 test protocols across 17 distinct exams demonstrated acceptable goodness-of-fit indices: χ<\/em>2<\/sup> = 107.83, df<\/em> = 41; TLI = .96, CFI = .97, RMSEA = .06. Inter-scale latent correlations confirmed meaningful construct distinctions: Student Burden correlated negatively with Exam Design (r<\/em> = -.27) and Transparency (r<\/em> = -.30), whereas Exam Design and Transparency exhibited a robust positive association (r<\/em> = .62)<\/span>.<\/p>\n To establish that the instrument measures true variation between academic assessments rather than homogenous response sets or invariant institutional dissatisfaction, multivariate analyses of variance (MANOVA) were conducted using individual examination modules as the independent factor and MFE-K subscale scores as dependent criteria. The analysis demonstrated significant, robust differentiation across examinations (F<\/em> = 11.9, df<\/em> = 48, p<\/em> < .01, η<\/em>2<\/sup> = .22). This substantial effect size indicates that 22% of the total variance in student evaluation scores was attributable to actual differences between specific exams, confirming the instrument’s high diagnostic sensitivity to divergent testing conditions, exam formats, and instructional preparation<\/span>.<\/p>\n The reliability of the MFE-K scales has been evaluated across extensive cross-sectional implementations, demonstrating solid to high internal consistency despite the deliberately parsimonious length of individual subscales:<\/p>\n Because the questionnaire is intentionally administered immediately following examination completion prior to grade disclosure, test-retest reliability across long intervals is theoretically inappropriate: examinee retrospective evaluations shift fundamentally once formal grades are received. However, split-half reliability and split-sample stability across parallel examination cohorts have repeatedly shown stable metric properties across academic semesters.<\/p>\n The factorial structure of the MFE-K was established through a series of exploratory (EFA) and confirmatory factor analyses (CFA) conducted across four consecutive academic semesters (Winter Semester 2007\/2008 through Winter Semester 2010\/2011). Maximum Likelihood Estimation within structural equation modeling software (IBM SPSS AMOS) served as the standard estimation technique.<\/p>\n Early drafts in 2008 utilized an exploratory two-factor solution comprising "Exam and Organization" and "Student Burden." When tested confirmatorily in 2009 (N<\/em> = 409), this model proved inadequate due to elevated residual covariances (RMSEA = .11, TLI = .87). The subsequent integration of qualitative interview findings (Froncek & Thielsch, 2011) led to a distinct separation of transparency, organizational framework, and specific question design<\/span>.<\/p>\n The established model structure demonstrates excellent psychometric fit indices across benchmark criteria (N<\/em> = 688)<\/span>:<\/p>\n These robust factor loadings substantiate the structural integrity of the instrument, validating its use as both a set of distinct diagnostic subscale scores and an integrated evaluation battery.<\/p>\n The MFE-K is a standardized, self-report paper-and-pencil or digital survey instrument designed for immediate administration upon completion of a written university exam.<\/p>\n The instrument primarily employs a 7-point Likert-type agreement scale formulated in standard German:<\/p>\n Specific supplementary items utilize alternative response modes: open numerical entry (e.g., hours spent studying, expected grade), German academic grading scale (1 = sehr gut<\/em> \/ very good to 6 = ungen\u00fcgend<\/em> \/ insufficient), or open-ended text fields for constructive feedback<\/span>.<\/p>\n Scale scores are computed by summing or averaging the individual item responses within each subscale. Reverse-scoring or inverted interpretation rules apply to negative indicators:<\/p>\n The M\u00fcnster Questionnaire for the Evaluation of Exams was initially conceptualized in 2007<\/strong> and formally validated through subsequent iterative cohorts culminating in standard operational deployment in 2011<\/strong>. The instrument was developed within the Department of Psychology at the Westf\u00e4lische Wilhelms-Universit\u00e4t M\u00fcnster as an open-access public-science contribution to university quality assurance. The scale is non-commercial and can be utilized free of charge by academic institutions, university departments, and researchers for educational and scientific evaluation purposes, provided proper scholarly citation is maintained. Adaptation or integration into digital campus evaluation platforms (e.g., EvaSys, LimeSurvey) is permitted. Inquiries regarding original institutional benchmarks or institutional documentation may be directed to Dr. Meinald T. Thielsch or Benjamin Froncek.<\/p>\n Antwortskala (Items 1–23):<\/strong> The M\u00fcnster Questionnaire for the Evaluation of Exams (MFE-K) is a standardized psychometric instrument designed to evaluate the quality, constructive alignment, environmental framework, and student burden of university written examinations.<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","template":"","categories":[21649,55,2],"tags":[26363,26381,184,26380,6,21015,22000],"class_list":["post-8905","psych_scale","type-psych_scale","status-publish","hentry","category-academic-assessment","category-educational-psychology","category-psychometrics","tag-didactics","tag-exam-evaluation","tag-higher-education","tag-mfe-k","tag-psychometrics","tag-quality-assurance","tag-student-evaluation"],"_links":{"self":[{"href":"https:\/\/ashadocs.org\/index.php?rest_route=\/wp\/v2\/psych_scale\/8905","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ashadocs.org\/index.php?rest_route=\/wp\/v2\/psych_scale"}],"about":[{"href":"https:\/\/ashadocs.org\/index.php?rest_route=\/wp\/v2\/types\/psych_scale"}],"author":[{"embeddable":true,"href":"https:\/\/ashadocs.org\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/ashadocs.org\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=8905"}],"version-history":[{"count":0,"href":"https:\/\/ashadocs.org\/index.php?rest_route=\/wp\/v2\/psych_scale\/8905\/revisions"}],"wp:attachment":[{"href":"https:\/\/ashadocs.org\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=8905"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ashadocs.org\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=8905"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ashadocs.org\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=8905"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}Keywords<\/h2>\n
Authors<\/h2>\n
\n
Purpose<\/h2>\n
\n
Psychological Construct<\/h2>\n
1. Exam Adequacy and Construction Quality (Angemessenheit und G\u00fcte der Klausur)<\/h3>\n
2. Curricular Alignment with Instructional Content (\u00dcbereinstimmung mit der Vorlesung)<\/h3>\n
3. Environmental and Administrative Framework (Rahmenbedingungen)<\/h3>\n
4. Student Preparation and Learning Engagement (Vorbereitung)<\/h3>\n
5. Grade Expectation and Global Evaluation (Notenerwartung und Gesamteindruck)<\/h3>\n
Theoretical Framework<\/h2>\n
Higher Education Didactics and Quality Assurance<\/h3>\n
Constructive Alignment and Criterion-Referenced Measurement<\/h3>\n
Qualitative Conceptions of "Good Examinations"<\/h3>\n
Validity<\/h2>\n
Content Validity<\/h3>\n
Construct and Factorial Validity<\/h3>\n
Criterion-Related and Discriminant Validity<\/h3>\n
Reliability<\/h2>\n
\n
Factor Analysis<\/h2>\n
Structural Revisions and Model Progression<\/h3>\n
Confirmatory Factor Model Parameters<\/h3>\n
\n
\n
Instrument \/ Measurement Tool<\/h2>\n
Structural Parameters<\/h3>\n
\n
Response Format<\/h3>\n
\n
Scoring and Subscale Architecture<\/h3>\n
\n
Permissions & Fee and Test Year<\/h2>\n
References<\/h2>\n
\n
Items of the Scale<\/h2>\n
\n Verwendet wird weitgehend ein 7-stufiges Antwortformat mit den Optionen:
\n 1 = "stimme gar nicht zu<\/span>"
\n 2 = "stimme nicht zu<\/span>"
\n 3 = "stimme eher nicht zu<\/span>"
\n 4 = "neutral<\/span>"
\n 5 = "stimme eher zu<\/span>"
\n 6 = "stimme zu<\/span>"
\n 7 = "stimme vollkommen zu<\/span>"<\/p>\nSkala 1: Angemessenheit und G\u00fcte der Klausur<\/h3>\n
\n
Skala 2: \u00dcbereinstimmung mit der Vorlesung<\/h3>\n
\n
Skala 3: Rahmenbedingungen<\/h3>\n
\n
Skala 4: Vorbereitung<\/h3>\n
\n
Skala 5: Notenerwartung und Gesamteindruck<\/h3>\n
\n