Additional Module Presentations – Münster Questionnaire for Evaluation (MFE-ZRe)

Abstract

The Münster Questionnaire for Evaluation – Additional Module Presentations (German: Münsteraner Fragebogen zur Evaluation – Zusatzmodul Referate, abbreviated as MFE-ZRe) is a specialized psychometric inventory designed to assess the pedagogical, communicative, and structural quality of student presentations within higher education seminars. Developed within the Department of Psychology at the University of Münster (Westfälische Wilhelms-Universität Münster), the MFE-ZRe functions as an elective didactic component integrated into the comprehensive Münster Questionnaire for Evaluation (MFE) system (PsyEval). Built upon systematic analyses of academic instructional quality and didactic frameworks of peer-assisted learning, the questionnaire provides nuanced, diagnostic feedback tailored to specific seminar formats where oral presentations represent a central learning activity. Comprising 13 items, the instrument measures two distinct yet interrelated dimensions: presentation delivery and design (Vortragsgestaltung) and content quality and didactic utility (Inhaltliche Qualität / Nutzen), alongside assessments of instructor support and competence acquisition. Responses are registered on a 7-point Likert scale ranging from 1 (“strongly disagree”) to 7 (“strongly agree”), accompanied by an explicit “cannot evaluate meaningfully” opt-out alternative. Psychometric evaluations demonstrate sound internal consistency, with Cronbach’s alpha coefficients ranging between .68 and .76 across subscales. Exploratory factor analyses confirm a robust two-factor structure explaining 54.9% of the total variance. Criterion and construct validity are supported through statistically significant positive correlations with global seminar quality, subjective learning success, and overall presentation grades. The instrument serves as a methodologically rigorous, highly economical feedback tool for academic quality assurance and instructional development.

Keywords

MFE-ZRe, Münster Questionnaire for Evaluation, student presentations, higher education evaluation, teaching quality, peer learning, psychometrics, course evaluation, oral presentations, PsyEval, instructional design

Authors

The development, standardization, and psychometric evaluation of the Münster Questionnaire for Evaluation system and its specialized modules are attributed to researchers affiliated with the Department of Psychology at the University of Münster (Westfälische Wilhelms-Universität Münster), Germany:

• Ina Grötemeier: Westfälische Wilhelms-Universität Münster, Institut für Psychologie, Fliednerstraße 21, 48149 Münster, Germany. Project coordination and psychometric evaluation within the Münster PsyEval system.
• Dr. Dipl.-Psych. Meinald T. Thielsch: Westfälische Wilhelms-Universität Münster, Psychologisches Institut 1, Fliednerstraße 21, 48149 Münster, Germany. Email: [email protected]. Specialist in human-computer interaction, online assessment methodologies, and institutional evaluation systems.
• Associated Contributors: Initial item pools and modular architectures were informed by foundational work on seminar evaluation dimensions conducted by Dipl.-Psych. J. Grabbe (2003), Dipl.-Psych. T. Moeck, and Dipl.-Psych. I. Haaser (2007).

Purpose

Course evaluations in tertiary education represent a critical mechanism for institutional quality assurance, curricular accreditation, and the continuous enhancement of university teaching standards. While broad omnibus questionnaires successfully capture universal dimensions of instructional effectiveness—such as instructor enthusiasm, syllabus clarity, and fairness of examinations—they regularly fail to address the idiosyncratic pedagogical mechanisms operative in specialized course formats. In contemporary university curricula, especially within the social sciences and humanities, academic seminars frequently hinge upon student-delivered oral presentations (Referate). In this cooperative learning paradigm, students transition from passive consumers of lecture content into active knowledge synthesizers, peer educators, and discussion leaders.

Standardized broad-scale inventories lack the granularity required to diagnose whether oral presentations enhance seminar discourse or devolve into disjointed, unengaging monologues. The MFE-ZRe was engineered specifically to bridge this diagnostic gap. Operating as a modular plug-in administered directly subsequent to the core seminar evaluation inventory (MFE-Sr), the MFE-ZRe offers several targeted practical and research applications:

• Formative Instructional Feedback: Instructors receive granular diagnostic feedback regarding how effectively student presenters conveyed technical concepts, whether visual materials supported peer understanding, and how successfully presentations sparked collaborative seminar discussions.
• Student Competence Diagnostics: The scale captures subjective competence acquisition, assessing whether preparing and delivering oral presentations improved students’ academic literature synthesis, scientific critique, and public speaking competencies.
• Monitoring Instructor Scaffolding: The instrument evaluates the degree to which academic instructors actively support presenters prior to the presentation (e.g., thematic guidance, methodological framing) and during the session (e.g., moderating debate, integrating technical depth).
• Survey Economy and Response Hygiene: By incorporating presentation-specific items only within courses where oral presentations actually occurred, the Münster evaluation architecture mitigates respondent fatigue, lowers survey abandonment rates, and avoids irrelevant items that contaminate student evaluations of educational quality (SET).

Psychological Construct

The MFE-ZRe measures the multidimensional pedagogical construct of Seminar Presentation Quality and Peer Learning Effectiveness in higher education. Within educational psychology, student presentations are conceptualized not merely as communicative performances, but as complex instructional interventions centered on active learning and co-constructive knowledge generation. The instrument captures this multidimensional construct across two empirically validated primary dimensions:

1. Presentation Delivery and Design (Vortragsgestaltung)

This dimension evaluates the rhetorical, communicative, and visual scaffolds utilized by student presenters to convey complex academic material to their peers. It encompasses:

• Rhetorical Fluency and Spontaneous Delivery: The presenter’s capacity to communicate without mechanical adherence to prepared scripts, maintaining natural vocal prosody, clear articulation, and eye contact with the audience.
• Media and Visual Scaffolding: The aesthetic, technical, and didactic appropriateness of presentation media (e.g., slide decks, handouts, conceptual posters) in highlighting salient constructs rather than cluttering cognitive bandwidth.
• Temporal Self-Regulation: Adherence to designated time limits, demonstrating professional time management and respect for interactive seminar discussion.
• Discussion Facilitation and Moderation: The ability to stimulate meaningful scholarly debate, formulate provocative inquiry prompts, and competently moderate divergent peer viewpoints.

2. Content Quality, Didactic Utility, and Competence Development (Inhaltliche Qualität / Nutzen)

This dimension assesses the intellectual rigor, structural coherence, and cognitive utility of the presented material from the perspective of the seminar cohort, as well as the personal competence gains derived from the presentation task. Key facets include:

• Conceptual Structure and Clarification: The systematic structuring of the academic subject matter, including transparent thematic sequencing and explicit emphasis on core scientific takeaways.
• Theoretical Rigor and Scientific Depth: The accuracy, empirical substance, and critical handling of primary literature and theoretical paradigms.
• Didactic Yield for Peer Comprehension: The subjective cognitive utility of the presentation in enhancing the overall audience’s comprehension of complex curriculum modules.
• Competence Acquisition in Scientific Inquiry: The personal developmental gain experienced by students through the rigorous preparation, literature synthesis, and oral defense of academic topics.
• Instructor Support and Feedback Integration: The perceived scaffolding provided by the academic instructor, encompassing preliminary topic consultations, constructive presentation critique, and expert supplementation during seminar proceedings.

Theoretical Framework

The architectural conception of the MFE-ZRe is rooted in educational measurement theory, social constructivism, and multidimensional models of instructional evaluation in higher education.

Multidimensional Models of Instructional Quality

Historically, educational measurement has grappled with the definition of “effective teaching.” Seminal work by Herbert W. Marsh on the Students’ Evaluations of Educational Quality (SEEQ) established that teaching effectiveness cannot be modeled as a unitary, unidimensional phenomenon. Instead, instructional efficacy comprises distinct dimensions such as learning value, enthusiasm, organization, group interaction, and individual rapport. In the German-speaking higher education sphere, Rindermann (1996) synthesized these paradigms into comprehensive structural models showing that university teaching quality operates at multiple structural levels: institutional inputs, course design characteristics, teacher competencies, and learner activities.

The MFE-ZRe specifically operationalizes the process and activity quality of university seminars. When seminars utilize student presentations as an instructional vehicle, the traditional direct-instruction model dissolves. The student presenter assumes a dual role: they remain a developing learner while simultaneously functioning as a temporary instructional facilitator for peers.

Cognitive Load Theory and Multimedia Learning

The presentation design dimension of the MFE-ZRe aligns directly with John Sweller’s Cognitive Load Theory and Richard Mayer’s Cognitive Theory of Multimedia Learning. In academic presentations, audience members must process visual inputs (slides, handouts) and auditory inputs (the presenter’s spoken explanations) concurrently within working memory. Items assessing whether presenters spoke fluently, avoided scripted monologues, utilized appealing media, and summarized main takeaways via structured handouts directly evaluate the mitigation of extraneous cognitive load. When presentations adhere to coherent signaling and spatial contiguity, peer understanding is measurably magnified.

Social Constructivism and Vygotskian Scaffolding

From a Vygotskian perspective, student learning flourishes within the Zone of Proximal Development (ZPD) when appropriately supported by instructional scaffolding. The preparation and delivery of an academic presentation represents an advanced developmental challenge. The MFE-ZRe reflects this reality by evaluating the supportive scaffolding provided by the faculty member. The instructor’s role is not passive observation; rather, it requires pre-presentation consultations, constructive feedback loops, and didactic interventions to clarify ambiguities during peer discussions. Without adequate instructor scaffolding, peer-led teaching models risk diffusing misconceptions or escalating student anxiety.

Validity

Psychometric validation of the MFE-ZRe has established strong content validity, construct validity, and criterion-related validity across university cohorts.

Content and Face Validity

The development of the MFE modules originated from comprehensive content analyses of high-quality university instruction conducted by Grabbe (2003) and iterative expert consultations with academic faculty across the Department of Psychology at the University of Münster. Academic staff confirmed that traditional generic course evaluation forms systematically obscured the didactic realities of student-led seminar sessions. Items were formulated to reflect concrete, observable behaviors (e.g., free speech delivery, visual clarity, discussion moderation) rather than ambiguous, high-inference abstractions, ensuring excellent face validity for both student respondents and course instructors.

Construct and Criterion-Related Validity

Because higher education evaluations encompass an intricate matrix of student characteristics, academic disciplines, and instructional designs (Marsh, 1984), validity must be demonstrated via convergent and divergent correlation patterns with established instructional indicators. In psychometric evaluations encompassing N = 331 to 348 university students, the MFE-ZRe subscales exhibited systematic, theoretically anticipated correlations:

• Overall Course Evaluation (Convergent Criterion): The MFE-ZRe Competence Acquisition dimension correlated strongly with students’ global evaluation of the overall seminar (r = .55, p < .01). In contrast, the Instructor Support dimension exhibited a moderate, divergent association (r = .32, p < .01), illustrating that while instructor guidance is valued, overall seminar excellence is primarily judged by cognitive yield and student engagement.
• Self-Reported Learning Success: Competence acquisition demonstrated a robust, statistically significant relationship with subjective individual learning outcomes (r = .54, p < .01), whereas instructor support correlated at r = .35 (p < .01).
• Global Quality of Seminar Presentations: When correlated against a global grading item evaluating all seminar presentations, the competence and content utility scale exhibited a large correlation (r = .50, p < .01), whereas instructor support displayed a smaller, distinct coefficient (r = .28, p < .01).

These differentiated correlation coefficients provide empirical evidence for construct validity, verifying that the subscales capture distinct facets of the educational ecosystem rather than undifferentiated halo effects.

Reliability

The reliability of the MFE-ZRe has been systematically evaluated through internal consistency analyses across seminar cohorts. In standard university evaluation contexts, data are aggregated at the course level while individual student responses provide the foundational measurement units.

• Internal Consistency (Cronbach’s Alpha): Psychometric testing conducted on sample cohorts (N = 331) demonstrated adequate to high internal consistency across subscales. The Support by Instructor subscale (3 items) yielded a Cronbach’s alpha of α = .68. Given the brief 3-item length of this subscale, this coefficient meets established thresholds for group-level evaluation inventories. The 5-item Competence Acquisition / Content Utility subscale demonstrated higher internal consistency with a Cronbach’s alpha of α = .76. Across the broader presentation design and utility scales, alpha values routinely fall between .68 and .76.
• Corrected Item-Total Correlations (r_it): Item discrimination indices demonstrated robust psychometric functioning across items:
• Item 4 (Instructor preparation time): r_it = .44
• Item 5 (Instructor content guidance): r_it = .58
• Item 8 (Instructor expertise integration): r_it = .54
• Item 6 (Presentation importance/motivation): r_it = .44
• Item 7 (Constructive feedback): r_it = .49
• Item 9 (Text analysis competence): r_it = .58
• Item 10 (Rhetorical skill improvement): r_it = .63
• Item 11 (Presentation technique guidance): r_it = .52

Alpha-if-item-deleted analyses verified that eliminating any single item does not substantially inflate scale consistency, indicating a cohesive, well-calibrated measurement pool.

Factor Analysis

The latent structural framework of the presentation evaluation items was investigated via exploratory factor analysis (EFA) employing principal axis factoring with an oblique Promax rotation, accommodating theoretical correlations among didactic dimensions.

Eigenvalues and Variance Explanation

Based on the Kaiser-Guttman criterion (Eigenvalues > 1.0) and scree plot examination, a clear two-factor solution was extracted:

• Factor 1 (Competence Acquisition & Didactic Yield): Initial Eigenvalue of 3.27, accounting for 40.6% of the total variance.
• Factor 2 (Instructor Support & Guidance): Initial Eigenvalue of 1.15, accounting for 14.3% of the total variance.
• Cumulative Variance Explained: Together, the two extracted factors account for 54.9% of the total empirical variance.
• Factor Intercorrelation: The oblique Promax rotation revealed an inter-factor correlation of r = .58 (p < .01), indicating that while instructor guidance and student competence acquisition are moderately interrelated facets of seminar success, they represent psychometrically distinct constructs.

Factor Loadings (AMOS & SPSS Analyses)

Factor loading matrices confirmed distinct structural alignment:

• Factor 1 Markers: Marked primarily by items addressing personal skill gains and didactic yield, including Item 10 (improvement of rhetorical abilities, loading = .77), Item 9 (improvement in scientific text analysis, loading = .73), Item 11 (presentation technique suggestions, loading = .60), Item 7 (useful feedback, loading = .48), and Item 6 (personal investment in presentation success, loading = .46).
• Factor 2 Markers: Defined by instructor scaffolding, including Item 5 (helpful suggestions regarding content, loading = .78), Item 8 (supplementing presentations with expert knowledge, loading = .55), and Item 4 (instructor time investment, loading = .54).
• Cross-Loadings: In accordance with real-world seminar dynamics, secondary loadings across factors were noted (> .30), reflecting the systemic interaction between instructor guidance and student performance.

Instrument / Measurement Tool

• Instrument Name: Münster Questionnaire for Evaluation – Additional Module Presentations (MFE-ZRe; Münsteraner Fragebogen zur Evaluation – Zusatzmodul Referate).
• Parent System: Münster Questionnaire for Evaluation (MFE / PsyEval system).
• Administration Format: Primarily web-based online survey platform (PHP/MySQL architecture), self-administered at the conclusion of the academic semester; adaptable for paper-and-pencil administration.
• Item Count: 13 items total (encompassing core presentation evaluation items, open-ended context metrics, and global performance evaluations).
• Dimensional Structure: Two validated analytical subscales: ‘Vortragsgestaltung’ (Presentation Delivery/Design; Items 1 to 7) and ‘Inhaltliche Qualität / Nutzen’ (Content Quality / Didactic Utility; Items 8 to 13).
• Response Scale: Für Items 4-11 wird ein 7-stufiges Antwortformat mit den Optionen 1 = “stimme gar nicht zu”, 2 = “stimme nicht zu”, 3 = “stimme eher nicht zu”, 4 = “neutral”, 5 = “stimme eher zu”, 6 = “stimme zu” und 7 = “stimme vollkommen zu” verwendet. Zusätzlich steht die Antwortoption “nicht sinnvoll beantwortbar” zur Verfügung.
• Scoring Algorithm: Subscale and total scores are calculated as arithmetic means across completed items. Responses marked as “nicht sinnvoll beantwortbar” (cannot evaluate meaningfully) are treated as missing data and excluded from mean computations. Higher numerical scores reflect greater perceived presentation quality, pedagogical effectiveness, and instructional support.

Permissions & Fee and Test Year

The Münster Questionnaire for Evaluation (MFE) system, including its modular extensions such as the MFE-ZRe, was originally conceptualized and integrated into university operations between 2000 and 2003, with significant psychometric revisions, standardization, and item documentation published by the University of Münster in 2010. The instrument is documented in the open-access psychometric repository ZIS (GESIS – Leibniz Institute for the Social Sciences).

The MFE-ZRe is available free of charge for non-commercial academic research, pedagogical inquiry, and institutional course evaluations within universities. Institutional researchers and educators wishing to utilize the MFE-ZRe or incorporate it into localized online evaluation platforms are encouraged to credit the original developers and contact Dr. Meinald T. Thielsch at the Department of Psychology, University of Münster ([email protected]; PsyEval Project).

References

• Göritz, A. S., Soucek, R., & Bacher, J. (2005). Die Nutzung des Internets für Befragungen in der Arbeits- und Organisationspsychologie. Wirtschaftspsychologie, 7(3), 4–11.
• Grabbe, J. (2003). Entwicklung und Erprobung eines Fragebogens zur Evaluation von Seminaren am Psychologischen Institut der Westfälischen Wilhelms-Universität Münster (Unpublished diploma thesis). Department of Psychology, University of Münster, Germany.
• Haaser, I., Thielsch, M. T., & Moeck, T. (2007). PsyEval: Konzeption und Evaluation eines webbasierten Lehrevaluationssystems. Psychologisches Institut, Westfälische Wilhelms-Universität Münster.
• Marsh, H. W. (1984). Students’ evaluations of university teaching: Dimensionality, reliability, validity, potential biases, and utility. Journal of Educational Psychology, 76(5), 707–754. https://doi.org/10.1037/0022-0663.76.5.707
• Mayer, R. E. (2009). Multimedia learning (2nd ed.). Cambridge University Press. https://doi.org/10.1017/CBO9780511811678
• Moeck, T., & Thielsch, M. T. (2004). Entwicklung von Zusatzmodulen für das Lehrevaluationssystem PsyEval. Psychologisches Institut, Westfälische Wilhelms-Universität Münster.
• Rindermann, H. (1996). Unterrichtsevaluation an Hochschulen: Ansätze zur Qualitätssicherung und -verbesserung. Waxmann.
• Schmidt, F. T. C., & Loßnitzer, T. (2010). Analysen zur Validität von Instrumenten der studentischen Lehrevaluation: Ein Überblick über den deutschsprachigen Raum. Zentrum für Evaluation und Forschungsberatung.
• Sweller, J. (2010). Element interactivity and intrinsic, extraneous, and germane cognitive load. Educational Psychology Review, 22(2), 123–138. https://doi.org/10.1007/s10648-010-9128-5
• Thielsch, M. T., & Weltzin, S. (2012). Online-Lehrevaluation: Praxis, Befunde und Empfehlungen aus der Psychologie. Zeitschrift für Hochschulentwicklung, 7(3), 1–12. https://doi.org/10.3217/zfhe-7-03/01

Items of the Scale