The Feedback Tool for Rescue Force Development \u2013 Basic Training<\/strong> (known in German as the Feedback-Instrument zur Rettungskr\u00e4fte-Entwicklung \u2013 Basisausbildung<\/em>, or FIRE-B<\/strong>) is a scientifically validated, multidimensional survey inventory engineered to assess the perceived pedagogical and organizational quality of foundational firefighter training programs at municipal, county, and district levels. Originating from an academic-applied collaboration between the Department of Organizational and Business Psychology at the University of M\u00fcnster (Westf\u00e4lische Wilhelms-Universit\u00e4t M\u00fcnster<\/a>) and the Fire Service Institute of North Rhine-Westphalia (Institut der Feuerwehr Nordrhein-Westfalen<\/em>; IdF NRW), the FIRE-B evaluates foundational courses for both career fire brigades (e.g., Brandmeisteranw\u00e4rter<\/em>) and voluntary fire services (e.g., Truppmann<\/em> and Truppf\u00fchrer<\/em> certifications).<\/p>\n The conceptual framework of the FIRE-B emerged from a rigorous multi-stage developmental program comprising qualitative critical incident analyses and comparative adaptations from university teaching evaluations and emergency service leadership assessment tools. Psychometrically established across two large-scale independent empirical investigations (total N<\/em> = 708 emergency responders), the core instrument consists of 29 primary items structured across six distinct, correlated first-order dimensions: (1) Structure & Didactics<\/strong> (Struktur & Didaktik<\/em>; 6 items), (2) Support & Encouragement<\/strong> (Unterst\u00fctzung & F\u00f6rderung<\/em>; 5 items), (3) Group Dynamics & Cohesion<\/strong> (Gruppe<\/em>; 3 items), (4) Practical Training Realism<\/strong> (Praxis<\/em>; 3 items), (5) Materials & Facilities<\/strong> (Material & R\u00e4umlichkeiten<\/em>; 5 items), and (6) Competence Acquisition<\/strong> (Kompetenzerwerb<\/em>; 7 items). Four supplementary diagnostic items (evaluating instructional pace, global learning gain, traditional academic grading, and qualitative commentary) provide actionable institutional intelligence<\/span>.<\/p>\n Scale responses are captured via a 7-point Likert scale ranging from 1 ("completely disagree") to 7 ("completely agree"), supplemented by a dedicated non-applicable response option. Psychometric analyses demonstrate robust internal consistency across all subscales, with Cronbach\u2019s alpha ($\u0007lpha$<\/span>) and McDonald\u2019s omega ($\\omega$<\/span>) values consistently meeting or exceeding .76. Confirmatory factor analyses support the postulated six-factor structural taxonomy, while extensive validation demonstrates robust content, construct, convergent, and criterion validity against objective and self-reported performance markers. The FIRE-B represents an empirically validated benchmark for quality assurance and pedagogical continuous improvement in high-risk emergency responder instruction.<\/p>\n FIRE-B, firefighter training evaluation, rescue forces, emergency responder education, psychometrics, training quality assessment, instructional didactics, competence acquisition, organizational psychology, vocational training evaluation.<\/p>\n The development, empirical validation, and psychometric operationalization of the FIRE-B were executed by research psychologists and emergency training specialists affiliated with the University of M\u00fcnster and the IdF NRW:<\/p>\n Emergency response personnel operate in high-reliability, time-pressured environments characterized by extreme physical hazard, environmental volatility, cognitive overload, and acute psychological stress. In statutory emergency frameworks\u2014such as those codified under the German Fire Service Regulations (e.g., Feuerwehr-Dienstvorschriften<\/em> FwDV 2 and FwDV 3) and federal state legislation like the Gesetz \u00fcber den Brandschutz, die Hilfeleistung und den Katastrophenschutz<\/em> (BHKG NRW)\u2014firefighters completing their entry-level credentials are immediately expected to carry out frontline search, rescue, suppression, and technical extrication operations under direct command. Despite prescriptive curriculum catalogs stipulating mandatory instructional hours and thematic topics, local executing bodies retain wide didactic and methodological autonomy. Historically, training quality at municipal and district training centers remained largely unmeasured by validated psychometric procedures.<\/p>\n The fundamental purpose of the FIRE-B is to resolve this diagnostic void by supplying a scientifically constructed, psychometrically grounded instrument tailored specifically to entry-level emergency services education. Distinct from general course evaluation questionnaires designed for traditional university lecture halls, the FIRE-B captures the dual classroom-practical nature of high-consequence vocational training. The scale functions along three primary applied vectors:<\/p>\n The construct assessed by the FIRE-B is the multidimensional perceived quality of basic emergency responder training<\/strong>. Rooted in training transfer frameworks, organizational behavior, and educational psychology, training quality is operationalized not as a monolithic score, but as a dynamic six-dimensional system capturing the holistic learning ecosystem:<\/p>\n Comprising 6 items (Items 1\u20136), this dimension gauges the cognitive organization, clarity, topical breadth, and pedagogical adaptability of the curriculum. It operationalizes the instructor's capacity to decompose complex fireground physics, hydraulics, and tactical operational models into intelligible, sequenced learning modules. Furthermore, it measures the instructional staff\u2019s didactic adaptability\u2014their ability to flexibly tailor content to varying participant baseline proficiencies\u2014and evaluates the subject-matter mastery exhibited by the training staff.<\/p>\n Capturing the socio-emotional climate and interpersonal instructor behavior through 5 items (Items 7\u201311), this scale evaluates the instructional cadre's student-centered engagement. It examines whether trainers display open receptivity toward student challenges, demonstrate active commitment to individual learner success, foster intrinsic motivation, and project psychological calm and composure under stress. Crucially for emergency responders, it measures the instructor's ability to contextualize didactic theory using authentic operational deployments (Einsatzerfahrungen<\/em>).<\/p>\n Measured via 3 items (Items 12\u201314), this subscale assesses the lateral learning environment, collective peer engagement, and social cohesion among trainees. In high-reliability emergency operations, operational safety rests heavily on team trust and dynamic coordination. This dimension captures whether course peers actively participate, maintain strong collective motivation, and develop reciprocal solidarity and team cohesion (Zusammenhalt<\/em>) during rigorous instructional phases.<\/p>\n Reflecting the experiential core of tactical emergency operations via 3 items (Items 15\u201317), this facet captures the physical fidelity and instructional scaffolding of tactical drills. It measures the ecological validity and operational realism of physical exercises (e.g., live-fire drills, heavy extrication simulations, self-contained breathing apparatus confidence courses), the adequacy of opportunities for repetitive physical skill rehearsal, and the rigor of structured pedagogical debriefings (after-action reviews).<\/p>\n Operationalized across 5 items (Items 18\u201322), this dimension evaluates the socio-technical and infrastructural foundation of the training facility. It measures the quantitative availability and operational quality of classrooms, drill yards, simulation buildings, audiovisual media, instructional textbooks, frontline fire apparatus (engines, ladder trucks), specialized rescue tooling (hydraulic spreaders, thermal imaging cameras), and authentic consumable practice objects (e.g., training manikins, vehicle chassis for extrication practice).<\/p>\n Forming the primary self-reported outcome criterion across 7 items (Items 23\u201329), this scale measures the recruit's perceived growth across multidimensional operational domains. It explicitly evaluates heightened hazard recognition and tactical reaction capacities, operational mastery of technical apparatus, perceived mission readiness for real-world frontline calls, expanded self-awareness regarding personal physical and psychological stress boundaries, operational self-efficacy, enhanced teamwork competencies, and broad theoretical knowledge consolidation.<\/p>\n The architecture of the FIRE-B is embedded in the intersection of Kirkpatrick's Four-Level Training Evaluation Model<\/a>, Cognitive Load Theory<\/a>, and the sociotechnical conceptualization of High-Reliability Organizations (HROs):<\/p>\n Donald Kirkpatrick's foundational model conceptualizes training effectiveness across four progressive tiers: Level 1 (Reaction), Level 2 (Learning), Level 3 (Behavior), and Level 4 (Results). Traditional course evaluations frequently conflate Level 1 satisfaction ("smile sheets") with genuine training effectiveness. The FIRE-B methodologically stratifies these layers. While Dimensions 1, 2, 4, and 5 assess Level 1 environmental and instructional design elements, Dimension 6 (Kompetenzerwerb<\/em>) directly taps into subjective Level 2 learning outcomes (knowledge retention, cognitive self-efficacy) and perceived precursors to Level 3 transfer (confidence to perform on upcoming frontline deployments).<\/p>\n Emergency responder training mandates that novices transition from cognitively demanding, effortful analytical processing to rapid, automated pattern matching under life-threatening stressors. According to Sweller\u2019s Cognitive Load Theory, poorly structured didactic material or chaotic exercise pacing induces extraneous cognitive load, impeding germane schema acquisition. The subscales Struktur & Didaktik<\/em> and the diagnostic pacing item (Item 30: "Das Tempo der Stoffvermittlung war zu hoch f\u00fcr mich") directly capture whether instructional pacing avoids cognitive overload, enabling foundational schema construction regarding equipment operation and hazard identification.<\/p>\n In high-reliability frameworks (Weick & Sutcliffe), organizations operating in hazardous settings maintain safety through collective mindfulness, deference to expertise, and redundancy. These qualities must be internalized during entry-level socialization. The FIRE-B explicitly includes Gruppe<\/em> and Unterst\u00fctzung & F\u00f6rderung<\/em> to operationalize the psychological safety, shared mental models, and supportive feedback loops necessary for recruits to admit errors, ask questions, and build resilient peer bonds before encountering hazardous real-world scenes.<\/p>\n The FIRE-B underwent rigorous empirical validation through a three-phase research program yielding robust content, construct, and criterion-related validity evidence:<\/p>\n Content validity was established in Study I<\/strong> via a qualitative exploratory study of subject-matter experts (N<\/em> = 21, including career and volunteer recruits, certified instructors, and fire school directors). Utilizing the Critical Incident Technique<\/a> (CIT; Flanagan, 1954) combined with open-ended exploratory probes regarding effective training characteristics, researchers conducted structured qualitative content analyses. This yielded eight fundamental training categories (Didactics, Motivation & Engagement, Personality, Contents & Methods, Structure & Organization, Materials & Premises, Group, and Goal Attainment), directly informing the initial 51-item pool. Subject-matter panels affirmed that every core operational aspect of basic responder training was adequately represented<\/span>.<\/p>\n Construct validity was demonstrated across Study II<\/strong> (N<\/em> = 257) and Study III<\/strong> (N<\/em> = 451). In Study II, exploratory factor analyses (EFA) on the preliminary 51-item pool guided psychometric pruning down to 30 items across six theoretical factors. In Study III, confirmatory factor analyses (CFA) cross-validated the refined 29-item instrument on an independent cohort of career (Brandmeister<\/em>) and voluntary (Truppmann<\/em>\/Truppf\u00fchrer<\/em>) candidates. The hypothesized six-factor model exhibited superior structural fit compared to competing unidimensional and hierarchical models, confirming that the six dimensions represent distinct yet correlated facets of training quality<\/span>.<\/p>\n Convergent validity was evaluated by correlating the FIRE-B subscales with established academic teaching evaluation tools adapted from higher education (e.g., FEVOR, TRIL, MFE scales) and leadership emergency evaluation scales (FIRE; Schulte & Thielsch). Subscales displayed strong, theoretically aligned bivariate correlations with global training evaluations:<\/p>\n Across validation samples, the FIRE-B exhibited exemplary internal consistency metrics. Psychometric assessments conducted during Study II (N<\/em> = 257) and confirmed in Study III (N<\/em> = 451) revealed scale reliability estimates well exceeding conventional psychometric thresholds for applied organizational diagnostics<\/span> ($\u0007lpha, \\omega ge .70$<\/span>):<\/p>\n The dimensionality of the FIRE-B was evaluated through a sequential exploratory and confirmatory factor analytic strategy across two independent responder samples:<\/p>\n In Study II (N<\/em> = 257; 229 males, 26 females, 2 unspecified; mean age 25.75, SD<\/em> = 6.48; 37% career fire service, 63% volunteer fire service), the preliminary 51-item instrument was subjected to an exploratory factor analysis (EFA; Principal Axis Factoring with oblique rotation [Promax], reflecting anticipated latent correlations among instructional facets). Missing values (0.5% of total cells, occurring primarily due to the non-applicable response option) were imputed via the Expectation-Maximization (EM) algorithm<\/span>.<\/p>\n Eigenvalue scree tests, parallel analysis, and factor interpretability converged on a clear six-factor architecture. Items demonstrating cross-loadings ($> .30$<\/span> on non-target factors), low primary factor loadings ($< .40$<\/span>), or poor item distributions were pruned. This resulted in an optimized 30-item operational version showing clean primary loadings and meaningful theoretical coherence.<\/p>\n In Study III (N<\/em> = 451; 414 males, 37 females; mean age 34.02, SD<\/em> = 9.92; encompassing career recruit training [24%], volunteer Truppmann<\/em> [19%], volunteer Truppf\u00fchrer<\/em> [33%], and other district-level courses [24%]), the factor structure was tested using maximum likelihood structural equation modeling. One item was eliminated due to marginal statistical contribution, producing the final 29-item primary inventory across six latent dimensions<\/span>.<\/p>\n The postulated six-factor model exhibited solid goodness-of-fit indices: the comparative fit index (CFI) and Tucker-Lewis index (TLI) approached or surpassed .90\/.95 thresholds, with acceptable root mean square error of approximation (RMSEA $le .06$<\/span>) and standardized root mean square residual (SRMR $le .06$<\/span>). Standardized factor loadings across all 29 items loaded substantially on their respective target factors (predominantly ranging from .60 to .88, all $p < .001$<\/span>), supporting the multidimensional construct definition.<\/p>\n The FIRE-B is a standardized, self-administered survey inventory available in digital (web-based) and paper-and-pencil formats.<\/p>\n The FIRE-B was developed and finalized between 2017 and 2018<\/strong> through research conducted at the University of M\u00fcnster in collaboration with the Institut der Feuerwehr NRW. The empirical foundation was documented in master's theses and research monographs by Streppel (2018) and Kl\u00e4pker (2018), building upon the leadership evaluation instrument FIRE (Schulte & Thielsch).<\/p>\n The instrument is published as an open-access scientific diagnostic tool for public, municipal, and non-commercial educational and research applications within public safety organizations, voluntary fire brigades, professional fire departments, and emergency service academies. No licensing fees or royalties are charged for non-commercial institutional evaluations, provided proper scientific attribution is maintained. Commercial assessment distributors or proprietary consulting vendors wishing to incorporate the instrument into paid commercial platforms must seek explicit permission from the original developers at the University of M\u00fcnster.<\/p>\n , A. (2015). Evaluation von F\u00fchrungskr\u00e4ftetrainings: Pilotierung eines Fragebogens<\/em> [Unpublished master's thesis]. University of M\u00fcnster, Germany.<\/p>\n<\/li>\n Response Scale (Items 1\u201329 & Optional Items 30\u201331):<\/strong><\/p>\n Siebenstufiges Antwortformat mit den Optionen 1 = stimme gar nicht zu, 2 = stimme nicht zu, 3 = stimme eher nicht zu, 4 = neutral, 5 = stimme eher zu, 6 = stimme zu, 7 = stimme vollkommen zu. Ein zus\u00e4tzliches Feld bietet die M\u00f6glichkeit anzugeben, dass das jeweilige Item nicht sinnvoll zu beantworten sei<\/span>.<\/p>\n2. Keywords<\/h2>\n
3. Authors<\/h2>\n
\n
4. Purpose<\/h2>\n
\n
5. Psychological Construct<\/h2>\n
1. Structure & Didactics (Struktur & Didaktik<\/em>)<\/h3>\n
2. Support & Encouragement (Unterst\u00fctzung & F\u00f6rderung<\/em>)<\/h3>\n
3. Group Dynamics & Cohesion (Gruppe<\/em>)<\/h3>\n
4. Practical Training Realism (Praxis<\/em>)<\/h3>\n
5. Materials & Facilities (Material & R\u00e4umlichkeiten<\/em>)<\/h3>\n
6. Competence Acquisition (Kompetenzerwerb<\/em>)<\/h3>\n
6. Theoretical Framework<\/h2>\n
Kirkpatrick's Hierarchical Evaluation Taxonomy<\/h3>\n
Cognitive Load and Dual-Processing in Tactical Training<\/h3>\n
Sociotechnical Systems and High-Reliability Organizing<\/h3>\n
7. Validity<\/h2>\n
Content Validity<\/h3>\n
Construct and Structural Validity<\/h3>\n
Convergent and Criterion-Related Validity<\/h3>\n
\n
8. Reliability<\/h2>\n
\n
9. Factor Analysis<\/h2>\n
Exploratory Factor Analysis (Study II)<\/h3>\n
Confirmatory Factor Analysis (Study III)<\/h3>\n
10. Instrument \/ Measurement Tool<\/h2>\n
Structural Configuration<\/h3>\n
\n
\n
\n
Response Formats<\/h3>\n
\n
Scoring and Aggregation Instructions<\/h3>\n
\n
11. Permissions & Fee and Test Year<\/h2>\n
12. References<\/h2>\n
\n
13. Items of the Scale<\/h2>\n
Subskala 1: Struktur & Didaktik (Items 1\u20136)<\/h3>\n
\n
Subskala 2: Unterst\u00fctzung & F\u00f6rderung (Items 7\u201311)<\/h3>\n
\n
Subskala 3: Gruppe (Items 12\u201314)<\/h3>\n
\n
Subskala 4: Praxis (Items 15\u201317)<\/h3>\n
\n