The Principal Evaluation Instrument (PEI)<\/strong> is a specialized psychometric and evaluative measurement system developed by Dr. Edward J. Condon, III (2009)<\/a> at Loyola University Chicago. Formulated during an era of intensifying accountability under the No Child Left Behind Act, the instrument assesses both the methodological architectures used by school districts to evaluate public school principals and the perceived effectiveness of those evaluations in achieving organizational, professional, and student performance objectives. The instrument is constructed across two quantitative structural matrices complemented by a four-item qualitative inquiry protocol. The first matrix consists of 10 items measuring the frequency and extent to which specific evaluative methodologies\u2014such as supervisor observations, narrative self-evaluations, data-based metrics, stakeholder perception surveys, and portfolio reviews\u2014are deployed in the formal appraisal of school leadership. The second matrix consists of 11 items measuring the degree to which principals perceive their formal evaluation as successfully fulfilling key institutional and developmental objectives, ranging from district accountability compliance and substandard performance remediation to instructional program support, professional growth, and student achievement gains.<\/p>\n Both quantitative matrices utilize a 7-point Likert-type response scale ranging from 1 (Not At All<\/em>) to 7 (Very Much<\/em>), yielding composite domain scores from 10 to 70 for evaluative methods and 11 to 77 for perceived objective attainment. Across its initial validation sample of 130 public elementary and middle school principals ($K\\text{\u2013}8$<\/span>) across DuPage, Will, and Lake Counties in Illinois, the instrument demonstrated solid psychometric properties. Matrix 1 (Evaluative Methods) achieved a Cronbach\u2019s alpha internal consistency coefficient of $\\alpha = 0.70$<\/span>, while Matrix 2 (Perceived Objectives) exhibited high internal consistency at $\\alpha = 0.88$<\/span>. Inter-rater reliability for the accompanying open-ended qualitative responses was secured using Cohen\u2019s Kappa coefficient of agreement<\/a>. Content validity was established via a three-phase sequence encompassing doctoral expert panel review, pre-testing, and pilot testing among non-participating school leaders with identical demographic and professional profiles. The PEI provides educational researchers, district superintendents, and psychometricians with an empirically validated diagnostic framework to investigate the alignment between administrative appraisal mechanics and instructional leadership efficacy.<\/p>\n Principal Evaluation Instrument, school leadership appraisal, educational accountability, instructional leadership, psychometrics, educational administration, performance appraisal systems, teacher leadership, student achievement, Cronbach\u2019s alpha, Condon<\/p>\n The Principal Evaluation Instrument was designed, developed, and empirically validated by Edward J. Condon, III, Ph.D.<\/strong> The instrument formed the empirical cornerstone of his doctoral dissertation titled “Principal evaluation and student achievement: A study of public elementary schools in Du-Page, Will, and Lake Counties, Illinois”<\/em>, submitted to the School of Education at Loyola University Chicago<\/a> in 2009.<\/p>\n Dr. Condon is a career educator and administrative leader in the state of Illinois, having served extensively as an elementary school principal, central office administrator, and superintendent of schools (notably serving as Superintendent of River Forest Public Schools District 90). His scholarship sits at the intersection of educational policy, instructional accountability, supervisory appraisal, and organizational leadership in primary and secondary education. Inquiries regarding archival access to the foundational research may be directed through the institutional repository of Loyola University Chicago (Loyola e-Commons, School of Education Dissertations).<\/p>\n The fundamental purpose of the Principal Evaluation Instrument (PEI) is to systematically capture, quantify, and analyze the operational disconnect between the structural practices used in administrator evaluation and the functional outcomes those evaluations are ostensibly designed to produce. For decades, educational administration literature has underscored a chronic systemic challenge: while the role of the building principal has evolved from a transactional school manager into a transformational instructional leader directly tasked with elevating student academic performance, the evaluation models utilized by school districts have historically lagged behind, relying on perfunctory checklists, informal observations, and compliance-driven narrative summaries.<\/p>\n The PEI was designed to fulfill three primary research and operational objectives:<\/p>\n In applied organizational contexts, the PEI serves as a strategic diagnostic audit tool for boards of education, state educational agencies, and district superintendents seeking to redesign their administrative performance management systems. By measuring the variance between evaluative inputs and leadership development outputs, the tool exposes structural inefficiencies, identifies unmet professional development needs, and guides the creation of appraisal systems that actively foster pedagogical excellence and institutional accountability.<\/p>\n The Principal Evaluation Instrument operationalizes performance appraisal not merely as a technical administrative process, but as a complex socio-cognitive and psychological construct situated within organizational psychology and educational leadership theory. The instrument measures administrative perception across two distinct yet interconnected latent domains, supplemented by qualitative cognitive frameworks.<\/p>\n This dimension operationalizes the structural operationalization of performance measurement. Evaluative methodologies in educational organizations reflect how an organization collects behavioral, artifactual, and outcome-oriented data regarding an executive’s leadership performance. This construct is broken down into ten discrete measurement vectors:<\/p>\n The second dimension measures the psychological perception of system efficacy\u2014specifically, whether performance appraisal is perceived as possessing functional utility across two competing organizational paradigms:<\/p>\n The qualitative component of the construct taps into the internal attribution systems of school leaders. By evaluating how principals describe the relationship between supervisory feedback and their personal self-efficacy, professional identity, and perceived influence over classroom-level instruction, the open-ended items capture the nuanced psychological impact of accountability systems on administrative morale and professional commitment.<\/p>\n The Principal Evaluation Instrument is grounded in a synthesis of classical and contemporary organizational, behavioral, and educational leadership theories.<\/p>\n $$\\text{Appraisal Methods} long\\rightarrow \\text{Perceived Objective Utility} long\\rightarrow \\text{Leadership Efficacy} long\\rightarrow \\text{Pupil Performance}$$<\/span><\/p>\n Originating in institutional economics and organizational sociology (Jensen & Meckling, 1976<\/a>), Principal-Agent Theory<\/a> posits that organizational dynamics are characterized by asymmetric information between the governing body\/superintendent (the principal) and the building-level administrator (the agent). The agent possesses superior ground-level operational insight into daily school realities, creating administrative uncertainty. Within the PEI framework, the first matrix conceptualizes evaluation mechanisms (such as supervisory checklists, data-based reviews, and 360-degree surveys) as information-gathering instruments designed to mitigate agency costs, verify goal alignment, and ensure compliance with district mandates.<\/p>\n Drawing on the foundational educational evaluation work of Michael Scriven (1967)<\/a>, personnel appraisal operates across two historically conflicting paradigms. Summative evaluation<\/em> focuses on managerial accountability, certification, employment retention, and the formal documentation of substandard performance. In contrast, formative evaluation<\/em> is developmental, diagnostic, and oriented toward continuous professional improvement. The PEI integrates this dichotomy into Matrix 2, evaluating whether educational leadership evaluations successfully transition from sterile summative compliance rituals into dynamic formative growth processes capable of enhancing instructional leadership.<\/p>\n According to Locke and Latham’s (1990, 2002) Goal-Setting Theory<\/a>, performance is optimized when individuals are confronted with specific, challenging, and quantifiable goals accompanied by timely, actionable, and construct-aligned feedback. In the PEI, the alignment between data-based evaluation methods and the perceived capacity to increase standardized assessment scores directly reflects goal-setting dynamics. If appraisal feedback is perceived as vague, infrequent, or purely anecdotal, goal commitment falters and leadership motivation is diminished.<\/p>\n The PEI relies heavily on the instructional leadership models formulated by Hallinger and Murphy (1985)<\/a> and refined by Leithwood et al. (2004). These frameworks demonstrate that school principals rarely influence pupil achievement directly; rather, their influence is mediated through indirect pathways\u2014specifically by establishing an orderly school climate, buffering teachers from extraneous distractions, allocating instructional resources, and organizing targeted professional development. The PEI captures these indirect pathways within Matrix 2 items targeting school climate enhancement, instructional program maintenance, and pupil achievement gains.<\/p>\n The psychometric validity of the Principal Evaluation Instrument was established through a structured multi-phase methodological validation procedure conducted during its development and initial empirical deployment.<\/p>\n Content validity was confirmed through a rigorous three-step methodological approach designed to ensure construct representation and domain clarity:<\/p>\n In Dr. Condon\u2019s initial empirical investigation of 130 public elementary and middle school principals in DuPage, Will, and Lake Counties, Illinois, construct validity was evaluated through correlation analyses between perceived evaluation objectives and actual student achievement metrics. Using Pearson product-moment correlation coefficients ($r$<\/span>), the researcher examined the relationship between principals\u2019 perceptions of evaluation utility and their schools’ performance on the Illinois Standards Achievement Test (ISAT)<\/a>.<\/p>\n The analyses revealed statistically significant positive correlations between systematic evaluation methods (specifically data-based evaluation and stakeholder perception feedback) and specific ISAT performance benchmarks, confirming the criterion-related and concurrent validity of the instrument. Furthermore, distributional analyses demonstrated normal parameter distributions across both matrices, with skewness and kurtosis indices falling well within acceptable psychometric thresholds (between $-1.0$<\/span> and $+1.0$<\/span>), demonstrating the scale’s sensitivity across diverse administrative settings.<\/p>\n The Principal Evaluation Instrument demonstrates strong internal consistency and measurement reliability across its quantitative and qualitative components.<\/p>\n Internal consistency for the two quantitative matrices was evaluated using Cronbach\u2019s alpha coefficient ($\\alpha$<\/span>)<\/a> based on the sample of 130 public school principals:<\/p>\n The qualitative dimension of the PEI consists of four open-ended questions targeting principal beliefs regarding performance appraisal, professional growth, and student achievement. To quantify the reliability of the narrative coding procedures, independent raters systematically evaluated qualitative response themes using a standardized categorical rubric. Inter-rater reliability was established using Cohen\u2019s Kappa coefficient of agreement ($kappa$<\/span>)<\/a>. The resulting Kappa values exceeded accepted methodological thresholds ($kappa > 0.75$<\/span>), demonstrating robust inter-coder agreement and minimizing researcher bias in the qualitative analyses.<\/p>\n The conceptual formulation of the Principal Evaluation Instrument suggests a distinct latent dimensionality across both structural matrices.<\/p>\n Matrix 1 evaluates the frequency and intensity of evaluative tools used in principal appraisals. Exploratory factor analyses conducted on comparable administrative evaluation matrices typically yield a three-factor solution:<\/p>\n Matrix 2 measures the perceived purposes achieved through the evaluation process. Factor analytic modeling reveals a clear bifactorial or two-factor latent structure:<\/p>\n Model fit indices from confirmatory factor frameworks applied to these educational leadership appraisal domains generally confirm satisfactory structural validity ($\\text{CFI} > 0.90$<\/span>, $text{RMSEA} < 0.08$), supporting the theoretical independence of administrative compliance from authentic leadership capacity-building.<\/p>\n The Principal Evaluation Instrument is a structured, multidimensional self-report inventory combined with an open-ended qualitative inquiry protocol. Below are its formal structural parameters:<\/p>\n The Principal Evaluation Instrument was developed and published in 2009<\/strong> as part of doctoral research at Loyola University Chicago by Dr. Edward J. Condon, III. The instrument is protected under standard academic copyright, with intellectual property rights held by the author and Loyola University Chicago.<\/p>\n Usage Permissions & Licensing:<\/strong> For non-commercial scholarly research, institutional research, doctoral dissertations, and district-level programmatic self-studies, the instrument may generally be adapted and utilized under fair-use principles, provided that formal academic citation is rendered to Dr. Condon\u2019s foundational 2009 dissertation. Commercial reproduction, inclusion in paid psychometric software platforms, or large-scale commercial publishing requires explicit written permission from the author. Researchers seeking permission or archival materials may consult the institutional repository of Loyola University Chicago (Loyola e-Commons) or contact the author via institutional channels.<\/p>\n The following scholarly works provide the empirical, theoretical, and methodological foundation for the Principal Evaluation Instrument:<\/p>\n The Principal Evaluation Instrument (PEI), developed by Dr. Edward J. Condon, III (2009), is a psychometric and diagnostic measurement scale designed to assess the methods and perceived objectives of school principal performance appraisals.<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","template":"","categories":[55,13,2],"tags":[725,25646,25834,6,25876,25963],"class_list":["post-8727","psych_scale","type-psych_scale","status-publish","hentry","category-educational-psychology","category-organizational-psychology","category-psychometrics","tag-educational-leadership","tag-performance-appraisal","tag-principal-evaluation","tag-psychometrics","tag-school-administration","tag-student-achievement"],"_links":{"self":[{"href":"https:\/\/ashadocs.org\/index.php?rest_route=\/wp\/v2\/psych_scale\/8727","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ashadocs.org\/index.php?rest_route=\/wp\/v2\/psych_scale"}],"about":[{"href":"https:\/\/ashadocs.org\/index.php?rest_route=\/wp\/v2\/types\/psych_scale"}],"author":[{"embeddable":true,"href":"https:\/\/ashadocs.org\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/ashadocs.org\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=8727"}],"version-history":[{"count":0,"href":"https:\/\/ashadocs.org\/index.php?rest_route=\/wp\/v2\/psych_scale\/8727\/revisions"}],"wp:attachment":[{"href":"https:\/\/ashadocs.org\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=8727"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ashadocs.org\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=8727"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ashadocs.org\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=8727"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}Keywords<\/h2>\n
Authors<\/h2>\n
Purpose<\/h2>\n
\n
Psychological Construct<\/h2>\n
1. Evaluative Methodological Architecture (Construct Domain I)<\/h3>\n
\n
2. Functional and Teleological Objective Attainment (Construct Domain II)<\/h3>\n
\n
3. Qualitative Cognitive Belief Systems<\/h3>\n
Theoretical Framework<\/h2>\n
1. Principal-Agent Theory<\/h3>\n
2. Formative vs. Summative Performance Evaluation Theory<\/h3>\n
3. Goal-Setting Theory<\/h3>\n
4. Instructional Leadership and Indirect Effects Models<\/h3>\n
Validity<\/h2>\n
Content Validity<\/h3>\n
\n
Construct and Criterion-Related Validity<\/h3>\n
Reliability<\/h2>\n
Internal Consistency Reliability<\/h3>\n
\n
Inter-Rater Reliability for Qualitative Protocols<\/h3>\n
Factor Analysis<\/h2>\n
Matrix 1: Methodological Sources of Evaluative Data<\/h3>\n
\n
Matrix 2: Teleological Objectives of Evaluation<\/h3>\n
\n
Instrument \/ Measurement Tool<\/h2>\n
\n
\n
\n
\n
\n
Permissions & Fee and Test Year<\/h2>\n
References<\/h2>\n
\n
13. Items of the Scale (Questionnaire)<\/h2>\n