The Measure of Original Thinking in Elementary School (MOTES)<\/strong> (Acar et al., 2024<\/a>) represents a significant advancement in computational psychometrics and educational assessment, specifically designed to capture the latent construct of original thinking in young learners. Traditional divergent thinking assessments have long faced psychometric and logistical constraints, including confounding fluency effects, labor-intensive manual scoring, and developmental mismatches when administered to pediatric cohorts. Developed to overcome these systemic challenges, MOTES is a computerized, gamified testing battery comprising 24 open-ended items distributed evenly across three distinct task subscales: Uses<\/em> (8 items), Examples<\/em> (8 items), and Sentences<\/em> (8 items). The assessment prompts elementary school children to produce unique, creative responses within interactive digital environments, which can subsequently be evaluated through both expert human ratings and advanced automated natural language processing (NLP) pipelines. Psychometric validation on diverse samples of elementary students across the United States demonstrates exceptional structural and internal consistency reliability, yielding maximal reliability coefficients (Hancock\u2019s H<\/em>) of 0.82 for Uses, 0.85 for Examples, 0.88 for Sentences, and 0.89 for a general higher-order Originality factor (McDonald\u2019s $\\omega = .87$<\/span>). Automated artificial intelligence scoring algorithms demonstrated high convergence with trained human raters, displaying correlations ranging from $r = .79$<\/span> to $.91$<\/span>. Confirmatory factor analyses support a hierarchical model wherein individual task performance loads onto respective domain facets, which in turn define a overarching original thinking latent trait. MOTES demonstrates robust external and criterion validity through significant correlations with established divergent thinking metrics\u2014notably the Torrance Tests of Creative Thinking<\/a> (TTCT)\u2014and standardized academic performance in mathematics and reading (Measures of Academic Progress; MAP). This assessment provides educators and researchers with a reliable, ecologically valid, and scalable methodology for diagnosing creative potential, evaluating instructional interventions, and cultivating 21st-century cognitive capacities in primary education.<\/p>\n Measure of Original Thinking in Elementary School, MOTES, Divergent Thinking, Originality, Computational Psychometrics, Automated Creativity Scoring, Elementary Education, Natural Language Processing, Latent Semantic Analysis, Differential Item Functioning, Torrance Tests of Creative Thinking<\/p>\n The Measure of Original Thinking in Elementary School was conceptualized, designed, and psychometrically validated through a collaborative cross-institutional research initiative by leading scholars in educational psychology, psychometrics, and computational linguistics:<\/p>\n The primary purpose of the Measure of Original Thinking in Elementary School (MOTES) is to provide an empirically grounded, developmentally calibrated, and computationally scalable assessment of creative ideation in children between the ages of 6 and 12 years (grades 1 through 6). The cultivation of creativity and divergent thinking has emerged as an indispensable educational priority in the 21st century. Despite universal acknowledgment of its importance, systematic assessment of creative ideation in young populations has been fundamentally hindered by the limitations of legacy psychometric instruments. Historical measures\u2014such as the classic Torrance Tests of Creative Thinking (TTCT)<\/a> or the Alternative Uses Task (AUT)<\/a>\u2014were predominantly designed for older children, adolescents, or adults, requiring extensive text-generation capacities, open-ended narrative writing, and protracted manual scoring procedures that introduce severe human rater fatigue and subjective bias.<\/p>\n MOTES resolves these long-standing operational bottlenecks by merging modern computational psychometrics with child-centered human-computer interaction principles. Specifically, MOTES addresses four central theoretical, clinical, and pedagogical needs:<\/p>\n The psychological construct evaluated by MOTES is Original Thinking<\/strong>, conceptualized as a primary sub-component of divergent thinking<\/a> and broader human creativity<\/a>. Historically defined by J.P. Guilford and E. Paul Torrance, original thinking denotes the mental operation of producing responses, cognitive representations, or associations that are statistically infrequent within a reference population, conceptually novel, and contextually appropriate. In MOTES, original thinking is operationalized not merely as idiosyncratic or bizarre responding, but as meaningful semantic divergence\u2014the cognitive capacity to navigate away from dominant, high-frequency mental schemas to retrieve, combine, and synthesize distant associative nodes in semantic memory.<\/p>\n To comprehensively sample the multifaceted expressions of original thinking across verbal and cognitive domains in childhood, MOTES bifurcates the overarching originality construct into three distinct task dimensions:<\/p>\n The Uses<\/em> subscale represents a developmentally adapted variation of the Alternative Uses Task. In this dimension, children are presented with common everyday objects (such as an empty tin can, a wooden pencil, or a plastic bucket) and prompted to devise clever, unusual, and highly original functions for the item beyond its intended conventional utility. Cognitively, this subscale captures cognitive flexibility<\/em> and the suppression of functional fixedness<\/em>. An unoriginal response relies entirely on dominant affordances (e.g., using a bucket to hold water), representing a baseline associative retrieval. Conversely, a highly original response requires cognitive restructuring of the physical attributes of the object (e.g., turning the bucket upside down and drumming on it to create a percussive musical instrument, or decorating it with colored paper to use as a protective helmet in a space game). Performance reflects the child\u2019s ability to inhibit immediate semantic prepotencies and explore distant associative networks.<\/p>\n The Examples<\/em> subscale measures the generative breadth of a child\u2019s category retrieval mechanisms. Students are presented with an abstract or broad descriptive category (e.g., things that make noise, things that are round, or things that are soft) and instructed to name an example that nobody else in their grade would likely think of, while still genuinely satisfying the category constraints. Whereas everyday cognitive tasks prioritize prototypical exemplars (e.g., naming a dog or a cat when asked for animals), creative originality demands searching peripheral conceptual domains. For instance, in response to “things that are cold,” responding “ice cube” represents minimal cognitive search and low originality, whereas responding “the shadow side of the moon” or “an abandoned winter campfire” indicates expansive semantic search, metaphorical bridging, and elite original ideation.<\/p>\n The Sentences<\/em> subscale evaluates original thinking within structured linguistic synthesis. Children are provided with pairs or triads of seemingly unrelated, semantically distant stimulus words (e.g., “cloud” and “shoe”) and asked to construct a coherent, meaningful sentence that links the concepts in an imaginative manner. This dimension challenges the child\u2019s syntactical integration and narrative elaboration. A conventional, low-originality response attempts to resolve the tension through superficial juxtaposing (e.g., “I looked at a cloud while tying my shoe”). In contrast, an original response recombines the conceptual frameworks of the stimuli into an integrated metaphorical or narrative image (e.g., “The giant walked through the sky, leaving muddy shoe prints that floated away as thunder clouds”). The Sentences subscale bridges divergent ideation with integrative cognitive convergence.<\/p>\n The conceptual and psychometric architecture of MOTES is grounded in an integration of classical psychometric creativity paradigms, contemporary cognitive associative network theories, and computational psychometric models.<\/p>\n MOTES traces its lineage to the pioneering psychometric formulations of J.P. Guilford (1950, 1967)<\/a>, who formally distinguished between convergent production<\/em> (arriving at a single correct solution) and divergent production<\/em> (generating a multiplicity of possibilities from given information). Guilford posited that divergent production comprises fluency, flexibility, elaboration, and originality. E. Paul Torrance (1966, 1974)<\/a> operationalized these concepts into standardized testing batteries. However, contemporary psychometrics has revealed that Guilford and Torrance\u2019s classic composite scoring suffers from multicollinearity: fluency often accounts for upwards of 80% of the variance in originality scores due to response-counting artifacts. MOTES directly resolves this theoretical dilemma by decoupling originality from fluency through a constrained “best-idea” or single-response prompt format, ensuring that the latent factor reflects cognitive novelty rather than mere processing rate.<\/p>\n At the cognitive processing level, MOTES draws heavily upon Sarnoff Mednick\u2019s (1962)<\/a> Associative Theory of the Creative Process<\/em>. Mednick hypothesized that individual differences in original thinking are governed by the organization of associative hierarchies in long-term memory. Less original individuals possess steep associative hierarchies, characterized by a rapid exhaustion of stereotypical associations with few idiosyncratic connections. Highly original thinkers possess flatter, broader associative hierarchies, allowing associative activation to spread to semantically distant concepts. Modern neuro-cognitive models (e.g., Beaty et al., 2014) expand this framework by demonstrating that original ideation requires a dynamic interplay between the Default Mode Network<\/em> (responsible for spontaneous idea generation and episodic retrieval) and the Central Executive Network<\/em> (responsible for cognitive control, task maintenance, and the inhibition of obvious, prepotent exemplars). In MOTES, tasks explicitly demand executive control to reject first-order associations in pursuit of distant semantic nodes.<\/p>\n The theoretical underpinning of MOTES scoring is rooted in the Distributional Hypothesis<\/em> of linguistics (Harris, 1954; Firth, 1957<\/a>), which asserts that words occurring in similar linguistic contexts share similar semantic meanings. By projecting child-generated textual responses into high-dimensional semantic vector spaces (e.g., using continuous vector space models like Word2Vec, GloVe, or transformer embeddings), the semantic relatedness between the prompt stimulus and the child\u2019s response can be quantified geometrically using cosine similarity. The inverse of cosine similarity represents semantic distance<\/strong>. Computational psychometricians (e.g., Dumas, Organisciak, & Doherty, 2020) have demonstrated that semantic distance serves as a rigorous, objective proxy for original thinking, freeing creativity assessment from the historical subjectivity of human rater consensus.<\/p>\n The construct, convergent, discriminant, and criterion-related validity of the Measure of Original Thinking in Elementary School has been comprehensively evaluated across multiple empirical studies involving elementary student populations in the United States (Acar et al., 2024<\/a>).<\/p>\n Construct validity was established by correlating MOTES scores with established, gold-standard measures of creativity. Most notably, MOTES task performance showed statistically significant, robust positive correlations with the Torrance Tests of Creative Thinking\u2013Figural Form A<\/em> (TTCT; Torrance, 1998b). Specifically, MOTES significantly predicted the Originality<\/strong> criterion scores on the TTCT ($r \\approx .35$<\/span> to $.45, p < .001$<\/span>) as well as the Abstractness of Titles<\/strong> scale, which measures conceptual synthesis and verbal metaphorical transformation. This demonstrates that while MOTES is primarily a verbal-computational assessment, it taps into domain-general creative ideational processes that transcend task modality.<\/p>\n Furthermore, convergent validity was substantiated through structural equation modeling examining relationships between latent originality and standardized academic achievement assessed via the Measures of Academic Progress (MAP)<\/a>. MOTES exhibited substantial, statistically significant standardized path coefficients with:<\/p>\n These findings align with cognitive developmental theory, which indicates that creative original thinking requires robust verbal knowledge networks, working memory capacity, and abstract relational reasoning\u2014facets central to reading comprehension and mathematical problem-solving.<\/p>\n To ensure that MOTES does not merely measure elementary cognitive processing speed, mechanical typing speed, or non-cognitive self-perception, discriminant validity analyses were conducted. MOTES originality scores demonstrated weak and non-significant or trivial correlations with mechanical reading and typing speed<\/strong> ($r < .15$<\/span>), confirming that the tool measures cognitive divergence rather than physical fluency or reading velocity. Additionally, correlations between MOTES scores and children\u2019s self-rated creative originality<\/strong> (measured via Likert-type creative self-efficacy scales) were modest ($r \\approx .18$<\/span> to $.22$<\/span>), reflecting the well-documented psychometric discrepancy between perceived creative competence and objectively verified creative production in pediatric populations.<\/p>\n To evaluate measurement invariance across diverse demographic subgroups, item response theory (IRT) and logistic regression DIF procedures were executed across biological sex (male vs. female) and racial\/ethnic groups. While minor, statistically significant DIF was detected at the isolated item level ($p = .01$<\/span>), effect sizes were negligible ($R^2 \\Delta < .02$<\/span>), indicating that the overall MOTES composite and subscale scores provide equitable, unbiased assessments of creative potential across diverse student groups.<\/p>\n The reliability of MOTES has been rigorously established utilizing both modern structural equation modeling reliability coefficients and automated-to-human scoring concordance analyses.<\/p>\n Because traditional Cronbach’s alpha ($\u0007lpha$<\/span>) relies on tau-equivalence assumptions that are routinely violated in multi-faceted creativity tasks, Acar et al. (2024) evaluated internal consistency utilizing Hancock\u2019s $H$<\/span><\/strong> (maximal reliability coefficient) alongside McDonald\u2019s omega ($\\omega$<\/span>)<\/strong>:<\/p>\n These coefficients significantly surpass the established .80 threshold recommended for individual diagnostic assessments, confirming that the 24-item battery provides a tightly calibrated, psychometrically stable measurement instrument.<\/p>\n The manual evaluation of MOTES items was conducted by multiple independent, trained raters utilizing a standardized 1-to-5 holistic originality scoring rubric. Across human raters, the two-way random intraclass correlation coefficients (ICC) exceeded $.84$<\/span>, indicating exceptional consensus. Even more critically for large-scale educational psychometrics, automated computational scoring algorithms (leveraging vector semantic spaces) demonstrated exceptional concordance with expert human judgment:<\/p>\n These findings confirm that automated semantic distance modeling can reliably substitute for manual human ratings, ensuring objective, rapid, and low-cost deployment in institutional environments without sacrificing measurement fidelity.<\/p>\n The internal structural architecture of MOTES was examined using extensive exploratory and confirmatory factor analytic (CFA) protocols across iterative development cohorts.<\/p>\n The initial prototyping of MOTES comprised four experimental task types with 10 draft prompts each (40 total items). Following qualitative cognitive laboratories with elementary students (evaluating developmental comprehension, digital interface interaction, and cognitive fatigue) and expert panel validation involving elementary educators, school psychologists, and creativity theorists, 16 psychometrically underperforming or developmentally confusing items were pruned. One task type was eliminated due to excessive collinearity and high task complexity, resulting in the final 24-item, three-subscale structure.<\/p>\n Acar et al. (2024) tested competing structural models via CFA using robust maximum likelihood estimation (MLR) to account for slight non-normality in semantic distance distributions:<\/p>\n The higher-order model was ultimately retained by the authors on both theoretical and pragmatic grounds: it formally recognizes the distinct cognitive operations required by different prompt formats while simultaneously providing empirical justification for calculating a single, unified composite score representing a child\u2019s overall original thinking capacity. All 24 items demonstrated high and statistically significant standardized factor loadings onto their designated first-order factors (ranging from $lambda = .58$<\/span> to $.84, p < .001$<\/span>), with first-order factors exhibiting robust loadings onto the overarching Originality construct ($lambda > .80$<\/span>).<\/p>\n The Measure of Original Thinking in Elementary School is configured as a standardized, interactive, digital assessment platform. Its formal structural specifications are summarized below:<\/p>\n The Measure of Original Thinking in Elementary School was officially published in 2024<\/strong>. The empirical development, factor structure, and psychometric validation of the instrument were detailed in the Journal of Educational Psychology<\/em> (Acar et al., 2024<\/a>), published by the American Psychological Association (APA)<\/a>. The formal APA PsycTests database entry is indexed under DOI: 10.1037\/t91308-000<\/a>.<\/p>\n The underlying conceptual frameworks, item rubrics, and research methodologies are copyrighted by the original authors and the American Psychological Association. For legitimate non-commercial, academic, and scientific research endeavors, the instrument and scoring algorithms may be accessed by contacting the lead author (Dr. Selcuk Acar, University of North Texas) or via institutional access to the APA PsycTests repository. Commercial use, reproduction in digital learning management systems, or widespread institutional screening deployment requires formal written permission and appropriate licensing agreements from the copyright holders.<\/p>\n2. Keywords<\/h2>\n
3. Authors<\/h2>\n
\n
4. Purpose<\/h2>\n
\n
5. Psychological Construct<\/h2>\n
5.1. Uses (Alternative Conceptual Repurposing)<\/h3>\n
5.2. Examples (Conceptual Categorization and Instance Generation)<\/h3>\n
5.3. Sentences (Creative Synthesizing and Contextual Recombination)<\/h3>\n
6. Theoretical Framework<\/h2>\n
6.1. Guilford\u2019s Structure-of-Intellect and Torrance’s Psychometrics<\/h3>\n
6.2. Associative Theory of Creativity and Modern Executive Search<\/h3>\n
6.3. Computational Linguistics and Distributional Semantics<\/h3>\n
7. Validity<\/h2>\n
7.1. Construct and Convergent Validity<\/h3>\n
\n
7.2. Discriminant Validity<\/h3>\n
7.3. Differential Item Functioning (DIF)<\/h3>\n
8. Reliability<\/h2>\n
8.1. Internal Consistency and Maximal Reliability<\/h3>\n
\n
8.2. Inter-Rater Reliability and AI-Human Scoring Concordance<\/h3>\n
\n
9. Factor Analysis<\/h2>\n
9.1. Exploratory Phase and Cognitive Labs<\/h3>\n
9.2. Confirmatory Factor Analysis (CFA) Models<\/h3>\n
\n
10. Instrument \/ Measurement Tool<\/h2>\n
\n
\n
\n
\n
11. Permissions & Fee and Test Year<\/h2>\n
12. References<\/h2>\n
\n
13. Items of the Scale<\/h2>\n