Assessing teachers' educational knowledge: Construct specification and validation using mixed methods

Journal article


Linninger, Christina, Kunina-Habenicht, Olga, Emmenlauer, Simone, Dicke, Theresa, Schulze-Stocker, Franziska, Leutner, Detlev, Seidel, Tina, Terhart, Ewald and Kunter, Mareike. (2015) Assessing teachers' educational knowledge: Construct specification and validation using mixed methods. Zeitschrift fuer Entwicklungspsychologie und Paedagogische Psychologie. 47(2), pp. 72 - 83. https://doi.org/10.1026/0049-8637/a000126
AuthorsLinninger, Christina, Kunina-Habenicht, Olga, Emmenlauer, Simone, Dicke, Theresa, Schulze-Stocker, Franziska, Leutner, Detlev, Seidel, Tina, Terhart, Ewald and Kunter, Mareike
Abstract

This paper presents two studies adding validity evidence to the assessment of educational knowledge (EK) measured by a recently developed test. The first study compared the test scores of a large sample of graduates from academic teacher education with those of a sample of first-semester teacher students. Results indicate higher scores for graduates in the majority of the test’s six domains. Additionally, we gained validity evidence based on response processes by conducting 46 cognitive interviews in Study 2. Participants with different professional backgrounds stated their response strategies while taking the knowledge test. Among other results, analyses revealed that graduates and advanced students in teacher education were often familiar with item topics and solved items mostly by retrieving academic knowledge from memory. Overall, results add to previously gained evidence suggesting that test scores can be taken to measure EK mainly gained by university studies.

Year2015
JournalZeitschrift fuer Entwicklungspsychologie und Paedagogische Psychologie
Journal citation47 (2), pp. 72 - 83
ISSN0049-8637
Digital Object Identifier (DOI)https://doi.org/10.1026/0049-8637/a000126
Page range72 - 83
Research GroupInstitute for Positive Psychology and Education
Publisher's version
File Access Level
Controlled
Permalink -

https://acuresearchbank.acu.edu.au/item/8qy7y/assessing-teachers-educational-knowledge-construct-specification-and-validation-using-mixed-methods

Restricted files

Publisher's version

  • 16
    total views
  • 0
    total downloads
  • 1
    views this month
  • 0
    downloads this month
These values are for the period from 19th October 2020, when this repository was created.

Export as

Related outputs

A tale of two quests: The (almost) non-overlapping research literatures on students' evaluations of secondary-school and university teachers
Marsh, Herbert W., Dicke, Theresa and Pfeiffer, Mathew. (2019) A tale of two quests: The (almost) non-overlapping research literatures on students' evaluations of secondary-school and university teachers. Contemporary Educational Psychology. 58, pp. 1 - 18. https://doi.org/10.1016/j.cedpsych.2019.01.011
Job satisfaction of teachers and their principals in relation to climate and student achievement
Dicke, Theresa, Marsh, Herbert W., Parker, Philip D., Guo, Jiesi, Riley, Philip and Waldeyer, Julia. (2019) Job satisfaction of teachers and their principals in relation to climate and student achievement. Journal of Educational Psychology. 111(7), pp. 1 - 13. https://doi.org/10.1037/edu0000409
A systematic evaluation and comparison between Exploratory Structural Equation Modeling and Bayesian Structural Equation Modeling
Guo, Jiesi, Marsh, Herbert W., Parker, Philip D., Dicke, Theresa, Lüdtke, Oliver and Diallo, Thierno M. O.. (2019) A systematic evaluation and comparison between Exploratory Structural Equation Modeling and Bayesian Structural Equation Modeling. Structural Equation Modeling: A Multidisciplinary Journal. 26(4), pp. 529 - 556. https://doi.org/10.1080/10705511.2018.1554999
Countries, parental occupation, and girls' interest in science
Guo, Jiesi, Marsh, Herb, Parker, Philip D., Dicke, Theresa and Zanden, Brooke Van. (2019) Countries, parental occupation, and girls' interest in science. The Lancet. 393, pp. 6 - 8. https://doi.org/10.1016/S0140-6736(19)30210-7
The murky distinction between self-concept and self-efficacy: Beware of lurking jingle-jangle fallacies
Marsh, Herbert W., Pekrun, Reinhard, Parker, Philip D., Murayama, Kou, Guo, Jiesi, Dicke, Theresa and Arens, A. Katrin. (2019) The murky distinction between self-concept and self-efficacy: Beware of lurking jingle-jangle fallacies. Journal of Educational Psychology. 111(2), pp. 331 - 353. https://doi.org/10.1037/edu0000281
Cross-cultural generalizability of social and dimensional comparison effects on reading, math, and science self-concepts for primary school students using the combined PIRLS and TIMSS data
Guo, Jiesi, Marsh, Herbert W., Parker, Philip D. and Dicke, Theresa. (2018) Cross-cultural generalizability of social and dimensional comparison effects on reading, math, and science self-concepts for primary school students using the combined PIRLS and TIMSS data. Learning and Instruction. 58, pp. 210 - 219. https://doi.org/10.1016/j.learninstruc.2018.07.007
An integrated model of academic self-concept development: academic self-concept, grades, test scores, and tracking over 6 years
Marsh, Herbert W., Pekrun, Reinhard, Murayama, Kou, Arens, A. Katrin, Parker, Philip D., Guo, Jiesi and Dicke, Theresa. (2018) An integrated model of academic self-concept development: academic self-concept, grades, test scores, and tracking over 6 years. Developmental Psychology. 54(2), pp. 263 - 280. https://doi.org/10.1037/dev0000393
A longitudinal study of teachers' occupational well-being: Applying the job demands-resources model
Dicke, Theresa, Stebner, Ferdinand, Linninger, Christina, Kunter, Mareike and Leutner, Detlev. (2018) A longitudinal study of teachers' occupational well-being: Applying the job demands-resources model. Journal of Occupational Health Psychology. 23(2), pp. 262 - 277. https://doi.org/10.1037/ocp0000070
What to do when scalar invariance fails: The extended alignment method for multi-group factor analysis comparison of latent means across many groups
Marsh, Herbert W., Guo, Jiesi, Parker, Philip D., Nagengast, Benjamin, Asparouhov, T., Muthen, Bengt and Dicke, Theresa. (2018) What to do when scalar invariance fails: The extended alignment method for multi-group factor analysis comparison of latent means across many groups. Psychological Methods. 23(3), pp. 524 - 545. https://doi.org/10.1037/met0000113
Inequity and excellence in academic performance: evidence from 27 countries
Parker, Philip D., Marsh, Herbert W., Jerrim, John P., Guo, Jiesi and Dicke, Theresa. (2018) Inequity and excellence in academic performance: evidence from 27 countries. American Educational Research Journal. 55(4), pp. 836 - 858. https://doi.org/10.3102/0002831218760213
An information distortion model of social class differences in math self-concept, intrinsic value, and utility value
Parker, Phil, Marsh, Herb, Guo, Jiesi, Anders, Jake, Shure, Nikki and Dicke, Theresa. (2018) An information distortion model of social class differences in math self-concept, intrinsic value, and utility value. Journal of Educational Psychology. 110(3), pp. 445 - 463. https://doi.org/10.1037/edu0000215
Validating the Copenhagen Psychosocial Questionnaire (COPSOQ-II) Using Set-ESEM: identifying psychosocial risk factors in a sample of school principals
Dicke, Theresa, Marsh, Herbert W., Riley, Philip, Parker, Philip D., Guo, Jiesi and Horwood, Marcus. (2018) Validating the Copenhagen Psychosocial Questionnaire (COPSOQ-II) Using Set-ESEM: identifying psychosocial risk factors in a sample of school principals. Frontiers in Psychology. 9, pp. 1 - 17. https://doi.org/10.3389/fpsyg.2018.00584
Effects of school-average achievement on individual self-concept and achievement: Unmasking phantom effects masquerading as true compositional effects
Dicke, Theresa, Marsh, Herbert W., Parker, Philip D., Pekrun, Reinhard, Guo, Jiesi and Televantou, Ioulia. (2018) Effects of school-average achievement on individual self-concept and achievement: Unmasking phantom effects masquerading as true compositional effects. Journal of Educational Psychology. 110(8), pp. 1112 - 1126. https://doi.org/10.1037/edu0000259
Extending expectancy-value theory predictions of achievement and aspirations in science : Dimensional comparison processes and expectancy-by-value interactions
Guo, Jiesi, Marsh, Herbert W., Parker, Philip D., Morin, Alexandre J. S. and Dicke, Theresa. (2017) Extending expectancy-value theory predictions of achievement and aspirations in science : Dimensional comparison processes and expectancy-by-value interactions. Learning and Instruction. 49, pp. 81-91. https://doi.org/10.1016/j.learninstruc.2016.12.007
Long-term positive effects of repeating a year in school: Six-year longitudinal study of self-beliefs, anxiety, social relations, school grades, and test scores
Marsh, Herbert W., Parker, Philip D., Guo, Jiesi, Dicke, Theresa, Pekrun, Reinhard, Murayama, K. and Lichtenfeld, Stephanie. (2017) Long-term positive effects of repeating a year in school: Six-year longitudinal study of self-beliefs, anxiety, social relations, school grades, and test scores. Journal of Educational Psychology. 109(3), pp. 425 - 438. https://doi.org/10.1037/edu0000144
"Double reality shock" when becoming a teacher? The development and potential influencing factors of emotional exhaustion during teacher induction time, and after having worked as fully licensed teacher
Dicke, Theresa, Holzberger, Doris, Kunina-Habenicht, Olga, Linninger, Christina, Schulze-Stocker, Franziska, Seidel, Tina, Terhart, Ewald, Leutner, Detlev and Kunter, M.. (2016) "Double reality shock" when becoming a teacher? The development and potential influencing factors of emotional exhaustion during teacher induction time, and after having worked as fully licensed teacher. Psychologie in Erziehung und Unterricht. 63(4), pp. 244 - 257. https://doi.org/10.2378/peu2016.art20d
Temporal ordering effects of adolescent depression, relational aggression, and victimization over six waves: Fully latent reciprocal effects models
Marsh, Herbert Warren, Craven, Rhonda G., Parker, Phil D., Parada, Roberto H., Guo, Jiesi, Dicke, Theresa and Abduljabbar, Adel S.. (2016) Temporal ordering effects of adolescent depression, relational aggression, and victimization over six waves: Fully latent reciprocal effects models. Developmental Psychology. 52(12), pp. 1994 - 2009. https://doi.org/10.1037/dev0000241
"Double reality shock" when becoming a teacher? The development and potential influencing factors of emotional exhaustion during teacher induction time, and after having worked as fully licensed teacher
Dicke, Theresa, Holzberger, Doris, Kunina-Habenicht, Olga, Linninger, Christina, Schulze-Stocker, Franziska, Seidel, Tina, Terhart, Ewald, Leutner, Detlev and Kunter, Mareike. (2016) "Double reality shock" when becoming a teacher? The development and potential influencing factors of emotional exhaustion during teacher induction time, and after having worked as fully licensed teacher. Psychologie in Erziehung und Unterricht. 63(4), pp. 244 - 257. https://doi.org/10.2378/peu2016.art20d
Temporal ordering effects of adolescent depression, relational aggression, and victimization over six waves: Fully latent reciprocal effects models
Marsh, Herbert W., Craven, Rhonda, Parker, Phil, Parada, Roberto H., Guo, Jiesi, Dicke, Theresa and Abduljabbar, Adel S.. (2016) Temporal ordering effects of adolescent depression, relational aggression, and victimization over six waves: Fully latent reciprocal effects models. Developmental Psychology. 52(12), pp. 1994 - 2009. https://doi.org/10.1037/dev0000241
Pedagogical professional knowledge of teachers: Evaluation of the ProwiN-tests [Padagogisch-psychologisches Professionswissen von Lehrkraften: Evaluation des ProwiN-Tests]
Lenske, Gerlinde, Thillmann, Hubertina, Wirth, Joachim, Dicke, Theresa and Leutner, Detlev. (2015) Pedagogical professional knowledge of teachers: Evaluation of the ProwiN-tests [Padagogisch-psychologisches Professionswissen von Lehrkraften: Evaluation des ProwiN-Tests]. Zeitschrift fur Erziehungswissenschaft. 18(2), pp. 225 - 245. https://doi.org/10.1007/s11618-015-0627-5
Reducing reality shock: The effects of classroom management skills training on beginning teachers
Dicke, Theresa, Elling, Jill, Schmeck, Annett and Leutner, Detlev. (2015) Reducing reality shock: The effects of classroom management skills training on beginning teachers. Teaching and Teacher Education. 48(1), pp. 1 - 12. https://doi.org/10.1016/j.tate.2015.01.013
Beginning teachers' efficacy and emotional exhaustion : Latent changes, reciprocity, and the influence of professional knowledge
Dicke, Theresa, Parker, Philip D., Holzberger, Doris, Kunina-Habenicht, Olga, Kunter, Mareike and Leutner, Detlev. (2015) Beginning teachers' efficacy and emotional exhaustion : Latent changes, reciprocity, and the influence of professional knowledge. Contemporary Educational Psychology. 41, pp. 62 - 72. https://doi.org/10.1016/j.cedpsych.2014.11.003
Teachers' knowledge about psychology: Development and validation of a test measuring theoretical foundations for teaching and its relation to instructional behavior
Lohse-Bossenz, Hendrik, Kunina-Habenicht, Olga, Dicke, Theresa, Leutner, Detlev and Kunter, Mareike. (2015) Teachers' knowledge about psychology: Development and validation of a test measuring theoretical foundations for teaching and its relation to instructional behavior. Studies in Educational Evaluation. 44, pp. 36 - 49. https://doi.org/10.1016/j.stueduc.2015.01.001
Self-efficacy in classroom management, classroom disturbances, and emotional exhaustion: A moderated mediation analysis of teacher candidates
Dicke, Theresa, Parker, Phillip David, Marsh, Herbert Warren, Kunter, Mareike, Schmeck, Annett and Leutner, Detlev. (2014) Self-efficacy in classroom management, classroom disturbances, and emotional exhaustion: A moderated mediation analysis of teacher candidates. Journal of Educational Psychology. 106(2), pp. 569 - 583. https://doi.org/10.1037/a0035504
Occupational Well-being and Motivation of Those in the Helping Professions
Parker, Phil, Martin, Andrew J. and Dicke, Theresa. (2014) Occupational Well-being and Motivation of Those in the Helping Professions. In Encyclopedia of Quality of Life and Well-Being Research pp. 4461 - 4464 Springer.
Which educational topics are important for teacher training? - Results of a Delphi study [Welche bildungswissenschaftlichen inhalte sind wichtig in der lehrerbildung? Ergebnisse einer delphi-studie]
Kunina-Habenicht, Olga, Lohse-Bossenz, Hendrik, Kunter, Mareike, Dicke, Theresa, Forster, Doris, Gossling, Jill, Schulze-Stocker, Franziska, Schmeck, Annett, Baumert, Jurgen, Leutner, Detlev and Terhart, Ewald. (2012) Which educational topics are important for teacher training? - Results of a Delphi study [Welche bildungswissenschaftlichen inhalte sind wichtig in der lehrerbildung? Ergebnisse einer delphi-studie]. Zeitschrift fur Erziehungswissenschaft. 15(4), pp. 649 - 682. https://doi.org/10.1007/s11618-012-0324-6