Estimating reliability statistics and measurement error variances using instrumental variables with longitudinal data

Journal article


Goldstein, Harvey, Haynes, Michele, Leckie, George and Tran, Phuong. (2020). Estimating reliability statistics and measurement error variances using instrumental variables with longitudinal data. Longitudinal and Life Course Studies. 11(3), pp. 289 - 306. https://doi.org/10.1332/175795920X15844303873216
AuthorsGoldstein, Harvey, Haynes, Michele, Leckie, George and Tran, Phuong
Abstract

The presence of randomly distributed measurement errors in scale scores such as those used in educational and behavioural assessments implies that careful adjustments are required to statistical model estimation procedures if inferences are required for ‘true’ as opposed to ‘observed’ relationships. In many cases this requires the use of external values for ‘reliability’ statistics or ‘measurement error variances’ which may be provided by a test constructor or else inferred or estimated by the data analyst. Popular measures are those described as ‘internal consistency’ estimates and sometimes other measures based on data grouping. All such measures, however, make particular assumptions that may be questionable but are often not examined. In this paper we focus on scaled scores derived from aggregating a set of indicators, and set out a general methodological framework for exploring different ways of estimating reliability statistics and measurement error variances, critiquing certain approaches and suggesting more satisfactory methods in the presence of longitudinal data. In particular, we explore the assumption of local (conditional) item response independence and show how a failure of this assumption can lead to biased estimates in statistical models using scaled scores as explanatory variables. We illustrate our methods using a large longitudinal data set of mathematics test scores from Queensland, Australia.

Keywordsinstrumental variables; longitudinal data; reliability
Year2020
JournalLongitudinal and Life Course Studies
Journal citation11 (3), pp. 289 - 306
PublisherPolicy Press
ISSN1757-9597
Digital Object Identifier (DOI)https://doi.org/10.1332/175795920X15844303873216
Page range289 - 306
Research GroupInstitute for Learning Sciences and Teacher Education (ILSTE)
Publisher's version
File Access Level
Controlled
Place of publicationUnited Kingdom
Permalink -

https://acuresearchbank.acu.edu.au/item/8q952/estimating-reliability-statistics-and-measurement-error-variances-using-instrumental-variables-with-longitudinal-data

Restricted files

Publisher's version

  • 89
    total views
  • 0
    total downloads
  • 2
    views this month
  • 0
    downloads this month
These values are for the period from 19th October 2020, when this repository was created.

Export as

Related outputs

The role of language in the association between theory of mind and executive functioning in early childhood : New longitudinal evidence
Shahaeian, Ameneh, Haynes, Michele and Frick, Paul J.. (2023). The role of language in the association between theory of mind and executive functioning in early childhood : New longitudinal evidence. Early Childhood Research Quarterly. 62, pp. 251-258. https://doi.org/10.1016/j.ecresq.2022.09.003
Measurement of student attitudes to science and association with inquiry-based learning in regional schools
Haynes, Michele, Brown, Alinta, Nichols, Kim and Parveen Musofer, Reshma. (2023). Measurement of student attitudes to science and association with inquiry-based learning in regional schools. International Journal of Science Education. 45(8), pp. 593-612. https://doi.org/10.1080/09500693.2023.2168138
Professionalizing teacher education : Performance Assessment, Standards, Moderation, and Evidence
Wyatt-Smith, Claire Maree, Adie, Lenore Ellen, Haynes, Michele and Day, Chantelle. (2022). Professionalizing teacher education : Performance Assessment, Standards, Moderation, and Evidence Routledge. https://doi.org/10.4324/9780429318504
How to promote STEM competencies through design
Nichols, Kim, Musofer, Reshma and Haynes, Michele. (2022). How to promote STEM competencies through design. Frontiers in Education. 7, p. Article 982035. https://doi.org/10.3389/feduc.2022.982035
Does parenting moderate the association between adverse childhood experiences and adolescents’ future orientation?
Chainey, Carys, Burke, Kylie and Haynes, Michele. (2022). Does parenting moderate the association between adverse childhood experiences and adolescents’ future orientation? Journal of Child and Family Studies. 31(9), pp. 2359-2375. https://doi.org/10.1007/s10826-022-02275-4
Cross-cultural design and healthcare waiting rooms for indigenous people in regional Australia
Timothy O'Rourke, Daphne Nash, Michele Haynes, Meredith Burgess and Paul Memmott. (2022). Cross-cultural design and healthcare waiting rooms for indigenous people in regional Australia. Environment and Behavior. 54(1), pp. 89-115. https://doi.org/10.1177/0013916520952443
Innovation in methodology : Longitudinal analysis of progression in teacher preparation
Haynes, Michele and Smith, Andrew. (2021). Innovation in methodology : Longitudinal analysis of progression in teacher preparation. In In Wyatt-Smith, Claire, Adie, Lenore and Nuttall, Joce (Ed.). Teaching performance assessments as a cultural disruptor in initial teacher education : Standards, evidence and collaboration pp. 201-215 Springer Nature. https://doi.org/10.1007/978-981-16-3705-6_16
Not in Employment, Education or Training (NEET); more than a youth policy issue
Mitrou, Francis, Haynes, Michele, Perales, Francisco, Zubrick, Stephen and Baxter, Janeen. (2021). Not in Employment, Education or Training (NEET); more than a youth policy issue. International Journal of Population Data Science. 6(1), p. Article: 14. https://doi.org/10.23889/ijpds.v6i1.1676
Enhanced use of educational accountability data to monitor educational progress of Australian students with focus on Indigenous students
Cumming, Joy, Goldstein, Harvey and Hand, Kirstine. (2020). Enhanced use of educational accountability data to monitor educational progress of Australian students with focus on Indigenous students. Educational Assessment, Evaluation and Accountability. 32, pp. 29-51. https://doi.org/10.1007/s11092-019-09310-x
Analysing Sensitive Data from Dynamically-Generated Overlapping Contingency Tables
Joshua J. Bon, Bernard Baffour, Melanie Spallek and Michele Haynes. (2020). Analysing Sensitive Data from Dynamically-Generated Overlapping Contingency Tables. Journal of Official Statistics. 36(2), pp. 275-296. https://doi.org/10.2478/jos-2020-0015
Indigenous preferences for inpatient rooms in Australian hospitals: A mixed-methods study in cross-cultural design
Nash, Daphne, O'Rourke, Timothy, Memmott, Paul and Haynes, Michele. (2020). Indigenous preferences for inpatient rooms in Australian hospitals: A mixed-methods study in cross-cultural design. Health Environments Research and Design Journal. https://doi.org/10.1177/1937586720925552
The value of administrative data for longitudinal social research: A case study investigating income support receipt and relationship separation in Australia
Spallek, Melanie, Haynes, Michele, Baxter, Janeen and Kapelle, Nicole. (2020). The value of administrative data for longitudinal social research: A case study investigating income support receipt and relationship separation in Australia. International Journal of Social Research Methodology. 23(5), pp. 467 - 481. https://doi.org/10.1080/13645579.2019.1707984
Post-school transitions for children in out-of-home care: Evidence from the Australian Census Longitudinal Dataset
Spallek, Melanie and Haynes, Michele. (2020). Post-school transitions for children in out-of-home care: Evidence from the Australian Census Longitudinal Dataset. Journal of Youth Studies. https://doi.org/10.1080/13676261.2020.1781803
Order and timing of home ownership and fertility decisions in Australia
Spallek, Melanie and Haynes, Michele. (2019). Order and timing of home ownership and fertility decisions in Australia. Critical Housing Analysis. 6(1), pp. 9 - 21. https://doi.org/10.13060/23362839.2019.6.1.445
How are pain and traumatic stress symptoms related in acute whiplash-associated disorders? An investigation of the role of pain-related fear in a daily diary study
Eather, Adele, Kenardy, Justin, Healy, Karyn L., Haynes, Michele and Sterling, Michele. (2019). How are pain and traumatic stress symptoms related in acute whiplash-associated disorders? An investigation of the role of pain-related fear in a daily diary study. Pain. 160(9), pp. 1954 - 1966. https://doi.org/10.1097/j.pain.0000000000001581
Aboriginal and Torres Strait Islander preferences for healthcare settings: Effective use of design images in survey research
Haynes, Michele, O'Rourke, Timothy, Nash, Daphne, Baffour, Bernard, York, Sue, Chainey, Carys, Betros, Georgia and Memmott, Paul. (2019). Aboriginal and Torres Strait Islander preferences for healthcare settings: Effective use of design images in survey research. Australian Health Review. https://doi.org/10.1071/AH18196
Misspecification of multimodal random-effect distributions in logistic mixed models for panel survey data
Marquart, Louise and Haynes, Michele. (2019). Misspecification of multimodal random-effect distributions in logistic mixed models for panel survey data. Journal of the Royal Statistical Society Series A: Statistics in Society. 182(1), pp. 305 - 321. https://doi.org/10.1111/rssa.12385
Mindfulness-based intervention for educators: Effects of a school-based cluster randomized controlled study
Hwang, Yoon-Suk, Goldstein, Harvey, Medvedev, Oleg N., Singh, Nirbhay N., Noh, Jae-Eun and Hand, Kirstine Alicia. (2019). Mindfulness-based intervention for educators: Effects of a school-based cluster randomized controlled study. Mindfulness. 10(7), pp. 1417 - 1436. https://doi.org/10.1007/s12671-019-01147-1
A software package for the application of probabilistic anonymisation to sensitive individual-level data: A proof of principle with an example from the ALSPAC birth cohort study
Avraam, Demetris, Boyd, Andy, Goldstein, Harvey and Burton, Paul. (2018). A software package for the application of probabilistic anonymisation to sensitive individual-level data: A proof of principle with an example from the ALSPAC birth cohort study. Longitudinal and Life Course Studies. 9(4), pp. 433-446. https://doi.org/10.14301/llcs.v9i4.478
GUILD: guidance for information about linking data sets
Gilbert, Ruth, Lafferty, Rosemary, Hagger-Johnson, Gareth, Harron, Katie, Zhang, Li-Chun, Smith, Peter W.F., Dibben, Chris and Goldstein, Harvey. (2018). GUILD: guidance for information about linking data sets. Journal of Public Health. 40(1), pp. 191 - 198. https://doi.org/10.1093/pubmed/fdx037
Multilevel growth curve models that incorporate a random coefficient model for the level 1 variance function
Goldstein, Harvey, Leckie, George, Charlton, Christopher, Tilling, Kate and Browne, William J.. (2018). Multilevel growth curve models that incorporate a random coefficient model for the level 1 variance function. Statistical Methods in Medical Research. 27(11), pp. 3478 - 3491. https://doi.org/10.1177/0962280217706728
2018 Queensland NAPLAN review: School and system perceptions report and literature review
Cumming, Joy, Jackson, Christine, Day, Chantelle, Maxwell, Graham, Adie, Lenore, Lingard, Bob, Haynes, Michele and Heck, Elizabeth. (2018). 2018 Queensland NAPLAN review: School and system perceptions report and literature review Australia: Institute for Learning Sciences and Teacher Education, Australian Catholic University.
Bayesian models for weighted data with missing values: a bootstrap approach
Goldstein, Harvey, Carpenter, James and Kenward, Michael G.. (2018). Bayesian models for weighted data with missing values: a bootstrap approach. Journal of the Royal Statistical Society Series C: Applied Statistics. 67(4), pp. 1071 - 1081. https://doi.org/10.1111/rssc.12259
A guide to evaluating linkage quality for the analysis of linked data
Harron, Katie, Doidge, James C., Knight, Hannah E., Gilbert, Ruth, Goldstein, Harvey, Cromwell, David A. and van der Meulen, Jan H.. (2017). A guide to evaluating linkage quality for the analysis of linked data. International Journal of Epidemiology. 46(5), pp. 1699 - 1710. https://doi.org/10.1093/ije/dyx177
A Bayesian model for measurement and misclassification errors alongside missing data, with an application to higher education participation in Australia
Goldstein, Harvey, Browne, William J. and Charlton, Christopher. (2017). A Bayesian model for measurement and misclassification errors alongside missing data, with an application to higher education participation in Australia. Journal of Applied Statistics. 45(5), pp. 918 - 931. https://doi.org/10.1080/02664763.2017.1322558
Probabilistic linkage to enhance deterministic algorithms and reduce data linkage errors in hospital administrative data
Hagger-Johnson, Gareth, Harron, Katie, Goldstein, Harvey, Aldridge, Rob and Gilbert, Ruth. (2017). Probabilistic linkage to enhance deterministic algorithms and reduce data linkage errors in hospital administrative data. Journal of Innovation in Health Informatics. 24(2), pp. 234 - 246. https://doi.org/10.14236/jhi.v24i2.891
A scaling approach to record linkage
Goldstein, Harvey, Harron, Katie and Cortina-Borja, Mario. (2017). A scaling approach to record linkage. Statistics in Medicine. 36(16), pp. 2514 - 2521. https://doi.org/10.1002/sim.7287
From bench to curbside: considering the role of simulations in scaling-up justice interventions
Mazerolle, Lorraine, Baxter, Janeen, Cobb-Clark, Deborah, Haynes, Michele, Lawrence, David and Western, Mark. (2017). From bench to curbside: considering the role of simulations in scaling-up justice interventions. Criminology and Public Policy. 16(2), pp. 501 - 510. https://doi.org/10.1111/1745-9133.12287
Utilising identifier error variation in linkage of large administrative data sources
Harron, Katie, Hagger-Johnson, Gareth, Gilbert, Ruth and Goldstein, Harvey. (2017). Utilising identifier error variation in linkage of large administrative data sources. BMC Medical Research Methodology. 17(1), pp. 1 - 9. https://doi.org/10.1186/s12874-017-0306-8
Challenges in administrative data linkage for research
Harron, Katie, Dibben, Chris, Boyd, James, Hjern, Anders, Azimaee, Mahmoud, Barreto, Mauricio L. and Goldstein, Harvey. (2017). Challenges in administrative data linkage for research. Big Data and Society. 4(2), pp. 1 - 12. https://doi.org/10.1177/2053951717745678
Integrating area-based and national samples in birth cohort studies: the case of life study
Goldstein, Harvey, Sera, Francesco, Elias, Peter and Dezateux, Carol. (2017). Integrating area-based and national samples in birth cohort studies: the case of life study. Longitudinal and Life Course Studies. 8(3), pp. 281 - 289. https://doi.org/10.14301/llcs.v8i3.439
Including mobile-only telephone users in a statewide preventive health survey-differences in the prevalence of health risk factors and impact on trends
Baffour, Bernard, Roselli, Tim, Haynes, Michele, Bon, Joshua J., Western, Mark and Clemens, Susan. (2017). Including mobile-only telephone users in a statewide preventive health survey-differences in the prevalence of health risk factors and impact on trends United States of Amercia: Elsevier Inc.. https://doi.org/10.1016/j.pmedr.2017.05.009
The evolution of school league tables in England 1992-2016: 'contextual value-added’, ‘expected progress’ and ‘progress 8’
Leckie, George and Goldstein, Harvey. (2017). The evolution of school league tables in England 1992-2016: 'contextual value-added’, ‘expected progress’ and ‘progress 8’. British Educational Research Journal. 43(2), pp. 193 - 212. https://doi.org/10.1002/berj.3264
Parents' interest in their child's education and children's outcomes in adolescence and adulthood: does gender matter?
Campbell, Alice K., Povey, Jenny, Hancock, Kirsten J., Mitrou, Francis and Haynes, Michele. (2017). Parents' interest in their child's education and children's outcomes in adolescence and adulthood: does gender matter? International Journal of Educational Research. 85, pp. 131 - 147. https://doi.org/10.1016/j.ijer.2017.07.010
Drivers of household income distribution dynamics in the Philippines
Martinez, Arturo, Western, Mark, Tomaszewski, Wojtek, Haynes, Michele, Manalo, Maria K. and Sebastian, Iva. (2016). Drivers of household income distribution dynamics in the Philippines. Philippine Statistician. 65(1), pp. 53 - 84.
Engaging parents in schools and building parent-school partnerships: the role of school and parent organisation leadership
Povey, Jenny, Campbell, Alice K., Willis, Linda D., Haynes, Michele, Western, Mark, Bennett, Sarah, Antrobus, Emma and Pedde, Charley. (2016). Engaging parents in schools and building parent-school partnerships: the role of school and parent organisation leadership. International Journal of Educational Research. 79, pp. 128 - 141. https://doi.org/10.1016/j.ijer.2016.07.005
Handling attrition and non-response in longitudinal data with an application to a study of Australian youth
Cumming, Jacqueline Joy and Goldstein, Harvey. (2016). Handling attrition and non-response in longitudinal data with an application to a study of Australian youth. Longitudinal and Life Course Studies. 7(1), pp. 53 - 63. https://doi.org/10.14301/llcs.v7i1.342
Record linkage
Goldstein, Harvey and Harron, Katie. (2016). Record linkage. In In K. Harron, H. Goldstein and C. Dibben (Ed.). Methodological developments in data linkage John Wiley & Sons.
Trends in examination performance and exposure to standardised tests in England and Wales
Goldstein, Harvey and Leckie, George. (2016). Trends in examination performance and exposure to standardised tests in England and Wales. British Educational Research Journal. 42(3), pp. 367 - 375. https://doi.org/10.1002/berj.3220
Weighting strategies for combining data from dual-frame telephone surveys: emerging evidence from Australia
Baffour, Bernard, Haynes, Michele, Western, Mark, Pennay, D. W., Misson, Sebastian and Martinez, Arturo. (2016). Weighting strategies for combining data from dual-frame telephone surveys: emerging evidence from Australia. Journal of Official Statistics. 32(3), pp. 549 - 578. https://doi.org/10.1515/JOS-2016-0029
Profiling the mobile-only population in Australia: insights from the Australian national health survey
Baffour, Bernard, Haynes, Michele, Dinsdale, Shane, Western, Mark and Pennay, D. W.. (2016). Profiling the mobile-only population in Australia: insights from the Australian national health survey. Australian and New Zealand Journal of Public Health. 40(5), pp. 443 - 447. https://doi.org/10.1111/1753-6405.12549
Interviewer effects on non-response propensity in longitudinal surveys : A multilevel modelling approach
Vassallo, Rebecca, Durrant, Gabriele, Smith, Peter and Goldstein, Harvey. (2015). Interviewer effects on non-response propensity in longitudinal surveys : A multilevel modelling approach. Royal Statistical Society. Journal. Series A: Statistics in Society. 178(1), pp. 83 - 99. https://doi.org/10.1111/rssa.12049
A multilevel modelling approach to measuring changing patterns of ethnic composition and segregation among London secondary schools, 2001-2010
Leckie, George and Goldstein, Harvey. (2015). A multilevel modelling approach to measuring changing patterns of ethnic composition and segregation among London secondary schools, 2001-2010. Royal Statistical Society. Journal. Series A: Statistics in Society. 178(2), pp. 405 - 424. https://doi.org/10.1111/rssa.12066
Validity, science and educational measurement
Goldstein, Harvey. (2015). Validity, science and educational measurement. Assessment in Education: Principles, Policy & Practice. 22(2), pp. 193 - 201. https://doi.org/10.1080/0969594X.2015.1015402
Population sampling in longitudinal surveys
Goldstein, Harvey, Lynn, Peter, Muniz-terrera, Graciela, Hardy, Rebecca, O'Muircheartaigh, Colm, Skinner, Chris and Lehtonen, Risto. (2015). Population sampling in longitudinal surveys. Longitudinal and Life Course Studies (online). 6(4), pp. 447 - 452. https://doi.org/10.14301/llcs.v6i4.345
After the RCT : Who comes to a family-based intervention for childhood overweight or obesity when it is implemented at scale in the community?
Fagg, James, Cole, Tim, Cummins, Steven, Goldstein, Harvey, Morris, Stephen, Radley, Duncan, Sacher, Paul and Law, Catherine. (2015). After the RCT : Who comes to a family-based intervention for childhood overweight or obesity when it is implemented at scale in the community? Journal of Epidemiology and Community Health. 69(2), pp. 142 - 148. https://doi.org/10.1136/jech-2014-204155
Data linkage errors in hospital administrative data when applying a pseudonymisation algorithm to paediatric intensive care records
Hagger-Johnson, Gareth, Harron, Katie, Fleming, Tom, Gilbert, Ruth, Goldstein, Harvey, Landy, Rebecca and Parslow, Roger. (2015). Data linkage errors in hospital administrative data when applying a pseudonymisation algorithm to paediatric intensive care records. BMJ Open. 5(8), pp. 1 - 8. https://doi.org/10.1136/bmjopen-2015-008118
Identifying possible false matches in anonymized hospital administrative data without patient identifiers
Hagger-Johnson, Gareth, Harron, Katie, Gonzallez-Izquierdo, Arturo, Cortina-Borja, Mario, Dattani, Nirupa, Muller-Pebody, Berit, Parslow, Roger, Gilbert, Ruth and Goldstein, Harvey. (2015). Identifying possible false matches in anonymized hospital administrative data without patient identifiers. Health Services Research. 50(4), pp. 1162 - 1178. https://doi.org/10.1111/1475-6773.12272
How income segmentation affects income mobility: Evidence from panel data in the Philippines
Martinez, Arturo, Western, Mark, Haynes, Michele and Tomaszewski, Wojtek. (2015). How income segmentation affects income mobility: Evidence from panel data in the Philippines. Asia and the Pacific Policy Studies. 2(3), pp. 590 - 608. https://doi.org/10.1002/app5.96
Time on housework and selection into and out of relationships in Australia: A multiprocess, multilevel approach
Haynes, Michele, Baxter, Janeen, Hewitt, Belinda and Western, Mark. (2015). Time on housework and selection into and out of relationships in Australia: A multiprocess, multilevel approach. Longitudinal and Life Course Studies. 6(3), pp. 245 - 263. https://doi.org/10.14301/llcs.v6i3.303
Life satisfaction and retirement in Australia: A longitudinal approach
Heybroek, Lachlan, Haynes, Michele and Baxter, Janeen. (2015). Life satisfaction and retirement in Australia: A longitudinal approach. Work, Aging and Retirement. 1(2), pp. 166 - 180. https://doi.org/10.1093/workar/wav006
Multiple job holding and income mobility in Indonesia
Martinez, Arturo, Western, Mark, Haynes, Michele, Tomaszewski, Wojtek and Macarayan, Erlyn. (2014). Multiple job holding and income mobility in Indonesia. Research in Social Stratification and Mobility: a research annual. 37, pp. 91 - 104. https://doi.org/10.1016/j.rssm.2013.09.008
Evaluating bias due to data linkage error in electronic healthcare records
Harron, Katie, Wade, Angie, Gilbert, Ruth, Muller-Pebody, Berit and Goldstein, Harvey. (2014). Evaluating bias due to data linkage error in electronic healthcare records. BMC Medical Research Methodology. 14(1), pp. 1 - 10. https://doi.org/10.1186/1471-2288-14-36
Fitting multilevel multivariate models with missing data in responses and covariates that may include interactions and non-linear terms
Goldstein, Harvey, Carpenter, James and Browne, William. (2014). Fitting multilevel multivariate models with missing data in responses and covariates that may include interactions and non-linear terms. Journal of the Royal Statistical Society Series A: Statistics in Society. 177(2), pp. 553 - 564. https://doi.org/10.1111/rssa.12022
Effect of health insurance on the utilisation of allied health services by people with chronic disease: A systematic review and meta-analysis
Skinner, Elizabeth H., Foster, Michele, Mitchell, Geoffrey, Haynes, Michele, O'Flaherty, Martin and Haines, Terry. (2014). Effect of health insurance on the utilisation of allied health services by people with chronic disease: A systematic review and meta-analysis. Australian Journal of Primary Health. 20(1), pp. 9 - 19. https://doi.org/10.1071/PY13092
Panel attrition : How important is interviewer continuity?
Lynn, Peter, Kaminska, Olena and Goldstein, Harvey. (2014). Panel attrition : How important is interviewer continuity? Journal of Official Statistics. 30(3), pp. 443 - 457. https://doi.org/10.2478/JOS-2014-0028
Using league table rankings in public policy formation : Statistical issues
Goldstein, Harvey. (2014). Using league table rankings in public policy formation : Statistical issues. Annual Review of Statistics and Its Application. 1, pp. 385 - 399.
Modelling survival and mortality risk to 15 years of age for a national cohort of children with serious congenital heart defects diagnosed in infancy
Knowles, Rachel L., Bull, Catherine, Wren, Christopher, Wade, Angela, Goldstein, Harvey and Dezateux, Carol. (2014). Modelling survival and mortality risk to 15 years of age for a national cohort of children with serious congenital heart defects diagnosed in infancy. PLoS ONE. 9(8), pp. 1 - 15. https://doi.org/10.1371/journal.pone.0106806
Holistic housing pathways for Australian families through the childbearing years
Spallek, Melanie, Haynes, Michele and Jones, Andrew. (2014). Holistic housing pathways for Australian families through the childbearing years. Longitudinal and Life Course Studies. 5(2), pp. 205 - 226. https://doi.org/10.14301/llcs.v5i2.276
From trial to population: A study of a family-based community intervention for childhood overweight implemented at scale
Fagg, James, Chadwick, P., Cole, Tim, Cummins, Steven, Goldstein, Harvey, Lewis, H., Morris, Sue, Radley, Duncan, Sacher, Paul and Law, Catherine. (2014). From trial to population: A study of a family-based community intervention for childhood overweight implemented at scale. International Journal of Obesity. 38(10), pp. 1343 - 1349. https://doi.org/10.1038/ijo.2014.103
Primary students' scientific reasoning and discourse during cooperative inquiry-based science activities
Gillies, Robyn, Nichols, Kim, Burgh, Gilbert and Haynes, Michele. (2014). Primary students' scientific reasoning and discourse during cooperative inquiry-based science activities. International Journal of Educational Research. 63, pp. 127 - 140. https://doi.org/10.1016/j.ijer.2013.01.001
Using league table rankings in public policy formation: Statistical issues
Goldstein, Harvey. (2014). Using league table rankings in public policy formation: Statistical issues. Annual Review of Statistics and Its Application. 1(1), pp. 385 - 399. https://doi.org/10.1146/annurev-Statistics-022513-115615
Knowledge and numbers in education
Goldstein, Harvey and Moss, Gemma. (2014). Knowledge and numbers in education. Comparative Education. 50(3), pp. 259 - 265. https://doi.org/10.1080/14681366.2014.926138
Is there income mobility in the Philippines?
Martinez, Arturo, Western, Mark, Haynes, Michele and Tomaszewski, Wojtek. (2014). Is there income mobility in the Philippines? Asian-Pacific Economic Literature. 28(1), pp. 96 - 115. https://doi.org/10.1111/apel.12047
Adjusting for differential misclassification in multilevel models: The relationship between child exposure to smoke and cognitive development
Ferrao, Maria and Goldstein, Harvey. (2014). Adjusting for differential misclassification in multilevel models: The relationship between child exposure to smoke and cognitive development. Quality and Quantity (Print). 48(1), pp. 251 - 258. https://doi.org/10.1007/s11135-012-9765-5
Effect of a group intervention to promote older adults' adjustment to driving cessation on community mobility: a randomized controlled trial
Liddle, Jacki, Haynes, Michele, Pachana, Nancy A., Mitchell, Geoffrey, McKenna, Kryss and Gustafsson, Louise. (2013). Effect of a group intervention to promote older adults' adjustment to driving cessation on community mobility: a randomized controlled trial. Gerontologist. 54(3), pp. 409 - 422. https://doi.org/10.1093/geront/gnt019
University mission creep? Comparing EU and US faculty views of university involvement in regional economic development and commercialization
Goldstein, Harvey, Bergman, Edward M. and Maier, Gunther. (2013). University mission creep? Comparing EU and US faculty views of university involvement in regional economic development and commercialization. The Annals of Regional Science. 50(2), pp. 453 - 477. https://doi.org/10.1007/s00168-012-0513-5
Change and stability in ethnic diversity across urban communities: explicating the influence of social cohesion on perceptions of disorder
Zahnow, Renee, Wickes, Rebecca, Haynes, Michele and Mazerolle, Lorraine. (2013). Change and stability in ethnic diversity across urban communities: explicating the influence of social cohesion on perceptions of disorder. Australian and New Zealand Journal of Criminology. 46(3), pp. 335 - 356. https://doi.org/10.1177/0004865813486903
Evaluating educational changes: A statistical perspective
Goldstein, Harvey. (2013). Evaluating educational changes: A statistical perspective. Ensaio: Avaliacao e Politicas Publicas em Educacao. 21(78), pp. 101 - 114. https://doi.org/10.1590/S0104-40362013005000002
Relationship dissolution and time on housework
Hewitt, Belinda, Haynes, Michele and Baxter, Janeen. (2013). Relationship dissolution and time on housework. Journal of Comparative Family Studies. 44(3), pp. 327 - 340.
Goal setting and self-efficacy among delinquent, at-risk and not at-risk adolescents
Carroll, Annemaree, Gordon, Kellie, Haynes, Michele and Houghton, Steve. (2013). Goal setting and self-efficacy among delinquent, at-risk and not at-risk adolescents. Journal of Youth and Adolescence. 42(3), pp. 431 - 443. https://doi.org/10.1007/s10964-012-9799-y
Health for all? Patterns and predictors of allied health service use in Australia
Foster, Michele, O'Flaherty, Martin, Haynes, Michele, Mitchell, Geoffrey and Haines, Terry. (2013). Health for all? Patterns and predictors of allied health service use in Australia. Australian Health Review. 37(3), pp. 389 - 396. https://doi.org/10.1071/AH12040
Linkage, Evaluation and Analysis of National Electronic Healthcare Data : Application to Providing Enhanced Blood-Stream Infection Surveillance in Paediatric Intensive Care
Harron, Katie, Goldstein, Harvey, Wade, Angie, Muller-Pebody, Berit, Parslow, Roger and Gilbert, Ruth. (2013). Linkage, Evaluation and Analysis of National Electronic Healthcare Data : Application to Providing Enhanced Blood-Stream Infection Surveillance in Paediatric Intensive Care. PLoS ONE. 8(12), pp. 1 - 11. https://doi.org/10.1371/journal.pone.0085278
Linkage, evaluation and analysis of National Electronic Healthcare Data : Application to providing enhanced blood-stream infection surveillance in paediatric intensive care
Harron, Katie, Goldstein, Harvey, Wade, Angie, Muller-Pebody, Berit, Goldstein, Harvey, Parslow, Roger and Gilbert, Ruth. (2013). Linkage, evaluation and analysis of National Electronic Healthcare Data : Application to providing enhanced blood-stream infection surveillance in paediatric intensive care. PLoS One (online). 8(12), pp. 1 - 11. https://doi.org/10.1007/s00134-013-2841-z
Risk-adjusted monitoring of blood-stream infection in paediatric intensive care : A data linkage study
Harron, Katie, Wade, Angie, Muller-Pebody, Berit, Goldstein, Harvey, Parslow, Roger, Gray, Jim, Hartley, John, Mok, Quen and Gilbert, Ruth. (2013). Risk-adjusted monitoring of blood-stream infection in paediatric intensive care : A data linkage study. Intensive Care Medicine. 39(6), pp. 1080 - 1087. https://doi.org/10.1007/s00134-013-2841-z
Transitioning to the new economy: Individual, regional and intermediation influences on workforce retraining outcomes
Goldstein, H. A., Lowe, N. and Donegan, M.. (2012). Transitioning to the new economy: Individual, regional and intermediation influences on workforce retraining outcomes. Regional Studies. 46(1), pp. 105 - 118. https://doi.org/10.1080/00343404.2010.486786
The effects of two strategic and meta-cognitive questioning approaches on children's explanatory behaviour, problem-solving, and learning during cooperative, inquiry-based science
Gillies, Robyn, Nichols, Kim, Burgh, Gilbert and Haynes, Michele. (2012). The effects of two strategic and meta-cognitive questioning approaches on children's explanatory behaviour, problem-solving, and learning during cooperative, inquiry-based science. International Journal of Educational Research. 53, pp. 93 - 106. https://doi.org/10.1016/j.ijer.2012.02.003
Individual and environmental characteristics associated with cognitive development in down syndrome: a longitudinal study
Couzens, Donna, Haynes, Michele and Cuskelly, Monica. (2012). Individual and environmental characteristics associated with cognitive development in down syndrome: a longitudinal study. Journal of Applied Research in Intellectual Disabilities. 25(5), pp. 396 - 413. https://doi.org/10.1111/j.1468-3148.2011.00673.x
Mid-aged adults' sitting time in three contexts
Burton, Nicola W., Haynes, Michele, van Uffelen, Jannique G. Z., Brown, Wendy J. and Turrell, Gavin. (2012). Mid-aged adults' sitting time in three contexts. American Journal of Preventive Medicine. 42(4), pp. 363 - 373. https://doi.org/10.1016/j.amepre.2011.11.012
Francis Galton, measurement, psychometrics and social progress
Goldstein, Harvey. (2012). Francis Galton, measurement, psychometrics and social progress. Assessment in Education: Principles, Policy & Practice. 19(2), pp. 147 - 158. https://doi.org/10.1080/0969594X.2011.614220
The quality of planning scholarship and doctoral education
Goldstein, Harvey A.. (2012). The quality of planning scholarship and doctoral education. Journal of Planning Education and Research. 32(4), pp. 493 - 496. https://doi.org/10.1177/0739456X12449484
Multilevel Modeling of Social Segregation
Leckie, George, Pillinger, Rebecca, Jones, Kelvyn and Goldstein, Harvey. (2012). Multilevel Modeling of Social Segregation. Journal of Educational and Behavioral Statistics. 37(1), pp. 3 - 30. https://doi.org/10.3102/1076998610394367
The analysis of record-linked data using multiple imputation with data value priors
Goldstein, Harvey, Harron, Katie and Wade, Angie. (2012). The analysis of record-linked data using multiple imputation with data value priors. Statistics in Medicine. 31(28), pp. 3481 - 3493. https://doi.org/10.1002/sim.5508
Time use differences in activity participation among children 4-5 years old with and without the risk of developing conduct problems
Yu, Mong L., Ziviani, Jenny, Baxter, Janeen and Haynes, Michele. (2012). Time use differences in activity participation among children 4-5 years old with and without the risk of developing conduct problems. Research in Developmental Disabilities. 33(2), pp. 490 - 498. https://doi.org/10.1016/j.ridd.2011.10.013
Measuring success: League tables in the public sector
Foley, Beth and Goldstein, Harvey. (2012). Measuring success: League tables in the public sector London, United Kingdom: The British Academy.
REALCOM-IMPUTE Software for Multilevel Multiple Imputation with Mixed Response Types
Carpenter, James, Goldstein, Harvey and Kenward, Michael. (2011). REALCOM-IMPUTE Software for Multilevel Multiple Imputation with Mixed Response Types. Journal of Statistical Software. 45(5), pp. 1 - 14.
A note on 'The limitations of school league tables to inform school choice'
Leckie, George and Goldstein, Harvey. (2011). A note on 'The limitations of school league tables to inform school choice'. Journal of the Royal Statistical Society Series A: Statistics in Society. 174(3), pp. 833 - 836. https://doi.org/10.1111/j.1467-985X.2010.00688.x
Estimating research performance by using research grant award gradings
Goldstein, Harvey. (2011). Estimating research performance by using research grant award gradings. Journal of the Royal Statistical Society Series A: Statistics in Society. 174(1), pp. 83 - 93. https://doi.org/10.1111/j.1467-985X.2010.00657.x
Increasing explanatory behaviour, problem-solving, and reasoning within classes using cooperative group work
Gillies, Robyn and Haynes, Michele. (2011). Increasing explanatory behaviour, problem-solving, and reasoning within classes using cooperative group work. Instructional Science. 39(3), pp. 349 - 366. https://doi.org/10.1007/s11251-010-9130-9
Cognitive development and down syndrome: Age-related change on the Stanford-Binet test (fourth edition)
Couzens, Donna, Cuskelly, Monica and Haynes, Michele. (2011). Cognitive development and down syndrome: Age-related change on the Stanford-Binet test (fourth edition). American Journal on Intellectual and Developmental Disabilities. 116(3), pp. 181 - 204. https://doi.org/10.1352/1944-7558-116.3.181
Understanding uncertainty in school league tables
Leckie, George and Goldstein, Harvey. (2011). Understanding uncertainty in school league tables. Fiscal Studies. 32(2), pp. 207 - 224. https://doi.org/10.1111/j.1475-5890.2011.00133.x
Patchwork intermediation: Challenges and opportunities for regionally coordinated workforce development
Lowe, Nichola, Goldstein, Harvey and Donegan, Mary. (2011). Patchwork intermediation: Challenges and opportunities for regionally coordinated workforce development. Economic Development Quarterly: the journal of American economic revitalization. 25(2), pp. 158 - 171. https://doi.org/10.1177/0891242410383413
Sleep, structured and social time use and young Australian children's physical activity
Yu, Mong L., Ziviani, Jenny and Haynes, Michele. (2011). Sleep, structured and social time use and young Australian children's physical activity. Health Promotion Journal of Australia. 22(3), pp. 203 - 209.
Pupil composition and accountability: An analysis in English primary schools
Kounali, Daphne, Robinson, Anthony, Lauder, Hugh and Goldstein, Harvey. (2010). Pupil composition and accountability: An analysis in English primary schools. International Journal of Educational Research. 49(2-3), pp. 49 - 68. https://doi.org/10.1016/j.ijer.2010.08.001
MCMC sampling for a multilevel model with nonindependent residuals within and between cluster units
Browne, William and Goldstein, Harvey. (2010). MCMC sampling for a multilevel model with nonindependent residuals within and between cluster units. Journal of Educational and Behavioral Statistics. 35(4), pp. 453 - 473. https://doi.org/10.3102/1076998609359788
Pupil composition and accountability: An analysis in English primary schools
Lauder, Hugh, Kounali, Daphne, Robinson, Anthony and Goldstein, Harvey. (2010). Pupil composition and accountability: An analysis in English primary schools. International Journal of Educational Research. 45(2-3), pp. 49 - 68. https://doi.org/10.1016/j.ijer.2010.08.001
Statistical modelling of repeated measurement data
Goldstein, Harvey. (2010). Statistical modelling of repeated measurement data. Longitudinal and Life Course Studies. 1(2), pp. 170 - 185. https://doi.org/10.14301/llcs.v1i2.67
Handling attrition and non-response in longitudinal data
Goldstein, Harvey. (2009). Handling attrition and non-response in longitudinal data. Longitudinal and Life Course Studies.
Multilevel multivariate modelling of childhood growth, numbers of growth measurements and adult characteristics
Goldstein, Harvey and Kounali, Daphne. (2009). Multilevel multivariate modelling of childhood growth, numbers of growth measurements and adult characteristics. Royal Statistical Society. Journal. Series A: Statistics in Society.
Multilevel models with multivariate mixed response types
Goldstein, Harvey, Carpenter, James R., Kenward, Michael G. and Levin, Kate A.. (2009). Multilevel models with multivariate mixed response types. Statistical Modelling.
Comment peut-on utiliser les etudes comparatives internationales pour doter les politiques educatives d'information fiables?
Goldstein, Harvey. (2009). Comment peut-on utiliser les etudes comparatives internationales pour doter les politiques educatives d'information fiables? Revue Francaise de Pedagogie.
Comment: Citation Statistics
Goldstein, Harvey and Spiegelhalter, David. (2009). Comment: Citation Statistics. Statistical Science.
The limitations of using school league tables to inform school choice
Leckie, George and Goldstein, Harvey. (2009). The limitations of using school league tables to inform school choice. Royal Statistical Society. Journal. Series A: Statistics in Society.
Evidence and education policy - some reflections and allegations
Goldstein, Harvey. (2008). Evidence and education policy - some reflections and allegations. Cambridge Journal of Education.
Adjusting for measurement error in the value added model: evidence from Portugal
Ferrao, Maria Eugenia and Goldstein, Harvey. (2008). Adjusting for measurement error in the value added model: evidence from Portugal. Quality and Quantity. 43, pp. 951 - 963. https://doi.org/10.1007/s11135-008-9171-1
Review of 'Monitoring Educational Achievement'
Goldstein, Harvey. (2008). Review of 'Monitoring Educational Achievement'. International Journal of Educational Development.
Modelling measurement errors and category misclassifications in multilevel models
Goldstein, Harvey, Kounali, Daphne and Robinson, Anthony. (2008). Modelling measurement errors and category misclassifications in multilevel models. Statistical Modelling.
School league tables: what can they really tell us?
Goldstein, Harvey. (2008). School league tables: what can they really tell us? Significance.
The effects of year repetition (redoublement) on the progress of pupils in the first three years of French schooling
Goldstein, Harvey. (2008). The effects of year repetition (redoublement) on the progress of pupils in the first three years of French schooling.
Techniques for Monitoring the Comparability of Examination Standards
Goldstein, Harvey. (2007). Techniques for Monitoring the Comparability of Examination Standards Qualifications and Curriculum Authority.