Reliability between online raters with varying familiarities of a region: microscale audit of pedestrian streetscapes (MAPS)

Journal article


Zhu, Wenfei, Sun, Yuliang, Kurka, Jonathan, Geremia, Carrie M., Engelberg, Jessa K., Cain, Kelli, Conway, Terry, Sallis, Jim, Hooker, Steven P. and Adams, Marc A.. (2017). Reliability between online raters with varying familiarities of a region: microscale audit of pedestrian streetscapes (MAPS). Landscape and Urban Planning. 167, pp. 240 - 248. https://doi.org/10.1016/j.landurbplan.2017.06.014
AuthorsZhu, Wenfei, Sun, Yuliang, Kurka, Jonathan, Geremia, Carrie M., Engelberg, Jessa K., Cain, Kelli, Conway, Terry, Sallis, Jim, Hooker, Steven P. and Adams, Marc A.
Abstract

Background To test inter-rater reliability of the online Microscale Audit of Pedestrian Streetscapes (MAPS) tool between raters with varying familiarities of Phoenix, Arizona. Methods The online MAPS tool, based on the MAPS in-field audit tool and scoring system, was used for audits. Sixty route pairs, 141 segment pairs, and 92 crossing pairs in Phoenix were included. Each route, segment or crossing was audited by two independent raters: one rater in Phoenix and the other in San Diego, California, respectively. Item, subscale scores, and total scores reliability analyses were computed using Kappa or intra-class correlation coefficient (ICC). Results The route overall score had substantial reliability (ICC: 0.832). Of the route subscale and overall scores, sixteen out of twenty had moderate to substantial reliability (ICC: 0.616–0.906), and the four subscales had fair reliability (ICC: 0.409–0.563). Sixteen out of twenty scores in segment and crossing sections demonstrated fair to substantial reliability (ICC: 0.448–0.897), and the remaining four had slight reliability (ICC: 0.348–0.364). Conclusions Most of the online MAPS items, subscales, and overall scores demonstrated fair to substantial reliability between raters with varied familiarities of the Phoenix area. Results support use of online MAPS to measure microscale elements of the built environment by raters unfamiliar with a region.

Year2017
JournalLandscape and Urban Planning
Journal citation167, pp. 240 - 248
PublisherElsevier B.V.
ISSN0169-2046
Digital Object Identifier (DOI)https://doi.org/10.1016/j.landurbplan.2017.06.014
Scopus EID2-s2.0-85026847663
Page range240 - 248
Research GroupMary MacKillop Institute for Health Research
Publisher's version
File Access Level
Controlled
Place of publicationNetherlands
EditorsJ. I. Nassauer
Permalink -

https://acuresearchbank.acu.edu.au/item/8942v/reliability-between-online-raters-with-varying-familiarities-of-a-region-microscale-audit-of-pedestrian-streetscapes-maps

Restricted files

Publisher's version

  • 89
    total views
  • 0
    total downloads
  • 3
    views this month
  • 0
    downloads this month
These values are for the period from 19th October 2020, when this repository was created.

Export as