Improving the translation of search strategies using the polyglot search translator : A randomized controlled trial

Journal article


Clark, Justin Michael, Sanders, Sharon, Carter, Matthew, Honeyman, David, Cleo, Gina, Auld, Yvonne, Booth, Debbie, Condron, Patrick, Dalais, Christine, Bateup, Sarah, Linthwaite, Bronwyn, May, Nikki, Munn, Jo, Ramsay, Lindy, Rickett, Kirsty, Rutter, Cameron, Smith, Angela, Sondergeld, Peter, Wallin, Margie, ... Beller, Elaine. (2020). Improving the translation of search strategies using the polyglot search translator : A randomized controlled trial. Journal of the Medical Library Association. 108(2), pp. 195-207. https://doi.org/10.5195/jmla.2020.834
AuthorsClark, Justin Michael, Sanders, Sharon, Carter, Matthew, Honeyman, David, Cleo, Gina, Auld, Yvonne, Booth, Debbie, Condron, Patrick, Dalais, Christine, Bateup, Sarah, Linthwaite, Bronwyn, May, Nikki, Munn, Jo, Ramsay, Lindy, Rickett, Kirsty, Rutter, Cameron, Smith, Angela, Sondergeld, Peter, Wallin, Margie, Jones, Mark and Beller, Elaine
Abstract

Background: Searching for studies to include in a systematic review (SR) is a time- and labor-intensive process with searches of multiple databases recommended. To reduce the time spent translating search strings across databases, a tool called the Polyglot Search Translator (PST) was developed. The authors evaluated whether using the PST as a search translation aid reduces the time required to translate search strings without increasing errors.

Methods: In a randomized trial, twenty participants were randomly allocated ten database search strings and then randomly assigned to translate five with the assistance of the PST (PST-A method) and five without the assistance of the PST (manual method). We compared the time taken to translate search strings, the number of errors made, and how close the number of references retrieved by a translated search was to the number retrieved by a reference standard translation.

Results: Sixteen participants performed 174 translations using the PST-A method and 192 translations using the manual method. The mean time taken to translate a search string with the PST-A method was 31 minutes versus 45 minutes by the manual method (mean difference: 14 minutes). The mean number of errors made per translation by the PST-A method was 8.6 versus 14.6 by the manual method. Large variation in the number of references retrieved makes results for this outcome unreliable, although the number of references retrieved by the PST-A method was closer to the reference standard translation than the manual method.

Conclusion: When used to assist with translating search strings across databases, the PST can increase the speed of translation without increasing errors. Errors in search translations can still be a problem, and search specialists should be aware of this.

Keywordsautomation; systematic reviews; search strategies; databases
Year2020
JournalJournal of the Medical Library Association
Journal citation108 (2), pp. 195-207
PublisherMedical Library Association
ISSN1536-5050
Digital Object Identifier (DOI)https://doi.org/10.5195/jmla.2020.834
Scopus EID2-s2.0-85083022893
Open accessPublished as ‘gold’ (paid) open access
Research or scholarlyResearch
Page range195-207
FunderAustralian Research Council (ARC)
Publisher's version
License
File Access Level
Open
Output statusPublished
Publication dates
OnlineApr 2020
Publication process dates
Deposited26 Aug 2021
ARC Funded ResearchThis output has been funded, wholly or partially, under the Australian Research Council Act 2001
Grant IDARC/1114605
Permalink -

https://acuresearchbank.acu.edu.au/item/8wq65/improving-the-translation-of-search-strategies-using-the-polyglot-search-translator-a-randomized-controlled-trial

Download files


Publisher's version
  • 58
    total views
  • 21
    total downloads
  • 2
    views this month
  • 1
    downloads this month
These values are for the period from 19th October 2020, when this repository was created.

Export as