Ändra sökning
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
Scoring reading parameters: An inter-rater reliability study using the MNREAD chart
Linnéuniversitetet, Fakulteten för Hälso- och livsvetenskap (FHL), Institutionen för medicin och optometri (MEO). (REVO)ORCID-id: 0000-0002-3745-0035
Linnéuniversitetet, Fakulteten för Hälso- och livsvetenskap (FHL), Institutionen för medicin och optometri (MEO). University of Minho Braga, Portugal.ORCID-id: 0000-0003-3436-2010
University of Minnesota, USA.
University of Minho Braga, Portugal.
Visa övriga samt affilieringar
2019 (Engelska)Ingår i: PLoS ONE, ISSN 1932-6203, E-ISSN 1932-6203, Vol. 14, nr 6, s. 1-14, artikel-id e0216775Artikel i tidskrift (Refereegranskat) Published
Abstract [en]

Purpose First, to evaluate inter-rater reliability when human raters estimate the reading performance of visually impaired individuals using the MNREAD acuity chart. Second, to evaluate the agreement between computer-based scoring algorithms and compare them with human rating. Methods Reading performance was measured for 101 individuals with low vision, using the Portuguese version of the MNREAD test. Seven raters estimated the maximum reading speed (MRS) and critical print size (CPS) of each individual MNREAD curve. MRS and CPS were also calculated automatically for each curve using two different algorithms: the original standard deviation method (SDev) and a non-linear mixed effects (NLME) modeling. Intra-class correlation coefficients (ICC) were used to estimate absolute agreement between raters and/or algorithms. Results Absolute agreement between raters was ‘excellent’ for MRS (ICC = 0.97; 95%CI [0.96, 0.98]) and ‘moderate’ to ‘good’ for CPS (ICC = 0.77; 95%CI [0.69, 0.83]). For CPS, inter-rater reliability was poorer among less experienced raters (ICC = 0.70; 95%CI [0.57, 0.80]) when compared to experienced ones (ICC = 0.82; 95%CI [0.76, 0.88]). Absolute agreement between the two algorithms was ‘excellent’ for MRS (ICC = 0.96; 95%CI [0.91, 0.98]). For CPS, the best possible agreement was found for CPS defined as the print size sustaining 80% of MRS (ICC = 0.77; 95%CI [0.68, 0.84]). Absolute agreement between raters and automated methods was ‘excellent’ for MRS (ICC = 0.96; 95% CI [0.88, 0.98] for SDev; ICC = 0.97; 95% CI [0.95, 0.98] for NLME). For CPS, absolute agreement between raters and SDev ranged from ‘poor’ to ‘good’ (ICC = 0.66; 95% CI [0.3, 0.80]), while agreement between raters and NLME was ‘good’ (ICC = 0.83; 95% CI [0.76, 0.88]). Conclusion For MRS, inter-rater reliability is excellent, even considering the possibility of noisy and/or incomplete data collected in low-vision individuals. For CPS, inter-rater reliability is lower. This may be problematic, for instance in the context of multisite investigations or follow-up examinations. The NLME method showed better agreement with the raters than the SDev method for both reading parameters. Setting up consensual guidelines to deal with ambiguous curves may help improve reliability. While the exact definition of CPS should be chosen on a case-by-case basis depending on the clinician or researcher’s motivations, evidence suggests that estimating CPS as the smallest print size sustaining about 80% of MRS would increase inter-rater reliability.

Ort, förlag, år, upplaga, sidor
Public Library of Science , 2019. Vol. 14, nr 6, s. 1-14, artikel-id e0216775
Nyckelord [en]
MNREAD acuity chart, visual impairment, algorithms
Nationell ämneskategori
Oftalmologi
Forskningsämne
Naturvetenskap, Optometri
Identifikatorer
URN: urn:nbn:se:lnu:diva-84759DOI: 10.1371/journal.pone.0216775ISI: 000470658500005PubMedID: 31173587Scopus ID: 2-s2.0-85067111247OAI: oai:DiVA.org:lnu-84759DiVA, id: diva2:1321533
Tillgänglig från: 2019-06-08 Skapad: 2019-06-08 Senast uppdaterad: 2019-08-29Bibliografiskt granskad

Open Access i DiVA

fulltext(2079 kB)95 nedladdningar
Filinformation
Filnamn FULLTEXT01.pdfFilstorlek 2079 kBChecksumma SHA-512
a0e879054d5e2a169de454ac0f7d9b7c9f1e5405f37c01d23f601695e4392799b49ac6c3a668d9e4436bd99fec5b058bd9cfe0692aa5994f537973c920bff154
Typ fulltextMimetyp application/pdf

Övriga länkar

Förlagets fulltextPubMedScopus

Sök vidare i DiVA

Av författaren/redaktören
Baskaran, KarthikeyanMacedo, António Filipe
Av organisationen
Institutionen för medicin och optometri (MEO)
I samma tidskrift
PLoS ONE
Oftalmologi

Sök vidare utanför DiVA

GoogleGoogle Scholar
Totalt: 95 nedladdningar
Antalet nedladdningar är summan av nedladdningar för alla fulltexter. Det kan inkludera t.ex tidigare versioner som nu inte längre är tillgängliga.

doi
pubmed
urn-nbn

Altmetricpoäng

doi
pubmed
urn-nbn
Totalt: 239 träffar
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf