When to use agreement versus reliability measures
- PMID:16980142
- DOI:10.1016/j.jclinepi.2005.10.015
When to use agreement versus reliability measures
Abstract
Background:Reproducibility concerns the degree to which repeated measurements provide similar results. Agreement parameters assess how close the results of the repeated measurements are, by estimating the measurement error in repeated measurements. Reliability parameters assess whether study objects, often persons, can be distinguished from each other, despite measurement errors. In that case, the measurement error is related to the variability between persons. Consequently, reliability parameters are highly dependent on the heterogeneity of the study sample, while the agreement parameters, based on measurement error, are more a pure characteristic of the measurement instrument.
Methods and results:Using an example of an interrater study, in which different physical therapists measure the range of motion of the arm in patients with shoulder complaints, the differences and relationships between reliability and agreement parameters for continuous variables are illustrated.
Conclusion:If the research question concerns the distinction of persons, reliability parameters are the most appropriate. But if the aim is to measure change in health status, which is often the case in clinical practice, parameters of agreement are preferred.
Comment in
-
Good validity and reliability of the forgotten joint score in evaluating the outcome of total knee arthroplasty.Acta Orthop. 2016 Jun;87(3):280-5. doi: 10.3109/17453674.2016.1156934. Epub 2016 Mar 3. Acta Orthop. 2016. PMID:26937689 Free PMC article.
Similar articles
-
Inter-observer reproducibility of measurements of range of motion in patients with shoulder pain using a digital inclinometer.BMC Musculoskelet Disord. 2004 Jun 14;5:18. doi: 10.1186/1471-2474-5-18. BMC Musculoskelet Disord. 2004. PMID:15196309 Free PMC article.
-
Reliability of two goniometric methods of measuring active inversion and eversion range of motion at the ankle.BMC Musculoskelet Disord. 2006 Jul 28;7:60. doi: 10.1186/1471-2474-7-60. BMC Musculoskelet Disord. 2006. PMID:16872545 Free PMC article.
-
Inter-professional agreement of ultrasound-based diagnoses in patients with shoulder pain between physical therapists and radiologists in the Netherlands.Man Ther. 2014 Oct;19(5):478-83. doi: 10.1016/j.math.2014.04.018. Epub 2014 May 14. Man Ther. 2014. PMID:24898215
-
Interrater agreement and interrater reliability: key concepts, approaches, and applications.Res Social Adm Pharm. 2013 May-Jun;9(3):330-8. doi: 10.1016/j.sapharm.2012.04.004. Epub 2012 Jun 12. Res社会Adm制药。2013年。 PMID:22695215 Review.
-
[Statistical approaches to evaluate agreement].Med Clin (Barc). 2004;122 Suppl 1:28-34. doi: 10.1157/13057543. Med Clin (Barc). 2004. PMID:14980157 Review. Spanish.
Cited by
-
The Preventiometer - reliability of a cardiovascular multi-device measurement platform and its measurement agreement with a cohort study.BMC Med Res Methodol. 2023 Apr 24;23(1):103. doi: 10.1186/s12874-023-01911-x. BMC Med Res Methodol. 2023. PMID:37095457 Free PMC article.
-
Elderly people with human T-cell leukemia virus type 1-associated myelopathy present an early impairment in cognitive skills.Arq Neuropsiquiatr. 2023 Mar;81(3):253-262. doi: 10.1055/s-0043-1763486. Epub 2023 Apr 14. Arq Neuropsiquiatr. 2023. PMID:37059435 Free PMC article.
-
Agreement and reliability of hepatic transient elastography in patients with chronic hepatitis C: A cross-sectional test-retest study.Health Sci Rep. 2023 Apr 3;6(4):e1184. doi: 10.1002/hsr2.1184. eCollection 2023 Apr. Health Sci Rep. 2023. PMID:37021011 Free PMC article.
-
Psychometric properties of the English language version of the C-BiLLT evaluated in typically developing Canadian children.J Pediatr Rehabil Med. 2023;16(1):71-81. doi: 10.3233/PRM-210101. J Pediatr Rehabil Med. 2023. PMID:36847022 Free PMC article.
-
Can an artificial intelligence powered software reliably assess pelvic radiographs?Int Orthop. 2023 Apr;47(4):945-953. doi: 10.1007/s00264-023-05722-z. Epub 2023 Feb 17. Int Orthop. 2023. PMID:36799971 Free PMC article.
MeSH terms
LinkOut - more resources
全文来源
Other Literature Sources
Medical