UniODA vs. Eyeball Analysis: Comparing Repeated Ordinal Scores

Paul R. Yarnold

Optimal Data Analysis, LLC

The Adverse Drug Reaction Probability Scale (APS) is an algorithm that is used to rate the probability that an adverse drug event is drug-induced. Prior research compared the reliability of APS ratings generated by 15 pairs of independent experts between baseline and training, versus between training and three-month follow-up. Findings of eyeball comparison of ranges of the intraclass correlation coefficient of reliability, versus findings obtained using UniODA to contrast the two testing periods, are compared.

View journal article