Signal Detection Based on Time to Onset Algorithm in Spontaneous Reporting System of China

Tianyi Zhang, Xiaofei Ye, Xiaojing Guo, Guizhi Wu, Yongfang Hou, Jinfang Xu, Wentao Shi, Tiantian Zhu, Yuan Zhang, Xinji Zhang, Jiaqi Song and Jia He ()
Additional contact information
Tianyi Zhang: Second Military Medical University
Xiaofei Ye: Second Military Medical University
Xiaojing Guo: Second Military Medical University
Guizhi Wu: National Center for ADR Monitoring
Yongfang Hou: National Center for ADR Monitoring
Jinfang Xu: Second Military Medical University
Wentao Shi: Second Military Medical University
Tiantian Zhu: Second Military Medical University
Yuan Zhang: Second Military Medical University
Xinji Zhang: Second Military Medical University
Jiaqi Song: Second Military Medical University
Jia He: Second Military Medical University

Drug Safety, 2017, vol. 40, issue 4, No 7, 343-350

Abstract: Abstract Introduction The method of time-to-onset (TTO) has been proposed to overcome the drawbacks of traditional disproportionality analyses (DPAs), and it has been used for detecting safety signals of vaccines and some non-vaccine products in spontaneous reporting systems (SRSs). However, there is no consensus on its superiority over DPAs. Further, it is still not clear whether this novel approach can be generalized to the entire national SRS database. Objective The purpose of this study was to generalize the TTO method to the Chinese SRS and to identify suitable parameters for its optimal performance. Methods Reports submitted to the national SRS of China in 2014 were used as the data source for analysis. We evaluated the performance of TTO by using product labels as proxies for the gold standard. A series of values of significance level and time windows were explored to identify the most suitable parameters for TTO based on Youden’s index, a statistic that summarizes the performance of a diagnostic test. Additionally, we compared TTO with traditional DPAs and explored the characteristics of signals detected by these methods. Results Compared with DPAs, TTO had a lower sensitivity, but higher specificity and positive predictive value. At a significance level of 0.2 and no restrictions on time windows, TTO had the highest Youden’s index. The kappa coefficients between TTO and DPAs were rather low, indicating poor agreement between the two methods. More than 30% of the true signals detected by TTO were not identified by DPAs. Furthermore, TTO needed more number of reports to be able to detect signals. Conclusions TTO can detect signals missed by traditional DPAs and could be an important complementary tool to the currently used DPAs in the SRS of China. We recommend a significance level of 0.2 and no restrictions on time windows for TTO.

Keywords: Time Window; Positive Predictive Value; Kappa Coefficient; True Signal; Information Component (search for similar items in EconPapers)
Date: 2017
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s40264-016-0503-0 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:drugsa:v:40:y:2017:i:4:d:10.1007_s40264-016-0503-0

Ordering information: This journal article can be ordered from
http://www.springer.com/adis/journal/40264

DOI: 10.1007/s40264-016-0503-0

Access Statistics for this article

Drug Safety is currently edited by Nitin Joshi

More articles in Drug Safety from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().