Combining machine learning and dynamic system techniques to early detection of respiratory outbreaks in routinely collected primary healthcare records

Dérick G. F. Borges, Eluã R. Coutinho, Thiago Cerqueira-Silva, Malú Grave, Adriano O. Vasconcelos, Luiz Landau, Alvaro L. G. A. Coutinho, Pablo Ivan P. Ramos, Manoel Barral-Netto, Suani T. R. Pinho, Marcos E. Barreto and Roberto F. S. Andrade

LSE Research Online Documents on Economics from London School of Economics and Political Science, LSE Library

Abstract: Background: Methods that enable early outbreak detection represent powerful tools in epidemiological surveillance, allowing adequate planning and timely response to disease surges. Syndromic surveillance data collected from primary healthcare encounters can be used as a proxy for the incidence of confirmed cases of respiratory diseases. Deviations from historical trends in encounter numbers can provide valuable insights into emerging diseases with the potential to trigger widespread outbreaks. Methods: Unsupervised machine learning methods and dynamical systems concepts were combined into the Mixed Model of Artificial Intelligence and Next-Generation (MMAING) ensemble, which aims to detect early signs of outbreaks based on primary healthcare encounters. We used data from 27 Brazilian health regions, which cover 41% of the country’s territory, from 2017-2023 to identify anomalous increases in primary healthcare encounters that could be associated with an epidemic onset. Our validation approach comprised (i) a comparative analysis across Brazilian capitals; (ii) an analysis of warning signs for the COVID-19 period; and (iii) a comparison with related surveillance methods (namely EARS C1, C2, C3) based on real and synthetic labeled data. Results: The MMAING ensemble demonstrated its effectiveness in early outbreak detection using both actual and synthetic data, outperforming other surveillance methods. It successfully detected early warning signals in synthetic data, achieving a probability of detection of 86%, a positive predictive value of 85%, and an average reliability of 79%. When compared to EARS C1, C2, and C3, it exhibited superior performance based on receiver operating characteristic (ROC) curve results on synthetic data. When evaluated on real-world data, MMAING performed on par with EARS C2. Notably, the MMAING ensemble accurately predicted the onset of the four waves of the COVID-19 period in Brazil, further validating its effectiveness in real-world scenarios. Conclusion: Identifying trends in time series data related to primary healthcare encounters indicated the possibility of developing a reliable method for the early detection of outbreaks. MMAING demonstrated consistent identification capabilities across various scenarios, outperforming established reference methods.

Keywords: syndromic surveillance; reproduction number; primary healthcare data; machine learning; outbreak detection (search for similar items in EconPapers)
JEL-codes: C1 (search for similar items in EconPapers)
Pages: 20 pages
Date: 2025-04-16
References: View references in EconPapers View complete reference list from CitEc
Citations:

Published in BMC Medical Research Methodology, 16, April, 2025, 25(1). ISSN: 1471-2288

Downloads: (external link)
http://eprints.lse.ac.uk/127964/ Open access version. (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:ehl:lserod:127964

Access Statistics for this paper

More papers in LSE Research Online Documents on Economics from London School of Economics and Political Science, LSE Library LSE Library Portugal Street London, WC2A 2HD, U.K.. Contact information at EDIRC.
Bibliographic data for series maintained by LSERO Manager ().