A Survey of Advances in Multimodal Federated Learning with Applications

Gregory Barry (), Elif Konyar (), Brandon Harvill () and Chancellor Johnstone ()
Additional contact information
Gregory Barry: Air Force Institute of Technology
Elif Konyar: University of Florida
Brandon Harvill: United States Air Force
Chancellor Johnstone: Air Force Institute of Technology

A chapter in Multimodal and Tensor Data Analytics for Industrial Systems Improvement, 2024, pp 315-344 from Springer

Abstract: Abstract Data privacy has long been an item of emphasis for personal data. This is especially true for healthcare data, which is often multimodal (i.e., it utilizes in some fashion multiple data streams from multiple sources). In an effort to enhance the knowledge-base of privacy-preserving techniques with respect to multimodal data, we provide a survey of multimodal federated learning (MMFL). Our paper includes a thorough introduction to federated learning as well as a discussion on applications of multimodal federated learning to disease classification, autonomous driving, and human activity recognition, among others. Additionally, we describe various methodological advances in MMFL, a subset of which include extensions to supervised learning, personalization, generative models, data reduction, and feature selection. As a proof-of-concept for MMFL, we also include a novel application of federated learning to a series of physiological signals collected during simulated flights, known as the CogPilot dataset.

Keywords: Distributed and federated learning; Model personalization; Data privacy; Physiological signals (search for similar items in EconPapers)
Date: 2024
References: Add references at CitEc
Citations:

There are no downloads for this item, see the EconPapers FAQ for hints about obtaining it.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:spochp:978-3-031-53092-0_15

Ordering information: This item can be ordered from
http://www.springer.com/9783031530920

DOI: 10.1007/978-3-031-53092-0_15

Access Statistics for this chapter

More chapters in Springer Optimization and Its Applications from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().