Efficient Imbalanced Multimedia Concept Retrieval by Deep Learning on Spark Clusters

Yilin Yan, Min Chen, Saad Sadiq and Mei-Ling Shyu
Additional contact information
Yilin Yan: University of Miami, Department of Electrical and Computer Engineering, Coral Gables, FL, USA
Min Chen: University of Washington Bothell, Bothell, Computing and Software Systems, School of STEM, WA, USA
Saad Sadiq: University of Miami, Department of Electrical and Computer Engineering, Coral Gables, FL, USA
Mei-Ling Shyu: University of Miami, Department of Electrical and Computer Engineering, Coral Gables, FL, USA

International Journal of Multimedia Data Engineering and Management (IJMDEM), 2017, vol. 8, issue 1, 1-20

Abstract: The classification of imbalanced datasets has recently attracted significant attention due to its implications in several real-world use cases. The classifiers developed on datasets with skewed distributions tend to favor the majority classes and are biased against the minority class. Despite extensive research interests, imbalanced data classification remains a challenge in data mining research, especially for multimedia data. Our attempt to overcome this hurdle is to develop a convolutional neural network (CNN) based deep learning solution integrated with a bootstrapping technique. Considering that convolutional neural networks are very computationally expensive coupled with big training datasets, we propose to extract features from pre-trained convolutional neural network models and feed those features to another full connected neutral network. Spark implementation shows promising performance of our model in handling big datasets with respect to feasibility and scalability.

Date: 2017
References: Add references at CitEc
Citations:

Downloads: (external link)
http://services.igi-global.com/resolvedoi/resolve. ... 18/IJMDEM.2017010101 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:igg:jmdem0:v:8:y:2017:i:1:p:1-20

Access Statistics for this article

International Journal of Multimedia Data Engineering and Management (IJMDEM) is currently edited by Chengcui Zhang

More articles in International Journal of Multimedia Data Engineering and Management (IJMDEM) from IGI Global
Bibliographic data for series maintained by Journal Editor ().