Using Deep Learning in Real-Time for Clothing Classification with Connected Thermostats

Adán Medina, Juana Isabel Méndez, Pedro Ponce, Therese Peffer, Alan Meier and Arturo Molina
Additional contact information
Adán Medina: School of Engineering and Sciences, Tecnologico de Monterrey, Mexico City 14380, Mexico
Juana Isabel Méndez: School of Engineering and Sciences, Tecnologico de Monterrey, Mexico City 14380, Mexico
Pedro Ponce: School of Engineering and Sciences, Tecnologico de Monterrey, Mexico City 14380, Mexico
Therese Peffer: Institute for Energy and Environment, University of California, Berkeley, CA 94720, USA
Alan Meier: Energy and Efficiency Institute, University of California, Davis, CA 95616, USA
Arturo Molina: School of Engineering and Sciences, Tecnologico de Monterrey, Mexico City 14380, Mexico

Energies, 2022, vol. 15, issue 5, 1-28

Abstract: Thermal comfort is associated with clothing insulation, conveying a level of satisfaction with the thermal surroundings. Besides, clothing insulation is commonly associated with indoor thermal comfort. However, clothing classification in smart homes might save energy when the end-user wears appropriate clothes to save energy and obtain thermal comfort. Furthermore, object detection and classification through Convolutional Neural Networks has increased over the last decade. There are real-time clothing garment classifiers, but these are oriented towards single garment recognition for texture, fabric, shape, or style. Consequently, this paper proposes a CNN model classification for the implementation of these classifiers on cameras. First, the Fashion MNIST was analyzed and compared with the VGG16, Inceptionvv4, TinyYOLOv3, and ResNet18 classification algorithms to determine the best clo classifier. Then, for real-time analysis, a new dataset with 12,000 images was created and analyzed with the YOLOv3 and TinyYOLO. Finally, an Azure Kinect DT was employed to analyze the clo value in real-time. Moreover, real-time analysis can be employed with any other webcam. The model recognizes at least three garments of a clothing ensemble, proving that it identifies more than a single clothing garment. Besides, the model has at least 90% accuracy in the test dataset, ensuring that it can be generalized and is not overfitting.

Keywords: clothing classifier; CNN models; thermal comfort; connected thermostat (search for similar items in EconPapers)
JEL-codes: Q Q0 Q4 Q40 Q41 Q42 Q43 Q47 Q48 Q49 (search for similar items in EconPapers)
Date: 2022
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
https://www.mdpi.com/1996-1073/15/5/1811/pdf (application/pdf)
https://www.mdpi.com/1996-1073/15/5/1811/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jeners:v:15:y:2022:i:5:p:1811-:d:761611

Access Statistics for this article

Energies is currently edited by Ms. Agatha Cao

More articles in Energies from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().