Using plants as biosensors to measure the emotions of jazz musicians

Anushka Bhave, Fritz K. Renold and Peter A. Gloor

Chapter 9 in Handbook of Social Computing, 2024, pp 173-188 from Edward Elgar Publishing

Abstract: This chapter proposes a novel non-invasive, and privacy-preserving approach to quantify human emotions by tracking the action potential activations in plants positioned in the vicinity of humans. The production of human electrostatic discharge triggers changes in the electrical action potential values of a Basil plant (Ocimum basilicum) that acts as a highly sensitive movement and sound sensor. We construct a machine learning model to predict human emotions using features extracted from the plant’s electrical signals. The data is collected from a two-hour jazz rehearsal session with an orchestra of 19 musicians. Moreover, the emotions of musicians are also measured with two well-tested systems to collect ground truth. The first is facial emotion recognition using CNNs by obtaining camera-recorded videos of the musicians. The second is smartwatch sensor data of physiological signals like heart rate and body movement. On experimental evaluation, we obtain Pearson correlation values and regression coefficients for group facial emotions and plant Mel Frequency Cepstral Coefficients (MFCCs). Our machine learning approach achieves a training and test accuracy of 69 percent and 64 percent, respectively.

Keywords: Business and Management; Innovations and Technology; Sociology and Social Policy (search for similar items in EconPapers)
Date: 2024
References: Add references at CitEc
Citations:

Downloads: (external link)
https://www.elgaronline.com/doi/10.4337/9781803921259.00017 (application/pdf)
Our link check indicates that this URL is bad, the error code is: 503 Service Temporarily Unavailable

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:elg:eechap:21469_9

Ordering information: This item can be ordered from
http://www.e-elgar.com

Access Statistics for this chapter

More chapters in Chapters from Edward Elgar Publishing
Bibliographic data for series maintained by Darrel McCalla ().