Application of ChatGPT-Based Digital Human in Animation Creation

Chong Lan, Yongsheng Wang, Chengze Wang (), Shirong Song and Zheng Gong
Additional contact information
Chong Lan: School of Art and Design, Lanzhou Jiaotong University, Lanzhou 730070, China
Yongsheng Wang: School of Art and Design, Lanzhou Jiaotong University, Lanzhou 730070, China
Chengze Wang: School of Art and Design, Lanzhou Jiaotong University, Lanzhou 730070, China
Shirong Song: School of Art and Design, Lanzhou Jiaotong University, Lanzhou 730070, China
Zheng Gong: School of Art and Design, Lanzhou Jiaotong University, Lanzhou 730070, China

Future Internet, 2023, vol. 15, issue 9, 1-18

Abstract: Traditional 3D animation creation involves a process of motion acquisition, dubbing, and mouth movement data binding for each character. To streamline animation creation, we propose combining artificial intelligence (AI) with a motion capture system. This integration aims to reduce the time, workload, and cost associated with animation creation. By utilizing AI and natural language processing, the characters can engage in independent learning, generating their own responses and interactions, thus moving away from the traditional method of creating digital characters with pre-defined behaviors. In this paper, we present an approach that employs a digital person’s animation environment. We utilized Unity plug-ins to drive the character’s mouth Blendshape, synchronize the character’s voice and mouth movements in Unity, and connect the digital person to an AI system. This integration enables AI-driven language interactions within animation production. Through experimentation, we evaluated the correctness of the natural language interaction of the digital human in the animated scene, the real-time synchronization of mouth movements, the potential for singularity in guiding users during digital human animation creation, and its ability to guide user interactions through its own thought process.

Keywords: digital people; unity; human–computer interaction; animation creation; ChatGPT (search for similar items in EconPapers)
JEL-codes: O3 (search for similar items in EconPapers)
Date: 2023
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/1999-5903/15/9/300/pdf (application/pdf)
https://www.mdpi.com/1999-5903/15/9/300/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jftint:v:15:y:2023:i:9:p:300-:d:1231661

Access Statistics for this article

Future Internet is currently edited by Ms. Grace You

More articles in Future Internet from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().