Medium - Video

SHANGAVATAR which created from ' I, AI Create Together - SHANGAVATAR ' gaved a speech inVoices in and out of Place ' virtual conference.

“A Sociable Avatar - ShangAvatar” is a project aiming to clone ShangYunWu her bios features into a virtual avatar for replacing the social and musical performance activities which need to face a wider audience. In her job, she needs to communicate with strangers, however, she is easily influenced by those unpredictable human emotion responses which inspire her to start with the project.

Artificial Intelligence is the rise of empathic media . ( “ Emotional AI : The Rise of Empathic Media ” ) While ShangYun was a project manager and performer, she realised that how to deal with human’s mental needs propoly is the key while facing a wider audience. It is not about acting the “right ” action or saying the “ honest ” words, it is more about reacting “ proper ” feedback to the others. Thus, how to understand the emotion behind the audience is an important design purpose which is the meaning of “ empathic” while reconstruing all the information into a system and representing them into a media form as a virtual avatar.

Vocal activity is always connected with the process of feedback through self-monitoring and social monitoring. This has been studied primarily through the mode of hearing, but it is a multisensory process. Therefore, in investigative efforts into auto-hearing, attention to how others hear you, and how these cycles feed into self-image, regulation, and posi- tioning within a social group, voice and multimodal listening are crucial. ( “ The Oxford Handbook of Voice Studies ” )

To design the media - avatar and how it could interact with the real human, computer analysis of speech involves emotion to capture to prime the systems to interact meaningfully with people makes voice-based emotional AIs design and other supportive recognition AI, for example, facial recognition become the main research and creative design for “ A Sociable Avatar - ShangAvatar”.

More information

https://blogs.ncl.ac.uk/vicariousvocalities2022/