[go: up one dir, main page]

Kullmann et al., 2023 - Google Patents

An evaluation of other-avatar facial animation methods for social VR

Kullmann et al., 2023

View PDF
Document ID
11129078338112577330
Author
Kullmann P
Menzel T
Botsch M
Latoschik M
Publication year
Publication venue
Extended abstracts of the 2023 CHI conference on human factors in computing systems

External Links

Snippet

We report a mixed-design study on the effect of facial animation method (static, synthesized, or tracked expressions) and its synchronization to speaker audio (in sync or delayed by the method's inherent latency) on an avatar's perceived naturalness and plausibility. We created …
Continue reading at downloads.hci.informatik.uni-wuerzburg.de (PDF) (other versions)

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/141Systems for two-way working between two video terminals, e.g. videophone
    • H04N7/147Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/15Conference systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRICAL DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013Eye tracking input arrangements
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRICAL DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012Head tracking input arrangements
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRICAL DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017Gesture based interaction, e.g. based on a set of recognized hand gestures
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/06Transformation of speech into a non-audible representation, e.g. speech visualisation or speech processing for tactile aids
    • G10L21/10Transformation of speech into a non-audible representation, e.g. speech visualisation or speech processing for tactile aids transforming into visible information
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00Animation
    • G06T13/203D [Three Dimensional] animation
    • G06T13/403D [Three Dimensional] animation of characters, e.g. humans, animals or virtual beings

Similar Documents

Publication Publication Date Title
Kullmann et al. An evaluation of other-avatar facial animation methods for social VR
US11514634B2 (en) Personalized speech-to-video with three-dimensional (3D) skeleton regularization and expressive body poses
CN112215927B (en) Method, device, equipment and medium for synthesizing face video
JP2022534708A (en) A Multimodal Model for Dynamically Reacting Virtual Characters
Seele et al. Here's looking at you anyway! How important is realistic gaze behavior in co-located social virtual reality games?
CN109844854A (en) word flow annotation
US12436977B2 (en) Apparatus, systems and methods for providing conversational assistance
CN108596107A (en) Lip reading recognition methods and its device, AR equipment based on AR equipment
Kato et al. Reality avatar for customer conversation in the metaverse
US12317002B2 (en) Selecting avatar for videoconference
Vertegaal Look who's talking to whom: mediating joint attention in multiparty communication and collaboration
Ehret et al. Who's next? Integrating Non-verbal turn-taking cues for embodied conversational agents
US20180160077A1 (en) System, Method and Software for Producing Virtual Three Dimensional Avatars that Actively Respond to Audio Signals While Appearing to Project Forward of or Above an Electronic Display
US20240256711A1 (en) User Scene With Privacy Preserving Component Replacements
Arboleda et al. Beyond looks: a study on agent movement and audiovisual spatial coherence in augmented reality
US20240119619A1 (en) Deep aperture
Brandstätter et al. Dialogues for one: Single-user content creation using immersive record and replay
US10469803B2 (en) System and method for producing three-dimensional images from a live video production that appear to project forward of or vertically above an electronic display
Wilczkowiak et al. Ecological validity and the evaluation of avatar facial animation noise
Rendle et al. Influence of audiovisual realism on communication behaviour in group-to-group telepresence
Nam et al. Watch Buddy: Evaluating the Impact of an Expressive Virtual Agent on Video Consumption Experience in Augmented Reality
DeMara et al. Towards interactive training with an avatar-based human-computer interface
WO2021140800A1 (en) Communication assistance system and communication assistance program
JP7559026B2 (en) VIRTUAL SPACE PROVIDING SYSTEM, VIRTUAL SPACE PROVIDING METHOD, AND PROGRAM
JP7397883B2 (en) Presentation of communication data based on environment