Toward Intelligent Virtual Anchor: Generative AI for Unified Multimodal Generation

Xinyu Zhong

doi:10.47297/taposatWSP2633-456920.20250606

PDF
Export
Share
Collection
Album

Toward Intelligent Virtual Anchor: Generative AI for Unified Multimodal Generation

Volume 6, Issue 6

Views: 0 Downloads: 0

Toward Intelligent Virtual Anchor: Generative AI for Unified Multimodal Generation
Toward Intelligent Virtual Anchor: Generative AI for Unified Multimodal Generation
Department of Electronics, University of Liverpool, Liverpool L69, United Kingdom
Vol. 6, Issue 6, Pages: 102-106(2025)
Published：30 June 2025
DOI：10.47297/taposatWSP2633-456920.20250606
Accepted：

Scan QR Code

Zhong Xinyu.Toward Intelligent Virtual Anchor: Generative AI for Unified Multimodal Generation[J].Theory and Practice of Science and Technology,2025,06(06):102-106.
DOI：

Zhong Xinyu.Toward Intelligent Virtual Anchor: Generative AI for Unified Multimodal Generation[J].Theory and Practice of Science and Technology,2025,06(06):102-106. DOI： 10.47297/taposatWSP2633-456920.20250606.

摘要

Abstract

The rapid advancement of generative artificial intelligence has propelled a profound transformation in the field of virtual anchors

shifting them from traditional script-driven and pre-animated unimodal expression to an intelligent

multimodal collaborative generation paradigm. This paper systematically analyzes the technological evolution paths of virtual anchor systems across three key dimensions—speech synthesis

facial animation

and interaction mechanisms—and explores how generative AI significantly enhances the naturalness of expression

real-time interactivity

and emotional richness. Additionally

it points out existing challenges such as interaction cost

personalized expression

and ethical transparency

and proposes future directions for the intelligent design of virtual humans.

关键词

Keywords

references

J. Kim, J. Kong, et al., "Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speech," in *Proc. 38th Int. Conf. on Machine Learning (ICML)*, PMLR 139, pp. 5530 – 5540 , 2021 .

Y. Shirahata, R. Yamamoto, et al., "Period VITS: Variational Inference with Explicit Pitch Modeling for End-to-End Emotional Speech Synthesis," in *Proc. IEEE Int. Conf. on Acoustics, Speech and Signal Processing (ICASSP)*, 2023.

A. Sikarwar, A. Pawar, et al., "CLIP Model Image Search: A Deep Learning Approach for Finding Relevant Images," *arXiv preprint arXiv:2111.14544*, 2021. [Online]. Available: https://arxiv.org/abs/2111.14544.

J. Kim, J. Kong, et al., "End-to-End Speech Synthesis with VITS," *IEEE/ACM Trans. Audio, Speech, and Language Processing*, vol. 30 , pp. 1849 – 1863 , 2022 .

M. Merleau-Ponty, D. Landes, et al., *Phenomenology of Perception*, New York, NY, USA: Taylor & Francis, 2013.

Y. Lingyan and Z. Yi, "Generative artificial intelligence empowers a new paradigm for the creation of virtual digital humans," Innovation and Application of Science and Technology, no. 16 , pp. 1 – 4 , 2025 .

P. Laukka, H. A. Elfenbein, et al., "Cross-Cultural Emotion Recognition and In-Group Advantage in Vocal Expression: A Meta-Analysis," *Emotion Review*, vol. 13 , no. 1 , pp. 3 – 11 , Jan. 2021 .

C. Liu, B. Zoph, et al., "Progressive Neural Architecture Search," in *Proc. Eur. Conf. on Computer Vision (ECCV)*, 2018, pp. 19 – 34 .

S. Xu, G. Chen, et al., "VASA-1: Lifelike Audio-Driven Talking Faces Generated in Real Time," in Advances in Neural Information Processing Systems (NeurIPS), vol. 37 , 2024.

Z. Dai, Z. Yang, et al., "Transformer-XL: Attentive Language Models beyond a Fixed-Length Context," ACL, 2019.

Y. Wang, Z. Liu, et al., "StyleGAN-EX: StyleGAN-based Expression Editing and Generation," CVPR, 2022.

A. Möslein, "AI as a Challenge for Legal Regulation – The Scope of Application of the Artificial Intelligence Act Proposal," *Law, Innovation and Technology*, vol. 23 , pp. 361 – 376 , 2023 .

L. Devlin, M.-W. Chang, et al., "Multimodal Learning Frameworks," *IEEE Trans. Pattern Anal. Mach. Intell.*, vol. 44 , no. 3 , pp. 963 – 976 , Mar. 2022 .

L. He, Z. Wang, et al., "Multimodal Mutual Attention-Based Sentiment Analysis Framework Adapted to Complicated Contexts," *IEEE Trans. Circuits Syst. Video Technol.*, published online May 15, 2023.

Alert me when the article has been cited

Submit

Design optimization of rehabilitation equipment based on ergonomics

Digital Protection and Display of Cantonese Embroidery Patterns Based on CAD and Human-computer Interaction

Related Author

Li Li Geely University of China

Xiaoli Qi

Hongming Li

Related Institution

Geely University of China

Dongguan Polytechnic

⁰