Toward Intelligent Virtual Anchor: Generative AI for Unified Multimodal Generation

Xinyu Zhong

doi:10.47297/taposatWSP2633-456920.20250606

PDF
导出
分享
收藏
专辑

Toward Intelligent Virtual Anchor: Generative AI for Unified Multimodal Generation

6卷第6期

浏览量: 0 Downloads: 0

Toward Intelligent Virtual Anchor: Generative AI for Unified Multimodal Generation
Toward Intelligent Virtual Anchor: Generative AI for Unified Multimodal Generation
Department of Electronics, University of Liverpool, Liverpool L69, United Kingdom
2025年6卷第6期页码：102-106
纸质出版日期：2025-06-30
DOI：10.47297/taposatWSP2633-456920.20250606
Accepted：

Scan QR Code

(2025). Toward Intelligent Virtual Anchor: Generative AI for Unified Multimodal Generation. 科技理论与实践（英文版）, 6(6), 102-106.

Zhong Xinyu.Toward Intelligent Virtual Anchor: Generative AI for Unified Multimodal Generation[J].Theory and Practice of Science and Technology,2025,06(06):102-106.
(2025). Toward Intelligent Virtual Anchor: Generative AI for Unified Multimodal Generation. 科技理论与实践（英文版）, 6(6), 102-106. DOI： 10.47297/taposatWSP2633-456920.20250606.

Zhong Xinyu.Toward Intelligent Virtual Anchor: Generative AI for Unified Multimodal Generation[J].Theory and Practice of Science and Technology,2025,06(06):102-106. DOI： 10.47297/taposatWSP2633-456920.20250606.

摘要

Abstract

The rapid advancement of generative artificial intelligence has propelled a profound transformation in the field of virtual anchors

shifting them from traditional script-driven and pre-animated unimodal expression to an intelligent

multimodal collaborative generation paradigm. This paper systematically analyzes the technological evolution paths of virtual anchor systems across three key dimensions—speech synthesis

facial animation

and interaction mechanisms—and explores how generative AI significantly enhances the naturalness of expression

real-time interactivity

and emotional richness. Additionally

it points out existing challenges such as interaction cost

personalized expression

and ethical transparency

and proposes future directions for the intelligent design of virtual humans.

关键词

Keywords

references

J. Kim, J. Kong, et al., "Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speech," in *Proc. 38th Int. Conf. on Machine Learning (ICML)*, PMLR 139, pp. 5530 – 5540 , 2021 .

Y. Shirahata, R. Yamamoto, et al., "Period VITS: Variational Inference with Explicit Pitch Modeling for End-to-End Emotional Speech Synthesis," in *Proc. IEEE Int. Conf. on Acoustics, Speech and Signal Processing (ICASSP)*, 2023.

A. Sikarwar, A. Pawar, et al., "CLIP Model Image Search: A Deep Learning Approach for Finding Relevant Images," *arXiv preprint arXiv:2111.14544*, 2021. [Online]. Available: https://arxiv.org/abs/2111.14544.

J. Kim, J. Kong, et al., "End-to-End Speech Synthesis with VITS," *IEEE/ACM Trans. Audio, Speech, and Language Processing*, vol. 30 , pp. 1849 – 1863 , 2022 .

M. Merleau-Ponty, D. Landes, et al., *Phenomenology of Perception*, New York, NY, USA: Taylor & Francis, 2013.

Y. Lingyan and Z. Yi, "Generative artificial intelligence empowers a new paradigm for the creation of virtual digital humans," Innovation and Application of Science and Technology, no. 16 , pp. 1 – 4 , 2025 .

P. Laukka, H. A. Elfenbein, et al., "Cross-Cultural Emotion Recognition and In-Group Advantage in Vocal Expression: A Meta-Analysis," *Emotion Review*, vol. 13 , no. 1 , pp. 3 – 11 , Jan. 2021 .

C. Liu, B. Zoph, et al., "Progressive Neural Architecture Search," in *Proc. Eur. Conf. on Computer Vision (ECCV)*, 2018, pp. 19 – 34 .

S. Xu, G. Chen, et al., "VASA-1: Lifelike Audio-Driven Talking Faces Generated in Real Time," in Advances in Neural Information Processing Systems (NeurIPS), vol. 37 , 2024.

Z. Dai, Z. Yang, et al., "Transformer-XL: Attentive Language Models beyond a Fixed-Length Context," ACL, 2019.

Y. Wang, Z. Liu, et al., "StyleGAN-EX: StyleGAN-based Expression Editing and Generation," CVPR, 2022.

A. Möslein, "AI as a Challenge for Legal Regulation – The Scope of Application of the Artificial Intelligence Act Proposal," *Law, Innovation and Technology*, vol. 23 , pp. 361 – 376 , 2023 .

L. Devlin, M.-W. Chang, et al., "Multimodal Learning Frameworks," *IEEE Trans. Pattern Anal. Mach. Intell.*, vol. 44 , no. 3 , pp. 963 – 976 , Mar. 2022 .

L. He, Z. Wang, et al., "Multimodal Mutual Attention-Based Sentiment Analysis Framework Adapted to Complicated Contexts," *IEEE Trans. Circuits Syst. Video Technol.*, published online May 15, 2023.

文章被引用时，请邮件提醒。

Submit

Design optimization of rehabilitation equipment based on ergonomics

Digital Protection and Display of Cantonese Embroidery Patterns Based on CAD and Human-computer Interaction

Related Author

Li Li Geely University of China

Xiaoli Qi

Hongming Li

Related Institution

Geely University of China

Dongguan Polytechnic

⁰