CCTV and Tencent create the first digital real integration virtual music world program experience

On May 4, China Central Radio and Television Corporation launched the special program of “struggling youth - May 4th Youth Day 2022”, which tells the story of inspirational youth and shows the youth’s spirit of pursuing dreams. The program is broadcast on CCTV comprehensive channel and CCTV variety channel of China Central Radio and television, and creates a “digital real integration virtual music world” based on Tencent music virtual social platform tmeland, so that users can get together in the cloud. The virtual people Jili, Xingtong and Tong Heguang, who are self-developed by Tencent interactive entertainment technology, also made a collective appearance and sang and danced with young actors and college students. The May 4th special program is the key IP of the general station, which has always attracted the attention of youth groups and constantly explored breakthroughs in form creativity and new technology application. This time, through the integration and application of cutting-edge culture and technology such as virtual music world and interactive entertainment technology, it has created the first program experience of digital real integration virtual music world in China and become another innovative example of culture and technology.

On the night of May 4th, more than one million users logged in to QQ music and national karaoke, searched “tmeland” and turned into “digital people” to enter the virtual music world. Digital people put on their customized May 4th costumes, watch the May 4th song exhibition in front of the big screen of conch disco, and feel a different “presence” experience. During the program, tmeland’s virtual music world was linked with the program site in real time, and the on-site host nigmaiti “separated” into the virtual world to cheer for the majority of young people on the digital square. When the song “as a wave behind” was sung on the scene of the program, digital people danced together with adult wave shapes. Based on the end cloud collaborative 3D technology pioneered by tmeland, the interactive experience of the virtual music world is equally smooth on the mobile phone and PC, creating a 130000 square meter large virtual space relative to the size of the digital avatar, which can accommodate 100000 users to interact on the same screen at the same time. This is the largest virtual venue that can be realized by domestic technology without downloading independent app.

Jili, Tong Heguang and Xingtong of Tencent mutual entertainment are also collectively “airborne” on the stage. The three virtual people have realistic facial expressions and flexible body movements. They jointly starred in the situational song and dance “New Youth” with young actors, which is naturally integrated into the real scene. With the camera switching, the virtual human also appeared on the campuses of Renmin University of China, Beijing University of Aeronautics and Astronautics and Wuhan University, and danced on the same screen with the young students of Heilongjiang University, Xi’an Jiaotong University and Guangzhou University to show their youthful style of vitality. Jili, Xingtong and Tong Heguang are respectively created by the peace elite team of Tencent mutual entertainment photon studio group, the virtual human team of the content Ecology Department, the QQ dazzle dance series project team, next studios and XnOx studios. Behind them are Tencent’s engine rendering ability and dynamic capture technology accumulated for many years in the game field, as well as Tencent’s self-developed digital character production, dynamic capture animation production capacity, RBF repair bone binding system and other technologies.

In recent years, the cutting-edge technologies represented by game technology, virtual music world and ultra-high definition video are cultural and scientific achievements deeply integrated with 5g, cloud computing, big data, artificial intelligence and other technologies in the cultural industry. On the occasion of the National Youth celebration, CCTV and Tencent joined hands to build a virtual music world with the combination of digital and real music, and integrated virtual human performance into literary and artistic performances, which is an active exploration in the field of innovative application of cultural and scientific and technological achievements. In the future, cultural and scientific achievements will explore more possibilities in the fields of cultural transmission, public services, scientific and technological innovation and so on.