The First Virtual News Anchor "SHEN XIAOYA" Appeared at the CIIE, SMT Is Waiting for You!

posted:

14/11/2020

In November 2020, the 3rd China International Import Expo was held as scheduled and closed successfully. In the live broadcasting of the CIIE this year, besides some popular technologies such as AR and VR, a new face appeared in the news anchor team-SHEN XIAOYA a virtual two-dimensional anchor that created by SMT through technological innovation. As the country's first two-dimensional virtual news anchor, SHEN XIAOYA has completed her debut on the big screen of the China International Import Expo. To ensure the live broadcasting of the CIIE, SMT enters the venue in advance for technical preparation and testing.

Set up an optical motion capture shed on the CIIE

A 20-square-meter optical motion capture shed was built at the CIIE to capture real-life actions and expressions through an infrared camera array to ensure the accuracy of data collection

Multiple Venues and Multiple Positions

In 4 different venues of the CIIE, set up 3 fixed camera positions + 1 push-pull camera position for shooting and collection. The main position and the back-up camera position are mutually guaranteed to ensure an error-free live broadcasting.

Remote adjustment to achieve signal superposition

Through the conversion equipment and the switcher, the synchronization of multi-camera data is realized, and multiple computers are linked for real-time synchronization processing. The system function uniformly match the camera positions and remotely adjust the gestures of the characters to ensure that the front studio can successfully capture the on-site shooting signals and superimposed the character signal of SHEN XIAOYA for broadcasting.

Optimize Character Image

Based on the accumulation of the original IP technology, SMT invested a lot of time and energy in designing the character image. By modifying the Unreal engine, adding cartoon rendering and dynamics technology, the edges of the characters are clearer, and the hair and skirts are more natural and elegant.

SHEN XIAOYA is a bold attempt of SMT to combine virtual live broadcasting and AR technology, and it is also the first time to use multi-camera AR technology in news program. By using real-time light capture drive, remote transmission, and real-time interaction, a virtual and reality linkage has been perfectly presented. Due to the forward-looking layout of virtual idol technology that SMT started a few years ago, the creation of SHEN XIAOYA only took two weeks.

Deploy a two-dimensional platform of virtual motion capture to incubate more possibilities

As a professional virtual motion capture technical service provider that entered the industry earlier in China. SMT independently operates four mature virtual idol IPs: Siva Xiao xiayu, Tian Xixi, EenJi_Fault Ai and Yiwan_iiivan, which has a mature technical solution, and is currently building a two-dimensional platform of virtual motion capture, hoping to expand the industrial boundary through continuous technological innovation, and incubate more innovative industrial models.

The emergence of SHEN XIAOYA not only gave a new answer to the form of live news programs, but also greatly increased the charm of live news reports. It was also a strong signal that opened up the broad application of virtual motion capture technology. In the next few years, China's virtual reality industry will expand in various fields such as games, video, live broadcasting, education, and medical care, and its proportion will rise steadily. Multi-format cooperation will become a trend and a selling point, and the changes brought about by accumulating technology will become the driving force for the development of the industry