What is the different interactive experience when an ordinary plane meets ar?
2021 is called the first year of metauniverse. With the rapid development and landing of 5g, XR and other technologies, AR, as one of the technical links connecting metauniverse and the real world, is also deepening the integration with all walks of life and bringing users more interesting and interactive immersive experience in the virtual world.
For example, with the help of an AR lamp, students can get a more social and real self-study experience on their desks, walls and even any plane. Without mobile phones or other devices, as long as you move your fingers, teachers and students can achieve remote real-time communication: Teachers’ corrections are no longer displayed on the electronic screen, but “written” on students’ homework books through AI algorithm to realize paper-based and electronic interaction, which not only reduces the damage of electronic devices to students’ eyes, but also makes online learning more interesting.
This desk lamp that can turn the plane into a self-study classroom is from Shenguang technology, a permanent supersonic entrepreneurial partner of sound network and a domestic developer of projection human-computer interaction technology and equipment. In its ar solution, the high stability real-time audio and video in the process of teacher-student interaction is provided by sound network, a real-time interactive cloud service provider. Users do not need to wear any equipment, but only through gestures Touch and other operation behaviors can realize the naked eye interactive application in real space.
Ar + AI, deep light refreshes the learning experience with technology
Ar must be the mainstream way of interaction in the future, said Guo Jiawei, CTO of deep light technology. The ultimate purpose of human-computer interaction is to maximize the efficiency of information communication, the simplest operation mode and the most comfortable user experience. AR is undoubtedly one of the most competitive ways of interaction, and the combination with educational hardware can improve the efficiency and experience of students’ online learning in many ways.
Although online teaching breaks the spatial constraints, the sense of distance still exists, and video teaching can not meet the needs of students for immersive self-study. How to make the interactive experience of online teaching more close to the effect of offline teaching when it has crossed the geographical and population restrictions is the core direction of the development of online education industry in the future.
Based on the exploration in this direction, deep light technology will cut into the education track in 2020 and launch deep light ar projection learning companion desk lamp. For home learning, online teaching and other scenes, it will combine projection technology, AR technology, AI recognition technology and eye protection desk lamp. Ar table lamp can project a 23 inch eye protection screen on any plane. In the process of learning, students can recognize the book content and present diversified E-education content in real time combined with AI algorithm.
When students interact with teachers remotely, based on the support of technologies and products such as real-time audio and video and interactive whiteboard of sound network, teachers can not only see the students’ status and desktop homework on the web, but also correct the homework in the picture in real time. The handwriting is presented on the homework paper and desktop synchronously, just like teachers sitting next to students to teach in person and breaking the sense of distance, Let students feel as if they are in the classroom, “although thousands of miles away, it is like being around”.
However, in order to truly make online education close to the efficiency and experience of offline education, in addition to restoring the writing mode of real-time classroom, we also need to show real-time class explanation. Therefore, in this process, high stability and low delay real-time audio and video is also the core key. “The cooperation with the sound network has successfully solved the stability problem of the previous ar lamp in the process of audio and video calls, and the ‘space audio’ technology of the sound network has helped to provide a more immersive and immersive teaching experience.” Feng Zhen, CEO of Shenguang technology, said.
In terms of interaction scheme, deep light technology is developed based on AI + AR algorithm and combined with multi-mode signal to realize millimeter accuracy and 70 frame touch frame rate under the condition of embedded computing power, effectively eliminate false touch and interference, and realize three types of interaction support: the interaction between projection and human touch, the interaction between projection and actual objects, and the end-to-end interaction of remote communication.
Technology blessing + resource collaboration, sound network ecological multi-dimensional empowerment, deep light
As a start-up company, in less than two years since its establishment, the order amount of AR smart light launched by Shenguang technology has exceeded 10 million yuan, and has obtained tens of millions of financing from Fengrui capital, Beihang investment, enlightenment star and so on. “Such rapid development is inseparable from the support of the ecological partner ‘sound network’.” Feng Zhen said frankly.
At the beginning of this year, deep light technology participated in the “supersonic plan” and “sound selection plan” of sound network ecology. In the polishing and optimization process of AR table lamp products, sound network not only provided a variety of technologies and product capabilities such as free million audio and video call minutes of “supersonic gift package”, but also through its own ecological technology cooperation and channel partner iFLYTEK in intelligent voice The interactive solution provides technical blessings:
Combined with iFLYTEK’s voice intelligence technology, it adds personalized functions such as voice wake-up, voice blessing, semantic understanding and voice library customization to AR lamp;
The ability of iFLYTEK aiui human-computer interaction platform continues to inject technical support, including the overall voice interaction solution including CAE noise reduction algorithm and AIU service authorization, to help Shenguang technology improve the comprehensive competitiveness of its own product solutions;
Assist Shenguang technology to integrate R & D resources, improve team efficiency, comprehensively ensure the online time and shorten the iteration cycle;
Moreover, for enterprises in the early stage of entrepreneurship, how to find sustainable sales channels, complete sales operations and cost expenditure are pain points and difficulties. Sound network has provided multi-channel resource assistance to Shenguang technology in this regard:
In terms of sales channels, sound network ecology helps to open up and try to link iFLYTEK distribution channels to provide product distribution for Shenguang technology;
Promote the access of Shenguang technology to iFLYTEK aiui human-computer interaction platform, and it is estimated that the comprehensive cost savings will reach 12%;
Provide free real-time audio and video quota for Shenguang, reduce the early-stage integration cost of voice capability, apply for corresponding technical support quota at iFLYTEK side, optimize the price structure in combination with the market volume, and finally reduce the early-stage cost of start-ups;
The application of virtual real human-computer interaction technology in the field of education has just started. Feng Zhen judged that the market of educational hardware will usher in a long-term outbreak period. Deep light technology will also continue to explore more