CN115665437B - Scene customizable on-site interactive AR slow live broadcast system - Google Patents
Scene customizable on-site interactive AR slow live broadcast system Download PDFInfo
- Publication number
- CN115665437B CN115665437B CN202211646371.8A CN202211646371A CN115665437B CN 115665437 B CN115665437 B CN 115665437B CN 202211646371 A CN202211646371 A CN 202211646371A CN 115665437 B CN115665437 B CN 115665437B
- Authority
- CN
- China
- Prior art keywords
- interactive
- live broadcast
- monitoring camera
- special effect
- interaction
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Landscapes
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses a scene customizable on-site interactive AR slow live broadcast system, which uploads a video picture to a server in real time through a monitoring camera, and fuses the picture, an interactive signal and an AR interactive special effect through the server according to an interactive signal generated by on-site triggering interactive equipment, so that a corresponding picture is output, audiences and users can conveniently carry out AR scene interactive interaction in the slow live broadcast process, the interactive form effect is customized and interactive and visualized, and the requirement of slow live broadcast when the audiences are released to a live broadcast platform is met.
Description
Technical Field
The invention relates to the technical field of online interactive live broadcast, in particular to a scene customizable on-site interactive AR slow live broadcast system.
Background
At present, slow live broadcast technology is available in the market everywhere, and the existing slow live broadcast technology is mostly applied to places or fields such as shopping malls, special stores, tourist attraction scenic spots, urban special street views, museums, exhibition halls and the like. Most of slow live broadcasts are live broadcast patterns which are recorded by a fixed monitoring camera synchronously and have time length exceeding several hours of an event, and the live broadcast patterns are put on a live broadcast platform, so that a live broadcast mode for audiences to watch on the live broadcast platform is provided. However, most of the existing slow live broadcasts are characterized in that no host comments, no wonderful clips and special effects, slow rhythm and simple pictures, and only a fixed monitoring camera is used for carrying out long-time live broadcasts, so that most of slow live broadcast pictures are single in content and cannot be watched in a live broadcast room for a long time by a user.
With the rapid development of the live broadcast technology, a patent scheme of 'an AR live broadcast system with virtual effect added' (CN 201821642446.4) is proposed, in which a computer is mainly used to fuse elements such as virtual characters, scenes, and basic terrains, and finally a user obtains shocked audio/video impression experience, however, the live broadcast scheme only improves the impression experience of the live broadcast user, cannot complete the on-site interactive interaction, and cannot drain online audiences to an offline site.
Disclosure of Invention
The invention aims to overcome the defects of the prior art, provides a scene customizable on-site interactive AR slow live broadcast system, and solves a series of problems that the interactive effect cannot be realized, the customization of interactive special effects cannot be realized, online audiences cannot be guided to an offline site, and the like in the conventional scheme.
The technical scheme of the invention is as follows: the utility model provides a scene customizable on-the-spot interactive AR slow live broadcast system, includes: the system comprises a monitoring camera, a server and interactive interaction equipment, wherein the server is connected and communicated with the monitoring camera and the interactive interaction equipment, and comprises an AR interactive fusion system, an AR interactive special effect, OBS software, a live broadcast platform and an interactive interaction data quantization system which are in information connection with one another;
the monitoring camera acquires video pictures, is in connection communication with the server through a network cable or wireless connection, and uploads the acquired video pictures to the server;
the server pulls a picture of the monitoring camera, then fuses the picture output by the monitoring camera with the AR special effect in real time and outputs a plug flow to each live broadcast platform for AR slow live broadcast;
and the interactive equipment triggers an interactive signal according to the real monitoring picture acquired by the monitoring camera and the interactive induction at the corresponding position, transmits the triggered interactive signal to the server and shows the AR interactive special effect.
Further, the monitoring camera is provided with RTMP or RTSP protocol.
Furthermore, the wireless connection mode between the monitoring camera and the server is 4G or 5G wireless communication.
Further, the AR interactive special effects include two types of animations:
1) When the field interactive equipment does not trigger an interactive signal, a plurality of customized AR special effect animations combined with the field environment are presented in the picture for timed carousel;
2) When the field interactive equipment sends a triggering interactive signal, the AR interactive special effect refers to the field environment and the characteristics of the scenic spot, and the display content makes the customizable AR interactive special effect content fused with the actual field environment.
Furthermore, a plurality of interactive induction marks are arranged in the image capturing range of the monitoring camera corresponding to the interactive equipment, when a user stands on or touches the interactive induction marks, the interactive equipment is triggered, corresponding interactive signals are generated, and the interactive signals are transmitted to the server.
Furthermore, the interactive interaction device adopts one or more of an infrared sensor, a touch interaction sensor or a somatosensory device.
Further, interactive equipment and interactive response sign setting are on ground, wall or the ceiling in the surveillance camera head monitoring area.
By adopting the scheme, the video pictures are uploaded to the server in real time through the monitoring camera, and the pictures are fused with the interactive signals and the AR interactive special effect through the server according to the interactive signals generated by the site-triggered interactive equipment, so that the corresponding pictures are output, the AR scene interactive interaction between audiences and users in the slow live broadcast process is facilitated, the interactive form effect is customized and the interaction is visualized, and the requirement of releasing the pictures to the live broadcast platform for slow live broadcast is met.
Drawings
FIG. 1 is a schematic block diagram of the connection of the present invention.
Detailed Description
The invention is described in detail below with reference to the figures and the specific embodiments.
Referring to fig. 1, the invention provides a scene customizable on-site interactive AR slow live broadcast system, which solves a series of problems that an interactive effect cannot be realized, customization of an interactive special effect cannot be realized, online audiences cannot be guided to an offline site, and the like in the conventional scheme.
The technical scheme of the invention is as follows: the utility model provides a scene customizable on-the-spot interactive AR slow live broadcast system, includes: the system comprises a monitoring camera, a server and interactive interaction equipment, wherein the server is in connection communication with the monitoring camera and the interactive interaction equipment.
The monitoring camera acquires a video picture, is in connection communication with the server through a network cable or wireless connection, and uploads the acquired video picture to the server; the picture pull stream can be performed using a monitoring camera with the RTMP or RTSP protocol. If the monitoring camera is convenient to use for network cable communication in the installation site, the camera and the server are connected through the network cable, and the stability of data transmission can be ensured. If the tidiness of the field environment is pursued, or the network cable is inconvenient to lay on the field, the signal transmission requirement between the camera and the server is met by adopting a 4G or 5G wireless communication mode.
And the server pulls the pictures of the monitoring camera, then fuses the pictures output by the monitoring camera with the AR special effect in real time and outputs a plug flow to each live broadcast platform for AR slow live broadcast. The server comprises an AR interactive fusion system, an AR interactive special effect, OBS software, a live broadcast platform and an interactive data quantification system which are in information connection with one another. And the server pulls the stream monitoring camera picture and outputs the picture to the AR interactive fusion system. And the pictures output by the monitoring camera and the AR interactive special effect are fused in real time in the AR interactive fusion system, and the fused interactive pictures are pushed to each live broadcast platform through OBS software to carry out AR slow live broadcast.
And the interactive equipment triggers an interactive signal according to the real monitoring picture acquired by the monitoring camera and the interactive induction at the corresponding position, transmits the triggered interactive signal to the server and shows the AR interactive special effect. The monitoring camera is provided with a plurality of interactive induction marks corresponding to the interactive induction equipment in the image capturing range, when a user stands on or touches the interactive induction marks, the interactive induction equipment is triggered, corresponding interactive signals are generated, and the interactive signals are transmitted to the server. The interactive equipment and the interactive induction mark are arranged on the ground, the wall surface or the ceiling in the monitoring area of the monitoring camera. According to a real monitoring picture, a plurality of interactive interaction devices are fixedly installed on the ground, the wall surface or the ceiling in an actual field monitoring area, interactive induction marks are made at corresponding positions, when a user stands on the interactive induction marks for a few seconds or touches the interactive interaction devices or the interactive induction marks, the interactive interaction devices are triggered, interactive interaction signals are generated and uploaded to a server, and an AR interactive special effect is displayed. The interactive interaction equipment adopts one or more of an infrared sensor, a touch interaction sensor or somatosensory equipment, is easy to install and convenient to hide, can make corresponding feedback signals according to the actions of a user, is convenient to generate corresponding AR interactive special effects in pictures, and meets the requirement of slow live broadcast interactive special effects.
The server comprises an AR interaction fusion system, an AR interaction special effect, OBS software, a live broadcast platform and an interactive interaction data quantification system which are in information connection with one another.
In the AR interactive fusion system, the actual monitoring picture of the monitoring camera is dragged to the AR interactive fusion system through an RTSP/RTMP protocol, interactive information positions of a plurality of interactive devices on the site planned on the monitoring picture are read in the AR fusion system, the manufactured AR interactive special effect content and interactive transmission signal data generated by triggering corresponding interactive positions are added to the interactive positions, the AR interactive animation content, the picture shot by the monitoring camera and the signal data of the interactive devices are fused, and finally the fused picture is converted into the RTSP protocol to be output. And performing pull streaming of pictures through OBS software, pushing the pictures output in the AR interaction fusion system to each live broadcast platform, and finally creating an AR slow live broadcast room on the live broadcast platform to perform AR slow live broadcast. Audience watches AR slow live broadcast through a live broadcast platform, and when an interactive signal is not triggered on a live broadcast site, a user can add a plurality of scene AR interactive special effects appearing in timed carousel in a live broadcast watching system. When the live broadcast site has a trigger interaction signal, the audience can see the AR interaction special effect picture which appears around the trigger due to the trigger interaction. The live audience can also arrive at a live broadcast area in person, touch or move in the area of the interactive interaction equipment so as to trigger the AR interactive special effect, watch the AR interactive special effect picture generated by the trigger interaction in the live broadcast room through mobile equipment such as a mobile phone and the like, and interact with other audiences in the live broadcast room in real time, so that the interactivity and the playability are improved, and the ornamental value of slow live broadcast is improved.
The AR interactive special effect comprises two types of animations:
1) When the field interactive equipment does not trigger an interactive signal, a plurality of customized AR special effect animations combined with the field environment are presented in the picture for timed carousel;
2) When the field interactive equipment sends a triggering interactive signal, the AR interactive special effect refers to the field environment and the characteristics of the scenic spot, and the display content makes the customizable AR interactive special effect content fused with the actual field environment.
The AR interactive special effect is switched in a simple switching mode, so that a user can make and switch automatically according to activity requirements conveniently, personalized setting is met, and a proper special effect animation and an interaction mode are selected according to different scenes.
In OBS software, the images output from the AR interaction fusion system are pulled and streamed, and the images are pushed and streamed to various slow live broadcast platforms. And the live broadcast platform carries out live broadcast picture stream pulling from OBS software, carries out slow live broadcast related setting in a live broadcast room, sets and establishes a live broadcast plan for live broadcast. The interactive data quantification system can collect, count, analyze and compare the interactive data of the users using the interactive equipment on site on line, analyze the number change of the online and offline audiences, increase the audience growth trend after AR interactive special effect live broadcast by comparison, and also analyze the audience growth trend when different AR special effect pictures are compared. The method comprises the steps of analyzing and counting growth data of interactive interaction on site, analyzing and triggering which AR interactive special effect is the largest in growth of the site interactive data, performing statistical analysis, combining the growth amount of field users who have AR special effects of site activities and are in slow live broadcasting, feeding real data back to the users, facilitating the switching and making of the most appropriate AR interactive special effects by the users according to the change of the use conditions of the users, and increasing the number of online site interactive users.
In summary, the invention uploads the video pictures to the server in real time through the monitoring camera, and fuses the pictures, the interactive signals and the AR interactive special effect through the server according to the interactive signals generated by the on-site triggering interactive equipment, thereby outputting the corresponding pictures, facilitating the interaction of the AR scenes between audiences and users in the slow live broadcast process, customizing the interactive form effect, visualizing the interaction, and meeting the requirement of slow live broadcast on a live broadcast platform.
The present invention is not limited to the above preferred embodiments, and any modifications, equivalent substitutions and improvements made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (5)
1. A scene customizable on-site interactive AR slow live broadcast system is characterized by comprising: the system comprises a monitoring camera, a server and interactive interaction equipment, wherein the server is in connection communication with the monitoring camera and the interactive interaction equipment and comprises an AR interactive fusion system, an AR interactive special effect, OBS software, a live broadcast platform and an interactive interaction data quantization system which are in mutual information interaction;
the monitoring camera acquires a video picture, is in connection communication with the server through a network cable or wireless connection, and uploads the acquired video picture to the server;
the server pulls the pictures of the monitoring camera, then fuses the pictures output by the monitoring camera with the AR special effect in real time and outputs plug flow to each live broadcast platform for AR slow live broadcast;
the interactive equipment triggers an interactive signal according to the interactive induction at the corresponding position according to the real monitoring picture acquired by the monitoring camera, transmits the triggered interactive signal to the server and displays the AR interactive special effect;
the AR interactive special effect comprises two types of animations:
1) When the field interactive equipment does not trigger an interactive signal, a plurality of customized AR special effect animations combined with the field environment are presented in the picture for timed carousel;
2) When the site interactive equipment sends a trigger interactive signal, the AR interactive special effect refers to the site environment, the characteristics of the scenic spot and the display content to manufacture customizable AR interactive special effect content fusing the site actual environment;
the monitoring camera is characterized in that a plurality of interactive induction marks are arranged in the image capture range of the monitoring camera corresponding to the interactive interaction equipment, when a user stands on or touches the interactive induction marks, the interactive interaction equipment is triggered, corresponding interactive interaction signals are generated, the interactive interaction signals are transmitted to the server, and the interactive interaction equipment and the interactive induction marks are arranged on the ground, the wall or the ceiling in the monitoring area of the monitoring camera.
2. The scene customizable live interactive AR slow live broadcast system according to claim 1, characterized in that the monitoring camera is provided with RTMP or RTSP protocol.
3. The scene customizable on-site interactive AR slow live broadcast system according to claim 1, characterized in that a wireless connection mode between the monitoring camera and the server is 4G or 5G wireless communication.
4. The scene-customizable on-site interactive AR slow-live system according to claim 1, wherein the interactive interaction device employs one or more of an infrared sensor, a touch interaction sensor, or a motion sensing device.
5. The scene-customizable on-site interactive AR slow live broadcasting system according to claim 1, characterized in that the interactive data quantification system performs statistics, analysis and comparison on the interactive data of the users using the interactive devices on-site on line, analyzes the change of the number of the online and offline audiences, compares and increases the audience growth trend after AR interactive special effect live broadcasting, and simultaneously analyzes and compares the audience growth trend when each different AR special effect picture is presented.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211646371.8A CN115665437B (en) | 2022-12-21 | 2022-12-21 | Scene customizable on-site interactive AR slow live broadcast system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211646371.8A CN115665437B (en) | 2022-12-21 | 2022-12-21 | Scene customizable on-site interactive AR slow live broadcast system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115665437A CN115665437A (en) | 2023-01-31 |
| CN115665437B true CN115665437B (en) | 2023-03-21 |
Family
ID=85022836
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211646371.8A Active CN115665437B (en) | 2022-12-21 | 2022-12-21 | Scene customizable on-site interactive AR slow live broadcast system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115665437B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117041628B (en) * | 2023-10-09 | 2024-02-02 | 腾讯科技（深圳）有限公司 | Live picture rendering method, system, device, equipment and medium |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111026261A (en) * | 2018-10-09 | 2020-04-17 | 上海奈飒翱网络科技有限公司 | Method for AR interactive display of tourist attractions |
| CN208739261U (en) * | 2018-10-10 | 2019-04-12 | 上海网映文化传播股份有限公司 | A kind of AR live broadcast system that virtual effect is added |
| CN109660818A (en) * | 2018-12-30 | 2019-04-19 | 广东彼雍德云教育科技有限公司 | A kind of virtual interactive live broadcast system |
| CN110928416A (en) * | 2019-12-06 | 2020-03-27 | 上海工程技术大学 | Immersive scene interactive experience simulation system |
| CN111640197A (en) * | 2020-06-09 | 2020-09-08 | 上海商汤智能科技有限公司 | Augmented reality AR special effect control method, device and equipment |
| CN113453035A (en) * | 2021-07-06 | 2021-09-28 | 浙江商汤科技开发有限公司 | Live broadcasting method based on augmented reality, related device and storage medium |
| CN115243059A (en) * | 2022-05-31 | 2022-10-25 | 广州播丫科技有限公司 | Direct broadcast machine for realizing slow direct broadcast through monitoring camera and working method thereof |
-
2022
- 2022-12-21 CN CN202211646371.8A patent/CN115665437B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN115665437A (en) | 2023-01-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101854529B (en) | Multi-picture network broadcast method for audience segmentation | |
| JP4927124B2 (en) | System and method for wirelessly triggering a portable device | |
| US8990842B2 (en) | Presenting content and augmenting a broadcast | |
| CN201168449Y (en) | Interactive movie theatre | |
| US20070122786A1 (en) | Video karaoke system | |
| CN106303555A (en) | A kind of live broadcasting method based on mixed reality, device and system | |
| CN106658032B (en) | Multi-camera live broadcasting method and system | |
| CN115665437B (en) | Scene customizable on-site interactive AR slow live broadcast system | |
| WO2015120413A1 (en) | Real-time imaging systems and methods for capturing in-the-moment images of users viewing an event in a home or local environment | |
| CN102307309A (en) | Somatosensory interactive broadcasting guide system and method based on free viewpoints | |
| CN105023532B (en) | Projection advertising machine and projection method thereof | |
| CN103475856A (en) | Video monitoring system applied to broadcast and TV network | |
| US20180176628A1 (en) | Information device and display processing method | |
| CN110928416A (en) | Immersive scene interactive experience simulation system | |
| KR102200239B1 (en) | Real-time computer graphics video broadcasting service system | |
| CN113259544B (en) | Remote interactive holographic demonstration system and method | |
| CN112528050B (en) | Multimedia interaction system and method | |
| CN109688450A (en) | Multi-screen interaction method, device and electronic equipment | |
| CN116931737A (en) | System and method for realizing virtual reality interaction between person and scene | |
| CN113382292B (en) | Court trial open display method for court | |
| CN104811830A (en) | Intelligent light and image special effect system | |
| CN108235142A (en) | Multi-screen real-time interactive system | |
| CN108366304A (en) | A kind of audio-visual broadcast control system and method based on virtual reality technology | |
| CN117768726B (en) | Intelligent media playing control system and audio and video display method | |
| KR20150044456A (en) | Method for providing time machine advertisement based on smart-TV with logotional advertisement function |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |