TWI811148B - Method for achieving latency-reduced one-to-many communication based on surrounding video and associated computer program product set - Google Patents

Abstract

A method for achieving latency-reduced one-to-many communication based on surrounding video and an associated computer program product set are disclosed. The method includes: a video and audio data conversion and sending step, a video and audio playback step, a unique voice communication request step, a unique voice communication execution step and a first voice playing step. The present invention uses third-party equipment to change the type of two-way video and audio transmission. One of the two sides of communication can use the surround view video and audio and the communication delay can be reduced. The present invention is no longer limited by the traditional single-view video and audio transmission. Application scenarios expands.

Description

Delay-reducing one-to-many communication method and computer program based on surround view audio and video product group

The present invention relates to a one-to-many communication method and a computer program product, in particular to a one-to-many communication method and a computer program product group based on surround view video and audio with reduced delay.

Before the 20th century, the main technology for real-time communication between people was the telephone. The communicators at both ends of the microphone can say what they want to say at any time, and hear the other party's voice almost without time difference. It is a pity that the communicator cannot obtain the image of the other party. At that time, videotelephony (Videotelephony) was already in practical use, such as combining an audio (telephone) system with two closed-circuit television systems connected by coaxial cable or radio. This two-way communication system is relatively expensive, and the experience of audio and video synchronization is not very good. It wasn't until the late 20th century, with the advent of powerful video codecs, combined with high-speed broadband Internet and integrated service digital network services, that videophones became a practical technology for routine use. In the 21st century, the software and hardware architecture and communication specifications of network communication have become more perfect, and network-based instant messaging technology products (such as SKYPE) have gradually changed the way of real-time communication between people. People began to communicate with others through video and audio with almost no delay, and the communication vehicle has also changed from a desktop computer to a smart phone. What's more, audio-visual communication has already changed from one-to-one to multi-point communication. Coupled with the maturity of streaming technology, multi-point audio-visual The immediacy and image quality (through compression technology) of the information are also greatly improved. This kind of technological advancement allows people to collaborate remotely and maintain economic operations in today's pandemic.

Surround image is a recently mature and popular technology that expands people's field of vision. Surround view images are recorded synchronously by multiple lenses framing views in different directions. Through image stitching technology, the images obtained by these lenses at the same time are integrated into one after another surround view images. The viewer can rotate the panorama image to see different scenes from different perspectives. Traditionally, single-view images (images recorded with a single lens) are used in streaming technology instead of surround-view images. However, with the completion of related streaming protocols (such as HTTP Live Streaming, HLS), surround view images can also be streamed and broadcasted, so that most people can watch them simultaneously. Surround image recording can also cooperate with radio equipment to capture background sound to achieve the purpose of one-way audio-visual communication. If the image receiver needs to communicate with the sender, it needs to use another set of audio-visual communication equipment, usually using single-view audio-visual. As far as multi-directional communication is concerned, if single-view audio and video are used, the network bandwidth used is smaller and the quality is better, but it is suitable for situations where the communicators are in a fixed position relative to the camera, such as in online conferences. If one of the communication parties uses surround view audio and video, the activity space of the party will be large, and there will be more application scenarios, such as online teaching and online travel that has become popular recently (the tour guide records the beautiful scenery and explains it at the scenic spot, through the Internet) live streaming to interact with online tourists), but there is currently no suitable solution.

This paragraph extracts and compiles certain features of the present invention. Other features will be disclosed in subsequent paragraphs. It is intended to cover various modifications and similar arrangements within the spirit and scope of the appended claims.

In order to meet the above requirements, the present invention discloses a one-to-many communication method based on surround view audio and video with reduced delay, including: a video and audio data conversion and sending step: a relay server receives a live broadcast from a surround view video and audio recording device A plurality of first ambient video stream packets encoded by the protocol, these The first surround view video stream packet is sequentially converted into a plurality of second surround view video stream packets according to the web real-time communication (Web Real-Time Communication, WebRTC) application program interface, and these second surround view video stream packets The packet is sent to a plurality of audio-visual communication devices connected to the relay server; an audio-visual playing step: respectively playing a continuous ambient video corresponding to the second ambient video streaming packets on the audio-visual communication devices; Unique voice communication request step: each of at least one audio-visual communication device converts a first voice into a plurality of first voice packets conforming to a voice protocol, and sends the first voice packets to the relay together with a communication request command Server; a unique voice communication execution step: the relay server sends these first voice packets to a voice communication device connected to its information, wherein, if more than two audio-visual communication devices send the communication request command, The first voice packet sent by the audio-visual communication device that sends out the communication request first will be sent to the voice communication device, and the first voice packets sent by other audio-visual communication devices are discarded; and a first voice dialing step: by the audio-visual communication device The voice communication device plays the first voice corresponding to the first voice packet sent by the relay server.

The one-to-many communication method based on surround view audio and video with reduced delay may further include: a specific object voice communication request step: converting a second voice into several second voices conforming to the voice agreement by the voice communication device packets, the second voice packets are sent to the relay server together with a designated communication request command, wherein the designated communication request command designates the second voice relays to be sent to a designated audio-visual communication device; a specific object voice communication is executed Step: sending the second voice packets by the relay server to the designated audio-visual communication device designated by the designated communication request command; The second voice corresponding to the second voice packet sent by the server.

According to the present invention, the surround view video recording device can further mix a fixed text, a horse racing text, an image and/or a background sound into at least one period of the continuous surround view video.

Preferably, the live broadcast protocol is Real-Time Messaging Protocol (RTMP) or encrypted real-time messaging protocol (RTMP-S).

Preferably, the voice protocol is H.323 specification, Session Initiation Protocol (Session Initiation Protocol, SIP) or Media Gateway Control Protocol (Media Gateway Control Protocol, MGCP).

Preferably, the audio-visual communication device is a smart phone, a tablet computer, a notebook computer, a desktop computer, smart glasses with a broadcasting function, or a head-mounted stereoscopic image player with a broadcasting function.

Preferably, the voice communication device is a smart phone or a tablet computer.

The present invention also discloses a computer program product group for one-to-many communication with reduced delay based on surround view video and audio, including: a first computer program product, loaded into the program via a relay server for execution: a first program instruction: receiving a plurality of first surround view video stream packets encoded by a live broadcast protocol from a surround view video recording device; The program interface is converted into a plurality of second ambient video streaming packets; a third program instruction: sending these second ambient video streaming packets to a plurality of audio-visual communication devices connected to the relay server information; a The 4th program command: receive several first voice packets from at least one audio-visual communication device and send a communication request command; and a 5th program command: send these first voice packets to a voice communication device connected with its information , wherein, if more than two audio-visual communication devices issue the communication request command, the first audio packet sent by the audio-visual communication device that first issued the communication request will be sent to the audio communication device, and the second voice packet sent by the other audio-visual communication devices A voice packet is discarded; and a second computer program product is loaded into the program via any audio-visual communication device for execution: a sixth program instruction: respectively play the corresponding second surround-view audio-visual streaming packets on the audio-visual communication device a continuous surround view audio-visual; a seventh program instruction: each of at least one audio-visual communication device converts a first voice into a plurality of first voice packets conforming to a voice protocol; and an eighth program instruction: convert The first voice packets are sent to the relay server together with the communication request command.

The computer program product group of one-to-many communication with reduced delay based on surround view audio and video further includes: a third computer program product, loaded into the program through the voice communication device and executed: a ninth program instruction: play the relay The first voice corresponding to the first voice packet sent by the server.

The third computer program product can further execute: a tenth program instruction: convert a second voice into a plurality of second voice packets conforming to the voice protocol; and an eleventh program instruction: combine these second voice packets with A designated communication request command is sent to the relay server, wherein the designated communication request command designates the second voice relays to send to a designated audio-visual communication device. The first computer program product may further execute: a twelfth program instruction: send the second voice packets to the designated audio-visual communication device designated by the designated communication request instruction. The second computer program product may further execute: a thirteenth program instruction: the designated audio-visual communication device plays the second voice corresponding to the second voice packet sent by the relay server.

The present invention uses third-party equipment to change the type of two-way audio-visual transmission, one of which uses surround-view audio-visual and can reduce communication delay. The present invention is no longer limited to the traditional single-view video and audio transmission, and expands the application scenarios.

1: Internet

10:Relay server

20: Surround view audio and video recording device

31: The first audio-visual communication device

32: Second audio-visual communication device

40:Voice communication device

41: Display interface

A: tour guide

B: Cloud tourists

C: Cloud tourists

FIG. 1 is a schematic diagram of a hardware architecture of an application of a one-to-many communication method with reduced delay based on surround view audio and video according to an embodiment of the present invention.

FIG. 2 is a flow chart of the delay-reducing one-to-many communication method based on surround view audio and video.

FIG. 3 is a sequence operation diagram of applying the one-to-many communication method with reduced delay based on surround view audio and video to the hardware architecture of FIG. 1 .

FIG. 4 illustrates an application scenario of the delay-reducing one-to-many communication method based on surround view audio and video.

FIG. 5 illustrates a display interface of a voice communication device.

The present invention will be described more specifically by referring to the following embodiments.

Please refer to FIG. 1 to FIG. 3. FIG. 1 is a schematic diagram of the hardware architecture of a one-to-many communication method (hereinafter referred to as the method) based on surround view audio and video with reduced delay according to an embodiment of the present invention, and FIG. 2 is a schematic diagram of the application of the method. As a flow chart, FIG. 3 is a timing diagram of the method applied to the hardware architecture of FIG. 1 .

The first step of the method is the audio-visual data conversion and sending step, and its content is that a relay server 10 receives a plurality of first surround-view video stream packets encoded by a live protocol from a surround-view video recording device 20, converting the first ambient video streaming packets into a plurality of second ambient video streaming packets in sequence according to the Web Real-Time Communication (WebRTC) application programming interface (Application Programming Interface, API), and Send the second surround view video stream packets to a plurality of video communication devices connected to the relay server 10 ( S01 ). According to the present invention, the type of the relay server 10 is not limited, but it needs to be able to execute the program advocated by the present invention to convert the image format, and it is not itself a hardware for storing image files and providing users as needed. Surround view video recording device 20 is an electronic device that can record 360-degree continuous surround view images around itself and simultaneously record background sound (continuous surround view video). Compared with general unidirectional audio-visual recording devices (such as motion cameras), the panoramic video-audio recording device 20 has several cameras with different directions, and each camera simultaneously records a part of the panoramic image, and the panoramic video-audio recording The internal circuit of the device 20 stitches all the partial images at the same time into one panoramic image. The continuous surround view video will be encoded into several first surround view stream packets through the live broadcast protocol before being output, so as to be output sequentially without being easily disturbed. Since the continuous surround view video is continuously recorded, the first surround view stream packet will also be generated and output synchronously. The live broadcast protocol is a specification for making the first ambient video streaming package (wireless signal). According to the present invention, the live broadcast protocol can be, but not limited to, Real-Time Messaging Protocol (RTMP) or Encrypted Instant Messaging Protocol (RTMP-S). In this embodiment, RTMP is taken as an example for illustration.

According to RTMP, the first surround view video stream packets are transmitted by the surround view video recording device 20 to the relay server 10 through the network (such as a wireless communication network), and the surround view video recorder 20 transfers these first surround view The video and audio streaming packets are sequentially converted into a plurality of second surround view video and audio streaming packets according to the API of WebRTC. RTMP encoding is used by most mainstream streaming platforms and devices, and its encoding is suitable for long-term playback. However, RTMP technology will produce a certain cumulative delay, because the server using RTMP will cache the lost picture files, resulting in a delay in the picture. Therefore, when watching RTMP live video, whether it is a surround-view video or not, the viewer will feel obvious delay. In order to solve the unavoidable delay caused by RTMP, the first ambient video stream packet is converted into the second ambient video stream packet which is not in the RTMP specification, so as to avoid the delay caused by the specification limitation. WebRTC is a technology that provides web applications and websites to record video or play streaming audio and video on demand. It can directly use the browser to exchange data without going through intermediary services, further reducing the occurrence of delays. Due to this conversion, the experience of the viewer who watches the continuous surround view video through the audio-visual communication device can be closer to real time (Real Time). According to the present invention, the audio-visual communication device for playing continuous surround-view video and audio can be a smart phone, a tablet computer, a notebook computer or a desktop computer. Since the continuous surround view audio and video provides stereoscopic images, the audio and video communication device can also be smart glasses with a broadcasting function or a head-mounted stereoscopic image player with a broadcasting function. For the convenience of description, in the embodiment, two audio-visual communication devices, the first audio-visual communication device 31 and the second audio-visual communication device 32 , are taken as an example for illustration. In practice, the number of audio-visual communication devices is not limited to two, but can be more. As shown in FIG. 3 , at time T1, the surround view video recording device 20 starts to record continuous surround view videos and continuously sends the first surround view video stream packets to the relay server 10, and the relay server 10 is switching After the surround view video stream packet is sent, the corresponding second surround view video stream packet is sent to the first video communication device 31 and the second video communication device 32 at time T2. The gap between T1 and T2 is much shorter than the intermediary time difference (server processing time) using only general live streaming protocols. In addition, according to the present invention, the actions performed in step S01 are continuous, represented by "...". Since the relay server 10 does not need to back up the first surround view video streaming packet and the second surround view video streaming packet like a general live server, the surround view video recording device 20 and the first video communication device 31 or the second The audio-visual communication devices 32 present a substantial point-to-point connection.

The second step of the method is an audio-visual playing step: respectively playing the continuous ambient video corresponding to the second ambient video streaming packets on the audio-visual communication devices ( S02 ). The first audio-visual communication device 31 and The second audio-visual communication device 32 is installed with application software or special-made hardware for decoding the second surround-view video stream packet in WebRTC format, so that continuous surround-view video can be played thereon. Step S01 and Step S02 complete the "one-to-many communication" based on surround view audio and video and reduce delay. The person holding the surround view video recording device 20 (hereinafter referred to as the first communicator) can speak to the microphone of the surround view video recording device 20, and what he says will become part of the background sound of the continuous surround view video. The first communicator may also not speak, and let the recorded continuous surround view image and background sound become the communication means for him to communicate with the person holding the first audio-visual communication device 31 and the second audio-visual communication device 32 (hereinafter referred to as the second communicator). content. If necessary, the control module of the surround view video and audio recording device 20 can be programmed and controlled so that the first communicator can operate the surround view video and audio recording device 20 to record a fixed text, a horse racing character, an image and/or A background sound is mixed into at least one period of the continuous ambient video. In this way, in the continuous panoramic images received by the first audio-visual communication device 31 and the second audio-visual communication device 32, word cards and marquees can be seen, and sound effects can be heard, which can increase the atmosphere when watching, and can more effectively understand the first communication. The message people want to express.

If the second communicator (in this embodiment, there are 2 people) will feed back information (according to the present invention, the feedback message is voice) to the first communicator, there will be the following problems: first, the surround view video and audio recording device 20 It does not have a loudspeaker or other loudspeaker devices; secondly, if two second communicators want to speak to the first communicator at the same time, the first communicator can only receive the voice of one second communicator at the moment. Steps S03 to S05 are techniques to solve this problem.

The third step of the method is a unique voice communication requirement step: each of at least one audio-visual communication device converts a first voice into a plurality of first voice packets conforming to a voice protocol, and these first voice packets are combined with a communication The request command is sent to the relay server 10 (S03). The first audio-visual communication device 31 or the second audio-visual communication device 32 can convert the words (first voice) that the second correspondent wants to say into several first voice packets that can be sent out, and the conversion standard is as follows: is a voice protocol. According to the present invention, the voice agreement can be, but not limited to, the H.323 specification, the session initiation agreement (Session Initiation Protocol, SIP) or the media gateway control protocol (Media Gateway Control Protocol, MGCP), It is a commonly used IP-based voice transmission (Voice over Internet Protocol, VoIP). The establishment of communication between the audio-visual communication device and the relay server 10 requires a lot of messages or instructions. The communication request command is sent by the audio-visual communication device actively, and the command to establish a unique voice communication with the voice communication device 40 requires the relay server 10 to execute. .

Then, the fourth step of the method is a unique voice communication execution step: the relay server 10 sends these first voice packets to a voice communication device 40 connected to its information, wherein, if there are more than two audio-visual communication devices When the communication request command is issued, the first voice packet sent by the audio-visual communication device that issued the communication request first will be sent to the audio communication device, and the first voice packets sent by other audio-visual communication devices will be discarded (S04). The voice communication device 40 is owned by the first communicator and is different from the surround view video and audio recording device 20 and can communicate with the second communicator. According to the present invention, the voice communication device 40 is preferably a smart phone or a tablet computer. For a better understanding of this step, please refer to Figure 3 again. At time T3, the second communicator holding the first audio-visual communication device 31 wants to speak to the first communicator, and he operates the first audio-visual communication device 31 to convert what he said into the first voice packet A, the first voice The packet A is sent to the relay server 10 together with the communication request command. If the second correspondent holding the second audio-visual communication device 32 does not want to talk to the first correspondent, the first voice packet A will be directly forwarded by the relay server 10 to the voice communication device 40 . Unfortunately, however, the second communicator holding the second audio-visual communication device 32 wants to talk to the first communicator. He operates the second audio-visual communication device 32 at time T4 to convert what he said into the first voice packet B, the second A voice packet B is also sent to the relay server 10 together with the communication request command. Since the second audio-visual communication device 32 sends out the communication request command later, the relay server 10 sends the first voice packet A to the voice communication device 40 at time T5, and the first voice packet B is discarded in the relay server 10 .

Next, the fifth step of the method is the step of playing the first voice: the voice communication device 40 plays the first voice corresponding to the first voice packet sent by the relay server 10 ( S05 ). So far, the first communicator can hear the voice from the first audio-visual communication device 31 through the voice communication device 40 .

If the first correspondent wants to speak to a specific second correspondent, but does not want other second correspondents to hear, the method provides additional steps to solve this problem. The following object-specific communication steps can be interspersed after step S02.

The first specific object communication step of the method is a specific object voice communication requirement step: a second voice is converted into several second voice packets conforming to the voice agreement by the voice communication device 40, and these second voice packets are together with a specified The communication request command is sent to the relay server 10, wherein the designated communication request command designates the second voice relays to send to a designated audio-visual communication device (S06). The second voice is the words spoken by the first communicator, and a plurality of second voice packets are generated according to the aforementioned voice protocol. The specified reply communication is operated by the voice communication device 40 , such as through a mobile application program installed thereon, to specify to the relay server 10 to request to relay and send the command signals of the second voices. In this embodiment, the specified audio-visual communication device is the first audio-visual communication device 31 . As shown in FIG. 3 , the first correspondent operates the voice communication device 40 at time T6 to send the designated communication request command and the second voice packet to the relay server 10 .

Next, the second specific object communication step of the method is the specific object voice communication execution step: the relay server 10 sends the second voice packets to the designated audio-visual communication device designated by the designated communication request command (S07). As shown in FIG. 3 , at time T7, the relay server 10 sends these second voice packets to the first audio-visual communication device 31, and sends the words of the first correspondent to the first audio-visual communication device 31. Two correspondents.

Finally, the third specific object communication step of the method is the second voice playing step: the designated audio-visual communication device plays the second voice corresponding to the second voice packet sent by the relay server 10 (S08). So far, the second communicator can listen to what the first communicator said through the first audio-visual communication device 31 .

Please refer to FIG. 4, which shows an application scenario of this method, and this application scenario is a remote real-time tour guide. The aforesaid first communicator is a tour guide A, who is carrying a surround view video and audio recording device 20 and a voice communication device 40 (such as a smart phone) to introduce scenic spots in Bali. The second communication of the first audio-visual communication device 31 The person is cloud tourist B located in Taipei, watching the direct dial of tour guide A from a distance, and his first audio-visual communication device 31 is a tablet computer. The second communicator of the second audio-visual communication device 32 is cloud tourist C located in Kaohsiung. He can also remotely watch the direct dialing of tour guide A at the same time. His second audio-visual communication device 32 is a notebook computer. The surround view video recording device 20 , the voice communication device 40 , the first video communication device 31 and the second video communication device 32 are signally connected to the relay server 10 through the network 1 to execute the method. Please refer to FIG. 5 , which shows the display interface 41 of the voice communication device 40 . If tour guide A wants to talk to tourist B in the cloud, tour guide A can operate the display interface 41 of the voice communication device 40, for example, press the image marked with tourist B in the cloud (shown in the upper left frame) and speak to the voice communication device 40, then he The speech will be sent to the relay server 10 along with the communication request command, and finally transmitted to the first audio-visual communication device 31, but the second audio-visual communication device 32 will not receive it.

According to the present invention, the aforesaid one-to-many communication method with reduced delay based on surround view video and audio is implemented on different devices, mainly by executing programs installed on individual hardware. Therefore, the present invention also discloses a computer program product group, the computer program product group includes a first computer program product, a second computer program product and a third computer program product.

The first computer program product can be loaded through the relay server 10 to execute the following program instructions: a first program instruction: receive a plurality of first surround view video streams encoded by a live protocol from a surround view video recording device stream packets; a second program instruction: convert these first surround view video stream packets into a plurality of second surround view video stream packets in sequence according to the webpage instant messaging application program interface; a third program instruction: convert the Send some second surround view audio-visual streaming packets to a plurality of audio-visual communication devices connected to the relay server; a fourth program instruction: receive several first voice packets and a communication request from at least one audio-visual communication device Command sending; and a 5th program command: send these first voice packets to a voice communication device connected to its information, if more than two audio-visual communication devices send the communication request command, first send the video-video communication of the communication request The first voice packet sent by the device is sent to the voice communication device, and the first voice packets sent by other audio-visual communication devices are discarded.

The second computer program product can be loaded through any audio-visual communication device to execute the following program instructions: a sixth program instruction: respectively play a continuous ambient scene corresponding to the second ambient video streaming packets on the audio-visual communication device Audio-visual; a 7th program instruction: each of at least one audio-visual communication device converts a first voice into a plurality of first voice packets conforming to a voice protocol; and an 8th program instruction: convert these first voice The packet is sent to the relay server together with the communication request command. The second computer program product may be a mobile application program, which is presented on the audio-visual communication device with a specific interface and accepts user operations.

The third computer program product can be loaded through the voice communication device 40 to execute the following program instructions: a ninth program instruction: play the first voice corresponding to the first voice packet sent by the relay server 10 . The third computer program product can also be a mobile application program, which is presented on the voice communication device 40 with a specific interface to accept user operations.

In order to perform voice transmission from the voice communication device 40 to the audio-visual communication device, the third computer program product can further execute: a tenth program instruction: convert a second voice into several second voice packets conforming to the voice protocol; An eleventh program command: sending the second voice packets together with a designated communication request command to the relay server 10, wherein the designated communication request command designates the second voice relays to be sent to a designated audio-visual communication device. At the same time, the first computer program product further executes: a twelfth program instruction: sending the second voice packets to the designated audio-visual communication device designated by the designated communication request instruction. Finally, the second computer program product further executes: a thirteenth program instruction: the designated audio-visual communication device plays the second voice corresponding to the second voice packet sent by the relay server 10 .

Likewise, the surround view video recording device 20 may further mix a fixed text, a horse racing text, an image and/or a background sound into at least one period of the continuous surround view video. However, this function must obtain the operation interface or source code developed by the manufacturer of the surround view video and audio recording device 20 , so as to add related functions to the surround view video and audio recording device 20 . The aforementioned live broadcast protocol can be an instant message protocol or Encrypted Instant Messaging Protocol. The voice protocol can be the H.323 specification, a session initiation protocol or a media gateway control protocol. The audio-visual communication device can be a smart phone, a tablet computer, a notebook computer, a desktop computer, smart glasses with a broadcasting function, or a head-mounted stereoscopic image player with a broadcasting function. The voice communication device can be a smartphone or a tablet.

Although the present invention has been disclosed above in terms of implementation, it is not intended to limit the present invention. Anyone with ordinary knowledge in the technical field may make some changes and modifications without departing from the spirit and scope of the present invention. Therefore, The scope of protection of the present invention should be defined by the scope of the appended patent application.

Claims (14)

A one-to-many communication method based on surround view audio and video with reduced delay, comprising: a step of converting and sending audio and video data: receiving by a relay server a plurality of first loops encoded by a live protocol from a surround view video and audio recording device Scene video stream packets, converting the first surround view video stream packets into a plurality of second surround view video stream packets sequentially according to the web real-time communication (Web Real-Time Communication, WebRTC) application program interface, and converting The second ambient video streaming packets are sent to a plurality of audio-visual communication devices connected to the relay server; an audio-visual playing step: playing the second ambient video streaming packets on the audio-visual communication devices respectively Corresponding to a continuous surround view audio-visual; a unique voice communication requires a step: each of at least one audio-visual communication device converts a first voice into a plurality of first voice packets conforming to a voice protocol, and the first voice packets together with A communication request command is sent to the relay server; a unique voice communication execution step: the relay server sends these first voice packets to a voice communication device connected to its information, wherein, if there are more than two When the audio-visual communication device issues the communication request instruction, the first voice packet sent by the audio-visual communication device that first issued the communication request will be sent to the audio-visual communication device, and the first voice packets sent by other audio-visual communication devices will be discarded; A voice playing step: the first voice corresponding to the first voice packet sent by the relay server is played by the voice communication device; a specific object voice communication request step: the voice communication device sends a second converting the voice into several second voice packets conforming to the voice protocol, and sending the second voice packets to the relay server together with a designated communication request command, wherein the designated communication request command designates the second voice relay to send to a designated audio-visual communication device; A voice communication execution step for a specific object: the relay server sends the second voice packets to the specified audio-visual communication device designated by the specified communication request command; and a second voice playback step: the specified audio-visual communication The device plays the second voice corresponding to the second voice packet sent by the relay server. The one-to-many communication method based on surround view audio and video with reduced delay as described in claim 1, wherein the surround view video and audio recording device further mixes a fixed text, a horse racing text, an image and/or a background sound into the During at least one period of continuous surround view video. The delay-reducing one-to-many communication method based on ambient video and audio as described in claim 1, wherein the live broadcast protocol is Real-Time Messaging Protocol (RTMP) or encrypted real-time messaging protocol (RTMP-S). The one-to-many communication method based on surround view audio and video as described in claim 1, wherein the voice protocol is H.323 specification, session initiation protocol (Session Initiation Protocol, SIP) or media gateway control protocol (Media Gateway Control Protocol, MGCP). The delay-reducing one-to-many communication method based on surround view audio and video as described in claim 1, wherein the audio and video communication device is a smart phone, a tablet computer, a notebook computer, a desktop computer, smart glasses with a broadcasting function, or A head-mounted stereoscopic image player with a broadcasting function. The delay-reducing one-to-many communication method based on surround view video and audio as described in Claim 1, wherein the voice communication device is a smart phone or a tablet computer. A computer program product group for one-to-many communication with reduced delay based on surround view video and audio, comprising: a first computer program product, loaded into the program via a relay server for execution: A first program instruction: receive a plurality of first surround view video stream packets encoded by a live broadcast protocol from a surround view video recording device; a second program instruction: convert these first surround view video stream packets according to The procedure is converted into a plurality of second surround view video streaming packets according to the web instant messaging application program interface; a third program instruction: send these second surround view video stream packets to a plurality of packets connected to the relay server information Audio-visual communication device sending; a 4th program instruction: receiving several first voice packets from at least one audio-visual communication device and sending a communication request instruction; and a 5th program instruction: sending these first voice packets to its information A voice communication device connected, wherein, if more than two audio-visual communication devices issue the communication request command, the first voice packet sent by the audio-visual communication device that first issued the communication request will be sent to the voice communication device, and the other audio-visual communication devices The first voice packet sent by the communication device is discarded; and a second computer program product is loaded into the program via any audio-visual communication device for execution: a sixth program instruction: play the second loops on the audio-visual communication device respectively A continuous surround view video stream packet corresponding to the scene video stream; a 7th program instruction: convert a first voice into a plurality of first voice packets conforming to a voice protocol by each of at least one audio-visual communication device; and a The eighth program instruction: send the first voice packets together with the communication request instruction to the relay server; and a third computer program product, which is loaded into the program via the voice communication device for execution: a ninth program instruction: playing the first voice corresponding to the first voice packet sent by the relay server; A 10th program instruction: convert a second voice into several second voice packets conforming to the voice agreement; and an 11th program instruction: send these second voice packets together with a designated communication request command to the relay The server, wherein the designated communication request command designates the second voice relays to be sent to a designated audio-visual communication device. The one-to-many communication computer program product group based on surround view audio and video as described in claim 7, wherein the first computer program product further executes: a twelfth program instruction: sending these second voice packets to The specified audio-visual communication device specified by the specified communication request command. The computer program product group of one-to-many communication with reduced delay based on surround view video and audio as described in claim 8, wherein the second computer program product further executes: a thirteenth program instruction: played by the designated audio-visual communication device The second voice corresponding to the second voice packet sent by the relay server. The computer program product group of one-to-many communication with reduced delay based on surround view video and audio as described in claim 7, wherein the surround view video and audio recording device further records a fixed text, a horse racing text, an image and/or a Background sound is mixed into at least one period of the continuous ambient video. The computer program product group for one-to-many communication with reduced delay based on surround view video and audio as described in claim 7, wherein the live broadcast protocol is an instant message protocol or an encrypted instant message protocol. The set of computer program products for one-to-many communication with reduced delay based on Surround View Audio and Video as described in Claim 7, wherein the voice protocol is H.323 specification, session initiation protocol or media gateway control protocol. The computer program product group of one-to-many communication with reduced delay based on surround view audio-visual as described in claim 7, wherein the audio-visual communication device is a smart phone, a tablet computer, a notebook computer, a desktop computer, and has a broadcasting function smart glasses or head-mounted stereoscopic video player with broadcasting function. The computer program product group for one-to-many communication with reduced delay based on surround view video and audio as described in claim 7, wherein the voice communication device is a smart phone or a tablet computer.