CN116896546A - Visual intercom method, system and storage medium based on SRT communication protocol - Google Patents

Abstract

The invention provides a visual intercom method, a system and a storage medium based on an SRT communication protocol, relating to the field of visual intercom processing, wherein the method comprises the following steps: responding to the first request information; generating a first SRT push-pull stream address; sending a first SRT push-pull stream address to a target end so as to establish a first SRT push-pull stream link with the target end; generating a second SRT push-pull stream address; sending a second SRT push-pull stream address to establish a second SRT push-pull stream link with the client; and transmitting the audio data and the video data according to the first SRT push-pull stream link and the second SRT push-pull stream link. The SRT protocol is combined with the URL technology, and the link can be conveniently and rapidly established with the media server through the first SRT push-pull stream address and the second SRT push-pull stream address, so that the link establishment process is simplified, video and audio are transmitted on the same SRT push-pull stream link channel, an intercom channel is not required to be additionally established, and the lightweight link establishment is realized.

Description

Video intercom method, system and storage medium based on SRT communication protocol

Technical field

The present invention relates to the technical field of video intercom processing, and in particular to a video intercom method, system and storage medium based on SRT communication protocol.

Background technique

In the existing technology, remote real-time video intercom includes methods based on RTMP (Real-Time Messaging Protocol) protocol and solutions based on WebRTC technology. However, the RTMP protocol has shortcomings such as poor real-time performance, accumulated delay, and does not support H.265 encoding. In addition, the RTMP protocol is based on TCP protocol transmission and uses non-public port 1935, making it difficult to pass the firewall. In addition, because RTMP does not support two-way communication, if an intercom channel needs to be established, a separate voice intercom channel needs to be established, which increases the technical difficulty of implementation. For WebRTC technology, P2P is used based on the browser, that is, point-to-point connection, which has poor security. In a complex network environment, video quality cannot be guaranteed. WebRTC technology is more complex, not lightweight enough, and lacks the deployment of server solutions, which cannot meet the needs of the media. Massive distribution of data. In summary, the existing video intercom method has the problems of complicated process of establishing link channels, the need to establish additional intercom channels, and not being lightweight enough.

Contents of the invention

The present invention provides a visual intercom method, system and storage medium based on SRT communication protocol to solve the defects in the prior art that the process of establishing a link channel is complicated, additional intercom channels need to be established, and it is not lightweight enough.

The present invention provides a visual intercom method based on SRT communication protocol, which is applied to media servers and includes:

In response to the client's first request information, the first request information includes client identification information of the client and target identification information of the target terminal;

According to the first request information, generate the first SRT push-pull stream address corresponding to the target end according to the URL format;

Send the first SRT push-pull flow address to the target end to establish a first SRT push-pull flow link with the target end;

Generate a second SRT push-pull stream address according to the URL format according to the first SRT push-pull stream link and the first request information;

Send the second SRT push-pull stream address to the client to establish a second SRT push-pull stream link with the client;

Transmit audio data and video data between the client and the target according to the first SRT push-pull stream link and the second SRT push-pull stream link;

Wherein, the first SRT push-pull stream address and the second SRT push-pull stream address are used to indicate establishing a link for push and pull multiplexing based on the SRT protocol.

According to the video intercom method based on the SRT communication protocol provided by the present invention, the first SRT push-pull stream address corresponding to the target end is generated according to the URL format according to the first request information, including:

Determine target terminal identification information according to the first request information;

Generate first key information according to the target identification information;

Generate the first SRT push-pull stream address according to the URL format according to the target identification information and the first key information;

Wherein, the first SRT push-pull stream address includes an SRT protocol field, a first key field corresponding to the first key information, and a first push-pull stream identification field.

According to the video intercom method based on the SRT communication protocol provided by the present invention, the second SRT push-pull stream address is generated according to the URL format according to the first SRT push-pull stream link and the first request information, including:

When the first SRT push-pull stream link is established, determine the client identification information according to the first request information;

Generate second key information according to the client identification information;

Generate the second SRT push-pull stream address according to the URL format according to the client identification information and the second key information;

Wherein, the second SRT push-pull stream address includes an SRT protocol field, a second key field corresponding to the second key information, and a second push-pull stream identification field.

According to the video intercom method based on the SRT communication protocol provided by the present invention, sending the first SRT push-pull flow address to the target end to establish a first SRT push-pull flow link with the target end includes:

Send the first SRT push-pull flow address to the signaling server to instruct the signaling server to forward the first SRT push-pull flow address to the target end;

In response to the second request information, establish a first SRT push-pull stream link with the target end;

Wherein, the second request information is generated based on the first SRT push-pull stream address.

According to the video intercom method based on the SRT communication protocol provided by the present invention, sending the second SRT push-pull stream address to the client to establish a second SRT push-pull stream link with the client includes:

Send the second SRT push-pull flow address to the signaling server to instruct the signaling server to forward the second SRT push-pull flow address to the client;

In response to the third request information, establish a second SRT push-pull stream link with the client;

Wherein, the third request information is generated based on the second SRT push-pull stream address.

According to the video intercom method based on the SRT communication protocol provided by the present invention, according to the first SRT push-pull flow link and the second SRT push-pull flow link, the transmission between the client and the target end is After the audio data and video data, it also includes:

In response to the client's stop request, close the second SRT push-pull stream link;

If data cannot be obtained from the client and continues for a preset time, the first SRT push-pull stream link is closed.

The video intercom method based on SRT communication protocol provided by the present invention is applied to the client and includes:

Send first request information to the signaling server, where the first request information includes client identification information of the client and target identification information of the target terminal;

Obtain the second SRT push-pull flow address from the signaling server;

Establish a second SRT push-pull stream link with the media server according to the second SRT push-pull stream address;

Establish a session keep-alive link with the signaling server, the session keep-alive link being used to maintain the second SRT push-pull flow link;

According to the second SRT push-pull stream link, audio data is sent to the media server to instruct the media server to forward audio data to the target end, and audio data and video data of the target end are obtained from the media server.

According to the video intercom method based on the SRT communication protocol provided by the present invention, during the push-pull stream link according to the second SRT, audio data is sent to the media server to instruct the media server to forward the audio data to the target. end, after obtaining the audio data and video data of the target end from the media server, it also includes:

In response to the stop operation, closing the session keepalive link with the signaling server;

Send a stop request to the media server to close the second SRT push-pull stream link.

The video intercom method based on SRT communication protocol provided by the present invention is applied to the target end and includes:

Get the first SRT push-pull stream address;

Establish a first SRT push-pull stream link with the media server according to the first SRT push-pull stream address;

According to the first SRT push-pull stream link, video data and audio data are sent to the media server to instruct the media server to forward the video data and audio data to the client, and the audio data of the client is obtained from the media server.

According to the video intercom method based on the SRT communication protocol provided by the present invention, according to the first SRT push-pull stream link, video data and audio data are sent to the media server to instruct the media server to forward the video data and Audio data to the client. After obtaining the audio data of the client from the media server, it also includes:

When the audio data of the client cannot be obtained from the media server and continues for a preset time, the first SRT push-pull stream link is closed.

The video intercom method based on the SRT communication protocol provided by the present invention is applied to the signaling server and includes:

In response to the client's first request information, the first request information includes client identification information of the client and target identification information of the target terminal;

Forward the first request information to the media server to obtain the first SRT push-pull stream address;

Send the first SRT push-pull stream address to the target end, so that the target end establishes a first SRT push-pull stream link with the media server based on the first SRT push-pull stream address;

Obtain the second SRT push-pull stream address from the media server;

The second SRT push-pull stream address is sent to the client, so that the client establishes a second SRT push-pull stream link with the media server based on the second SRT push-pull stream address.

The present invention also provides a video intercom system, including: a client device, a target device, a signaling server and a media server; the client device sends the first request information to the signaling server; the signaling server forwards The first request information is sent to the media server; the media server generates the first SRT push-pull stream address corresponding to the target device according to the URL format according to the first request information, and sends the first SRT push-pull stream address. stream address to the signaling server; the signaling server forwards the first SRT push-pull stream address to the target device; the target device establishes a connection with the media server based on the first SRT push-pull stream address. A first SRT push-pull stream link; the media server generates a second SRT push-pull stream address based on the first SRT push-pull stream link and the first request information, and sends the second SRT push-pull stream address to the signaling Server; the signaling server forwards the second SRT push-pull stream address to the client device; the client device establishes a second SRT push-pull stream link with the media server based on the second SRT push-pull stream address; The media server obtains the video data and audio data of the target device according to the first SRT push-pull stream link and sends the client's audio data to the target device, and according to the second SRT push-pull stream link , obtain the audio data of the client device and send the video data and audio data of the target device to the client device.

The present invention also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the program, it implements SRT-based communication as described above. Protocol video intercom method.

The present invention also provides a non-transitory computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the video intercom method based on the SRT communication protocol as described above is implemented.

The present invention also provides a computer program product, which includes a computer program. When the computer program is executed by a processor, the computer program implements any of the above-mentioned video intercom methods based on the SRT communication protocol.

The visual intercom method based on the SRT communication protocol provided by the present invention has at least the following beneficial effects: the media server generates the first SRT push-pull stream address according to the URL format according to the first request information, so that the target end can push-pull the stream address according to the first SRT Establish the first SRT push-pull stream link with the media server. After the first SRT push-pull stream link is successfully established, the media server generates the second SRT push-pull stream address according to the URL format based on the first request information, so that the client can push-pull the stream according to the second SRT The address establishes a second SRT push-pull stream link with the media server. The media server transmits video data and audio data between the client and the target client based on the first SRT push-pull stream link and the second SRT push-pull stream link to achieve the effect of visual intercom. . In this way, the SRT protocol is combined with URL technology, and the first SRT push-pull stream link and the second SRT push-pull stream link can be established conveniently and quickly with the media server through the first SRT push-pull stream address and the second SRT push-pull stream address, which is beneficial to Simplifies the process of establishing a link channel, and the SRT push-pull stream link has bidirectional transmission characteristics and can transmit video data and audio data on the same SRT push-pull stream link channel without the need to establish an additional intercom channel. At the same time, the first SRT based on the URL format The push-pull stream address and the second SRT push-pull stream address have a small amount of data during transmission, which is conducive to lightweight link construction.

Description of the drawings

In order to explain the present invention or the technical solutions in the prior art more clearly, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings in the following description are of the present invention. For some embodiments of the invention, those of ordinary skill in the art can also obtain other drawings based on these drawings without exerting creative efforts.

Figure 1 is a signaling diagram of the visual intercom method based on SRT communication protocol provided by the present invention;

Figure 2 is one of the flow diagrams of the video intercom method based on the SRT communication protocol applied to the media server provided by the present invention;

Figure 3 is a second schematic flowchart of the video intercom method based on the SRT communication protocol applied to the media server provided by the present invention;

Figure 4 is the third schematic flow chart of the video intercom method based on the SRT communication protocol applied to the media server provided by the present invention;

Figure 5 is a schematic flowchart of the fourth embodiment of the present invention providing a video intercom method based on the SRT communication protocol applied to a media server;

FIG. 6 is a schematic flow chart of the fifth video intercom method based on the SRT communication protocol applied to the media server provided by the present invention;

Figure 7 is a schematic flow chart of the video intercom method based on the SRT communication protocol provided by the present invention and applied to the client;

Figure 8 is a schematic flowchart of the video intercom method based on the SRT communication protocol provided by the present invention and applied to the target end;

Figure 9 is a schematic flow chart of the visual intercom method based on the SRT communication protocol applied to the signaling server provided by the present invention;

Figure 10 is a schematic structural diagram of the video intercom system provided by the present invention;

Figure 11 is a schematic structural diagram of the electronic device provided by the present invention.

Detailed ways

In order to make the purpose, technical solutions and advantages of the present invention more clear, the technical solutions in the present invention will be clearly and completely described below in conjunction with the accompanying drawings of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention. , not all examples. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without making creative efforts fall within the scope of protection of the present invention.

The video intercom method based on the SRT communication protocol of the present invention is described below with reference to Figures 1 to 5. It is applied to the media server and includes:

S100: Respond to the client's first request information, where the first request information includes client identification information of the client and target identification information of the target terminal;

S110: According to the first request information, generate the first SRT push-pull stream address corresponding to the target end according to the URL format;

S120: Send the first SRT push-pull flow address to the target end to establish a first SRT push-pull flow link with the target end;

S130: Generate a second SRT push-pull stream address according to the URL format according to the first SRT push-pull stream link and the first request information;

S140: Send the second SRT push-pull stream address to the client to establish a second SRT push-pull stream link with the client;

S150: Transmit audio data and video data between the client and the target according to the first SRT push-pull stream link and the second SRT push-pull stream link;

Wherein, the first SRT push-pull stream address and the second SRT push-pull stream address are used to indicate establishing a link for push and pull multiplexing based on the SRT protocol.

The media server generates the first SRT push-pull stream address according to the URL format according to the first request information, so that the target end establishes the first SRT push-pull stream link with the media server based on the first SRT push-pull stream address. After the first SRT push-pull stream link is successfully established, , the media server generates the second SRT push-pull stream address according to the URL format according to the first request information, so that the client establishes the second SRT push-pull stream link with the media server based on the second SRT push-pull stream address, and the media server generates the second SRT push-pull stream link based on the first SRT push-pull stream link. And the second SRT push-pull stream link transmits video data and audio data between the client and the target to achieve the effect of visual intercom. In this way, the SRT protocol is combined with URL technology, and the first SRT push-pull stream link and the second SRT push-pull stream link can be established conveniently and quickly with the media server through the first SRT push-pull stream address and the second SRT push-pull stream address, which is beneficial to Simplifies the process of establishing a link channel, and the SRT push-pull stream link has bidirectional transmission characteristics and can transmit video data and audio data on the same SRT push-pull stream link channel without the need to establish an additional intercom channel. At the same time, the first SRT based on the URL format The push-pull stream address and the second SRT push-pull stream address have a small amount of data during transmission, which is conducive to lightweight link construction.

URL (Uniform Resource Locator) is a string format used to identify and locate resources on the Internet, including the protocol, location, access conditions, etc. required to access the resource. SRT (Secure Reliable Transport) protocol is an open source real-time transmission protocol designed to provide reliable, secure and low-latency streaming media transmission. It has forward error correction and packet loss retransmission mechanisms to ensure reliable transmission of data, and has The two-way transmission feature can transmit video data and audio data on the same SRT link, that is, video and audio multiplex one channel, without the need to establish an additional link for intercom audio. At the same time, the SRT link supports H.265 encoding transmission. Combining the SRT protocol with URL technology can quickly and easily establish an SRT link to provide a low-latency, stable, and reliable two-way transmission channel to meet the needs of video intercoms.

Referring to Figure 3, the present invention provides a video intercom method based on SRT communication protocol applied to a media server. In some embodiments, the S110 includes:

S111: Determine the target identification information according to the first request information;

S112: Generate first key information according to the target identification information;

S113: Generate the first SRT push-pull stream address according to the URL format according to the target identification information and the first key information;

Wherein, the first SRT push-pull stream address includes an SRT protocol field, a first key field corresponding to the first key information, and a first push-pull stream identification field.

By generating the first key information based on the target identification information, and the first SRT push-pull stream address including the corresponding first key field, the target terminal establishes the first SRT push-pull stream link process with the media server based on the first SRT push-pull stream address. , performing security verification based on the first key information and the first key field is beneficial to improving the security of the first SRT push-pull flow link.

The target identification information may be the target's MAC address, IP address, identification code and other implementation methods.

Referring to Figure 4, the present invention provides a video intercom method based on the SRT communication protocol applied to the media server. In some embodiments, the S130 includes:

S131: When the first SRT push-pull stream link is established, determine the client identification information according to the first request information;

S132: Generate second key information according to the client identification information;

S133: Generate the second SRT push-pull stream address according to the URL format according to the client identification information and the second key information;

Wherein, the second SRT push-pull stream address includes an SRT protocol field, a second key field corresponding to the second key information, and a second push-pull stream identification field.

After the first SRT push-pull stream link is established, that is, the target device and the media server can transmit data normally, the second key information is generated based on the client identification information, and the second SRT push-pull stream address includes the corresponding second key field, so that When the client establishes the second SRT push-pull stream link with the media server based on the second SRT push-pull stream address, security verification is performed based on the second key information and the second key field, which is beneficial to improving the security of the second SRT push-pull stream link. .

The client identification information may be the client's MAC address, IP address or identity code.

Referring to Figure 5, the present invention provides a video intercom method based on SRT communication protocol applied to a media server. In some embodiments, the S120 includes:

S121: Send the first SRT push-pull flow address to the signaling server to instruct the signaling server to forward the first SRT push-pull flow address to the target end;

S122: In response to the second request information, establish a first SRT push-pull stream link with the target end;

Wherein, the second request information is generated based on the first SRT push-pull stream address.

The signaling server is used for session management and can directly send or receive messages with the client and target. The target establishes a link and session and generally interacts with the signaling server. The media server sends the generated first SRT push-pull stream address to the signaling server, and the signaling server forwards the first SRT push-pull stream address to the target end. When the target end uses the first SRT push-pull flow address, it will generate a second request information and send it to The media server responds to the second request information and establishes a first SRT push-pull stream link with the target end. In this way, the target end can directly establish the first SRT push-pull stream link with the media server through the first SRT push-pull stream address without going through the signaling server again, which is beneficial to simplifying the process of establishing a link channel.

In some embodiments of the present invention, the media server may also directly send the first SRT push-pull stream address to the target end.

Referring to Figure 6, the present invention provides a video intercom method based on the SRT communication protocol applied to the media server. In some embodiments, the S140 includes:

S141: Send the second SRT push-pull flow address to the signaling server to instruct the signaling server to forward the second SRT push-pull flow address to the client;

S142: In response to the third request information, establish a second SRT push-pull stream link with the client;

Wherein, the third request information is generated based on the second SRT push-pull stream address.

The signaling server is used for session management and can directly send or receive messages to the client and target. The client establishes a link and session and generally interacts with the signaling server to request information to be sent to the client. The media server sends the generated second SRT push-pull stream address to the signaling server, and the signaling server forwards the second SRT push-pull stream address to the client. When the target uses the second SRT push-pull stream address, a third request message is generated and sent to The media server responds to the third request information and establishes a second SRT push-pull stream link with the client. In this way, after the client sends the first request information to the signaling server, the signaling server returns the second SRT push-pull stream address without changing the communication target. The client can directly establish the second SRT with the media server through the second SRT push-pull stream address. Push-pull streaming links do not need to go through the signaling server again, which helps simplify the process of establishing link channels.

In some embodiments of the present invention, the media server may also directly send the second SRT push-pull stream address to the client.

Referring to Figures 1 and 2, the present invention provides a video intercom method based on SRT communication protocol applied to a media server. In some embodiments, after S150, it also includes:

S160: In response to the client's stop request, close the second SRT push-pull stream link;

S170: If data cannot be obtained from the client and continues for a preset time, close the first SRT push-pull flow link.

When the client completes the video intercom service, it sends a stop request. The media server responds to the stop request and closes the second SRT push-pull stream link to release link resources. After no data is received from the client for a preset time, the first SRT stream link is closed. SRT pushes and pulls streaming links to release link resources. In this way, the resources of the second SRT push-pull flow link can be released in time after the video intercom service is completed, and the resources of the first SRT push-pull flow link can be released after the second SRT push-pull flow link is released and a preset time has elapsed. Within the preset time, if the client establishes the second SRT push-pull stream link again through the second SRT push-pull stream address, it can continue the video intercom service with the target end normally without waiting for the client to re-establish the first SRT push-pull stream link. , which helps to improve efficiency. In addition, when the client fails and cannot send data to the media server, the resources of the first SRT push-pull stream link are released after a preset time to avoid empty running of resources occupied for a long time.

Referring to Figures 1 and 7, the present invention also provides a visual intercom method based on the SRT communication protocol applied to the client, including:

S200: Send first request information to the signaling server, where the first request information includes client identification information of the client and target identification information of the target terminal;

S210: Obtain the second SRT push-pull stream address from the signaling server;

S220: Establish a second SRT push-pull stream link with the media server according to the second SRT push-pull stream address;

S230: Establish a session keep-alive link with the signaling server. The session keep-alive link is used to maintain the second SRT push-pull flow link;

S240: According to the second SRT push-pull stream link, send audio data to the media server to instruct the media server to forward the audio data to the target end, and obtain the audio data and video data of the target end from the media server .

When performing the video intercom service, the client sends the first request information to the signaling server to obtain the returned second SRT push-pull stream address. The client can use the second SRT push-pull stream address to send the third request to the media server to Establish a second SRT push-pull stream link with the media server. Based on the second SRT push-pull stream link, the client can send local audio data as a push stream to the media server for the target end to obtain, and at the same time obtain the audio data and video data of the target end as a pull stream from the media server, using the media server as a The relay and target terminal realize visual intercom. In this way, using the second SRT push-pull stream address generated by combining the SRT protocol and URL technology, the client can use the second SRT push-pull stream address to quickly and conveniently establish a second SRT push-pull stream link with the media server, which is conducive to simplifying the establishment. The process of linking channels, and the SRT push-pull stream link has the characteristics of two-way transmission, which can transmit video data and audio data on the same SRT push-pull stream link channel without the need to establish an additional intercom channel. At the same time, a second SRT push-pull stream based on the URL format Address, the amount of data during transmission is small, which is conducive to lightweight link building.

Since the signaling server is used to manage link sessions, the client establishes a session keep-alive link with the signaling server to maintain the second SRT push-pull stream link. When the client fails, the signaling server cannot use session keep-alive. After the link receives the keep-alive heartbeat packet from the client, the signaling server can send an instruction to the media server so that the media server closes the second SRT push-pull stream link to release resources. In this way, when the client fails, the second SRT push-pull stream link can be closed in time to avoid long-term resource occupation.

The keep-alive session link is used to periodically send keep-alive heartbeat packets to know whether the other party of the link is working normally or whether the link used is reliable. If the keep-alive heartbeat packet is not received after the preset time, it can be considered that the other party of the link is faulty. Or the link fails.

Referring to Figures 1 and 7, the present invention provides a visual intercom method based on the SRT communication protocol applied to the client. In some embodiments, after the S240, it also includes:

S250: In response to the stop operation, close the session keepalive link with the signaling server;

S260: Send a stop request to the media server to close the second SRT push-pull stream link.

When the user completes the stop operation of the video intercom service, the client closes the session keepalive link with the signaling server, and sends a stop request to the media server through the second SRT push-pull stream link, causing the media server to close the second SRT. Push and pull streaming links to release link resources.

Referring to Figures 1 and 8, the present invention also provides a visual intercom method based on the SRT communication protocol applied to the target end, including:

S300: Obtain the first SRT push-pull stream address;

S310: Establish a first SRT push-pull stream link with the media server according to the first SRT push-pull stream address;

S320: According to the first SRT push-pull stream link, send video data and audio data to the media server to instruct the media server to forward the video data and audio data to the client, and obtain the client's audio from the media server data.

The signaling server sends the first SRT push-pull stream address to the target end. The target end uses the obtained first SRT push-pull flow address to generate the second request information sent to the media server, and then can establish the first SRT push-pull flow with the media server. Link. Based on the first SRT push-pull stream link, the target end can send locally generated video data and audio data as push streams to the media server for the client to obtain. At the same time, it can also obtain the audio data of the client as a pull stream for local playback. Use the media server as a relay to achieve the purpose of video intercom. In this way, using the SRT protocol combined with URL technology to generate the first SRT push-pull stream address, the target can use the first SRT push-pull stream address to quickly and conveniently establish the first SRT push-pull stream link with the media server, which is conducive to simplifying the establishment. The process of linking channels, and the SRT push-pull stream link has the characteristics of two-way transmission, which can transmit video data and audio data on the same SRT push-pull stream link channel without the need to establish an additional intercom channel. At the same time, the first SRT push-pull stream based on the URL format Address, the amount of data during transmission is small, which is conducive to lightweight link building.

Referring to Figures 1 and 8, the present invention provides a video intercom method based on the SRT communication protocol applied to the target end. In some embodiments, after the S320, it also includes:

S330: When the audio data of the client cannot be obtained from the media server and continues for a preset time, close the first SRT push-pull stream link.

After the client's audio data cannot be obtained from the media server for a preset time, it can be considered that the client is faulty and video intercom cannot continue. Therefore, the first SRT push-pull stream link is closed to release the link resources, which is helpful to prevent the link resources from being used for a long time. Occupy empty running and improve resource utilization.

Referring to Figures 1 and 9, the present invention also provides a visual intercom method based on the SRT communication protocol applied to the signaling server, including:

S400: Respond to the first request information of the client, where the first request information includes the client identification information of the client and the target identification information of the target terminal;

S410: Forward the first request information to the media server to obtain the first SRT push-pull stream address;

S420: Send the first SRT push-pull stream address to the target terminal, so that the target terminal establishes a first SRT push-pull stream link with the media server based on the first SRT push-pull stream address;

S430: Obtain the second SRT push-pull stream address from the media server;

S440: Send the second SRT push-pull stream address to the client, so that the client establishes a second SRT push-pull stream link with the media server based on the second SRT push-pull stream address.

After receiving the first request information sent by the client, the signaling server forwards it to the media server, and forwards the first SRT push-pull stream address generated by the media server to the target end. After the target end establishes the first SRT push-pull flow link with the media server, The media server generates a second SRT push-pull stream address, and the signaling server obtains the second SRT push-pull stream address from the media server and forwards it to the client. The client can establish a second SRT push-pull stream link with the media server based on the second SRT push-pull stream address. Then carry out visual intercom. In this way, the first SRT push-pull stream address and the second SRT push-pull stream address generated by using the SRT protocol and URL technology can quickly and conveniently establish an SRT push-pull stream link with the media server, which is conducive to simplifying the process of establishing a link channel. Moreover, the SRT push-pull stream link has bidirectional transmission characteristics and can transmit video data and audio data on the same SRT push-pull stream link channel without establishing an additional intercom channel. At the same time, based on the URL format of the first SRT push-pull stream address, the second SRT The push-pull stream address has a small amount of data during transmission, which is conducive to lightweight link building.

The video intercom system provided by the present invention is described below. The video intercom system described below and the video intercom method based on the SRT communication protocol described above can correspond to each other.

Referring to Figure 10, the present invention also provides a video intercom system, including: client device, target device, signaling server and media server;

The client device sends first request information to the signaling server;

The signaling server forwards the first request information to the media server;

The media server generates a first SRT push-pull stream address corresponding to the target device according to the URL format according to the first request information, and sends the first SRT push-pull stream address to the signaling server;

The signaling server forwards the first SRT push-pull stream address to the target device;

The target device establishes a first SRT push-pull stream link with the media server based on the first SRT push-pull stream address;

The media server generates a second SRT push-pull stream address according to the first SRT push-pull stream link and the first request information, and sends the second SRT push-pull stream address to the signaling server;

The signaling server forwards the second SRT push-pull stream address to the client device;

The client device establishes a second SRT push-pull stream link with the media server according to the second SRT push-pull stream address;

The media server pushes and pulls the stream link according to the first SRT, obtains the video data and audio data of the target device and sends the audio data of the client device to the target device, and pushes and pulls according to the second SRT. Stream link, obtain the audio data of the client device and send the video data and audio data of the target device to the client device.

Combining the SRT protocol with URL technology, through the first SRT push-pull stream address and the second SRT push-pull stream address, the target device and client device can conveniently and quickly establish the first SRT push-pull stream link and the second SRT push-pull stream with the media server. link, which helps simplify the process of establishing a link channel, and the SRT push-pull stream link has the characteristics of two-way transmission, and can transmit video data and audio data on the same SRT push-pull stream link channel without the need to establish an additional intercom channel. At the same time, based on the URL format The first SRT push-pull flow address and the second SRT push-pull flow address have a small amount of data during transmission, which is conducive to lightweight link construction.

The client device may specifically be a mobile phone, a computer, an embedded device, or other implementations. The target device may specifically be a mobile phone, a computer, a monitoring device, a smart doorbell and other implementations. The structure of signaling server and media server can clearly divide functions and facilitate management and expansion.

Figure 11 is a schematic diagram of the physical structure of an electronic device provided by the present invention. As shown in Figure 11, the electronic device may include: a processor (processor) 810, a communications interface (Communications Interface) 820, a memory (memory) 830 and Communication bus 840, in which the processor 810, the communication interface 820, and the memory 830 complete communication with each other through the communication bus 840. The processor 810 can call logical instructions in the memory 830 to execute the above-mentioned video intercom method based on the SRT communication protocol.

The electronic device provided by the present invention can be used as a media server, client device, target device or signaling server.

In addition, the above-mentioned logical instructions in the memory 830 can be implemented in the form of software functional units and can be stored in a computer-readable storage medium when sold or used as an independent product. Based on this understanding, the technical solution of the present invention essentially or the part that contributes to the existing technology or the part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium, including Several instructions are used to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in various embodiments of the present invention. The aforementioned storage media include: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disk or optical disk and other media that can store program code. .

On the other hand, the present invention also provides a computer program product. The computer program product includes a computer program. The computer program can be stored on a non-transitory computer-readable storage medium. When the computer program is executed by a processor, the computer can Execute the video intercom method based on the SRT communication protocol provided by each of the above methods.

In another aspect, the present invention also provides a non-transitory computer-readable storage medium on which a computer program is stored. The computer program is implemented when executed by the processor to execute the visual interface based on the SRT communication protocol provided by the above methods. Talk about methods.

The device embodiments described above are only illustrative. The units described as separate components may or may not be physically separated. The components shown as units may or may not be physical units, that is, they may be located in One location, or it can be distributed across multiple network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment. Persons of ordinary skill in the art can understand and implement the method without any creative effort.

Through the above description of the embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by software plus a necessary general hardware platform, and of course, it can also be implemented by hardware. Based on this understanding, the part of the above technical solution that essentially contributes to the existing technology can be embodied in the form of a software product. The computer software product can be stored in a computer-readable storage medium, such as ROM/RAM, magnetic disc, optical disk, etc., including a number of instructions to cause a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in various embodiments or certain parts of the embodiments.

Finally, it should be noted that the above embodiments are only used to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that it can still be used Modifications are made to the technical solutions described in the foregoing embodiments, or equivalent substitutions are made to some of the technical features; however, these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims (15)

1. The visual intercom method based on the SRT communication protocol is characterized by being applied to a media server and comprising the following steps:

responding to first request information of a client, wherein the first request information comprises client identification information of the client and target identification information of a target;

generating a first SRT push-pull stream address corresponding to the target end according to the first request information and the URL format;

sending the first SRT push-pull stream address to the target end so as to establish a first SRT push-pull stream link with the target end;

generating a second SRT push-pull stream address according to the URL format according to the first SRT push-pull stream link and the first request information;

sending the second SRT push-pull stream address to the client so as to establish a second SRT push-pull stream link with the client;

transmitting audio data and video data between the client and the target according to the first SRT push-pull stream link and the second SRT push-pull stream link;

the first SRT push-pull stream address and the second SRT push-pull stream address are used for indicating that a link for push stream and pull stream multiplexing is established based on an SRT protocol.

2. The visual intercom method based on the SRT communication protocol as set forth in claim 1, wherein said generating a first SRT push-pull address corresponding to the target according to the URL format according to the first request information includes:

Determining target end identification information according to the first request information;

generating first key information according to the target end identification information;

generating the first SRT push-pull stream address according to the target end identification information and the first key information and the URL format;

the first SRT push-pull address includes an SRT protocol field, a first key field corresponding to the first key information, and a first push-pull identifier field.

3. The visual intercom method based on the SRT communication protocol as set forth in claim 1, wherein said generating a second SRT push-pull address according to URL format based on said first SRT push-pull link and said first request information comprises:

when the first SRT push-pull stream link is established, determining client identification information according to the first request information;

generating second key information according to the client identification information;

generating the second SRT push-pull stream address according to the URL format according to the client identification information and the second key information;

the second SRT push-pull address includes an SRT protocol field, a second key field corresponding to the second key information, and a second push-pull identifier field.

4. The method of claim 1, wherein the sending the first SRT push-to-flow address to the target to establish a first SRT push-to-flow link with the target comprises:

sending the first SRT push-pull address to a signaling server to instruct the signaling server to forward the first SRT push-pull address to the target end;

responding to the second request information, and establishing a first SRT push-pull stream link with the target end;

wherein the second request information is generated based on the first SRT push-pull address.

5. The SRT communication protocol based visual intercom method of claim 1, wherein said sending the second SRT push-pull address to the client for establishing a second SRT push-pull link with the client comprises:

sending the second SRT push-pull address to a signaling server to instruct the signaling server to forward the second SRT push-pull address to the client;

responding to third request information, and establishing a second SRT push-pull stream link with the client;

wherein the third request information is generated based on the second SRT push-pull address.

6. The SRT communication protocol based visual intercom method of claim 1, further comprising, after said transmitting audio data and video data between said client and said target according to said first SRT push-pull link and said second SRT push-pull link:

closing the second SRT push-pull stream link in response to the stop request of the client;

and if the data cannot be acquired from the client and the preset time is continued, closing the first SRT push-pull stream link.

7. The visual intercom method based on the SRT communication protocol is characterized by being applied to a client and comprising the following steps:

transmitting first request information to a signaling server, wherein the first request information comprises client identification information of a client and target identification information of a target;

acquiring a second SRT push-pull stream address from a signaling server;

establishing a second SRT push-pull stream link with a media server according to the second SRT push-pull stream address;

establishing a session keep-alive link with the signaling server, the session keep-alive link for maintaining the second SRT push-pull link;

and sending audio data to the media server according to the second SRT push-pull stream link to instruct the media server to forward the audio data to the target end, and acquiring the audio data and the video data of the target end from the media server.

8. The SRT communication protocol based visual intercom method of claim 7, wherein after said sending audio data to said media server according to said second SRT push-pull link to instruct said media server to forward audio data to said destination, obtaining audio data and video data of said destination from said media server further comprises:

closing the session keep-alive link with the signaling server in response to a stop operation;

and sending a stop request to the media server to close the second SRT push-pull link.

9. The visual intercom method based on the SRT communication protocol is characterized by being applied to a target end and comprising the following steps:

acquiring a first SRT push-pull stream address;

establishing a first SRT push-pull stream link with a media server according to the first SRT push-pull stream address;

and sending video data and audio data to the media server according to the first SRT push-pull stream link to instruct the media server to forward the video data and the audio data to a client, and acquiring the audio data of the client from the media server.

10. The SRT communication protocol based visual intercom method of claim 9, wherein after said sending video data and audio data to said media server according to said first SRT push-pull link to instruct said media server to forward video data and audio data to a client, obtaining audio data of said client from said media server, further comprising:

And closing the first SRT push-pull stream link after the audio data of the client cannot be acquired from the media server and the preset time is continued.

11. The visual intercom method based on the SRT communication protocol is characterized by being applied to a signaling server and comprising the following steps:

responding to first request information of a client, wherein the first request information comprises client identification information of the client and target identification information of a target;

forwarding the first request information to a media server to obtain a first SRT push-pull stream address;

sending the first SRT push-pull address to the target end so that the target end establishes a first SRT push-pull link with the media server based on the first SRT push-pull address;

acquiring a second SRT push-pull address from the media server;

and sending the second SRT push-pull address to the client so that the client establishes a second SRT push-pull link with the media server based on the second SRT push-pull address.

12. A visual intercom system, comprising: the system comprises client equipment, target equipment, a signaling server and a media server;

the client device sends first request information to the signaling server;

The signaling server forwards the first request information to the media server;

the media server generates a first SRT push-pull address corresponding to the target terminal equipment according to the first request information and a URL format, and sends the first SRT push-pull address to the signaling server;

the signaling server forwards the first SRT push-pull address to the target terminal device;

the target end device establishes a first SRT push-pull stream link with the media server according to the first SRT push-pull stream address;

the media server generates a second SRT push-pull address according to the first SRT push-pull link and the first request information, and sends the second SRT push-pull address to the signaling server;

the signaling server forwards the second SRT push-pull address to the client device;

the client device establishes a second SRT push-pull link with the media server according to the second SRT push-pull address;

the media server obtains video data and audio data of the target terminal device according to the first SRT push-pull stream link and sends the audio data of the client terminal device to the target terminal device, and obtains audio data of the client terminal device and sends the video data and the audio data of the target terminal device to the client terminal device according to the second SRT push-pull stream link.

13. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the SRT communication protocol based visual intercom method of any of claims 1 to 11 when the program is executed.

14. A non-transitory computer readable storage medium having stored thereon a computer program, which when executed by a processor, implements the SRT communication protocol based visual intercom method of any of claims 1 to 11.

15. A computer program product comprising a computer program which, when executed by a processor, implements the visual intercom method based on the SRT communication protocol as claimed in any of claims 1 to 11.