CN115396410A - Video resource transmission method and device, electronic equipment and storage medium - Google Patents

Abstract

The invention provides a video resource transmission method and device, electronic equipment and a storage medium. The transmission method is suitable for the server and comprises the following steps: sending a first protocol to a terminal, and receiving a second protocol sent by the terminal; under the condition that the first protocol and the second protocol accord with preset conditions, receiving a first identifier sent by a terminal; under the condition that the terminal enters the video conference, determining video resources according to the first identification, and sending the video resources to the terminal; the first protocol is a session protocol of the server, the second protocol is a session protocol of the terminal, the first identifier is used for indicating a multi-code stream of the terminal, and the video resource is a video resource of the multi-code stream.

Description

Video resource transmission method, device, electronic device and storage medium

technical field

The present invention relates to the field of communication technologies, and in particular, to a video resource transmission method, device, electronic equipment and storage medium.

Background technique

In the related art, during a video conference, the server usually uses a fixed bit rate as the terminal device to transmit the video. Using this solution may result in unclear video images watched by terminals with higher network speeds and stronger decoding capabilities, and unsmooth videos watched by terminals with lower network speeds and weaker decoding capabilities.

Contents of the invention

The present invention aims to solve at least one of the technical problems existing in the related art.

To this end, the first aspect of the present invention is to propose a video resource transmission method.

The second aspect of the present invention is to provide a video resource transmission device.

A third aspect of the present invention is to provide an electronic device.

A fourth aspect of the present invention is to propose a readable storage medium.

In view of this, according to one aspect of the present invention, a video resource transmission method is proposed, the transmission method is suitable for the server, the transmission method includes: sending the first protocol to the terminal, and receiving the second protocol sent by the terminal; When the first protocol and the second protocol meet the preset conditions, receiving the first identification sent by the terminal; when the terminal enters the video conference, determining the video resource according to the first identification, and sending the video resource to the terminal; wherein, The first protocol is the session protocol of the server, the second protocol is the session protocol of the terminal, the first identifier is used to indicate the multi-stream of the terminal, and the video resource is the video resource of the multi-stream.

It should be noted that the execution subject of the video resource transmission method proposed by the present invention may be a video resource transmission device. In order to explain the video resource transmission method proposed by the present invention more clearly, the video resource is used in the following technical solutions The execution body of the transmission method is a video resource transmission device for an exemplary description.

In this technical solution, the above-mentioned transmission method is applicable to the server, the above-mentioned first protocol represents the session protocol of the server, the above-mentioned second protocol represents the session protocol of the terminal, and the above-mentioned first identifier represents the identifier of the multi-code stream of the terminal, which can be used for the terminal Multiple streams are used for description. Multi-streams mean that the terminal can support the generation of multiple video streams. These streams are completely independently configured and can be different resolutions, different frame rates, different compression ratios, or different video streams. Encoding.

Specifically, the transmission device first sends the first protocol to the terminal, and receives the second protocol returned by the terminal. Specifically, the transmission device may determine whether the server and the terminal are capable of multi-stream interaction according to the above-mentioned first protocol and the above-mentioned second protocol.

Further, the transmission device judges whether the first protocol and the second protocol both meet the preset conditions, and if they both meet the preset conditions, receive the first identifier sent by the terminal.

Specifically, the preset condition represents the situation that the first agreement includes the first target agreement, and the second agreement includes the second target agreement.

Specifically, if the first protocol and the second protocol meet the preset conditions, it indicates that the server and the terminal have the capability of multi-stream interaction, that is, the terminal will send the first identification, the transmission device will receive the first identification.

Further, when determining that the terminal enters the video conference, the transmission device determines the video resource according to the first identifier, and sends the video resource to the terminal. Specifically, according to the first identifier, the terminal's requirements for receiving video resource resolution, network bandwidth, or encoding method can be determined. Therefore, the transmission device can determine the video resource to be sent according to the first identifier.

In this technical solution, when the first protocol and the second protocol meet the preset conditions, the transmission device can receive the first identifier used to indicate the multi-code stream of the terminal, and when confirming that the terminal enters the video conference, the transmission device The video resource can be determined according to the first identifier, and the video resource can be sent to the terminal. In the technical solution of the present invention, the transmission device can send video resources that meet the resolution, network bandwidth and coding mode requirements for the terminal according to the first identification, so that the server can provide suitable video resources for terminals in different situations.

In addition, the video resource transmission method proposed according to the above technical solution of the present invention may also have the following additional technical features:

In the above technical solution, the step of determining the video resource according to the first identifier specifically includes: determining the data transmission requirement of the terminal according to the first identifier; and generating the video resource according to the data transmission requirement.

In this technical solution, the terminal's data transmission requirements represent the terminal's requirements for video resource resolution, network bandwidth, and encoding methods.

Specifically, the process for the transmission device to determine the video resource according to the first identifier is as follows: the transmission device first determines the data transmission requirements of the terminal according to the first identifier, that is, determines the terminal's requirements for video resource resolution, network bandwidth, and encoding methods.

Further, the transmission device processes the video data in the video conference according to the above-mentioned data transmission requirements, and determines the above-mentioned video resources.

In this technical solution, the video resource is generated by the transmission device according to the data transmission requirements of the terminal, so that during the video conference, the server provides the terminal with a video resource that matches its own situation, avoiding the terminal in the subsequent steps. The display of the video resource is not clear or the displayed video is not smooth.

In the above technical solution, the step of sending the video resource to the terminal specifically includes: sending the video resource to the terminal through the channel of the real-time transport protocol.

In this technical solution, the transmission device specifically transmits through the channel of Real-time Transport Protocol (RTP, Real-time Transport Protocol). Specifically, the above-mentioned video resources are transmitted through the channel of Real-time Transport Protocol, which is beneficial to ensure the low delay of video resources. sex.

In the above technical solution, after the video resource is sent to the terminal, the transmission method further includes: sending layout information to the terminal, so that the terminal displays a picture of the video conference according to the layout information and the video resource.

In this technical solution, after sending the video resource to the terminal, the transmission device also needs to send layout information to the terminal. Specifically, according to the layout information, information such as the number of people participating in the meeting and the video window of each participant can be known, so the terminal can display the picture of the video conference according to the layout information and video resources.

In this technical solution, after sending the video resource to the terminal, the transmission device can also send the layout information to the terminal, so that the video conference screen displayed by the terminal meets the requirements set by the conference initiator.

In the above technical solution, before sending the video resource to the terminal, the transmission method further includes: confirming whether the video resource matches the layout information, and confirming to send the video resource to the terminal if they match.

In this technical solution, before sending the video resource to the terminal through the channel of the real-time transmission protocol, the transmission device needs to determine whether the video resource matches the requirements in the layout information, and if it matches, confirm that the above video resource can be sent to the terminal. resource.

Specifically, the video resource determined according to the first identifier may not match the requirements in the layout information. Even if the video resource is sent to the terminal, the terminal cannot display the video resource. Therefore, the transmission device adds a filtering mechanism. After confirming the video resource Only when the resource matches the layout information can the video resource be sent to the terminal.

In this technical solution, before sending the video resource to the terminal, the transmission device also needs to confirm whether the video resource matches the layout information, and only in the case of matching can the video resource be sent to the terminal. In this way, a filtering mechanism is added to the channel of the real-time transport protocol, avoiding the transmission of useless video resources, and better avoiding the problem of timing disorder of signaling and media cooperation in the real-time transport protocol channel.

In the above technical solution, before sending the layout information to the terminal, the transmission method further includes: determining the layout information according to the first protocol.

In this technical solution, before sending the layout information to the terminal, the transmission device also needs to determine the layout information according to the first protocol, that is, the session protocol of the server. It is understandable that the initiator of the video conference will pre-set requirements related to the conference, such as the number of participants in the conference, the name of the video window of each participant, etc., and such information is usually reflected in the first protocol. Therefore, the transmission device can determine the layout information according to the first protocol.

In the above technical solution, the transmission method further includes: receiving a third protocol sent by the terminal, the third protocol being a session protocol updated by the terminal according to the decoding capability and upload bandwidth; re-determining the video resources and layout information according to the third protocol; The re-determined video resources and layout information are sent to the terminal.

In this technical solution, the third protocol refers to the session protocol updated by the terminal according to its own decoding capability and its own upload bandwidth, that is, the session protocol updated by the terminal according to its own actual situation.

Specifically, when the actual situation of the terminal changes, such as when the decoding ability and the bandwidth of uploading data change, the terminal will modify the session protocol to generate a third protocol that meets its own conditions, and will send the third protocol to the server. Therefore, the transmitting device also needs to receive the third protocol.

Further, the transmission device re-determines the video resource and the video information according to the third protocol, and sends the re-determined video resource and layout information to the terminal. Specifically, if the third protocol is received, it indicates that the data transmission requirement of the terminal may have changed. Therefore, the transmission device needs to re-determine the video resource and layout information according to the third protocol.

In this technical solution, when the transmission device receives the third protocol, that is, when the terminal modifies the session protocol according to its own situation, it can re-determine the video resources and layout information, and send the re-determined video resources and layout information to the terminal. In this way, the video conference picture displayed by the terminal is adapted to the situation of the terminal itself, and the situation that the video picture of the terminal is not clear or the video is not smooth is avoided.

According to the second aspect of the present invention, a video resource transmission device is proposed, which is suitable for a server. The transmission device includes: a transmission module, used to send the first protocol to the terminal, and receive the second protocol sent by the terminal; the transmission module It is also used to receive the first identification sent by the terminal when the first protocol and the second agreement meet the preset conditions; the processing module is used to determine the video resource according to the first identification when the terminal enters the video conference; transmit The module is also used to send video resources to the terminal; wherein, the first protocol is the session protocol of the server, the second protocol is the session protocol of the terminal, the first identifier is used to indicate the multi-stream of the terminal, and the video resource is the session protocol of the multi-stream video resources.

In this technical solution, the above-mentioned transmission method is applicable to the server, the above-mentioned first protocol represents the session protocol of the server, the above-mentioned second protocol represents the session protocol of the terminal, and the above-mentioned first identifier represents the identifier of the multi-code stream of the terminal, which can be used for the terminal Multiple streams are used for description. Multi-streams mean that the terminal can support the generation of multiple video streams. These streams are completely independently configured and can be different resolutions, different frame rates, different compression ratios, or different video streams. Encoding.

Specifically, the transmission module first sends the first protocol to the terminal, and receives the second protocol returned by the terminal. Specifically, the processing module may determine whether the server and the terminal are capable of multi-stream interaction according to the above-mentioned first protocol and the above-mentioned second protocol.

Further, the processing module judges whether the first protocol and the second protocol meet the preset conditions, and receives the first identification sent by the terminal through the transmission module when it is determined that the preset conditions are met.

Specifically, the preset condition represents the situation that the first agreement includes the first target agreement, and the second agreement includes the second target agreement.

Specifically, if the first protocol and the second protocol meet the preset conditions, it indicates that the server and the terminal have the capability of multi-stream interaction, that is, the terminal will send the first ID, the transmission module will receive the first ID.

Specifically, if the processing module determines that the first protocol and the second protocol do not meet the preset conditions, it indicates that the server and/or terminal does not have the capability of multi-stream interaction. At this time, the processing module can use a fixed code stream to determine the video resources, and send the video resources to the terminal through the transmission module. In this way, the device for transmitting video resources can transmit video resources for the terminal in a traditional mode or in a multi-stream interactive mode.

Further, when the processing module determines that the terminal enters the video conference, it determines the video resource according to the first identifier, and sends the video resource to the terminal through the transmission module. Specifically, according to the first identifier, the requirements of the terminal for receiving video resource resolution, network bandwidth, or encoding method can be determined. Therefore, the processing module can determine the video resource to be sent according to the above-mentioned first identifier.

In this technical solution, when the first protocol and the second protocol meet the preset conditions, the transmission module can receive the first identifier used to indicate the multi-bit stream of the terminal, and when it is confirmed that the terminal enters the video conference, the processing module The video resource can be determined according to the first identifier, and the transmission module can send the video resource to the terminal. In the technical solution of the present invention, the processing module can send video resources meeting the resolution, network bandwidth and coding mode requirements for the terminal according to the first identification, so that the server can provide suitable video resources for terminals in different situations.

According to the third aspect of the present invention, an electronic device is proposed, the electronic device includes: a memory, programs or instructions are stored in the memory; a processor, the processor executes the programs or instructions stored in the memory to implement the above-mentioned technology of the present invention The steps of the video resource transmission method proposed by the solution have all the beneficial technical effects of the video resource transmission method proposed by the above technical solution of the present invention, and will not be repeated here.

According to a fourth aspect of the present invention, a readable storage medium is provided, on which programs or instructions are stored, and when the programs or instructions are executed by a processor, the method for transmitting video resources as proposed in the technical solution of the present invention is implemented. Therefore, the readable storage medium has all the beneficial effects of the method for transmitting video resources proposed by the above-mentioned technical solution of the present invention, which will not be repeated here.

Additional aspects and advantages of the invention will become apparent in the description which follows, or may be learned by practice of the invention.

Description of drawings

The above and/or additional aspects and advantages of the present invention will become apparent and comprehensible from the description of the embodiments in conjunction with the following drawings, wherein:

FIG. 1 shows one of the schematic flow charts of a video resource transmission method according to an embodiment of the present invention;

FIG. 2 shows the second schematic flow diagram of the video resource transmission method according to the embodiment of the present invention;

Fig. 3 shows the third schematic flow diagram of the video resource transmission method according to the embodiment of the present invention;

FIG. 4 shows a fourth schematic flow diagram of a video resource transmission method according to an embodiment of the present invention;

FIG. 5 shows a fifth schematic flow diagram of a video resource transmission method according to an embodiment of the present invention;

FIG. 6 shows a sixth schematic flow diagram of a video resource transmission method according to an embodiment of the present invention;

FIG. 7 shows a seventh schematic flow diagram of a video resource transmission method according to an embodiment of the present invention;

FIG. 8 shows a schematic block diagram of an apparatus for transmitting video resources according to an embodiment of the present invention;

Fig. 9 shows a schematic block diagram of an electronic device according to an embodiment of the present invention.

Detailed ways

In order to understand the above-mentioned purpose, features and advantages of the present invention more clearly, the present invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments. It should be noted that, in the case of no conflict, the embodiments of the present invention and the features in the embodiments can be combined with each other.

In the following description, many specific details are set forth in order to fully understand the present invention, but the present invention can also be implemented in other ways different from those described here, therefore, the protection scope of the present invention is not limited to the specific details disclosed below. EXAMPLE LIMITATIONS.

The video resource transmission method, device, electronic device, and storage medium provided by the embodiments of the present invention are described in detail below through specific embodiments and application scenarios with reference to FIGS. 1 to 9 .

Embodiment one:

Fig. 1 shows a schematic flow diagram of a video resource transmission method according to an embodiment of the present invention, which is applicable to a server, and the transmission method includes:

S102. Send the first protocol to the terminal, and receive the second protocol sent by the terminal;

S104. When the first protocol and the second protocol meet the preset conditions, receive the first identifier sent by the terminal;

S106. When the terminal enters the video conference, determine the video resource according to the first identifier, and send the video resource to the terminal.

Wherein, the first protocol is the session protocol of the server, the second protocol is the session protocol of the terminal, the first identifier is used to indicate the multi-stream of the terminal, and the video resource is the video resource of the multi-stream.

It should be noted that the video resource transmission method proposed in the present invention may be executed by a video resource transmission device. In order to explain the video resource transmission method proposed in the present invention more clearly, the video resource transmission method is used in the following embodiments. The execution body of the transmission method is a video resource transmission device for an exemplary description.

In this embodiment, the above-mentioned transmission method is applicable to the server, the above-mentioned first protocol represents the session protocol of the server, the above-mentioned second protocol represents the session protocol of the terminal, and the above-mentioned first identifier represents the identifier of the multi-code stream of the terminal, which can be used for the terminal Multiple streams are used for description. Multi-streams mean that the terminal can support the generation of multiple video streams. These streams are completely independently configured and can be different resolutions, different frame rates, different compression ratios, or different video streams. Encoding.

Specifically, the transmission device first sends the first protocol to the terminal, and receives the second protocol returned by the terminal. Specifically, the transmission device may determine whether the server and the terminal are capable of multi-stream interaction according to the above-mentioned first protocol and the above-mentioned second protocol.

Further, the transmission device judges whether the first protocol and the second protocol both meet the preset conditions, and if they both meet the preset conditions, receive the first identifier sent by the terminal.

Specifically, the preset condition represents the situation that the first agreement includes the first target agreement, and the second agreement includes the second target agreement.

Specifically, if the first protocol and the second protocol meet the preset conditions, it indicates that the server and the terminal have the capability of multi-stream interaction, that is, the terminal will send the first identification, the transmission device will receive the first identification.

Exemplarily, taking the first protocol and the second protocol as an SDP (Session Description Protocol, describing a session) protocol as an example, the first target protocol is a=sfu-mode:svr, and the second target protocol is a=sfu- mode:cli, that is, when the first protocol contains a=sfu-mode:svr, and the second protocol contains a=sfu-mode:cli, it can be determined that the server and the terminal have the capability of multi-stream interaction.

Specifically, if the transmission device determines that the first protocol and the second protocol do not meet the preset conditions, it indicates that the server and/or terminal does not have the capability of multi-stream interaction. At this time, the transmission device can use a fixed code stream to determine the video resource, and send the video resource to the terminal. In this way, the transmission device can use the traditional mode or the multi-stream interactive mode to send video resources to the terminal.

Further, when determining that the terminal enters the video conference, the transmission device determines the video resource according to the first identifier, and sends the video resource to the terminal. Specifically, according to the first identifier, the terminal's requirements for receiving video resource resolution, network bandwidth, or encoding method can be determined. Therefore, the transmission device can determine the video resource to be sent according to the first identifier.

Exemplarily, the first identifier is an SSRC (Synchronous source, synchronous source) identifier, wherein the fields contained in the first identifier and the meanings of the fields are shown in Table 1:

Table 1

In this embodiment, when the first protocol and the second protocol meet the preset conditions, the transmission device can receive the first identifier used to indicate the multi-bit stream of the terminal, and when confirming that the terminal enters the video conference, the transmission device The video resource can be determined according to the first identifier, and the video resource can be sent to the terminal. In the embodiment of the present invention, the transmission device can send video resources meeting the resolution, network bandwidth and coding mode requirements for the terminal according to the first identifier, so that the server can provide suitable video resources for terminals in different situations.

FIG. 2 shows a schematic flow diagram of a video resource transmission method according to an embodiment of the present invention, and the transmission method includes:

S202. Send the first protocol to the terminal, and receive the second protocol sent by the terminal;

S204. When the first protocol and the second protocol meet preset conditions, receive the first identifier sent by the terminal;

S206. Determine the data transmission requirement of the terminal according to the first identifier;

S208. Generate video resources according to data transmission requirements, and send the video resources to the terminal.

In this embodiment, the data transmission requirement of the terminal indicates the terminal's requirements for video resource resolution, network bandwidth, and encoding method.

Specifically, the process for the transmission device to determine the video resource according to the first identifier is as follows: the transmission device first determines the data transmission requirements of the terminal according to the first identifier, that is, determines the terminal's requirements for video resource resolution, network bandwidth, and encoding methods.

Further, the transmission device processes the video data in the video conference according to the above-mentioned data transmission requirements, and determines the above-mentioned video resources.

It can be understood that, during a video conference, there may be multiple terminals. Therefore, according to the data transmission requirements of the terminals, the transmission device also needs to consider the data transmission requirements of other terminal devices to comprehensively determine the above video resources, so that The server can satisfy the data transmission requirements of all terminals as much as possible.

In this embodiment, the video resource is generated by the transmission device according to the data transmission requirements of the terminal. In this way, during the video conference, the server provides the terminal with video resources that match its own situation, which avoids the terminal in the subsequent steps. The display of the video resource is not clear or the displayed video is not smooth.

FIG. 3 shows a schematic flowchart of a video resource transmission method according to an embodiment of the present invention, and the transmission method includes:

S302. Send the first protocol to the terminal, and receive the second protocol sent by the terminal;

S304. When the first protocol and the second protocol meet preset conditions, receive the first identifier sent by the terminal;

S306. When the terminal enters the video conference, determine the video resource according to the first identifier;

S308. Send the video resource to the terminal through the channel of the real-time transport protocol.

In this embodiment, the transmission device specifically transmits through the channel of the real-time transport protocol. Specifically, transmitting the video resource through the channel of the real-time transport protocol is beneficial to ensure low delay of the video resource.

FIG. 4 shows a schematic flowchart of a method for transmitting video resources according to an embodiment of the present invention. The transmission method includes:

S402. Send the first protocol to the terminal, and receive the second protocol sent by the terminal;

S404. When the first protocol and the second protocol meet the preset condition, receive the first identifier sent by the terminal;

S406. When the terminal enters the video conference, determine the video resource according to the first identifier, and send the video resource to the terminal;

S408. Send the layout information to the terminal, so that the terminal displays a picture of the video conference according to the layout information and video resources.

In this embodiment, after sending the video resource to the terminal, the sending device also needs to send layout information to the terminal. Specifically, according to the layout information, information such as the number of people participating in the meeting and the video window of each participant can be known, so the terminal can display the picture of the video conference according to the layout information and video resources.

Exemplarily, the layout information includes the subject of the video conference, the sponsor, the live broadcast status, the recording status, the speaker ID (Identity Doucument, encoding), and the like.

Exemplarily, the layout information can also set a control protocol that limits whether the terminal can customize the split screen. For example, if the custom split screen protocol in the layout information is force_mcu_layout=1, the terminal cannot customize the split screen, or in the layout If the custom split screen protocol in the information is force_mcu_layout=0, the terminal can choose to use the split screen set by the server or a custom split screen. In this way, when the terminal can customize the split screen, the user can adjust it according to his own needs. Screenshot of the video conference display. Specifically, the above force_mcu_layout field can be sent through the meeting_info event in the layout information.

Exemplarily, since the information in the video conference changes in real time, the transmission device will update the layout information in real time or at regular intervals, and send the updated layout information to the terminal. The accuracy of the picture.

In this embodiment, after the video resource is sent to the terminal, the transmission device can also send the layout information to the terminal, so that the terminal displays the video conference picture meeting the requirements set by the conference initiator.

FIG. 5 shows a schematic flowchart of a video resource transmission method according to an embodiment of the present invention, the transmission method comprising:

S502. Send the first protocol to the terminal, and receive the second protocol sent by the terminal;

S504. When the first protocol and the second protocol meet preset conditions, receive the first identifier sent by the terminal;

S506. When the terminal enters the video conference, determine the video resource according to the first identifier;

S508. Confirm whether the video resource matches the layout information, and if they match, send the video resource to the terminal;

S510. Send layout information to the terminal, so that the terminal displays a picture of the video conference according to the layout information and video resources.

In this embodiment, before sending the video resource to the terminal through the channel of the real-time transmission protocol, the transmission device also needs to determine whether the video resource matches the requirements in the layout information, and if it matches, confirm that the above video resource can be sent to the terminal. resource.

Specifically, the video resource determined according to the first identifier may not match the requirements in the layout information. Even if the video resource is sent to the terminal, the terminal cannot display the video resource. Therefore, the transmission device adds a filtering mechanism. After confirming the video resource Only when the resource matches the layout information can the video resource be sent to the terminal.

For example, in order to ensure that all terminals joining the conference can display video resources, the transmission device also needs to regenerate the video resources according to the fixed code stream when it is determined that the video resources determined according to the first identifier may not match the requirements in the layout information. video resources, and send the regenerated video resources to the terminal.

In this embodiment, before sending the video resource to the terminal, the transmission device also needs to confirm whether the video resource matches the layout information, and only if they match, can the video resource be sent to the terminal. In this way, a filtering mechanism is added to the channel of the real-time transport protocol, avoiding the transmission of useless video resources, and better avoiding the problem of timing disorder of signaling and media cooperation in the real-time transport protocol channel.

FIG. 6 shows a schematic flowchart of a method for transmitting video resources according to an embodiment of the present invention. The transmission method includes:

S602. Send the first protocol to the terminal, and receive the second protocol sent by the terminal;

S604. When the first protocol and the second protocol meet the preset condition, receive the first identifier sent by the terminal;

S606. When the terminal enters the video conference, determine the video resource according to the first identifier, and send the video resource to the terminal;

S608. Determine layout information according to the first protocol;

S610. Send the layout information to the terminal, so that the terminal displays a picture of the video conference according to the layout information and video resources.

In this embodiment, before sending the layout information to the terminal, the transmission device also needs to determine the layout information according to the first protocol, that is, the session protocol of the server. It is understandable that the initiator of the video conference will pre-set requirements related to the conference, such as the number of participants in the conference, the name of the video window of each participant, etc., and such information is usually reflected in the first agreement. Therefore, the transmission device can determine the layout information according to the first protocol.

FIG. 7 shows a schematic flowchart of a video resource transmission method according to an embodiment of the present invention, which is suitable for a server. The transmission method includes:

S702. Send the first protocol to the terminal, and receive the second protocol sent by the terminal;

S704. When the first protocol and the second protocol meet the preset condition, receive the first identifier sent by the terminal;

S706. When the terminal enters the video conference, determine the video resource according to the first identifier, and send the video resource to the terminal;

S708. Receive a third protocol sent by the terminal, where the third protocol is a session protocol updated by the terminal according to the decoding capability and the upload bandwidth;

S710. Re-determine the video resource and layout information according to the third protocol;

S712. Send the re-determined video resource and layout information to the terminal.

In this embodiment, the third protocol refers to the session protocol updated by the terminal according to its own decoding capability and its own upload bandwidth, that is, the session protocol updated by the terminal according to its actual situation.

Specifically, when the actual situation of the terminal changes, such as when the decoding ability and the bandwidth of uploading data change, the terminal will modify the session protocol to generate a third protocol that meets its own conditions, and will send the third protocol to the server. Therefore, the transmitting device also needs to receive the third protocol.

Exemplarily, the terminal can also detect the state of the server-side device, and in the process of modifying the session protocol, the detected state of the server-side device will also be considered, so that the video resources received by the terminal in subsequent steps are more in line with the requirements of the terminal and the server. status.

Further, the transmission device re-determines the video resource and the video information according to the third protocol, and sends the re-determined video resource and layout information to the terminal. Specifically, if the third protocol is received, it indicates that the data transmission requirement of the terminal may have changed. Therefore, the transmission device needs to re-determine the video resource and layout information according to the third protocol.

In this embodiment, when the transmission device receives the third protocol, that is, when the terminal modifies the session protocol according to its own situation, it can re-determine the video resources and layout information, and send the re-determined video resources and layout information to terminal. In this way, the video conference picture displayed by the terminal is adapted to the situation of the terminal itself, and the situation that the video picture of the terminal is not clear or the video is not smooth is avoided.

Embodiment two:

Fig. 8 shows a schematic block diagram of an apparatus for transmitting video resources according to an embodiment of the present invention. The apparatus 800 for transmitting video resources is suitable for a server, and the apparatus 800 for transmitting video resources includes: a transmission module 802 configured to send the first protocol, and receive the second protocol sent by the terminal; the transmission module 802 is also used to receive the first identification sent by the terminal when the first protocol and the second protocol meet the preset conditions; the processing module 804 is used to enter the In the case of a video conference, the video resource is determined according to the first identifier; the transmission module 802 is also used to send the video resource to the terminal; wherein, the first protocol is the session protocol of the server, the second protocol is the session protocol of the terminal, and the first identifier It is used to indicate the multi-stream of the terminal, and the video resource is the video resource of the multi-stream.

In this embodiment, the above-mentioned transmission method is applicable to the server, the above-mentioned first protocol represents the session protocol of the server, the above-mentioned second protocol represents the session protocol of the terminal, and the above-mentioned first identifier represents the identifier of the multi-code stream of the terminal, which can be used for the terminal Multiple streams are used for description. Multi-streams mean that the terminal can support the generation of multiple video streams. These streams are completely independently configured and can be different resolutions, different frame rates, different compression ratios, or different video streams. Encoding.

Specifically, the transmission module 802 first sends the first protocol to the terminal, and receives the second protocol returned by the terminal. Specifically, the processing module 804 may determine whether the server and the terminal are capable of multi-stream interaction according to the above-mentioned first protocol and the above-mentioned second protocol.

Further, the processing module 804 judges whether the first protocol and the second protocol meet the preset conditions, and receives the first identifier sent by the terminal through the transmission module 802 when it is determined that the preset conditions are met.

Specifically, the preset condition represents the situation that the first agreement includes the first target agreement, and the second agreement includes the second target agreement.

Specifically, if the first protocol and the second protocol meet the preset conditions, it indicates that the server and the terminal have the capability of multi-stream interaction, that is, the terminal will send the first ID, the transmission module 802 will receive the first ID.

Specifically, if the processing module 804 judges that the first protocol and the second protocol do not meet the preset conditions, it indicates that the server and/or terminal does not have the capability of multi-stream interaction. At this time, the processing module 804 can use a fixed code stream Determine the video resource, and send the video resource to the terminal through the transmission module 802 . In this way, the apparatus 800 for transmitting video resources can transmit video resources for terminals in a traditional mode or in a multi-stream interactive mode.

Further, when the processing module 804 determines that the terminal enters the video conference, it determines the video resource according to the first identifier, and sends the video resource to the terminal through the transmission module 802 . Specifically, according to the first identifier, the requirements of the terminal for receiving video resource resolution, network bandwidth, or encoding method can be determined. Therefore, the processing module 804 can determine the video resource to be sent according to the above-mentioned first identifier.

In this embodiment, when the first protocol and the second protocol meet the preset conditions, the transmission module 802 can receive the first identifier used to indicate the multi-stream of the terminal, and when it is confirmed that the terminal enters the video conference, process The module 804 can determine the video resource according to the first identifier, and the transmission module 802 can send the video resource to the terminal. In the embodiment of the present invention, the processing module 804 can send video resources meeting the resolution, network bandwidth and coding mode requirements for the terminal according to the first identifier, so that the server can provide suitable video resources for terminals in different situations.

Further, in this embodiment, the processing module 804 is specifically configured to determine the data transmission requirement of the terminal according to the first identifier; and generate video resources according to the data transmission requirement.

Further, in this embodiment, the transmission module 802 is specifically configured to send video resources to the terminal through a channel of the real-time transport protocol.

Further, in this embodiment, the transmission module 802 is further configured to send the layout information to the terminal, so that the terminal displays a picture of the video conference according to the layout information and video resources.

Further, in this embodiment, the processing module 804 is further configured to confirm whether the video resource matches the layout information, and if they match, confirm to send the video resource to the terminal.

Further, in this embodiment, the processing module 804 is further configured to determine layout information according to the first protocol.

Further, in this embodiment, the transmission module 802 is also used to receive the third protocol sent by the terminal, the third protocol is the session protocol updated by the terminal according to the decoding capability and upload bandwidth; the processing module 804 is also used to receive the third protocol according to the third protocol , re-determine the video resource and layout information; the transmission module 802 is also configured to send the re-determined video resource and layout information to the terminal.

Embodiment three:

9 shows a schematic block diagram of an electronic device according to an embodiment of the present invention. The electronic device 900 includes: a memory 902, in which programs or instructions are stored; a processor 904, which executes the programs or instructions stored in the memory 902; instructions to implement the steps of the video resource transmission method proposed by the above-mentioned embodiments of the present invention, thus having all the beneficial technical effects of the video resource transmission method proposed by the above-mentioned embodiments of the present invention, and will not be repeated here.

Embodiment four:

According to the fourth embodiment of the present invention, a readable storage medium is provided, on which programs or instructions are stored, and when the programs or instructions are executed by a processor, the method for transmitting video resources as proposed in the above-mentioned embodiments of the present invention is implemented. Therefore, the readable storage medium has all the beneficial effects of the video resource transmission method proposed in the above-mentioned embodiments of the present invention, which will not be repeated here.

In the description of this specification, the terms "first" and "second" are only used for the purpose of indication, and cannot be understood as indicating or implying relative importance, unless otherwise clearly specified and limited; the terms "connection", " "Installation" and "fixation" should be understood in a broad sense. For example, "connection" can be a fixed connection, a detachable connection, or an integral connection; it can be a direct connection or an indirect connection through an intermediary. Those of ordinary skill in the art can understand the specific meanings of the above terms in the present invention according to specific situations.

In the description of this specification, descriptions of the terms "one embodiment", "some embodiments", "specific embodiments" and the like mean that specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in the present invention In at least one embodiment or example of . In this specification, schematic representations of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.

In addition, the technical solutions of the various embodiments of the present invention can be combined with each other, but it must be based on the realization of those skilled in the art. When the combination of technical solutions is contradictory or cannot be realized, it should be considered as a combination of technical solutions. Does not exist, nor is it within the scope of protection required by the present invention.

The above are only preferred embodiments of the present invention, and are not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and changes. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present invention shall be included within the protection scope of the present invention.

Claims (10)

1. A transmission method of video resource, is characterized in that, is applicable to server, and described transmission method comprises: sending the first protocol to the terminal, and receiving the second protocol sent by the terminal; receiving the first identifier sent by the terminal when the first protocol and the second protocol meet preset conditions; When the terminal enters a video conference, determine a video resource according to the first identifier, and send the video resource to the terminal; Wherein, the first protocol is the session protocol of the server, the second protocol is the session protocol of the terminal, the first identifier is used to indicate the multi-code stream of the terminal, and the video resource is a multi-stream The video resource of the bitstream. 2. The method for transmitting video resources according to claim 1, wherein the determining the video resources according to the first identifier specifically comprises: Determine the data transmission requirement of the terminal according to the first identifier; Generate the video resource according to the data transmission requirement. 3. The method for transmitting video resources according to claim 2, wherein the sending the video resources to the terminal specifically comprises: Send the video resource to the terminal through a channel of the real-time transport protocol. 4. The method for transmitting video resources according to any one of claims 1 to 3, wherein after the video resources are sent to the terminal, the transmission method further comprises: Sending the layout information to the terminal, so that the terminal displays the picture of the video conference according to the layout information and the video resource. 5. The transmission method of video resources according to claim 4, characterized in that, before sending the video resources to the terminal, the transmission method further comprises: Confirming whether the video resource matches the layout information, and if so, confirming that the video resource is sent to the terminal. 6. The transmission method of video resources according to claim 4, characterized in that, before sending the layout information to the terminal, the transmission method further comprises: According to the first protocol, the layout information is determined. 7. The method for transmitting video resources according to any one of claims 1 to 3, wherein the transmission method further comprises: receiving a third protocol sent by the terminal, where the third protocol is a session protocol updated by the terminal according to the decoding capability and upload bandwidth; Re-determine the video resource and layout information according to the third protocol; Sending the re-determined video resource and the layout information to the terminal. 8. A video resource transmission device, characterized in that it is suitable for a server, and the transmission device includes: a transmission module, configured to send the first protocol to the terminal, and receive the second protocol sent by the terminal; The transmission module is further configured to receive the first identifier sent by the terminal when the first protocol and the second protocol meet preset conditions; A processing module, configured to determine a video resource according to the first identifier when the terminal enters a video conference; The transmission module is also used to send the video resource to the terminal; Wherein, the first protocol is the session protocol of the server, the second protocol is the session protocol of the terminal, the first identifier is used to indicate the multi-code stream of the terminal, and the video resource is a multi-stream The video resource of the bitstream. 9. An electronic device, comprising: a memory and a processor, the memory stores a program, and when the processor executes the program, the video resource according to any one of claims 1 to 7 is realized The steps of the transfer method. 10. A readable storage medium, characterized in that, the readable storage medium stores a program or an instruction, and when the program or instruction is executed by a processor, the video as described in any one of claims 1 to 7 is realized. The steps of the transfer method of the resource.

Images