CN115396410A - Video resource transmission method and device, electronic equipment and storage medium - Google Patents

Video resource transmission method and device, electronic equipment and storage medium Download PDF

Info

Publication number
CN115396410A
CN115396410A CN202210972689.9A CN202210972689A CN115396410A CN 115396410 A CN115396410 A CN 115396410A CN 202210972689 A CN202210972689 A CN 202210972689A CN 115396410 A CN115396410 A CN 115396410A
Authority
CN
China
Prior art keywords
terminal
protocol
video
video resource
identifier
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210972689.9A
Other languages
Chinese (zh)
Inventor
胡昭程
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Viazijing Technology Co ltd
Original Assignee
Beijing Viazijing Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Viazijing Technology Co ltd filed Critical Beijing Viazijing Technology Co ltd
Priority to CN202210972689.9A priority Critical patent/CN115396410A/en
Publication of CN115396410A publication Critical patent/CN115396410A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/15—Conference systems

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The invention provides a video resource transmission method and device, electronic equipment and a storage medium. The transmission method is suitable for the server and comprises the following steps: sending a first protocol to a terminal, and receiving a second protocol sent by the terminal; under the condition that the first protocol and the second protocol accord with preset conditions, receiving a first identifier sent by a terminal; under the condition that the terminal enters the video conference, determining video resources according to the first identification, and sending the video resources to the terminal; the first protocol is a session protocol of the server, the second protocol is a session protocol of the terminal, the first identifier is used for indicating a multi-code stream of the terminal, and the video resource is a video resource of the multi-code stream.

Description

Video resource transmission method and device, electronic equipment and storage medium
Technical Field
The present invention relates to the field of communications technologies, and in particular, to a method and an apparatus for transmitting video resources, an electronic device, and a storage medium.
Background
In the related art, when a video conference is performed, a server generally transmits a video by using a terminal device with a fixed code stream. By adopting the scheme, video pictures watched by the terminal with higher network speed and stronger decoding capability are not clear, and videos watched by the terminal with lower network speed and weaker decoding capability are not smooth.
Disclosure of Invention
The present invention has been made to solve at least one of the problems occurring in the related art.
To this end, a first aspect of the present invention is to propose a method for transmitting a video asset.
A second aspect of the present invention is to provide a transmission apparatus for video resources.
A third aspect of the invention is directed to an electronic device.
A fourth aspect of the invention is directed to a readable storage medium.
In view of this, according to an aspect of the present invention, a method for transmitting a video resource is provided, the method is applied to a server, and the method includes: sending a first protocol to a terminal, and receiving a second protocol sent by the terminal; under the condition that the first protocol and the second protocol accord with preset conditions, receiving a first identification sent by a terminal; under the condition that the terminal enters a video conference, determining video resources according to the first identification, and sending the video resources to the terminal; the first protocol is a session protocol of the server, the second protocol is a session protocol of the terminal, the first identifier is used for indicating a multi-code stream of the terminal, and the video resource is a video resource of the multi-code stream.
It should be noted that the execution subject of the video resource transmission method provided by the present invention may be a video resource transmission device, and in order to describe the video resource transmission method provided by the present invention more clearly, the execution subject of the video resource transmission method is exemplarily described as the video resource transmission device in the following technical solution.
In this technical solution, the transmission method is applicable to a server, the first protocol represents a session protocol of the server, the second protocol represents a session protocol of a terminal, the first identifier represents an identifier of a multi-code stream of the terminal, and can describe the multi-code stream of the terminal, and the multi-code stream represents a code stream in which the terminal can support generation of multiple videos, and the code streams are completely and independently configured and can be respectively different resolutions, different frame rates, different compression ratios, or different encoding modes.
Specifically, the transmission device first sends a first protocol to the terminal and receives a second protocol transmitted back by the terminal. Specifically, the transmission device may determine whether the server and the terminal have the capability of multi-stream interaction according to the first protocol and the second protocol.
Further, the transmission device judges whether the first protocol and the second protocol both meet preset conditions, and receives the first identifier sent by the terminal under the condition that both meet the preset conditions.
Specifically, the preset condition indicates that the first protocol includes a first target protocol, and the second protocol includes a second target protocol.
Specifically, if the first protocol and the second protocol meet the preset condition, it indicates that the server and the terminal have the multi-stream interaction capability, that is, the terminal will send the first identifier and the transmission device will receive the first identifier only when it is determined that the server and the terminal have the multi-stream interaction capability.
Further, the transmission device determines the video resource according to the first identifier and sends the video resource to the terminal under the condition that the terminal is determined to enter the video conference. Specifically, the requirements of the terminal on the resolution of the received video resource, the network bandwidth, the coding mode, or the like can be determined according to the first identifier, and therefore, the transmission device can determine the video resource to be transmitted according to the first identifier.
In the technical scheme, under the condition that the first protocol and the second protocol meet the preset conditions, the transmission device can receive a first identifier for indicating the multi-code stream of the terminal, and when the terminal is confirmed to enter the video conference, the transmission device can determine the video resource according to the first identifier and can send the video resource to the terminal. In the technical scheme of the invention, the transmission device can send the video resources meeting the requirements of the resolution, the network bandwidth and the coding mode to the terminal according to the first identifier, so that the server can provide the appropriate video resources for the terminals under different conditions.
In addition, the transmission method of video resources proposed by the above technical solution of the present invention may further have the following additional technical features:
in the above technical solution, the step of determining the video resource according to the first identifier specifically includes: determining the data transmission requirement of the terminal according to the first identifier; and generating video resources according to the data transmission requirements.
In the technical scheme, the data transmission requirement of the terminal represents the requirements of the terminal on the aspects of the resolution, the network bandwidth, the coding mode and the like of video resources.
Specifically, the process of the transmission device determining the video resource according to the first identifier is as follows: the transmission device firstly determines the data transmission requirement of the terminal according to the first identifier, namely determines the requirements of the terminal on the resolution, the network bandwidth, the coding mode and the like of the video resource.
Further, the transmission device processes the video data in the video conference according to the data transmission requirement, and determines the video resource.
In the technical scheme, the video resources are generated by the transmission device according to the data transmission requirements of the terminal, so that the server provides the video resources matched with the self condition for the terminal in the video conference process, and the condition that the terminal displays unclear videos or the videos displayed by the terminal are not smooth according to the video resources in the subsequent steps is avoided.
In the above technical solution, the step of sending the video resource to the terminal specifically includes: and sending the video resource to the terminal through a channel of a real-time transmission protocol.
In the technical scheme, the transmission device specifically transmits through a channel of a Real-time Transport Protocol (RTP), and specifically transmits the video resource through the channel of the RTP, which is beneficial to ensuring low latency of the video resource.
In the above technical solution, after sending the video resource to the terminal, the transmission method further includes: and sending the layout information to the terminal so that the terminal displays the picture of the video conference according to the layout information and the video resource.
In this technical solution, after sending the video resource to the terminal, the transmitting device also needs to send layout information to the terminal. Specifically, the number of people participating in the conference, the video window of each participant, and the like can be known from the layout information, and therefore, the terminal can display the screen of the video conference based on the layout information and the video resource.
In the technical scheme, after the video resources are sent to the terminal, the transmission device can also send the layout information to the terminal, so that the picture of the video conference displayed by the terminal meets the requirements set by a conference initiator.
In the above technical solution, before sending the video resource to the terminal, the transmission method further includes: and confirming whether the video resources are matched with the layout information or not, and confirming that the video resources are sent to the terminal under the condition of matching.
In the technical scheme, before sending the video resource to the terminal through the channel of the real-time transmission protocol, the transmission device needs to determine whether the video resource is matched with the requirement in the layout information, and under the condition of matching, the transmission device confirms that the video resource can be sent to the terminal.
Specifically, the video resource determined based on the first identifier may not match the requirement in the layout information, and even if the video resource is transmitted to the terminal, the terminal cannot display the video resource, so that the transmission apparatus adds a filtering mechanism to ensure that the video resource can be transmitted to the terminal only if the video resource matches the layout information.
In the technical scheme, before sending the video resource to the terminal, the transmission device further needs to confirm whether the video resource is matched with the layout information, and can send the video resource to the terminal under the condition of matching. Therefore, a filtering mechanism is added for the channel of the real-time transmission protocol, the transmission of useless video resources is avoided, and the problem of time sequence disorder of the coordination of signaling and media in the channel of the real-time transmission protocol is better avoided.
In the above technical solution, before sending the layout information to the terminal, the transmission method further includes: according to a first protocol, layout information is determined.
In this technical solution, before sending the layout information to the terminal, the transmission device further needs to determine the layout information according to the first protocol, i.e. the session protocol of the server. It will be appreciated that the originator of the video conference may have pre-set requirements regarding the conference, such as the number of people participating in the conference, the name of the video window of each participant, etc., which are typically embodied in the first protocol. Thus, the transmitting device may determine the layout information according to the first protocol.
In the above technical solution, the transmission method further includes: receiving a third protocol sent by the terminal, wherein the third protocol is a session protocol updated by the terminal according to the decoding capability and the uploading bandwidth; according to a third protocol, video resources and layout information are determined again; and sending the video resource and the layout information which are determined again to the terminal.
In the technical scheme, the third protocol represents a session protocol updated by the terminal according to the decoding capability and the uploading bandwidth of the terminal, namely the session protocol updated by the terminal according to the actual situation of the terminal.
Specifically, when the actual situation of the terminal itself changes, for example, the decoding capability and the bandwidth of the uploaded data change, the terminal modifies the session protocol to generate a third protocol meeting the conditions of the terminal itself, and sends the third protocol to the server. Therefore, the transmitting device also needs to receive the third protocol.
Further, the transmission means redetermines the video resource and the video information according to a third protocol, and transmits the redetermined video resource and layout information to the terminal. Specifically, if the third protocol is received, it indicates that the data transmission requirements of the terminal may have changed, and therefore, the transmission apparatus needs to re-determine the video resources and the layout information according to the third protocol.
In this technical solution, the transmission apparatus may re-determine the video resource and the layout information and send the re-determined video resource and the layout information to the terminal in a case where the third protocol is received, that is, in a case where the terminal modifies the session protocol according to its own condition. Therefore, the video conference picture displayed by the terminal is adaptive to the terminal self condition, and the condition that the video picture is not clear or the video is not smooth is avoided.
According to a second aspect of the present invention, there is provided a transmission apparatus for video resources, which is suitable for a server, the transmission apparatus comprising: the transmission module is used for sending a first protocol to the terminal and receiving a second protocol sent by the terminal; the transmission module is also used for receiving a first identifier sent by the terminal under the condition that the first protocol and the second protocol accord with preset conditions; the processing module is used for determining video resources according to the first identifier under the condition that the terminal enters the video conference; the transmission module is also used for sending the video resource to the terminal; the first protocol is a session protocol of the server, the second protocol is a session protocol of the terminal, the first identifier is used for indicating a multi-code stream of the terminal, and the video resource is a video resource of the multi-code stream.
In this technical solution, the transmission method is applicable to a server, the first protocol represents a session protocol of the server, the second protocol represents a session protocol of a terminal, the first identifier represents an identifier of a multi-code stream of the terminal, and can describe the multi-code stream of the terminal, and the multi-code stream represents a code stream in which the terminal can support generation of multiple videos, and the code streams are completely and independently configured and can be respectively different resolutions, different frame rates, different compression ratios, or different encoding modes.
Specifically, the transmission module firstly sends a first protocol to the terminal and receives a second protocol transmitted back by the terminal. Specifically, the processing module may determine whether the server and the terminal have the capability of multi-stream interaction according to the first protocol and the second protocol.
Further, the processing module judges whether the first protocol and the second protocol both meet a preset condition, and receives the first identifier sent by the terminal through the transmission module under the condition that the first protocol and the second protocol both meet the preset condition.
Specifically, the preset condition indicates that the first protocol includes a first target protocol, and the second protocol includes a second target protocol.
Specifically, if the first protocol and the second protocol meet the preset condition, it indicates that the server and the terminal have the multi-stream interaction capability, that is, the terminal will send the first identifier and the transmission module will receive the first identifier only when it is determined that the server and the terminal have the multi-stream interaction capability.
Specifically, if the processing module determines that the first protocol and the second protocol do not meet the preset condition, it indicates that the server and/or the terminal do not have the multi-stream interaction capability, and at this time, the processing module may determine the video resource by using a fixed code stream, and send the video resource to the terminal through the transmission module. Therefore, the video resource transmission device can adopt a traditional mode or a multi-stream interaction mode to transmit the video resource to the terminal.
Further, the processing module determines the video resource according to the first identifier under the condition that the terminal is determined to enter the video conference, and sends the video resource to the terminal through the transmission module. Specifically, the requirements of the terminal on the resolution of the received video resource, the network bandwidth, the coding mode, or the like can be determined according to the first identifier, and therefore, the processing module can determine the video resource to be transmitted according to the first identifier.
In the technical scheme, under the condition that the first protocol and the second protocol meet the preset conditions, the transmission module can receive a first identifier for indicating the multi-code stream of the terminal, when the terminal is confirmed to enter the video conference, the processing module can determine the video resource according to the first identifier, and the transmission module can send the video resource to the terminal. In the technical scheme of the invention, the processing module can send the video resources meeting the requirements of the resolution, the network bandwidth and the coding mode to the terminal according to the first identifier, so that the server can provide the appropriate video resources for the terminals under different conditions.
According to a third aspect of the invention, there is provided an electronic device comprising: a memory having a program or instructions stored therein; the processor executes the program or the instruction stored in the memory to implement the steps of the method for transmitting video resources according to the above technical solution of the present invention, so that the method has all the beneficial technical effects of the method for transmitting video resources according to the above technical solution of the present invention, and will not be described in detail herein.
According to a fourth aspect of the present invention, a readable storage medium is provided, on which a program or instructions are stored, and the program or instructions, when executed by a processor, implement the transmission method of video resources according to the above technical solution of the present invention. Therefore, the readable storage medium has all the advantages of the video resource transmission method proposed by the above technical solution of the present invention, and details are not repeated herein.
Additional aspects and advantages of the invention will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention.
Drawings
The above and/or additional aspects and advantages of the present invention will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
fig. 1 shows one of the flow diagrams of the transmission method of the video resource of the embodiment of the present invention;
fig. 2 illustrates a second flowchart of a method for transmitting a video resource according to an embodiment of the present invention;
fig. 3 is a third schematic flow chart of a video resource transmission method according to an embodiment of the present invention;
fig. 4 is a fourth flowchart of a video resource transmission method according to an embodiment of the present invention;
fig. 5 is a flow chart illustrating a fifth exemplary method of transmitting a video resource according to an embodiment of the present invention;
fig. 6 shows a sixth flowchart of a video resource transmission method according to an embodiment of the present invention;
fig. 7 shows a seventh flowchart of a video resource transmission method according to an embodiment of the present invention;
fig. 8 shows a schematic block diagram of a transmission apparatus of a video asset of an embodiment of the present invention;
FIG. 9 shows a schematic block diagram of an electronic device of an embodiment of the invention.
Detailed Description
In order that the above objects, features and advantages of the present invention can be more clearly understood, a more particular description of the invention will be rendered by reference to the appended drawings. It should be noted that the embodiments of the present invention and features of the embodiments may be combined with each other without conflict.
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention, however, the present invention may be practiced in other ways than those specifically described herein, and therefore the scope of the present invention is not limited to the specific embodiments disclosed below.
The following describes in detail a transmission method, an apparatus, an electronic device, and a storage medium of a video resource according to embodiments of the present invention with reference to fig. 1 to fig. 9 through specific embodiments and application scenarios thereof.
The first embodiment is as follows:
fig. 1 shows a flowchart of a video resource transmission method according to an embodiment of the present invention, which is applicable to a server, and the transmission method includes:
s102, sending a first protocol to a terminal, and receiving a second protocol sent by the terminal;
s104, receiving a first identification sent by a terminal under the condition that the first protocol and the second protocol accord with preset conditions;
and S106, under the condition that the terminal enters the video conference, determining the video resource according to the first identifier, and sending the video resource to the terminal.
The first protocol is a session protocol of the server, the second protocol is a session protocol of the terminal, the first identifier is used for indicating a multi-code stream of the terminal, and the video resource is a video resource of the multi-code stream.
It should be noted that the execution subject of the transmission method of the video resource proposed by the present invention may be a transmission apparatus of the video resource, and in order to describe the transmission method of the video resource proposed by the present invention more clearly, the execution subject of the transmission method of the video resource is exemplarily described as the transmission apparatus of the video resource in the following embodiments.
In this embodiment, the transmission method is applicable to a server, the first protocol represents a session protocol of the server, the second protocol represents a session protocol of a terminal, the first identifier represents an identifier of a multi-code stream of the terminal, and can describe the multi-code stream of the terminal, and the multi-code stream represents a code stream in which the terminal can support generation of multiple videos, and the code streams are completely and independently configured and can be different resolutions, different frame rates, different compression ratios, or different encoding modes.
Specifically, the transmission device first sends a first protocol to the terminal and receives a second protocol transmitted back by the terminal. Specifically, the transmission device may determine whether the server and the terminal have the capability of multi-stream interaction according to the first protocol and the second protocol.
Further, the transmission device judges whether the first protocol and the second protocol both meet preset conditions, and receives the first identifier sent by the terminal under the condition that both meet the preset conditions.
Specifically, the preset condition indicates that the first protocol includes a first target protocol, and the second protocol includes a second target protocol.
Specifically, if the first protocol and the second protocol meet the preset condition, it indicates that the server and the terminal have the multi-stream interaction capability, that is, the terminal sends the first identifier only if it is determined that the server and the terminal have the multi-stream interaction capability, and the transmission device receives the first identifier only if it is determined that the server and the terminal have the multi-stream interaction capability.
For example, taking the first Protocol and the second Protocol as SDP (Session Description Protocol, describing a Session) as an example, the first target Protocol is a = sfu-mode: svr, and the second target Protocol is a = sfu-mode: cli, that is, in the case that the first Protocol contains a = sfu-mode: svr, and the second Protocol contains a = sfu-mode: cli, it may be determined that the server and the terminal have the capability of multi-stream interaction.
Specifically, if the transmission device determines that the first protocol and the second protocol do not meet the preset condition, it indicates that the server and/or the terminal do not have the multi-stream interaction capability, and at this time, the transmission device may determine the video resource by using a fixed code stream and send the video resource to the terminal. Therefore, the transmission device can adopt a traditional mode or a multi-stream interactive mode to transmit the video resource for the terminal.
Further, the transmission device determines the video resource according to the first identifier and sends the video resource to the terminal under the condition that the terminal is determined to enter the video conference. Specifically, the requirements of the terminal on the resolution of the received video resource, the network bandwidth, the coding mode, or the like can be determined according to the first identifier, and therefore, the transmission device can determine the video resource to be transmitted according to the first identifier.
Illustratively, the first identifier is an SSRC (Synchronous source) identifier, wherein the first identifier includes fields and meanings of the fields as shown in table 1:
TABLE 1
Figure BDA0003797340960000091
In this embodiment, the transmission device can receive a first identifier for indicating a multi-stream of the terminal when the first protocol and the second protocol meet a preset condition, and when it is determined that the terminal enters the video conference, the transmission device can determine the video resource according to the first identifier and can send the video resource to the terminal. In the embodiment of the invention, the transmission device can send the video resource which meets the requirements of the resolution, the network bandwidth and the coding mode of the terminal according to the first identifier, so that the server can provide the appropriate video resource for the terminals under different conditions.
Fig. 2 is a schematic flowchart illustrating a transmission method of a video resource according to an embodiment of the present invention, where the transmission method includes:
s202, sending a first protocol to a terminal, and receiving a second protocol sent by the terminal;
s204, receiving a first identifier sent by the terminal under the condition that the first protocol and the second protocol accord with preset conditions;
s206, determining the data transmission requirement of the terminal according to the first identifier;
and S208, generating a video resource according to the data transmission requirement, and sending the video resource to the terminal.
In this embodiment, the data transmission requirement of the terminal indicates the requirements of the terminal on the resolution, network bandwidth, encoding mode and the like of the video resource.
Specifically, the process of the transmission device determining the video resource according to the first identifier is as follows: the transmission device firstly determines the data transmission requirement of the terminal according to the first identifier, namely determines the requirements of the terminal on the resolution, the network bandwidth, the coding mode and the like of the video resource.
Further, the transmission device processes the video data in the video conference according to the data transmission requirement, and determines the video resource.
It can be understood that, when a video conference is performed, a plurality of terminals may exist, and therefore, when data transmission requirements of the terminals are met, the transmission device needs to comprehensively determine the video resources in consideration of data transmission requirements of other terminal devices, so that the server can meet the data transmission requirements of all the terminals as much as possible.
In the embodiment, the video resource is generated by the transmission device according to the data transmission requirement of the terminal, so that the server provides the video resource matched with the situation of the server for the terminal in the video conference process, and the situation that the terminal displays unclear or displayed videos are not smooth according to the video resource in the subsequent steps is avoided.
Fig. 3 is a flowchart illustrating a transmission method of a video resource according to an embodiment of the present invention, where the transmission method includes:
s302, sending a first protocol to a terminal, and receiving a second protocol sent by the terminal;
s304, receiving a first identifier sent by a terminal under the condition that the first protocol and the second protocol accord with preset conditions;
s306, under the condition that the terminal enters the video conference, determining video resources according to the first identifier;
and S308, sending the video resource to the terminal through a channel of the real-time transmission protocol.
In this embodiment, the transmission device specifically transmits through a channel of a real-time transport protocol, and specifically, transmits the video resource through the channel of the real-time transport protocol, which is beneficial to ensuring low latency of the video resource.
Fig. 4 is a flowchart illustrating a transmission method of a video resource according to an embodiment of the present invention, where the transmission method includes:
s402, sending a first protocol to a terminal, and receiving a second protocol sent by the terminal;
s404, receiving a first identification sent by the terminal under the condition that the first protocol and the second protocol accord with preset conditions;
s406, under the condition that the terminal enters the video conference, determining video resources according to the first identifier, and sending the video resources to the terminal;
and S408, sending the layout information to the terminal so that the terminal can display the picture of the video conference according to the layout information and the video resource.
In this embodiment, after transmitting the video asset to the terminal, the transmitting apparatus also needs to transmit the layout information to the terminal. Specifically, the number of people participating in the conference, the video window of each participant, and the like can be known from the layout information, and therefore, the terminal can display the screen of the video conference based on the layout information and the video resources.
Illustratively, the layout information includes the subject of the video conference, the originator, the live status, the recording status, the presenter ID (Identity douccuent), and the like.
For example, a control protocol for limiting whether the terminal can customize split screen may be further set in the layout information, for example, when the customized split screen protocol in the layout information is force _ mcu _ layout =1, the terminal cannot customize split screen, or when the customized split screen protocol in the layout information is force _ mcu _ layout =0, the terminal may select split screen or customized split screen set by the server, so that, when the terminal can customize split screen, the user may adjust the picture displayed by the video conference according to the own requirement. Specifically, the force _ mcu _ layout field may be transmitted through a meeting _ info event in the layout information.
Illustratively, since the information in the video conference is changed in real time, the transmission device updates the layout information in real time or at certain intervals and sends the updated layout information to the terminal, so that the accuracy of the picture of the video conference displayed by the terminal can be ensured.
In this embodiment, after sending the video resource to the terminal, the transmitting device can also send the layout information to the terminal, so that the terminal displays the picture of the video conference meeting the requirements set by the conference initiator.
Fig. 5 is a flowchart illustrating a transmission method of a video resource according to an embodiment of the present invention, where the transmission method includes:
s502, sending a first protocol to a terminal and receiving a second protocol sent by the terminal;
s504, under the condition that the first protocol and the second protocol accord with preset conditions, receiving a first identifier sent by a terminal;
s506, under the condition that the terminal enters the video conference, determining video resources according to the first identification;
s508, whether the video resources are matched with the layout information is confirmed, and the video resources are sent to the terminal under the condition of matching;
and S510, sending layout information to the terminal so that the terminal can display the video conference picture according to the layout information and the video resources.
In this embodiment, before sending the video resource to the terminal through the channel of the real-time transport protocol, the transmission apparatus further needs to determine whether the video resource matches with the requirement in the layout information, and in case of a match, confirms that the video resource can be sent to the terminal.
Specifically, the video resource determined based on the first identifier may not match the requirement in the layout information, and even if the video resource is transmitted to the terminal, the terminal cannot display the video resource, so that the transmission apparatus adds a filtering mechanism to ensure that the video resource can be transmitted to the terminal only if the video resource matches the layout information.
For example, in order to ensure that the terminal entering the meeting can display the video resource, when it is determined that the video resource determined according to the first identifier may not match the requirement in the layout information, the transmission device further needs to regenerate the video resource according to the fixed code stream and send the regenerated video resource to the terminal.
In this embodiment, before sending the video resource to the terminal, the transmission device further needs to confirm whether the video resource matches with the layout information, and in case of matching, can send the video resource to the terminal. Therefore, a filtering mechanism is added for the channel of the real-time transmission protocol, the transmission of useless video resources is avoided, and the problem of time sequence disorder of the coordination of signaling and media in the channel of the real-time transmission protocol is better avoided.
Fig. 6 is a flowchart illustrating a transmission method of a video resource according to an embodiment of the present invention, where the transmission method includes:
s602, sending a first protocol to a terminal, and receiving a second protocol sent by the terminal;
s604, receiving a first identifier sent by a terminal under the condition that the first protocol and the second protocol accord with preset conditions;
s606, under the condition that the terminal enters the video conference, determining video resources according to the first identification, and sending the video resources to the terminal;
s608, determining layout information according to the first protocol;
and S610, sending layout information to the terminal so that the terminal can display the picture of the video conference according to the layout information and the video resource.
In this embodiment, the transmission means further needs to determine the layout information according to the first protocol, i.e. the session protocol of the server, before sending the layout information to the terminal. It will be appreciated that the originator of the video conference may have pre-set requirements regarding the conference, such as the number of people participating in the conference, the name of the video window of each participant, etc., which are typically embodied in the first protocol. Thus, the transmitting device may determine the layout information according to the first protocol.
Fig. 7 is a flowchart illustrating a video resource transmission method according to an embodiment of the present invention, which is applicable to a server, and the transmission method includes:
s702, sending a first protocol to a terminal, and receiving a second protocol sent by the terminal;
s704, receiving a first identifier sent by a terminal under the condition that the first protocol and the second protocol meet preset conditions;
s706, determining video resources according to the first identifier and sending the video resources to the terminal under the condition that the terminal enters the video conference;
s708, receiving a third protocol sent by the terminal, wherein the third protocol is a session protocol updated by the terminal according to the decoding capability and the uploading bandwidth;
s710, re-determining video resources and layout information according to a third protocol;
and S712, sending the redetermined video resource and layout information to the terminal.
In this embodiment, the third protocol represents a session protocol updated by the terminal according to its decoding capability and its upload bandwidth, that is, the session protocol updated by the terminal according to its actual situation.
Specifically, when the actual situation of the terminal itself changes, for example, the decoding capability and the bandwidth of the uploaded data change, the terminal modifies the session protocol to generate a third protocol meeting the conditions of the terminal itself, and sends the third protocol to the server. Therefore, the transmitting device also needs to receive the third protocol.
Illustratively, the terminal can also detect the state of the server-side device, and during the process of modifying the session protocol, the detected state of the server-side device is also considered, so that the video resource received by the terminal in the subsequent steps is more consistent with the states of the terminal and the server.
Further, the transmission means redetermines the video resource and the video information according to a third protocol, and transmits the redetermined video resource and layout information to the terminal. Specifically, if the third protocol is received, it indicates that the data transmission requirements of the terminal may have changed, and therefore, the transmission apparatus needs to re-determine the video resources and the layout information according to the third protocol.
In this embodiment, the transmission means may re-determine the video resource and the layout information and transmit the re-determined video resource and the layout information to the terminal in the case where the third protocol is received, that is, the terminal modifies the session protocol according to the situation of the terminal itself. Therefore, the video conference picture displayed by the terminal is adaptive to the terminal self condition, and the condition that the video picture is not clear or the video is not smooth is avoided.
Example two:
fig. 8 shows a schematic block diagram of a transmission apparatus of a video resource, the transmission apparatus 800 of the video resource is suitable for a server, the transmission apparatus 800 of the video resource includes: a transmission module 802, configured to send a first protocol to a terminal and receive a second protocol sent by the terminal; the transmission module 802 is further configured to receive a first identifier sent by the terminal when the first protocol and the second protocol meet a preset condition; the processing module 804 is configured to determine a video resource according to the first identifier when the terminal enters the video conference; the transmission module 802 is further configured to send the video resource to the terminal; the first protocol is a session protocol of the server, the second protocol is a session protocol of the terminal, the first identifier is used for indicating a multi-code stream of the terminal, and the video resource is a video resource of the multi-code stream.
In this embodiment, the transmission method is applicable to a server, the first protocol represents a session protocol of the server, the second protocol represents a session protocol of a terminal, the first identifier represents an identifier of a multi-code stream of the terminal, and can describe the multi-code stream of the terminal, and the multi-code stream represents a code stream in which the terminal can support generation of multiple videos, and the code streams are completely and independently configured and can be different resolutions, different frame rates, different compression ratios, or different encoding modes.
Specifically, the transmission module 802 first sends a first protocol to the terminal and receives a second protocol transmitted back by the terminal. Specifically, the processing module 804 may determine whether the server and the terminal have the capability of multi-stream interaction according to the first protocol and the second protocol.
Further, the processing module 804 determines whether the first protocol and the second protocol both meet a preset condition, and receives the first identifier sent by the terminal through the transmission module 802 when it is determined that the first protocol and the second protocol both meet the preset condition.
Specifically, the preset condition indicates that the first protocol includes a first target protocol, and the second protocol includes a second target protocol.
Specifically, if the first protocol and the second protocol meet the preset condition, it indicates that the server and the terminal have the multi-stream interaction capability, that is, the terminal will send the first identifier only if it is determined that the server and the terminal have the multi-stream interaction capability, and the transmission module 802 will receive the first identifier only if it is determined that the server and the terminal have the multi-stream interaction capability.
Specifically, if the processing module 804 determines that the first protocol and the second protocol do not meet the preset condition, it indicates that the server and/or the terminal do not have the multi-stream interaction capability, and at this time, the processing module 804 may determine the video resource by using a fixed code stream, and send the video resource to the terminal through the transmission module 802. This enables the video resource transmission apparatus 800 to transmit the video resource to the terminal in the conventional mode or the multi-stream interactive mode.
Further, the processing module 804 determines the video resource according to the first identifier when determining that the terminal enters the video conference, and sends the video resource to the terminal through the transmission module 802. Specifically, the requirements of the terminal on the resolution of the received video resource, the network bandwidth, or the encoding mode, etc. may be determined according to the first identifier, and therefore, the processing module 804 may determine the video resource to be transmitted according to the first identifier.
In this embodiment, under the condition that the first protocol and the second protocol meet the preset condition, the transmission module 802 may receive a first identifier for indicating a multi-stream of the terminal, and when it is determined that the terminal enters the video conference, the processing module 804 may determine the video resource according to the first identifier, and the transmission module 802 may send the video resource to the terminal. In the embodiment of the present invention, the processing module 804 can send, to the terminal, the video resource meeting the requirements of the resolution, the network bandwidth, and the encoding mode of the terminal according to the first identifier, so that the server can provide suitable video resources for terminals in different situations.
Further, in this embodiment, the processing module 804 is specifically configured to determine a data transmission requirement of the terminal according to the first identifier; and generating video resources according to the data transmission requirements.
Further, in this embodiment, the transmission module 802 is specifically configured to send the video resource to the terminal through a channel of a real-time transport protocol.
Further, in this embodiment, the transmission module 802 is further configured to send layout information to the terminal, so that the terminal displays a picture of the video conference according to the layout information and the video resource.
Further, in this embodiment, the processing module 804 is further configured to confirm whether the video resource matches with the layout information, and in case of a match, confirm that the video resource is sent to the terminal.
Further, in this embodiment, the processing module 804 is further configured to determine layout information according to the first protocol.
Further, in this embodiment, the transmission module 802 is further configured to receive a third protocol sent by the terminal, where the third protocol is a session protocol updated by the terminal according to the decoding capability and the upload bandwidth; the processing module 804 is further configured to re-determine the video resource and the layout information according to a third protocol; the transmission module 802 is further configured to transmit the re-determined video resource and layout information to the terminal.
Example three:
fig. 9 shows a schematic block diagram of an electronic device of an embodiment of the invention, the electronic device 900 comprising: a memory 902, the memory 902 having programs or instructions stored therein; the processor 904 and the program or the instructions stored in the memory 902 are executed by the processor 904 to implement the steps of the method for transmitting video resources according to the above-mentioned embodiment of the present invention, so that all the advantageous technical effects of the method for transmitting video resources according to the above-mentioned embodiment of the present invention are achieved, and the details are not repeated herein.
Example four:
according to a fourth embodiment of the present invention, a readable storage medium is proposed, on which a program or instructions are stored, which when executed by a processor implement the transmission method of a video asset as proposed by the above-mentioned embodiments of the present invention. Therefore, the readable storage medium has all the advantages of the video resource transmission method provided by the above embodiment of the present invention, and details are not described herein again.
In the description herein, the terms "first" and "second" are used for purposes of illustration only and are not to be construed as indicating or implying relative importance unless explicitly stated or limited otherwise; the terms "connected," "mounted," "secured," and the like are to be construed broadly and include, for example, fixed connections, removable connections, or integral connections; may be directly connected or indirectly connected through an intermediate. The specific meanings of the above terms in the present invention can be understood by those skilled in the art according to specific situations.
In the description of the present specification, the description of "one embodiment," "some embodiments," "specific embodiments," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
In addition, the technical solutions in the embodiments of the present invention may be combined with each other, but it must be based on the realization of those skilled in the art, and when the technical solutions are contradictory or cannot be realized, such a combination of technical solutions should not be considered to exist, and is not within the protection scope of the present invention.
The above is only a preferred embodiment of the present invention, and is not intended to limit the present invention, and various modifications and changes will occur to those skilled in the art. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims (10)

1. A transmission method of video resources is applicable to a server, and comprises the following steps:
sending a first protocol to a terminal, and receiving a second protocol sent by the terminal;
receiving a first identifier sent by the terminal under the condition that the first protocol and the second protocol meet preset conditions;
under the condition that the terminal enters a video conference, determining video resources according to the first identification, and sending the video resources to the terminal;
the first protocol is a session protocol of the server, the second protocol is a session protocol of the terminal, the first identifier is used for indicating a multi-code stream of the terminal, and the video resource is a video resource of the multi-code stream.
2. The method for transmitting a video resource according to claim 1, wherein the determining a video resource according to the first identifier specifically includes:
determining the data transmission requirement of the terminal according to the first identifier;
and generating the video resource according to the data transmission requirement.
3. The method for transmitting the video resource according to claim 2, wherein the sending the video resource to the terminal specifically includes:
and sending the video resource to the terminal through a channel of a real-time transmission protocol.
4. The method for transmitting the video resource according to any one of claims 1 to 3, wherein after the sending the video resource to the terminal, the method further comprises:
and sending layout information to the terminal so that the terminal displays the picture of the video conference according to the layout information and the video resources.
5. The method for transmitting video resources according to claim 4, wherein before sending the video resources to the terminal, the method further comprises:
and confirming whether the video resources are matched with the layout information or not, and confirming that the video resources are sent to the terminal under the condition of matching.
6. The method for transmitting video resources according to claim 4, wherein before sending the layout information to the terminal, the method further comprises:
and determining the layout information according to the first protocol.
7. The method for transmitting video assets according to any one of claims 1 to 3, wherein the method for transmitting further comprises:
receiving a third protocol sent by the terminal, wherein the third protocol is a session protocol updated by the terminal according to decoding capability and uploading bandwidth;
re-determining the video resources and layout information according to the third protocol;
and sending the video resource and the layout information which are determined again to the terminal.
8. A transmission apparatus of video resources, adapted to a server, the transmission apparatus comprising:
the transmission module is used for sending a first protocol to a terminal and receiving a second protocol sent by the terminal;
the transmission module is further configured to receive a first identifier sent by the terminal when the first protocol and the second protocol meet a preset condition;
the processing module is used for determining video resources according to the first identifier under the condition that the terminal enters a video conference;
the transmission module is also used for transmitting the video resource to the terminal;
the first protocol is a session protocol of the server, the second protocol is a session protocol of the terminal, the first identifier is used for indicating a multi-code stream of the terminal, and the video resource is a video resource of the multi-code stream.
9. An electronic device, comprising: memory storing a program and a processor implementing the steps of the method for transmitting a video asset according to any one of claims 1 to 7 when executing said program.
10. A readable storage medium, on which a program or instructions are stored, which when executed by a processor implement the steps of the transmission method of a video asset as claimed in any one of claims 1 to 7.
CN202210972689.9A 2022-08-15 2022-08-15 Video resource transmission method and device, electronic equipment and storage medium Pending CN115396410A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210972689.9A CN115396410A (en) 2022-08-15 2022-08-15 Video resource transmission method and device, electronic equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210972689.9A CN115396410A (en) 2022-08-15 2022-08-15 Video resource transmission method and device, electronic equipment and storage medium

Publications (1)

Publication Number Publication Date
CN115396410A true CN115396410A (en) 2022-11-25

Family

ID=84118685

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210972689.9A Pending CN115396410A (en) 2022-08-15 2022-08-15 Video resource transmission method and device, electronic equipment and storage medium

Country Status (1)

Country Link
CN (1) CN115396410A (en)

Similar Documents

Publication Publication Date Title
EP3562163B1 (en) Audio-video synthesis method and system
CN100546264C (en) By network and display device method for communicating
CN112738644B (en) Video stream transmission method and device based on WebRTC
CN105763832B (en) A kind of video interactive, control method and device
US20220078396A1 (en) Immersive media content presentation and interactive 360° video communication
CN103109528A (en) System and method for the control and management of multipoint conferences
US8842159B2 (en) Encoding processing for conferencing systems
CN102299917A (en) Combining direct and routed communication in a video conference
US9912714B2 (en) Sending 3D image with first video image and macroblocks in the second video image
CN109089129B (en) Stable multi-video binding live broadcasting system and method thereof
US20180367586A1 (en) Methods, devices, and computer programs for improving streaming of portions of media data
US20230012201A1 (en) A Method, An Apparatus and a Computer Program Product for Video Encoding and Video Decoding
CN111385515B (en) Video conference data transmission method and video conference data transmission system
CN101754002B (en) Video monitoring system and realization method for dual-stream monitoring front end thereof
US6928087B2 (en) Method and apparatus for automatic cross-media selection and scaling
KR102340490B1 (en) Platform system and method of transmitting real time video for an ultra low latency
US9936164B2 (en) Media control method and device
CN114500914A (en) Audio and video forwarding method, device, terminal and system
CN115396410A (en) Video resource transmission method and device, electronic equipment and storage medium
US20220407899A1 (en) Real-time augmented reality communication session
CN112804471A (en) Video conference method, conference terminal, server and storage medium
CN107483876A (en) Video data handling procedure, storage device, straight recorded broadcast interactive terminal
CN113726534A (en) Conference control method, conference control device, electronic equipment and storage medium
CN112839197B (en) Image code stream processing method, device, system and storage medium
CN104702970A (en) Video data synchronization method, device and system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination