CN108540745B - High-definition double-stream video transmission method, transmitting end, receiving end and transmission system - Google Patents
High-definition double-stream video transmission method, transmitting end, receiving end and transmission system Download PDFInfo
- Publication number
- CN108540745B CN108540745B CN201710130535.4A CN201710130535A CN108540745B CN 108540745 B CN108540745 B CN 108540745B CN 201710130535 A CN201710130535 A CN 201710130535A CN 108540745 B CN108540745 B CN 108540745B
- Authority
- CN
- China
- Prior art keywords
- video
- picture
- receiving end
- path
- receiving
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
- H04N21/234381—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by altering the temporal resolution, e.g. decreasing the frame rate by frame skipping
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
- H04N21/2662—Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440281—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the temporal resolution, e.g. by frame skipping
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/647—Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
- H04N21/64784—Data processing by the network
- H04N21/64792—Controlling the complexity of the content stream, e.g. by dropping packets
Abstract
The invention discloses a transmission method of a high-definition double-stream video, which comprises the following steps: a sending end sends a first path of video and a second path of video with a first preset code rate to a receiving end of video conference terminal equipment; when receiving the current bandwidth information and the network transmission information fed back by the receiving end, if the video source type of the second path of video is a static video, the sending end encodes the rest video picture frames at a second preset code rate when the current bandwidth information and the network transmission information meet preset conditions; and the sending end packs the coded video data and sends the packed video data to the receiving end. The invention also discloses a sending end, a receiving end and a transmission system of the video conference terminal equipment. The invention can solve the problems of unsmooth playing and unsmooth playing of high-definition double-stream videos, so as to improve the user experience.
Description
Technical Field
The invention relates to the technical field of communication, in particular to a transmission method, a sending end, a receiving end and a transmission system of high-definition double-stream video.
Background
The double-stream technology is an advanced technology specially developed for the requirement of data application in a video conference, and realizes synchronous transmission of video, audio and data through a call bandwidth, so that a conference user can watch the graph of a speaker and watch the activity graph of a speaker computer while listening to the sound of the speaker; and the image information can be displayed with high-definition resolution. The double stream of the video conference is to send two video streams to the opposite end when the conference is in progress: one path is to collect the main video of the scene of the meeting place through a camera, and the other path is to collect the main video of the scene of the meeting place through a personal computer/notebook screen or office documents such as WORD/PPT on the screen, or audio/video on devices such as DVD.
While the high-definition video conference terminal brings clearer/more vivid audio-visual effect to people, the massive video data streams of the high-definition video conference terminal also present greater challenges to the current network transmission environment. For example, a network bandwidth required for 1080P full real-time (25fps) of a single-channel high-definition video using a standard h.264main Profile compression algorithm is at least above 4 Mbps. In practical application, due to network bandwidth and load, video blocking and unsmooth phenomenon are easily caused under the condition of large concurrency. For the video conference terminal supporting high-definition double-stream videos, if two paths of videos are transmitted by using video code streams corresponding to high definition, the video blocking phenomenon is more easily caused, and thus, the user experience is seriously reduced.
The above is only for the purpose of assisting understanding of the technical aspects of the present invention, and does not represent an admission that the above is prior art.
Disclosure of Invention
The invention mainly aims to provide a transmission method, a sending end, a receiving end and a transmission system of a high-definition double-stream video, and aims to solve the problems of unsmooth playing and unsmooth playing of the high-definition double-stream video so as to improve user experience.
In order to achieve the above object, the present invention provides a method for transmitting a high definition dual-stream video, which comprises the following steps:
a sending end sends a first path of video and a second path of video with a first preset code rate to a receiving end of video conference terminal equipment;
when receiving the current bandwidth information and the network transmission information fed back by the receiving end, if the video source type of the second path of video is a static video, the sending end encodes the rest video picture frames at a second preset code rate when the current bandwidth information and the network transmission information meet preset conditions;
and the sending end packs the coded video data and sends the packed video data to the receiving end.
Preferably, when receiving the current bandwidth information and the network transmission information fed back by the receiving end, if the video source type of the second path of video is a static video, and when the current bandwidth information and the network transmission information satisfy a predetermined condition, the step of the sending end encoding the remaining video picture frames at a second predetermined code rate includes:
when receiving current bandwidth information and network transmission information fed back by the receiving end, if the video source type of the second path of video is a static video, acquiring bandwidth allowance according to the current bandwidth information, and acquiring network packet loss rate according to the network transmission information;
comparing the size relationship between the bandwidth allowance and a first preset threshold value, and the size relationship between the network packet loss rate and a second preset threshold value;
and when the bandwidth margin is greater than a first preset threshold and the network packet loss rate is less than a second preset threshold, the sending end encodes the rest video picture frame at a second preset code rate.
Preferably, the method for transmitting the high-definition dual-stream video further includes:
when receiving a picture switching instruction of a second path of video, if the receiving end receives a picture to be switched, the sending end sends a skip indication message to the receiving end so as to enable the receiving end to skip to a corresponding picture according to the skip indication message.
Preferably, the method for transmitting the high-definition dual-stream video further includes:
and when receiving a picture switching instruction of a second path of video, if the receiving end does not receive the picture to be switched, the sending end encodes the rest video picture frames at a second preset code rate, and packs and sends the encoded video data to the receiving end.
In order to achieve the above object, the present invention further provides a method for transmitting a high definition dual-stream video, where the method for transmitting a high definition dual-stream video includes the following steps:
a receiving end of video conference terminal equipment receives a first path of video and a second path of video with a first preset code rate, which are sent by a sending end;
the receiving end feeds back current bandwidth information and network transmission information to the sending end;
and if the video source type of the second path of video is a static video, receiving the rest video frame data coded by the sending end at a second preset code rate when the current bandwidth information and the network transmission information meet preset conditions.
Preferably, the method for transmitting the high-definition dual-stream video further includes:
when receiving a picture switching instruction of a second path of video, if the receiving end has received a picture to be switched, when receiving a skip indication message sent by the sending end, the receiving end skips to a corresponding picture according to the skip indication message.
Preferably, the step of the receiving end jumping to the corresponding picture according to the jump instruction message includes:
the receiving end analyzes the jump indication message and extracts the picture number and the picture position to be jumped;
searching a corresponding video picture according to the extracted picture number to be jumped and the picture position;
and extracting the corresponding video picture from the cache for display.
In order to achieve the above object, the present invention further provides a sending end of a video conference terminal device, where the sending end of the video conference terminal device includes:
the sending module is used for sending a first path of video and a second path of video with a first preset code rate to a receiving end of the video conference terminal equipment;
the encoding module is used for encoding the rest video picture frames at a second preset code rate by the sending end when the current bandwidth information and the network transmission information fed back by the receiving end are received and the video source type of the second path of video is the static video when the current bandwidth information and the network transmission information meet preset conditions;
the sending module is further configured to pack the encoded video data by the sending end and send the packed video data to the receiving end.
Preferably, the encoding module comprises:
an obtaining unit, configured to, when receiving current bandwidth information and network transmission information fed back by the receiving end, obtain a bandwidth margin according to the current bandwidth information if the video source type of the second path of video is a static video, and obtain a network packet loss rate according to the network transmission information;
a comparing unit, configured to compare a size relationship between the bandwidth margin and a first predetermined threshold, and a size relationship between the network packet loss rate and a second predetermined threshold;
and the coding unit is used for coding the rest video picture frames by the sending end at a second preset code rate when the bandwidth margin is greater than a first preset threshold and the network packet loss rate is less than a second preset threshold.
Preferably, the sending module is further configured to:
when receiving a picture switching instruction of a second path of video, if the receiving end receives a picture to be switched, the sending end sends a skip indication message to the receiving end so as to enable the receiving end to skip to a corresponding picture according to the skip indication message.
Preferably, the sending module is further configured to:
and when receiving a picture switching instruction of a second path of video, if the receiving end does not receive the picture to be switched, the sending end encodes the rest video picture frames at a second preset code rate, and packs and sends the encoded video data to the receiving end.
In order to achieve the above object, the present invention further provides a receiving end of a video conference terminal device, where the receiving end of the video conference terminal device includes:
the receiving module is used for receiving a first path of video and a second path of video with a first preset code rate, which are sent by a sending end, by a receiving end of the video conference terminal equipment;
the feedback module is used for the receiving end to feed back the current bandwidth information and the network transmission information to the sending end;
and the receiving module is configured to receive the remaining video frame data encoded by the sending end at the second predetermined code rate when the current bandwidth information and the network transmission information satisfy a predetermined condition if the video source type of the second path of video is a static video.
Preferably, the receiving end further includes:
and the skipping module is used for skipping to a corresponding picture according to the skipping indication message when the skipping indication message sent by the sending end is received if the receiving end receives the picture to be switched when the picture switching instruction of the second path of video is received.
Preferably, the skip module includes:
the extracting unit is used for analyzing the jump indicating message by the receiving end and extracting the picture number and the picture position to be jumped;
the searching unit is used for searching the corresponding video picture according to the extracted picture number to be jumped and the picture position;
and the display unit is used for extracting the corresponding video picture from the cache to display.
In order to achieve the above object, the present invention further provides a transmission system, where the transmission system includes the sending end of the video conference terminal device as described above, and the receiving end of the video conference terminal device as described above.
The invention provides a transmission method, a sending end, a receiving end and a transmission system of high-definition double-stream videos. Therefore, under the condition of ensuring the video quality, the network bandwidth can be fully utilized, the video definition in the double-flow video is improved, and the phenomena of video blockage and unsmooth when the bandwidth is utilized at the instantaneous peak value can be avoided.
Drawings
Fig. 1 is a schematic flow chart of a first embodiment of a transmission method of a high definition dual-stream video according to the present invention;
fig. 2 is a schematic diagram of a refining process of the step in fig. 1, when receiving the current bandwidth information and the network transmission information fed back by the receiving end, and if the video source type of the second path of video is a static video, the sending end encodes the remaining video frame at a second predetermined code rate when the current bandwidth information and the network transmission information satisfy a predetermined condition;
fig. 3 is a schematic flow chart of a transmission method of high definition dual-stream video according to a second embodiment of the present invention;
fig. 4 is a schematic flow chart of a transmission method of high definition dual-stream video according to a third embodiment of the present invention;
fig. 5 is a schematic flow chart of a fourth embodiment of a transmission method for high definition dual-stream video according to the present invention;
fig. 6 is a flowchart illustrating a fifth embodiment of a transmission method for high definition dual-stream video according to the present invention;
fig. 7 is a schematic diagram illustrating a detailed flow of the step S24 in fig. 6 in which the receiving end skips to the corresponding screen according to the skip instruction message;
fig. 8 is a functional block diagram of a transmitting end of the video conference terminal device according to the present invention;
FIG. 9 is a schematic diagram of a refinement function module of the encoding module of FIG. 8;
fig. 10 is a functional block diagram of a receiving end of a video conference terminal apparatus according to a first embodiment of the present invention;
fig. 11 is a functional block diagram of a receiving end of a video conference terminal apparatus according to a second embodiment of the present invention;
FIG. 12 is a schematic diagram of a detailed functional block of the skip module of FIG. 11;
fig. 13 is a functional block diagram of a transmission system according to an embodiment of the present invention.
The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
The invention provides a transmission method of a high-definition double-stream video, and referring to fig. 1, in an embodiment, the transmission method of the high-definition double-stream video includes:
step S11, the sending end sends a first path of video and a second path of video with a first preset code rate to the receiving end of the video conference terminal equipment;
in this embodiment, the dual stream mode needs to be opened for the sending end and the receiving end of the terminal device of the video conference, and the sending end can send two paths of video streams to the receiving end: the first path is to collect the main video of the scene of the meeting place through a camera, and the second path is to collect the office documents such as a personal computer/notebook screen or WORD/PPT on the personal computer/notebook screen or the audio/video on the devices such as DVD. The form of the first path of main video is not limited; the second path of high-definition video transmitted by the transmitting end is a static video relative to the main video collected by the camera, and the relative static video refers to that each frame of the video is fixed and unchangeable, such as PPT, and each page of PPT is known not to change; or for example a video or video, whose picture is unchanged for each frame. Such as personal computer/notebook screen or WORD/PPT document thereon, and also pictures/albums, videos/animations, etc., which are all storable, read-only content.
In this embodiment, with the definition of video image from standard definition, high definition to super definition, its corresponding video code rate constantly increases to 1Mbps, 2Mbps, 4Mbps, 6Mbps, 8Mbps, 10Mbps or more. In the preferred embodiment, the first predetermined code rate is a predetermined high code rate, and may be set to be 4Mbps or more, and may be set reasonably according to actual needs, which is not specifically limited in the present invention.
Step S12, when receiving the current bandwidth information and the network transmission information fed back by the receiving end, if the video source type of the second path of video is a static video, the sending end encodes the remaining video frame at a second predetermined code rate when the current bandwidth information and the network transmission information satisfy the predetermined condition;
in this embodiment, when receiving a dual-stream video transmitted by a transmitting end, a receiving end may count bandwidth information and network transmission information, and feed back the bandwidth information and the network transmission information to the transmitting end, where the bandwidth information includes a total bandwidth size, a video/audio channel bandwidth allocation proportion, an actual network port bandwidth, a current bandwidth utilization rate, and the network transmission information includes a network packet loss number, a network packet loss rate, and the like.
After the receiving end completes the statistics of the related bandwidth information and the network transmission information, the double-stream video is cached into a data packet with a certain size so as to be called and displayed at any time. And when the current bandwidth information and the network transmission information meet the preset conditions, the sending end encodes the rest video picture frames at a second preset code rate. The second predetermined code rate is a predetermined low code rate, and may be set to be less than 4Mbps, such as 1Mbps, 2Mbps, and the like, and may be reasonably set according to actual needs, which is not specifically limited in the present invention.
And step S13, the sending end packs the encoded video data and sends the packed video data to the receiving end.
In this embodiment, when the second path of high definition video stays in a certain still picture, the bandwidth occupied by the video code stream is relatively small, the receiving end feeds back bandwidth utilization to the sending end, and the sending end encodes the remaining video pictures by using the second predetermined code rate and transmits the remaining video pictures to the receiving end in advance by using the redundant bandwidth when judging that the bandwidth has a margin and the network packet loss rate is low according to the current bandwidth information and the network transmission information fed back by the receiving end. And finishing coding at the sending end, namely packaging the video data and sending the video data to the receiving end so that the receiving end extracts the video from the cache for displaying.
The invention provides a transmission method of high-definition double-stream videos, which is characterized in that a sending end sends a first path of video and a second path of video with a first preset code rate to a receiving end of video conference terminal equipment, when current bandwidth information and network transmission information fed back by the receiving end are received, if the video source type of the second path of video is a static video, when the current bandwidth information and the network transmission information meet preset conditions, the rest video pictures are coded with a second preset code rate, and the coded video data are packaged and sent to the receiving end. Therefore, under the condition of ensuring the video quality, the network bandwidth can be fully utilized, the video definition in the double-flow video is improved, and the phenomena of video blockage and unsmooth when the bandwidth is utilized at the instantaneous peak value can be avoided.
In an embodiment, as shown in fig. 2, on the basis of the embodiment shown in fig. 1, the step S12 includes:
step S121, when receiving the current bandwidth information and the network transmission information fed back by the receiving end, if the video source type of the second path of video is a static video, obtaining bandwidth allowance according to the current bandwidth information, and obtaining a network packet loss rate according to the network transmission information;
step S122, comparing the size relationship between the bandwidth margin and a first preset threshold value, and the size relationship between the network packet loss rate and a second preset threshold value;
in this embodiment, the sending end needs to make two decisions: the first decision is made, whether the current video source is in a double-current mode or not is judged, whether the video source type of the second path of video is equal to the static video type or not is judged, if yes, the second decision is made, and if not, the video stream is coded and transmitted according to the original video standard; and the second decision is made, namely the size relation between the bandwidth allowance and the first preset threshold value and the size relation between the network packet loss rate and the second preset threshold value are judged.
Step S123, when the bandwidth margin is greater than the first predetermined threshold and the network packet loss rate is less than the second predetermined threshold, the sending end encodes the remaining video frame at the second predetermined code rate.
In this embodiment, if the bandwidth margin is greater than a first predetermined threshold, for example, 20% (which may be obtained by comprehensively calculating parameters such as the number of access terminals, the call rate, the network bandwidth, and a proposed reference ratio), and the network packet loss rate is less than a second predetermined threshold, for example, 1, the sending end encodes the remaining video frame at a relatively lower second predetermined code rate. Otherwise, the video stream is encoded and transmitted according to the original video standard. The second predetermined code rate may be set to be less than 4Mbps, and may be set reasonably according to actual needs, which is not specifically limited in the present invention.
In an embodiment, as shown in fig. 3, based on the embodiment shown in fig. 1, the method for transmitting a high definition dual-stream video further includes:
step S14, when receiving the image switching instruction of the second path of video, if the image to be switched is received, the sending end sends a jump instruction message to the receiving end, so that the receiving end jumps to the corresponding image according to the jump instruction message.
In this embodiment, when the second path of video is to jump to the next screen, the sending end sends a jump instruction message to the receiving end, where the jump instruction message refers to a variable parameter (e.g., the page of the PPT) such as a frame number or a packet sequence number.
In this embodiment, if the picture to be switched by the user is already sent to the receiving end, the data does not need to be sent again, and the sending end only needs to send a picture jump indication message to notify the receiving end of jumping to the corresponding position. Thus, it is possible to avoid sending picture data with a large data amount, and it is only necessary to send a control message with a small data amount.
In another embodiment, as shown in fig. 4, based on the embodiment shown in fig. 1, the method for transmitting high definition dual-stream video further includes:
step S15, when receiving the picture switching instruction of the second path of video, if the receiving end does not receive the picture to be switched, the sending end encodes the remaining video picture frames at the second predetermined code rate, and packs the encoded video data to send to the receiving end.
In this embodiment, when receiving the picture switching instruction of the second path of video, if the receiving end does not receive the picture to be switched, that is, the picture to be switched by the user is not yet sent to the receiving end, the sending end needs to encode the remaining video picture frames at a second predetermined relatively low bit rate, and pack and send the encoded video data to the receiving end.
Referring to fig. 5, in an embodiment, the method for transmitting a high-definition dual-stream video includes the following steps:
step S21, the receiving end of the video conference terminal equipment receives the first path of video and the second path of video with the first preset code rate sent by the sending end;
in this embodiment, the dual stream mode needs to be opened for the sending end and the receiving end of the terminal device of the video conference, and the sending end can send two paths of video streams to the receiving end: the first path is to collect the main video of the scene of the meeting place through a camera, and the second path is to collect the office documents such as a personal computer/notebook screen or WORD/PPT on the personal computer/notebook screen or the audio/video on the devices such as DVD. The form of the first path of main video is not limited; the second path of high-definition video transmitted by the transmitting end is a static video relative to the main video collected by the camera, and the relative static video refers to that each frame of the video is fixed and unchangeable, such as PPT, and each page of PPT is known not to change; or for example a video or video, whose picture is unchanged for each frame. Such as personal computer/notebook screen or WORD/PPT document thereon, and also pictures/albums, videos/animations, etc., which are all storable, read-only content.
In this embodiment, with the definition of video image from standard definition, high definition to super definition, its corresponding video code rate constantly increases to 1Mbps, 2Mbps, 4Mbps, 6Mbps, 8Mbps, 10Mbps or more. In the preferred embodiment, the first predetermined code rate is a predetermined high code rate, and may be set to be 4Mbps or more, and may be set reasonably according to actual needs, which is not specifically limited in the present invention.
Step S22, the receiving end feeds back current bandwidth information and network transmission information to the sending end;
in this embodiment, when receiving a dual-stream video transmitted by a transmitting end, a receiving end may count bandwidth information and network transmission information, and feed back the bandwidth information and the network transmission information to the transmitting end, where the bandwidth information includes a total bandwidth size, a video/audio channel bandwidth allocation proportion, an actual network port bandwidth, a current bandwidth utilization rate, and the network transmission information includes a network packet loss number, a network packet loss rate, and the like.
After the receiving end completes the statistics of the related bandwidth information and the network transmission information, the sending end can cache the double-stream video into a data packet with a certain size so as to be called and displayed at any time. And when the current bandwidth information and the network transmission information meet the preset conditions, the sending end encodes the rest video picture frames at a second preset code rate. The second predetermined code rate is a predetermined low code rate, and may be set to be less than 4Mbps, such as 1Mbps, 2Mbps, and the like, and may be reasonably set according to actual needs, which is not specifically limited in the present invention.
Step S23, if the video source type of the second path of video is a static video, receiving the remaining video frame data encoded by the sending end at the second predetermined code rate when the current bandwidth information and the network transmission information satisfy the predetermined condition.
In this embodiment, when the second path of high definition video stays in a certain still picture, the bandwidth occupied by the video code stream is relatively small, the receiving end feeds back bandwidth utilization to the sending end, and the sending end encodes the remaining video pictures by using the second predetermined code rate and transmits the remaining video pictures to the receiving end in advance by using the redundant bandwidth when judging that the bandwidth has a margin and the network packet loss rate is low according to the current bandwidth information and the network transmission information fed back by the receiving end. And finishing coding at the sending end, namely packaging the video data and sending the video data to the receiving end so that the receiving end extracts the video from the cache for displaying.
The invention provides a transmission method of high-definition double-stream videos, which is characterized in that a receiving end of video conference terminal equipment receives a first path of video and a second path of video with preset code rates, which are sent by a sending end, the receiving end feeds back current bandwidth information and network transmission information to the sending end, and if the video source type of the second path of video is a static video, the remaining video frame data coded by the sending end with a second preset code rate are received when the current bandwidth information and the network transmission information meet preset conditions. Therefore, under the condition of ensuring the video quality, the network bandwidth can be fully utilized, the video definition in the double-flow video is improved, and the phenomena of video blockage and unsmooth when the bandwidth is utilized at the instantaneous peak value can be avoided.
In an embodiment, as shown in fig. 6, based on the embodiment shown in fig. 5, the method for transmitting a high definition dual-stream video further includes:
step S24, when receiving the picture switching instruction of the second path of video, if the receiving end has received the picture to be switched, when receiving the skip indication message sent by the sending end, the receiving end skips to the corresponding picture according to the skip indication message.
In this embodiment, when the second path of video is to jump to the next screen, the sending end sends a jump instruction message to the receiving end, where the jump instruction message refers to a variable parameter (e.g., the page of the PPT) such as a frame number or a packet sequence number.
In this embodiment, if the picture to be switched by the user is already sent to the receiving end, the data does not need to be sent again, and the sending end only needs to send a picture jump indication message to notify the receiving end of jumping to the corresponding position. Thus, it is possible to avoid sending picture data with a large data amount, and it is only necessary to send a control message with a small data amount.
In this embodiment, the receiving end matches parameters such as a corresponding frame number and a frame position according to the received frame message of the second path of video, and skips to a corresponding frame according to the corresponding parameters. The sending end sends the frame picture number and the picture position information in a signaling mode or a mode carried in a data packet, and the frame picture number and the picture position information can be transmitted by using an RTP (real time Transport Protocol) or an RTCP (real time Transport Control Protocol).
In an embodiment, as shown in fig. 7, based on the embodiment shown in fig. 6, the step of the receiving end jumping to a corresponding screen according to the jump instruction message in step S24 includes:
step S241, the receiving end analyzes the jump instruction message, and extracts the picture number and the picture position to be jumped;
in this embodiment, when receiving the skip instruction message, the receiving end parses the skip instruction message, where the skip instruction message includes a frame number, a picture position, a picture size, and the like, and extracts information such as the picture number to be skipped, the picture position, and the like from the skip instruction message.
Step S242, searching a corresponding video picture according to the extracted picture number to be jumped and the picture position;
in this embodiment, when the receiving end extracts the picture number and the picture position to be skipped according to the skip instruction message, it searches for the corresponding video picture.
And step S243, extracting the corresponding video picture from the cache to display.
In this embodiment, the receiving end extracts a corresponding video frame from the previously cached data packet to display. The method for transmitting the high-definition dual-stream video provided by the embodiment can more fully utilize the bandwidth, when the video network transmission condition is good and the bandwidth utilization rate is low, the remaining picture frame stream can be additionally transmitted, and when the subsequent network transmission condition becomes poor or the bandwidth utilization rate is high, the picture jump of the receiving end is only required to be notified through signaling or other modes, so that the definition and the fluency of the video can be ensured, and more bandwidth allowance can be reserved for the first path of main video.
Referring to fig. 8, in an embodiment, the sending end 10 of the video conference terminal device includes:
the sending module 11 is configured to send a first path of video and a second path of video with a first predetermined code rate to a receiving end of the video conference terminal device;
in this embodiment, the dual stream mode needs to be opened for the sending end and the receiving end of the terminal device of the video conference, and the sending end can send two paths of video streams to the receiving end: the first path is to collect the main video of the scene of the meeting place through a camera, and the second path is to collect the office documents such as a personal computer/notebook screen or WORD/PPT on the personal computer/notebook screen or the audio/video on the devices such as DVD. The form of the first path of main video is not limited; the second path of high-definition video transmitted by the transmitting end is a static video relative to the main video collected by the camera, and the relative static video refers to that each frame of the video is fixed and unchangeable, such as PPT, and each page of PPT is known not to change; or for example a video or video, whose picture is unchanged for each frame. Such as personal computer/notebook screen or WORD/PPT document thereon, and also pictures/albums, videos/animations, etc., which are all storable, read-only content.
In this embodiment, with the definition of video image from standard definition, high definition to super definition, its corresponding video code rate constantly increases to 1Mbps, 2Mbps, 4Mbps, 6Mbps, 8Mbps, 10Mbps or more. In the preferred embodiment, the first predetermined code rate is a predetermined high code rate, and may be set to be 4Mbps or more, and may be set reasonably according to actual needs, which is not specifically limited in the present invention.
The encoding module 12 is configured to, when receiving the current bandwidth information and the network transmission information fed back by the receiving end, if the video source type of the second path of video is a static video, encode, by the sending end, the remaining video picture frames at a second predetermined code rate when the current bandwidth information and the network transmission information satisfy a predetermined condition;
in this embodiment, when receiving a dual-stream video transmitted by a transmitting end, a receiving end may count bandwidth information and network transmission information, and feed back the bandwidth information and the network transmission information to the transmitting end, where the bandwidth information includes a total bandwidth size, a video/audio channel bandwidth allocation proportion, an actual network port bandwidth, a current bandwidth utilization rate, and the network transmission information includes a network packet loss number, a network packet loss rate, and the like.
After the receiving end completes the statistics of the related bandwidth information and the network transmission information, the double-stream video is cached into a data packet with a certain size so as to be called and displayed at any time. And when the current bandwidth information and the network transmission information meet the preset conditions, the sending end encodes the rest video picture frames at a second preset code rate. The second predetermined code rate is a predetermined low code rate, and may be set to be less than 4Mbps, such as 1Mbps, 2Mbps, and the like, and may be reasonably set according to actual needs, which is not specifically limited in the present invention.
The sending module 11 is further configured to pack the encoded video data by the sending end and send the packed video data to the receiving end.
In this embodiment, when the second path of high definition video stays in a certain still picture, the bandwidth occupied by the video code stream is relatively small, the receiving end feeds back bandwidth utilization to the sending end, and the sending end encodes the remaining video pictures by using the second predetermined code rate and transmits the remaining video pictures to the receiving end in advance by using the redundant bandwidth when judging that the bandwidth has a margin and the network packet loss rate is low according to the current bandwidth information and the network transmission information fed back by the receiving end. And finishing coding at the sending end, namely packaging the video data and sending the video data to the receiving end so that the receiving end extracts the video from the cache for displaying.
The sending end 10 of the video conference terminal device provided by the invention sends the first path of video and the second path of video with the first predetermined code rate to the receiving end of the video conference terminal device, when receiving the current bandwidth information and the network transmission information fed back by the receiving end, if the video source type of the second path of video is a static video, when the current bandwidth information and the network transmission information meet the predetermined conditions, the remaining video pictures are encoded with the second predetermined code rate, and the encoded video data are packed and sent to the receiving end. Therefore, under the condition of ensuring the video quality, the network bandwidth can be fully utilized, the video definition in the double-flow video is improved, and the phenomena of video blockage and unsmooth when the bandwidth is utilized at the instantaneous peak value can be avoided.
In an embodiment, as shown in fig. 9, on the basis of the embodiment shown in fig. 8, the encoding module 12 includes:
an obtaining unit 121, configured to, when receiving current bandwidth information and network transmission information fed back by the receiving end, obtain, according to the current bandwidth information, a bandwidth margin if the video source type of the second path of video is a static video, and obtain a network packet loss rate according to the network transmission information;
a comparing unit 122, configured to compare a size relationship between the bandwidth margin and a first predetermined threshold, and a size relationship between the network packet loss rate and a second predetermined threshold;
in this embodiment, the sending end needs to make two decisions: the first decision is made, whether the current video source is in a double-current mode or not is judged, whether the video source type of the second path of video is equal to the static video type or not is judged, if yes, the second decision is made, and if not, the video stream is coded and transmitted according to the original video standard; and the second decision is made, namely the size relation between the bandwidth allowance and the first preset threshold value and the size relation between the network packet loss rate and the second preset threshold value are judged.
And an encoding unit 123, configured to, when the bandwidth margin is greater than a first predetermined threshold and the network packet loss rate is less than a second predetermined threshold, encode, by the sending end, the remaining video picture frames at a second predetermined code rate.
In this embodiment, if the bandwidth margin is greater than a first predetermined threshold, for example, 20% (which may be obtained by comprehensively calculating parameters such as the number of access terminals, the call rate, the network bandwidth, and a proposed reference ratio), and the network packet loss rate is less than a second predetermined threshold, for example, 1, the sending end encodes the remaining video frame at a relatively lower second predetermined code rate. Otherwise, the video stream is encoded and transmitted according to the original video standard. The second predetermined code rate may be set to be less than 4Mbps, and may be set reasonably according to actual needs, which is not specifically limited in the present invention.
In an embodiment, on the basis of the embodiment shown in fig. 8, the sending module 11 is further configured to:
when receiving a picture switching instruction of a second path of video, if the receiving end receives a picture to be switched, the sending end sends a skip indication message to the receiving end so as to enable the receiving end to skip to a corresponding picture according to the skip indication message.
In this embodiment, when the second path of video is to jump to the next screen, the sending end sends a jump instruction message to the receiving end, where the jump instruction message refers to a variable parameter (e.g., the page of the PPT) such as a frame number or a packet sequence number.
In this embodiment, if the picture to be switched by the user is already sent to the receiving end, the data does not need to be sent again, and the sending end only needs to send a picture jump indication message to notify the receiving end of jumping to the corresponding position. Thus, it is possible to avoid sending picture data with a large data amount, and it is only necessary to send a control message with a small data amount.
In another embodiment, on the basis of the embodiment shown in fig. 8, the sending module 11 is further configured to:
and when receiving a picture switching instruction of a second path of video, if the receiving end does not receive the picture to be switched, the sending end encodes the rest video picture frames at a second preset code rate, and packs and sends the encoded video data to the receiving end.
In this embodiment, when receiving the picture switching instruction of the second path of video, if the receiving end does not receive the picture to be switched, that is, the picture to be switched by the user is not yet sent to the receiving end, the sending end needs to encode the remaining video picture frames at a second predetermined relatively low bit rate, and pack and send the encoded video data to the receiving end.
The present invention further provides a receiving end 20 of a video conference terminal device, referring to fig. 10, in an embodiment, the receiving end 20 of the video conference terminal device includes:
the receiving module 21 is configured to receive, by a receiving end of the video conference terminal device, a first path of video and a second path of video with a first predetermined code rate, which are sent by a sending end;
in this embodiment, the dual stream mode needs to be opened for the sending end and the receiving end of the terminal device of the video conference, and the sending end can send two paths of video streams to the receiving end: the first path is to collect the main video of the scene of the meeting place through a camera, and the second path is to collect the office documents such as a personal computer/notebook screen or WORD/PPT on the personal computer/notebook screen or the audio/video on the devices such as DVD. The form of the first path of main video is not limited; the second path of high-definition video transmitted by the transmitting end is a static video relative to the main video collected by the camera, and the relative static video refers to that each frame of the video is fixed and unchangeable, such as PPT, and each page of PPT is known not to change; or for example a video or video, whose picture is unchanged for each frame. Such as personal computer/notebook screen or WORD/PPT document thereon, and also pictures/albums, videos/animations, etc., which are all storable, read-only content.
In this embodiment, with the definition of video image from standard definition, high definition to super definition, its corresponding video code rate constantly increases to 1Mbps, 2Mbps, 4Mbps, 6Mbps, 8Mbps, 10Mbps or more. In the preferred embodiment, the first predetermined code rate is a predetermined high code rate, and may be set to be 4Mbps or more, and may be set reasonably according to actual needs, which is not specifically limited in the present invention.
A feedback module 22, configured to feed back, by the receiving end, current bandwidth information and network transmission information to the sending end;
in this embodiment, when receiving a dual-stream video transmitted by a transmitting end, a receiving end may count bandwidth information and network transmission information, and feed back the bandwidth information and the network transmission information to the transmitting end, where the bandwidth information includes a total bandwidth size, a video/audio channel bandwidth allocation proportion, an actual network port bandwidth, a current bandwidth utilization rate, and the network transmission information includes a network packet loss number, a network packet loss rate, and the like.
After the receiving end completes the statistics of the related bandwidth information and the network transmission information, the sending end can cache the double-stream video into a data packet with a certain size so as to be called and displayed at any time. And when the current bandwidth information and the network transmission information meet the preset conditions, the sending end encodes the rest video picture frames at a second preset code rate. The second predetermined code rate is a predetermined low code rate, and may be set to be less than 4Mbps, such as 1Mbps, 2Mbps, and the like, and may be reasonably set according to actual needs, which is not specifically limited in the present invention.
The receiving module 21 is configured to receive, if the video source type of the second path of video is a static video, the remaining video frame data encoded by the sending end at the second predetermined code rate when the current bandwidth information and the network transmission information meet predetermined conditions.
In this embodiment, when the second path of high definition video stays in a certain still picture, the bandwidth occupied by the video code stream is relatively small, the receiving end feeds back bandwidth utilization to the sending end, and the sending end encodes the remaining video pictures by using the second predetermined code rate and transmits the remaining video pictures to the receiving end in advance by using the redundant bandwidth when judging that the bandwidth has a margin and the network packet loss rate is low according to the current bandwidth information and the network transmission information fed back by the receiving end. And finishing coding at the sending end, namely packaging the video data and sending the video data to the receiving end so that the receiving end extracts the video from the cache for displaying.
The receiving end 20 of the video conference terminal device provided by the invention feeds back the current bandwidth information and the network transmission information to the sending end by receiving the first path of video and the second path of video with the predetermined code rate sent by the sending end, and receives the rest video frame data coded by the sending end with the second predetermined code rate when the current bandwidth information and the network transmission information meet the predetermined conditions if the video source type of the second path of video is the static video. Therefore, under the condition of ensuring the video quality, the network bandwidth can be fully utilized, the video definition in the double-flow video is improved, and the phenomena of video blockage and unsmooth when the bandwidth is utilized at the instantaneous peak value can be avoided.
In an embodiment, as shown in fig. 11, based on the embodiment shown in fig. 10, the receiving end 20 further includes:
the skip module 23 is configured to, when receiving a picture switching instruction of a second path of video, skip to a corresponding picture according to a skip indication message sent by the sending end when the receiving end has received a picture to be switched.
In this embodiment, when the second path of video is to jump to the next screen, the sending end sends a jump instruction message to the receiving end, where the jump instruction message refers to a variable parameter (e.g., the page of the PPT) such as a frame number or a packet sequence number.
In this embodiment, if the picture to be switched by the user is already sent to the receiving end, the data does not need to be sent again, and the sending end only needs to send a picture jump indication message to notify the receiving end of jumping to the corresponding position. Thus, it is possible to avoid sending picture data with a large data amount, and it is only necessary to send a control message with a small data amount.
In this embodiment, the receiving end matches parameters such as a corresponding frame number and a frame position according to the received frame message of the second path of video, and skips to a corresponding frame according to the corresponding parameters. The sending end sends the frame picture number and the picture position information in a signaling mode or a mode carried in a data packet, and the frame picture number and the picture position information can be transmitted by using an RTP (real time Transport Protocol) or an RTCP (real time Transport Control Protocol).
In an embodiment, as shown in fig. 12, based on the embodiment shown in fig. 11, the skip module 23 includes:
an extracting unit 231, configured to analyze the skip instruction message by the receiving end, and extract a picture number and a picture position to be skipped;
in this embodiment, when receiving the skip instruction message, the receiving end parses the skip instruction message, where the skip instruction message includes a frame number, a picture position, a picture size, and the like, and extracts information such as the picture number to be skipped, the picture position, and the like from the skip instruction message.
The searching unit 232 is configured to search for a corresponding video picture according to the extracted picture number to be skipped and the picture position;
in this embodiment, when the receiving end extracts the picture number and the picture position to be skipped according to the skip instruction message, it searches for the corresponding video picture.
And a display unit 233, configured to extract the corresponding video picture from the buffer for display.
In this embodiment, the receiving end extracts a corresponding video frame from the previously cached data packet to display. The method for transmitting the high-definition dual-stream video provided by the embodiment can more fully utilize the bandwidth, when the video network transmission condition is good and the bandwidth utilization rate is low, the remaining picture frame stream can be additionally transmitted, and when the subsequent network transmission condition becomes poor or the bandwidth utilization rate is high, the picture jump of the receiving end is only required to be notified through signaling or other modes, so that the definition and the fluency of the video can be ensured, and more bandwidth allowance can be reserved for the first path of main video.
The present invention further provides a transmission system 100, and referring to fig. 13, in an embodiment, the transmission system 100 includes the sending end 10 of the video conference terminal device as described above, and the receiving end 20 of the video conference terminal device as described above.
In this embodiment, a sending end sends a first path of video and a second path of video with a first predetermined code rate to a receiving end of a video conference terminal device, the receiving end feeds back current broadband information and network transmission information to the sending end, and when the sending end receives the current bandwidth information and the network transmission information fed back by the receiving end, if a video source type of the second path of video is a static video, the sending end encodes the remaining video frame with a second predetermined code rate when the current bandwidth information and the network transmission information meet predetermined conditions, and packs and sends the encoded video data to the receiving end.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.
Claims (15)
1. A transmission method of a high-definition double-stream video is characterized by comprising the following steps: a sending end sends a first path of video and a second path of video with a first preset code rate to a receiving end of video conference terminal equipment;
when receiving the current bandwidth information and the network transmission information fed back by the receiving end, if the video source type of the second path of video is a static video, the sending end encodes the rest video picture frames at a second preset code rate when the current bandwidth information and the network transmission information meet preset conditions;
the sending end packs the coded video data and sends the packed video data to the receiving end;
the step of the sending end encoding the rest video picture frame with the second predetermined code rate further comprises:
and when the second path of high-definition video stays in a certain static picture, the bandwidth has a margin and the network packet loss rate is lower than a preset threshold value, the sending end encodes the remaining video pictures by using a second preset code rate.
2. The method for transmitting high definition dual-stream video according to claim 1, wherein when receiving the current bandwidth information and the network transmission information fed back by the receiving end, if the video source type of the second path of video is a static video, and when the current bandwidth information and the network transmission information satisfy the predetermined condition, the step of the sending end encoding the remaining video picture frames at the second predetermined code rate includes: when receiving current bandwidth information and network transmission information fed back by the receiving end, if the video source type of the second path of video is a static video, acquiring bandwidth allowance according to the current bandwidth information, and acquiring network packet loss rate according to the network transmission information;
comparing the size relationship between the bandwidth allowance and a first preset threshold value, and the size relationship between the network packet loss rate and a second preset threshold value;
and when the bandwidth margin is greater than a first preset threshold and the network packet loss rate is less than a second preset threshold, the sending end encodes the rest video picture frame at a second preset code rate.
3. The method for transmitting high definition dual stream video according to claim 1, wherein the method for transmitting high definition dual stream video further comprises: when receiving a picture switching instruction of a second path of video, if the receiving end receives a picture to be switched, the sending end sends a skip indication message to the receiving end so as to enable the receiving end to skip to a corresponding picture according to the skip indication message.
4. The method for transmitting high definition dual stream video according to claim 1, wherein the method for transmitting high definition dual stream video further comprises: and when receiving a picture switching instruction of a second path of video, if the receiving end does not receive the picture to be switched, the sending end encodes the rest video picture frames at a second preset code rate, and packs and sends the encoded video data to the receiving end.
5. A transmission method of a high-definition double-stream video is characterized by comprising the following steps: a receiving end of video conference terminal equipment receives a first path of video and a second path of video with a preset code rate, which are sent by a sending end;
the receiving end feeds back current bandwidth information and network transmission information to the sending end;
if the video source type of the second path of video is a static video, receiving the rest video frame data coded by the sending end at a second preset code rate when the current bandwidth information and the network transmission information meet preset conditions;
the step of the sending end encoding the rest video picture frame data with the second predetermined code rate further comprises:
and when the second path of high-definition video stays in a certain static picture, the bandwidth has a margin and the network packet loss rate is lower than a preset threshold value, the sending end encodes the remaining video pictures by using a second preset code rate.
6. The method for transmitting high definition dual stream video according to claim 5, wherein the method for transmitting high definition dual stream video further comprises: when receiving a picture switching instruction of a second path of video, if the receiving end has received a picture to be switched, when receiving a skip indication message sent by the sending end, the receiving end skips to a corresponding picture according to the skip indication message.
7. The transmission method of high definition dual-stream video according to claim 6, wherein the step of the receiving end jumping to the corresponding picture according to the jump indication message comprises: the receiving end analyzes the jump indication message and extracts the picture number and the picture position to be jumped;
searching a corresponding video picture according to the extracted picture number to be jumped and the picture position;
and extracting the corresponding video picture from the cache for display.
8. A sending end of a video conference terminal device, wherein the sending end of the video conference terminal device comprises: the sending module is used for sending a first path of video and a second path of video with preset code rate to a receiving end of the video conference terminal equipment;
the encoding module is used for encoding the rest video picture frames at a second preset code rate by the sending end when the current bandwidth information and the network transmission information fed back by the receiving end are received and the video source type of the second path of video is the static video when the current bandwidth information and the network transmission information meet preset conditions;
the sending module is further configured to pack the encoded video data by the sending end and send the packed video data to the receiving end;
the step of the sending end encoding the rest video picture frames with the second predetermined code rate comprises:
and when the second path of high-definition video stays in a certain static picture, the bandwidth has a margin and the network packet loss rate is lower than a preset threshold value, the sending end encodes the remaining video pictures by using a second preset code rate.
9. The transmitting end of the video conference terminal device of claim 8, wherein the encoding module comprises: an obtaining unit, configured to, when receiving current bandwidth information and network transmission information fed back by the receiving end, obtain a bandwidth margin according to the current bandwidth information if the video source type of the second path of video is a static video, and obtain a network packet loss rate according to the network transmission information;
a comparing unit, configured to compare a size relationship between the bandwidth margin and a first predetermined threshold, and a size relationship between the network packet loss rate and a second predetermined threshold;
and the coding unit is used for coding the rest video picture frames by the sending end at a second preset code rate when the bandwidth margin is greater than a first preset threshold and the network packet loss rate is less than a second preset threshold.
10. The transmitting end of the video conference terminal device of claim 8, wherein the transmitting module is further configured to: when receiving a picture switching instruction of a second path of video, if the receiving end receives a picture to be switched, the sending end sends a skip indication message to the receiving end so as to enable the receiving end to skip to a corresponding picture according to the skip indication message.
11. The transmitting end of the video conference terminal device of claim 8, wherein the transmitting module is further configured to: and when receiving a picture switching instruction of a second path of video, if the receiving end does not receive the picture to be switched, the sending end encodes the rest video picture frames at a second preset code rate, and packs and sends the encoded video data to the receiving end.
12. A receiving end of a video conference terminal device, the receiving end of the video conference terminal device comprising: the receiving module is used for receiving a first path of video and a second path of video with a preset code rate, which are sent by a sending end, by a receiving end of the video conference terminal equipment;
the feedback module is used for the receiving end to feed back the current bandwidth information and the network transmission information to the sending end;
the receiving module is configured to receive, if the video source type of the second path of video is a static video, remaining video frame data encoded by the sending end at a second predetermined code rate when the current bandwidth information and the network transmission information satisfy a predetermined condition;
the step of the sending end encoding the rest video frame data with the second preset code rate comprises the following steps:
and when the second path of high-definition video stays in a certain static picture, the bandwidth has a margin and the network packet loss rate is lower than a preset threshold value, the sending end encodes the remaining video pictures by using a second preset code rate.
13. The receiving end of the video conference terminal device according to claim 12, wherein the receiving end further comprises: and the skipping module is used for skipping to a corresponding picture according to the skipping indication message when the skipping indication message sent by the sending end is received if the receiving end receives the picture to be switched when the picture switching instruction of the second path of video is received.
14. The receiving end of the video conference terminal device of claim 13, wherein the skip module comprises: the extracting unit is used for analyzing the jump indicating message by the receiving end and extracting the picture number and the picture position to be jumped;
the searching unit is used for searching the corresponding video picture according to the extracted picture number to be jumped and the picture position;
and the display unit is used for extracting the corresponding video picture from the cache to display.
15. A transmission system, characterized in that the transmission system comprises a transmitting end of the video conference terminal device according to any one of claims 8 to 11, and a receiving end of the video conference terminal device according to any one of claims 12 to 14.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710130535.4A CN108540745B (en) | 2017-03-06 | 2017-03-06 | High-definition double-stream video transmission method, transmitting end, receiving end and transmission system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710130535.4A CN108540745B (en) | 2017-03-06 | 2017-03-06 | High-definition double-stream video transmission method, transmitting end, receiving end and transmission system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108540745A CN108540745A (en) | 2018-09-14 |
| CN108540745B true CN108540745B (en) | 2021-04-30 |
Family
ID=63489665
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710130535.4A Active CN108540745B (en) | 2017-03-06 | 2017-03-06 | High-definition double-stream video transmission method, transmitting end, receiving end and transmission system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108540745B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109413205A (en) * | 2018-12-04 | 2019-03-01 | 北京诺士诚国际工程项目管理有限公司 | A kind of management data uploading method and device |
| CN110753230A (en) * | 2019-11-15 | 2020-02-04 | 北京淳中科技股份有限公司 | Video streaming system and method |
| CN111988645B (en) * | 2020-08-27 | 2022-07-19 | 上海七牛信息技术有限公司 | Audio and video transmission bandwidth self-adaption method |
| CN113286146B (en) * | 2021-07-26 | 2021-10-01 | 腾讯科技（深圳）有限公司 | Media data processing method, device, equipment and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6091777A (en) * | 1997-09-18 | 2000-07-18 | Cubic Video Technologies, Inc. | Continuously adaptive digital video compression system and method for a web streamer |
| CN101242513A (en) * | 2008-03-10 | 2008-08-13 | 杭州华三通信技术有限公司 | Dual-stream transmission method in video conference and video conference system |
| CN101341746A (en) * | 2005-12-22 | 2009-01-07 | 维德约股份有限公司 | System and method for videoconferencing using scalable video coding and compositing scalable video conferencing servers |
| US9894322B1 (en) * | 2017-03-08 | 2018-02-13 | Via Technologies, Inc. | Video conference system, server and terminal equipment |
-
2017
- 2017-03-06 CN CN201710130535.4A patent/CN108540745B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6091777A (en) * | 1997-09-18 | 2000-07-18 | Cubic Video Technologies, Inc. | Continuously adaptive digital video compression system and method for a web streamer |
| CN101341746A (en) * | 2005-12-22 | 2009-01-07 | 维德约股份有限公司 | System and method for videoconferencing using scalable video coding and compositing scalable video conferencing servers |
| CN101242513A (en) * | 2008-03-10 | 2008-08-13 | 杭州华三通信技术有限公司 | Dual-stream transmission method in video conference and video conference system |
| US9894322B1 (en) * | 2017-03-08 | 2018-02-13 | Via Technologies, Inc. | Video conference system, server and terminal equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108540745A (en) | 2018-09-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR101557504B1 (en) | Method for transmitting adapted channel condition apparatus using the method and providing system | |
| US8661152B2 (en) | Method and apparatus for reducing deterioration of a quality of experience of a multimedia service in a multimedia system | |
| CN108540745B (en) | High-definition double-stream video transmission method, transmitting end, receiving end and transmission system | |
| JP4670902B2 (en) | Transmitting apparatus, transmitting method, and receiving apparatus | |
| WO2011049179A1 (en) | Distribution system, gateway, distribution method, and program | |
| US9369508B2 (en) | Method for transmitting a scalable HTTP stream for natural reproduction upon the occurrence of expression-switching during HTTP streaming | |
| WO2011004886A1 (en) | Delivering system, method, gateway apparatus and program | |
| WO2011049193A1 (en) | Distribution system, gateway, distribution method, and program | |
| US10003626B2 (en) | Adaptive real-time transcoding method and streaming server therefor | |
| US20140189064A1 (en) | Method and system for adaptive video transmission | |
| JPWO2007105618A1 (en) | Buffer control method, relay device, communication system | |
| US20130039177A1 (en) | Remote mobile communication system, server device and control method of remote mobile communication system | |
| CN108924631B (en) | Video generation method based on audio and video shunt storage | |
| US20120017249A1 (en) | Delivery system, delivery method, conversion apparatus, and program | |
| US10085029B2 (en) | Switching display devices in video telephony | |
| US9313508B1 (en) | Feeding intra-coded video frame after port reconfiguration in video telephony | |
| US11197044B2 (en) | Communication apparatus, media distribution system, media distribution method, and non-transitory computer readable medium | |
| US10686859B2 (en) | Content scenario and network condition based multimedia communication | |
| KR101055169B1 (en) | Traffic control method and device therefor in streaming system | |
| EP2882164A1 (en) | Communication system, server apparatus, server apparatus controlling method and program | |
| WO2011142312A1 (en) | Remote mobile communications system, server device, and remote mobile communications system control method | |
| JP2016192658A (en) | Communication system, communication device, communication method and communication control method | |
| KR100713363B1 (en) | Apparatus and method for transmitting mpeg | |
| KR20160147322A (en) | Method and appratus for controlling media contents delivery |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |