CN106060582B - Video transmission system, method and device - Google Patents

Video transmission system, method and device Download PDF

Info

Publication number
CN106060582B
CN106060582B CN201610352594.1A CN201610352594A CN106060582B CN 106060582 B CN106060582 B CN 106060582B CN 201610352594 A CN201610352594 A CN 201610352594A CN 106060582 B CN106060582 B CN 106060582B
Authority
CN
China
Prior art keywords
image frame
sub
video
resolution
original
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201610352594.1A
Other languages
Chinese (zh)
Other versions
CN106060582A (en
Inventor
王云
朱庆泉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Huaduo Network Technology Co Ltd
Original Assignee
Guangzhou Huaduo Network Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Huaduo Network Technology Co Ltd filed Critical Guangzhou Huaduo Network Technology Co Ltd
Priority to CN201610352594.1A priority Critical patent/CN106060582B/en
Publication of CN106060582A publication Critical patent/CN106060582A/en
Application granted granted Critical
Publication of CN106060582B publication Critical patent/CN106060582B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/854—Content authoring
    • H04N21/8547—Content authoring involving timestamps for synchronizing content
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234363—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by altering the spatial resolution, e.g. for clients with a lower screen resolution
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440263—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/647—Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
    • H04N21/64784—Data processing by the network
    • H04N21/64792—Controlling the complexity of the content stream, e.g. by dropping packets

Abstract

The embodiment of the invention discloses a kind of Video transmission systems, method and device, belong to field of video processing.The system includes: video capture device, for sending collected original video stream to video processing equipment；Video processing equipment, for extracting the original image frame in original video stream, original image frame has first resolution；Each original image frame is divided into n sub-image frame, sub-image frame has second resolution, and first resolution > second resolution；It include the n way video flowing of sub-image frame to an at least video encoder distribution；Video encoder, the sub-image frame for including in sub-video stream are encoded；Sub-video stream after coding is transmitted to video decoding apparatus；Video decoding apparatus, for receiving the n way video flowing of at least video encoder transmission；The sub-image frame for including in each way video flowing is decoded；Splice sub-video stream described in the decoded road n and obtains original video stream.

Description

Video transmission system, method and device
Technical field
The present embodiments relate to field of video processing, in particular to a kind of Video transmission system, method and device.
Background technique
Internet video live broadcasting facilitates user to watch the real-time of live streaming scene by network as a kind of emerging direct-seeding Picture.
When carrying out internet video live broadcasting, the video capture device that scene is broadcast live is spread collected video by network Video encoder is transported to, the video flowing received is encoded using predictive encoding format by video encoder, and leads to Cross each user terminal that the video after coding is streamed to viewing live streaming by network.It is right after user terminal receives video flowing The video flowing is decoded, to show the real-time pictures at live streaming scene.
In the implementation of the present invention, the inventor finds that the existing technology has at least the following problems: in order to improve network The quality of net cast, video capture device needs to improve the resolution ratio of the video flowing of acquisition, when video in video encoder Encoder support resolution ratio be less than the video flowing resolution ratio when, need to upgrade video encoder, upgrade cost compared with It is high.For example, needing to configure support in video encoder when video capture device acquires and transmits the video flowing of 4K resolution ratio The video encoder of 4K resolution ratio could encode the video flowing.
Summary of the invention
In order to solve when the resolution ratio that video encoder is supported in video encoder is less than the resolution for receiving video flowing It when rate, needs to upgrade video encoder, the higher problem of upgrade cost, the embodiment of the invention provides a kind of video biographies Defeated system, method and device.The technical solution is as follows:
According to a first aspect of the embodiments of the present invention, a kind of Video transmission system is provided, the system comprises: video acquisition Equipment, video processing equipment, video encoder and video decoding apparatus；
The video capture device, for sending collected original video stream to the video processing equipment；
The video processing equipment, for extracting the original image frame in the original video stream, the original image frame With first resolution；Each original image frame is divided into n sub-image frame, the sub-image frame has second resolution, And second resolution described in the first resolution >；It include the subgraph at least one video encoder distribution The n way video flowing of frame；
The video encoder, for being encoded to the sub-image frame for including in the sub-video stream；It will compile The sub-video stream after code is transmitted to the video decoding apparatus；
The video decoding apparatus, for receiving the n way video that at least a video encoder is sent Stream；The sub-image frame for including in each way video flowing is decoded；Splice sub-video stream described in the decoded road n to obtain The original video stream.
According to a second aspect of the embodiments of the present invention, a kind of video transmission method is provided, which comprises
Receive the original video stream that video capture device is sent；
The original image frame in the original video stream is extracted, the original image frame has first resolution；
Each original image frame is divided into n sub-image frame, the sub-image frame has a second resolution, and described the Second resolution described in one resolution ratio >；
It include the n way video flowing of the sub-image frame, the Video coding to an at least video encoder distribution Equipment spreads the sub-video after coding for encoding to the sub-image frame for including in the sub-video stream Video decoding apparatus is transported to, the video decoding apparatus is used to receive the n that at least a video encoder is sent Way video flowing, and after the sub-image frame for including in each way video flowing is decoded, splice the decoded road n institute It states sub-video stream and obtains the original video stream.
According to a third aspect of the embodiments of the present invention, a kind of video transmission method is provided, which comprises
Receive the n way video flowing of at least video encoder transmission；The subgraph for including in the sub-video stream Frame by coding, by video processing equipment to the original image frame in original video stream divided to obtain, described by the sub-image frame Original image frame has first resolution, and the sub-image frame has second resolution, and the described in the first resolution > Two resolution ratio；
The sub-image frame for including in each way video flowing is decoded；
Splice the decoded n way video flowing and obtains the original video stream.
According to a fourth aspect of the embodiments of the present invention, a kind of video frequency transmitter is provided, described device includes:
First receiving module, for receiving the original video stream of video capture device transmission；
Extraction module, for extracting the original image frame in the original video stream, the original image frame has first Resolution ratio；
Divide module, for each original image frame to be divided into n sub-image frame, the sub-image frame has second point Resolution, and second resolution described in the first resolution >；
Distribution module, for including the n way video flowing of the sub-image frame to an at least video encoder distribution, The video encoder is for encoding the sub-image frame for including in the sub-video stream, and by the institute after coding It states sub-video stream and is transmitted to video decoding apparatus, the video decoding apparatus is for receiving an at least video encoder The n way video flowing sent, and after the sub-image frame for including in each way video flowing is decoded, splicing solution Sub-video stream described in the road n after code obtains the original video stream.
According to a fifth aspect of the embodiments of the present invention, a kind of video frequency transmitter is provided, described device includes:
Second receiving module, for receiving the n way video flowing of at least video encoder transmission；The sub-video The sub-image frame for including in stream is by coding, and the sub-image frame is by video processing equipment to the original image in original video stream Frame is divided to obtain, and the original image frame has first resolution, and the sub-image frame has second resolution, and described first Second resolution described in resolution ratio >；
Decoder module, for being decoded to the sub-image frame for including in each way video flowing；
Splicing module obtains the original video stream for splicing the decoded n way video flowing.
The original image frame in original video stream is divided into n sub-image frame by video processing equipment, and to video Encoding device distribution includes the n way video flowing of the sub-image frame, is carried out by video encoder to the sub-video stream received Coding, and it is transmitted to video decoding apparatus, spelling finally is decoded to the n way video flowing received by video decoding apparatus It connects, obtains original video stream；It solves and receives video when the resolution ratio that video encoder is supported in video encoder is less than It when the resolution ratio of stream, needs to upgrade video encoder, the higher problem of upgrade cost；Reach not to Video coding It is by video processing equipment that original video stream intermediate-resolution is biggish original under the premise of video encoder is upgraded in equipment Image frame division is the lesser sub-image frame of several resolution ratio, and by several video encoders respectively to including subgraph The sub-video stream of frame is encoded, and the coding to original video stream is realized, to save upgrade cost.
Detailed description of the invention
To describe the technical solutions in the embodiments of the present invention more clearly, make required in being described below to embodiment Attached drawing is briefly described, it should be apparent that, drawings in the following description are only some embodiments of the invention, for For those of ordinary skill in the art, without creative efforts, it can also be obtained according to these attached drawings other Attached drawing.
Fig. 1 shows the structural schematic diagram of Video transmission system provided by one embodiment of the present invention；
Fig. 2A is a kind of schematic diagram of original image frame partitioning scheme；
Fig. 2 B is the schematic diagram of another original image frame partitioning scheme；
Fig. 3 is the implementation diagram of Video transmission system transmission 4K video；
Fig. 4 is the implementation diagram that video decoding apparatus sub-video stream is decoded splicing；
Fig. 5 shows the flow chart of video transmission method provided by one embodiment of the present invention；
Fig. 6 shows the flow chart of the video transmission method of another embodiment of the present invention offer；
Fig. 7 A shows the flow chart for the video transmission method that further embodiment of the present invention provides；
Fig. 7 B is the flow chart of sub-video stream distribution procedure involved in video transmission method shown in Fig. 7 A；
Fig. 7 C is the flow chart of sub-image frame splicing involved in video transmission method shown in Fig. 7 A；
Fig. 7 D is the flow chart of packet loss retransmission processes involved in video transmission method shown in Fig. 7 A；
Fig. 7 E is the flow chart of packet loss retransmission request generating process involved in video transmission method shown in Fig. 7 A；
Fig. 8 shows the structural block diagram of video frequency transmitter provided by one embodiment of the present invention；
Fig. 9 shows the structural block diagram of the video frequency transmitter of another embodiment of the present invention offer；
Figure 10 shows the structural block diagram for the video frequency transmitter that further embodiment of the present invention provides；
Figure 11 shows the structural block diagram for the video frequency transmitter that another embodiment of the invention provides.
Specific embodiment
To make the object, technical solutions and advantages of the present invention clearer, below in conjunction with attached drawing to embodiment party of the present invention Formula is described in further detail.
Referring to FIG. 1, it illustrates the structural schematic diagrams of Video transmission system provided by one embodiment of the present invention.The view It include video capture device 110, video processing equipment 120, video encoder 130 and video decoding apparatus in frequency Transmission system 140。
Video capture device 110 is the electronic equipment with video acquisition function, which can be smart phone, Tablet computer, personal computer or the video camera being connected with personal computer etc..
It is connected between video capture device 110 and video processing equipment 120 by wired or wireless network, and is had by this Line or wireless network send collected original video stream to video processing equipment 120.
Video processing equipment 120 is the computer or server with video processing function.Video processing equipment 120 is used for The original video stream received is split, so that original video stream is divided into several sub-video streams, and by compiling with video Several sub-video streams are distributed to an at least video encoder 130 by the network between decoding apparatus 130.
It is connected between video processing equipment 120 and video encoder 130 by wired or wireless network.
Video encoder 130 is the computer or server for being equipped with video encoder.The video encoder is for adopting With predictive encoding format, the sub-video stream received is encoded, and the sub-video stream after coding is transmitted to video decoding Equipment.
It is connected between video encoder 130 and video decoding apparatus 140 by wired or wireless network.
Video decoding apparatus 140 is the electronic equipment with video decoding function, the electronic equipment can be smart phone, Tablet computer, personal computer etc..Video decoding apparatus 140 is used to receive what an at least video encoder 130 transmitted Sub-video stream, and several sub-video streams are spliced to obtain original video stream.Optionally, in the video decoding apparatus 140 It is also equipped with net cast application program, video decoding apparatus 140 is i.e. by the net cast application program to spliced original Beginning video flowing is shown.
Video transmission system as shown in connection with fig. 1, the original video stream that video capture device 110 acquires is by several continuous Original image frame is constituted, and video processing equipment 120 can be realized by being split to original image frame by original video flow point Several sub-video streams are segmented into, correspondingly, video decoding apparatus 140 can be by being decoded splicing to several sub-video streams, also Former original video stream.
Optionally, video capture device 110, for sending collected original video stream to video processing equipment 120.
Operation has net cast application program in video capture device, when the video for enabling the net cast application program is straight When multicast function, video capture device passes through camera or other Image Acquisition tools acquisition video data, and handles to video Equipment sends collected video flowing.Wherein, which can be the background devices of net cast application program.
The original video stream that video capture device is sent is made of several continuous original image frames, and each original image Frame is the original image without coding.For example, video capture device is to support 4K (being often referred to resolution ratio is 3840*2160) The video camera of video record, each of original video stream which sends to video processing equipment original graph As the original image of RGB or yuv format that frame is 4K resolution ratio.
Video processing equipment 120, for extracting the original image frame in original video stream, original image frame has first point Resolution；Each original image frame is divided into n sub-image frame, sub-image frame has second resolution, and first resolution > Second resolution；It include the n way video flowing of sub-image frame to an at least distribution of video encoder 130.
After receiving original video stream, video processing equipment extracts each original image frame in the original video stream, In each original image frame be first resolution original image.Further, video processing equipment is each to what is extracted Original image frame is split, and each original image frame is divided into sub-image frame (the n sub-image frame of n second resolution Intersection be the original image frame), wherein first resolution > second resolution, and second resolution be video encoder The resolution ratio supported.
In a kind of possible embodiment, after video processing equipment receives original video stream, original video stream is obtained The corresponding first resolution of middle original image frame, and the second resolution that video encoder is supported is obtained, thus according to One resolution ratio and second resolution calculate the quantity n for the sub-image frame being divided into.Further, video processing equipment is according to first The ratio between the resolution ratio of resolution ratio and second resolution on transverse and longitudinal direction, is divided into n second resolution for original image frame Sub-image frame.
Wherein, the quantity of sub-image frame=(corresponding transverse direction of the corresponding lateral resolution/second resolution of first resolution Resolution ratio) × (the corresponding longitudinal resolution of the corresponding longitudinal resolution/second resolution of first resolution)
For example, as shown in Figure 2 A, when the corresponding first resolution of original image frame is 3840*2160 (i.e. 4K), and video When the second resolution that encoding device is supported is 1920*1080 (i.e. 1080p or 2K), subgraph is calculated in video processing equipment As the quantity of frame is (3840/1920) × (2160/1080)=4.Video processing equipment is i.e. according to first resolution and second point The ratio between lateral resolution of resolution (3840/1920=2), from vertical direction on original image frame is divided into two equal portions, according to The ratio between longitudinal resolution of first resolution and second resolution (2160/1080=2), from horizontal direction on by original image frame Two equal portions are divided into, so that original image frame to be divided into the sub-image frame of 4 1080p.
For another example, as shown in Figure 2 B, when the corresponding first resolution of original image frame be 3840*2160 (i.e. 4K), and regard When the second resolution that frequency encoding device is supported is 1280*720 (i.e. 720p), sub-image frame is calculated in video processing equipment Quantity be (3840/1280) × (2160/720)=9.Video processing equipment is according to first resolution and second resolution The ratio between lateral resolution (3840/1280=3), from vertical direction on original image frame is divided into three equal parts, according to first point The ratio between resolution and the longitudinal resolution of second resolution (2160/720=3), from horizontal direction on original image frame is divided into Three equal parts, so that original image frame to be divided into the sub-image frame of 9 720p.
It should be noted that may exist intersection between n sub-image frame being divided into can also when segmentation original image frame Intersection is not present, and the partitioning scheme that each original image frame uses in same original video stream is identical.The embodiment of the present disclosure It is only schematically illustrated, the disclosure is not constituted with above-mentioned partitioning scheme (intersection is mutually not present between n sub-image frame) It limits.
After being split to each original image frame in original video stream, original video stream is n son after being divided Video flowing includes the sub-image frame in each sub-video stream.The n sub-video stream that video processing equipment obtains segmentation is distributed An at least video encoder into Video transmission system.
Video encoder 130, the sub-image frame for including in sub-video stream are encoded；By the son view after coding Frequency is streamed to video decoding apparatus 140.
After video encoder receives sub-video stream, using each subgraph in predictive encoding mode sub-video stream Frame is encoded.In a kind of possible embodiment, video encoder can use H264 coded format sub-video stream It is encoded, each sub-image frame coding is H264 picture in the sub-video stream after coding.Further, video encoder Sub-video stream after coding is transmitted to video decoding apparatus.
Video decoding apparatus 140, for receiving the n way video flowing of an at least video encoder 130 transmission；To each The sub-image frame for including in way video flowing is decoded；Splice decoded n way video flowing and obtains original video stream.
Net cast application program is installed, when the live streaming for opening the net cast application program is received in video decoding apparatus When seeing function, which is the n way video flowing for receiving an at least video encoder and sending, and to n way Video flowing is decoded splicing, to restore original video stream.
Video transmission system as shown in connection with fig. 1, as shown in figure 3, the original video stream sent in video capture device 110 Resolution ratio be 4K in the case where, the original video stream of 4K is divided into the sub-video of 4 road 1080p by video processing equipment 120 Stream, and sub-video is carried out by an at least video encoder 130 (resolution ratio of support is 1080p but does not support 4K resolution ratio) The coding of stream, so that the coding to 4K original video stream is realized, finally by video decoding apparatus 140 according to 4 way video flowing solutions Code splicing and recovery goes out original video stream, realizes the transmission of 4K video.Entire video transmitting procedure is not necessarily to video encoder Video encoder is upgraded, and display reduces the transmission cost of high-resolution video.
In each sub-video stream divided by original video stream, multiple sub-image frames including arranged in sequence, in order to Guarantee that video decoding apparatus can be original out according to the sub-image frame data splicing and recovery under synchronization in different sub-video streams Picture frame, each sub-image frame in sub-video stream correspond to the timestamp and location information of itself.
Optionally, video processing equipment 120, for obtaining the timestamp of original image frame；By the time of original image frame Stamp is determined as the timestamp of the corresponding each sub-image frame of original image frame；Obtain the location information of each sub-image frame.
Each original image frame includes corresponding timestamp in original video stream, which is used to indicate corresponding original graph As the acquisition time of frame, and the corresponding timestamp of continuous original image frame is continuous.Video processing equipment to original image frame into When row segmentation, the timestamp of original image frame is obtained, and using the timestamp as the timestamp of each sub-image frame after segmentation.
For example, the timestamp of some original image frame in original video stream is 106139152551415, then it is original by this The timestamp of each sub-image frame made of image frame division is 106139152551415.
In order to indicate sub-image frame the location of in corresponding original image frame, each sub-image frame includes corresponding Location information.In a kind of possible embodiment, which can use set of coordinates, i.e., indicate by way of coordinate Position of the sub-image frame in original image frame.
For example, the location information can be quaternary set of coordinates (a, b, c, d), wherein the cross of a expression sub-image frame left edge Coordinate, b indicate that the ordinate of sub-image frame top edge, c indicate that the abscissa of sub-image frame right hand edge, d indicate under sub-image frame The ordinate at edge.As shown in Figure 2 A, using the left upper apex of original image frame (4K picture) as origin, sub-image frame 1 is corresponding Location information can be expressed as (0,0,1920,1080), the corresponding location information of sub-image frame 2 can be expressed as (1920,0, 3840,1080), the corresponding location information of sub-image frame 3 can be expressed as (0,1080,1920,2160), and sub-image frame 4 is corresponding Location information can be expressed as (1920,1080,3840,2160).It should be noted that in other possible embodiments In, it can also be using the absolute coordinate of sub-image frame as location information, the present embodiment is defined not to this.
After getting the timestamp and location information of sub-video frame, video processing equipment can using predetermined format to its into Row storage, schematically, which can be shown in table one.
Table one
Wherein, ChannelID is used to indicate original video stream belonging to sub-video frame, meanwhile, in order to avoid different original Video flowing is obscured, and the ChannelID is unique in systems；Timestamp is the timestamp of sub-video frame；LocationType is used The meaning of each location parameter in instruction sub-image frame corresponding position information；Location is the corresponding position of sub-image frame Information.
Video processing equipment 120 is also used to that n way video flowing is distributed to n platform video according to timestamp and location information Encoding device.
After video processing equipment gets the timestamp and location information of sub-image frame, according to the timestamp and location information It determines n way video flowing, guarantees in same way video flowing, the timestamp of each sub-image frame is continuous and different, and each The location information of a sub-image frame is identical.
Since the processing capacity of video encoder is limited, by n way video stream to same video encoder, and N way video flowing is encoded by the video encoder, separate unit video encoder processing pressure will be caused excessive, is influenced Video treatment effeciency and stability.Therefore, in a kind of possible embodiment, video processing equipment is by n way video flow point It is sent to n platform video encoder, so that every video encoder only needs to encode 1 way video flowing, is significantly reduced The processing pressure of separate unit video encoder improves the efficiency and stability of video processing.
Correspondingly, after video decoding apparatus receives the sub-video stream that video processing equipment is distributed, according to each subgraph The corresponding timestamp of frame and location information are decoded splicing to n way video flowing, to restore original video stream.
Optionally, video decoding apparatus 130, for obtaining the timestamp of each sub-image frame in each way video flowing；It is right The identical n sub-image frame of timestamp is decoded.
For the n way video flowing received, video decoding apparatus by timestamp in each way video flowing it is identical n son Picture frame is determined as being associated with sub-image frame (association sub-image frame belongs to same original image frame), and by Video Decoder to pass Connection sub-image frame is decoded.Wherein, decoded association sub-image frame is the picture that can be RGB or yuv format.
Video decoding apparatus 130 is also used to acquisition time and stabs identical n sub-image frame respective positions information；According to Location information splices decoded n sub-image frame, obtains the corresponding original image frame of n sub-image frame.
In order to further determine each association sub-image frame the location of in corresponding original image frame, video decoding is set The standby location information for obtaining each association sub-image frame, and its position is determined according to the location information.Video decoding apparatus according to Sub-image frame respective positions are associated with, n sub-image frame are spliced, to restore original image frame.
In a kind of possible embodiment, which is the set of coordinates of sub-image frame, i.e., by way of coordinate Indicate position of the sub-image frame in original image frame.For example, the location information can be quaternary set of coordinates (a, b, c, d), In, a indicates that the abscissa of sub-image frame left edge, b indicate that the ordinate of sub-image frame top edge, c indicate on the right of sub-image frame The abscissa of edge, d indicate the ordinate of sub-image frame lower edge.
As shown in Figure 2 A, video decoding apparatus determines associated 4 sub-image frames according to the timestamp of sub-image frame, In, the corresponding quaternary set of coordinates of sub-image frame 1 is (0,0,1920,1080), and the corresponding quaternary set of coordinates of sub-image frame 2 is (1920,0,3840,1080), the corresponding quaternary set of coordinates of sub-image frame 3 are (0,1080,1920,2160), and sub-image frame 4 is right The quaternary set of coordinates answered is (1920,1080,3840,2160).According to the corresponding quaternary set of coordinates of each sub-image frame, video solution Decoding apparatus determines that sub-image frame 1 is located at the upper left corner of original image frame, and sub-image frame 2 is located at the upper right corner of original image frame, son Picture frame 3 is located at the lower left corner of original image frame, and sub-image frame 4 is located at the lower right corner of original image frame, and according to each subgraph As the relative position between frame is spliced, to restore original image frame.
In the present embodiment, the timestamp of each sub-image frame and position in the sub-video stream that is divided into according to original video stream The n sub-image frame splicing and recovery original image frame with identical time stamp is avoided that mistake occurs when splicing, guaranteed by information Video transmission quality.
In the present embodiment, coding transmission is carried out to n way video flowing by n platform video encoder, so that every video Encoding device only needs to encode 1 way video flowing, significantly reduces the processing pressure of separate unit video encoder, improves The efficiency and stability of video processing.
When video encoder transmits sub-video stream to video decoding apparatus, due to network fluctuation etc., sub-video stream In partial subgraph as frame it is possible that lose, in order to guarantee video decoding apparatus normal decoding splice, when generation packet loss When, video decoding apparatus requests to retransmit the subgraph lost to video encoder according to preset packet loss retransmission mechanism Frame.
Optionally, video decoding apparatus 140 are also used to the timestamp according to each sub-image frame in each way video flowing, Timestamp alignment is carried out to the sub-image frame in each way video flowing；When the quantity of the sub-image frame with identical time stamp is less than When n, packet loss retransmission request is sent to video encoder 130, packet loss retransmission request is for requesting video encoder 130 again Send the sub-image frame lost.
Since original image frame is divided into n sub-image frame, in the case where packet loss does not occur, video decoding Sub-image frame in the n way video flowing that equipment receives, including n with identical time stamp；In the case where packet loss occurs, In the n way video flowing that video decoding apparatus receives, the sub-image frame quantity with identical time stamp will be less than n.
After video decoding apparatus receives n way video flowing, according to the time of each sub-image frame in each way video flowing Stamp carries out timestamp alignment to the sub-image frame in each way video flowing.After timestamp is aligned, video decoding apparatus detection Whether the quantity of the sub-image frame with identical time stamp is equal to n, when the quantity of the sub-image frame with identical time stamp is equal to n When, packet loss does not occur for determination, and is decoded splicing to the sub-image frame with identical time stamp；When with identical time stamp It when the quantity of sub-image frame is less than n, determines and packet loss has occurred, and send packet loss retransmission request, instruction view to video encoder Frequency encoding device retransmits the sub-image frame lost.
For example, as shown in figure 4, video decoding apparatus receives 4 way video flowings, respectively sub-video stream 1, sub-video stream 2, sub-video stream 3 and sub-video stream 4.It is sent out after carrying out timestamp alignment to the sub-image frame in each way video flowing according to timestamp Existing, the quantity of the corresponding sub-image frame of timestamp 2 is 3 (sub-image frame that timestamp is 2 in sub-video stream 2 is lost), when Between stab 98 corresponding sub-image frames quantity be 3 (sub-image frame that timestamp is 98 in sub-video stream 3 is lost).Video solution Decoding apparatus sends packet loss to the corresponding video encoder of sub-video stream 2 and the corresponding video encoder of sub-video stream 3 Retransmission request.
In a kind of possible embodiment, before sending packet loss retransmission request to video encoder, video decoding is set Standby 140, it is also used to when the quantity of the sub-image frame with identical time stamp is less than n, obtains the of the sub-image frame received One location information；According to first location information, the second location information for the sub-image frame lost is determined；According to timestamp and second Location information generates packet loss retransmission request.
Since the location information of the sub-image frame with identical time stamp is different, when the son with identical time stamp When the quantity of picture frame is less than n, video decoding apparatus can be determined to lose according to the location information of the sub-image frame received Picture frame location information.
For example, video decoding apparatus gets the corresponding location information of sub-image frame that timestamp is 2 in sub-video stream 1 is (0,0,1920,1080), the corresponding location information of sub-image frame that timestamp is 2 in sub-video stream 3 be (0,1080,1920, 2160) the corresponding location information of sub-image frame that, timestamp is 2 in sub-video stream 4 is (1920,1080,3840,2160), i.e., The location information that can determine the sub-image frame that the timestamp lost in sub-video stream 2 is 2 is (1920,0,3840,1080).
After (second) location information for determining the sub-image frame lost, video decoding apparatus and according to timestamp and should (the Two) location information generates corresponding packet loss retransmission request.
Video encoder 130 is also used to retransmit and lose to video decoding apparatus 140 according to packet loss retransmission request Sub-image frame.
Correspondingly, video encoder is lost according to the packet loss retransmission request received to video decoding apparatus retransmission The sub-image frame of mistake.
As shown in figure 4, receive video encoder return loss sub-image frame after, video decoding apparatus passes through solution Code device is decoded sub-image frame, obtains decoded sub-image frame, and splice according to the location information of each sub-image frame Restore original image frame.
In the present embodiment, video decoding apparatus determines whether according to the timestamp of each sub-image frame in each way video flowing Packet loss has occurred, and when detecting generation packet loss, corresponding video encoder is requested to retransmit the sub-image frame lost.It compares In retransmitting entire original image frame, only the sub-image frame of loss is retransmitted, can be improved retransmission efficiency, thus in network wave Guarantee preferable video fluency in the case where dynamic.
It may include a variety of decoders in video decoding apparatus, by taking video decoding apparatus is smart phone as an example, intelligent hand Machine can pass through CPU (Central Processing Unit, central processing unit), GPU (Graphics Processing Unit, graphics processor) or core video card (being integrated on CPU).It is wherein decoded using CPU and is commonly called as soft solution, and utilize GPU Or core video card is decoded and is commonly called as solving firmly.
When in order to avoid being decoded using single decoder, the excessive problem of decoder processes pressure, optionally, video Decoding device 140, for being decoded to the sub-image frame for including in n way video flowing by least one decoder；
Wherein, at least one decoder includes at least one of CPU, GPU and core video card.
For example, as shown in figure 4,4 way video flowings for receiving, video decoding apparatus pass through 4 kinds of different decodings Device is respectively decoded 4 way video flowings, can significantly improve the decoding efficiency of video decoding apparatus.
In the present embodiment, video decoding apparatus passes through at least one decoder, to the subgraph for including in n way video flowing Frame is decoded, and is avoided the excessive problem of single decoder processes pressure, is improved the decoding efficiency of video decoding apparatus.
Video transmission system as shown in connection with fig. 1, referring to FIG. 5, it illustrates views provided by one embodiment of the present invention Keep pouring in the flow chart of transmission method.The present embodiment is carried out so that the video transmission method is for the video processing equipment 120 in Fig. 1 as an example Illustrate, this method comprises:
Step 501, the original video stream that video capture device is sent is received.
Step 502, the original image frame in original video stream is extracted, original image frame has first resolution.
Step 503, each original image frame being divided into n sub-image frame, sub-image frame has a second resolution, and the One resolution ratio > second resolution.
For example, when n is 4, second resolution can be 2K when first resolution is 4K；When first resolution is 8K, n 4 When, second resolution can be 4K；When first resolution is 8K, and n is 16, second resolution can be 2K.
It step 504, include the n way video flowing of sub-image frame, Video coding to an at least video encoder distribution Sub-image frame of the equipment for including in sub-video stream is encoded, and the sub-video stream after coding is transmitted to video decoding Equipment, video decoding apparatus are used to receive the n way video flowing that at least a video encoder is sent, and to each road After the sub-image frame for including in sub-video stream is decoded, splices decoded n way video flowing and obtain original video stream.
In conclusion video transmission method provided in this embodiment, it will be in original video stream by video processing equipment Original image frame is divided into n sub-image frame, and includes the n way video flowing of the sub-image frame to video encoder distribution, The sub-video stream received is encoded by video encoder, and is transmitted to video decoding apparatus, is finally decoded by video The n way video flowing that equipment interconnection receives is decoded splicing, obtains original video stream；It solves and is regarded when in video encoder It when the resolution ratio that frequency encoder is supported is less than the resolution ratio for receiving video flowing, needs to upgrade video encoder, upgrade The problem of higher cost；Reach under the premise of not upgrading to video encoder in video encoder, by video It manages equipment and the biggish original image frame of original video stream intermediate-resolution is divided into the lesser sub-image frame of several resolution ratio, and The sub-video stream comprising sub-image frame is encoded respectively by several video encoders, realizes the volume to original video stream Code, to save upgrade cost.
Video transmission system as shown in connection with fig. 1, referring to FIG. 6, provided it illustrates another embodiment of the present invention The flow chart of video transmission method.The present embodiment by taking the video transmission method is for the video decoding apparatus 140 in Fig. 1 as an example into Row explanation, this method comprises:
Step 601, the n way video flowing of at least video encoder transmission is received；The son for including in sub-video stream Picture frame by coding, by video processing equipment to the original image frame in original video stream divided to obtain, original by sub-image frame Picture frame has first resolution, and sub-image frame has second resolution, and first resolution > second resolution.
Step 602, the sub-image frame for including in each way video flowing is decoded.
Step 603, splice decoded n way video flowing and obtain original video stream.
In conclusion video transmission method provided in this embodiment, it will be in original video stream by video processing equipment Original image frame is divided into n sub-image frame, and includes the n way video flowing of the sub-image frame to video encoder distribution, The sub-video stream received is encoded by video encoder, and is transmitted to video decoding apparatus, is finally decoded by video The n way video flowing that equipment interconnection receives is decoded splicing, obtains original video stream；It solves and is regarded when in video encoder It when the resolution ratio that frequency encoder is supported is less than the resolution ratio for receiving video flowing, needs to upgrade video encoder, upgrade The problem of higher cost；Reach under the premise of not upgrading to video encoder in video encoder, by video It manages equipment and the biggish original image frame of original video stream intermediate-resolution is divided into the lesser sub-image frame of several resolution ratio, and The sub-video stream comprising sub-image frame is encoded respectively by several video encoders, realizes the volume to original video stream Code, to save upgrade cost.
Video transmission system as shown in connection with fig. 1 please refers to Fig. 7 A, provides it illustrates further embodiment of the present invention The flow chart of video transmission method.The present embodiment by the video transmission method for for Video transmission system shown in FIG. 1 into Row explanation, this method comprises:
Step 701, the original video stream that video capture device is sent to video processing equipment.
The original video stream that video capture device is sent is made of several continuous original image frames, and each original image Frame is the original image without coding.For example, video capture device is to support 4K (being often referred to resolution ratio is 3840*2160) The video camera of video record, each of original video stream which sends to video processing equipment original graph As the original image of RGB or yuv format that frame is 4K resolution ratio.
Step 702, video processing equipment receives the original video stream that video capture device is sent.
Corresponding, video processing equipment receives the original video stream that video capture device is sent.
Step 703, video processing equipment extracts the original image frame in original video stream, which has first Resolution ratio.
After receiving original video stream, video processing equipment extracts each original image frame in the original video stream, In each original image frame be first resolution original image.
For example, each original image frame that video processing equipment extracts is 4K when original video stream is 4K video.
Step 704, each original image frame is divided into n sub-image frame by video processing equipment, and sub-image frame has the Two resolution ratio, and first resolution > second resolution.
Further, video processing equipment is split each original image frame extracted, by each original image Frame is divided into the sub-image frame of n second resolution, wherein and the resolution that second resolution is supported by video encoder Rate.
In a kind of possible embodiment, after video processing equipment receives original video stream, original video stream is obtained The corresponding first resolution of middle original image frame, and the second resolution that video encoder is supported is obtained, thus according to One resolution ratio and second resolution calculate the quantity n for the sub-image frame being divided into.Further, video processing equipment is according to first The ratio between the resolution ratio of resolution ratio and second resolution on transverse and longitudinal direction, is divided into n second resolution for original image frame Sub-image frame.
Wherein, the quantity of sub-image frame=(corresponding transverse direction of the corresponding lateral resolution/second resolution of first resolution Resolution ratio) × (the corresponding longitudinal resolution of the corresponding longitudinal resolution/second resolution of first resolution)
For example, as shown in Figure 2 A, when the corresponding first resolution of original image frame is 3840*2160 (i.e. 4K), and video When the second resolution that encoding device is supported is 1920*1080 (i.e. 1080p or 2K), subgraph is calculated in video processing equipment As the quantity of frame is (3840/1920) × (2160/1080)=4.Video processing equipment is i.e. according to first resolution and second point The ratio between lateral resolution of resolution (3840/1920=2), from vertical direction on original image frame is divided into two equal portions, according to The ratio between longitudinal resolution of first resolution and second resolution (2160/1080=2), from horizontal direction on by original image frame Two equal portions are divided into, so that original image frame to be divided into the sub-image frame of 4 1080p.
For another example, as shown in Figure 2 B, when the corresponding first resolution of original image frame be 3840*2160 (i.e. 4K), and regard When the second resolution that frequency encoding device is supported is 1280*720 (i.e. 720p), sub-image frame is calculated in video processing equipment Quantity be (3840/1280) × (2160/720)=9.Video processing equipment is according to first resolution and second resolution The ratio between lateral resolution (3840/1280=3), from vertical direction on original image frame is divided into three equal parts, according to first point The ratio between resolution and the longitudinal resolution of second resolution (2160/720=3), from horizontal direction on original image frame is divided into Three equal parts, so that original image frame to be divided into the sub-image frame of 9 720p.
It should be noted that may exist intersection between n sub-image frame being divided into can also when segmentation original image frame Intersection is not present, and the partitioning scheme that each original image frame uses in same original video stream is identical.The embodiment of the present disclosure It is only schematically illustrated, the disclosure is not constituted with above-mentioned partitioning scheme (intersection is mutually not present between n sub-image frame) It limits.Step 705, video processing equipment distributes the n way video flowing comprising sub-image frame to an at least video encoder.
After being split to each original image frame in original video stream, original video stream is n son after being divided Video flowing includes the sub-image frame in each sub-video stream.The n sub-video stream that video processing equipment obtains segmentation is distributed An at least video encoder into Video transmission system.
In order to guarantee that video decoding apparatus can be spelled according to the sub-image frame data under synchronization in different sub-video streams It connects and restores original image frame, and mitigate the processing pressure of separate unit video encoder, in a kind of possible mode, such as Fig. 7 B Shown, this step may include steps of.
Step 705A, video processing equipment obtain the timestamp of original image frame.
Each original image frame includes corresponding timestamp in original video stream, which is used to indicate corresponding original graph As the acquisition time of frame, and the corresponding timestamp of continuous original image frame is continuous.Video processing equipment to original image frame into When row segmentation, the timestamp of original image frame is obtained.
The timestamp of original image frame is determined as the corresponding each height of original image frame by step 705B, video processing equipment The timestamp of picture frame.
For example, the timestamp that video processing equipment gets some original image frame in original video stream is 106139152551415, then the timestamp for each sub-image frame being split to form by the original image frame is 106139152551415。
Step 705C, video processing equipment obtain the location information of each sub-image frame.
In order to indicate sub-image frame the location of in corresponding original image frame, each sub-image frame includes corresponding Location information.In a kind of possible embodiment, which can use set of coordinates, i.e., indicate by way of coordinate Position of the sub-image frame in original image frame
N way video flowing is distributed to n platform video according to timestamp and location information and compiled by step 705D, video processing equipment Decoding apparatus.
After getting timestamp and location information, video processing equipment determines n way according to the timestamp and location information Video flowing guarantees in same way video flowing that the timestamp of each sub-image frame is continuous and different, and each sub-image frame Location information it is identical.
Since the processing capacity of video encoder is limited, by n way video stream to same video encoder, and N way video flowing is encoded by the video encoder, separate unit video encoder processing pressure will be caused excessive, is influenced Video treatment effeciency and stability.Therefore, in a kind of possible embodiment, video processing equipment is by n way video flow point It is sent to n platform video encoder, so that every video encoder only needs to encode 1 way video flowing, is significantly reduced The processing pressure of separate unit video encoder improves the efficiency and stability of video processing.
It is set it should be noted that n way video flowing is only distributed to n platform Video coding with video processing equipment by the present embodiment It is illustrated for standby, the ways of distribution of sub-video stream, which is not constituted, limits.
Step 706, video encoder receives the sub-video stream of video processing equipment distribution.
Correspondingly, each video encoder receives the sub-video stream of video processing equipment distribution.
Step 707, the sub-image frame for including in video encoder sub-video stream is encoded.
Video encoder is encoded using each sub-image frame in predictive encoding mode sub-video stream.In one kind In possible embodiment, video encoder can be encoded using H264 coded format sub-video stream, after coding Each sub-image frame coding is H264 picture in sub-video stream.
Step 708, the sub-video stream after coding is transmitted to video decoding apparatus by video encoder.
After video encoder completes the coding of sub-video stream, the sub-video stream after coding is transmitted to video decoding and is set It is standby.Wherein, which is the electronic equipment of request original video stream.
Step 709, video decoding apparatus receives the n way video flowing that an at least video encoder is sent.
In a kind of possible embodiment, when carrying out sub-video stream coding by n platform video encoder, video decoding Equipment receives the n way video flowing that n platform video encoder is sent.
Step 710, video decoding apparatus is decoded the sub-image frame for including in each way video flowing.
When in order to avoid being decoded using single decoder, the excessive problem of decoder processes pressure, in a kind of possibility Embodiment in, video decoding apparatus passes through at least one decoder, carries out to the sub-image frame for including in n way video flowing Decoding, wherein at least one decoder includes at least one of CPU, GPU and core video card.
For example, as shown in figure 4,4 way video flowings for receiving, video decoding apparatus pass through kind of a different decoder 4 way video flowings are decoded respectively, to mitigate the processing pressure of single decoder, improve the decoding effect of video decoding apparatus Rate.
Step 711, the decoded n way video flowing of video decoding apparatus splicing obtains original video stream.
Video decoding apparatus is same to belonging to according to the corresponding timestamp of sub-image frame each in sub-video stream and location information The sub-image frame of one original image frame is spliced, to realize that by n way video stream splicing be original video stream.One kind can In the embodiment of energy, as seen in figure 7 c, this step be may include steps of.
Step 711A, video decoding apparatus acquisition time stab identical n sub-image frame respective positions information.
For the n way video flowing received, video decoding apparatus by timestamp in each way video flowing it is identical n son Picture frame is determined as being associated with sub-image frame (association sub-image frame belongs to same original image frame), and it is each to obtain association sub-image frame Self-corresponding location information.
Step 711B, video decoding apparatus splice decoded n sub-image frame according to location information, obtain n subgraph As the corresponding original image frame of frame.
In a kind of possible embodiment, which is the set of coordinates of sub-image frame, i.e., by way of coordinate Indicate position of the sub-image frame in original image frame.For example, the location information can be quaternary set of coordinates (a, b, c, d), In, a indicates that the abscissa of sub-image frame left edge, b indicate that the ordinate of sub-image frame top edge, c indicate on the right of sub-image frame The abscissa of edge, d indicate the ordinate of sub-image frame lower edge.
As shown in Figure 2 A, video decoding apparatus determines associated 4 sub-image frames according to the timestamp of sub-image frame, In, the corresponding quaternary set of coordinates of sub-image frame 1 is (0,0,1920,1080), and the corresponding quaternary set of coordinates of sub-image frame 2 is (1920,0,3840,1080), the corresponding quaternary set of coordinates of sub-image frame 3 are (0,1080,1920,2160), and sub-image frame 4 is right The quaternary set of coordinates answered is (1920,1080,3840,2160).According to the corresponding quaternary set of coordinates of each sub-image frame, video solution Decoding apparatus determines that sub-image frame 1 is located at the upper left corner of original image frame, and sub-image frame 2 is located at the upper right corner of original image frame, son Picture frame 3 is located at the lower left corner of original image frame, and sub-image frame 4 is located at the lower right corner of original image frame, and according to each subgraph As the relative position between frame is spliced, to restore original image frame.
In conclusion video transmission method provided in this embodiment, it will be in original video stream by video processing equipment Original image frame is divided into n sub-image frame, and includes the n way video flowing of the sub-image frame to video encoder distribution, The sub-video stream received is encoded by video encoder, and is transmitted to video decoding apparatus, is finally decoded by video The n way video flowing that equipment interconnection receives is decoded splicing, obtains original video stream；It solves and is regarded when in video encoder It when the resolution ratio that frequency encoder is supported is less than the resolution ratio for receiving video flowing, needs to upgrade video encoder, upgrade The problem of higher cost；Reach under the premise of not upgrading to video encoder in video encoder, by video It manages equipment and the biggish original image frame of original video stream intermediate-resolution is divided into the lesser sub-image frame of several resolution ratio, and The sub-video stream comprising sub-image frame is encoded respectively by several video encoders, realizes the volume to original video stream Code, to save upgrade cost.
In the present embodiment, the timestamp of each sub-image frame and position in the sub-video stream that is divided into according to original video stream The n sub-image frame splicing and recovery original image frame with identical time stamp is avoided that mistake occurs when splicing, guaranteed by information Video transmission quality.
In the present embodiment, coding transmission is carried out to n way video flowing by n platform video encoder, so that every video Encoding device only needs to encode 1 way video flowing, significantly reduces the processing pressure of separate unit video encoder, improves The efficiency and stability of video processing.
In the present embodiment, video decoding apparatus passes through at least one decoder, to the subgraph for including in n way video flowing Frame is decoded, and is avoided the excessive problem of single decoder processes pressure, is improved the decoding efficiency of video decoding apparatus.
Due to network fluctuation etc., the partial subgraph in sub-video stream is as frame it is possible that losing, in order to guarantee to regard The normal decoding of frequency decoding device is spliced, and when packet loss occurs, video decoding apparatus is according to preset packet loss retransmission mechanism, to view The request of frequency encoding device retransmits the sub-image frame lost.It as illustrated in fig. 7d, further include walking as follows before above-mentioned steps 711 Suddenly.
Step 712, video decoding apparatus regards each way according to the timestamp of each sub-image frame in each way video flowing Sub-image frame in frequency stream carries out timestamp alignment.
Since original image frame is divided into n sub-image frame, in the case where packet loss does not occur, video decoding Sub-image frame in the n way video flowing that equipment receives, including n with identical time stamp；In the case where packet loss occurs, In the n way video flowing that video decoding apparatus receives, the sub-image frame quantity with identical time stamp will be less than n.
After video decoding apparatus receives n way video flowing, according to the time of each sub-image frame in each way video flowing Stamp carries out timestamp alignment to the sub-image frame in each way video flowing.After timestamp is aligned, video decoding apparatus detection Whether the quantity of the sub-image frame with identical time stamp is equal to n, when the quantity of the sub-image frame with identical time stamp is equal to n When, packet loss does not occur for determination, and is decoded splicing to the sub-image frame with identical time stamp；When with identical time stamp When the quantity of sub-image frame is less than n, packet loss has occurred for determination.
Step 713, when the quantity of the sub-image frame with identical time stamp is less than n, video decoding apparatus is compiled to video Decoding apparatus sends packet loss retransmission request, and packet loss retransmission request is used to that video encoder to be requested to retransmit the subgraph lost Frame.
When the quantity of the sub-image frame with identical time stamp is less than n, packet loss has occurred for video decoding apparatus determination, and Packet loss retransmission request is sent to corresponding video encoder, the video encoder is requested to retransmit the subgraph lost Frame.In a kind of possible embodiment, as seen in figure 7e, this step be may include steps of.
Step 713A, when the quantity of the sub-image frame with identical time stamp is less than n, video decoding apparatus, which obtains, to be received The first location information of the sub-image frame arrived.
Since the location information of the sub-image frame with identical time stamp is different, when the son with identical time stamp When the quantity of picture frame is less than n, video decoding apparatus can be determined to lose according to the location information of the sub-image frame received Picture frame location information.
Step 713B, video decoding apparatus determine the second confidence for the sub-image frame lost according to first location information Breath.
For example, video decoding apparatus gets the corresponding location information of sub-image frame that timestamp is 2 in sub-video stream 1 is (0,0,1920,1080), the corresponding location information of sub-image frame that timestamp is 2 in sub-video stream 3 be (0,1080,1920, 2160) the corresponding location information of sub-image frame that, timestamp is 2 in sub-video stream 4 is (1920,1080,3840,2160), i.e., The location information that can determine the sub-image frame that the timestamp lost in sub-video stream 2 is 2 is (1920,0,3840,1080).
Step 713C, video decoding apparatus generate packet loss retransmission request according to timestamp and second location information.
After (second) location information for determining the sub-image frame lost, video decoding apparatus and according to timestamp and should (the Two) location information generates corresponding packet loss retransmission request.
For example, video decoding apparatus determines that the corresponding timestamp of sub-image frame lost is " timestamp 2 ", and corresponding position Confidence breath is " (1920,0,3840,1080) ", that is, generates losing comprising " timestamp 2 " and " (1920,0,3840,1080) " Packet retransmission request.
Step 713D, video decoding apparatus send packet loss retransmission request to video encoder.
It is corresponding, after video encoder receives the packet loss retransmission request of video decoding apparatus transmission, according to the request In include timestamp and location information, retransmit corresponding sub-image frame to video decoding apparatus.
Step 714, video decoding apparatus receives the sub-image frame for the loss that video encoder retransmits.
Corresponding, video decoding apparatus receives the sub-image frame for the loss that video encoder retransmits, and further The splicing of original image frame is carried out according to the sub-image frame and the sub-image frame received.
In the present embodiment, video decoding apparatus determines whether according to the timestamp of each sub-image frame in each way video flowing Packet loss has occurred, and when detecting generation packet loss, corresponding video encoder is requested to retransmit the sub-image frame lost.It compares In retransmitting entire original image frame, only the sub-image frame of loss is retransmitted, can be improved retransmission efficiency, thus in network wave Guarantee preferable video fluency in the case where dynamic.
Referring to FIG. 8, it illustrates the structural block diagrams of video frequency transmitter provided by one embodiment of the present invention.The view Frequency transmitting device can by software, hardware or both be implemented in combination with as the whole of video processing equipment 120 in Fig. 1 or Person's a part.The video frequency transmitter, comprising:
First receiving module 810, for receiving the original video stream of video capture device transmission；
Extraction module 820, for extracting the original image frame in the original video stream, the original image frame has the One resolution ratio；
Divide module 830, for each original image frame to be divided into n sub-image frame, the sub-image frame is with the Two resolution ratio, and second resolution described in the first resolution >；
Distribution module 840, for including the n way video of the sub-image frame to an at least video encoder distribution Stream, the video encoder are used to encode the sub-image frame for including in the sub-video stream, and will be after coding The sub-video stream be transmitted to video decoding apparatus, the video decoding apparatus is for receiving an at least Video coding The n way video flowing that equipment is sent, and after the sub-image frame for including in each way video flowing is decoded, it spells It connects sub-video stream described in the decoded road n and obtains the original video stream.
In conclusion video frequency transmitter provided in this embodiment, it will be in original video stream by video processing equipment Original image frame is divided into n sub-image frame, and includes the n way video flowing of the sub-image frame to video encoder distribution, The sub-video stream received is encoded by video encoder, and is transmitted to video decoding apparatus, is finally decoded by video The n way video flowing that equipment interconnection receives is decoded splicing, obtains original video stream；It solves and is regarded when in video encoder It when the resolution ratio that frequency encoder is supported is less than the resolution ratio for receiving video flowing, needs to upgrade video encoder, upgrade The problem of higher cost；Reach under the premise of not upgrading to video encoder in video encoder, by video It manages equipment and the biggish original image frame of original video stream intermediate-resolution is divided into the lesser sub-image frame of several resolution ratio, and The sub-video stream comprising sub-image frame is encoded respectively by several video encoders, realizes the volume to original video stream Code, to save upgrade cost.
Referring to FIG. 9, the structural block diagram of the video frequency transmitter provided it illustrates another embodiment of the present invention.It should Video frequency transmitter can pass through the whole of software, hardware or both being implemented in combination with as video processing equipment 120 in Fig. 1 Or a part.The video frequency transmitter, comprising:
First receiving module 910, for receiving the original video stream of video capture device transmission；
Extraction module 920, for extracting the original image frame in the original video stream, the original image frame has the One resolution ratio；
Divide module 930, for each original image frame to be divided into n sub-image frame, the sub-image frame is with the Two resolution ratio, and second resolution described in the first resolution >；
Distribution module 940, for including the n way video of the sub-image frame to an at least video encoder distribution Stream, the video encoder are used to encode the sub-image frame for including in the sub-video stream, and will be after coding The sub-video stream be transmitted to video decoding apparatus, the video decoding apparatus is for receiving an at least Video coding The n way video flowing that equipment is sent, and after the sub-image frame for including in each way video flowing is decoded, it spells It connects sub-video stream described in the decoded road n and obtains the original video stream.
It optionally, include multiple sub-image frames of arranged in sequence in the sub-video stream, each sub-image frame corresponds to itself Timestamp and location information, the location information is used to indicate sub-image frame position locating in the original image frame It sets；
The distribution module 940, comprising:
First acquisition unit 941, for obtaining the timestamp of the original image frame；
First determination unit 942, it is corresponding for the timestamp of the original image frame to be determined as the original image frame Each sub-image frame timestamp；
Second acquisition unit 943, for obtaining the location information of each sub-image frame；
Dispatching Unit 944, for the n way video flowing to be distributed to n according to the timestamp and the location information Video encoder described in platform；
Wherein, in same sub-video stream, the location information of each sub-image frame is identical, and the timestamp of each sub-image frame It is continuous and different.
Optionally, the complete or collected works of the n sub-image frame are the original image frame.
In conclusion video frequency transmitter provided in this embodiment, it will be in original video stream by video processing equipment Original image frame is divided into n sub-image frame, and includes the n way video flowing of the sub-image frame to video encoder distribution, The sub-video stream received is encoded by video encoder, and is transmitted to video decoding apparatus, is finally decoded by video The n way video flowing that equipment interconnection receives is decoded splicing, obtains original video stream；It solves and is regarded when in video encoder It when the resolution ratio that frequency encoder is supported is less than the resolution ratio for receiving video flowing, needs to upgrade video encoder, upgrade The problem of higher cost；Reach under the premise of not upgrading to video encoder in video encoder, by video It manages equipment and the biggish original image frame of original video stream intermediate-resolution is divided into the lesser sub-image frame of several resolution ratio, and The sub-video stream comprising sub-image frame is encoded respectively by several video encoders, realizes the volume to original video stream Code, to save upgrade cost.
In the present embodiment, the timestamp of each sub-image frame and position in the sub-video stream that is divided into according to original video stream The n sub-image frame splicing and recovery original image frame with identical time stamp is avoided that mistake occurs when splicing, guaranteed by information Video transmission quality.
Referring to FIG. 10, the structural block diagram of the video frequency transmitter provided it illustrates further embodiment of the present invention. The video frequency transmitter can by software, hardware or both be implemented in combination with as in Fig. 1 video decoding apparatus 140 it is complete Portion or a part.The video frequency transmitter, comprising:
Second receiving module 1010, for receiving the n way video flowing of at least video encoder transmission；The son The sub-image frame for including in video flowing is by coding, and the sub-image frame is by video processing equipment to original in original video stream Image frame division obtains, and the original image frame has first resolution, and the sub-image frame has second resolution, and described Second resolution described in first resolution >；
Decoder module 1020, for being decoded to the sub-image frame for including in each way video flowing；
Splicing module 1030 obtains the original video stream for splicing the decoded n way video flowing.
In conclusion video frequency transmitter provided in this embodiment, it will be in original video stream by video processing equipment Original image frame is divided into n sub-image frame, and includes the n way video flowing of the sub-image frame to video encoder distribution, The sub-video stream received is encoded by video encoder, and is transmitted to video decoding apparatus, is finally decoded by video The n way video flowing that equipment interconnection receives is decoded splicing, obtains original video stream；It solves and is regarded when in video encoder It when the resolution ratio that frequency encoder is supported is less than the resolution ratio for receiving video flowing, needs to upgrade video encoder, upgrade The problem of higher cost；Reach under the premise of not upgrading to video encoder in video encoder, by video It manages equipment and the biggish original image frame of original video stream intermediate-resolution is divided into the lesser sub-image frame of several resolution ratio, and The sub-video stream comprising sub-image frame is encoded respectively by several video encoders, realizes the volume to original video stream Code, to save upgrade cost.
Figure 11 is please referred to, it illustrates the structural block diagrams for the video frequency transmitter that another embodiment of the invention provides. The video frequency transmitter can by software, hardware or both be implemented in combination with as in Fig. 1 video decoding apparatus 140 it is complete Portion or a part.The video frequency transmitter, comprising:
Second receiving module 1110, for receiving the n way video flowing of at least video encoder transmission；The son The sub-image frame for including in video flowing is by coding, and the sub-image frame is by video processing equipment to original in original video stream Image frame division obtains, and the original image frame has first resolution, and the sub-image frame has second resolution, and described Second resolution described in first resolution >；
Decoder module 1120, for being decoded to the sub-image frame for including in each way video flowing；
Splicing module 1130 obtains the original video stream for splicing the decoded n way video flowing.
It optionally, include multiple sub-image frames of arranged in sequence in the sub-video stream, each sub-image frame corresponds to itself Timestamp and location information, the location information is used to indicate sub-image frame position locating in the original image frame It sets；
The splicing module 1130, comprising:
Third acquiring unit 1131, for obtaining the respective position letter of the identical n sub-image frame of the timestamp Breath；
Concatenation unit 1132 obtains described for splicing the decoded n sub-image frame according to the positional information The corresponding original image frame of n sub-image frame.
Optionally, described device, further includes:
Alignment module 1140, for the timestamp according to each sub-image frame in each way video flowing, to each way The sub-image frame in video flowing carries out timestamp alignment；
Sending module 1150, for when the quantity of the sub-image frame with identical time stamp be less than n when, to the view Frequency encoding device sends packet loss retransmission request, and the packet loss retransmission request is for requesting the video encoder retransmission to be lost The sub-image frame of mistake；
Third receiving module 1160, for receiving the subgraph for the loss that the video encoder retransmits Frame.
Optionally, the sending module 1150, comprising:
4th acquiring unit 1151, for obtaining when the quantity of the sub-image frame with identical time stamp is less than n The first location information of the sub-image frame received；
Second determination unit 1152, for according to the first location information, determining the of the sub-image frame of the loss Two location informations；
Generation unit 1153, for generating the packet loss re-transmission and asking according to the timestamp and the second location information It asks；
Transmission unit 1154, for sending the packet loss retransmission request to the video encoder.
Optionally, the decoder module 1120 is also used to through at least one decoder, in the n way video flowing The sub-image frame for including is decoded；
Wherein, at least one decoder include in central processor CPU, graphics processor GPU and core video card at least It is a kind of.
In conclusion video frequency transmitter provided in this embodiment, it will be in original video stream by video processing equipment Original image frame is divided into n sub-image frame, and includes the n way video flowing of the sub-image frame to video encoder distribution, The sub-video stream received is encoded by video encoder, and is transmitted to video decoding apparatus, is finally decoded by video The n way video flowing that equipment interconnection receives is decoded splicing, obtains original video stream；It solves and is regarded when in video encoder It when the resolution ratio that frequency encoder is supported is less than the resolution ratio for receiving video flowing, needs to upgrade video encoder, upgrade The problem of higher cost；Reach under the premise of not upgrading to video encoder in video encoder, by video It manages equipment and the biggish original image frame of original video stream intermediate-resolution is divided into the lesser sub-image frame of several resolution ratio, and The sub-video stream comprising sub-image frame is encoded respectively by several video encoders, realizes the volume to original video stream Code, to save upgrade cost.
In the present embodiment, video decoding apparatus passes through at least one decoder, to the subgraph for including in n way video flowing Frame is decoded, and is avoided the excessive problem of single decoder processes pressure, is improved the decoding efficiency of video decoding apparatus.
In the present embodiment, video decoding apparatus determines whether according to the timestamp of each sub-image frame in each way video flowing Packet loss has occurred, and when detecting generation packet loss, corresponding video encoder is requested to retransmit the sub-image frame lost.It compares In retransmitting entire original image frame, only the sub-image frame of loss is retransmitted, can be improved retransmission efficiency, thus in network wave Guarantee preferable video fluency in the case where dynamic.
It should be understood that video frequency transmitter provided by the above embodiment is when carrying out transmission of video, only with above-mentioned each The division progress of functional module can according to need and for example, in practical application by above-mentioned function distribution by different function Energy module is completed, i.e., the internal structure of video processing equipment or video decoding apparatus is divided into different functional modules, with complete At all or part of function described above.In addition, video frequency transmitter provided by the above embodiment and video transmission method Embodiment belongs to same design, and specific implementation process is detailed in embodiment of the method, and which is not described herein again.
The serial number of the above embodiments of the invention is only for description, does not represent the advantages or disadvantages of the embodiments.
Those of ordinary skill in the art will appreciate that realizing that all or part of the steps of above-described embodiment can pass through hardware It completes, relevant hardware can also be instructed to complete by program, the program can store in a kind of computer-readable In storage medium, storage medium mentioned above can be read-only memory, disk or CD etc..
The foregoing is merely presently preferred embodiments of the present invention, is not intended to limit the invention, it is all in spirit of the invention and Within principle, any modification, equivalent replacement, improvement and so on be should all be included in the protection scope of the present invention.

Claims (17)

1. a kind of Video transmission system, which is characterized in that the system comprises: video capture device, video processing equipment, video Encoding device and video decoding apparatus；
The video capture device, for sending collected original video stream to the video processing equipment；
The video processing equipment obtains the original image frame for extracting the original image frame in the original video stream The first resolution having, and obtain the second resolution that the video encoder is supported；According to the first resolution With resolution ratio the ratio between of the second resolution on transverse and longitudinal direction, each original image frame is divided into n sub-image frame, institute Stating sub-image frame has second resolution, and second resolution described in the first resolution >；To an at least video Encoding device distribution includes the n way video flowing of the sub-image frame；
The video encoder, for being encoded to the sub-image frame for including in the sub-video stream；After encoding The sub-video stream be transmitted to the video decoding apparatus；
The video decoding apparatus, for receiving the n way video flowing that at least a video encoder is sent；It is right The sub-image frame for including in each way video flowing is decoded；Splice sub-video stream described in the decoded road n obtain it is described Original video stream.
2. system according to claim 1, which is characterized in that include multiple subgraphs of arranged in sequence in the sub-video stream As frame, each sub-image frame corresponds to the timestamp and location information of itself, and the location information is used to indicate the sub-image frame The location of in the original image frame；
The video processing equipment, for obtaining the timestamp of the original image frame；By the timestamp of the original image frame It is determined as the timestamp of the corresponding each sub-image frame of the original image frame；Obtain the position letter of each sub-image frame Breath；
The video processing equipment is also used to the n way video stream distribution according to the timestamp and the location information To video encoder described in n platform；
Wherein, in same sub-video stream, the location information of each sub-image frame is identical, and the timestamp of each sub-image frame is continuous And it is different.
3. system according to claim 2, which is characterized in that
The video decoding apparatus, for obtaining the timestamp of each sub-image frame in each way video flowing；To it is described when Between stab identical n sub-image frame and be decoded；
The video decoding apparatus is also used to obtain the respective location information of the identical n sub-image frame of the timestamp； Splice the decoded n sub-image frame according to the positional information, it is corresponding described original to obtain the n sub-image frame Picture frame.
4. system according to claim 2 or 3, which is characterized in that
The video decoding apparatus is also used to the timestamp according to each sub-image frame in each way video flowing, to each road The sub-image frame in sub-video stream carries out timestamp alignment；When the quantity of the sub-image frame with identical time stamp is small When n, Xiang Suoshu video encoder sends packet loss retransmission request, and the packet loss retransmission request is for requesting the Video coding Equipment retransmits the sub-image frame lost；
The video encoder is also used to according to the packet loss retransmission request, and Xiang Suoshu video decoding apparatus retransmits institute State the sub-image frame of loss.
5. system according to claim 4, which is characterized in that
The video decoding apparatus is also used to when the quantity of the sub-image frame with identical time stamp is less than n, and acquisition connects The first location information of the sub-image frame received；According to the first location information, the sub-image frame of the loss is determined Second location information；According to the timestamp and the second location information, the packet loss retransmission request is generated.
6. a kind of video transmission method, which is characterized in that the described method includes:
Receive the original video stream that video capture device is sent；
The original image frame in the original video stream is extracted, obtains the first resolution that the original image frame has, and obtain Take the second resolution that video encoder is supported；
According to the ratio between the resolution ratio of the first resolution and the second resolution on transverse and longitudinal direction, by each original image Frame is divided into n sub-image frame, and the sub-image frame has second resolution, and the second resolution described in the first resolution > Rate；
It include the n way video flowing of the sub-image frame, the video encoder to an at least video encoder distribution For being encoded to the sub-image frame for including in the sub-video stream, and the sub-video stream after coding is transmitted to Video decoding apparatus, the video decoding apparatus are used to receive the n way that at least a video encoder is sent Video flowing, and after the sub-image frame for including in each way video flowing is decoded, splice son described in the decoded road n Video flowing obtains the original video stream.
7. according to the method described in claim 6, it is characterized in that, including multiple subgraphs of arranged in sequence in the sub-video stream As frame, each sub-image frame corresponds to the timestamp and location information of itself, and the location information is used to indicate the sub-image frame The location of in the original image frame；
It is described to distribute the n way video flowing comprising the sub-image frame to an at least video encoder, comprising:
Obtain the timestamp of the original image frame；
The timestamp of the original image frame is determined as to the timestamp of the corresponding each sub-image frame of the original image frame；
Obtain the location information of each sub-image frame；
The n way video flowing is distributed to video encoder described in n platform according to the timestamp and the location information；
Wherein, in same sub-video stream, the location information of each sub-image frame is identical, and the timestamp of each sub-image frame is continuous And it is different.
8. a kind of video transmission method, which is characterized in that the described method includes:
Receive the n way video flowing of at least video encoder transmission；The sub-image frame warp for including in the sub-video stream Cross coding, resolution of the sub-image frame by video processing equipment according to first resolution and second resolution on transverse and longitudinal direction The ratio between rate is divided to obtain to the original image frame in original video stream, and the first resolution is that the original image frame has Resolution ratio, the resolution ratio that the second resolution is supported by the video encoder, the sub-image frame has described Second resolution, and second resolution described in the first resolution >；
The sub-image frame for including in each way video flowing is decoded；
Splice the decoded n way video flowing and obtains the original video stream.
9. according to the method described in claim 8, it is characterized in that, including multiple subgraphs of arranged in sequence in the sub-video stream As frame, each sub-image frame corresponds to the timestamp and location information of itself, and the location information is used to indicate the sub-image frame The location of in the original image frame；
The decoded n way video flowing of splicing obtains the original video stream, comprising:
Obtain the respective location information of the identical n sub-image frame of the timestamp；
Splice the decoded n sub-image frame according to the positional information, it is corresponding described to obtain the n sub-image frame Original image frame.
10. method according to claim 8 or claim 9, which is characterized in that the decoded n way video flowing of splicing Before obtaining the original video stream, further includes:
According to the timestamp of each sub-image frame in each way video flowing, the sub-image frame in each way video flowing is carried out Timestamp alignment；
When the quantity of the sub-image frame with identical time stamp is less than n, Xiang Suoshu video encoder sends packet loss weight Request is passed, the packet loss retransmission request is used to that the video encoder to be requested to retransmit the sub-image frame lost；
Receive the sub-image frame for the loss that the video encoder retransmits.
11. according to the method described in claim 10, it is characterized in that, described when the sub-image frame with identical time stamp Quantity be less than n when, Xiang Suoshu video encoder send packet loss retransmission request, comprising:
When the quantity of the sub-image frame with identical time stamp is less than n, the of the sub-image frame received is obtained One location information；
According to the first location information, the second location information of the sub-image frame of the loss is determined；
According to the timestamp and the second location information, the packet loss retransmission request is generated；
The packet loss retransmission request is sent to the video encoder.
12. a kind of video frequency transmitter, which is characterized in that described device includes:
First receiving module, for receiving the original video stream of video capture device transmission；
Extraction module obtains the original image frame has for extracting the original image frame in the original video stream One resolution ratio, and obtain the second resolution that video encoder is supported；
Divide module, for the ratio between the resolution ratio according to the first resolution and the second resolution on transverse and longitudinal direction, Each original image frame is divided into n sub-image frame, the sub-image frame has second resolution, and the first resolution Second resolution described in >；
Distribution module, it is described for including the n way video flowing of the sub-image frame to an at least video encoder distribution Video encoder is for encoding the sub-image frame for including in the sub-video stream, and by the son after coding Video is streamed to video decoding apparatus, and the video decoding apparatus is sent for receiving an at least video encoder The n way video flowing, and after the sub-image frame for including in each way video flowing is decoded, after splicing decoding The road n described in sub-video stream obtain the original video stream.
13. device according to claim 12, which is characterized in that include multiple sons of arranged in sequence in the sub-video stream Picture frame, each sub-image frame correspond to the timestamp and location information of itself, and the location information is used to indicate the subgraph Frame is the location of in the original image frame；
The distribution module, comprising:
First acquisition unit, for obtaining the timestamp of the original image frame；
First determination unit, for the timestamp of the original image frame to be determined as the corresponding each height of the original image frame The timestamp of picture frame；
Second acquisition unit, for obtaining the location information of each sub-image frame；
Dispatching Unit, for the n way video flowing to be distributed to view described in n platform according to the timestamp and the location information Frequency encoding device；
Wherein, in same sub-video stream, the location information of each sub-image frame is identical, and the timestamp of each sub-image frame is continuous And it is different.
14. a kind of video frequency transmitter, which is characterized in that described device includes:
Second receiving module, for receiving the n way video flowing of at least video encoder transmission；In the sub-video stream Including sub-image frame by coding, the sub-image frame exists by video processing equipment according to first resolution and second resolution The ratio between resolution ratio on transverse and longitudinal direction, divides to obtain to the original image frame in original video stream, and the first resolution is institute The resolution ratio that original image frame has is stated, the resolution ratio that the second resolution is supported by the video encoder is described Sub-image frame has the second resolution, and second resolution described in the first resolution >；
Decoder module, for being decoded to the sub-image frame for including in each way video flowing；
Splicing module obtains the original video stream for splicing the decoded n way video flowing.
15. device according to claim 14, which is characterized in that include multiple sons of arranged in sequence in the sub-video stream Picture frame, each sub-image frame correspond to the timestamp and location information of itself, and the location information is used to indicate the subgraph Frame is the location of in the original image frame；
The splicing module, comprising:
Third acquiring unit, for obtaining the respective location information of the identical n sub-image frame of the timestamp；
Concatenation unit obtains the n subgraph for splicing the decoded n sub-image frame according to the positional information As the corresponding original image frame of frame.
16. device according to claim 14 or 15, which is characterized in that described device, further includes:
Alignment module, for the timestamp according to each sub-image frame in each way video flowing, to the institute in each way video flowing It states sub-image frame and carries out timestamp alignment；
Sending module, for when the quantity of the sub-image frame with identical time stamp is less than n, Xiang Suoshu Video coding to be set Preparation send packet loss retransmission request, and the packet loss retransmission request is used to that the video encoder to be requested to retransmit the subgraph lost As frame；
Third receiving module, for receiving the sub-image frame for the loss that the video encoder retransmits.
17. device according to claim 16, which is characterized in that the sending module, comprising:
4th acquiring unit, for obtaining and receiving when the quantity of the sub-image frame with identical time stamp is less than n The first location information of the sub-image frame；
Second determination unit, for determining the second confidence of the sub-image frame of the loss according to the first location information Breath；
Generation unit, for generating the packet loss retransmission request according to the timestamp and the second location information；
Transmission unit, for sending the packet loss retransmission request to the video encoder.
CN201610352594.1A 2016-05-24 2016-05-24 Video transmission system, method and device Active CN106060582B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610352594.1A CN106060582B (en) 2016-05-24 2016-05-24 Video transmission system, method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610352594.1A CN106060582B (en) 2016-05-24 2016-05-24 Video transmission system, method and device

Publications (2)

Publication Number Publication Date
CN106060582A CN106060582A (en) 2016-10-26
CN106060582B true CN106060582B (en) 2019-06-11

Family

ID=57175941

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610352594.1A Active CN106060582B (en) 2016-05-24 2016-05-24 Video transmission system, method and device

Country Status (1)

Country Link
CN (1) CN106060582B (en)

Families Citing this family (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3442240A1 (en) * 2017-08-10 2019-02-13 Nagravision S.A. Extended scene view
CN109561119B (en) * 2017-09-26 2022-04-01 中国移动通信有限公司研究院 Data receiving method and equipment
CN109698850B (en) * 2017-10-23 2022-06-07 北京京东尚科信息技术有限公司 Processing method and system
CN108881927B (en) * 2017-11-30 2020-06-26 视联动力信息技术股份有限公司 Video data synthesis method and device
CN108198108B (en) * 2017-12-28 2021-12-31 深圳市东微智能科技股份有限公司 Education embedded system and education management system
CN109040840B (en) * 2018-09-20 2021-09-21 深圳市道通智能航空技术股份有限公司 Image transmission method and device, image sending end and aircraft image transmission system
CN110113658B (en) * 2019-04-04 2022-04-29 武汉精立电子技术有限公司 Ultrahigh-resolution video playing method and system
CN111447394A (en) * 2020-03-05 2020-07-24 视联动力信息技术股份有限公司 Video data processing method, electronic equipment and storage medium
CN112511768B (en) * 2020-11-27 2024-01-02 上海网达软件股份有限公司 Multi-picture synthesis method, device, equipment and storage medium
CN112911346A (en) * 2021-01-27 2021-06-04 北京淳中科技股份有限公司 Video source synchronization method and device
CN113630597B (en) * 2021-08-19 2024-01-23 随锐科技集团股份有限公司 Method and system for preventing video from losing packets irrelevant to encoding and decoding
CN113905256B (en) * 2021-12-10 2022-04-12 北京拙河科技有限公司 Video data processing method, device and system supporting interactive watching
CN114245133A (en) * 2022-02-23 2022-03-25 北京拙河科技有限公司 Video block coding method, coding transmission method, system and equipment
CN115209079B (en) * 2022-02-23 2023-05-02 北京拙河科技有限公司 Method and equipment suitable for long-time data storage of high-speed camera

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2005076627A1 (en) * 2004-02-09 2005-08-18 Nevil Soft Co., Ltd. Process method for compressing moving pictures and apparatus for performing said method
CN103165104A (en) * 2011-12-12 2013-06-19 宁波Gqy视讯股份有限公司 Video signal synchronously displaying method of spliced screen
CN102724560B (en) * 2012-06-28 2016-03-30 广东威创视讯科技股份有限公司 Video data display packing and device thereof
CN103618640B (en) * 2013-11-19 2016-08-31 武汉烽火网络有限责任公司 Ethernet performance method of testing based on point-to-point test and device
CN104602008B (en) * 2015-01-14 2018-03-20 腾讯科技（深圳）有限公司 Method for video coding, device and system

Also Published As

Publication number Publication date
CN106060582A (en) 2016-10-26

Similar Documents

Publication Publication Date Title
CN106060582B (en) Video transmission system, method and device
KR102294098B1 (en) Apparatus and method for providing and displaying content
US9756328B2 (en) System, terminal, and method for dynamically adjusting video
CN110149542B (en) Transmission control method
US10757463B2 (en) Information processing apparatus and information processing method
US20180176650A1 (en) Information processing apparatus and information processing method
CN111416989A (en) Video live broadcast method and system and electronic equipment
CN108650542A (en) Generate vertical screen video flowing, the method for image procossing, electronic equipment and video system
US8925019B2 (en) Synchronous display streaming system and synchronous displaying method
CN104980697A (en) Video transmission method for web camera
CN105979224A (en) Head mount display, video output device and video processing method and system
JP2007274150A (en) Server device and video distributing method
US10924782B2 (en) Method of providing streaming service based on image segmentation and electronic device supporting the same
CN107690074A (en) Video coding and restoring method, audio/video player system and relevant device
EP3434021B1 (en) Method, apparatus and stream of formatting an immersive video for legacy and immersive rendering devices
WO2013127126A1 (en) Video image sending method, device and system
CN112035081A (en) Screen projection method and device, computer equipment and storage medium
CN112219403A (en) Rendering perspective metrics for immersive media
CN109587478A (en) A kind of processing method and processing device of media information
CN115225937A (en) Immersive media providing method, immersive media obtaining device, immersive media equipment and storage medium
CN111479162A (en) Live data transmission method and device and computer readable storage medium
EP3621309A1 (en) Transmission system for multi-channel image, control method therefor, and multi-channel image playback method and apparatus
CN205812229U (en) A kind of head-mounted display, picture output device and processing system for video
US20180109585A1 (en) Information processing apparatus and information processing method
CN102843566A (en) Communication method and equipment for three-dimensional (3D) video data

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
EE01 Entry into force of recordation of patent licensing contract

Application publication date: 20161026

Assignee: GUANGZHOU CUBESILI INFORMATION TECHNOLOGY Co.,Ltd.

Assignor: GUANGZHOU HUADUO NETWORK TECHNOLOGY Co.,Ltd.

Contract record no.: X2021980000101

Denomination of invention: Video transmission system, method and device

Granted publication date: 20190611

License type: Common License

Record date: 20210106

EE01 Entry into force of recordation of patent licensing contract