CN109996013B - A kind of low delay video-splicing methods, devices and systems - Google Patents
A kind of low delay video-splicing methods, devices and systems Download PDFInfo
- Publication number
- CN109996013B CN109996013B CN201910466048.4A CN201910466048A CN109996013B CN 109996013 B CN109996013 B CN 109996013B CN 201910466048 A CN201910466048 A CN 201910466048A CN 109996013 B CN109996013 B CN 109996013B
- Authority
- CN
- China
- Prior art keywords
- video
- address
- road
- signal
- fusion
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/44004—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving video buffer management, e.g. video decoder buffer or video display buffer
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/44016—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving splicing one content stream with another content stream, e.g. for substituting a video clip
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/265—Mixing
Abstract
The invention discloses a kind of low delay video-splicing methods, devices and systems, are related to video-splicing technical field, and method includes the input refresh rate and video input signals time series data for obtaining multi-channel video signal；The scaling road Hou Ge vision signal is respectively written into cache unit；Obtain the output refresh rate and video output signals time series data of the video fusion instruction road Zhong Ge video；Based on current cache writing address and input/output refresh rate and input/output video frequency signal time sequence data, the optimal reading first address of each road video is generated；Corresponding vision signal is read from cache unit according to optimal reading first address and output refresh rate；Display is exported after carrying out anastomosing and splicing to each road vision signal read out.The present invention optimizes the reading manner of image data by setting cache unit, can reduce the delay of video-splicing, so that output image real-time is more preferable, it is more smooth, it can satisfy the demand of the low delays application scenarios such as medical treatment.
Description
Technical field
The present invention relates to video-splicing technical field, especially a kind of low delay video-splicing methods, devices and systems.
Background technique
The technologies such as Image Acquisition, transmission, display are advanced side by side, and more and more fields are promoted, such as medical treatment, security protection, religion
It educates, medium etc., starts the Real-Time Sharing for realizing information by video.In most of application scenarios, video viewers are past
Toward needing to watch several video pictures, this needs video montaging device just to complete the fusion of image, could set in limited display
The standby upper more video pictures of viewing.
However, but having higher requirement in medical field video montaging device --- low delay.Such as in the course of surgery, doctor
Need to integrate the surgical action for determining next step according to several video pictures seen.If video pictures delay is excessive, can give
Doctor brings operational inconvenience, and it is excessive to even result in surgical action, causes unnecessary damage to patient.So how to drop
The delay of low video montaging device is the current demand of medical industry.
Summary of the invention
The object of the present invention is to provide a kind of low delay video-splicing methods, devices and systems, can reduce input picture with
The delay between image is exported, real-time, the reliability shown after video-splicing is improved.
The technical scheme adopted by the invention is as follows: a kind of low delay video-splicing method, comprising:
The parallel input signal of multi-channel video is obtained, and detects and obtains the input refresh rate of each road video input signals
With video input signals time series data；
Each road video input signals are zoomed in and out according to preset ratio, and the road Hou Ge video input signals will be scaled
It is respectively written into cache unit；
Video fusion command information is obtained, video fusion command information includes the output refresh rate for merging the road Hou Ge videoWith video output signals time series data；
Based on current cache writing address and the input refresh rate, video input signals time series data, output brush
New rateAnd video output signals time series data, generate the current optimal reading first address of each road video to be spliced, comprising:
Vision signal to be spliced for any road:
Calculate present frame picture write-in cache unit required time T1；
Calculating reads T2 the time required to frame picture to be spliced from caching；
If T1 > T2, the current optimal first address that reads is the previous frame image that current cache writing address corresponds to frame image
First pixel address, otherwise the current optimal first address that reads is the first pixel address that current cache writing address corresponds to frame image；
According to the current optimal reading first address of each road video to be spliced, according to output refresh rateFrom cache unit
Appropriate address reads corresponding vision signal；
Display is exported after carrying out anastomosing and splicing to each road read out vision signal to be spliced.
Current cache writing address described above is a certain pixel in a certain frame image of caching is currently written slow
Deposit writing address.
To multi-channel video when low delay video-splicing method of the invention optimizes video-splicing by the way that cache unit is arranged
The reading manner of signal determines optimal reading first address by comparing the size of video frame picture storage time and readout time
Corresponding frame picture may make the delay between the input picture of cache unit and output image to decrease below a frame image
Delay.
The present invention splices the video read and the prior art all can be used in spliced output.
Preferably, for every road vision signal, the optimal first address that reads starts to read in each completely new frame image
Taking preceding generation, in the reading process of every frame image, the current address that reads successively deviates on the basis of current optimal reading first address,
Until each pixel reading of a frame image finishes.Namely it needs to wait spelling for every road in each output video image refresh process
Incoming video signal is connect, each selection for carrying out a suboptimum and reading first address can guarantee that the delay of every road input video is minimum,
Ensure that address is read in the reading process of a frame image does not exceed writing address, and reading is complete frame figure
Picture is not in that picture tearing, dislocation etc. are abnormal.
Preferably, video input signals time series data includes total line number of a frame video input signalsWith a frame
Effective line number of video input signals, video output signals time series data includes the head office of a frame video output signals
Number, the effective line number for scaling latter frame video signal is；
Define certain all the way the corresponding frame image of the presently written buffer address of vision signal to be spliced theRow, then for this
Road video to be spliced:
Present frame picture is stored in T1 the time required to cache unit are as follows:
Frame picture required time T2 to be spliced is read from caching are as follows:
。
Preferably, video fusion command information further includes that each road vision signal for needing to read is merging the position in picture
Information and figure layer precedence information；
When carrying out anastomosing and splicing to each road vision signal read out, according to the position specified in video fusion command information
Anastomosing and splicing is carried out with figure layer priority.
Further, video fusion command information further includes the resolution information of anastomosing and splicing rear video, video fusion
It is carried out when splicing according to specified resolution information.
On the other hand, invention additionally discloses a kind of low delay video-splicing devices, comprising:
Video input signals obtain and detection module, for obtaining the parallel input signal of multi-channel video, and detect and obtain
The input refresh rate of each road video input signalsWith video input signals time series data；
Video scaling and caching writing module, for being zoomed in and out according to preset ratio to each road vision signal, and will
The scaling road Hou Ge vision signal is respectively written into cache unit；
Video fusion instruction analysis module, for obtaining video fusion command information, video fusion command information includes melting
The output refresh rate of the road He Houge videoWith video output signals time series data；
Optimal reading first address generation module, for being based on current cache writing address and the input refresh rate、
Video input signals time series data, output refresh rateAnd video output signals time series data, generate working as each road video
Preceding optimal reading first address, comprising:
Vision signal to be spliced for any road:
Calculate present frame picture write-in cache unit required time T1；
Calculating reads T2 the time required to frame picture to be spliced from caching；
If T1 > T2, the current optimal first address that reads is the previous frame image that current cache writing address corresponds to frame image
First pixel address, otherwise the current optimal first address that reads is the first pixel address that current cache writing address corresponds to frame image；
Video reads module, for the current optimal reading first address according to each road video, according to output refresh rate
Corresponding vision signal is read from the appropriate address of cache unit；
Video-splicing output module, for exporting display after carrying out anastomosing and splicing to each road vision signal read out.
Invention additionally discloses a kind of low delay video-splicing systems, including video input module, video routing module, video
Signal processing module and control module；
Video input module includes multiple video input channels, and each video input channel receives video input signals simultaneously respectively
Vision signal is converted into high-speed serial signals；
Control module is used to send video forwarding instruction to video routing module, and sends to video signal processing module
Video scaling instruction and video fusion instruction；Video routing module forwards multipath high-speed serial signal according to video forwarding instruction
To video signal processing module；
The quantity of video signal processing module is at least one, and it is single that each video signal processing module respectively includes signal conversion
Member, detecting signal unit, image fusion unit, read-write control unit, cache unit and video output unit；Signal conversion unit
It receives multipath high-speed serial signal and is converted to parallel signal；Detecting signal unit is based on each road vision signal of parallel signal process
Input supplemental characteristic；Image fusion unit zooms in and out processing to each road vision signal according to video scaling instruction；Read-write
Control unit is directed to the corresponding writing address that each road vision signal generates, and cache unit is written in the vision signal after scaling
Appropriate address in；Image fusion unit is instructed according to the video fusion, is joined by read-write control unit based on the input
Number data and video fusion instruction generate the optimal reading first address of corresponding each road vision signal to be spliced, and then according to optimal reading
First address is successively read each pixel transmission of a frame image to image fusion unit out；Image fusion unit is melted according to the video
It closes instruction and splicing is carried out to the video image read out, spliced video signal transmission to video output unit is carried out
Output.
Preferably, in video signal processing module, input supplemental characteristic of the detecting signal unit based on detection includes input
Refresh rateWith video input signals time series data；The video fusion instruction includes that the output of the fusion road Hou Ge video refreshes
Rate, video output signals time series data, each road vision signal fusion picture in location information and figure layer priority letter
The resolution information of breath and fusion rear video；
Image fusion unit receives the input supplemental characteristic of detecting signal unit output, and is receiving video fusion instruction
Afterwards by the output refresh rate of the fusion road the Hou Ge video in the input supplemental characteristic and video fusion instructionAnd video
Output signal time series data is transmitted to read-write control unit；Read-write control unit is written according to the current cache of each road vision signal
Address, input supplemental characteristic and the output refresh rate for merging the road Hou Ge videoIt is raw with video output signals time series data
At the optimal reading first address of each road of correspondence video to be spliced；
When image fusion unit carries out anastomosing and splicing to each road vision signal read out, according to video fusion command information
In the position specified, figure layer priority and resolution information carry out anastomosing and splicing.
The video scaling instruction includes the scaling of corresponding each road vision signal to be spliced.
Preferably, video input signals time series data includes total line number of a frame video input signalsWith a frame
Effective line number of video input signals, video output signals time series data includes the head office of a frame video output signals
Number, the effective line number for scaling latter frame video signal is；Define certain presently written caching of vision signal all the way
The of the corresponding frame image in addressRow, then be directed to the road vision signal, and read-write control unit generates optimal reading first address packet
It includes:
Calculate present frame picture deposit cache unit required time T1 are as follows:
Calculating reads T2 the time required to frame picture to be spliced from cache unit are as follows:
If T1 > T2, the current optimal first address that reads is the previous frame image that current cache writing address corresponds to frame image
First pixel address, otherwise the current optimal first address that reads is the first pixel address that current cache writing address corresponds to frame image.
Preferably, in video input module, each video input channel is respectively included for receiving video input signals
And received signal is converted to the video input unit of parallel signal, and for parallel signal to be converted to high speed serialization letter
Number high-speed serial signals converting unit 1；Each video input channel reception video input signals all the way；
In video signal processing module, each signal conversion unit receives video routing module and is turned according to video forwarding instruction
The multipath high-speed serial signal of hair, and be converted to parallel signal；Each video output unit exports the view after anastomosing and splicing all the way
Frequency signal.
The received vision signal of video input unit is also different according to interface type unlike signal format, video input unit
The vision signal received can be uniformly converted to the existing product of parallel signal, the vision signal exported after conversion for one kind
The mainly elements such as including RGB, DE, HS, VS.High-speed serial signals converting unit 1 then considers the transmission rate and letter of vision signal
Parallel signal, is converted to unified high-speed serial signals by number line number amount.
Beneficial effect
The present invention optimizes the reading manner of image data by setting cache unit, and for believing per video to be spliced all the way
Number, the comparison result the time required to being stored in caching based on frame picture and the time required to reading, before the reading of each frame latest image
Optimal reading first address is generated, the delay of video-splicing can be reduced, so that between the input picture of cache unit and output image
Delay less than a frame image delay, output image real-time it is more preferable, it is more smooth.Simultaneously in the reading process of a frame image
In, the present invention uses the method successively deviated on optimal reading first address, and it is abnormal will not to generate picture break-up, dislocation etc..Cause
This, the present invention can satisfy the demand of the low delays application scenarios such as medical treatment.
Detailed description of the invention
Fig. 1 show low delay video-splicing method flow schematic diagram of the present invention；
Fig. 2 show the optimal a kind of embodiment schematic illustration for reading first address in video-splicing method of the present invention；
Fig. 3 show video-splicing system schematic of the present invention.
Specific embodiment
It is further described below in conjunction with the drawings and specific embodiments.
Embodiment 1
The present embodiment is a kind of low delay video-splicing method, refering to what is shown in Fig. 1, method includes:
The parallel input signal of multi-channel video is obtained, and detects and obtains the input refresh rate of each road vision signalAnd view
Frequency input signal time series data；Video input signals time series data includes total line number of a frame video input signalsWith
Effective line number of one frame video input signals；
Each road vision signal is zoomed in and out according to preset ratio, and the scaling road Hou Ge vision signal is respectively written into
In cache unit；
Video fusion command information is obtained, video fusion command information includes the output refresh rate for merging the road Hou Ge videoWith video output signals time series data；Video output signals time series data includes total line number of a frame video output signals, the effective line number for scaling latter frame video signal is；
Based on current cache writing address and the input refresh rate, video input signals time series data, output brush
New rateAnd video output signals time series data, generate the current optimal reading first address of each road video, comprising:
Calculate each road video present frame picture deposit cache unit required time T1；
It calculates each road video and reads T2 the time required to a frame picture from caching；
Define certain all the way the corresponding frame image of the presently written buffer address of vision signal theRow, the road Ze Gai video are current
Frame picture is stored in T1 the time required to cache unit are as follows:
Frame picture required time T2 to be spliced is read from caching are as follows:
；
Video to be spliced for any road, if T1 > T2, current optimal reading first address is current cache writing address pair
The first pixel address of the previous frame image of frame image is answered, otherwise current optimal reading first address is corresponding for current cache writing address
The first pixel address of frame image；
According to the current optimal reading first address of each road video, according to output refresh rateCorrespondingly from cache unit
Read corresponding vision signal in location；
Display is exported after carrying out anastomosing and splicing to each road vision signal read out.
Current cache writing address described above is a certain pixel in a certain frame image of caching is currently written slow
Deposit writing address.
Refering to what is shown in Fig. 2, being fused to full frame aobvious after exporting video after being handled with the scaling that input video carries out 1:1
It is shown as example, introduces the optimal generation process for reading first address.
If input video resolution ratio is 100x100, time sequence parameter、, input view
Frequency refresh rate；Output resolution ratio is also 100x100, time sequence parameter after fusion, video brush
New rate、；
Assuming that current write address is the 10th row of the i-th frame image, then T1 when needing to generate new optimal reading first address
=(1/30)*((100-10)/120)=25ms；
Read time T2 required for a frame picture=(1/60) * (100/120)=13.89ms；
Since T1 is greater than T2, so the optimal first pixel address for reading first address and taking the (i-1)-th frame.
Similarly, when if desired generating new optimal reading first address, current write address is more than the 51st of the i-th frame image the
It goes, then T1=(1/30) * ((100-51)/120)=13.61ms；
Since T2 is still 13.89ms, then the first pixel address for reading first address and taking the i-th frame optimal at this time.
To multi-channel video when low delay video-splicing method of the invention optimizes video-splicing by the way that cache unit is arranged
The reading manner of signal determines optimal reading first address by comparing the size of video frame picture storage time and readout time
Corresponding frame picture may make the delay between the input picture of cache unit and output image to decrease below a frame image
Delay.
The present invention splices the video read and the prior art all can be used in spliced output.
For every road vision signal, the optimal first address that reads starts to read preceding production in each completely new frame image
Raw, in the reading process of every frame image, the current address that reads successively deviates on the basis of current optimal reading first address, until one
Each pixel reading of frame image finishes.
Video fusion command information further includes that each road vision signal for needing to read is merging the location information in picture, figure
Layer precedence information and resolution information；
When carrying out anastomosing and splicing to each road vision signal read out, according to the position specified in video fusion command information
It sets, figure layer priority and resolution information carry out anastomosing and splicing.
Embodiment 2
The present embodiment is a kind of low delay video-splicing device, comprising:
Video input signals obtain and detection module, for obtaining the parallel input signal of multi-channel video, and detect and obtain
The input refresh rate of each road video input signalsWith video input signals time series data；
Video scaling and caching writing module, for being zoomed in and out according to preset ratio to each road vision signal, and will
The scaling road Hou Ge vision signal is respectively written into cache unit；
Video fusion instruction analysis module, for obtaining video fusion command information, video fusion command information includes melting
The output refresh rate of the road He Houge videoWith video output signals time series data；
Optimal reading first address generation module, for being based on current cache writing address and the input refresh rate、
Video input signals time series data, output refresh rateAnd video output signals time series data, generate working as each road video
Preceding optimal reading first address, comprising:
Calculate each road video present frame picture deposit cache unit required time T1；
It calculates each road video and reads T2 the time required to a frame picture from caching；
For any road video, if T1 > T2, current optimal reading first address is that current cache writing address corresponds to frame figure
The first pixel address of the previous frame image of picture, otherwise current optimal reading first address is that current cache writing address corresponds to frame image
First pixel address；
Video reads module, for the current optimal reading first address according to each road video, according to output refresh rate
Corresponding vision signal is read from the appropriate address of cache unit；
Video-splicing output module, for exporting display after carrying out anastomosing and splicing to each road vision signal read out.
Embodiment 3
The present embodiment is a kind of low delay video-splicing system, refering to what is shown in Fig. 3, system includes video input module, view
Frequency routing module, video signal processing module and control module；
Video input module includes multiple video input channels, and each video input channel receives video input signals simultaneously respectively
Vision signal is converted into high-speed serial signals；Each video input channel is successively arranged video input unit and high speed serialization respectively
Signal conversion unit 1, video input unit convert received signal for receiving video input signals to be spliced all the way
For parallel signal；The parallel signal that video input unit exports is converted to unified high speed by high-speed serial signals converting unit 1
Serial signal；
The received vision signal of video input unit is also different according to interface type unlike signal format, video input unit
The vision signal received can be uniformly converted to the existing product of parallel signal, the vision signal exported after conversion for one kind
The mainly elements such as including RGB, DE, HS, VS.High-speed serial signals converting unit 1 then considers the transmission rate and letter of vision signal
Parallel signal, is converted to unified high-speed serial signals by number line number amount.
Control module is used to send video forwarding instruction to video routing module, and sends to video signal processing module
Video scaling instruction and video fusion instruction；Video routing module forwards multipath high-speed serial signal according to video forwarding instruction
To video signal processing module；
The quantity of video signal processing module is at least one, and it is single that each video signal processing module respectively includes signal conversion
Member, detecting signal unit, image fusion unit, read-write control unit, cache unit and video output unit；Signal conversion unit
It receives multipath high-speed serial signal and is converted to parallel signal；Detecting signal unit is based on each road vision signal of parallel signal process
Input supplemental characteristic；Image fusion unit zooms in and out processing to each road vision signal according to video scaling instruction；Read-write
Control unit is directed to the corresponding writing address that each road vision signal generates, and cache unit is written in the vision signal after scaling
Appropriate address in；Image fusion unit is instructed according to the video fusion, is joined by read-write control unit based on the input
Number data and video fusion instruction generate the optimal reading first address of corresponding each road vision signal to be spliced, and then according to optimal reading
First address is successively read each pixel transmission of a frame image to image fusion unit out；Image fusion unit is melted according to the video
It closes instruction and splicing is carried out to the video image read out, spliced video signal transmission to video output unit is carried out
Output.
In video signal processing module, each signal conversion unit receives video routing module and is turned according to video forwarding instruction
The multipath high-speed serial signal of hair, and be converted to parallel signal；Each video output unit exports the view after anastomosing and splicing all the way
Frequency signal.
In video signal processing module, input supplemental characteristic of the detecting signal unit based on detection includes input refresh rateWith video input signals time series data；The video fusion instruction includes the output refresh rate of the fusion road Hou Ge video、
Location information in fusion picture of video output signals time series data, each road vision signal and figure layer precedence information and melt
Close the resolution information of rear video；
Image fusion unit receives the input supplemental characteristic of detecting signal unit output, and is receiving video fusion instruction
Afterwards by the output refresh rate of the fusion road the Hou Ge video in the input supplemental characteristic and video fusion instructionAnd video
Output signal time series data is transmitted to read-write control unit；Read-write control unit is written according to the current cache of each road vision signal
Address, input supplemental characteristic and the output refresh rate for merging the road Hou Ge videoIt is raw with video output signals time series data
At the optimal reading first address of each road of correspondence video to be spliced；
When image fusion unit carries out anastomosing and splicing to each road vision signal read out, according to video fusion command information
In the position specified, figure layer priority and resolution information carry out anastomosing and splicing.
The video scaling instruction includes the scaling of corresponding each road vision signal to be spliced.
Video input signals time series data includes total line number of a frame video input signalsWith a frame video input
Effective line number of signal, video output signals time series data includes total line number of a frame video output signals, the effective line number for scaling latter frame video signal is；Define certain presently written caching ground of vision signal all the way
The of the corresponding frame image in locationRow, then be directed to the road vision signal, and read-write control unit generates optimal reading first address and includes:
Calculate present frame picture deposit cache unit required time T1 are as follows:
Calculating reads T2 the time required to frame picture to be spliced from caching are as follows:
If T1 > T2, the current optimal first address that reads is the previous frame image that current cache writing address corresponds to frame image
First pixel address, otherwise the current optimal first address that reads is the first pixel address that current cache writing address corresponds to frame image.
It should be understood by those skilled in the art that, embodiments herein can provide as method, system or computer program
Product.Therefore, complete hardware embodiment, complete software embodiment or reality combining software and hardware aspects can be used in the application
Apply the form of example.Moreover, it wherein includes the computer of computer usable program code that the application, which can be used in one or more,
The computer program implemented in usable storage medium (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.) produces
The form of product.
The application is referring to method, the process of equipment (system) and computer program product according to the embodiment of the present application
Figure and/or block diagram describe.It should be understood that every one stream in flowchart and/or the block diagram can be realized by computer program instructions
The combination of process and/or box in journey and/or box and flowchart and/or the block diagram.It can provide these computer programs
Instruct the processor of general purpose computer, special purpose computer, Embedded Processor or other programmable data processing devices to produce
A raw machine, so that being generated by the instruction that computer or the processor of other programmable data processing devices execute for real
The device for the function of being specified in present one or more flows of the flowchart and/or one or more blocks of the block diagram.
These computer program instructions, which may also be stored in, is able to guide computer or other programmable data processing devices with spy
Determine in the computer-readable memory that mode works, so that it includes referring to that instruction stored in the computer readable memory, which generates,
Enable the manufacture of device, the command device realize in one box of one or more flows of the flowchart and/or block diagram or
The function of being specified in multiple boxes.
These computer program instructions also can be loaded onto a computer or other programmable data processing device, so that counting
Series of operation steps are executed on calculation machine or other programmable devices to generate computer implemented processing, thus in computer or
The instruction executed on other programmable devices is provided for realizing in one or more flows of the flowchart and/or block diagram one
The step of function of being specified in a box or multiple boxes.
The embodiment of the present invention is described in conjunction with attached drawing above, but the invention is not limited to above-mentioned specific
Embodiment, the above mentioned embodiment is only schematical, rather than restrictive, those skilled in the art
Under the inspiration of the present invention, without breaking away from the scope protected by the purposes and claims of the present invention, it can also make very much
Form, all of these belong to the protection of the present invention.
Claims (8)
1. a kind of low delay video-splicing method, characterized in that include:
The parallel input signal of multi-channel video is obtained, and detects and obtains the input refresh rate of each road video input signalsAnd video
Input signal time series data；Video input signals time series data includes total line number of a frame video input signalsWith one
Effective line number of frame video input signals；
Each road video input signals are zoomed in and out according to preset ratio, and will the scaling road Hou Ge video input signals difference
It is written in cache unit；
Video fusion command information is obtained, video fusion command information includes the output refresh rate for merging the road Hou Ge videoWith
Video output signals time series data；Video output signals time series data includes total line number of a frame video output signals
, the effective line number for scaling latter frame video signal is；
Based on current cache writing address and the input refresh rate, video input signals time series data, output refresh rateAnd video output signals time series data, generate the current optimal reading first address of each road video, comprising:
Vision signal to be spliced for any road:
Calculate present frame picture write-in cache unit required time T1；
Calculating reads T2 the time required to frame picture to be spliced from caching；
If T1 > T2, the current optimal head for reading first address and corresponding to the previous frame image of frame image for current cache writing address
Pixel address, otherwise the current optimal first address that reads is the first pixel address that current cache writing address corresponds to frame image；
According to the current optimal reading first address of each road video, according to output refresh rateIt is read from the appropriate address of cache unit
Take corresponding vision signal；
Display is exported after carrying out anastomosing and splicing to each road vision signal read out；
Define certain all the way the corresponding frame image of the presently written buffer address of vision signal to be spliced theRow, then wait for the road
Splice video:
Present frame picture is stored in T1 the time required to cache unit are as follows:
Frame picture required time T2 to be spliced is read from caching are as follows:
。
2. according to the method described in claim 1, it is characterized in that, for every road vision signal, the optimal reading first address exists
Each completely new frame image starts to read preceding generation, and in the reading process of every frame image, the current address that reads is current optimal
It is successively deviated on the basis of reading first address, until each pixel reading of a frame image finishes.
3. according to the method described in claim 1, it is characterized in that, video fusion command information further include need read each road view
Location information and figure layer precedence information of the frequency signal in fusion picture；
When carrying out anastomosing and splicing to each road vision signal read out, according to the position and figure specified in video fusion command information
Layer priority carries out anastomosing and splicing.
4. method according to claim 1 or 3, characterized in that video fusion command information further includes anastomosing and splicing backsight
The resolution information of frequency carries out when video fusion splices according to specified resolution information.
5. a kind of low delay video-splicing device, characterized in that include:
Video input signals obtain and detection module, for obtaining the parallel input signal of multi-channel video, and detect and obtain each road
The input refresh rate of video input signalsWith video input signals time series data；Video input signals time series data includes one
Total line number of frame video input signalsWith effective line number of a frame video input signals；
Video scaling and caching writing module, for being zoomed in and out according to preset ratio to each road vision signal, and will scaling
The road Hou Ge vision signal is respectively written into cache unit；Video output signals time series data includes a frame video output signals
Total line number, the effective line number for scaling latter frame video signal is；
Video fusion instruction analysis module, for obtaining video fusion command information, video fusion command information includes after merging
The output refresh rate of each road videoWith video output signals time series data；
Optimal reading first address generation module, for being based on current cache writing address and the input refresh rate, video
Input signal time series data, output refresh rateAnd video output signals time series data, generate each road video it is current most
Excellent reading first address, comprising:
Vision signal to be spliced for any road:
Calculate present frame picture write-in cache unit required time T1；
Calculating reads T2 the time required to frame picture to be spliced from caching；
If T1 > T2, the current optimal head for reading first address and corresponding to the previous frame image of frame image for current cache writing address
Pixel address, otherwise the current optimal first address that reads is the first pixel address that current cache writing address corresponds to frame image；
Define certain all the way the corresponding frame image of the presently written buffer address of vision signal to be spliced theRow, then wait for the road
Splice video:
Present frame picture is stored in T1 the time required to cache unit are as follows:
Frame picture required time T2 to be spliced is read from caching are as follows:
；
Video reads module, for the current optimal reading first address according to each road video, according to output refresh rateFrom caching
The appropriate address of unit reads corresponding vision signal；
Video-splicing output module, for exporting display after carrying out anastomosing and splicing to each road vision signal read out.
6. a kind of low delay video-splicing system, characterized in that including video input module, video routing module, vision signal
Processing module and control module；
Video input module includes multiple video input channels, and each video input channel receives video input signals respectively and will view
Frequency signal is converted to high-speed serial signals；
Control module is used to send video forwarding instruction to video routing module, and sends video to video signal processing module
Scaling instruction and video fusion instruction；Multipath high-speed serial signal is forwarded to view according to video forwarding instruction by video routing module
Audio signalprocessing module；The video fusion instruction includes the output refresh rate of the fusion road Hou Ge video, video output letter
Number time series data；
The quantity of video signal processing module be at least one, each video signal processing module respectively include signal conversion unit,
Detecting signal unit, image fusion unit, read-write control unit, cache unit and video output unit；Signal conversion unit connects
It receives multipath high-speed serial signal and is converted to parallel signal；Detecting signal unit is defeated based on each road vision signal of parallel signal process
Enter supplemental characteristic, input supplemental characteristic includes input refresh rateWith video input signals time series data；Image fusion unit root
Processing is zoomed in and out to each road vision signal according to video scaling instruction；Read-write control unit is generated for each road vision signal
Corresponding writing address, and by after scaling vision signal write-in cache unit appropriate address in；Image fusion unit root
It is instructed according to the video fusion, the input supplemental characteristic is based on by read-write control unit and video fusion instruction is generated and corresponded to
The optimal reading first address of each road vision signal to be spliced, and then each of a frame image is successively read according to optimal reading first address
Pixel transmission is to image fusion unit；Image fusion unit is instructed according to the video fusion and is carried out to the video image read out
Splicing exports spliced video signal transmission to video output unit；
Video input signals time series data includes total line number of a frame video input signalsWith a frame video input signals
Effective line number, video output signals time series data includes total line number of a frame video output signals, contracting
The effective line number for putting latter frame video signal is；Define certain corresponding frame figure of the presently written buffer address of vision signal all the way
The of pictureRow, then be directed to the road vision signal, and read-write control unit generates optimal reading first address and includes:
Calculate present frame picture deposit cache unit required time T1 are as follows:
Calculating reads T2 the time required to frame picture to be spliced from caching are as follows:
If T1 > T2, the current optimal head for reading first address and corresponding to the previous frame image of frame image for current cache writing address
Pixel address, otherwise the current optimal first address that reads is the first pixel address that current cache writing address corresponds to frame image.
7. low delay video-splicing system according to claim 6, characterized in that the video scaling instruction includes corresponding to
The scaling of each road vision signal to be spliced.
8. low delay video-splicing system according to claim 6, characterized in that described in video signal processing module
Video fusion instruction further include merge the road Hou Ge vision signal fusion picture in location information and figure layer precedence information with
And the resolution information of fusion rear video；
Image fusion unit receives the input supplemental characteristic of detecting signal unit output, and will after receiving video fusion instruction
The output refresh rate of the fusion road Hou Ge video in the input supplemental characteristic and video fusion instructionIt is exported with video
Signal sequence data are transmitted to read-write control unit；Read-write control unit is written ground according to the current cache of each road vision signal
Location, input supplemental characteristic and the output refresh rate for merging the road Hou Ge videoWith video output signals time series data, generate
The optimal reading first address of corresponding each road video to be spliced；
When image fusion unit carries out anastomosing and splicing to each road vision signal read out, according to video fusion command information middle finger
Fixed position, figure layer priority and resolution information carries out anastomosing and splicing.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910466048.4A CN109996013B (en) | 2019-05-31 | 2019-05-31 | A kind of low delay video-splicing methods, devices and systems |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910466048.4A CN109996013B (en) | 2019-05-31 | 2019-05-31 | A kind of low delay video-splicing methods, devices and systems |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109996013A CN109996013A (en) | 2019-07-09 |
| CN109996013B true CN109996013B (en) | 2019-08-16 |
Family
ID=67136944
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910466048.4A Active CN109996013B (en) | 2019-05-31 | 2019-05-31 | A kind of low delay video-splicing methods, devices and systems |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109996013B (en) |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110570441B (en) * | 2019-09-16 | 2020-07-24 | 广州波视信息科技股份有限公司 | Ultra-high definition low-delay video control method and system |
| CN111083394B (en) * | 2019-12-18 | 2022-03-01 | 南京巨鲨显示科技有限公司 | High-efficiency video splicing device and method |
| CN113038273B (en) * | 2021-05-24 | 2021-08-10 | 湖北芯擎科技有限公司 | Video frame processing method and device, storage medium and electronic equipment |
| CN113377049B (en) * | 2021-06-11 | 2022-09-06 | 西安应用光学研究所 | DDR control method based on FPGA low-delay video image cache |
| CN113810628B (en) * | 2021-09-18 | 2023-07-21 | 南京巨鲨显示科技有限公司 | Low-power-consumption video splicer and method |
| CN114125328B (en) * | 2021-11-24 | 2023-03-17 | 康佳集团股份有限公司 | Multi-source input multi-screen splicing system and method and display device |
| CN115314644A (en) * | 2022-09-16 | 2022-11-08 | 广州市保伦电子有限公司 | Video data processing system based on FPGA |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101374233B (en) * | 2008-10-23 | 2011-09-07 | 杭州华三通信技术有限公司 | Method and apparatus for adapting video stream frame rate, and FPGA chip as well as equipment for processing video stream |
| CN103024363B (en) * | 2013-01-10 | 2019-01-01 | 深圳市长江力伟股份有限公司 | A kind of multi-channel video joining method, system and electronic device |
| CN104660916B (en) * | 2013-11-18 | 2018-09-18 | 杭州海康威视数字技术股份有限公司 | The processing method of screen splicing system and video data stream |
| CN104363508B (en) * | 2014-11-21 | 2018-03-23 | 浙江宇视科技有限公司 | A kind of image split-joint method and device that prevent video from retracting |
| CN107333164B (en) * | 2016-04-29 | 2020-05-15 | 北京学而思教育科技有限公司 | Image data processing method and device |
-
2019
- 2019-05-31 CN CN201910466048.4A patent/CN109996013B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN109996013A (en) | 2019-07-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109996013B (en) | A kind of low delay video-splicing methods, devices and systems | |
| US20150237297A1 (en) | Television camera | |
| JP4241709B2 (en) | Image processing device | |
| US7561187B2 (en) | Image distributing apparatus | |
| WO2017221216A1 (en) | Positional audio assignment system | |
| JP4346591B2 (en) | Video processing apparatus, video processing method, and program | |
| JP5116498B2 (en) | Video processing apparatus and control method thereof | |
| US9491398B1 (en) | System and method for processing assorted video signals | |
| JP2008271237A (en) | Image processing apparatus, image processing method and image processing program, and reproduced image generating device, reproduced image generating method and reproduced image generating program | |
| US8249425B2 (en) | Method and apparatus for controlling image display | |
| US9100637B2 (en) | Image processing apparatus and control method thereof | |
| CN102625086B (en) | DDR2 (Double Data Rate 2) storage method and system for high-definition digital matrix | |
| US20230217084A1 (en) | Image capture apparatus, control method therefor, image processing apparatus, and image processing system | |
| US20080260213A1 (en) | Face image detection device, face image detection method and imaging apparatus | |
| JP2017054263A (en) | Image processing device, control method of image processing device, and imaging system | |
| KR20000013229A (en) | Screen portion zoom-in apparatus | |
| US10855435B2 (en) | Communication apparatus, generated data size controlling method, and program | |
| JP5885025B2 (en) | Signal processing apparatus, signal processing method, program, and electronic apparatus | |
| JP2004221955A (en) | High-speed imaging signal recorder | |
| CN110381331A (en) | A kind of image processing method, device, equipment of taking photo by plane and storage medium | |
| JPH10243380A (en) | Video monitor system | |
| JP2013090102A (en) | Distribution system | |
| KR102270723B1 (en) | Method and apparatus for displaying a multiple images of varying location and size using limited resources | |
| TWI773047B (en) | Multi-video image setting method and multi-video processing method | |
| JPH11352946A (en) | Video output processing device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |