CN109996013A - A kind of low delay video-splicing methods, devices and systems - Google Patents
A kind of low delay video-splicing methods, devices and systems Download PDFInfo
- Publication number
- CN109996013A CN109996013A CN201910466048.4A CN201910466048A CN109996013A CN 109996013 A CN109996013 A CN 109996013A CN 201910466048 A CN201910466048 A CN 201910466048A CN 109996013 A CN109996013 A CN 109996013A
- Authority
- CN
- China
- Prior art keywords
- video
- address
- road
- signal
- fusion
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 34
- 230000004927 fusion Effects 0.000 claims abstract description 84
- 230000000153 supplemental effect Effects 0.000 claims description 15
- 238000006243 chemical reaction Methods 0.000 claims description 10
- 238000001514 detection method Methods 0.000 claims description 7
- 230000005540 biological transmission Effects 0.000 claims description 6
- 108010076504 Protein Sorting Signals Proteins 0.000 claims description 5
- 238000004458 analytical method Methods 0.000 claims description 3
- 230000008054 signal transmission Effects 0.000 claims description 3
- 230000001934 delay Effects 0.000 abstract description 2
- 238000004590 computer program Methods 0.000 description 7
- 238000010586 diagram Methods 0.000 description 7
- 230000006870 function Effects 0.000 description 3
- 230000002159 abnormal effect Effects 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000001356 surgical procedure Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44004—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving video buffer management, e.g. video decoder buffer or video display buffer
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44016—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving splicing one content stream with another content stream, e.g. for substituting a video clip
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/265—Mixing
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
The invention discloses a kind of low delay video-splicing methods, devices and systems, are related to video-splicing technical field, and method includes the input refresh rate and video input signals time series data for obtaining multi-channel video signal；The scaling road Hou Ge vision signal is respectively written into cache unit；Obtain the output refresh rate and video output signals time series data of the video fusion instruction road Zhong Ge video；Based on current cache writing address and input/output refresh rate and input/output video frequency signal time sequence data, the optimal reading first address of each road video is generated；Corresponding vision signal is read from cache unit according to optimal reading first address and output refresh rate；Display is exported after carrying out anastomosing and splicing to each road vision signal read out.The present invention optimizes the reading manner of image data by setting cache unit, can reduce the delay of video-splicing, so that output image real-time is more preferable, it is more smooth, it can satisfy the demand of the low delays application scenarios such as medical treatment.
Description
Technical field
The present invention relates to video-splicing technical field, especially a kind of low delay video-splicing methods, devices and systems.
Background technique
The technologies such as Image Acquisition, transmission, display are advanced side by side, and more and more fields are promoted, such as medical treatment, security protection, religion
It educates, medium etc., starts the Real-Time Sharing for realizing information by video.In most of application scenarios, video viewers are past
Toward needing to watch several video pictures, this needs video montaging device just to complete the fusion of image, could set in limited display
The standby upper more video pictures of viewing.
However, but having higher requirement in medical field video montaging device --- low delay.Such as in the course of surgery, doctor
Need to integrate the surgical action for determining next step according to several video pictures seen.If video pictures delay is excessive, can give
Doctor brings operational inconvenience, and it is excessive to even result in surgical action, causes unnecessary damage to patient.So how to drop
The delay of low video montaging device is the current demand of medical industry.
Summary of the invention
The object of the present invention is to provide a kind of low delay video-splicing methods, devices and systems, can reduce input picture with
The delay between image is exported, real-time, the reliability shown after video-splicing is improved.
The technical scheme adopted by the invention is as follows: a kind of low delay video-splicing method, comprising:
The parallel input signal of multi-channel video is obtained, and detects and obtains the input refresh rate of each road video input signalsAnd view
Frequency input signal time series data；
Each road video input signals are zoomed in and out according to preset ratio, and will the scaling road Hou Ge video input signals difference
It is written in cache unit；
Video fusion command information is obtained, video fusion command information includes the output refresh rate for merging the road Hou Ge videoWith
Video output signals time series data；
Based on current cache writing address and the input refresh rate, video input signals time series data, output refresh rateAnd video output signals time series data, generate the current optimal reading first address of each road video to be spliced, comprising:
Vision signal to be spliced for any road:
Calculate present frame picture write-in cache unit required time T1；
Calculating reads T2 the time required to frame picture to be spliced from caching；
If T1 > T2, the current optimal head for reading first address and corresponding to the previous frame image of frame image for current cache writing address
Pixel address, otherwise the current optimal first address that reads is the first pixel address that current cache writing address corresponds to frame image；
According to the current optimal reading first address of each road video to be spliced, according to output refresh rateFrom the corresponding of cache unit
Read corresponding vision signal in address；
Display is exported after carrying out anastomosing and splicing to each road read out vision signal to be spliced.
Current cache writing address described above is a certain pixel in a certain frame image of caching is currently written slow
Deposit writing address.
To multi-channel video when low delay video-splicing method of the invention optimizes video-splicing by the way that cache unit is arranged
The reading manner of signal determines optimal reading first address by comparing the size of video frame picture storage time and readout time
Corresponding frame picture may make the delay between the input picture of cache unit and output image to decrease below a frame image
Delay.
The present invention splices the video read and the prior art all can be used in spliced output.
Preferably, for every road vision signal, the optimal first address that reads starts to read in each completely new frame image
Taking preceding generation, in the reading process of every frame image, the current address that reads successively deviates on the basis of current optimal reading first address,
Until each pixel reading of a frame image finishes.Namely it needs to wait spelling for every road in each output video image refresh process
Incoming video signal is connect, each selection for carrying out a suboptimum and reading first address can guarantee that the delay of every road input video is minimum,
Ensure that address is read in the reading process of a frame image does not exceed writing address, and reading is complete frame figure
Picture is not in that picture tearing, dislocation etc. are abnormal.
Preferably, video input signals time series data includes total line number of a frame video input signalsWith a frame
Effective line number of video input signals, video output signals time series data includes the head office of a frame video output signals
Number, the effective line number for scaling latter frame video signal is；
Define certain all the way the corresponding frame image of the presently written buffer address of vision signal to be spliced theRow, then for the road
Video to be spliced:
Present frame picture is stored in T1 the time required to cache unit are as follows:
Frame picture required time T2 to be spliced is read from caching are as follows:
。
Preferably, video fusion command information further includes that each road vision signal for needing to read is merging the position in picture
Information and figure layer precedence information；
When carrying out anastomosing and splicing to each road vision signal read out, according to the position and figure specified in video fusion command information
Layer priority carries out anastomosing and splicing.
Further, video fusion command information further includes the resolution information of anastomosing and splicing rear video, video fusion
It is carried out when splicing according to specified resolution information.
On the other hand, invention additionally discloses a kind of low delay video-splicing devices, comprising:
Video input signals obtain and detection module, for obtaining the parallel input signal of multi-channel video, and detect and obtain each road
The input refresh rate of video input signalsWith video input signals time series data；
Video scaling and caching writing module, for being zoomed in and out according to preset ratio to each road vision signal, and will scaling
The road Hou Ge vision signal is respectively written into cache unit；
Video fusion instruction analysis module, for obtaining video fusion command information, video fusion command information includes after merging
The output refresh rate of each road videoWith video output signals time series data；
Optimal reading first address generation module, for being based on current cache writing address and the input refresh rate, video
Input signal time series data, output refresh rateAnd video output signals time series data, generate each road video it is current most
Excellent reading first address, comprising:
Vision signal to be spliced for any road:
Calculate present frame picture write-in cache unit required time T1；
Calculating reads T2 the time required to frame picture to be spliced from caching；
If T1 > T2, the current optimal head for reading first address and corresponding to the previous frame image of frame image for current cache writing address
Pixel address, otherwise the current optimal first address that reads is the first pixel address that current cache writing address corresponds to frame image；
Video reads module, for the current optimal reading first address according to each road video, according to output refresh rateIt postpones
The appropriate address of memory cell reads corresponding vision signal；
Video-splicing output module, for exporting display after carrying out anastomosing and splicing to each road vision signal read out.
Invention additionally discloses a kind of low delay video-splicing systems, including video input module, video routing module, video
Signal processing module and control module；
Video input module includes multiple video input channels, and each video input channel receives video input signals respectively and will view
Frequency signal is converted to high-speed serial signals；
Control module is used to send video forwarding instruction to video routing module, and sends video to video signal processing module
Scaling instruction and video fusion instruction；Multipath high-speed serial signal is forwarded to view according to video forwarding instruction by video routing module
Audio signalprocessing module；
The quantity of video signal processing module be at least one, each video signal processing module respectively include signal conversion unit,
Detecting signal unit, image fusion unit, read-write control unit, cache unit and video output unit；Signal conversion unit connects
It receives multipath high-speed serial signal and is converted to parallel signal；Detecting signal unit is defeated based on each road vision signal of parallel signal process
Enter supplemental characteristic；Image fusion unit zooms in and out processing to each road vision signal according to video scaling instruction；Read-write control
Unit processed is directed to the corresponding writing address that each road vision signal generates, and cache unit is written in the vision signal after scaling
In appropriate address；Image fusion unit is instructed according to the video fusion, is based on the input parameter by read-write control unit
Data and video fusion instruction generate the optimal reading first address of corresponding each road vision signal to be spliced, and then according to optimal reading
First address is successively read each pixel transmission of a frame image to image fusion unit；Image fusion unit is according to the video fusion
It instructs and splicing is carried out to the video image read out, spliced video signal transmission to video output unit is carried out defeated
Out.
Preferably, in video signal processing module, input supplemental characteristic of the detecting signal unit based on detection includes input
Refresh rateWith video input signals time series data；The video fusion instruction includes that the output of the fusion road Hou Ge video refreshes
Rate, video output signals time series data, each road vision signal fusion picture in location information and figure layer priority letter
The resolution information of breath and fusion rear video；
Image fusion unit receives the input supplemental characteristic of detecting signal unit output, and will after receiving video fusion instruction
The output refresh rate of the fusion road Hou Ge video in the input supplemental characteristic and video fusion instructionIt is exported with video
Signal sequence data are transmitted to read-write control unit；Read-write control unit is written ground according to the current cache of each road vision signal
Location, input supplemental characteristic and the output refresh rate for merging the road Hou Ge videoWith video output signals time series data, generate
The optimal reading first address of corresponding each road video to be spliced；
When image fusion unit carries out anastomosing and splicing to each road vision signal read out, according to video fusion command information middle finger
Fixed position, figure layer priority and resolution information carries out anastomosing and splicing.
The video scaling instruction includes the scaling of corresponding each road vision signal to be spliced.
Preferably, video input signals time series data includes total line number of a frame video input signalsWith a frame
Effective line number of video input signals, video output signals time series data includes the head office of a frame video output signals
Number, the effective line number for scaling latter frame video signal is；Define certain presently written caching of vision signal all the way
The of the corresponding frame image in addressRow, then be directed to the road vision signal, and read-write control unit generates optimal reading first address packet
It includes:
Calculate present frame picture deposit cache unit required time T1 are as follows:
Calculating reads T2 the time required to frame picture to be spliced from cache unit are as follows:
If T1 > T2, the current optimal head for reading first address and corresponding to the previous frame image of frame image for current cache writing address
Pixel address, otherwise the current optimal first address that reads is the first pixel address that current cache writing address corresponds to frame image.
Preferably, in video input module, each video input channel is respectively included for receiving video input signals
And received signal is converted to the video input unit of parallel signal, and for parallel signal to be converted to high speed serialization letter
Number high-speed serial signals converting unit 1；Each video input channel reception video input signals all the way；
In video signal processing module, each signal conversion unit receives video routing module and forwards instruction forwarding according to video
Multipath high-speed serial signal, and be converted to parallel signal；Each video output unit exports the video letter after anastomosing and splicing all the way
Number.
The received vision signal of video input unit is also different according to interface type unlike signal format, video input unit
The vision signal received can be uniformly converted to the existing product of parallel signal, the vision signal exported after conversion for one kind
The mainly elements such as including RGB, DE, HS, VS.High-speed serial signals converting unit 1 then considers the transmission rate and letter of vision signal
Parallel signal, is converted to unified high-speed serial signals by number line number amount.
Beneficial effect
The present invention optimizes the reading manner of image data by setting cache unit, and for per vision signal to be spliced all the way,
Comparison result the time required to being stored in caching based on frame picture and the time required to reading, the generation before each frame latest image is read
Optimal reading first address, can reduce the delay of video-splicing, so that prolonging between the input picture of cache unit and output image
When less than a frame image delay, output image real-time it is more preferable, it is more smooth.Simultaneously in the reading process of a frame image,
The present invention uses the method successively deviated on optimal reading first address, and it is abnormal will not to generate picture break-up, dislocation etc..Therefore,
The present invention can satisfy the demand of the low delays application scenarios such as medical treatment.
Detailed description of the invention
Fig. 1 show low delay video-splicing method flow schematic diagram of the present invention；
Fig. 2 show the optimal a kind of embodiment schematic illustration for reading first address in video-splicing method of the present invention；
Fig. 3 show video-splicing system schematic of the present invention.
Specific embodiment
It is further described below in conjunction with the drawings and specific embodiments.
Embodiment 1
The present embodiment is a kind of low delay video-splicing method, refering to what is shown in Fig. 1, method includes:
The parallel input signal of multi-channel video is obtained, and detects and obtains the input refresh rate of each road vision signalIt is defeated with video
Enter signal sequence data；Video input signals time series data includes total line number of a frame video input signalsWith a frame
Effective line number of video input signals；
Each road vision signal is zoomed in and out according to preset ratio, and the scaling road Hou Ge vision signal is respectively written into caching
In unit；
Video fusion command information is obtained, video fusion command information includes the output refresh rate for merging the road Hou Ge videoWith
Video output signals time series data；Video output signals time series data includes total line number of a frame video output signals
, the effective line number for scaling latter frame video signal is；
Based on current cache writing address and the input refresh rate, video input signals time series data, output refresh rateAnd video output signals time series data, generate the current optimal reading first address of each road video, comprising:
Calculate each road video present frame picture deposit cache unit required time T1；
It calculates each road video and reads T2 the time required to a frame picture from caching；
Define certain all the way the corresponding frame image of the presently written buffer address of vision signal theRow, the road Ze Gai video present frame
Picture is stored in T1 the time required to cache unit are as follows:
Frame picture required time T2 to be spliced is read from caching are as follows:
；
Video to be spliced for any road, if T1 > T2, current optimal reading first address is that current cache writing address corresponds to frame
The first pixel address of the previous frame image of image, otherwise current optimal reading first address is that current cache writing address corresponds to frame figure
The first pixel address of picture；
According to the current optimal reading first address of each road video, according to output refresh rateIt is read from the appropriate address of cache unit
Take corresponding vision signal；
Display is exported after carrying out anastomosing and splicing to each road vision signal read out.
Current cache writing address described above is a certain pixel in a certain frame image of caching is currently written slow
Deposit writing address.
Refering to what is shown in Fig. 2, being fused to full frame aobvious after exporting video after being handled with the scaling that input video carries out 1:1
It is shown as example, introduces the optimal generation process for reading first address.
If input video resolution ratio is 100x100, time sequence parameter、, input view
Frequency refresh rate；Output resolution ratio is also 100x100, time sequence parameter after fusion, video brush
New rate、；
Assuming that current write address is the 10th row of the i-th frame image, then T1=(1/ when needing to generate new optimal reading first address
30)*((100-10)/120)=25ms；
Read time T2 required for a frame picture=(1/60) * (100/120)=13.89ms；
Since T1 is greater than T2, so the optimal first pixel address for reading first address and taking the (i-1)-th frame.
Similarly, when if desired generating new optimal reading first address, current write address is more than the 51st of the i-th frame image the
It goes, then T1=(1/30) * ((100-51)/120)=13.61ms；
Since T2 is still 13.89ms, then the first pixel address for reading first address and taking the i-th frame optimal at this time.
To multi-channel video when low delay video-splicing method of the invention optimizes video-splicing by the way that cache unit is arranged
The reading manner of signal determines optimal reading first address by comparing the size of video frame picture storage time and readout time
Corresponding frame picture may make the delay between the input picture of cache unit and output image to decrease below a frame image
Delay.
The present invention splices the video read and the prior art all can be used in spliced output.
For every road vision signal, the optimal first address that reads starts to read preceding production in each completely new frame image
Raw, in the reading process of every frame image, the current address that reads successively deviates on the basis of current optimal reading first address, until one
Each pixel reading of frame image finishes.
Video fusion command information further includes that each road vision signal for needing to read is merging the location information in picture, figure
Layer precedence information and resolution information；
When carrying out anastomosing and splicing to each road vision signal read out, according to the position specified in video fusion command information, scheme
Layer priority and resolution information carry out anastomosing and splicing.
Embodiment 2
The present embodiment is a kind of low delay video-splicing device, comprising:
Video input signals obtain and detection module, for obtaining the parallel input signal of multi-channel video, and detect and obtain each road
The input refresh rate of video input signalsWith video input signals time series data；
Video scaling and caching writing module, for being zoomed in and out according to preset ratio to each road vision signal, and will scaling
The road Hou Ge vision signal is respectively written into cache unit；
Video fusion instruction analysis module, for obtaining video fusion command information, video fusion command information includes after merging
The output refresh rate of each road videoWith video output signals time series data；
Optimal reading first address generation module, for being based on current cache writing address and the input refresh rate, video
Input signal time series data, output refresh rateAnd video output signals time series data, generate each road video it is current most
Excellent reading first address, comprising:
Calculate each road video present frame picture deposit cache unit required time T1；
It calculates each road video and reads T2 the time required to a frame picture from caching；
For any road video, if T1 > T2, current optimal reading first address is that current cache writing address corresponds to frame image
The first pixel address of previous frame image, otherwise the current optimal first address that reads is the head that current cache writing address corresponds to frame image
Pixel address；
Video reads module, for the current optimal reading first address according to each road video, according to output refresh rateIt postpones
The appropriate address of memory cell reads corresponding vision signal；
Video-splicing output module, for exporting display after carrying out anastomosing and splicing to each road vision signal read out.
Embodiment 3
The present embodiment is a kind of low delay video-splicing system, refering to what is shown in Fig. 3, system includes video input module, video road
By module, video signal processing module and control module；
Video input module includes multiple video input channels, and each video input channel receives video input signals respectively and will view
Frequency signal is converted to high-speed serial signals；Each video input channel is successively arranged video input unit and high-speed serial signals respectively
Converting unit 1, video input unit are converted to received signal simultaneously for receiving video input signals to be spliced all the way
Row signal；The parallel signal that video input unit exports is converted to unified high speed serialization by high-speed serial signals converting unit 1
Signal；
The received vision signal of video input unit is also different according to interface type unlike signal format, and video input unit is one
The vision signal received can be uniformly converted to the existing product of parallel signal by kind, and the vision signal exported after conversion is main
The elements such as including RGB, DE, HS, VS.High-speed serial signals converting unit 1 then considers the transmission rate and signal wire of vision signal
Parallel signal is converted to unified high-speed serial signals by quantity.
Control module is used to send video forwarding instruction to video routing module, and sends to video signal processing module
Video scaling instruction and video fusion instruction；Video routing module forwards multipath high-speed serial signal according to video forwarding instruction
To video signal processing module；
The quantity of video signal processing module be at least one, each video signal processing module respectively include signal conversion unit,
Detecting signal unit, image fusion unit, read-write control unit, cache unit and video output unit；Signal conversion unit connects
It receives multipath high-speed serial signal and is converted to parallel signal；Detecting signal unit is defeated based on each road vision signal of parallel signal process
Enter supplemental characteristic；Image fusion unit zooms in and out processing to each road vision signal according to video scaling instruction；Read-write control
Unit processed is directed to the corresponding writing address that each road vision signal generates, and cache unit is written in the vision signal after scaling
In appropriate address；Image fusion unit is instructed according to the video fusion, is based on the input parameter by read-write control unit
Data and video fusion instruction generate the optimal reading first address of corresponding each road vision signal to be spliced, and then according to optimal reading
First address is successively read each pixel transmission of a frame image to image fusion unit；Image fusion unit is according to the video fusion
It instructs and splicing is carried out to the video image read out, spliced video signal transmission to video output unit is carried out defeated
Out.
In video signal processing module, each signal conversion unit receives video routing module and is turned according to video forwarding instruction
The multipath high-speed serial signal of hair, and be converted to parallel signal；Each video output unit exports the view after anastomosing and splicing all the way
Frequency signal.
In video signal processing module, input supplemental characteristic of the detecting signal unit based on detection includes input refresh rateWith video input signals time series data；The video fusion instruction includes the output refresh rate of the fusion road Hou Ge video、
Location information in fusion picture of video output signals time series data, each road vision signal and figure layer precedence information and melt
Close the resolution information of rear video；
Image fusion unit receives the input supplemental characteristic of detecting signal unit output, and will after receiving video fusion instruction
The output refresh rate of the fusion road Hou Ge video in the input supplemental characteristic and video fusion instructionIt is exported with video
Signal sequence data are transmitted to read-write control unit；Read-write control unit is written ground according to the current cache of each road vision signal
Location, input supplemental characteristic and the output refresh rate for merging the road Hou Ge videoWith video output signals time series data, generate
The optimal reading first address of corresponding each road video to be spliced；
When image fusion unit carries out anastomosing and splicing to each road vision signal read out, according to video fusion command information middle finger
Fixed position, figure layer priority and resolution information carries out anastomosing and splicing.
The video scaling instruction includes the scaling of corresponding each road vision signal to be spliced.
Video input signals time series data includes total line number of a frame video input signalsWith a frame video input
Effective line number of signal, video output signals time series data includes total line number of a frame video output signals, the effective line number for scaling latter frame video signal is；Define certain presently written caching ground of vision signal all the way
The of the corresponding frame image in locationRow, then be directed to the road vision signal, and read-write control unit generates optimal reading first address and includes:
Calculate present frame picture deposit cache unit required time T1 are as follows:
Calculating reads T2 the time required to frame picture to be spliced from caching are as follows:
If T1 > T2, the current optimal head for reading first address and corresponding to the previous frame image of frame image for current cache writing address
Pixel address, otherwise the current optimal first address that reads is the first pixel address that current cache writing address corresponds to frame image.
It should be understood by those skilled in the art that, embodiments herein can provide as method, system or computer program
Product.Therefore, complete hardware embodiment, complete software embodiment or reality combining software and hardware aspects can be used in the application
Apply the form of example.Moreover, it wherein includes the computer of computer usable program code that the application, which can be used in one or more,
The computer program implemented in usable storage medium (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.) produces
The form of product.
The application is referring to method, the process of equipment (system) and computer program product according to the embodiment of the present application
Figure and/or block diagram describe.It should be understood that every one stream in flowchart and/or the block diagram can be realized by computer program instructions
The combination of process and/or box in journey and/or box and flowchart and/or the block diagram.It can provide these computer programs
Instruct the processor of general purpose computer, special purpose computer, Embedded Processor or other programmable data processing devices to produce
A raw machine, so that being generated by the instruction that computer or the processor of other programmable data processing devices execute for real
The device for the function of being specified in present one or more flows of the flowchart and/or one or more blocks of the block diagram.
These computer program instructions, which may also be stored in, is able to guide computer or other programmable data processing devices with spy
Determine in the computer-readable memory that mode works, so that it includes referring to that instruction stored in the computer readable memory, which generates,
Enable the manufacture of device, the command device realize in one box of one or more flows of the flowchart and/or block diagram or
The function of being specified in multiple boxes.
These computer program instructions also can be loaded onto a computer or other programmable data processing device, so that counting
Series of operation steps are executed on calculation machine or other programmable devices to generate computer implemented processing, thus in computer or
The instruction executed on other programmable devices is provided for realizing in one or more flows of the flowchart and/or block diagram one
The step of function of being specified in a box or multiple boxes.
The embodiment of the present invention is described in conjunction with attached drawing above, but the invention is not limited to above-mentioned specific
Embodiment, the above mentioned embodiment is only schematical, rather than restrictive, those skilled in the art
Under the inspiration of the present invention, without breaking away from the scope protected by the purposes and claims of the present invention, it can also make very much
Form, all of these belong to the protection of the present invention.
Claims (10)
1. a kind of low delay video-splicing method, characterized in that include:
The parallel input signal of multi-channel video is obtained, and detects and obtains the input refresh rate of each road video input signalsAnd video
Input signal time series data；
Each road video input signals are zoomed in and out according to preset ratio, and will the scaling road Hou Ge video input signals difference
It is written in cache unit；
Video fusion command information is obtained, video fusion command information includes the output refresh rate for merging the road Hou Ge videoWith
Video output signals time series data；
Based on current cache writing address and the input refresh rate, video input signals time series data, output refresh rateAnd video output signals time series data, generate the current optimal reading first address of each road video, comprising:
Vision signal to be spliced for any road:
Calculate present frame picture write-in cache unit required time T1；
Calculating reads T2 the time required to frame picture to be spliced from caching；
If T1 > T2, the current optimal head for reading first address and corresponding to the previous frame image of frame image for current cache writing address
Pixel address, otherwise the current optimal first address that reads is the first pixel address that current cache writing address corresponds to frame image；
According to the current optimal reading first address of each road video, according to output refresh rateIt is read from the appropriate address of cache unit
Take corresponding vision signal；
Display is exported after carrying out anastomosing and splicing to each road vision signal read out.
2. according to the method described in claim 1, it is characterized in that, for every road vision signal, the optimal reading first address exists
Each completely new frame image starts to read preceding generation, and in the reading process of every frame image, the current address that reads is current optimal
It is successively deviated on the basis of reading first address, until each pixel reading of a frame image finishes.
3. according to the method described in claim 1, it is characterized in that, video input signals time series data include a frame video input letter
Number total line numberWith effective line number of a frame video input signals, video output signals time series data packet
Include total line number of a frame video output signals, the effective line number for scaling latter frame video signal is；
Define certain all the way the corresponding frame image of the presently written buffer address of vision signal to be spliced theRow, then wait for the road
Splice video:
Present frame picture is stored in T1 the time required to cache unit are as follows:
Frame picture required time T2 to be spliced is read from caching are as follows:
。
4. according to the method described in claim 1, it is characterized in that, video fusion command information further include need read each road view
Location information and figure layer precedence information of the frequency signal in fusion picture；
When carrying out anastomosing and splicing to each road vision signal read out, according to the position and figure specified in video fusion command information
Layer priority carries out anastomosing and splicing.
5. method according to claim 1 or 4, characterized in that video fusion command information further includes anastomosing and splicing backsight
The resolution information of frequency carries out when video fusion splices according to specified resolution information.
6. a kind of low delay video-splicing device, characterized in that include:
Video input signals obtain and detection module, for obtaining the parallel input signal of multi-channel video, and detect and obtain each road
The input refresh rate of video input signalsWith video input signals time series data；
Video scaling and caching writing module, for being zoomed in and out according to preset ratio to each road vision signal, and will scaling
The road Hou Ge vision signal is respectively written into cache unit；
Video fusion instruction analysis module, for obtaining video fusion command information, video fusion command information includes after merging
The output refresh rate of each road videoWith video output signals time series data；
Optimal reading first address generation module, for being based on current cache writing address and the input refresh rate, video
Input signal time series data, output refresh rateAnd video output signals time series data, generate each road video it is current most
Excellent reading first address, comprising:
Vision signal to be spliced for any road:
Calculate present frame picture write-in cache unit required time T1；
Calculating reads T2 the time required to frame picture to be spliced from caching；
If T1 > T2, the current optimal head for reading first address and corresponding to the previous frame image of frame image for current cache writing address
Pixel address, otherwise the current optimal first address that reads is the first pixel address that current cache writing address corresponds to frame image；
Video reads module, for the current optimal reading first address according to each road video, according to output refresh rateFrom caching
The appropriate address of unit reads corresponding vision signal；
Video-splicing output module, for exporting display after carrying out anastomosing and splicing to each road vision signal read out.
7. a kind of low delay video-splicing system, characterized in that including video input module, video routing module, vision signal
Processing module and control module；
Video input module includes multiple video input channels, and each video input channel receives video input signals respectively and will view
Frequency signal is converted to high-speed serial signals；
Control module is used to send video forwarding instruction to video routing module, and sends video to video signal processing module
Scaling instruction and video fusion instruction；Multipath high-speed serial signal is forwarded to view according to video forwarding instruction by video routing module
Audio signalprocessing module；
The quantity of video signal processing module be at least one, each video signal processing module respectively include signal conversion unit,
Detecting signal unit, image fusion unit, read-write control unit, cache unit and video output unit；Signal conversion unit connects
It receives multipath high-speed serial signal and is converted to parallel signal；Detecting signal unit is defeated based on each road vision signal of parallel signal process
Enter supplemental characteristic；Image fusion unit zooms in and out processing to each road vision signal according to video scaling instruction；Read-write control
Unit processed is directed to the corresponding writing address that each road vision signal generates, and cache unit is written in the vision signal after scaling
In appropriate address；Image fusion unit is instructed according to the video fusion, is based on the input parameter by read-write control unit
Data and video fusion instruction generate the optimal reading first address of corresponding each road vision signal to be spliced, and then according to optimal reading
First address is successively read each pixel transmission of a frame image to image fusion unit；Image fusion unit is according to the video fusion
It instructs and splicing is carried out to the video image read out, spliced video signal transmission to video output unit is carried out defeated
Out.
8. low delay video-splicing system according to claim 7, characterized in that the video scaling instruction includes corresponding to
The scaling of each road vision signal to be spliced.
9. low delay video-splicing system according to claim 7, characterized in that in video signal processing module, signal
Input supplemental characteristic of the detection unit based on detection includes input refresh rateWith video input signals time series data；The view
Frequency fusion instruction includes the output refresh rate of the fusion road Hou Ge video, video output signals time series data, each road video letter
Number fusion picture in location information and figure layer precedence information and merge rear video resolution information；
Image fusion unit receives the input supplemental characteristic of detecting signal unit output, and will after receiving video fusion instruction
The output refresh rate of the fusion road Hou Ge video in the input supplemental characteristic and video fusion instructionIt is exported with video
Signal sequence data are transmitted to read-write control unit；Read-write control unit is written ground according to the current cache of each road vision signal
Location, input supplemental characteristic and the output refresh rate for merging the road Hou Ge videoWith video output signals time series data, generate
The optimal reading first address of corresponding each road video to be spliced；
When image fusion unit carries out anastomosing and splicing to each road vision signal read out, according to video fusion command information middle finger
Fixed position, figure layer priority and resolution information carries out anastomosing and splicing.
10. low delay video-splicing system according to claim 9, characterized in that video input signals time series data packet
Include total line number of a frame video input signalsWith effective line number of a frame video input signals, video is defeated
Signal sequence data include total line number of a frame video output signals out, scale effective row of latter frame video signal
Number is；Define certain all the way the corresponding frame image of the presently written buffer address of vision signal theRow is then regarded for the road
Frequency signal, read-write control unit generate optimal reading first address and include:
Calculate present frame picture deposit cache unit required time T1 are as follows:
Calculating reads T2 the time required to frame picture to be spliced from caching are as follows:
If T1 > T2, the current optimal head for reading first address and corresponding to the previous frame image of frame image for current cache writing address
Pixel address, otherwise the current optimal first address that reads is the first pixel address that current cache writing address corresponds to frame image.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910466048.4A CN109996013B (en) | 2019-05-31 | 2019-05-31 | A kind of low delay video-splicing methods, devices and systems |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910466048.4A CN109996013B (en) | 2019-05-31 | 2019-05-31 | A kind of low delay video-splicing methods, devices and systems |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109996013A true CN109996013A (en) | 2019-07-09 |
| CN109996013B CN109996013B (en) | 2019-08-16 |
Family
ID=67136944
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910466048.4A Active CN109996013B (en) | 2019-05-31 | 2019-05-31 | A kind of low delay video-splicing methods, devices and systems |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109996013B (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110570441A (en) * | 2019-09-16 | 2019-12-13 | 广州波视信息科技股份有限公司 | Ultra-high definition low-delay video control method and system |
| CN111083394A (en) * | 2019-12-18 | 2020-04-28 | 南京巨鲨显示科技有限公司 | High-efficiency video splicing device and method |
| CN113038273A (en) * | 2021-05-24 | 2021-06-25 | 湖北芯擎科技有限公司 | Video frame processing method and device, storage medium and electronic equipment |
| CN113377049A (en) * | 2021-06-11 | 2021-09-10 | 西安应用光学研究所 | DDR control method based on FPGA low-delay video image cache |
| CN113810628A (en) * | 2021-09-18 | 2021-12-17 | 南京巨鲨显示科技有限公司 | Low-power-consumption video splicer and method |
| CN113852733A (en) * | 2021-10-21 | 2021-12-28 | 中国北方车辆研究所 | Multi-source image low-delay parallel transmission circuit and method based on single-path coaxiality |
| CN115314644A (en) * | 2022-09-16 | 2022-11-08 | 广州市保伦电子有限公司 | Video data processing system based on FPGA |
| WO2023092815A1 (en) * | 2021-11-24 | 2023-06-01 | 康佳集团股份有限公司 | Multi-source input multi-screen tiling system and method, and display apparatus |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101374233A (en) * | 2008-10-23 | 2009-02-25 | 杭州华三通信技术有限公司 | Method and apparatus for adapting video stream frame rate, and FPGA chip as well as equipment for processing video stream |
| CN103024363A (en) * | 2013-01-10 | 2013-04-03 | 深圳市长江力伟股份有限公司 | Method, system and electronic device for stitching multiple channels of videos |
| CN104363508A (en) * | 2014-11-21 | 2015-02-18 | 浙江宇视科技有限公司 | Image stitching method and device for preventing video rollback |
| US20160291917A1 (en) * | 2013-11-18 | 2016-10-06 | Hangzhou Hikvision Digital Technology Co., Ltd. | Screen splicing system and video data stream processing method |
| CN107333164A (en) * | 2016-04-29 | 2017-11-07 | 北京学而思教育科技有限公司 | A kind of image processing method and device |
-
2019
- 2019-05-31 CN CN201910466048.4A patent/CN109996013B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101374233A (en) * | 2008-10-23 | 2009-02-25 | 杭州华三通信技术有限公司 | Method and apparatus for adapting video stream frame rate, and FPGA chip as well as equipment for processing video stream |
| CN103024363A (en) * | 2013-01-10 | 2013-04-03 | 深圳市长江力伟股份有限公司 | Method, system and electronic device for stitching multiple channels of videos |
| US20160291917A1 (en) * | 2013-11-18 | 2016-10-06 | Hangzhou Hikvision Digital Technology Co., Ltd. | Screen splicing system and video data stream processing method |
| CN104363508A (en) * | 2014-11-21 | 2015-02-18 | 浙江宇视科技有限公司 | Image stitching method and device for preventing video rollback |
| CN107333164A (en) * | 2016-04-29 | 2017-11-07 | 北京学而思教育科技有限公司 | A kind of image processing method and device |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110570441A (en) * | 2019-09-16 | 2019-12-13 | 广州波视信息科技股份有限公司 | Ultra-high definition low-delay video control method and system |
| CN111083394A (en) * | 2019-12-18 | 2020-04-28 | 南京巨鲨显示科技有限公司 | High-efficiency video splicing device and method |
| CN111083394B (en) * | 2019-12-18 | 2022-03-01 | 南京巨鲨显示科技有限公司 | High-efficiency video splicing device and method |
| CN113038273A (en) * | 2021-05-24 | 2021-06-25 | 湖北芯擎科技有限公司 | Video frame processing method and device, storage medium and electronic equipment |
| CN113377049A (en) * | 2021-06-11 | 2021-09-10 | 西安应用光学研究所 | DDR control method based on FPGA low-delay video image cache |
| CN113810628A (en) * | 2021-09-18 | 2021-12-17 | 南京巨鲨显示科技有限公司 | Low-power-consumption video splicer and method |
| CN113852733A (en) * | 2021-10-21 | 2021-12-28 | 中国北方车辆研究所 | Multi-source image low-delay parallel transmission circuit and method based on single-path coaxiality |
| CN113852733B (en) * | 2021-10-21 | 2024-04-30 | 中国北方车辆研究所 | Multi-source image low-delay parallel transmission circuit and method based on single-path coaxiality |
| WO2023092815A1 (en) * | 2021-11-24 | 2023-06-01 | 康佳集团股份有限公司 | Multi-source input multi-screen tiling system and method, and display apparatus |
| CN115314644A (en) * | 2022-09-16 | 2022-11-08 | 广州市保伦电子有限公司 | Video data processing system based on FPGA |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109996013B (en) | 2019-08-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109996013B (en) | A kind of low delay video-splicing methods, devices and systems | |
| US9674481B2 (en) | Television camera | |
| JP4346591B2 (en) | Video processing apparatus, video processing method, and program | |
| US20200186887A1 (en) | Real-time broadcast editing system and method | |
| JP2007110193A (en) | Image processing apparatus | |
| JP2007243699A (en) | Method and apparatus for video recording and playback | |
| US20210217444A1 (en) | Audio and video processing | |
| EP3468171B1 (en) | Display apparatus and recording medium | |
| US8249425B2 (en) | Method and apparatus for controlling image display | |
| CN102625086B (en) | DDR2 (Double Data Rate 2) storage method and system for high-definition digital matrix | |
| US20110267424A1 (en) | Image processing apparatus and control method thereof | |
| KR20130044062A (en) | Remote video transmission system | |
| US20230217084A1 (en) | Image capture apparatus, control method therefor, image processing apparatus, and image processing system | |
| JP2005316007A (en) | Image display controlling apparatus | |
| JP2017054263A (en) | Image processing device, control method of image processing device, and imaging system | |
| EP3941067A1 (en) | Moving image distribution system, moving image distribution method, and display terminal | |
| JP7274917B2 (en) | Video playback device and video playback method | |
| KR20000013229A (en) | Screen portion zoom-in apparatus | |
| JP5885025B2 (en) | Signal processing apparatus, signal processing method, program, and electronic apparatus | |
| JP2006324941A (en) | Apparatus, method and program for processing image | |
| JPH10243380A (en) | Video monitor system | |
| US20120002105A1 (en) | Video Signal Interpolation Device, Video Display Device, and Video Signal Interpolation Method | |
| TWI773047B (en) | Multi-video image setting method and multi-video processing method | |
| JP2013090102A (en) | Distribution system | |
| CN113760121B (en) | Intelligent multi-interface controlled liquid crystal screen splicing system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |