CN106210535A - The real-time joining method of panoramic video and device - Google Patents
The real-time joining method of panoramic video and device Download PDFInfo
- Publication number
- CN106210535A CN106210535A CN201610619401.4A CN201610619401A CN106210535A CN 106210535 A CN106210535 A CN 106210535A CN 201610619401 A CN201610619401 A CN 201610619401A CN 106210535 A CN106210535 A CN 106210535A
- Authority
- CN
- China
- Prior art keywords
- video data
- wide
- frame
- angle video
- memorizer
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 59
- 230000008569 process Effects 0.000 claims abstract description 24
- 230000004927 fusion Effects 0.000 claims description 16
- 230000001360 synchronised effect Effects 0.000 claims description 3
- FGRBYDKOBBBPOI-UHFFFAOYSA-N 10,10-dioxo-2-[4-(N-phenylanilino)phenyl]thioxanthen-9-one Chemical compound O=C1c2ccccc2S(=O)(=O)c2ccc(cc12)-c1ccc(cc1)N(c1ccccc1)c1ccccc1 FGRBYDKOBBBPOI-UHFFFAOYSA-N 0.000 claims 1
- 238000000151 deposition Methods 0.000 claims 1
- 230000006835 compression Effects 0.000 description 4
- 238000007906 compression Methods 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 3
- 230000000007 visual effect Effects 0.000 description 3
- 241000251468 Actinopterygii Species 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000003384 imaging method Methods 0.000 description 2
- 230000002159 abnormal effect Effects 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000002372 labelling Methods 0.000 description 1
- 230000008520 organization Effects 0.000 description 1
- 238000005192 partition Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/04—Context-preserving transformations, e.g. by using an importance map
- G06T3/047—Fisheye or wide-angle transformations
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T3/4038—Image mosaicing, e.g. composing plane images from plane sub-images
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/80—Geometric correction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/2621—Cameras specially adapted for the electronic generation of special effects during image pickup, e.g. digital cameras, camcorders, video cameras having integrated special effects capability
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/265—Mixing
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Image Processing (AREA)
- Studio Devices (AREA)
Abstract
The invention discloses a kind of real-time joining method of panoramic video and device, described method includes that receiving multiple image acquisition units shoots the multichannel wide-angle video data obtained；Multichannel wide-angle video data are carried out synchronization process；Each road wide-angle video data write memorizer after synchronizing, and launch wide-angle video data and realize distortion correction；The overlapping region of the multichannel wide-angle video data after launching is carried out anastomosing and splicing process.The application can realize panoramic video in panorama camera and splice in real time, without carrying out later stage splicing by mobile phone or computer, before and after being capable of instantaneous acquiring, instant splicing and splicing, frame per second is consistent, improve the real-time of panoramic video splicing, and splicing low cost without putting into other hardware costs again, simplify operation, easy to use.
Description
Technical field
The application relates to image processing techniques, espespecially a kind of real-time joining method of panoramic video and device.
Background technology
Along with visual pattern technology and the development of video capture technology, video acquisition is from obtaining regarding of common view angle
Frequently, develop into wide-angle video, develop into horizontal direction 360 degree, the panoramic video of vertical direction 360 degree further.
In order to obtain panoramic picture, the panorama camera using two or more camera lens to form is needed to shoot multiple sides
To image, then by mobile phone or PC, the image later stage of the multiple directions of two or more lens shootings is spliced into panorama
Image.
Carry out later stage splicing by mobile phone or PC again after above-mentioned prior art shoots image by panorama camera to obtain
To the mode of panoramic picture, there is the defect that poor real, splicing cost height and operation are complicated.
Summary of the invention
In order to solve above-mentioned technical problem, the invention provides a kind of real-time joining method of panoramic video and device, it is possible to
In real time splicing is realized in panorama camera, and splicing low cost, easy to use.
In order to reach the object of the invention, this application provides a kind of real-time joining method of panoramic video, be applied to shooting eventually
In end, described camera terminal comprises multiple image acquisition units, and described method includes:
Receive multiple image acquisition units and shoot the multichannel wide-angle video data obtained；
Described multichannel wide-angle video data are carried out synchronization process；
Each road wide-angle video data write memorizer after synchronizing, and launch wide-angle video data realization distortion school
Just；
Carry out splicing fusion treatment to the overlapping region of the multichannel wide-angle video data after launching.
Present invention also provides a kind of real-time splicing apparatus of panoramic video, be applied in camera terminal, described camera terminal
Comprising multiple image acquisition units, described device includes:
One input block, for receiving the multichannel wide-angle video data that multiplex image acquisition unit photographs obtains；
One lock unit, carries out synchronization process for the multichannel wide-angle video data receiving described input block；
One storage control unit, each road wide-angle video data write storage after described lock unit is synchronized
Device；
One panoramic mosaic unit, is used for launching wide-angle video data and realizes distortion correction, and to the multichannel Radix Rumicis after launching
Video data carries out the anastomosing and splicing of overlapping region and processes.
Compared with prior art, the application includes that receiving multiple image acquisition units shoots the multichannel wide-angle video number obtained
According to；Multichannel wide-angle video data are carried out synchronization process；Each road wide-angle video data write memorizer after synchronizing, and open up
Open wide-angle video data and realize distortion correction；The overlapping region of the multichannel wide-angle video data after launching is carried out at anastomosing and splicing
Reason.The application can realize panoramic video in panorama camera and splice in real time, it is not necessary to carry out later stage spelling by mobile phone or computer
Connect process, it is possible to before and after realizing instantaneous acquiring, instant splicing and splicing, frame per second is consistent, improves the real-time of panoramic video splicing
Property, and splicing low cost without putting into other hardware costs again, simplify operation, easy to use.
Other features and advantages of the present invention will illustrate in the following description, and, partly become from description
Obtain it is clear that or understand by implementing the present invention.The purpose of the present invention and other advantages can be by description, rights
Structure specifically noted in claim and accompanying drawing realizes and obtains.
Accompanying drawing explanation
Accompanying drawing is used for providing being further appreciated by technical solution of the present invention, and constitutes a part for description, with this
The embodiment of application is used for explaining technical scheme together, is not intended that the restriction to technical solution of the present invention.
The flow chart of the real-time joining method of panoramic video that Fig. 1 provides for the application one embodiment；
The Organization Chart of the real-time splicing apparatus of panoramic video that Fig. 2 provides for another embodiment of the application.
Detailed description of the invention
For making the object, technical solutions and advantages of the present invention clearer, below in conjunction with accompanying drawing to the present invention
Embodiment be described in detail.It should be noted that in the case of not conflicting, in embodiment in the application and embodiment
Feature can mutual combination in any.
Can be in middle execution such as such as CPU, special image processing chips etc. in the step shown in the flow chart of accompanying drawing.Further,
Although showing logical order in flow charts, but in some cases, can perform shown with the order being different from herein
The step gone out or describe.
In existing panoramic video joining method, after needing video panorama camera shot by mobile phone or PC to carry out
The splicing fusion treatment of phase, the splicing poor real of this mode, splicing cost are high and operate complicated.For this problem, this Shen
Please provide a solution, cardinal principle is: is shot external image by multiple image acquisition units of camera terminal, obtains
Multichannel wide-angle video data, camera terminal receives each road wide-angle video data, carries out multichannel wide-angle video data at synchronization
Reason, after completing synchronization process, each road wide-angle video data write memorizer after synchronizing, and carry out launching to realize distortion school
Just, finally, the overlapping region to the multichannel wide-angle video data after launching carries out splicing fusion treatment.
Owing to the application completing in camera terminal the splicing fusion treatment of panoramic video, therefore, obtain many in shooting
After the wide-angle video data of road, it is not necessary to re-use mobile phone or PC carries out later stage splicing fusion treatment, improve panoramic video splicing
Real-time.Further, use an equipment complete from wide-angle video photograph image mosaic merge whole work, due to without
Later stage puts into other hardware costs again, greatly reduces the cost of image procossing, and simplifies the operation of user, simpler
Easy-to-use.
The technical scheme that each embodiment of the application provides is described in detail below in conjunction with accompanying drawing.
The real-time joining method of panoramic video of the application is applied in camera terminal.In actual applications, complete in order to obtain
Scape image, panoramic video, occur in that pan-shot terminal, such as panorama camera, panoramic camera etc..These pan-shot terminals
Including at least two image acquisition units, image acquisition units includes a wide-angle lens (such as fish eye lens) and a picked-up
The imageing sensor of the image formed by this wide-angle lens.At least two image acquisition units is arranged dorsad, it is ensured that collect water
The panoramic picture of gentle the most each 360 °.Camera terminal is by the acquisition that combined by the image that each image acquisition units is absorbed
Solid angle radian is the image of 4 π.
The flow chart of the real-time joining method of panoramic video that Fig. 1 provides for the application one embodiment.As it is shown in figure 1, the party
Method includes:
Step 101: receive multiple image acquisition units and shoot the multichannel wide-angle video data obtained；
Step 102: multichannel wide-angle video data are carried out synchronization process；
Step 103: each road wide-angle video data write memorizer after synchronizing, and launch the realization of wide-angle video data
Distortion correction；
Step 104: carry out splicing fusion treatment to the overlapping region of the multichannel wide-angle video data after launching.
In actual applications, for obtaining panorama content, need respectively to be clapped by the camera terminal comprising multiple image acquisition units
Take the photograph the image more than 180 degree of scopes, then carry out splicing fusion and obtain panorama content.The method that the present embodiment provides can be used for clapping
Take the photograph terminal Zhong Jiangge road and be fused to panoramic picture, panoramic video more than the image mosaic of 180 degree of scopes.Preferably, this method can
For comprising the camera terminal of two image acquisition units, two-way is fused to panorama sketch more than the image mosaic of 180 degree of scopes
Picture, panoramic video.
What deserves to be explained is, the method for the present embodiment also is not only limited to merge the image mosaic more than 180 degree of scopes
For panoramic picture, panoramic video, optionally, the image for the shooting of several non-wide-angle lens can also use the present embodiment to provide
Method be spliced into panoramic picture, panoramic video, but be not limited to this.
In order to obtain panoramic picture or panoramic video, camera terminal needs first by image acquisition units shooting external world figure
Picture, obtains multichannel wide-angle video data, and the image of two image acquisition units shootings need to ensure the region that overlaps.Camera terminal
Receive multichannel wide-angle video data, to carry out multichannel wide-angle video data splicing fusion treatment, obtain panoramic picture, aphorama
Frequently.
Owing to multiplex image acquisition unit is separate, the image collected has successively time difference, synchronizes even if using
Control circuit is controlled, and also cannot ensure to shoot the multichannel wide-angle video data precise synchronization obtained.Therefore, multichannel is being obtained
After wide-angle video data, need these multichannel wide-angle video data are first carried out synchronization process.
Concrete, these multichannel wide-angle video data are first carried out synchronization process, including: by multichannel wide-angle video data respectively
Write caching, at synchronization by the wide-angle video data read-out in multiple cachings after a delay specifying time threshold,
Multichannel wide-angle video data Complete Synchronization after synchronization process.
Multichannel wide-angle video data after synchronization ensure in time domain the most consistent, it is to avoid shake and time occurs in video
The phenomenon such as inconsistent.
Wide-angle lens, especially fish eye lens, the scope reaching or seeing beyond human eye is made every effort at its visual angle.Therefore,
There is bigger distortion in wide-angle lens in imaging process, fault image does not meets the viewing custom of human eye, so fault image
Needs are corrected.
Based on this, after multichannel wide-angle video data are carried out synchronization process, need each road wide-angle video data are entered
Line distortion corrects, in the method that the present embodiment provides, by launching to realize wide-angle video data to each road wide-angle video data
Distortion correction.In the present embodiment, in each road wide-angle video data write memorizer after synchronizing, and complete to launch, with
Continuous overlapping region to the multichannel wide-angle video data after launching further carries out splicing fusion treatment after an action of the bowels.
The above-mentioned expansion to wide-angle video data refers to according to imaging model, multiple image acquisition units are shot several
Different visual angles image unification is in the same coordinate system.The wide-angle lens of camera terminal is marked by the method for the present embodiment in advance
Fixed, obtain each self-corresponding image coordinate information for distortion correction of each wide-angle lens.During image spread, sit according to image
Mark information carries out coordinate addressing, reads out the pixel in wide-angle video data, is equivalent to each road wide-angle video data unified
In same coordinate system, completing the expansion of image, it is achieved that the distortion correction of image, this mode greatly simplify reality
Time process complexity.
In the method for the present embodiment, in each road wide-angle video data write memorizer after synchronizing, can be for
Each road wide-angle video data are respectively configured a memorizer one to one, for starting to shoot Radix Rumicis in image acquisition units
After video data, the wide-angle video data obtained are write corresponding memorizer, and, in advance by corresponding wide-angle lens
Image coordinate information stores in the memorizer of correspondence, in order to according to the image coordinate information of storage in memorizer, to write, this is deposited
The wide-angle video data of reservoir are launched.
Optionally, it is also possible to a memorizer is marked off multiple subregion, each zone configuration gives the Radix Rumicis that a road is corresponding
The wide-angle video data obtained, after image acquisition units starts to shoot wide-angle video data, are written to correspondence by video data
Subregion in, and, in advance corresponding image coordinate information is stored in respective partition.
Image coordinate information can represent in the way of using look-up table, when unfolded image, by reading the side of look-up table
Formula obtains coordinate, reads out the pixel in wide-angle video data further according to coordinate.
Based on above-mentioned, think that each road wide-angle video data are respectively configured one one to one as a example by memorizer, will be with
Each road wide-angle video data write memorizer after step, and launch wide-angle video data and realize distortion correction, including:
Will synchronize after each road wide-angle video data frame by frame be written as the relative of this road wide-angle video data configuration
In the memorizer answered, wherein, corresponding memorizer prestores corresponding image coordinate information, for writing this image
The wide-angle video data of coordinate information place memorizer carry out distortion correction；
While frame by frame by memorizer corresponding for the write of wide-angle video data, from corresponding memorizer, read image sit
Coordinate in mark information, and open up from written into the wide-angle video data of this memorizer read out pixel corresponding to coordinate
Open wide-angle video data, it is achieved the distortion correction of wide-angle video data.
The wide-angle video data on each road are all to be written to frame by frame in the memorizer of correspondence, during write image,
The coordinate in the image coordinate information of storage can be read in this memorizer simultaneously, according to coordinate read written into memorizer wide
The pixel of angle video data, thus launch written into the wide-angle video data in this memorizer, it is achieved distortion correction.
After wide-angle video data after being launched, it is possible to carry out the splicing fusion treatment of overlapping region, obtain complete
Scape image, i.e. can get panoramic video for video capture.But, need to carry out memorizer behaviour during image spread
Make, which limits the efficiency that image launches in real time, the frame per second of the panoramic picture obtained after may causing splicing and image acquisition
The frame per second of the video that unit gathers is different, causes the problem that image frame per second declines, cannot ensure to splice in real time.
In the method that the present embodiment provides, for avoiding the frame per second before and after splicing different, adopt with the following method: after synchronizing
Each road wide-angle video data write frame by frame with in the wide-angle video data memorizer one to one of each road, and frame by frame will
While the memorizer that the write of wide-angle video data is corresponding, read in image coordinate information from the memorizer that wide-angle video is corresponding
Coordinate, and from written into the wide-angle video data of this memorizer read out the pixel that coordinate is corresponding, including:
For each road wide-angle video data after synchronizing, in the row field effective time of presently written frame, perform frame
The operation of the memorizer that data write is corresponding, in the row field blanking interval of presently written frame, reads coordinate, and reads according to coordinate
Take written into the pixel in the previous frame of the presently written frame of described memorizer, complete at the same time presently written frame write and
After the reading of described previous frame, next frame is write corresponding memorizer as presently written frame and substitutes the frame number being read
According to, and circulated the expansion of wide-angle video data successively.
The present embodiment provide method in, for synchronize after each road wide-angle video data be all write frame by frame the most right
The memorizer answered, therefore, is referred to as presently written frame by the picture frame of memorizer to be written to.Picture frame comprises capable field have
Effect signal and row field invalid signals, row field useful signal marks the row field effective time of picture frame, row field invalid signals labelling
The row field blanking that goes out picture frame interval (or claim row field ineffective time).In the embodiment of the present application, have in the row field of presently written frame
In the effect time, perform the write of frame data, within row field ineffective time of presently written frame, perform the reading of the pixel of previous frame
Take, it is possible to efficiently utilize bandwidth of memory, it is ensured that the frame per second before and after splicing is consistent, i.e. ensure that the real-time of splicing.
In other words, the write operation namely making presently written frame write memorizer enables signal and presently written frame line field
Useful signal keeps consistent, makes the row field invalid signals reading to enable signal with presently written frame that reading previous frame pixel operates
Keep consistent.
In the method that the present embodiment provides, after the row field effective time of presently written frame arrives, write in memorizer
The effective image data of present frame, after completing the write of effective image data, row field effective time terminates, then row field blanking district
Between arrive, within this period, read coordinate, and according to coordinate read written in the previous frame of the presently written frame of memorizer
Pixel, so far complete a read-write cycle, and reciprocal with this, complete the write of presently written frame and presently written frame
Previous frame expansion after, using the next frame of presently written frame as next presently written frame write memorizer, refresh substitute
The previous frame being read, the picture frame being the most just written into memorizer will be unfolded as previous frame.
Based on above-mentioned, owing to the present embodiment being write memorizer frame by frame, therefore, when writing the first frame to memorizer,
When namely writing each road wide-angle video data the first frame after synchronizing, memorizer also there is no data, therefore, for same
First frame of each road wide-angle video data after step, in the row field effective time of the first frame, performs to write this first frame
The operation of corresponding memorizer；In the row field blanking interval of the first frame, do not perform read operation.In the write completing the first frame
After, during using the second frame as presently written frame, according in the row field effective time of presently written frame, perform writing of frame data
Enter, within row field ineffective time of presently written frame, perform the reading of the pixel of previous frame.
In the method that the present embodiment provides, after each road wide-angle video data are launched, to the multichannel Radix Rumicis after launching
The overlapping region of video data carries out splicing fusion treatment, obtains panoramic picture or panoramic video.
The method merged such as uses Wavelet Fusion, weighted average fusion etc..Such as, the photo terminal to twin-lens shoots
Two-way wide-angle video data, the video image after launching two carries out the fusion treatment of overlapping region, two video image warps
Unite two into one after fusion, form the full-view video image spliced.
Further, in the method that the present embodiment provides, melt the overlapping region of multichannel wide-angle video data is carried out splicing
Conjunction processes after obtaining panoramic picture or panoramic video, is also standard by spliced panoramic video or panoramic picture compression coding
Data form, and the panoramic video after compression or panoramic picture are transferred to rear end equipment and store or show.For example, it is possible to
By the panoramic video after the data transmission interface transmission compressions such as USB interface, wifi interface or panoramic picture.
As in figure 2 it is shown, present invention also provides a kind of real-time splicing apparatus of panoramic video, it is applied in camera terminal, should
Camera terminal comprises multiple image acquisition units, and described device includes:
One input block, for receiving the multichannel wide-angle video data that multiplex image acquisition unit photographs obtains；
One lock unit, carries out synchronization process for the multichannel wide-angle video data receiving described input block；
One storage control unit, each road wide-angle video data write storage after described lock unit is synchronized
Device；
One panoramic mosaic unit, is used for launching wide-angle video data and realizes distortion correction, and to the multichannel Radix Rumicis after launching
Video data carries out the anastomosing and splicing of overlapping region and processes.
Further, store control unit, specifically for will synchronize after each road wide-angle video data write frame by frame with often
In one road wide-angle video data memorizer one to one, the memorizer of described correspondence is previously stored with for corresponding Radix Rumicis
Video data carries out the image coordinate information of distortion correction；
Described panoramic mosaic unit, specifically for writing correspondence by wide-angle video data frame by frame in described storage control unit
Memorizer while, from corresponding memorizer, read the coordinate in image coordinate information, and from written into this memorizer
Wide-angle video data read out pixel corresponding to coordinate thus launches wide-angle video data, it is achieved wide-angle video data abnormal
Become correction.
Further, described storage control unit, specifically for for each road wide-angle video data after synchronizing, currently
In the row field effective time of write frame, perform the operation of memorizer corresponding for frame data write；
Described panoramic mosaic unit, specifically in the row field blanking interval of presently written frame, reads coordinate, and according to
Coordinate reads written into the pixel in the previous frame of the described presently written frame of described memorizer；
After the reading of the write and described previous frame that complete presently written frame, next frame is write as presently written frame
Corresponding memorizer substitutes the frame data being read, and has circulated the expansion of wide-angle video data successively.
Further, described storage control unit, specifically for the first frame to each road wide-angle video data after synchronizing,
In the row field effective time of the first frame, perform the operation of memorizer corresponding for the write of this first frame；
Described panoramic mosaic unit, specifically for, in the row field blanking interval of the first frame, not performing read operation.
Further, described lock unit carries out synchronization process to described multichannel wide-angle video data, including:
Described multichannel wide-angle video data are respectively written into caching, after postponing an appointment time threshold, at synchronization
By multichannel wide-angle video data read-out, it is achieved the synchronization of described multichannel wide-angle video data.
It addition, in an alternative embodiment of the application, the real-time splicing apparatus of this panoramic video, also include a video compress
Unit, for by the video data that full-view video image compression coding is standard after described panoramic mosaic unit spliced.
In another alternative embodiment of the application, the real-time splicing apparatus of this panoramic video, also include an output unit, use
Video data transmission after being compressed by described video compressing unit stores to rear end equipment or shows.
Although the embodiment that disclosed herein is as above, but described content only readily appreciates that the present invention uses
Embodiment, is not limited to the present invention.Technical staff in any art of the present invention, is being taken off without departing from the present invention
On the premise of the spirit and scope of dew, any amendment and change can be carried out in the form implemented and details, but the present invention
Scope of patent protection, still must be defined in the range of standard with appending claims.
Claims (10)
1. the real-time joining method of panoramic video, it is characterised in that being applied in camera terminal, described camera terminal comprises many
Individual image acquisition units, described method includes:
Receive multiple image acquisition units and shoot the multichannel wide-angle video data obtained；
Described multichannel wide-angle video data are carried out synchronization process；
Each road wide-angle video data write memorizer after synchronizing, and launch wide-angle video data and realize distortion correction；
Carry out splicing fusion treatment to the overlapping region of the multichannel wide-angle video data after launching.
Method the most according to claim 1, it is characterised in that described will synchronize after the write of each road wide-angle video data
Memorizer, and launch wide-angle video data and realize distortion correction, including:
Each road wide-angle video data after synchronizing write and each road wide-angle video data memorizer one to one frame by frame
In, the memorizer of described correspondence is previously stored with the image coordinate letter for corresponding wide-angle video data carry out distortion correction
Breath；
While frame by frame by memorizer corresponding for the write of wide-angle video data, from corresponding memorizer, read image coordinate letter
Coordinate in breath, and from launching wide written into the wide-angle video data of this memorizer read out pixel corresponding to coordinate
Angle video data, it is achieved the distortion correction of wide-angle video data.
Method the most according to claim 2, it is characterised in that described will synchronize after each road wide-angle video data frame by frame
In write and each road wide-angle video data memorizer one to one, and frame by frame by wide-angle video data write correspondence
While memorizer, from the memorizer that wide-angle video data are corresponding, read the coordinate in image coordinate information, and from written into
The wide-angle video data of this memorizer read out the pixel that coordinate is corresponding, including:
For each road wide-angle video data after synchronizing, in the row field effective time of presently written frame, perform frame data
The operation of the memorizer that write is corresponding, in the row field blanking interval of presently written frame, reads coordinate, and has read according to coordinate
Pixel in the previous frame of the described presently written frame writing described memorizer, complete at the same time presently written frame write and
After the reading of described previous frame, next frame is write corresponding memorizer as presently written frame and substitutes the frame number being read
According to, and circulated the expansion of wide-angle video data successively.
Method the most according to claim 3, it is characterised in that described method also includes:
To the first frame of each road wide-angle video data after synchronizing, in the row field effective time of the first frame, perform by this
The operation of the memorizer that one frame write is corresponding；In the row field blanking interval of the first frame, do not perform read operation.
5. according to Claims 1 to 4 one of arbitrarily described method, it is characterised in that described to described multichannel wide-angle video number
According to carrying out synchronization process, including:
Described multichannel wide-angle video data are respectively written into caching, after postponing an appointment time threshold, will be many at synchronization
Road wide-angle video data read-out, it is achieved the synchronization of described multichannel wide-angle video data.
6. the real-time splicing apparatus of panoramic video, it is characterised in that being applied in camera terminal, described camera terminal comprises many
Individual image acquisition units, described device includes:
One input block, for receiving the multichannel wide-angle video data that multiplex image acquisition unit photographs obtains；
One lock unit, carries out synchronization process for the multichannel wide-angle video data receiving described input block；
One storage control unit, each road wide-angle video data write memorizer after described lock unit is synchronized；
One panoramic mosaic unit, is used for launching wide-angle video data and realizes distortion correction, and to the multichannel wide-angle video after launching
Data carry out the anastomosing and splicing of overlapping region and process.
Device the most according to claim 6, it is characterised in that:
Described storage control unit, writes and each road Radix Rumicis frame by frame specifically for each road wide-angle video data after synchronizing
In video data memorizer one to one, the memorizer of described correspondence is previously stored with for corresponding wide-angle video data
Carry out the image coordinate information of distortion correction；
Described panoramic mosaic unit, specifically for described storage control unit depositing wide-angle video data write correspondence frame by frame
While reservoir, from corresponding memorizer, read the coordinate in image coordinate information, and from the Radix Rumicis written into this memorizer
Video data reads out pixel corresponding to coordinate thus launches wide-angle video data, it is achieved the distortion school of wide-angle video data
Just.
Device the most according to claim 7, it is characterised in that:
Described storage control unit, specifically for for each road wide-angle video data after synchronizing, at the row of presently written frame
In the effective time of field, perform the operation of memorizer corresponding for frame data write；
Described panoramic mosaic unit, specifically in the row field blanking interval of presently written frame, reads coordinate, and according to coordinate
Read written into the pixel in the previous frame of the described presently written frame of described memorizer；
After the reading of the write and described previous frame that complete presently written frame, next frame is corresponding as the write of presently written frame
Memorizer substitute the frame data that have been read, and circulated the expansion of wide-angle video data successively.
Device the most according to claim 8, it is characterised in that:
Described storage control unit, specifically for the first frame to each road wide-angle video data after synchronizing, at the first frame
In the effective time of row field, perform the operation of memorizer corresponding for the write of this first frame；
Described panoramic mosaic unit, specifically for, in the row field blanking interval of the first frame, not performing read operation.
10. according to claim 6～9 one of arbitrarily described device, it is characterised in that described lock unit is wide to described multichannel
Angle video data carries out synchronization process, including:
Described multichannel wide-angle video data are respectively written into caching, after postponing an appointment time threshold, will be many at synchronization
Road wide-angle video data read-out, it is achieved the synchronization of described multichannel wide-angle video data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610619401.4A CN106210535A (en) | 2016-07-29 | 2016-07-29 | The real-time joining method of panoramic video and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610619401.4A CN106210535A (en) | 2016-07-29 | 2016-07-29 | The real-time joining method of panoramic video and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106210535A true CN106210535A (en) | 2016-12-07 |
Family
ID=57497356
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610619401.4A Pending CN106210535A (en) | 2016-07-29 | 2016-07-29 | The real-time joining method of panoramic video and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106210535A (en) |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106713755A (en) * | 2016-12-29 | 2017-05-24 | 北京疯景科技有限公司 | Method and apparatus for processing panoramic image |
| CN106911898A (en) * | 2017-03-31 | 2017-06-30 | 北京疯景科技有限公司 | Panorama shooting device |
| CN107333064A (en) * | 2017-07-24 | 2017-11-07 | 广东工业大学 | The joining method and system of a kind of spherical panorama video |
| CN108234933A (en) * | 2016-12-21 | 2018-06-29 | 上海杰图软件技术有限公司 | The method and system of real-time splicing panorama image based on multiway images signal processing |
| CN108234820A (en) * | 2016-12-21 | 2018-06-29 | 上海杰图软件技术有限公司 | The method and system of real-time splicing panorama image based on the processing of single channel picture signal |
| CN108282606A (en) * | 2017-01-05 | 2018-07-13 | 浙江舜宇智能光学技术有限公司 | Panorama mosaic method and its equipment |
| CN108449553A (en) * | 2018-03-23 | 2018-08-24 | 中国人民解放军92941部队 | Instructor in broadcasting's control system and signal processing method |
| CN108550106A (en) * | 2018-03-30 | 2018-09-18 | 深圳岚锋创视网络科技有限公司 | A kind of color calibration method of panoramic picture, device and electronic equipment |
| CN108616717A (en) * | 2016-12-12 | 2018-10-02 | 中国航空工业集团公司西安航空计算技术研究所 | A kind of real-time panoramic video splicing display device and its method |
| CN111127361A (en) * | 2019-12-24 | 2020-05-08 | 中山大学 | Perspective distortion correction method for video splicing |
| CN111726566A (en) * | 2019-03-21 | 2020-09-29 | 上海飞猿信息科技有限公司 | Implementation method for correcting splicing anti-shake in real time |
| CN113793382A (en) * | 2021-08-04 | 2021-12-14 | 北京旷视科技有限公司 | Video image splicing seam searching method and video image splicing method and device |
| CN113992857A (en) * | 2021-12-06 | 2022-01-28 | 北京拙河科技有限公司 | Image acquisition, identification and classified storage method and device based on billion-level pixels |
Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1696815A (en) * | 2004-05-14 | 2005-11-16 | 索尼株式会社 | Imaging apparatus, auto focus device, and auto focus method |
| CN101000461A (en) * | 2006-12-14 | 2007-07-18 | 上海杰图软件技术有限公司 | Method for generating stereoscopic panorama by fish eye image |
| CN101521745A (en) * | 2009-04-14 | 2009-09-02 | 王广生 | Multi-lens optical center superposing type omnibearing shooting device and panoramic shooting and retransmitting method |
| US20100251101A1 (en) * | 2009-03-31 | 2010-09-30 | Haussecker Horst W | Capture and Display of Digital Images Based on Related Metadata |
| CN103035005A (en) * | 2012-12-13 | 2013-04-10 | 广州致远电子股份有限公司 | Panorama parking calibration method and device, and automatic calibration method |
| CN103165104A (en) * | 2011-12-12 | 2013-06-19 | 宁波Gqy视讯股份有限公司 | Video signal synchronously displaying method of spliced screen |
| CN103702013A (en) * | 2013-11-28 | 2014-04-02 | 北京航空航天大学 | Frame synchronization method for multiple channels of real-time videos |
| CN103971352A (en) * | 2014-04-18 | 2014-08-06 | 华南理工大学 | Rapid image splicing method based on wide-angle lenses |
| CN104168426A (en) * | 2013-05-17 | 2014-11-26 | 华为技术有限公司 | Multipath video mosaic display synchronization method and device |
| CN204090039U (en) * | 2014-10-16 | 2015-01-07 | 北京十方慧通科技有限公司 | Integration large scene panoramic video monitoring device |
| CN104639911A (en) * | 2015-02-09 | 2015-05-20 | 浙江宇视科技有限公司 | Panoramic video stitching method and device |
| CN105187753A (en) * | 2015-08-06 | 2015-12-23 | 佛山六滴电子科技有限公司 | System for recording panoramic video |
| CN105245977A (en) * | 2015-10-10 | 2016-01-13 | 上海慧体网络科技有限公司 | Method for synchronous live broadcast through multiple cameras |
| CN105684415A (en) * | 2013-04-04 | 2016-06-15 | 大卫·安格莱利虚拟意念公司 | Spherical omnidirectional video-shooting system |
-
2016
- 2016-07-29 CN CN201610619401.4A patent/CN106210535A/en active Pending
Patent Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1696815A (en) * | 2004-05-14 | 2005-11-16 | 索尼株式会社 | Imaging apparatus, auto focus device, and auto focus method |
| CN101000461A (en) * | 2006-12-14 | 2007-07-18 | 上海杰图软件技术有限公司 | Method for generating stereoscopic panorama by fish eye image |
| US20100251101A1 (en) * | 2009-03-31 | 2010-09-30 | Haussecker Horst W | Capture and Display of Digital Images Based on Related Metadata |
| CN101521745A (en) * | 2009-04-14 | 2009-09-02 | 王广生 | Multi-lens optical center superposing type omnibearing shooting device and panoramic shooting and retransmitting method |
| CN103165104A (en) * | 2011-12-12 | 2013-06-19 | 宁波Gqy视讯股份有限公司 | Video signal synchronously displaying method of spliced screen |
| CN103035005A (en) * | 2012-12-13 | 2013-04-10 | 广州致远电子股份有限公司 | Panorama parking calibration method and device, and automatic calibration method |
| CN105684415A (en) * | 2013-04-04 | 2016-06-15 | 大卫·安格莱利虚拟意念公司 | Spherical omnidirectional video-shooting system |
| CN104168426A (en) * | 2013-05-17 | 2014-11-26 | 华为技术有限公司 | Multipath video mosaic display synchronization method and device |
| CN103702013A (en) * | 2013-11-28 | 2014-04-02 | 北京航空航天大学 | Frame synchronization method for multiple channels of real-time videos |
| CN103971352A (en) * | 2014-04-18 | 2014-08-06 | 华南理工大学 | Rapid image splicing method based on wide-angle lenses |
| CN204090039U (en) * | 2014-10-16 | 2015-01-07 | 北京十方慧通科技有限公司 | Integration large scene panoramic video monitoring device |
| CN104639911A (en) * | 2015-02-09 | 2015-05-20 | 浙江宇视科技有限公司 | Panoramic video stitching method and device |
| CN105187753A (en) * | 2015-08-06 | 2015-12-23 | 佛山六滴电子科技有限公司 | System for recording panoramic video |
| CN105245977A (en) * | 2015-10-10 | 2016-01-13 | 上海慧体网络科技有限公司 | Method for synchronous live broadcast through multiple cameras |
Cited By (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108616717A (en) * | 2016-12-12 | 2018-10-02 | 中国航空工业集团公司西安航空计算技术研究所 | A kind of real-time panoramic video splicing display device and its method |
| CN108234820A (en) * | 2016-12-21 | 2018-06-29 | 上海杰图软件技术有限公司 | The method and system of real-time splicing panorama image based on the processing of single channel picture signal |
| CN108234933A (en) * | 2016-12-21 | 2018-06-29 | 上海杰图软件技术有限公司 | The method and system of real-time splicing panorama image based on multiway images signal processing |
| CN106713755B (en) * | 2016-12-29 | 2020-02-18 | 北京疯景科技有限公司 | Panoramic image processing method and device |
| CN106713755A (en) * | 2016-12-29 | 2017-05-24 | 北京疯景科技有限公司 | Method and apparatus for processing panoramic image |
| CN108282606B (en) * | 2017-01-05 | 2020-09-15 | 浙江舜宇智能光学技术有限公司 | Panoramic stitching method and equipment |
| CN108282606A (en) * | 2017-01-05 | 2018-07-13 | 浙江舜宇智能光学技术有限公司 | Panorama mosaic method and its equipment |
| CN106911898A (en) * | 2017-03-31 | 2017-06-30 | 北京疯景科技有限公司 | Panorama shooting device |
| CN107333064A (en) * | 2017-07-24 | 2017-11-07 | 广东工业大学 | The joining method and system of a kind of spherical panorama video |
| CN107333064B (en) * | 2017-07-24 | 2020-11-13 | 广东工业大学 | Spherical panoramic video splicing method and system |
| CN108449553A (en) * | 2018-03-23 | 2018-08-24 | 中国人民解放军92941部队 | Instructor in broadcasting's control system and signal processing method |
| US11948228B2 (en) | 2018-03-30 | 2024-04-02 | Arashi Vision Inc. | Color correction method for panoramic image and electronic device |
| CN108550106A (en) * | 2018-03-30 | 2018-09-18 | 深圳岚锋创视网络科技有限公司 | A kind of color calibration method of panoramic picture, device and electronic equipment |
| CN108550106B (en) * | 2018-03-30 | 2021-06-01 | 影石创新科技股份有限公司 | Color correction method and device for panoramic image and electronic equipment |
| CN111726566A (en) * | 2019-03-21 | 2020-09-29 | 上海飞猿信息科技有限公司 | Implementation method for correcting splicing anti-shake in real time |
| CN111127361B (en) * | 2019-12-24 | 2023-07-28 | 中山大学 | Perspective distortion correction method for video stitching |
| CN111127361A (en) * | 2019-12-24 | 2020-05-08 | 中山大学 | Perspective distortion correction method for video splicing |
| CN113793382A (en) * | 2021-08-04 | 2021-12-14 | 北京旷视科技有限公司 | Video image splicing seam searching method and video image splicing method and device |
| CN113992857A (en) * | 2021-12-06 | 2022-01-28 | 北京拙河科技有限公司 | Image acquisition, identification and classified storage method and device based on billion-level pixels |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106210535A (en) | The real-time joining method of panoramic video and device | |
| US11074756B1 (en) | Camera arrangements with backlighting detection and methods of using same | |
| CN101689292B (en) | Banana codec | |
| CN106507094B (en) | Correct the method and device of panoramic video display view angle | |
| CN100369461C (en) | Image capture apparatus, image display method, and program | |
| CN106296589B (en) | Panoramic image processing method and device | |
| CN110636276B (en) | Video shooting method and device, storage medium and electronic equipment | |
| CN105554478A (en) | Video monitoring system and method | |
| CN107426491B (en) | Implementation method of 360-degree panoramic video | |
| CN107318008A (en) | Panoramic video player method and playing device | |
| CN113923354B (en) | Video processing method and device based on multi-frame images and virtual background shooting system | |
| CN102025922A (en) | Image matching system and method | |
| CN102868853A (en) | 360-degree non-blind area panorama video shooting device based on regular polyhedron | |
| KR101704362B1 (en) | System for real time making of panoramic video base on lookup table and Method for using the same | |
| CN116320364B (en) | Virtual reality shooting method and display method based on multi-layer display | |
| CN110278366A (en) | A kind of panoramic picture weakening method, terminal and computer readable storage medium | |
| CN112422882A (en) | Method and device for providing video source for video conference system | |
| CN105467741B (en) | A kind of panorama photographic method and terminal | |
| CN106534650A (en) | System and method for photographing panoramic image | |
| CN116193182A (en) | Screen projection method and system of AR content, electronic equipment and storage medium | |
| CN109218602A (en) | Image capture unit, image treatment method and electronic device | |
| CN115002442A (en) | Image display method and device, electronic equipment and storage medium | |
| WO2022045779A1 (en) | Restoration of the fov of images for stereoscopic rendering | |
| TWI517666B (en) | Portable device with single image capturing module to form sterio-image and the method thereof | |
| CN111988535A (en) | System and method for optically positioning fusion picture |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20170310 Address after: 100041 Beijing, Shijingshan District Xing Xing street, building 30, No. 17, building 4, No. 80 Applicant after: BEIJING FENGJING TECHNOLOGY Co.,Ltd. Applicant after: BEIJING XIAOMI MOBILE SOFTWARE Co.,Ltd. Address before: 100041 Beijing, Shijingshan District Xing Xing street, building 30, No. 17, building 4, No. 80 Applicant before: BEIJING FENGJING TECHNOLOGY Co.,Ltd. |
|
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20161207 |