CN106303495B - Synthetic method, device and its mobile terminal of panoramic stereo image - Google Patents
Synthetic method, device and its mobile terminal of panoramic stereo image Download PDFInfo
- Publication number
- CN106303495B CN106303495B CN201510373146.5A CN201510373146A CN106303495B CN 106303495 B CN106303495 B CN 106303495B CN 201510373146 A CN201510373146 A CN 201510373146A CN 106303495 B CN106303495 B CN 106303495B
- Authority
- CN
- China
- Prior art keywords
- picture
- stereo
- image
- multiframe
- speed
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
Abstract
The invention discloses the method, apparatus and its mobile terminal of a kind of panoramic stereo image synthesis, wherein, the method for panoramic stereo image synthesis includes：Image information is obtained, described image information is one group of multiframe consecutive image；From the multiframe consecutive image, the two field pictures for meeting predetermined frame period are extracted respectively, and the two field pictures extracted are subjected to stereo-picture synthesis respectively, to obtain the multiframe stereo-picture of one group of different visual angles.Panoramic stereo image is realized by the present invention to synthesize, and meets viewing demand of the user to panoramic stereo image.
Description
Technical field
The present invention relates to technical field of image processing, more particularly to a kind of synthetic method of panoramic stereo image, device and
Its mobile terminal.
Background technology
Image is caused figure or image by the actual picture of the imaging devices such as camera, video camera seizure.
With requirement more and more higher of the people for image, it is often desirable that see panoramic picture or stereo-picture, panorama
Image refers to that image can reach and meets eyes normally effective visual angle (about horizontal 90-degree, vertical 70 degree) or including regarding more than eyes
More than angle (about horizontal 180 degree, vertical 90 degree), or even the image gone out captured by 360 degree of complete angulars field of view, stereo-picture are
Refer to the content that left and right eyes viewing is represented with two pictures with alternate position spike, allow observer to produce band using right and left eyes parallax
There is the image of depth preception effect.
And although as the development of imaging device, the camera lens with big visual angle, such as wide-angle lens, fish eye lens etc. obtain
Extensive use, it is possible to achieve the shooting at super large visual angle, but can not still panoramic picture be shot, it is necessary to the side synthesized using image
Formula is formed.
Due to the limitation of existing three-dimensional display apparatus, user can not easily experience images What You See Is What You Get by two dimension
Effect, cause two dimensional image synthetic stereo image technology be not widely used.But with virtual reality, enhancing
The maturation and popularization, people of reality and naked eye three-dimensional technology can greatly increase to the demand of two dimensional image synthetic stereo image.
Inventor has found that not a kind of effective image composing technique, can be formed complete in the prior art under study for action
The image of scape and solid, to meet the needs of user.
The content of the invention
The present invention provides a kind of panoramic stereo image synthetic method, can synthesize the stereo-picture of different visual angles, to realize
Panoramic stereo image, meet user's request.In a first aspect, the present invention provides a kind of synthetic method of panoramic stereo image, bag
Include：Image information is obtained, described image information is one group of multiframe consecutive image；
From the multiframe consecutive image, the two field pictures for meeting predetermined frame period, described image packet are extracted respectively
Move angle and speed containing each two field picture, the angle and speed record are in the File header information of each two field picture；
The two field pictures of extraction are subjected to stereo-picture synthesis respectively, it is three-dimensional to obtain the multiframe of one group of different visual angles
Image, wherein, the anglec of rotation and speed recorded in the File header information by each two field picture is described predetermined to determine
Frame period.
In second aspect, the present invention also provides a kind of panoramic stereo image synthesizer, it is characterised in that including：
Acquiring unit, for obtaining image information, described image information is one group of multiframe consecutive image, the acquiring unit
Move angle and speed of the described image packet of acquisition containing each two field picture, the angle and speed record are in each frame figure
In the File header information of picture；
Extracting unit, for from the multiframe consecutive image, extracting the two field pictures for meeting predetermined frame period respectively, its
In, the anglec of rotation and speed that are recorded in the File header information by each two field picture determine the predetermined frame period；
Synthesis unit, it is different to obtain one group for the two field pictures of extraction to be carried out into stereo-picture synthesis respectively
The multiframe stereo-picture at visual angle.
In the third aspect, the present invention provides a kind of mobile terminal again, including：
Central processing unit, for obtaining image information, described image information is one group of multiframe consecutive image, and described image is believed
Breath includes the File header information of the move angle and speed of each two field picture, the angle and speed record in each two field picture
In；From the multiframe consecutive image, the two field pictures for meeting predetermined frame period are extracted respectively, wherein, pass through each frame
The anglec of rotation and speed recorded in the File header information of image determines the predetermined frame period, and respectively by the institute of extraction
State two field pictures and carry out stereo-picture synthesis, to obtain the multiframe stereo-picture of one group of different visual angles；
Display screen, for showing the multiframe stereo-picture.
In embodiments of the present invention, by obtaining one group of multiframe consecutive image；And from the multiframe consecutive image respectively
Extract and meet that the two field pictures of predetermined frame period carry out stereo-picture synthesis, to obtain the multiframe stereogram of one group of different visual angles
Picture, solve in the prior art without a kind of effective image composing technique, filled up the blank of prior art.Realize panorama
Stereo-picture synthesizes, and meets viewing demand of the user to panoramic stereo image.
Brief description of the drawings
Fig. 1 is a kind of synthetic method schematic flow sheet of panoramic stereo image of the embodiment of the present invention；
Fig. 2 is the follow shot schematic top plan view of the embodiment of the present invention in the horizontal direction；
Fig. 3 is circumference follow shot schematic top plan view of the embodiment of the present invention using reference object as the center of circle；
Fig. 4 is the embodiment of the present invention according to position of human eye presentation of information multiframe stereo-picture flow schematic diagram；
Fig. 5 is that the embodiment of the present invention shows multiframe stereo-picture flow schematic diagram according to rotation angle information；
Fig. 6 is a kind of panoramic stereo image synthesizer schematic diagram of the embodiment of the present invention；
Fig. 7 is a kind of mobile terminal schematic diagram of the embodiment of the present invention.
Embodiment
The present invention is described in detail with reference to the accompanying drawings and examples.
If it should be noted that not conflicting, each feature in the embodiment of the present invention and embodiment can be tied mutually
Close, within protection scope of the present invention.In addition, though functional module division is carried out in schematic device, in flow
Logical order is shown in figure, but in some cases, can be with different from the Module Division in device, or in flow chart
Order performs shown or described step.
The synthetic method of the panoramic stereo image of the embodiment of the present invention is briefly described below.In the embodiment of the present invention
In, one group of multiframe consecutive image is obtained by high speed continuous shooting or video capture, extracts and meets in advance respectively from multiframe consecutive image
The two field pictures of frame interval.Wherein, multigroup two field pictures for meeting predetermined frame period in multiframe consecutive image be present, such as,
If predetermined frame is one group at intervals of 3, the 1st frames and the 4th two field picture, the 2nd frame and the 5th two field picture are one group, and the rest may be inferred.Will
Meet that the two field pictures of predetermined frame period carry out stereo-picture synthesis respectively in multiframe consecutive image, regarded so as to obtain one group of difference
The multiframe stereo-picture at angle.
In embodiments of the present invention, in order to determine frame period, such as, can be the anglec of rotation taken pictures or during recorded video
It is saved in translational speed in the File header information of each photo or each frame video, then passes through each photo or each
The anglec of rotation and speed that are recorded in frame video file header determines frame period.In embodiments of the present invention, speed is bigger
The frame period that should be taken is smaller；The frame period that angle is bigger to be taken is smaller；Speed is bigger and the bigger frame period that should be taken of angle
It is smaller.Meanwhile panoramic stereo image for convenience of user to watch, in the stereo-picture of viewing synthesis, watched according to beholder
Stereo-picture is presented according to the anglec of rotation of screen in the visual angle of screen, so as to realize that panoramic stereo image is shown.
The embodiment of the present invention is further elaborated below in conjunction with the accompanying drawings.
Fig. 1 is a kind of synthetic method schematic flow sheet of panoramic stereo image of the embodiment of the present invention, as shown in figure 1, this hair
The method of bright embodiment, comprises the following steps：
S11, image information is obtained, described image information is one group of multiframe consecutive image；
In embodiments of the present invention, for the situation of movement of each frame in accurate recording multiple image information, can record
The move angle and speed of each two field picture, therefore, image information can include the move angle and speed of each frame, the angle
Degree and speed record are in the File header information of each two field picture.
In embodiments of the present invention, the move angle and speed that image information includes can be at the uniform velocity to move, and also may be used
To be speed change movement, such as Fig. 2, Fig. 3, which are shown, overlooks shooting process schematic diagram, wherein, Fig. 2 is follow shot in the horizontal direction
Schematic top plan view, in fig. 2 photographic system face photographed scene from left to right (horizontal direction) do at the uniform velocity or variable speed translation motion,
Fig. 3 is the circumference follow shot schematic top plan view using reference object as the center of circle, and photographic system is made even around shooting object in figure 3
Speed or speed change circular motion.In moving process, the quick continuous shooting of photographic system or video record, so as to obtain one group of continuous multiple frames
Image, such as, Img_1, Img_2 ... .Img_N1, Img_N1+1 ....
One group of multiframe consecutive image is obtained, following two modes can be used：
First way：If user starts handheld device after acquisition picture frame, such as mobile phone, at the uniform velocity even angle is always maintained at
The operation of degree, after waiting user to operate certain time (1-2 seconds), the shifting of handheld device can be obtained by the way of delay is shot
Dynamic angle and acceleration, and speed can be obtained by acceleration, determined to shoot the number of photo in the unit interval with these parameters
The quantity of amount or video frame image：When handheld device angle and bigger speed, the more picture frame of shooting is more preferable to obtain
Stereo-picture；When handheld device angle and smaller speed, less picture frame is obtained, to reduce duplicate data treating capacity.
In embodiments of the present invention, realize that situation judges whether handheld device is uniform motion by following two:First
Kind is to utilize acceleration transducer, and combines gravity sensor to judge, if acceleration transducer is displayed without acceleration, but
It is that gravity sensor shows movement, illustrates to be exactly uniform motion；Second is exactly the image obtained using separated in time
Data, compare the difference of two adjacent images data, then judge whether mobile phone is moving with uniform velocity according to the size of difference.
Even angle can obtain the angle of gyroscope by separated in time, if most of angle is the same, just illustrate that mobile phone is even
Angle.
The second way：, can be with the setting unit time except by setup module before automatic continuous shooting or recorded video
Outside the number parameter of continuous shooting image, the parameter such as mobile phone angle and mobile phone acceleration can also be concurrently set, so as to realize unit field
The quantity of image of shooting or the quantity of picture frame are equal in scape angle, after ensureing follow-up compound stereoscopic photo, are checked vertical
During body photo, the uniformity of stereoscopic photograph picture effect.Further, since the quantity of the amount of images or picture frame in unit angle
It is equal, can avoids in a certain angle, due to shooting or recorded video overlong time, causes data volume larger, so as to
The problem of causing stereo-picture synthesis processing time long.
S13, from the multiframe consecutive image, the two field pictures for meeting predetermined frame period are extracted respectively, and respectively by institute
The two field pictures of extraction carry out stereo-picture synthesis, to obtain the multiframe stereo-picture of one group of different visual angles.
In embodiments of the present invention, for synthetic stereo image, satisfaction can be extracted from the multiframe consecutive image of acquisition
The two field pictures of predetermined frame period, such as, Img_i and Img_i+n are as the left and right figure for having certain parallax, for compound stereoscopic
Image, wherein, for i since 1, i is natural number, and n is the space-number of setting, and this space-number can be according to following two ways come really
It is fixed：
(1) if user start obtain picture frame after handheld device be always maintained at the uniform velocity even angle operation (i.e. the first
Mode), so that it may with accordance with formula：Frame period=(totalframes/(angle * speed))/Ω determines the interval of extraction frame number, wherein,
The totalframes is the quantity of multiframe consecutive image in described image information, and the Ω is the frame period empirical value of test gained.
This interval holding is constant, if meet in multiframe consecutive image this frame period two field pictures can combination of two, be used for
Synthetic stereo image.
(2) if with the above-mentioned second way obtain picture frame, can with the 1st picture frame respectively with the 2nd picture frame
To N picture frame synthetic stereo images, using the combination of composograph optimal quality as the interval for extracting frame, this interval holding is not
Become, such as, it is assumed that the stereo image quality that the 1st picture frame synthesizes with the 10th picture frame is optimal, then frame period is 9, moreover, more
Also the two field pictures for synthetic stereo image are determined between other frames in frame consecutive image by this frame period.
In embodiments of the present invention, by the two field pictures of the frame period for meeting aforesaid way and determining in multiframe consecutive image
Stereo-picture synthesis is carried out, such as, by photo Img_i and Img_i+n compound stereoscopic figure, Img_i+1 and Img_i+n+1 synthesis are vertical
Body image, the rest may be inferred, by all two field pictures synthetic stereo images for meeting frame period, is so obtained with one group of difference
The multiframe stereo-picture at visual angle for example, Img3d_1, Img3d_2 ... Img3d_N.
Alternatively, in embodiments of the present invention, in addition to：
S15, motion compensation is made in vertical direction to the stereo-picture.
In embodiments of the present invention, obtain in image process, due to unstable, the meeting of vertical direction (Y direction) be present
Moved up and down so that acquired multiple image (Img_1, Img_2 ... .Img_N1, Img_N1+1 ...) produces, stereo-picture closes
Image mosaic can also introduce moving up and down for image during.Therefore, can be to above-mentioned in the stereo-picture of display synthesis
Multiframe stereo-picture vertical direction (Y direction) makees motion compensation, so as to which image is trembled when eliminating continuous presentation multiframe stereo-picture
The problem of dynamic, the algorithm of existing image mosaic can be specifically used, such as, panaroma algorithms adjust adjacent stereo-picture
Pixel position, so as to eliminate the technological deficiency of flating.
Alternatively, in embodiments of the present invention, in addition to：
S17, show the multiframe stereo-picture.
In embodiments of the present invention, can point two ways show multiframe stereo-picture, be according to position of human eye respectively
Or rotation angle information determines which frame stereo-picture is shown in multiframe stereo-picture.
In embodiments of the present invention, Fig. 4 is according to position of human eye presentation of information multiframe stereo-picture flow schematic diagram, is such as schemed
Shown in 4, following steps are specifically included：
S41, obtain positional information of the human eye relative to the display screen for showing the multiframe stereo-picture.
In embodiments of the present invention, tracked object human eye positional information is obtained, and is that quilt is shot by camera
Human eye is tracked, obtains the positional information of the relative display screen for showing the multiframe stereo-picture of tracked object eye.Wherein,
When multiple users before display screen be present, suitable human eye is selected in the diverse location that can be tracked from camera, such as,
Left, center, right position before display screen is respectively present different human eyes, then can be according to advance setting rule, selection
The human eye in centre position is as the position of human eye for determining display multiframe stereo-picture before display screen.
S42, the specific stereo-picture for determining to show in the multiframe stereo-picture according to the position of human eye information.
In embodiments of the present invention, it can be calculated according to the position of human eye information and any pictures shown；Such as：If see
The point midway of two lines of the person of examining is among display screen, then it is shown that intermediate time shooting in multiframe stereo-picture
Stereo-picture synthesized by image.The marquis when position of human eye is located at the display screen left side, shows and is clapped earlier than intermediate time
The stereo-picture synthesized by picture taken the photograph, the marquis when position of human eye is on the right of Central steering display screen, in showing
Between stereo-picture synthesized by the picture that shoots after the moment.
In embodiments of the present invention, Fig. 5 is to show multiframe stereo-picture flow schematic diagram according to rotation angle information, is such as schemed
Shown in 5, following steps are specifically included：
S51, obtain the rotation angle information for the display screen for showing the multiframe stereo-picture
In embodiments of the present invention, the display screen rotation angle information for showing the multiframe stereo-picture is obtained, can be with
The angle information that display screen rotates is obtained by the time of gyro sensor X-axis angular speed and rotation, wherein it is possible to open
Begin to show that stereo-picture is original state, calculate display screen further according to the angular velocity information of gyroscope and turned over around X-direction
Angle and direction.
S52, the specific stereo-picture for determining to show in the multiframe stereo-picture according to the rotation angle information.
In embodiments of the present invention, it can read the stereo-picture in multiple image according to rotation angle information and show
Show.Such as if acquired image from left to right direction is shot, the stereo-picture bag hand of captured image synthesis
Img3D_1, Img3D_2, Img3D_3, Img3D_4 ... Img3D_N N pictures, Img3D_1 are captured by leftmost position
Image synthesized by stereo-picture, Img3D_N be in the stereo-picture synthesized by the image captured by farthest right position.First
N/2 are shown as during beginning state, that is to say the intermediate time image of shooting process.If rotated clockwise, show than in
Between the picture that shoots earlier of moment, the angle turned over is bigger, shows the time of shooting more early picture.If rotated counterclockwise,
The picture of shooting more late than intermediate time is shown, the angle turned over is bigger, shows the time of shooting more late picture.In order to institute
Aobvious speed adapts to human eye requirement, it is impossible to which brush screen is too fast, if the number of picture is more, can make point of angular speed classification
Analysis, if angular speed is more slowly 1 grade, every all shows.If speed is 2 grades, every 1 display, if angular speed is more
Fast is 3 grades, every 2 displays.
It should be noted that in embodiments of the present invention, when showing multiframe stereo-picture, if exist simultaneously human eye and
Rotation angle information, priority can be set to avoid conflicting, such as, rotation angle information priority is believed higher than position of human eye
Breath, then can determine the specific stereo-picture shown in multiframe stereo-picture according to rotation angle information.
It should be noted that in embodiments of the present invention, using two field pictures synthetic stereo image, movement compensating algorithm with
And tracing of human eye algorithm can use algorithm of the prior art, the present invention is not construed as limiting.
In embodiments of the present invention, by obtaining one group of multiframe consecutive image；And from multiframe consecutive image, extract respectively
Meet that the two field pictures of predetermined frame period carry out stereo-picture synthesis, to obtain the multiframe stereo-picture of one group of different visual angles, solution
Determine in the prior art without a kind of effective image composing technique, filled up the blank of prior art.Realize full-view stereo
Image synthesizes, and meets viewing demand of the user to panoramic stereo image, moreover, by motion compensation to eliminate presentation stereogram
As when flating, meanwhile, the display of panoramic stereo image can be carried out according to position of human eye or rotation angle information, enter one
Step improves Consumer's Experience.
Fig. 6 is a kind of panoramic stereo image synthesizer schematic diagram of the embodiment of the present invention, as shown in fig. 6, including：
Acquiring unit 61, for obtaining image information, described image information is one group of multiframe consecutive image；
Extracting unit 62, the two field pictures of predetermined frame period are met for being extracted respectively from the multiframe consecutive image,
Synthesis unit 63, for the two field pictures of extraction to be carried out into stereo-picture synthesis respectively, to obtain one group not
With the multiframe stereo-picture at visual angle.
In embodiments of the present invention, move angle and speed of the described image packet containing each two field picture, the angle
With speed record in the File header information of each two field picture.
In embodiments of the present invention, extracting unit 63, it is specifically used for：Extract and meet in advance from the multiframe consecutive image of acquisition
The two field pictures of frame interval, wherein, predetermined frame period determines according to following two modes：
(1) if user start obtain picture frame after handheld device be always maintained at the uniform velocity even angle operation (i.e. the first
Mode), so that it may with accordance with formula：Frame period=(totalframes/(angle * speed))/Ω determines the interval of extraction frame number, wherein,
The totalframes is the quantity of multiframe consecutive image in described image information, and the Ω is the frame period empirical value of test gained.
This interval holding is constant, as long as meeting that the two field pictures of this frame period can group two-by-two in multiframe consecutive image
Close, for synthetic stereo image.
(2) N frame synthetic stereo images can be arrived with 2 respectively with the 1st two field picture, using composograph optimal quality combination as
The interval of frame is extracted, this interval holding is constant, such as, it is assumed that the stereo image quality that the 1st two field picture synthesizes with the 10th two field picture
Optimal, then frame period is 9, moreover, also vertical for synthesizing by the determination of this frame period between other frames in multiframe consecutive image
The two field pictures of body image.
In embodiments of the present invention, described device, in addition to：
Motion compensation units 64, for making motion compensation in vertical direction to the stereo-picture, institute is presented to eliminate
State flating during stereo-picture.
In embodiments of the present invention, it can produce and move up and down during acquisition multiple image, moreover, being synthesized in stereo-picture
During, image mosaic can also introduce moving up and down for image.Therefore, can be to above-mentioned in the stereo-picture of display synthesis
Multiframe stereo-picture vertical direction (Y direction) makees motion compensation, flating when multiframe stereo-picture is continuously presented to eliminate.
In embodiments of the present invention, described device, in addition to：
Display unit 65, for showing the multiframe stereo-picture.
In embodiments of the present invention, the multiframe stereo-picture of the different visual angles synthesized for convenience of user to watch, realize complete
Scape stereo-picture viewing effect, user can be presented to by display unit 65.
The stereo-picture under different visual angles is presented to user for convenience, in embodiments of the present invention, described device, also wraps
Include：
Position of human eye acquiring unit 66, for obtaining human eye relative to the display screen for showing the multiframe stereo-picture
Positional information, and/or,
Angle information acquiring unit 67, for obtaining the anglec of rotation letter for the display screen for showing the multiframe stereo-picture
Breath,
Display image determining unit 68, for according to the position of human eye information or the rotation angle information, determining institute
State the specific stereo-picture shown in multiframe stereo-picture.
In embodiments of the present invention, position of human eye acquiring unit 66 can shoot tracking human eye by camera, meanwhile, profit
Positional information of the human eye relative to display screen is determined with bore hole track algorithm.Moreover, multiple use be present before display screen
During family, suitable human eye is selected in the diverse location that can be tracked from camera, such as, the left, center, right before display screen
Position is respectively present different human eyes, then according to advance setting rule, can select the people in centre position before display screen
Eye is as the position of human eye for determining display multiframe stereo-picture.
In embodiments of the present invention, angle information acquiring unit 67 can be obtained by the gyroscope inductor on display screen
Take the rotation angle information of display screen.
In embodiments of the present invention, position of human eye acquiring unit 66 and angle information acquiring unit 67 can exist simultaneously,
Wherein any one unit can also be only existed, when both simultaneously in the presence of, for avoid display image determining unit 68 it is determined that
Issuable conflict when showing the specific stereo-picture in the multiframe stereo-picture, priority can be set, such as, preferentially
Determined according to position of human eye, it is of course also possible to preferentially be determined according to the anglec of rotation.
It should be noted that the information in panoramic stereo image synthesizer in the embodiment of the present invention between unit
The contents such as interaction, implementation procedure, due to being based on same design with the inventive method embodiment, the particular content in embodiment of the method
It is equally applicable.Unit in the embodiment of the present invention can be used as single hardware or software to realize, and can basis
Single hardware or software is needed to use to realize the combination of the function of unit.
It should be noted that in embodiments of the present invention, using two field pictures synthetic stereo image, movement compensating algorithm with
And tracing of human eye algorithm can use algorithm of the prior art, the present invention is not construed as limiting.
In embodiments of the present invention, by obtaining one group of multiframe consecutive image；And from multiframe consecutive image, extract respectively
Meet that the two field pictures of predetermined frame period carry out stereo-picture synthesis, it is real to obtain the multiframe stereo-picture of one group of different visual angles
Panoramic stereo image synthesis is showed, has met viewing demand of the user to panoramic stereo image, moreover, by motion compensation to disappear
Flating during except presentation stereo-picture, meanwhile, full-view stereo figure can be carried out according to position of human eye or rotation angle information
The display of picture, further improves Consumer's Experience.
Fig. 7 is a kind of mobile terminal schematic diagram of the embodiment of the present invention, including：Central processing unit 71 and display screen 73, its
In：
Central processing unit 71, for obtaining image information, described image information is one group of multiframe consecutive image；Connect from multiframe
In continuous image, the two field pictures for meeting predetermined frame period are extracted respectively, and respectively found the two field pictures of extraction
Body image synthesizes, to obtain the multiframe stereo-picture of one group of different visual angles；
Display screen 73, for showing the multiframe stereo-picture.
In the embodiment of the present invention, the aforesaid operations performed by processor can be stored in memory in the form of one section of program
In, when needing to perform aforesaid operations, this section of program is called in into computing device processing.
In all embodiments of the invention, mobile terminal can include such as PDA, tablet personal computer, MP4, smart mobile phone, electricity
The Portable mobile electronic devices such as paper book.
In embodiments of the present invention, by obtaining one group of multiframe consecutive image；And from multiframe consecutive image, extract respectively
Meet that the two field pictures of predetermined frame period carry out stereo-picture synthesis, it is real to obtain the multiframe stereo-picture of one group of different visual angles
Panoramic stereo image synthesis is showed, has met viewing demand of the user to panoramic stereo image, moreover, by motion compensation to disappear
Flating during except presentation stereo-picture, meanwhile, full-view stereo figure can be carried out according to position of human eye or rotation angle information
The display of picture, further improves Consumer's Experience.
Embodiments of the present invention are the foregoing is only, are not intended to limit the scope of the invention, it is every to utilize this
The equivalent structure or equivalent flow conversion that description of the invention and accompanying drawing content are made, or directly or indirectly it is used in other correlations
Technical field, it is included within the scope of the present invention.
Claims (17)
- A kind of 1. synthetic method of panoramic stereo image, it is characterised in that including：Image information is obtained, described image information is one group of multiframe consecutive image, and described image packet is containing each two field picture Move angle and speed, the angle and speed record are in the File header information of each two field picture；From the multiframe consecutive image, the two field pictures for meeting predetermined frame period are extracted respectively, wherein, pass through each frame The anglec of rotation and speed recorded in the File header information of image determines the predetermined frame period；The two field pictures of extraction are subjected to stereo-picture synthesis respectively, to obtain the multiframe stereogram of one group of different visual angles Picture；Wherein, the move angle and speed are bigger, the consecutive image quantity in the image information that shooting obtains in the unit interval More, the move angle and speed are smaller, and the consecutive image quantity in the image information that shooting obtains in the unit interval is fewer； Or the quantity that the interior shooting of unit scene angle obtains picture frame is equal.
- 2. according to the method for claim 1, it is characterised in that the move angle and speed included in described image information is equal At the uniform velocity to move, then the predetermined frame period is inversely proportional with the angle and speed.
- 3. according to the method for claim 2, it is characterised in that the predetermined frame period=(totalframes/(angle * speed Degree))/Ω, wherein, the totalframes is the quantity of multiframe consecutive image in described image information, and the Ω is test gained Frame period empirical value.
- 4. according to the method for claim 1, it is characterised in that the move angle and speed included in described image information be Speed change moves；The predetermined frame is at intervals of the first picture frame in the multiframe consecutive image respectively with removing institute in the multiframe consecutive image After stating other picture frame synthetic stereo images outside the first picture frame, image corresponding to the stereo-picture of optimal quality is selected Frame period between frame and described first image frame.
- 5. according to the method any one of claim 2-4, it is characterised in that it is described at the uniform velocity move or speed change movement be edge The movement of horizontal direction or the circumference movement using reference object as the center of circle.
- 6. according to the method described in claim any one of 1-4, it is characterised in that also include：Motion compensation is made in vertical direction to the stereo-picture, to eliminate the flating when stereo-picture is presented.
- 7. according to the method for claim 6, it is characterised in that also include：Show the multiframe stereo-picture.
- 8. according to the method for claim 7, it is characterised in that the display multiframe stereo-picture, specifically include：Obtain positional information of the human eye relative to the display screen for showing the multiframe stereo-picture；According to the position of human eye information, the specific stereo-picture shown in the multiframe stereo-picture is determined.
- 9. according to the method for claim 7, it is characterised in that the display multiframe stereo-picture, specifically include：Obtain the rotation angle information for the display screen for showing the multiframe stereo-picture；According to the rotation angle information, the specific stereo-picture shown in the multiframe stereo-picture is determined.
- A kind of 10. panoramic stereo image synthesizer, it is characterised in that including：Acquiring unit, for obtaining image information, described image information is one group of multiframe consecutive image, and the acquiring unit obtains Move angle and speed of the described image packet containing each two field picture, the angle and speed record are in each two field picture In File header information；Extracting unit, for from the multiframe consecutive image, extracting the two field pictures for meeting predetermined frame period respectively, wherein, The anglec of rotation and speed that are recorded in File header information by each two field picture determines the predetermined frame period；Synthesis unit, for the two field pictures of extraction to be carried out into stereo-picture synthesis respectively, to obtain one group of different visual angles Multiframe stereo-picture.
- 11. device according to claim 10, it is characterised in that wrapped in the described image information that the acquiring unit obtains The move angle and speed contained is at the uniform velocity to move, then the predetermined frame period is inversely proportional with the angle and speed.
- 12. device according to claim 11, it is characterised in that predetermined frame period described in the extracting unit=(total Frame number/(angle * speed))/Ω, wherein, the totalframes be described image information in multiframe consecutive image quantity, the Ω For the frame period empirical value of test gained.
- 13. device according to claim 10, it is characterised in that wrapped in the described image information that the acquiring unit obtains The move angle and speed contained moves for speed change；The predetermined frame is at intervals of the first picture frame in the multiframe consecutive image respectively with removing institute in the multiframe consecutive image After stating other picture frame synthetic stereo images outside the first picture frame, image corresponding to the stereo-picture of optimal quality is selected Frame period between frame and described first image frame.
- 14. according to the device described in claim any one of 10-13, it is characterised in that also include：Motion compensation units, for making motion compensation in vertical direction to the stereo-picture, the solid is presented to eliminate Flating during image.
- 15. device according to claim 14, it is characterised in that also include：Display unit, for showing the multiframe stereo-picture.
- 16. device according to claim 15, it is characterised in that described device also includes：Position of human eye acquiring unit, believe for obtaining human eye relative to the position for the display screen for showing the multiframe stereo-picture Breath, and/orAngle information acquiring unit, for obtaining the rotation angle information for the display screen for showing the multiframe stereo-picture,Display image determining unit, for according to the position of human eye information or the rotation angle information, determining the multiframe The specific stereo-picture shown in stereo-picture.
- A kind of 17. mobile terminal, it is characterised in that including：Central processing unit, for obtaining image information, described image information is one group of multiframe consecutive image, described image packet Move angle and speed containing each two field picture, the angle and speed record are in the File header information of each two field picture；From In the multiframe consecutive image, the two field pictures for meeting predetermined frame period are extracted respectively, wherein, pass through each two field picture The anglec of rotation and speed recorded in File header information determines the predetermined frame period, and respectively by two frame of extraction Image carries out stereo-picture synthesis, to obtain the multiframe stereo-picture of one group of different visual angles；Display screen, for showing the multiframe stereo-picture.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510373146.5A CN106303495B (en) | 2015-06-30 | 2015-06-30 | Synthetic method, device and its mobile terminal of panoramic stereo image |
| TW104137748A TWI584050B (en) | 2015-06-30 | 2015-11-16 | Panoramic stereoscopic image synthesis method, apparatus and mobile terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510373146.5A CN106303495B (en) | 2015-06-30 | 2015-06-30 | Synthetic method, device and its mobile terminal of panoramic stereo image |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106303495A CN106303495A (en) | 2017-01-04 |
| CN106303495B true CN106303495B (en) | 2018-01-16 |
Family
ID=57651118
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510373146.5A Active CN106303495B (en) | 2015-06-30 | 2015-06-30 | Synthetic method, device and its mobile terminal of panoramic stereo image |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN106303495B (en) |
| TW (1) | TWI584050B (en) |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106851251A (en) * | 2017-02-28 | 2017-06-13 | 宇龙计算机通信科技(深圳)有限公司 | Three-D imaging method and three-dimensional imaging terminal |
| CN109672776B (en) | 2017-10-16 | 2021-07-09 | 华为技术有限公司 | Method and terminal for displaying dynamic image |
| CN109104576A (en) * | 2018-10-29 | 2018-12-28 | 努比亚技术有限公司 | A kind of panorama shooting method, wearable device and computer readable storage medium |
| TWI700000B (en) * | 2019-01-29 | 2020-07-21 | 威盛電子股份有限公司 | Image stabilization method and apparatus for panoramic video, and method for evaluating image stabilization algorithm |
| CN110769159B (en) * | 2019-11-19 | 2021-07-09 | 海南车智易通信息技术有限公司 | Photographing method, photographing device and panoramic photographing system |
| CN114697758B (en) * | 2020-12-30 | 2023-03-31 | 北京金山云网络技术有限公司 | Video processing method and device and electronic equipment |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102905079A (en) * | 2012-10-16 | 2013-01-30 | 北京小米科技有限责任公司 | Method, device and mobile terminal for panorama shooting |
| CN103168315A (en) * | 2010-09-09 | 2013-06-19 | 数字光学欧洲有限公司 | Stereoscopic (3D) panorama creation on handheld device |
| CN104660897A (en) * | 2013-11-20 | 2015-05-27 | 浪潮乐金数字移动通信有限公司 | Acquisition method of 360-degree panoramic image based on mobile terminal |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120019613A1 (en) * | 2009-12-11 | 2012-01-26 | Tessera Technologies Ireland Limited | Dynamically Variable Stereo Base for (3D) Panorama Creation on Handheld Device |
| JP2012068380A (en) * | 2010-09-22 | 2012-04-05 | Sony Corp | Image processor, imaging apparatus, image processing method, and program |
| JP2013034081A (en) * | 2011-08-02 | 2013-02-14 | Sony Corp | Image processing device, control method therefor, and program |
-
2015
- 2015-06-30 CN CN201510373146.5A patent/CN106303495B/en active Active
- 2015-11-16 TW TW104137748A patent/TWI584050B/en not_active IP Right Cessation
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103168315A (en) * | 2010-09-09 | 2013-06-19 | 数字光学欧洲有限公司 | Stereoscopic (3D) panorama creation on handheld device |
| CN102905079A (en) * | 2012-10-16 | 2013-01-30 | 北京小米科技有限责任公司 | Method, device and mobile terminal for panorama shooting |
| CN104660897A (en) * | 2013-11-20 | 2015-05-27 | 浪潮乐金数字移动通信有限公司 | Acquisition method of 360-degree panoramic image based on mobile terminal |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106303495A (en) | 2017-01-04 |
| TWI584050B (en) | 2017-05-21 |
| TW201701051A (en) | 2017-01-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106303495B (en) | Synthetic method, device and its mobile terminal of panoramic stereo image | |
| CN109615703B (en) | Augmented reality image display method, device and equipment | |
| JP5659305B2 (en) | Image generating apparatus and image generating method | |
| JP5659304B2 (en) | Image generating apparatus and image generating method | |
| US9781341B2 (en) | Image processing system, information processing device, information storage device, and image processing method | |
| JP5769813B2 (en) | Image generating apparatus and image generating method | |
| JP5865388B2 (en) | Image generating apparatus and image generating method | |
| CN106507094B (en) | Correct the method and device of panoramic video display view angle | |
| US20160295108A1 (en) | System and method for panoramic imaging | |
| US10277890B2 (en) | System and method for capturing and viewing panoramic images having motion parallax depth perception without image stitching | |
| CN106296589B (en) | Panoramic image processing method and device | |
| US20130335521A1 (en) | Method of Synthesizing Stereo 3D Panorama Image and Related 3D Camera | |
| US11538138B2 (en) | Methods and apparatus for applying motion blur to overcaptured content | |
| CN102972035A (en) | Stereoscopic panorama image synthesizing device and compound-eye imaging device as well as stereoscopic panorama image synthesizing method | |
| WO2012070636A1 (en) | Image processing device, image processing method, and image processing program | |
| US20150326847A1 (en) | Method and system for capturing a 3d image using single camera | |
| US20180192031A1 (en) | Virtual Reality Viewing System | |
| CN110636276A (en) | Video shooting method and device, storage medium and electronic equipment | |
| JP2018033107A (en) | Video distribution device and distribution method | |
| US10587856B1 (en) | Spherical visual content transitions | |
| CN114071009B (en) | Shooting method and equipment | |
| CN113747044A (en) | Panoramic shooting method and device | |
| CN106681674A (en) | Display control method and system of virtual reality display | |
| JP2012220603A (en) | Three-dimensional video signal photography device | |
| US20200128224A1 (en) | Computer implemented method of capturing stereo images using single lens optics of any smart device without the use of any additional hardware |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20180712 Address after: 518000 Room 201, building A, 1 front Bay Road, Shenzhen Qianhai cooperation zone, Shenzhen, Guangdong Patentee after: Shenzhen super Technology Co., Ltd. Address before: 518000 Guangdong Shenzhen Baoan District Xixiang Street Gonghe Industrial Road West hair B District Xu Sheng research and development building 11 story 1113U Patentee before: SHENZHEN CHUANGRUISI TECHNOLOGY CO., LTD. |
|
| TR01 | Transfer of patent right |