CN107155072A - Panorama shooting method, device and terminal device - Google Patents
Panorama shooting method, device and terminal device Download PDFInfo
- Publication number
- CN107155072A CN107155072A CN201710295949.2A CN201710295949A CN107155072A CN 107155072 A CN107155072 A CN 107155072A CN 201710295949 A CN201710295949 A CN 201710295949A CN 107155072 A CN107155072 A CN 107155072A
- Authority
- CN
- China
- Prior art keywords
- depth information
- panoramic pictures
- target
- overlapping region
- depth
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/265—Mixing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/50—Depth or shape recovery
- G06T7/55—Depth or shape recovery from multiple images
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/2624—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects for obtaining an image which is composed of whole input images, e.g. splitscreen
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10004—Still image; Photographic image
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Studio Devices (AREA)
Abstract
The invention discloses a kind of panorama shooting method, device and terminal device, after at least two Target Photos comprising the first depth information of acquisition, according to the overlapping region of at least two Target Photos, at least two Target Photos are spliced, panoramic pictures are obtained.And then the second depth information is calculated to the panoramic pictures, obtain including the panoramic pictures of the second depth information, wherein, the part of correspondence overlapping region in panoramic pictures, according to first depth information of the overlapping region in different target picture, calculating obtains the second depth information.Due to including the second depth information in panoramic pictures, so that the information content entrained by panoramic pictures is enriched, meanwhile, based on the second depth information, it can aid in and more abundant function is realized using panoramic pictures.Solve in the panoramic pictures obtained by pan-shot in the prior art, entrained information content is limited, can only zoom in and out, it is impossible to realize the technical problem of more abundant function.
Description
Technical field
The present invention relates to technique for taking field, more particularly to a kind of panorama shooting method, device and terminal device.
Background technology
Pan-shot is that one group of picture split for being arrived 360 degree of scene captures using camera includes whole scenes as a width
Picture.
In the prior art, pan-shot is linked together multiple pictures by software, and the system of eventually passing is rendered to
It can show, the spherical picture centered on photographer.But panorama of the prior art.But panorama of the prior art is clapped
Take the photograph in resulting panoramic pictures, entrained information content is limited, can only zoom in and out, it is impossible to realize more abundant work(
Energy.
The content of the invention
The purpose of the present invention is intended at least solve one of above-mentioned technical problem to a certain extent.
Therefore, first purpose of the present invention is to propose a kind of panorama shooting method, this method is wrapped by shooting
Panoramic pictures containing depth information, so as to enrich the information content and feature of panoramic pictures.
Second object of the present invention is to propose a kind of panorama shooting device.
Third object of the present invention is to propose a kind of terminal device.
Fourth object of the present invention is to propose another terminal device.
To achieve these goals, first aspect present invention embodiment proposes a kind of panorama shooting method, including following
Step：
Obtain at least two Target Photos for including the first depth information；
According to the overlapping region of at least two Target Photos, at least two Target Photos are spliced, panorama sketch is obtained
Piece；
Second depth information is calculated to the panoramic pictures, obtains including the panoramic pictures of the second depth information；Wherein, institute
The part of the correspondence overlapping region in panoramic pictures is stated, according to first depth of the overlapping region in different target picture
Information, calculating obtains the second depth information.
The panorama shooting method of the embodiment of the present invention, by obtaining at least two Target Photos for including the first depth information
Afterwards, according to the overlapping region of at least two Target Photos, at least two Target Photos is spliced, panoramic pictures are obtained.
And then the second depth information is calculated to the panoramic pictures, obtain including the panoramic pictures of the second depth information, wherein, panoramic pictures
The part of middle correspondence overlapping region, according to first depth information of the overlapping region in different target picture, calculating obtains second
Depth information.Due to including the second depth information in panoramic pictures, so that the information content entrained by panoramic pictures is enriched,
Meanwhile, based on the second depth information, it can aid in and more abundant function is realized using panoramic pictures.Solve prior art
In panoramic pictures obtained by middle pan-shot, entrained information content is limited, can only zoom in and out, it is impossible to realize richer
The technical problem of rich function.
To achieve these goals, second aspect of the present invention embodiment proposes a kind of panorama shooting device, including：
Acquisition module, for obtaining at least two Target Photos for including the first depth information；
At least two Target Photos, for the overlapping region according at least two Target Photos, are spelled by concatenation module
Connect, obtain panoramic pictures；
Computing module, for calculating the second depth information to the panoramic pictures, obtains complete comprising the second depth information
Scape picture；Wherein, the part of the overlapping region is corresponded in the panoramic pictures, according to the overlapping region in different target figure
The first depth information in piece, calculating obtains the second depth information.
The panorama shooting device of the embodiment of the present invention, by obtaining at least two Target Photos for including the first depth information
Afterwards, according to the overlapping region of at least two Target Photos, at least two Target Photos is spliced, panoramic pictures are obtained.
And then the second depth information is calculated to the panoramic pictures, obtain including the panoramic pictures of the second depth information, wherein, panoramic pictures
The part of middle correspondence overlapping region, according to first depth information of the overlapping region in different target picture, calculating obtains second
Depth information.Due to including the second depth information in panoramic pictures, so that the information content entrained by panoramic pictures is enriched,
Meanwhile, based on the second depth information, it can aid in and more abundant function is realized using panoramic pictures.Solve prior art
In panoramic pictures obtained by middle pan-shot, entrained information content is limited, can only zoom in and out, it is impossible to realize richer
The technical problem of rich function.
To achieve these goals, third aspect present invention embodiment proposes a kind of terminal device, including：The present invention the
Panorama shooting device described in two aspect embodiments.
The terminal device of the embodiment of the present invention, by obtain at least two comprising the first depth information Target Photos it
Afterwards, according to the overlapping region of at least two Target Photos, at least two Target Photos is spliced, panoramic pictures are obtained.Enter
And the panoramic pictures are calculated with the second depth information, obtain including the panoramic pictures of the second depth information, wherein, in panoramic pictures
The part of correspondence overlapping region, according to first depth information of the overlapping region in different target picture, it is deep that calculating obtains second
Spend information.Due to including the second depth information in panoramic pictures, so as to enrich the information content entrained by panoramic pictures, together
When, based on the second depth information, it can aid in and more abundant function is realized using panoramic pictures.Solve in the prior art
In panoramic pictures obtained by pan-shot, entrained information content is limited, can only zoom in and out, it is impossible to realizes and more enriches
Function technical problem.
To achieve these goals, fourth aspect present invention embodiment proposes another terminal device, including with next
Individual or multiple components：Housing and processor, memory and camera module in the housing, wherein, the processor leads to
Cross and read the executable program code that stores in the memory to run program corresponding with the executable program code, with
For performing following steps：
Obtain at least two Target Photos for including the first depth information；
According to the overlapping region of at least two Target Photos, at least two Target Photos are spliced, panorama sketch is obtained
Piece；
Second depth information is calculated to the panoramic pictures, obtains including the panoramic pictures of the second depth information；Wherein, institute
The part of the correspondence overlapping region in panoramic pictures is stated, according to first depth of the overlapping region in different target picture
Information, calculating obtains the second depth information.
The terminal device of the embodiment of the present invention, by obtain at least two comprising the first depth information Target Photos it
Afterwards, according to the overlapping region of at least two Target Photos, at least two Target Photos is spliced, panoramic pictures are obtained.Enter
And the panoramic pictures are calculated with the second depth information, obtain including the panoramic pictures of the second depth information, wherein, in panoramic pictures
The part of correspondence overlapping region, according to first depth information of the overlapping region in different target picture, it is deep that calculating obtains second
Spend information.Due to including the second depth information in panoramic pictures, so as to enrich the information content entrained by panoramic pictures, together
When, based on the second depth information, it can aid in and more abundant function is realized using panoramic pictures.Solve in the prior art
In panoramic pictures obtained by pan-shot, entrained information content is limited, can only zoom in and out, it is impossible to realizes and more enriches
Function technical problem.
The additional aspect of the present invention and advantage will be set forth in part in the description, and will partly become from the following description
Obtain substantially, or recognized by the practice of the present invention.
Brief description of the drawings
Of the invention above-mentioned and/or additional aspect and advantage will become from the following description of the accompanying drawings of embodiments
Substantially and be readily appreciated that, wherein：
Fig. 1 is the flow chart of panorama shooting method according to an embodiment of the invention；
Fig. 2 is the flow chart of panorama shooting method in accordance with another embodiment of the present invention；
Fig. 3 a are one of phase difference relation schematic diagram；
Fig. 3 b are the two of phase difference relation schematic diagram；
Fig. 3 c are the three of phase difference relation schematic diagram；
Fig. 4 is the schematic diagram of two Target Photos；
Fig. 5 is the flow chart of the panorama shooting method according to another embodiment of the invention；
Fig. 6 is the schematic diagram of image space in pan-shot；
Fig. 7 a are one of schematic diagram of Target Photo for being obtained in different image spaces；
Fig. 7 b are the two of the schematic diagram of the Target Photo obtained in different image spaces；
Fig. 8 is Similar Principle of Triangle schematic diagram；
Fig. 9 is a kind of structural representation of panorama shooting device provided in an embodiment of the present invention；
Figure 10 is the structural representation of another panorama shooting device provided in an embodiment of the present invention；And
Figure 11 is the structural representation of terminal device in accordance with another embodiment of the present invention.
Embodiment
Embodiments of the invention are described below in detail, the example of the embodiment is shown in the drawings, wherein from beginning to end
Same or similar label represents same or similar element or the element with same or like function.Below with reference to attached
The embodiment of figure description is exemplary, it is intended to for explaining the present invention, and be not considered as limiting the invention.
Below with reference to the accompanying drawings the panorama shooting method, device and terminal device of the embodiment of the present invention described.
Fig. 1 is the flow chart of panorama shooting method according to an embodiment of the invention, as shown in figure 1, this method includes：
Step 101, at least two Target Photos for including the first depth information are obtained.
Specifically, at least two Target Photos are obtained by shooting, during the content that Target Photo is showed is panoramic pictures
A part.Include the first depth information in Target Photo, for example：The depth of field.
As a kind of possible implementation, it can be shot, be taken the photograph because RGBD is mono- by RGBD single camera cameras
The depth of field is included in picture as captured by head camera, therefore, it can the Target Photo for obtaining including the first depth information.
Wherein, RGBD single cameras, for by shoot obtain common RGB (RGB) Three Channel Color image it
Outside, phase related information can also be obtained, phase related information here can indicate the corresponding sensor distance of each pixel
The actual range of subject.
As alternatively possible implementation, it can be shot by common single camera camera.Specifically, may be used
Based on different camera sites, to be imaged to identical subject, obtain including at least two Target Photos of same characteristic features point；Enter
And, using binocular location algorithm, according to relative position of the characteristic point at least two Target Photos, and the different imagings
Displacement between position, calculates the first depth information for obtaining characteristic point described in Target Photo.
Step 102, according to the overlapping region of at least two Target Photos, at least two Target Photos is spliced, obtained
To panoramic pictures.
Specifically, when splicing to two Target Photos, the overlapping region of two Target Photos can be alignd, from
And splice and obtain panoramic pictures.
Step 103, the second depth information is calculated to panoramic pictures, obtains including the panoramic pictures of the second depth information.
Wherein, the part of the overlapping region is corresponded in panoramic pictures, according to the overlapping region in different target picture
In the first depth information, calculating obtain the second depth information.
Alternatively, first depth information of the overlapping region in different target picture is inquired about；In the panoramic pictures
The part of the correspondence overlapping region, averages to the first depth information inquired, obtains the correspondence overlapping region
The second partial depth information.The part in the non-coincidence region of correspondence in the panoramic pictures, by the non-coincidence region described
The first depth information in Target Photo, is used as the second depth information of the correspondence non-coincidence region part.
In the present embodiment, after at least two Target Photos comprising the first depth information of acquisition, according at least two
The overlapping region of Target Photo is opened, at least two Target Photos are spliced, panoramic pictures are obtained.And then to the panoramic pictures
The second depth information is calculated, obtains including the panoramic pictures of the second depth information, wherein, correspondence overlapping region in panoramic pictures
Part, according to first depth information of the overlapping region in different target picture, calculating obtains the second depth information.Due to complete
Include the second depth information in scape picture, so that the information content entrained by panoramic pictures is enriched, meanwhile, based on the second depth
Information, can aid in and more abundant function is realized using panoramic pictures.Obtained by solving pan-shot in the prior art
Panoramic pictures in, entrained information content is limited, can only zoom in and out, it is impossible to realize that the technology of more abundant function is asked
Topic.
Method in order to more comprehensively illustrate the embodiment of the present invention, method will be described in detail below：
Fig. 2 is the flow chart of panorama shooting method in accordance with another embodiment of the present invention, the side that the present embodiment is provided
Method, is the method for progress pan-shot under the application scenarios shot based on RGBD single camera cameras.
As shown in Fig. 2 the panorama shooting method includes：
Step 201, it is imaged based on imaging sensor, obtains Target Photo, and Target Photo is spliced, is obtained
Panoramic pictures.
Wherein, imaging sensor includes：Photosensitive unit array, the filter unit being arranged on photosensitive unit array battle array
Row and the microlens array on the filter unit array, wherein, it is single that the photosensitive unit array includes multiple focusings
First and multiple non-focusing units, the microlens array includes the first lenticule and the second lenticule, and one described first micro-
Mirror covers a focusing unit, and N × N number of second lenticule covers a non-focusing unit, wherein, N is positive integer.
Step 202, according to phase information entrained in Target Photo, the depth map of Target Photo is reconstructed.
Wherein, the phase information be it is described focusing unit 2 × 2 photosensitive pixels in any two photosensitive pixel with
Phase difference between two other photosensitive pixel.
Here depth map is used to indicate the picture corresponding depth of field everywhere.
Specifically, the principle focused based on phase, under focus state, the distance between sensor and subject etc.
In focal length.In this case, Fig. 3 a are one of phase difference relation schematic diagram, as shown in Figure 3 a, the phase difference of left and right phase point
It is zero.When such as Fig. 3 b and Fig. 3 c, schematic diagram describes the distance between sensor and subject smaller and larger than focal length respectively,
The phase difference relation of left and right phase point.
Based on phase difference, it may be determined that the focus region in Target Photo.And then high pass filter can be carried out to Target Photo
Ripple, extracts the edge and details of image, and analyzes the phase difference of image edge location and the phase difference of details position, obtains image
Marginal position is with respect to the depth of field relation in focus region, and details position is with respect to the depth of field relation in focus region.According to image side
Edge position is with respect to the depth of field relation in focus region, and details position sets up depth of field profile with respect to the depth of field relation in focus region
In figure, the depth of field profile diagram initially set up, only include the depth of field of image edge location, details position and focus region.It is next
Step can carry out improving the depth map for obtaining whole picture to depth of field profile diagram.Specifically, it can be tied in depth of field profile diagram
Picture material, the continuity of color are closed, the depth of field of marginal position is calculated by the way of difference, profile can also be filled and hooked
The depth of field of the flat site of Le.
Step 203, first depth information of the overlapping region in different target picture is inquired about.
Step 204, the part of the overlapping region is corresponded in panoramic pictures, flat is asked to the first depth information inquired
Average, obtains the second depth information of the correspondence overlapping region part.
For example：Fig. 4 is the schematic diagram of two Target Photos, as shown in figure 4, scribe area is correspondence overlapping region in figure
Part, the part in correspondence overlapping region, depth of field value takes average.
Step 205, the part in non-coincidence region is corresponded in panoramic pictures, by the non-coincidence region in the Target Photo
In the first depth information, be used as the second depth information of the correspondence non-coincidence region part.
In the present embodiment, after at least two Target Photos comprising the first depth information of acquisition, according at least two
The overlapping region of Target Photo is opened, at least two Target Photos are spliced, panoramic pictures are obtained.And then to the panoramic pictures
The second depth information is calculated, obtains including the panoramic pictures of the second depth information, wherein, correspondence overlapping region in panoramic pictures
Part, according to first depth information of the overlapping region in different target picture, calculating obtains the second depth information.Due to complete
Include the second depth information in scape picture, so that the information content entrained by panoramic pictures is enriched, meanwhile, based on the second depth
Information, can aid in and more abundant function is realized using panoramic pictures.Obtained by solving pan-shot in the prior art
Panoramic pictures in, entrained information content is limited, can only zoom in and out, it is impossible to realize that the technology of more abundant function is asked
Topic.
Fig. 5 is the flow chart of the panorama shooting method according to another embodiment of the invention, the side that the present embodiment is provided
Method, is that kip is led under the application scenarios that single camera camera is shot, the method for carrying out pan-shot, in the present embodiment,
First depth information and the second depth information are specifically as follows the depth of field.As shown in figure 5, this method includes：
Step 301, during pan-shot, at least two different camera sites, identical subject is imaged, obtained
To at least two Target Photos comprising same characteristic features point.
Specifically, shot as a result of common camera, in order to obtain the first depth information, it is necessary to using at least
Two different camera sites are imaged to same subject, so as to during pan-shot, can specifically use, in movement side
Upwards, the edge of latter Target Photo is between two sides of previous Target Photo so that between two Target Photos
With overlapping region, so as to calculate the first depth information of characteristic point in overlapping region.
More first depth informations are obtained in order to calculate as far as possible, increase the area of overlapping region as far as possible, it is preferable that in phase
In three adjacent Target Photos, the back edge of first Target Photo and the front of the 3rd Target Photo are along overlapping, and first
The front edge of the back edge and the 3rd Target Photo of opening Target Photo is between two sides of second Target Photo.
Step 302, using binocular location algorithm, according to relative position of the characteristic point at least two Target Photos, with
And the displacement between the different image spaces, calculate the first depth information for obtaining each characteristic point in Target Photo.
Specifically, picture is shot from two different image spaces, Fig. 6 is the schematic diagram of image space in pan-shot,
As shown in fig. 6, two image spaces are recorded as into Ol and Or respectively, the displacement between two image spaces is designated as S.Fig. 7 a and
Fig. 7 b are the schematic diagram of the Target Photo obtained in different image spaces, find characteristic point in Fig. 7 a and Fig. 7 b, and record spy
The position a little to edge, as Xl and Xr are levied, image size is C.
Fig. 8 is Similar Principle of Triangle schematic diagram, as shown in figure 8, can obtain characteristic point P using Similar Principle of Triangle
The depth of field D of point.
It should be noted that F is focal length in Fig. 8, S is the displacement between different image spaces.Similar Principle of Triangle
Particular content can be found in be repeated no more in the related content of optical principle, the present embodiment for specific algorithm.
Step 303, according to the characteristic point that at least two Target Photos are included, overlapping region is determined, at least two mesh
Piece of marking on a map is spliced according to overlapping region, obtains panoramic pictures.
Specifically, same characteristic features point constitutes the coincidence area of this at least two Target Photos at least two Target Photos
Domain.After overlapping region is determined, spliced according to overlapping region, obtain panoramic pictures.
Step 304, the first depth information in Target Photo, obtains the second depth information of panoramic pictures.
Specifically, in three adjacent Target Photos, first target figure is obtained by above-mentioned Similar Principle of Triangle
The depth of field of overlapping region between piece and second Target Photo；And weight between second Target Photo and the 3rd Target Photo
Close the depth of field in region.
Since in three adjacent Target Photo shooting process, camera site movement and little, first Target Photo
The region for the depth of field tried to achieve with second Target Photo, the area of the depth of field is tried to achieve with second Target Photo and the 3rd Target Photo
Lap is might have between domain, the depth of field of lap is averaged, that is, the first depth information is averaged, is obtained
Second depth information of panoramic picture.
In the present embodiment, after at least two Target Photos comprising the first depth information of acquisition, according at least two
The overlapping region of Target Photo is opened, at least two Target Photos are spliced, panoramic pictures are obtained.And then to the panoramic pictures
The second depth information is calculated, obtains including the panoramic pictures of the second depth information, wherein, correspondence overlapping region in panoramic pictures
Part, according to first depth information of the overlapping region in different target picture, calculating obtains the second depth information.Due to complete
Include the second depth information in scape picture, so that the information content entrained by panoramic pictures is enriched, meanwhile, based on the second depth
Information, can aid in and more abundant function is realized using panoramic pictures.Obtained by solving pan-shot in the prior art
Panoramic pictures in, entrained information content is limited, can only zoom in and out, it is impossible to realize that the technology of more abundant function is asked
Topic.
In order to realize above-described embodiment, the invention also provides a kind of panorama shooting device, Fig. 9 carries for the embodiment of the present invention
The structural representation of a kind of panorama shooting device supplied, as shown in figure 9, panorama shooting device includes：Acquisition module 61, splicing mould
Block 62 and computing module 63.
Acquisition module 61, for obtaining at least two Target Photos for including the first depth information.
As a kind of possible implementation, acquisition module 61, specifically for：During pan-shot, at least two
Individual different camera sites, are imaged to identical subject, obtain including at least two Target Photos of same characteristic features point；Using double
Mesh location algorithm, according to relative position of the characteristic point at least two Target Photos, and between the different image spaces
Displacement, calculate and obtain the first depth information of characteristic point described in Target Photo.
At least two Target Photos, for the overlapping region according at least two Target Photos, are carried out by concatenation module 62
Splicing, obtains panoramic pictures.
Computing module 63, for calculating the second depth information to the panoramic pictures, is obtained comprising the second depth information
Panoramic pictures；Wherein, the part of the overlapping region is corresponded in the panoramic pictures, according to the overlapping region in different target
The first depth information in picture, calculating obtains the second depth information.
In the embodiment of the present invention, after at least two Target Photos comprising the first depth information of acquisition, according to extremely
At least two Target Photos are spliced, obtain panoramic pictures by the overlapping region of few two Target Photos.And then to the panorama
Picture calculates the second depth information, obtains including the panoramic pictures of the second depth information, wherein, correspondence overlaps area in panoramic pictures
The part in domain, according to first depth information of the overlapping region in different target picture, calculating obtains the second depth information.Due to
Include the second depth information in panoramic pictures, so that the information content entrained by panoramic pictures is enriched, meanwhile, based on second
Depth information, can aid in and more abundant function is realized using panoramic pictures.Solve the institute of pan-shot in the prior art
In obtained panoramic pictures, entrained information content is limited, can only zoom in and out, it is impossible to realize the skill of more abundant function
Art problem.
It should be noted that the foregoing description to panorama shooting method embodiment, is also applied for the complete of the embodiment of the present invention
Scape filming apparatus, its realization principle is similar, will not be repeated here.
And then, Figure 10 is the structural representation of another panorama shooting device provided in an embodiment of the present invention, such as Figure 10 institutes
Show, on the basis of as shown in Figure 9, acquisition module 61, including：Imaging unit 611, reconfiguration unit 612.
Imaging unit 611, for being imaged based on imaging sensor, obtains the Target Photo.
Wherein, described image sensor includes：Photosensitive unit array, the optical filtering list being arranged on the photosensitive unit array
Element array and the microlens array on the filter unit array, wherein, it is multiple right that the photosensitive unit array includes
Burnt unit and multiple non-focusing units, the microlens array include the first lenticule and the second lenticule, one described first
Lenticule covers a focusing unit, and N × N number of second lenticule covers a non-focusing unit, wherein, N is positive integer.
Reconfiguration unit 612, for according to phase information entrained in the Target Photo, reconstructing the Target Photo
Depth map.
Wherein, the phase information be it is described focusing unit 2 × 2 photosensitive pixels in any two photosensitive pixel with
Phase difference between two other photosensitive pixel.
Further, computing module 63, including：First computing unit 631 and the second computing unit 632.
First computing unit 631, for inquiring about first depth information of the overlapping region in different target picture；Institute
The part of the correspondence overlapping region in panoramic pictures is stated, the first depth information inquired is averaged, correspondence is obtained
Second depth information of the overlapping region part.
Second computing unit 632, for the part in the non-coincidence region of correspondence in the panoramic pictures, by the non-coincidence area
First depth information of the domain in the Target Photo, is used as the second depth information of the correspondence non-coincidence region part.
It should be noted that the foregoing description to panorama shooting method embodiment, is also applied for the complete of the embodiment of the present invention
Scape filming apparatus, its realization principle is similar, will not be repeated here.
In summary, the panorama shooting device of the embodiment of the present invention, the first depth information is included by obtaining at least two
Target Photo after, according to the overlapping regions of at least two Target Photos, at least two Target Photos are spliced, obtained
Panoramic pictures.And then the second depth information is calculated to the panoramic pictures, obtain including the panoramic pictures of the second depth information, its
In, the part of correspondence overlapping region in panoramic pictures, according to first depth information of the overlapping region in different target picture, meter
Calculation obtains the second depth information.Due to including the second depth information in panoramic pictures, taken so as to enrich panoramic pictures
The information content of band, meanwhile, based on the second depth information, it can aid in and more abundant function is realized using panoramic pictures.Solution
In the panoramic pictures determined obtained by pan-shot in the prior art, entrained information content is limited, can only zoom in and out, nothing
Method realizes the technical problem of more abundant function.
In order to realize above-described embodiment, the invention also provides a kind of terminal device, including foregoing panorama shooting device.
It should be noted that the foregoing description to panorama shooting device embodiment, is also applied for the end of the embodiment of the present invention
End equipment, its realization principle is similar, will not be repeated here.
In summary, the terminal device of the embodiment of the present invention, by obtaining at least two mesh for including the first depth information
Mark on a map after piece, according to the overlapping region of at least two Target Photos, at least two Target Photos are spliced, panorama is obtained
Picture.And then the second depth information is calculated to the panoramic pictures, obtain including the panoramic pictures of the second depth information, wherein, entirely
The part of correspondence overlapping region, according to first depth information of the overlapping region in different target picture, is calculated in scape picture
To the second depth information.Due to including the second depth information in panoramic pictures, so as to enrich entrained by panoramic pictures
Information content, meanwhile, based on the second depth information, it can aid in and more abundant function is realized using panoramic pictures.Solve
In the prior art in the panoramic pictures obtained by pan-shot, entrained information content is limited, can only zoom in and out, it is impossible to real
The technical problem for the function of now more enriching.
In order to realize above-described embodiment, the invention also provides another terminal device, Figure 11 is another according to the present invention
The structural representation of the terminal device of individual embodiment, as shown in figure 11, the terminal device 1000 include：Housing 1100 and positioned at shell
The built-in storage 1111 of body 1100, processor 1112 and camera module 1113.
Wherein, processor 1111 runs and can perform by reading the executable program code stored in memory 1112
The corresponding program of program code, for performing following steps：
Obtain at least two Target Photos for including the first depth information；
According to the overlapping region of at least two Target Photos, at least two Target Photos are spliced, panorama sketch is obtained
Piece；
Second depth information is calculated to the panoramic pictures, obtains including the panoramic pictures of the second depth information；Wherein, institute
The part of the correspondence overlapping region in panoramic pictures is stated, according to first depth of the overlapping region in different target picture
Information, calculating obtains the second depth information.
It should be noted that the foregoing description to panorama shooting method embodiment, is also applied for the end of the embodiment of the present invention
End equipment 1000, its realization principle is similar, will not be repeated here.
In summary, the terminal device of the embodiment of the present invention, by obtaining at least two mesh for including the first depth information
Mark on a map after piece, according to the overlapping region of at least two Target Photos, at least two Target Photos are spliced, panorama is obtained
Picture.And then the second depth information is calculated to the panoramic pictures, obtain including the panoramic pictures of the second depth information, wherein, entirely
The part of correspondence overlapping region, according to first depth information of the overlapping region in different target picture, is calculated in scape picture
To the second depth information.Due to including the second depth information in panoramic pictures, so as to enrich entrained by panoramic pictures
Information content, meanwhile, based on the second depth information, it can aid in and more abundant function is realized using panoramic pictures.Solve
In the prior art in the panoramic pictures obtained by pan-shot, entrained information content is limited, can only zoom in and out, it is impossible to real
The technical problem for the function of now more enriching.
In the description of this specification, reference term " one embodiment ", " some embodiments ", " example ", " specifically show
The description of example " or " some examples " etc. means to combine specific features, structure, material or the spy that the embodiment or example are described
Point is contained at least one embodiment of the present invention or example.In this manual, to the schematic representation of above-mentioned term not
Identical embodiment or example must be directed to.Moreover, specific features, structure, material or the feature of description can be with office
Combined in an appropriate manner in one or more embodiments or example.In addition, in the case of not conflicting, the skill of this area
Art personnel can be tied the not be the same as Example or the feature of example and non-be the same as Example or example described in this specification
Close and combine.
Although embodiments of the invention have been shown and described above, it is to be understood that above-described embodiment is example
Property, it is impossible to limitation of the present invention is interpreted as, one of ordinary skill in the art within the scope of the invention can be to above-mentioned
Embodiment is changed, changed, replacing and modification.
Claims (14)
1. a kind of panorama shooting method, it is characterised in that comprise the following steps：
Obtain at least two Target Photos for including the first depth information；
According to the overlapping region of at least two Target Photos, at least two Target Photos are spliced, panoramic pictures are obtained；
Second depth information is calculated to the panoramic pictures, obtains including the panoramic pictures of the second depth information；Wherein, it is described complete
The part of the correspondence overlapping region in scape picture, believes according to the first depth of the overlapping region in different target picture
Breath, calculating obtains the second depth information.
2. panorama shooting method according to claim 1, it is characterised in that the acquisition at least two includes the first depth
The Target Photo of information, including：
It is imaged based on imaging sensor, obtains the Target Photo；
Wherein, described image sensor includes：Photosensitive unit array, the filter unit being arranged on photosensitive unit array battle array
Row and the microlens array on the filter unit array, wherein, it is single that the photosensitive unit array includes multiple focusings
First and multiple non-focusing units, the microlens array includes the first lenticule and the second lenticule, and one described first micro-
Mirror covers a focusing unit, and N × N number of second lenticule covers a non-focusing unit, wherein, N is positive integer.
3. panorama shooting method according to claim 2, it is characterised in that described that imaging is carried out based on imaging sensor
Afterwards, in addition to：
According to phase information entrained in the Target Photo, the depth map of the Target Photo is reconstructed；
Wherein, the phase information be it is described focusing unit 2 × 2 photosensitive pixels in any two photosensitive pixel with addition
Phase difference between two photosensitive pixels.
4. the panorama shooting method according to claim any one of 1-3, it is characterised in that described to the panoramic pictures meter
The second depth information is calculated, including：
Inquire about first depth information of the overlapping region in different target picture；
The part of the correspondence overlapping region, averages to the first depth information inquired, obtains in the panoramic pictures
To the second depth information of the correspondence overlapping region part.
5. panorama shooting method according to claim 4, it is characterised in that described that the panoramic pictures are calculated with second deeply
Information is spent, in addition to：
The part in the non-coincidence region of correspondence in the panoramic pictures, by the non-coincidence region in the Target Photo first
Depth information, is used as the second depth information of the correspondence non-coincidence region part.
6. panorama shooting method according to claim 1, it is characterised in that the acquisition at least two includes the first depth
The Target Photo of information, including：
During pan-shot, at least two different camera sites, identical subject is imaged, obtains including identical spy
Levy at least two Target Photos a little；
Using binocular location algorithm, according to relative position of the characteristic point at least two Target Photos, and it is described it is different into
Displacement between image position, calculates the first depth information for obtaining characteristic point described in Target Photo.
7. a kind of panorama shooting device, it is characterised in that including：
Acquisition module, for obtaining at least two Target Photos for including the first depth information；
At least two Target Photos, for the overlapping region according at least two Target Photos, are spliced, obtained by concatenation module
To panoramic pictures；
Computing module, for calculating the second depth information to the panoramic pictures, obtains including the panorama sketch of the second depth information
Piece；Wherein, the part of the overlapping region is corresponded in the panoramic pictures, according to the overlapping region in different target picture
The first depth information, calculating obtain the second depth information.
8. panorama shooting device according to claim 7, it is characterised in that the acquisition module, including：
Imaging unit, for being imaged based on imaging sensor, obtains the Target Photo；
Wherein, described image sensor includes：Photosensitive unit array, the filter unit being arranged on photosensitive unit array battle array
Row and the microlens array on the filter unit array, wherein, it is single that the photosensitive unit array includes multiple focusings
First and multiple non-focusing units, the microlens array includes the first lenticule and the second lenticule, and one described first micro-
Mirror covers a focusing unit, and N × N number of second lenticule covers a non-focusing unit, wherein, N is positive integer.
9. panorama shooting device according to claim 8, it is characterised in that the acquisition module, in addition to：
Reconfiguration unit, for according to phase information entrained in the Target Photo, reconstructing the depth of the Target Photo
Figure；
Wherein, the phase information be it is described focusing unit 2 × 2 photosensitive pixels in any two photosensitive pixel with addition
Phase difference between two photosensitive pixels.
10. the panorama shooting device according to claim any one of 7-9, it is characterised in that the computing module, including：
First computing unit, for inquiring about first depth information of the overlapping region in different target picture；The panorama
The part of the correspondence overlapping region, averages to the first depth information inquired in picture, obtains correspondence described heavy
Close the second depth information of region part.
11. panorama shooting device according to claim 10, it is characterised in that the computing module, in addition to：
Second computing unit, for the part in the non-coincidence region of correspondence in the panoramic pictures, by the non-coincidence region in institute
The first depth information in Target Photo is stated, the second depth information of the correspondence non-coincidence region part is used as.
12. panorama shooting device according to claim 7, it is characterised in that the acquisition module, specifically for：
During pan-shot, at least two different camera sites, identical subject is imaged, obtains including identical spy
Levy at least two Target Photos a little；It is relative at least two Target Photos according to characteristic point using binocular location algorithm
Displacement between position, and the different image spaces, calculates the first depth letter for obtaining characteristic point described in Target Photo
Breath.
13. a kind of terminal device, it is characterised in that including the panorama shooting device as described in claim any one of 7-12.
14. a kind of terminal device, it is characterised in that including following one or more assemblies：Housing and in the housing
Processor, memory and camera module, wherein, the executable program generation that the processor is stored by reading in the memory
Code runs program corresponding with the executable program code, for performing following steps：
Obtain at least two Target Photos for including the first depth information；
According to the overlapping region of at least two Target Photos, at least two Target Photos are spliced, panoramic pictures are obtained；
Second depth information is calculated to the panoramic pictures, obtains including the panoramic pictures of the second depth information；Wherein, it is described complete
The part of the correspondence overlapping region in scape picture, believes according to the first depth of the overlapping region in different target picture
Breath, calculating obtains the second depth information.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710295949.2A CN107155072A (en) | 2017-04-28 | 2017-04-28 | Panorama shooting method, device and terminal device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710295949.2A CN107155072A (en) | 2017-04-28 | 2017-04-28 | Panorama shooting method, device and terminal device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107155072A true CN107155072A (en) | 2017-09-12 |
Family
ID=59792709
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710295949.2A Pending CN107155072A (en) | 2017-04-28 | 2017-04-28 | Panorama shooting method, device and terminal device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107155072A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112535408A (en) * | 2019-09-23 | 2021-03-23 | 佛山市顺德区美的电热电器制造有限公司 | Auxiliary cooking method, device and computer storage medium |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101577795A (en) * | 2009-06-17 | 2009-11-11 | 深圳华为通信技术有限公司 | Method and device for realizing real-time viewing of panoramic picture |
| CN105611122A (en) * | 2015-12-18 | 2016-05-25 | 广东欧珀移动通信有限公司 | Image sensor, output method, phase focusing method, imaging apparatus and terminal |
-
2017
- 2017-04-28 CN CN201710295949.2A patent/CN107155072A/en active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101577795A (en) * | 2009-06-17 | 2009-11-11 | 深圳华为通信技术有限公司 | Method and device for realizing real-time viewing of panoramic picture |
| CN105611122A (en) * | 2015-12-18 | 2016-05-25 | 广东欧珀移动通信有限公司 | Image sensor, output method, phase focusing method, imaging apparatus and terminal |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112535408A (en) * | 2019-09-23 | 2021-03-23 | 佛山市顺德区美的电热电器制造有限公司 | Auxiliary cooking method, device and computer storage medium |
| CN112535408B (en) * | 2019-09-23 | 2022-04-01 | 佛山市顺德区美的电热电器制造有限公司 | Auxiliary cooking method, device and computer storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US5583971A (en) | Filmless method and apparatus for producing 3-D photographs | |
| US10425638B2 (en) | Equipment and method for promptly performing calibration and verification of intrinsic and extrinsic parameters of a plurality of image capturing elements installed on electronic device | |
| CN105894451B (en) | Panorama Mosaic method and apparatus | |
| CN103826033B (en) | Image processing method, image processing equipment, image pick up equipment and storage medium | |
| JP5854984B2 (en) | Image processing apparatus, imaging apparatus, control method, and program | |
| JP5127787B2 (en) | Compound eye photographing apparatus and control method thereof | |
| CN103167239B (en) | Image processing apparatus, image processing method, camera head and display device | |
| JPH0380676A (en) | Electronic pan focus device | |
| CN201523430U (en) | Panoramic video monitoring system | |
| CN106131581A (en) | The panoramic video manufacturing technology of mixed image | |
| CN108200360A (en) | A kind of real-time video joining method of more fish eye lens panoramic cameras | |
| CN108347505B (en) | Mobile terminal with 3D imaging function and image generation method | |
| CN108600729B (en) | Dynamic 3D model generation device and image generation method | |
| CN110278366B (en) | Panoramic image blurring method, terminal and computer readable storage medium | |
| JP6931268B2 (en) | Image processing device and image processing method | |
| JP2005217874A (en) | File management method | |
| JP2000125190A (en) | Camera system and recording medium | |
| JP2012195797A (en) | Pan-focus image generating device | |
| CN107155072A (en) | Panorama shooting method, device and terminal device | |
| CN206450959U (en) | Light field panorama camera | |
| CN107450265A (en) | Light field panorama camera | |
| JP5191864B2 (en) | Three-dimensional display device, method and program | |
| CN109587396A (en) | Image pickup method and filming apparatus | |
| US5572633A (en) | Key-subject alignment method and printer for 3D printing utilizing a video monitor for exposure | |
| JP6502640B2 (en) | IMAGE PROCESSING APPARATUS, IMAGE PROCESSING METHOD, PROGRAM, AND RECORDING MEDIUM |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170912 |