CN109413334A - Image pickup method and filming apparatus - Google Patents
Image pickup method and filming apparatus Download PDFInfo
- Publication number
- CN109413334A CN109413334A CN201811526267.9A CN201811526267A CN109413334A CN 109413334 A CN109413334 A CN 109413334A CN 201811526267 A CN201811526267 A CN 201811526267A CN 109413334 A CN109413334 A CN 109413334A
- Authority
- CN
- China
- Prior art keywords
- image
- shooting
- area
- mentioned
- lens group
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/62—Control of parameters via user interfaces
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N17/00—Diagnosis, testing or measuring for television systems or their details
- H04N17/002—Diagnosis, testing or measuring for television systems or their details for television cameras
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Health & Medical Sciences (AREA)
- Biomedical Technology (AREA)
- General Health & Medical Sciences (AREA)
- Studio Devices (AREA)
Abstract
This application provides a kind of image pickup method and filming apparatus, this method comprises: shooting using shooting unit to reference object, sequentially form at least one preview image and a shooting image, shooting unit includes lens group, and lens group includes at least one camera lens；Amount of exercise of the detector lens group when shooting shoots image；In the case where detecting that amount of exercise of the lens group when shooting shoots image is greater than threshold value, at least part in first area in one preview image is fused in the corresponding part in the first area of shooting image, the corresponding part of the part and shooting image that are fused to the preview image of shooting image is same a part of reference object.The calculation amount of the image pickup method is smaller, and the higher shooting image of available quality.
Description
Technical field
This application involves imaging fields, in particular to a kind of image pickup method and filming apparatus.
Background technique
Photo captured by the filming apparatus of actual use, especially mobile terminal filming apparatus mounted generally all needs
It corrects to eliminate the various unintelligible phenomenons in image, such as image fault and Mobile phone mirror caused by hand shaking when as shooting
The aberrations such as distortion and color difference caused by head itself.
In existing technology, there are two types of common anti-fluttering methods, and one kind is physics revised law, for example, using all kinds of lens
Combination and increase diaphragm etc., still, this method can not thoroughly solve shake these problems；Another kind is bit shift compensation method, usually
To use bit shift compensation to carry out the movement offseted with shake to lens group or photosensitive element, this method proposes hardware
It is more to require, image processing software, which is still frequently necessary to, in practical application is manually handled.
Therefore, needing exist for one kind can effectively prevent the reduction of image quality caused by hand shaking, and calculating needed for image correction
Measure less mechanism.
Disclosed information above is used only to reinforce the background technique to technology described herein in the background section
Understanding may include therefore certain information in background technique, these information are to those skilled in the art and not formed
The home known prior art.
Summary of the invention
The main purpose of the application is to provide a kind of image pickup method and filming apparatus, to solve stabilization side in the prior art
Method is difficult to the problem of using less calculation amount amendment shooting image.
To achieve the goals above, according to the one aspect of the application, a kind of image pickup method is provided, this method comprises:
Reference object is shot using shooting unit, sequentially forms at least one preview image and a shooting image, above-mentioned bat
Taking the photograph unit includes lens group, and above-mentioned lens group includes at least one camera lens；It detects above-mentioned lens group and is shooting above-mentioned shooting image
When amount of exercise；It, will in the case where detecting that amount of exercise of the above-mentioned lens group when shooting above-mentioned shooting image is greater than threshold value
At least part in first area in one above-mentioned preview image is fused to pair in the first area of above-mentioned shooting image
It answers in part, the corresponding part of the part for being fused to the above-mentioned preview image of above-mentioned shooting image and above-mentioned shooting image is above-mentioned
Same a part of reference object.
Further, above-mentioned preview image has multiple, the above method further include detect above-mentioned lens group shoot it is above-mentioned pre-
Look at image when amount of exercise, it is above-mentioned to detect that amount of exercise of the above-mentioned lens group when shooting above-mentioned shooting image be greater than threshold value
In the case of, at least part in an above-mentioned preview image is fused in the corresponding part of above-mentioned shooting image include:
In multiple above-mentioned preview images, select above-mentioned lens group when shooting the smallest above-mentioned preview image of above-mentioned amount of exercise as fusion
Image；Calculate pair of at least part in the first area of above-mentioned blending image relative to the first area of above-mentioned shooting image
Answer the offset of part, wherein firstth area of at least part of the first area of above-mentioned blending image and above-mentioned shooting image
The corresponding part in domain is same a part of above-mentioned reference object；According to above-mentioned offset by least one in above-mentioned first area
Divide the corresponding part for being fused to the first area of above-mentioned shooting image.
Further, the above method further include: above-mentioned amount of exercise and above-mentioned preview image are cached.
Further, the region in above-mentioned blending image in addition to above-mentioned first area is second area, above-mentioned shooting figure
Region as in addition to above-mentioned first area is second area, the above method further include: according to above-mentioned amount of exercise to above-mentioned bat
The second area for taking the photograph image compensates.
Further, after being compensated according to second area of the above-mentioned amount of exercise to above-mentioned shooting image, above-mentioned side
Method further include: at least the above second area of above-mentioned shooting image is corrected using scheduled aberration correction data.
Further, the pixel number in above-mentioned second area is less than the pixel number in above-mentioned first area.
Further, the part in the above-mentioned first area for calculating above-mentioned offset is 32*32,16*16 or 8*8
Pixel portion, and above-mentioned pixel portion includes luminance information and hue information.
To achieve the goals above, according to the one aspect of the application, a kind of filming apparatus, above-mentioned apparatus packet are provided
It includes: shooting unit, including lens group and image-forming module, wherein above-mentioned lens group includes at least one camera lens, above-mentioned shooting unit
For shooting to reference object, at least one preview image and a shooting image are sequentially formed；Motion sensor is used for
Detect amount of exercise of the above-mentioned lens group when shooting above-mentioned shooting image；Processing unit is detecting that above-mentioned lens group shooting
In the case that amount of exercise when above-mentioned shooting image is greater than threshold value, for will be in the first area in an above-mentioned preview image
At least part is fused in the corresponding part in the first area of above-mentioned shooting image, is fused to the above-mentioned of above-mentioned shooting image
The corresponding part of the part of preview image and above-mentioned shooting image is same a part of above-mentioned reference object.
Further, above-mentioned preview image has multiple, and it is above-mentioned in shooting that above-mentioned motion sensor also detects above-mentioned lens group
Amount of exercise when preview image, above-mentioned processing unit include: selecting module, are used in multiple above-mentioned preview images, in selection
The smallest above-mentioned preview image of the above-mentioned amount of exercise of lens group when shooting is stated as blending image；Computing module, for calculating
The corresponding part of at least part in the first area of above-mentioned blending image relative to the first area of above-mentioned shooting image
Offset, wherein the correspondence of the first area of at least part of the first area of above-mentioned blending image and above-mentioned shooting image
Part is same a part of above-mentioned reference object；Fusion Module, for according to above-mentioned offset by above-mentioned first area extremely
Few a part is fused to the corresponding part of the first area of above-mentioned shooting image.
Further, above-mentioned motion sensor includes accelerometer and gyroscope.
Using the technical solution of the application, in above-mentioned image pickup method, before shooting forms shooting image, formed at least
One preview image then uses preview when the amount of exercise for detecting lens group when shooting above-mentioned shooting image is more than threshold value
Image to shooting image be modified, specific makeover process be by the first area in an above-mentioned preview image at least
A part is fused in the corresponding part in the first area of above-mentioned shooting image, and is fused to the above-mentioned pre- of above-mentioned shooting image
The corresponding part of part and above-mentioned shooting image of image look at is same a part of above-mentioned reference object, for example, coming for personage
It saying, usual user is relatively concerned with face, then, in specific fusion process, can choose includes face in preview image
A lesser region be first area, and the face in the region is fused to the face in shooting image, formation repairs
Shooting image after just.The image pickup method can be only by a partial fusion in the first area in preview image to shooting figure
As in, obtain the higher revised shooting image of quality, the calculation amount of the image pickup method is smaller, and available quality compared with
High shooting image.
Detailed description of the invention
The accompanying drawings constituting a part of this application is used to provide further understanding of the present application, and the application's shows
Meaning property embodiment and its explanation are not constituted an undue limitation on the present application for explaining the application.In the accompanying drawings:
Fig. 1 shows the flow diagram of the embodiment of the image pickup method according to the application；
Fig. 2 shows the structural schematic diagrams according to the embodiment of the filming apparatus of the application；
Fig. 3 shows multiple preview images in one embodiment of the application；
Fig. 4 shows the shooting image in one embodiment of the application；And
Fig. 5 shows the firstth area of the shooting image being fused to the first area of a preview image in Fig. 3 in Fig. 4
The image formed behind domain.
Specific embodiment
It should be noted that in the absence of conflict, the features in the embodiments and the embodiments of the present application can phase
Mutually combination.The application is described in detail below with reference to the accompanying drawings and in conjunction with the embodiments.
In order to make those skilled in the art more fully understand application scheme, below in conjunction in the embodiment of the present application
Attached drawing, the technical scheme in the embodiment of the application is clearly and completely described, it is clear that described embodiment is only
The embodiment of the application a part, instead of all the embodiments.Based on the embodiment in the application, ordinary skill people
Member's every other embodiment obtained without making creative work, all should belong to the model of the application protection
It encloses.
It should be noted that the description and claims of this application and term " first " in above-mentioned attached drawing, "
Two " etc. be to be used to distinguish similar objects, without being used to describe a particular order or precedence order.It should be understood that using in this way
Data be interchangeable under appropriate circumstances, so as to embodiments herein described herein.In addition, term " includes " and " tool
Have " and their any deformation, it is intended that cover it is non-exclusive include, for example, containing a series of steps or units
Process, method, system, product or equipment those of are not necessarily limited to be clearly listed step or unit, but may include without clear
Other step or units listing to Chu or intrinsic for these process, methods, product or equipment.
As described in background technique, the method for stabilization in the prior art is difficult to repair using the less method of calculation amount
The problem of positive shooting image.
According to the first embodiment of the application, a kind of image pickup method is provided.
Fig. 1 is the flow chart according to the image pickup method of the embodiment of the present application.As shown in Figure 1, method includes the following steps:
Step S101 shoots reference object using shooting unit, sequentially forms at least one preview image and one
A shooting image, above-mentioned shooting unit include lens group, and above-mentioned lens group includes at least one camera lens；
Step S102, detects amount of exercise of the above-mentioned lens group when shooting above-mentioned shooting image, and amount of exercise can be rotation
Angle, angular speed and/or acceleration etc.；
Step S103 is detecting the case where amount of exercise of the above-mentioned lens group when shooting above-mentioned shooting image is greater than threshold value
Under, at least part in the first area in an above-mentioned preview image is fused in the first area of above-mentioned shooting image
Corresponding part in, the corresponding part of the part and above-mentioned shooting image that are fused to the above-mentioned preview image of above-mentioned shooting image is
Same a part of above-mentioned reference object.
It should be noted that step shown in the flowchart of the accompanying drawings can be in such as a group of computer-executable instructions
It is executed in computer system, although also, logical order is shown in flow charts, and it in some cases, can be with not
The sequence being same as herein executes shown or described step.
In above-mentioned image pickup method, before shooting forms shooting image, at least one preview image is formed, when detecting
When the amount of exercise of lens group when shooting above-mentioned shooting image is more than threshold value, then shooting image is repaired using preview image
Just, specific makeover process is that at least part in the first area in an above-mentioned preview image is fused to above-mentioned shooting
In corresponding part in the first area of image, and be fused to the above-mentioned preview image of above-mentioned shooting image part and above-mentioned bat
The corresponding part for taking the photograph image is same a part of above-mentioned reference object, for example, usual user compares concern for personage
It is face, then, in specific fusion process, can choose a lesser region in preview image including face is first
Region, and the face in the region is fused to the face in shooting image, form revised shooting image.The shooting side
Method can obtain the higher amendment of quality only by a partial fusion in the first area in preview image into shooting image
Shooting image afterwards, the calculation amount of the image pickup method is smaller, and the higher shooting image of available quality.
In specific shooting process, since the shake of general lens group is rotation, so, above-mentioned amount of exercise can also be set
It is set to rotational angle.
Above-mentioned shooting unit not only includes lens group, and in the second embodiment of the application, shooting unit can also include
Imaging device, such as all kinds of CCD or CMOS sensor, montage receive incident light, and imaging device is used for montage
The incident light of receipts is imaged.
In order to further ensure using less calculation amount can the higher revised bat of quality in the image pickup method
Take the photograph image, in the 3rd embodiment of the application, above-mentioned preview image has multiple, and the above method further includes detecting above-mentioned lens group to exist
Amount of exercise when above-mentioned preview image is shot, it is above-mentioned to detect amount of exercise of the above-mentioned lens group when shooting above-mentioned shooting image
In the case where greater than threshold value, at least part in an above-mentioned preview image is fused to the corresponding part of above-mentioned shooting image
In include: to select the above-mentioned lens group the smallest above-mentioned preview graph of above-mentioned amount of exercise when shooting in multiple above-mentioned preview images
As being used as blending image；Calculate of at least part in the first area of above-mentioned blending image relative to above-mentioned shooting image
The offset of the corresponding part in one region, wherein at least part of the first area of above-mentioned blending image and above-mentioned shooting figure
The corresponding part of the first area of picture is same a part of above-mentioned reference object；It will be in above-mentioned first area according to above-mentioned offset
At least part be fused to above-mentioned shooting image first area corresponding part.
In above-mentioned image pickup method, after selected blending image, at least part is chosen from first area therein
To calculate it relative to the block in shooting image along the offset vector of each axis, collectively referred to as offset.Due to blending image
Generally it is not much different with the characteristics of image in the first area in shooting image, can use color distribution feature (such as color point
Cloth matrix and its feature vector) and specific coordinate information find a part in blending image in first area to answering the bid
Which part of first area in image taken the photograph.For example, being chosen from the first area of blending image one or more with specific
COLOR COMPOSITION THROUGH DISTRIBUTION, edge, Luminance Distribution or feature vector part, later shooting image in first area in scan for
Corresponding part.Finally, can movement from corresponding part or gyration vector estimate the relative motion of corresponding part to get to
The offset is applied in the part in blending image first area by offset later, and by the blending image after application
Among partial fusion to shooting image.
In the fourth embodiment of the application, in the shooting process of shooting unit, the time for exposure of preview image can be small
The default aperture time that lens group is automatically selected when user's shooting, to improve the readability of shooting image, further
Improve the quality of revised shooting image.
In order to facilitate calling amount of exercise and preview image, in the 5th embodiment of the application, the above method further include: to upper
When stating amount of exercise and above-mentioned preview image cached in real time, and caching, when preview image can with amount of exercise at that time, in this way
It can choose a width to approach in time with shooting image, and corresponding amount of exercise is smaller, image MTF or contrast are more preferably schemed
As being used as blending image, the quality of revised shooting image can be further promoted.
Region in above-mentioned blending image in addition to above-mentioned first area is second area, is removed in above-mentioned shooting image upper
Stating region other than first area is second area, in the sixth embodiment of the application, the above method further include: according to above-mentioned fortune
Momentum compensates the second area of above-mentioned shooting image.In general, first area be user it is interested or pay attention to
Central area, second area are the fringe region of image, so, comparatively, second area includes user's object of interest
Possibility is very low, also higher to fuzzy tolerance.Therefore, the amount of exercise situation sensed when being based only upon shooting image is trembled
Dynamic amendment compensates second area the amount of exercise of an opposite direction, correct in this way relative to using with to first area
The identical method of method come the method for correcting second area, this method is simpler, and calculation amount is smaller, and treatment effeciency is higher.
Such as shooting standard calibration plate demarcates camera lens when leaving the factory, corresponds to each special exercise amount or range, calculates
Corresponding imaging device or lens group need to carry out clarity could be maintained at by a great reverse motions compensation rate can
Receive level, calculates the parameter of the image compensations processes such as corresponding filtering or interpolation according to the motion compensation quantity later, it will
The fitting function that these correction parameters form template form directly applies to user and shoots in image included in second area
Pixel.The template is preferably stored in memory with the aberration correction data of camera lens (such as distortion, chromatic aberration correction) and one
It rises and is applied to second area, this can be further improved efficiency.
Certainly, it in the image pickup method of the application, can be repaired using with to the identical method of the modified method in first area
The second area of positive shooting image, although this method is complicated, corresponding obtained revised shooting picture quality is higher.
In order to enable the quality for the revised shooting image that the image pickup method finally obtains is higher, the 7th of the application is real
It applies in example, after being compensated according to second area of the above-mentioned amount of exercise to above-mentioned shooting image, the above method further include: adopt
It is corrected at least the above second area of the scheduled aberration correction data to above-mentioned shooting image, which is aberration
Correction, aberration correction data, which can be, when factory to be constructed camera lens distortion itself, color difference etc. according to focal length, stop position etc.
Fixed numbers, because second area is generally fringe region, and fringe region is affected by aberration, so, this method
In can only the region is corrected, improve treatment effeciency.Certainly, it is not limited to only carry out picture to second area in the application
Difference correction can also carry out aberration correction to first area.
In the 8th embodiment of the application, the above method further include: to revised shooting image and aberration correction data
It is stored, can be convenient the calling of aberration correction data in this way, also can be convenient user and revised shooting image is carried out
It checks.
In order to be further reduced the calculation amount of the image pickup method, in the 9th embodiment of the application, in above-mentioned second area
Pixel number be less than above-mentioned first area in pixel number.The region merged is needed to account for the smaller portions of picture totality in this way, such as
It is only picture central part or a part for detecting portrait.
In the tenth embodiment of the application, the part in above-mentioned first area for calculating above-mentioned offset be 32*32,
The pixel portion of 16*16 or 8*8, and above-mentioned pixel portion includes luminance information and hue information, such pixel portion be based on
Such as in the graphics standards such as MPEG or JPG in Motion evaluation pixel portion definition.
In the 11st embodiment of the application, above-mentioned shooting unit include the first shooting module and the second shooting module, two
A shooting module respectively includes a camera lens and an imaging device, wherein the imaging of two shooting modules some or certain
Several performances have differences, above-mentioned to be shot using shooting unit to reference object, sequentially form at least one preview image
It include: that at least one first preview image and a first count are successively shot to obtain using the first shooting module with a shooting image
Image is taken the photograph, at least one second preview image and one second shooting image are successively shot to obtain using the second shooting module, wherein
First preview image and the second preview image correspond, and corresponding first preview image and the second preview image are respectively two
What a shooting module was formed simultaneously, the first shooting image and the second shooting image are respectively that two shooting modules are formed simultaneously；
It merges the first preview image and corresponding second preview image to obtain preview image；By the first shooting image and the second shooting figure
As fusion obtains shooting image.Here fusion can be partial fusion, or all fusions.
The 12nd embodiment of the application additionally provides a kind of filming apparatus, it should be noted that the bat of the embodiment of the present application
Taking the photograph device can be used for executing image pickup method provided by the embodiment of the present application.Shooting provided by the embodiments of the present application is filled below
It sets and is introduced.
Fig. 2 is the schematic diagram according to the filming apparatus of the embodiment of the present application.As shown in Fig. 2, the device includes:
Shooting unit 10, including lens group and image-forming module, wherein above-mentioned lens group includes at least one camera lens, above-mentioned
Shooting unit sequentially forms at least one preview image and a shooting image for shooting to reference object；
Motion sensor 20, for detecting amount of exercise of the above-mentioned lens group when shooting above-mentioned shooting image；
Processing unit 30 is detecting feelings of amount of exercise of the above-mentioned lens group when shooting above-mentioned shooting image greater than threshold value
Under condition, at least part in the first area in an above-mentioned preview image to be fused to the first of above-mentioned shooting image
In corresponding part in region, the part for being fused to the above-mentioned preview image of above-mentioned shooting image is corresponding with above-mentioned shooting image
Part is same a part of above-mentioned reference object.
In above-mentioned filming apparatus, shooting unit forms at least one preview image before shooting forms shooting image,
When the amount of exercise for detecting lens group when shooting above-mentioned shooting image is more than threshold value, then processing unit uses preview image pair
Shooting image is modified, and specific makeover process is by least part in the first area in an above-mentioned preview image
It is fused in the corresponding part in the first area of above-mentioned shooting image, and is fused to the above-mentioned preview image of above-mentioned shooting image
Part and above-mentioned shooting image corresponding part be above-mentioned reference object same a part, for example, for personage, usually
User is relatively concerned with face, then, in specific fusion process, can choose in preview image including one of face compared with
Small region is first area, and the face in the region is fused to the face in shooting image, forms revised bat
Take the photograph image.The filming apparatus can obtain only by a partial fusion in the first area in preview image into shooting image
To the higher revised shooting image of quality, the calculation amount of the filming apparatus is smaller, and the higher bat of available quality
Take the photograph image.
In a kind of specific embodiment, when user opens lens group and shoots, preview graph is shown on the screen first
Picture presses the virtual or entity button taken pictures when user is taken pictures by preview image judgement and produces a width shooting figure
Picture.Can according to motion sensor senses at this time to shake and conditions of exposure at that time judge whether image needs to carry out
Jitter correction, this can be judged by judging whether amount of exercise (such as angular speed, acceleration etc.) has been more than threshold value.Need into
When row jitter correction, piece image is selected from several preview images of caching and is used in fusion, it can be with when caching preview image
Amount of exercise at that time is corresponding, so that one width of selection approaches in time with shooting image, and corresponding amount of exercise is smaller, image
MTF or contrast more preferably image are as blending image.Preview image and shooting image can use pre-set unification
Space division mode divided, by the central area (such as accounting for 1/4,1/9 or so ratio of image etc.) of image be used as the firstth area
Domain, that is, area-of-interest, remaining marginal portion are defined as second area.Furthermore it can also be detected according to portrait in preview image
It is divided after approximate region Deng determining personage, as shown in Figure 3 and Figure 4, it will include face that Fig. 3, which is multiple preview images 100,
First area 102 of the region as preview image, using remaining region as the second area 103 of preview image, in the figure
Face be known as the first face 101；Fig. 4 is shooting image 200, and will include the region of face as the firstth area of shooting figure
Domain 202, using remaining region as the second area 203 of shooting figure, the face in the figure is known as the second face 201, after fusion
Shooting image 300 be Fig. 5, by Fig. 4 and Fig. 5 comparison it is found that in Fig. 4 dotted line indicate the second unclear face 201 pass through
After the first face 101 amendment of preview image, become the clearly face of Fig. 5 solid line expression, which is known as third face
301。
In specific shooting process, since the shake of general lens group is rotation, so, above-mentioned amount of exercise can also be set
It is set to rotational angle.
Above-mentioned shooting unit not only includes lens group, and in the 13rd embodiment of the application, shooting unit can also be wrapped
Imaging device, such as all kinds of CCD or CMOS sensor are included, montage receives incident light, and imaging device is used for lens group
Received incident light is imaged.
In order to further ensure using less calculation amount can the higher revised bat of quality in the filming apparatus
Take the photograph image, in the 14th embodiment of the application, above-mentioned preview image has multiple, and above-mentioned motion sensor also detects above-mentioned camera lens
Amount of exercise of the group when shooting above-mentioned preview image, above-mentioned processing unit include selecting module, computing module and Fusion Module, choosing
Module is selected for selecting the above-mentioned amount of exercise of above-mentioned lens group when shooting the smallest above-mentioned pre- in multiple above-mentioned preview images
Image is look at as blending image；Computing module be used to calculate at least part in the first area of above-mentioned blending image relative to
The offset of the corresponding part of the first area of above-mentioned shooting image, wherein at least the one of the first area of above-mentioned blending image
The corresponding part of part and the first area of above-mentioned shooting image is same a part of above-mentioned reference object；Fusion Module is used for root
At least part in above-mentioned first area is fused to the correspondence portion of the first area of above-mentioned shooting image according to above-mentioned offset
Point.
In order to simplify filming apparatus, in the 15th embodiment of the application, above-mentioned motion sensor include accelerometer and
Gyroscope.Certainly, the motion sensor of the application can detect degree of jitter and can be with the biography of return position information to be any
Sensor, for example, the equipment such as direction sensor, magnetometric sensor, proximity sensor or gravity sensor.
In order to facilitate amount of exercise and preview image is called, in the 16th embodiment of the application, above-mentioned apparatus further includes delaying
Memory cell, cache unit is for caching above-mentioned amount of exercise and above-mentioned preview image, and cache unit and when caching, preview
It can choose a width in this way with amount of exercise at that time when image and be approached in time with shooting image, and corresponding movement
Amount is smaller, and image MTF or contrast more preferably image can further promote revised shooting image as blending image
Quality.
In the 17th embodiment of the application, in the shooting process of shooting unit, time for exposure of preview image can be with
The default aperture time that lens group is automatically selected when less than user's shooting, to improve the readability of shooting image, into one
Step improves the quality of revised shooting image.
Region in above-mentioned blending image in addition to above-mentioned first area is second area, is removed in above-mentioned shooting image upper
The region other than first area is stated as second area, in the 18th embodiment of the application, above-mentioned apparatus further includes compensating unit,
The compensating unit according to second area of the above-mentioned amount of exercise to above-mentioned shooting image for compensating.In general, the firstth area
Domain is the central area that user is interested or payes attention to, and second area is the fringe region of image, so, comparatively, second
A possibility that region includes user's object of interest is very low, also higher to fuzzy tolerance.Therefore, when being based only upon shooting image
The amendment that the amount of exercise situation sensed is shaken compensates second area the amount of exercise of an opposite direction, such phase
For using with device that second area is corrected to the identical device of the modified device in first area, the device is simpler,
Calculation amount is smaller, and treatment effeciency is higher.Such as shooting standard calibration plate demarcates camera lens when leaving the factory, corresponds to each spy
Determining amount of exercise, perhaps range calculates corresponding imaging device or lens group needs to carry out a great reverse motions compensation
Clarity could be maintained at acceptable level by amount, calculate corresponding filtering or interpolation etc. according to the motion compensation quantity later
The fitting function that these correction parameters form template form is directly applied to user and shoots image by the parameter of image compensation process
Pixel included in middle second area.The template preferably with the aberration correction data of camera lens (such as distortion, chromatic aberration correction) one
It rises to save and is applied to second area in memory and together, this can be further improved efficiency.
Certainly, in the filming apparatus of the application, the second area of shooting image can be corrected using processing unit, so that
Corresponding obtained revised shooting picture quality is higher.
In order to enable the quality for the revised shooting image that the filming apparatus finally obtains is higher, the 19th of the application the
In embodiment, after being compensated according to second area of the above-mentioned amount of exercise to above-mentioned shooting image, above-mentioned apparatus further includes
Aberration correction unit, aberration correction unit is using scheduled aberration correction data at least the above secondth area of above-mentioned shooting image
Domain is corrected, to camera lens distortion itself, color difference etc. according to focal length, stop position etc. when aberration correction data can be factory
The fixed numbers of building, because second area is generally fringe region, and fringe region is affected by aberration, so,
Only the region can be corrected in the device, improve treatment effeciency.Certainly, it is not limited in the application only to second area
Aberration correction is carried out, aberration correction can also be carried out to first area.
In order to be further reduced the calculation amount of the filming apparatus, in the 20th embodiment of the application, above-mentioned second area
In pixel number be less than above-mentioned first area in pixel number.The region merged is needed to account for the smaller portions of picture totality in this way,
As being only picture central part or a part for detecting portrait.
In the 21st embodiment of the application, the part in above-mentioned first area for calculating above-mentioned offset is
The pixel portion of 32*32,16*16 or 8*8, and above-mentioned pixel portion includes luminance information and hue information, such pixel portion
For the definition based on pixel portion in Motion evaluation in the graphics standards such as such as MPEG or JPG.
In the 22nd embodiment of the application, above-mentioned apparatus further include: to revised shooting image and aberration correction
Data are stored, and can be convenient the calling of aberration correction data in this way, also can be convenient user to revised shooting image
It checks etc..
In the 23rd embodiment of the application, above-mentioned shooting unit include the first shooting module, the second shooting module and
Fusion Module, two shooting modules respectively include a camera lens and an imaging device, wherein the imaging of two shooting modules
Some or a few a performances have differences, and the first shooting module successively shoots to obtain at least one first preview image and one
One shooting image, the second shooting module successively shoot to obtain at least one second preview image and one second shooting image, wherein
First preview image and the second preview image correspond, and corresponding first preview image and the second preview image are respectively two
What a shooting module was formed simultaneously, the first shooting image and the second shooting image are respectively that two shooting modules are formed simultaneously；
Fusion Module merges the first preview image and corresponding second preview image to obtain preview image, and Fusion Module is shot first
Image and the second shooting image co-registration obtain shooting image.Here fusion can be partial fusion, or all fusions.
In the 24th embodiment of the application, provide a kind of electronic equipment, the electronic equipment include filming apparatus and
Display device etc., specifically, the electronic equipment can be mobile terminal apparatus, for example, mobile phone or PAD etc..
Above-mentioned filming apparatus includes processor and memory, and above-mentioned processing unit etc. is stored in storage as program unit
In device, above procedure unit stored in memory is executed by processor to realize corresponding function.
Include kernel in processor, is gone in memory to transfer corresponding program unit by kernel.Kernel can be set one
Or more, by adjusting kernel parameter come use less calculation amount to shooting image be modified.
Memory may include the non-volatile memory in computer-readable medium, random access memory (RAM) and/
Or the forms such as Nonvolatile memory, if read-only memory (ROM) or flash memory (flash RAM), memory include that at least one is deposited
Store up chip.
The embodiment of the invention provides a kind of storage mediums, are stored thereon with program, real when which is executed by processor
Existing above-mentioned image pickup method.
The embodiment of the invention provides a kind of processor, above-mentioned processor is for running program, wherein above procedure operation
The above-mentioned image pickup method of Shi Zhihang.
The embodiment of the invention provides a kind of equipment, equipment include processor, memory and storage on a memory and can
The program run on a processor, processor realize at least following steps when executing program:
In the case where detecting that amount of exercise of the above-mentioned lens group when shooting above-mentioned shooting image is greater than threshold value, by one
At least part in first area in above-mentioned preview image is fused to the correspondence portion in the first area of above-mentioned shooting image
In point, the corresponding part of the part and above-mentioned shooting image that are fused to the above-mentioned preview image of above-mentioned shooting image is above-mentioned shooting
Same a part of object.
Equipment herein can be server, PC, PAD, mobile phone etc..
Present invention also provides a kind of computer program products, when executing on data processing equipment, are adapted for carrying out just
Beginningization has the program of at least following method and step:
In the case where detecting that amount of exercise of the above-mentioned lens group when shooting above-mentioned shooting image is greater than threshold value, by one
At least part in first area in above-mentioned preview image is fused to the correspondence portion in the first area of above-mentioned shooting image
In point, the corresponding part of the part and above-mentioned shooting image that are fused to the above-mentioned preview image of above-mentioned shooting image is above-mentioned shooting
Same a part of object.
It should be understood by those skilled in the art that, embodiments herein can provide as method, system or computer program
Product.Therefore, complete hardware embodiment, complete software embodiment or reality combining software and hardware aspects can be used in the application
Apply the form of example.Moreover, it wherein includes the computer of computer usable program code that the application, which can be used in one or more,
The computer program implemented in usable storage medium (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.) produces
The form of product.
The application is referring to method, the process of equipment (system) and computer program product according to the embodiment of the present application
Figure and/or block diagram describe.It should be understood that every one stream in flowchart and/or the block diagram can be realized by computer program instructions
The combination of process and/or box in journey and/or box and flowchart and/or the block diagram.It can provide these computer programs
Instruct the processor of general purpose computer, special purpose computer, Embedded Processor or other programmable data processing devices to produce
A raw machine, so that being generated by the instruction that computer or the processor of other programmable data processing devices execute for real
The device for the function of being specified in present one or more flows of the flowchart and/or one or more blocks of the block diagram.
These computer program instructions, which may also be stored in, is able to guide computer or other programmable data processing devices with spy
Determine in the computer-readable memory that mode works, so that it includes referring to that instruction stored in the computer readable memory, which generates,
Enable the manufacture of device, the command device realize in one box of one or more flows of the flowchart and/or block diagram or
The function of being specified in multiple boxes.
These computer program instructions also can be loaded onto a computer or other programmable data processing device, so that counting
Series of operation steps are executed on calculation machine or other programmable devices to generate computer implemented processing, thus in computer or
The instruction executed on other programmable devices is provided for realizing in one or more flows of the flowchart and/or block diagram one
The step of function of being specified in a box or multiple boxes.
In a typical configuration, calculating equipment includes one or more processors (CPU), input/output interface, net
Network interface and memory.
Memory may include the non-volatile memory in computer-readable medium, random access memory (RAM) and/
Or the forms such as Nonvolatile memory, such as read-only memory (ROM) or flash memory (flash RAM).Memory is computer-readable Jie
The example of matter.
Computer-readable medium includes permanent and non-permanent, removable and non-removable media can be by any method
Or technology come realize information store.Information can be computer readable instructions, data structure, the module of program or other data.
The example of the storage medium of computer includes, but are not limited to phase change memory (PRAM), static random access memory (SRAM), moves
State random access memory (DRAM), other kinds of random access memory (RAM), read-only memory (ROM), electric erasable
Programmable read only memory (EEPROM), flash memory or other memory techniques, read-only disc read only memory (CD-ROM) (CD-ROM),
Digital versatile disc (DVD) or other optical storage, magnetic cassettes, tape magnetic disk storage or other magnetic storage devices
Or any other non-transmission medium, can be used for storage can be accessed by a computing device information.As defined in this article, it calculates
Machine readable medium does not include temporary computer readable media (transitory media), such as the data-signal and carrier wave of modulation.
It should also be noted that, the terms "include", "comprise" or its any other variant are intended to nonexcludability
It include so that the process, method, commodity or the equipment that include a series of elements not only include those elements, but also to wrap
Include other elements that are not explicitly listed, or further include for this process, method, commodity or equipment intrinsic want
Element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that including element
There is also other identical elements in process, method, commodity or equipment.
It will be understood by those skilled in the art that embodiments herein can provide as method, system or computer program product.
Therefore, complete hardware embodiment, complete software embodiment or embodiment combining software and hardware aspects can be used in the application
Form.It is deposited moreover, the application can be used to can be used in the computer that one or more wherein includes computer usable program code
The shape for the computer program product implemented on storage media (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.)
Formula.
It can be seen from the above description that the application the above embodiments realize following technical effect:
1), in the image pickup method of the application, before shooting forms shooting image, at least one preview image is formed, when
Detect shoot above-mentioned shooting image when lens group amount of exercise be more than threshold value when, then using preview image to shooting image into
Row amendment, specific makeover process are above-mentioned at least part in the first area in an above-mentioned preview image to be fused to
Shoot image first area in corresponding part in, and be fused to above-mentioned shooting image above-mentioned preview image part with it is upper
The corresponding part for stating shooting image is same a part of above-mentioned reference object, for example, usual user compares pass for personage
Note is face, then, in specific fusion process, can choose a lesser region in preview image including face is
First area, and the face in the region is fused to the face in shooting image, form revised shooting image.The bat
The method of taking the photograph it is higher can to obtain quality only by a partial fusion in the first area in preview image into shooting image
Revised shooting image, the calculation amount of the image pickup method is smaller, and the higher shooting image of available quality.
2), in the filming apparatus of the application, shooting unit forms at least one preview before shooting forms shooting image
Image, when the amount of exercise for detecting lens group when shooting above-mentioned shooting image is more than threshold value, then processing unit uses preview
Image to shooting image be modified, specific makeover process be by the first area in an above-mentioned preview image at least
A part is fused in the corresponding part in the first area of above-mentioned shooting image, and is fused to the above-mentioned pre- of above-mentioned shooting image
The corresponding part of part and above-mentioned shooting image of image look at is same a part of above-mentioned reference object, for example, coming for personage
It saying, usual user is relatively concerned with face, then, in specific fusion process, can choose includes face in preview image
A lesser region be first area, and the face in the region is fused to the face in shooting image, formation repairs
Shooting image after just.The filming apparatus can be only by a partial fusion in the first area in preview image to shooting figure
As in, obtain the higher revised shooting image of quality, the calculation amount of the filming apparatus is smaller, and available quality compared with
High shooting image.
The foregoing is merely preferred embodiment of the present application, are not intended to limit this application, for the skill of this field
For art personnel, various changes and changes are possible in this application.Within the spirit and principles of this application, made any to repair
Change, equivalent replacement, improvement etc., should be included within the scope of protection of this application.
Claims (10)
1. a kind of image pickup method characterized by comprising
Reference object is shot using shooting unit, sequentially forms at least one preview image and a shooting image, institute
Stating shooting unit includes lens group, and the lens group includes at least one camera lens；
Detect amount of exercise of the lens group when shooting the shooting image；
In the case where detecting that amount of exercise of the lens group when shooting the shooting image is greater than threshold value, described in one
At least part in first area in preview image is fused in the corresponding part in the first area of the shooting image,
The corresponding part of the part and the shooting image that are fused to the preview image of the shooting image is the reference object
Same a part.
2. the method according to claim 1, wherein the preview image have it is multiple, the method also includes inspection
Amount of exercise of the lens group when shooting the preview image is surveyed, it is described to detect the lens group in the shooting shooting
In the case that amount of exercise when image is greater than threshold value, at least part in a preview image is fused to the shooting
Include: in the corresponding part of image
In multiple preview images, selecting the lens group, the smallest preview image of the amount of exercise is made when shooting
For blending image；
Calculate pair of at least part relative to the first area for shooting image in the first area of the blending image
Answer the offset of part, wherein firstth area of at least part of the first area of the blending image and the shooting image
The corresponding part in domain is same a part of the reference object；
At least part in the first area is fused to the first area for shooting image according to the offset
Corresponding part.
3. method according to claim 1 or 2, which is characterized in that the method also includes:
The amount of exercise and the preview image are cached.
4. according to the method described in claim 2, it is characterized in that, area in the blending image in addition to the first area
Domain is second area, and the region in the shooting image in addition to the first area is second area, the method also includes:
It is compensated according to second area of the amount of exercise to the shooting image.
5. according to the method described in claim 4, it is characterized in that, shooting the second of image to described according to the amount of exercise
After region compensates, the method also includes:
It is corrected using at least described second area of the scheduled aberration correction data to the shooting image.
6. according to the method described in claim 4, it is characterized in that, the pixel number in the second area is less than firstth area
Pixel number in domain.
7. according to the method described in claim 2, it is characterized in that, being used to calculate in the first area of the offset
Part is the pixel portion of 32*32,16*16 or 8*8, and the pixel portion includes luminance information and hue information.
8. a kind of filming apparatus, which is characterized in that described device includes:
Shooting unit, including lens group and image-forming module, wherein the lens group includes at least one camera lens, and the shooting is single
Member sequentially forms at least one preview image and a shooting image for shooting to reference object；
Motion sensor, for detecting amount of exercise of the lens group when shooting the shooting image；
Processing unit, in the case where detecting that amount of exercise of the lens group when shooting the shooting image is greater than threshold value,
For at least part in the first area in a preview image to be fused to the first area of the shooting image
In corresponding part in, be fused to it is described shooting image the preview image part and it is described shooting image corresponding part
For same a part of the reference object.
9. device according to claim 8, which is characterized in that the preview image has multiple, and the motion sensor is also
Amount of exercise of the lens group when shooting the preview image is detected, the processing unit includes:
Selecting module, in multiple preview images, selecting the amount of exercise of the lens group when shooting minimum
The preview image as blending image；
Computing module, at least part in first area for calculating the blending image is relative to the shooting image
The offset of the corresponding part of first area, wherein at least part of the first area of the blending image and the shooting
The corresponding part of the first area of image is same a part of the reference object；
Fusion Module, at least part in the first area to be fused to the shooting image according to the offset
First area corresponding part.
10. device according to claim 8, which is characterized in that the motion sensor includes accelerometer and gyroscope.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811526267.9A CN109413334B (en) | 2018-12-13 | 2018-12-13 | Photographing method and photographing apparatus |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811526267.9A CN109413334B (en) | 2018-12-13 | 2018-12-13 | Photographing method and photographing apparatus |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109413334A true CN109413334A (en) | 2019-03-01 |
| CN109413334B CN109413334B (en) | 2020-09-25 |
Family
ID=65458905
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811526267.9A Active CN109413334B (en) | 2018-12-13 | 2018-12-13 | Photographing method and photographing apparatus |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109413334B (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110996003A (en) * | 2019-12-16 | 2020-04-10 | Tcl移动通信科技（宁波）有限公司 | Photographing positioning method and device and mobile terminal |
| CN110995996A (en) * | 2019-12-11 | 2020-04-10 | Tcl移动通信科技（宁波）有限公司 | Image display method and device, storage medium and terminal equipment |
| CN111083359A (en) * | 2019-12-06 | 2020-04-28 | Oppo广东移动通信有限公司 | Image processing method and apparatus, electronic device, and computer-readable storage medium |
| CN113038055A (en) * | 2021-01-27 | 2021-06-25 | 维沃移动通信有限公司 | Image processing method and device and electronic equipment |
| WO2021139764A1 (en) * | 2020-01-09 | 2021-07-15 | Oppo广东移动通信有限公司 | Method and device for image processing, electronic device, and storage medium |
| CN113790874A (en) * | 2021-08-27 | 2021-12-14 | 歌尔光学科技有限公司 | Lens test system |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070285521A1 (en) * | 2006-06-02 | 2007-12-13 | Yoshinori Watanabe | Image sensing apparatus, and control method, program, and storage medium of image sensing apparatus |
| CN106161932A (en) * | 2016-06-30 | 2016-11-23 | 维沃移动通信有限公司 | A kind of photographic method and mobile terminal |
| CN106686307A (en) * | 2016-12-28 | 2017-05-17 | 努比亚技术有限公司 | Shooting method and mobile terminal |
-
2018
- 2018-12-13 CN CN201811526267.9A patent/CN109413334B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070285521A1 (en) * | 2006-06-02 | 2007-12-13 | Yoshinori Watanabe | Image sensing apparatus, and control method, program, and storage medium of image sensing apparatus |
| CN106161932A (en) * | 2016-06-30 | 2016-11-23 | 维沃移动通信有限公司 | A kind of photographic method and mobile terminal |
| CN106686307A (en) * | 2016-12-28 | 2017-05-17 | 努比亚技术有限公司 | Shooting method and mobile terminal |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111083359A (en) * | 2019-12-06 | 2020-04-28 | Oppo广东移动通信有限公司 | Image processing method and apparatus, electronic device, and computer-readable storage medium |
| CN111083359B (en) * | 2019-12-06 | 2021-06-25 | Oppo广东移动通信有限公司 | Image processing method and apparatus, electronic device, and computer-readable storage medium |
| CN110995996A (en) * | 2019-12-11 | 2020-04-10 | Tcl移动通信科技（宁波）有限公司 | Image display method and device, storage medium and terminal equipment |
| CN110996003A (en) * | 2019-12-16 | 2020-04-10 | Tcl移动通信科技（宁波）有限公司 | Photographing positioning method and device and mobile terminal |
| CN110996003B (en) * | 2019-12-16 | 2022-03-25 | Tcl移动通信科技（宁波）有限公司 | Photographing positioning method and device and mobile terminal |
| WO2021139764A1 (en) * | 2020-01-09 | 2021-07-15 | Oppo广东移动通信有限公司 | Method and device for image processing, electronic device, and storage medium |
| CN113038055A (en) * | 2021-01-27 | 2021-06-25 | 维沃移动通信有限公司 | Image processing method and device and electronic equipment |
| CN113038055B (en) * | 2021-01-27 | 2023-06-23 | 维沃移动通信有限公司 | Image processing method and device and electronic equipment |
| CN113790874A (en) * | 2021-08-27 | 2021-12-14 | 歌尔光学科技有限公司 | Lens test system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109413334B (en) | 2020-09-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109413334A (en) | Image pickup method and filming apparatus | |
| US7825969B2 (en) | Image stabilization using multi-exposure pattern | |
| JP5820257B2 (en) | Image processing apparatus, imaging apparatus, image processing method, and program | |
| US20160300337A1 (en) | Image fusion method and image processing apparatus | |
| CN105323465B (en) | Image processing apparatus and its control method | |
| JP5535053B2 (en) | Image processing apparatus and image processing method | |
| JP5141245B2 (en) | Image processing apparatus, correction information generation method, and imaging apparatus | |
| CN109978808B (en) | Method and device for image fusion and electronic equipment | |
| JP6308748B2 (en) | Image processing apparatus, imaging apparatus, and image processing method | |
| US9332195B2 (en) | Image processing apparatus, imaging apparatus, and image processing method | |
| CN101516001A (en) | Digital photographing apparatus, method of controlling the digital photographing apparatus, and recording medium | |
| CN109194877A (en) | Image compensation method and device, computer readable storage medium and electronic equipment | |
| CN109348088A (en) | Image denoising method, device, electronic equipment and computer readable storage medium | |
| CN103888661A (en) | Image pickup apparatus, image pickup system and method of controlling image pickup apparatus | |
| CN110266966A (en) | Image generating method and device, electronic equipment, computer readable storage medium | |
| CN110493522A (en) | Anti-fluttering method and device, electronic equipment, computer readable storage medium | |
| JP2017011327A (en) | Image processing apparatus, image processing method, and program | |
| US20080055431A1 (en) | Dark frame subtraction using multiple dark frames | |
| CN103024302A (en) | Image processing device that performs image processing | |
| US20060104627A1 (en) | Apparatus and method for excluding vignetting in a digital camera | |
| US20130002932A1 (en) | Image Enhancement Via Lens Simulation | |
| CN112991163B (en) | Panoramic image acquisition method, device and equipment | |
| US20180077353A1 (en) | Terminal device and photographing method | |
| CN110519513A (en) | Anti-fluttering method and device, electronic equipment, computer readable storage medium | |
| CN109587396A (en) | Image pickup method and filming apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |