CN105049682B - Digital camera system and the method for controlling the digital camera system - Google Patents
Digital camera system and the method for controlling the digital camera system Download PDFInfo
- Publication number
- CN105049682B CN105049682B CN201510113209.3A CN201510113209A CN105049682B CN 105049682 B CN105049682 B CN 105049682B CN 201510113209 A CN201510113209 A CN 201510113209A CN 105049682 B CN105049682 B CN 105049682B
- Authority
- CN
- China
- Prior art keywords
- lens unit
- processor
- data
- movement
- described image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/64—Imaging systems using optical elements for stabilisation of the lateral and angular position of the image
- G02B27/646—Imaging systems using optical elements for stabilisation of the lateral and angular position of the image compensating for small deviations, e.g. due to vibration or shake
Abstract
A kind of digital camera system can include the lens unit of the image of detection main body and the parallel first processor for performing image compensation data generating process and optical compensation process.The optical compensation process can be the process for the movement that the lens unit is selectively controlled based on the corresponding exercise data of movement with camera module.Image compensation data generating process can be the process for generating image compensation data corresponding with described image.
Description
Cross reference to related applications
This application claims entitled " the Digital Photographing System and submitted on April 18th, 2014
The South Korea patent application No.10-2014-0046885 of Controlling Method Thereof " and June 20 in 2014
Korea Spro of entitled " Digital Photographing System and Controlling Method Thereof " that day submits
The equity of state patent application No.10-2014-0076061, content are integrally hereby expressly incorporated by reference.
Technical field
Some embodiments of the present invention can be related to digital camera system and the side for controlling the digital camera system
Method.
Background technology
In general, digital camera system can use digital signal processor processes is received by picture pick-up device image, press
Contracting treated image is to generate image file and store generated image file in memory.
In addition, digital camera system can show the image of image file in the display equipment of such as LCD, by taking the photograph
As equipment receives or is stored in storage medium.However, the digital camera system of such as camera may be due to the movement of user
Arbitrary interference when (hand shaking when) or user shoot desired image and shake.Due to the shake, inputted by picture pick-up device
The degrading quality of flating and therefore image.
[relevant technical literature]
[patent document]
(patent document 1) Korean Patent Publication No No.10-2010-0104383
Invention content
Some embodiments of the disclosure can provide digital camera system and the side for controlling the digital camera system
Method, the system and method can shoot main body (subject) process during camera move when be based on motion-sensing
The exercise data Parallel application optical compensation process and image compensation process about camera motion of device are with to captured figure
The shake or interference of picture compensate.
Digital camera system and for controlling some embodiments of the method for the digital camera system can be according to described
Whether displacement distance of the camera module on each axial direction be next in preset reference range to perform optical compensation parallel
Process and image compensation data generating process, and can by predefined conditions selectively Application Optics compensation process come
Compensate the shake of the image caused by movement.The displacement distance of camera module can be based on the movement pair with camera module
The exercise data answered is calculated.
Some embodiments of the disclosure can individually application be controlled by using pre-determined synchronization information in predefined conditions
The image compensation data generating process of the optical compensation processor of the movement of lens unit processed and generation image compensation data contracts
The short image compensation process time caused by movement and the reliability for ensuring picture quality, for movement (hand shaking or level/hang down
Translation is moved) it may be when image (static or mobile picture) be taken.
Description of the drawings
In terms of the above and other that the present invention can be more clearly understood the following specifically describes in, feature and other are excellent
Point, these descriptions are provided with reference to attached drawing, wherein：
Fig. 1 is the block diagram for the digital camera system for showing the illustrative embodiments according to the disclosure；
Fig. 2 is the configuration of the camera module for the digital camera system for showing the illustrative embodiments according to the disclosure
Diagram；
Fig. 3 is the Autofocus Processor for the digital camera system for showing the illustrative embodiments according to the disclosure
The diagram of function；
Fig. 4 and Fig. 5 is the diagram of calibration (pretreatment) process for showing the illustrative embodiments according to the disclosure；
Fig. 6 is the figure of the image compensation process in the first processor shown according to the illustrative embodiments of the disclosure
Show；
Fig. 7 is to show between the picture frame calculated in application processor according to the illustrative embodiments of the disclosure
The diagram of the process of mobile pixel (moving pixel) information；And
Fig. 8 is the stream for being used to control the method for digital camera system for showing the illustrative embodiments according to the disclosure
Cheng Tu.
Specific embodiment
The target of the disclosure, feature and excellent can be more clearly understood from the specific descriptions of following exemplary embodiment
Point, these descriptions are provided with reference to attached drawing.Throughout the drawings, identical reference number is used to indicate same or similar
Component, and its extra description will be omitted.Further, in the following description, term " first ", " second ", " side ",
" opposite side " etc. be used to distinguish specific components and other components, but the configuration of these components is not construed as
It is limited by these terms.Further, in the description of the disclosure, when the detailed description for determining related field will obscure this public affairs
During the purport opened, its description will be omitted.
Hereinafter, will be described in detail with reference to the attached drawings according to the digital camera systems of the illustrative embodiments of the disclosure and
For controlling the method for the digital camera system.
Fig. 1 is the block diagram for the digital camera system for showing the illustrative embodiments according to the disclosure, and Fig. 2 is shows
According to the diagram of the configuration of the camera module of the digital camera system of the illustrative embodiments of the disclosure, Fig. 3 is shows
According to the diagram of the function of the Autofocus Processor of the digital camera system of the illustrative embodiments of the disclosure.
As depicted in figs. 1 and 2, photograph can be included according to the digital camera system 10 of the illustrative embodiments of the disclosure
Machine module 140, motion sensor 100, first processor 110, optical drive 120, optical drive module 130, second processing
Device 160, memory 170 and Autofocus Processor 180.Digital camera system 10 can for example be included in mobile multifunctional and set
In standby (such as digital camera, cellular phone and tablet computer) or it is included in laptop computer, desktop computer etc.,
But digital camera system 10 is without being limited thereto.
Motion sensor 100 can be in the internal or external offer of camera module 140, and can generate or export and shine
The corresponding exercise data of movement of camera model 140.Motion sensor 100 can include angular-rate sensor 101 and acceleration
Sensor 102.Angular-rate sensor 101 can sense the variation of the rotational component (angular speed) of camera module 140, such as but
It is not limited to, changes caused by hand shaking or interference etc..Acceleration transducer 102 can be with the change of sense linear component (speed)
Change, such as, but not limited to, change caused by the movement on the horizontal or vertical direction of camera module 140.
Such as：1) angular-rate sensor 101 can be gyro sensor, can sense the two of yaw axis and pitch axis
The variation of the angular speed of the movement of camera module 140 is taken a picture with compensating caused by the hand shaking of user or interference on a direction
The vertically and horizontally shake or movement of machine module 140 and 2) acceleration transducer 102 can sense due to user movement or
The variation of camera module 140 caused by interference horizontal (x-axis) or vertical (y-axis) square upward velocity, and due to camera mould
Linear component caused by the movement of block 140 corresponds to.
Lens unit 141 can include lens barrel 141a and position sensor 142.Lens barrel 141a can include figure
As sensor 141b and lens group (not shown), optical treatment is carried out to the light for carrying out autonomous agent 141c to detect or capture such as
The picture frame of the image of static (still) of main body 141c or mobile picture.Position sensor 142 can sense lens barrel
The change in location of 141a (referring to Fig. 3).
For example, lens group (not shown) can include at least one of zoom lens, condenser lens and offset lens.Figure
As sensor 141b may, for example, be, but be not limited to, charge (CCD), complementary metal oxide semiconductor (CMOS)
Or the arbitrary equipment for electric analoging signal being converted to by the optical signalling of the light of lens barrel 141a incidences.Position sensor
142 can sense the change in location of lens barrel 141a to transmit the current location information of lens barrel 141a to first processor
110.Position sensor 142 can be, for example, but be not limited to, and be come using wherein voltage with the Hall effect of change of magnetic field strength
Detect the Hall sensor (not shown) of the current location of lens barrel 141a.
Optical drive 120 can generate optical drive module 130 driving voltage and control signal with according to from first
The control signal that processor 110 inputs carrys out mobile lens unit 141.
In addition, optical drive 120 can based on control lens unit 141 moving range control signal it is corresponding
Handover operation controls the driving of optical drive module 130.Optical drive 120 can be, for example, but be not limited to, motor driving
Integrated chip (IC).Optical drive 120 can be embedded in first processor 110.
In this embodiment, optical drive module 130 can include the comprising voice coil motor (VCM) or piezoelectric device
One and second actuator 131 and 132.First actuator 131 can control lens unit 141 in vertical direction (y-axis direction)
Movement, and the second actuator 132 can control movement of the lens unit 141 in the horizontal direction in (x-axis direction).
First processor 110 can be performed in parallel or concurrently image compensation data generating process and optical compensation process.Example
Such as, optical compensation process can control the movement of lens unit 141 based on exercise data, and image compensation data generating process
The image compensation data corresponding to image can be generated, but not limited to this.Image compensation data generating process and optical compensation mistake
Journey may be performed simultaneously.
For example, optical compensation process can be according to camera module 140 in moving direction (each axial direction, such as x-axis
Or y-axis direction) on displacement distance whether selectively perform in the preset reference range, and its detailed content will be
It is described below.The displacement distance of camera module 140 can be based on such as, but not limited to corresponding with the movement of camera module 140
Exercise data (acceleration or the data of angular speed variation) calculate.
In addition, when performing image compensation data generating process, first processor 110 can based on pre-determined synchronization information come
Generation and the image compensation data of each image frame synchronization of image.For example, image compensation data ID(referring to Fig. 6) can include
It is configured with the virtual data of sky data and is configured with the focus information of lens unit 141 and the movement number depending on acceleration change
According to metadata.
For example, by using synchronizing information (the detection opportunity (timing) of the focus information of lens unit 141 and movement number
According to referring to Fig. 5), first processor 110 can be with 1) by virtual data and the period or the part that wherein perform optical compensation process
The image frame synchronization of middle acquisition and 2) by metadata be wherein not carried out optical drive process period or part in obtain
Image frame synchronization.
In addition, optical drive processor or first processor 110 can be by image compensation data IDIt is stored in memory 170
In or by image compensation data IDIt is sent to application processor or second processor 160.
When performing optical compensation process, first processor 110 can be (every in moving direction according to camera module 140
A axial direction, such as x-axis or y-axis direction) on displacement distance (its can be based on exercise data calculate) whether in default
Optical compensation process is selectively performed in term of reference.
Exercise data can include, but not limited to, e.g. the camera module 140 caused by the hand shaking of user or interference
Rotational component (angular speed) and the linear component (acceleration) of the movement of camera module 140 in the horizontal or vertical directions
Data.
When the displacement distance of camera module 140 is in term of reference, it is saturating that first processor 110 can perform control
The optical compensation process of the movement of mirror unit 141, so as to compensate the movement of camera module 140.For example, term of reference can
Think on horizontal (x-axis) direction or on vertical (y-axis) direction lens unit maximum mobile range DXOr DY, but not limited to this.
Specifically, first processor 110 can be believed based on the position of the lens barrel 141a transmitted from position sensor 142
It ceases to control the movement of lens barrel 141a, so as to compensate trembling for the image caused by the movement of camera module 140
It is dynamic.For example, first processor 110 can generate control signal in the direction opposite with the moving direction of camera module 140
On ground mobile lens lens barrel 141a as identical with the displacement distance of camera module 140 as possible, and transmit generated control letter
Number to optical drive 120.
Optical drive 120 can generate driving voltage and the control signal of optical drive module 130 with basis or response
Carry out mobile lens unit 141 in the control signal transmitted from first processor 110.In addition, optical drive 120 can be based on
The corresponding handover operation of control signal of mobile lens unit 141 controls the driving of optical drive module 130.
Therefore, it detects or captures by using lens unit in the period of optical compensation process or part is wherein performed
It is possible that 141 compensation, which are shaken caused by the movement of camera module 140 or interfere the picture frame obtained,.
Second processor 160 can use the image compensation data transmitted from first processor 110 to carry out calculation display 190
Mobile Pixel Information between upper each picture frame, and can be compensated later based on the mobile Pixel Information calculated due to shining
The shake or interference of image caused by the movement of camera model 140.
Specifically, second processor 160 can use the image obtained based on synchronizing information with forming the picture frame of image
Offset data, such as virtual data and metadata, to calculate the mobile Pixel Information between each picture frame, and compensate due to shining
The shake or interference of image caused by the movement of camera model 140.For example, second processor 160 can be application processor,
It is assemblied in mobile phone etc., and image sensing processor (ISP) can be included.
Autofocus Processor 180 can calculate each picture frame about the main body obtained by lens unit 141
Focus information (including focal length), and focus information can be transmitted to first processor 110.Focus information can also be by closely
Sensor and/or optics or acoustic apparatus are detected.
For example, as shown in figure 3, Autofocus Processor 180 can control the position of focal length f with from f1It is moved to f2, so as to
In the position of main body 141c P2 is moved to from P1 or when the position of lens barrel 141a is moved to L2 from L1 clearly by master
In the image projection of body to imaging sensor 141b, and such as focal length can be calculated (it is focal length f and projects to image sensing
The distance between image of main body on device 141b) focus information, and later transmission focus information to first processor 110.
What memory 170 generated during can storing the image compensation data generated by first processor 110 and/or calibration
Or the synchronizing information established.Memory 170 can be such as, but not limited to, such as static RAM (SRAM) and dynamic
The volatile memory of random access memory (DRAM) or such as read-only memory (ROM) and the non-volatile memories of flash memory
Device.
Display 190 can be the visually display apparatus of output data, and can be, for example, that cathode is penetrated on the screen
Spool (CRT), liquid crystal display (LCD), plasma display panel (PDP), light emitting diode (LED) and Organic Light Emitting Diode
(OLED), but it is not necessarily limited to this.
Above-mentioned first processor 110, application processor or second processor 160 and auto-focusing processor 180 can
To include the algorithm for performing aforementioned function, and can be by firmware, software or hardware (for example, semiconductor chip or special
Integrated circuit) it realizes.
It hereinafter, will according to calibration (pretreatment) process of the digital camera system of the illustrative embodiments of the disclosure
It is described in more detail with reference to figure 4 and Fig. 5.
Fig. 4 is the flow of the calibration process for the digital camera system for showing the illustrative embodiments according to the disclosure
Figure and Fig. 5 are to show that the calibration of the digital camera system by the illustrative embodiments according to the disclosure is same come what is detected
Walk the diagram of information.
First, as shown in figure 4, calibration (pretreatment) according to the digital camera system of the illustrative embodiments of the disclosure
It can include at least one of the following or multiple steps：1) detect, capture or sense mobile picture using lens unit 141
Each picture frame (S10) of (moving picture) (or static image), 2) obtain the fortune exported from motion sensor 100
Dynamic data (S20) and 3) calculate it is same about the acquisition opportunity of picture frame and exercise data (acquisition timing)
Walk information (S30).Here, calibration can in the early stage the stage be executed once, and memory 170, first can be stored in later
In 110 grade of processor, and it is possible thereby to it is reused.
For example, as shown in figure 5, each image of the mobile picture of composition 1) is detected, captures or sensed by lens unit 141
Frame f1To fn.Here, the shooting speed (cycle T of each picture frame of mobile pictureCAnd detection speed) can be according to mobile picture
Screening-mode (for example, 30 frames (fps) per second or 40fps) being configured differently.
2) motion sensor 100 can be exported due to or corresponding to the movement of camera module 140 (can be with constant speed
Generated during the shooting process of mobile picture) exercise data a1To an(preferably, by the angle speed of gyro sensor detection
The data of the variation of degree).Here, exercise data a1To anOutput speed can be changed according to the setting of motion sensor 100.
3) according to the exercise data a exported from motion sensor 1001To an, detect opportunity t1To t4n+1(in the detection
Machine most accurately represents the picture frame f caused by the movement of camera module 1401To fnMovement exercise data a5Extremely
a4n+1It is detected) it can be calculated, and detect opportunity t1To t4n+1There can be predetermined period Ta.The Δ T expressions of Fig. 5 are being transported
Delay time before the synchronization of dynamic data can be because of the output speed and figure of the exercise data of motion sensor 100
As start shooting speed between difference and generate.
Here, detection opportunity can be configured differently according to the screening-mode (for example, 30fps) of mobile picture, only
An example, and thus detection opportunity be not limited to it is described above.
Extraction opportunity accordingly, with respect to exercise data and each picture frame f of mobile picture can be obtained1To fnOpportunity
Synchronizing information (during the detection of the detection speed (for example, 30fps) of the picture frame of mobile picture and exercise data correspondingly
Machine t5To t4n+1) can be obtained by calibrating (pretreatment) process.
Hereinafter, according to the digital camera system of the illustrative embodiments of the disclosure and for controlling the Digital photographic
The method of system will be described in detail with reference to figure 1,2 and 5 to 8.
Fig. 6 is the image compensation data generation for the digital camera system for showing the illustrative embodiments according to the disclosure
The diagram of process, Fig. 7 are the composition figure calculated in digital camera system for showing the illustrative embodiments according to the disclosure
The diagram and Fig. 8 of the process of mobile Pixel Information between the picture frame of picture are the exemplary implementation shown according to the disclosure
The flow chart for being used to control the method for digital camera system of mode.
First, as shown in figs. 1 and 8, according to the digital camera system 10 of the illustrative embodiments of the disclosure and for controlling
The method for making the digital camera system can perform：1) pass through image (static or shifting of the lens unit 141 to composition main body 141c
Motion picture cartoon) each picture frame shot (detection) (S100).The detection speed of picture frame and period can be according to images
Screening-mode and be arranged differently than.The picture frame of captured mobile picture can be sent to by lens unit 141 at second
Manage device 160.
Next, 2) when the movement of camera module 140 (hand shaking, horizontally or vertically movement or any interference) is by saturating
In the case that mirror unit 141 occurs when the image of main body 141c being shot, captured or sensed (detection), due in movement
The variation of angular speed caused by hand shaking (rotational component on yaw axis or pitching axis direction) and by the level in movement or hang down
The variation (velocity variations on horizontal (x-axis) or vertical (y-axis) direction) of acceleration caused by the upward linear movement of Nogata
Exercise data can export (S110) from motion sensor 100.
Next, 3) first processor 110 can perform Image Compensation data generating procedure, based on by calibrated presets
Synchronizing information is (in the detection opportunity t of exercise data5To 54n+1In, corresponding to current mobile picture shooting speed (for example,
30fps or 50fps) synchronizing information (the detection opportunity of exercise data)) can generate and the image frame synchronization of mobile picture
Image compensation data (being configured with virtual data and metadata) (S120).
In addition, 4) first processor 110 can use the angular speed for applying autokinesis sensor 100 (in yaw axis or to bow
Face upward the rotational component in axis direction) and acceleration (velocity variations on horizontal (x-axis) or vertical (y-axis) direction) exercise data
Calculate the displacement distance of camera module 140 on practical moving direction and horizontal (x-axis) or vertical (y-axis) direction, so as to
Determine whether to perform optical compensation process (S130).
For example, first processor 110 can determine the camera module 140 in horizontal (x-axis) or vertically (y-axis) direction
Whether displacement distance is in preset reference range (such as, but not limited to level (DX) direction and vertical (DY) lens unit on direction
141 maximum mobile range) in.
In addition, i) when the displacement distance of camera module 140 is in term of reference, first processor 110 can be from
The current location information of 142 receiving lens lens barrel 141a of position sensor.Ii) first processor 110 can be based on location information
The movement of lens barrel 141a is controlled to compensate the shake of the image for the movement for depending on camera module 140.Such as at first
Reason device 110 can generate control signal on the direction opposite with the direction of motion of camera module 140 as far as possible with photograph
The practical displacement distance of machine module 140 mobile lens unit 141, and transmit generated control signal to optical drive in the same manner
Device 120.
Iii the control signal and driving that) optical drive 120 can be based on control signal generation optical drive module 130
Electric current, and later optical drive module (such as, but not limited to voice coil motor or piezoelectric device) 130 is controlled using control signal
Driving, so as to perform control lens unit 141 moving range optical drive process.
Here, the first actuator 131 can control the movement and second of lens unit 141 in vertical direction (y-axis direction)
Actuator 132 can be with the movement of lens unit 141 in controlled level direction (x-axis direction).
First processor 110 can be with i) based on synchronizing information (such as with being set in the calibration of generation image compensation data
The current detection opportunity of the corresponding exercise data of shooting speed shot to mobile picture) by virtual data with wherein
The picture frame (compensating picture frame by the hand shaking of optical compensation process) for performing the image obtained in the part of optical compensation is synchronous
(S140)。
In addition, first processor can be with ii) by metadata and the figure that obtains in the part for being wherein not carried out optical compensation
The image frame synchronization (S150) of picture.Here, virtual data can be configured null data (negligible value is skimble-skamble
Value), and metadata can be configured with the exercise data of each picture frame of the mobile picture of shooting (for example, acceleration change
Data) and lens unit 141 focus information (such as focal length).
Autofocus Processor 180 can obtain opportunity t in picture frame1To t4n+1Calculate the focus information of lens unit 141
(for example, focal length) by focus information (for example, focal length) to be sent to first processor 110.
For example, as shown in fig. 6,1) by lens unit 141 with constant shooting speed (such as 30fps) detection, capture or sense
The each picture frame f for the mobile picture surveyed1To fnSecond processor 160 can be transferred into and 2) be based on and camera module
The 140 corresponding exercise data of movement (e.g., acceleration change and the data of angular speed variation), first processor 110 can be true
Whether displacement distance of the camera module 140 in horizontal (x-axis) or vertical (y-axis) direction is determined in preset reference range (example
As but be not limited to level (D as shown in Figure 2X) and vertical (DY) lens unit 141 on direction maximum mobile range)
It is interior with determine whether perform optical drive process.
3) first processor 110 can perform image compensation process parallel, can generate and be configured with based on corresponding to shifting
Synchronizing information (such as, but not limited to, the detection opportunity t of exercise data of the shooting speed of motion picture cartoon5、t9And t13To t4n+1)
With the virtual data of image frame synchronization and the image compensation data I of metadataD。
For example, i) virtual data D1、D2、D3、……、DnIt can be based on part or the period for performing optical compensation wherein
(for example, part a or when displacement distance of the camera module 140 in horizontal (x-axis) or vertical (y-axis) direction is in default ginseng
When in the range of examining) in obtain image picture frame synchronizing information (for example, detection opportunity t5、t9、t13To t4n+1) and it is same
Step.
Ii) based on synchronizing information, metadata can be with being wherein not carried out the part of optical compensation (for example, part b or when shining
Displacement distance of the camera model 140 in horizontal (x-axis) or vertical (y-axis) direction is beyond preset reference range or in preset reference
When except range) in obtain image image frame synchronization (for example, machine t when detecting5、t9、t13To t4n+1The metadata of acquisition
M4、M5And M6To Mn(exercise data of each picture frame of the mobile picture of shooting and focus information (such as lens unit 141
Focal length)) can be with the image frame synchronization of image that is obtained in part b.
Iii) therefore, according to whether being detected, being sensed or all picture frame f of capture images by lens unit 1411To fn
Shi Zhihang optical drive processes pass through the image compensation data I for the image that image compensation data generating process generatesD=D1、D2、
D3、…、M4、M5And M6To MNCan be configured with pre-determined synchronization information based on the shooting speed corresponding to mobile picture with
The virtual data and metadata of image frame synchronization.
In addition, at the end of the shooting to image, first processor 110 can store the figure of image in memory 170
As offset data or image compensation data is transmitted to second processor 160.
Next, second processor 160 can use the image compensation data transmitted from first processor 110 to calculate structure
Into the mobile Pixel Information (S160) between each picture frame of image.
For example, second processor 160 can use the acceleration of picture frame and motion sensor 100 for forming image to become
The metadata M of the exercise data of change and focus information including lens unit 1414、M5And M6To MNCome calculate each picture frame it
Between mobile Pixel Information, picture frame and exercise data and metadata are synchronous at the acquisition opportunity of each picture frame.
For example, as shown in fig. 7, the mobile Pixel Information between picture frame in second processor 160 can be by following
Equation 1 to 4 calculates, wherein WdRepresent the horizontal distance or width of imaging sensor 141b, visual field (FOV) represents visual angle, RSTable
Show the screen resolution (figure setting value) of display, δpRepresent the quantity of the mobile pixel of each picture frame on display, with
And δSRepresent the displacement distance of camera module 140.
Here, it (is obtained using the exercise data of the focal length of lens unit 141 and acceleration change by acceleration transducer 102
The data taken) the mobile Pixel Information between the picture frame that calculates can include the quantity and moving direction of mobile pixel.
[equation 1]
Wd=2*1*tan (FOV/2)
[equation 2]
δp：δs=Rs：Wd
[equation 3]
δs=∫ ∫ (δ2s/δt2)
[equation 4]
δp=δs*Rs/(2*tan(FOV/2))
Next, since the mobile Pixel Information between the picture frame that is calculated by second processor 160 can be stored in
In 170 grade of memory, and the image compensated can by using image and corresponding to the image mobile Pixel Information via
The outputs such as special player, this is compared to for image taking and later using the post-compensation (post- of image processing techniques
Compensation) method can more reduce power consumption and the processing time of image compensation.
As described above, according to the digital camera system of the illustrative embodiments of the disclosure can according to may static or
Movement (hand shaking, horizontal/vertical movement or any interference) Parallel application optical compensation process that mobile picture occurs when being taken
With image compensation data generating process, so as to shorten image compensation process time to movement and ensure that image compensation can
By property.
Although the preferred embodiment of the disclosure is disclosed for illustration purposes, they are for having
Body explains the disclosure and therefore according to the digital camera system of the disclosure and for controlling the method for the digital camera system not
Limited to this, skilled person will understand that without departing substantially from the scope of the present disclosure such as disclosed in the accompanying claims
In the case of spirit, various modifications can be carried out, increases and replaces.
Therefore, any and all modifications, deformation or equivalent arrangement are considered as falling within the scope of the disclosure, and public
The detailed range opened will be disclosed by following claims.
Claims (30)
1. a kind of digital camera system, which includes：
Lens unit detects the image of main body；And
First processor controls the movement of the lens unit simultaneously based on the corresponding exercise data of movement with camera module
Generation image compensation data corresponding with described image,
Wherein, described image offset data includes virtual data and metadata,
The virtual data in the first processor based on the exercise data by using pre-determined synchronization information and with being controlled
The image frame synchronization of the described image obtained in the part of the movement of the lens unit,
The portion of movement of the metadata with being not based on the exercise data control lens unit in the first processor
The image frame synchronization of the described image obtained in point.
2. digital camera system according to claim 1, wherein the first processor exists according to the camera module
Whether displacement distance on moving direction in preset reference range selectively controls the movement of the lens unit, institute
Displacement distance is stated to be calculated based on the exercise data.
3. digital camera system according to claim 2, wherein the displacement distance in the camera module is in
When in the term of reference, the first processor controls the lens unit based on the location information of the lens unit
It is mobile.
4. digital camera system according to claim 3, wherein the term of reference can for the maximum of the lens unit
Moving range.
5. digital camera system according to claim 2, wherein：
The first processor is based on the synchronizing information and generates described image offset data, the image compensation data and the figure
Each image frame synchronization of picture,
The virtual data include empty data and
The metadata includes the focus information of the exercise data and the lens unit, and the exercise data is included about adding
The information of velocity variations.
6. digital camera system according to claim 1, which further includes：
Second processor forms described image by using the described image offset data calculating generated by the first processor
Each picture frame between mobile Pixel Information and based on the mobile Pixel Information compensation described image.
7. digital camera system according to claim 6, which further includes：
Autofocus Processor, calculate the lens unit focus information and the transmission focus information at described first
Manage device.
8. digital camera system according to claim 1, wherein the exercise data includes：
Represent the data of the variation of the rotational component of the camera module；And
Represent the data of the variation of the linear component of the camera module.
9. digital camera system according to claim 7, which further includes：
Memory stores the described image offset data generated by the first processor；And
Display exports the described image compensated by the second processor.
10. digital camera system according to claim 2, which further includes：
Optical drive module, the mobile lens unit；And
Optical drive is generated according to the control signal of the movement for the lens unit transmitted from the first processor
Driving voltage and control signal simultaneously apply the driving voltage generated and control signal to the optical drive module.
11. digital camera system according to claim 1, wherein the lens unit is included in the camera module
In.
12. digital camera system according to claim 1, wherein the first processor will be based on the exercise data control
The movement and generation described image offset data corresponding with described image for making the lens unit merge.
13. a kind of method for controlling digital camera system, this method includes：
Detect the image of main body；
The movement of lens unit is selectively controlled based on the corresponding exercise data of movement with camera module；And
Generation image compensation data corresponding with described image, described image offset data include virtual data and metadata,
It is wherein parallel to perform to the control of movement of the lens unit and the generation of described image offset data,
Wherein, the generation of described image offset data includes：
By the virtual data and the described image that is obtained in the part for performing the control to the movement of the lens unit
Image frame synchronization；And
By the metadata and the described image that obtains in the part for the control for being not carried out the movement to the lens unit
Image frame synchronization.
14. according to the method for claim 13, wherein the control of the movement to the lens unit includes：
The moving direction and displacement distance of the camera module are calculated based on the exercise data；
Determine the displacement distance whether in preset reference range；And
When the displacement distance is in the term of reference, the displacement distance and moving direction of the lens unit are controlled.
15. the method according to claim 11, wherein
The virtual data includes empty data, and the metadata includes the focal length letter of the exercise data and the lens unit
Breath, the exercise data include the information about acceleration change.
16. according to the method for claim 15, wherein the focus information of the lens unit is by automatic focusing
Device calculates and transmission.
17. according to the method for claim 13, this method further includes：
Receive described image offset data；
The quantity of the mobile pixel for each picture frame for forming described image is calculated by using described image offset data；With
And
Quantity compensation described image based on the mobile pixel.
18. according to the method for claim 13, this method further includes：
Before the detection described image,
Each picture frame of the described image of the main body is detected by the lens unit；
Detect the exercise data corresponding with the movement of the camera module from motion sensor；And
Calculate the synchronizing information on the acquisition opportunity about described image frame and the exercise data.
19. a kind of digital camera system, which includes：
Lens unit detects the image of main body；And
First processor calculates the movement of camera module based on the corresponding exercise data of movement with the camera module
Whether direction and displacement distance simultaneously determine the displacement distance of the camera module on the moving direction in default
In term of reference, and image compensation data corresponding with described image is generated,
Wherein, described image offset data includes virtual data and metadata,
The virtual data in the first processor based on the exercise data by using pre-determined synchronization information and with being controlled
The image frame synchronization of the described image obtained in the part of the movement of the lens unit and
The portion of movement of the metadata with being not based on the exercise data control lens unit in the first processor
The image frame synchronization of the described image obtained in point.
20. digital camera system according to claim 19, wherein：
The first processor is generated in the displacement distance of the camera module when except the term of reference to be included
The metadata of the exercise data, and when the displacement distance of the camera module is in the term of reference
Control the lens unit movement and
The lens unit detection passes through the movement for mobile the compensated picture frame for controlling the lens unit.
21. digital camera system according to claim 20, wherein at the displacement distance of the camera module
When in the term of reference, location information of the first processor based on the lens unit controls the lens unit
It is mobile.
22. digital camera system according to claim 20, wherein the metadata is included based on pre-determined synchronization information
The focus information of the exercise data and the lens unit, the exercise data include the information about acceleration change, institute
State exercise data and do not control the movement of the lens unit in the first processor part in the described image frame that obtains
It is corresponding.
23. digital camera system according to claim 22, which further includes：
Second processor calculates the mobile Pixel Information about each picture frame using the metadata and is based on the shifting
Dynamic Pixel Information compensation described image.
24. digital camera system according to claim 23, which further includes：
Autofocus Processor, calculate the lens unit the focus information and the transmission focus information to described the
One processor.
25. a kind of digital camera system, which includes：
Camera module, the lens unit including being used to sense image；And
Processor controls the movement of the lens unit and generates for compensating in response to the movement of the camera module
The image compensation data of the image of sensing,
Wherein, described image offset data includes virtual data and metadata,
The virtual data by using pre-determined synchronization information and in movement of the processor based on the camera module
Control the described image obtained in the part of the movement of the lens unit image frame synchronization and
The metadata and the movement that lens unit described in the motion control of the camera module is not based in the processor
Part in the image frame synchronization of described image that obtains.
26. digital camera system according to claim 25, wherein the shifting that the processor will control the lens unit
The dynamic data with generating the image sensed for compensation merge.
27. digital camera system according to claim 25, wherein shifting of the processor according to the camera module
Dynamic distance selectively controls the movement of the lens unit.
28. digital camera system according to claim 27, wherein at the displacement distance of the camera module
When in preset range, the processor controls the movement of the lens unit based on the location information of the lens unit,
And the camera module the displacement distance when except the preset range, processor generation include about
The focus information of the data of the information of acceleration change and the lens unit.
29. digital camera system according to claim 28, wherein the preset range is the removable of the lens unit
Dynamic range.
30. digital camera system according to claim 25, wherein image of the processor based on the image sensed
Mobile Pixel Information compensation described image between frame.
Applications Claiming Priority (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| KR10-2014-0046885 | 2014-04-18 | ||
| KR20140046885 | 2014-04-18 | ||
| KR1020140076061A KR101642569B1 (en) | 2014-04-18 | 2014-06-20 | Digital photographing System and Controlling method thereof |
| KR10-2014-0076061 | 2014-06-20 |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105049682A CN105049682A (en) | 2015-11-11 |
| CN105049682B true CN105049682B (en) | 2018-06-29 |
Family
ID=54428960
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510113209.3A Active CN105049682B (en) | 2014-04-18 | 2015-03-16 | Digital camera system and the method for controlling the digital camera system |
Country Status (2)
| Country | Link |
|---|---|
| KR (1) | KR101642569B1 (en) |
| CN (1) | CN105049682B (en) |
Families Citing this family (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105391943B (en) * | 2015-12-03 | 2019-04-26 | Oppo广东移动通信有限公司 | The quick focusing method and system of filming apparatus |
| KR102530761B1 (en) * | 2016-08-03 | 2023-05-11 | 삼성전자주식회사 | Image sensor, camera module and apparatus comprising the same |
| JP6674701B2 (en) * | 2016-09-28 | 2020-04-01 | ルネサスエレクトロニクス株式会社 | Image processing module and semiconductor system |
| US11202006B2 (en) | 2018-05-18 | 2021-12-14 | Samsung Electronics Co., Ltd. | CMOS-assisted inside-out dynamic vision sensor tracking for low power mobile platforms |
| CN110049238B (en) * | 2019-03-26 | 2021-09-07 | Oppo广东移动通信有限公司 | Camera anti-shake system and method, electronic device, and computer-readable storage medium |
| CN109922264B (en) * | 2019-03-26 | 2022-02-18 | Oppo广东移动通信有限公司 | Camera anti-shake system and method, electronic device, and computer-readable storage medium |
| CN110035228B (en) * | 2019-03-26 | 2021-09-07 | Oppo广东移动通信有限公司 | Camera anti-shake system, camera anti-shake method, electronic device, and computer-readable storage medium |
| KR20200122013A (en) * | 2019-04-17 | 2020-10-27 | 엘지이노텍 주식회사 | A camera module and an optical instrument including the same |
| CN112839177B (en) * | 2021-01-20 | 2023-07-04 | 北京小米移动软件有限公司 | Lens control method, lens control device and storage medium |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1806202A (en) * | 2003-06-09 | 2006-07-19 | 奥林巴斯株式会社 | Image capture device |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4511766B2 (en) * | 2000-07-10 | 2010-07-28 | 株式会社リコー | Image capturing apparatus and shake correction method in image capturing apparatus |
| JP4717748B2 (en) * | 2006-08-11 | 2011-07-06 | キヤノン株式会社 | Camera body and camera system having the same |
| JP2009145852A (en) * | 2007-11-22 | 2009-07-02 | Fujifilm Corp | Automatic focusing device, camera, automatic focusing method |
| KR101528860B1 (en) * | 2008-12-11 | 2015-06-15 | 삼성전자주식회사 | Method and apparatus for correcting a shakiness in digital photographing apparatus |
| KR101575630B1 (en) | 2009-03-17 | 2015-12-08 | 삼성전자주식회사 | Driving assembly for image stabilization of digital camera |
-
2014
- 2014-06-20 KR KR1020140076061A patent/KR101642569B1/en active IP Right Grant
-
2015
- 2015-03-16 CN CN201510113209.3A patent/CN105049682B/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1806202A (en) * | 2003-06-09 | 2006-07-19 | 奥林巴斯株式会社 | Image capture device |
Also Published As
| Publication number | Publication date |
|---|---|
| KR20150120832A (en) | 2015-10-28 |
| KR101642569B1 (en) | 2016-07-26 |
| CN105049682A (en) | 2015-11-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105049682B (en) | Digital camera system and the method for controlling the digital camera system | |
| KR102143456B1 (en) | Depth information acquisition method and apparatus, and image collection device | |
| WO2020088133A1 (en) | Image processing method and apparatus, electronic device and computer-readable storage medium | |
| US9699381B2 (en) | Digital photographing motion compensation system and method | |
| TWI394435B (en) | Method and system for determining the motion of an imaging apparatus | |
| US8433185B2 (en) | Multiple anti-shake system and method thereof | |
| CN104735347A (en) | Autofocus adjusting method and apparatus | |
| CN107295268A (en) | The dark angle compensation method of image, device and terminal device | |
| KR20160140193A (en) | Circuit for correcting image and correcting image Method thereof | |
| CN113875219B (en) | Image processing method and device, electronic equipment and computer readable storage medium | |
| JP2012039591A (en) | Imaging apparatus | |
| KR102592745B1 (en) | Posture estimating apparatus, posture estimating method and computer program stored in recording medium | |
| KR102305118B1 (en) | Method for stabilizing image and electronic device thereof | |
| JP7387713B2 (en) | Imaging device, solid-state imaging device, camera module, drive control unit, and imaging method | |
| JP2020056953A (en) | Anti-shake device, image processing apparatus, and detection method | |
| JP2010147661A (en) | Electronic camera | |
| US10097758B2 (en) | Data processing apparatus, data processing method, and recording medium | |
| CN114760465A (en) | System and method for calculating anti-shake performance of camera | |
| US8619149B2 (en) | Camera with an image sensor that doubles as a motion sensor | |
| JP2011041186A (en) | Electronic camera | |
| JP7119678B2 (en) | Interchangeable lens and camera body | |
| JP5525807B2 (en) | camera | |
| KR20140124431A (en) | Photographing apparatus | |
| TW201632974A (en) | Image capture system | |
| CN116437207A (en) | Optical anti-shake method and apparatus, electronic device, and computer-readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |