CN102821241B - Device and method using object moving trend to drive shutter - Google Patents
Device and method using object moving trend to drive shutter Download PDFInfo
- Publication number
- CN102821241B CN102821241B CN201110157004.7A CN201110157004A CN102821241B CN 102821241 B CN102821241 B CN 102821241B CN 201110157004 A CN201110157004 A CN 201110157004A CN 102821241 B CN102821241 B CN 102821241B
- Authority
- CN
- China
- Prior art keywords
- image
- moving article
- shutter
- resolution
- prediction
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Landscapes
- Studio Devices (AREA)
- Exposure Control For Cameras (AREA)
Abstract
The invention discloses a device and a method using an object moving trend to drive a shutter. The device comprises an inductor, a prediction mobile system and an automatic shutter control device. The inductor is used for performing an image capture process, wherein the image capture process captures a first image of a moving object by a first resolution, the prediction mobile system analyzes the first image to judge prediction time needed by the moving object to arrive at a feature point. The automatic shutter control device performs an automatic shutter control process according to the prediction time, and a second image of the moving object is captured by a second resolution, wherein the second resolution is larger than the first resolution. According to the device and the method using the object moving trend to drive the shutter, the prediction mobile system analyzes the moving object and automatically captures the second image needed by a user at the feature point of the moving object.
Description
Technical field
The present invention relates to a kind of system and method driving shutter, particularly relates to a kind of system and method utilizing object mobile trend to drive shutter.
Background technology
Digital still camera now, because the increase of operational capability, introduces the function of automatic shooting gradually.For example, some camera can pass through detecting face location, and being transferred to can the The Cloud Terrace of movement automatically, and utilizes the mutual feedback between these two devices, and main body be seated in the middle of picture, after face location meets specified conditions, camera will automatically snap.
Because there is the design automatically driving shutter like this through human face detection, many distortion about such concept recently and application are also arisen at the historic moment.For example, market there have been many cameras included the design of smile shutter in, have made when taking portrait, the time of shooting can have been determined through the expression of the shooting body by camera.Other similar application also comprise as pet pattern, detecting nictation or human face recognition, only just drive the design of shutter when known main body personage occurs smiling expression.These some automatically drive shutter design, mostly concentrate on the application of face or known main body or behavior, use all to be through and compare with main body in data bank, when automatically driving shutter again after comparison success.But the above is all be applied in static main body, is not considered the shooting of moving article.
When taking photograph, except the main body of static state, we are also normal retains dynamic moment, and these some dynamic objects are often not limited to camera can the theme (as face, pet or expression) of identification.For example, in extreme sport, human body moves in half-pipe through slide plate, and makes action of all kinds at peak.If only transmit detecting face or expression, the action that human body is made at peak cannot be automatically snapped.
Comply with presently, dynamic photograph is more difficult shooting, mainly because will motive objects be taken, or need to drive shutter through artificial intervention and operation, wherein, people has the delay in reaction time, therefore when seeing the picture wanting to take, pressing shutter and often missing the most excellent a moment.
Under the progress of CMOS (Complementary Metal Oxide Semiconductor) (Complementary Metal-Oxide-Semiconductor) processing procedure, because of the minimizing of its noise problem and the feature of high-speed sampling, the degree of difficulty of moving article photography also declines gradually, for current technology, CMOS (Complementary Metal Oxide Semiconductor) at a high speed can allow the resolution of the picture element of more than 10,000,000 usually, the speed of tens of is opened, each moment of record move object with number of samples per second.But such solution needs to spend sizable cost just feasible.With the photograph of 10,000,000 picture elements, shooting per second ten is example, has the solution that two kinds are possible:
1. the design of image processing hardware is accelerated, but such design can increase huge hardware demand, and this design only does optimization for this pattern, the demand of its logic may be more than ten times of required amount of logic under general screening-mode, extra cost can be made like this to increase, and is not a feasible scheme usually.
2. utilize external memory first to be stored by undressed filmed image, then through the mode of reprocessing, from external memory readout process after image capture.But such mode needs quite huge memory space, single just untreated image, the storage area just needing 100 megabit tuples (MB:Mega Byte) per second, although lower compared to the cost payout of aforementioned (1) item, equally need the cost additionally paying external memory.
In addition, rotate in follow shot instantaneously at face, perhaps the mechanism of existing human face detection can be utilized, as the foundation driving shutter, but such method may have two problems and cause the photograph successfully cannot taken user and want: the first, because human face detection is the computing belonging to object matching, calculation process cannot complete usually immediately, so at human face detection to afterwards, mobile agent has not been there is same posture usually.The second, when face moves or rotate, covering (when such as face rotates, hair covers part face) of mobile fuzzy to a certain degree or object may be caused, therefore likely cause the situation cannot detecting face to occur.
Summary of the invention
In view of this, object of the present invention is just to provide a kind of system and method utilizing object mobile trend to drive shutter, to solve the problem that moving article is difficult to take.
For reaching above-mentioned purpose, the present invention by the following technical solutions: a kind of object mobile trend that utilizes drives the system of shutter, comprises: inductor, prediction mobile system and automatic gate control device.Inductor is used for performing image capture flow process, wherein image capture flow process is with the first image of the first resolution acquisition moving article, in addition, prediction mobile system system is electrically connected inductor, wherein predict that mobile system is used for analysis first image to judge that moving article arrives the predicted time needed for characteristic point, here will should be mentioned that especially, characteristic point refers to that moving article compares the characteristic point of tool in motion track, and such as, peak in motion track or vertical speed are the position of zero.In addition, automatic gate control device system is electrically connected prediction mobile system, and wherein automatic gate control device performs automatic gate control flow according to predicted time, and makes inductor with the second image of the second resolution acquisition moving article, wherein, the second resolution is greater than the first resolution.In fact, the second resolution can be 4096 × 3072pixels, and the first resolution can be 640 × 480pixels.
According to the method utilizing object mobile trend to drive shutter of the present invention, comprise: perform image capture flow process, wherein image capture flow process is with the first image of the first resolution acquisition moving article; The first image is analyzed to judge that moving article arrives the predicted time needed for a characteristic point by prediction mobile system; Then automatic gate control flow is performed according to predicted time, and with the second image of the second resolution acquisition moving article, wherein, second resolution is greater than the first resolution, for example, first resolution can be 640 lower × 480pixels, and the second resolution can be 4096 higher × 3072pixels.In other words, the present invention utilizes prediction mobile system to predict that described moving article arrives the predicted time of characteristic point, and automatically snaps at predicted time.Wherein, prediction mobile system realizes with Kalman filter, Kalman filter can arrive the time of characteristic point according to the position of moving article, speed, acceleration, angle, angular speed or angular acceleration prediction moving article, characteristic point can set according to needed for user.For example, moving article does a parabolic motion, and user wants to take moving article in the situation of peak, and therefore user just can set moving article and takes when vertical speed is zero, to obtain the photograph of moving article at peak.In fact, Kalman filter can also according to the size of moving article, size variation, focusing from, focusing from change with obtain predicted time to coke number, make described automatic gate control flow according to described described second image coke number being captured to described moving article.Wherein, also can pass through described in particle filter correction coke number.In addition, in automatic gate control flow, also comprise analyze moving article according to prediction mobile system result to adjust acquisition the second image time photosensitivity size and the time for exposure.
In addition, in the step of acquisition second image, also comprise by image sensing process (ISP Pipeline:Image Sensor processing pipeline), be image data by the second image processing, and image data can be stored to external memory to retain image data.
From the above, according to the system and method utilizing object mobile trend to drive shutter of the present invention, there is following advantage:
1. the object mobile trend that utilizes of the present invention drives the system and method for shutter to be to predict that moving article arrives the predicted time of characteristic point by prediction mobile system, and automatically snap at predicted time, therefore do not need again through manual operation, thus avoid the error of human response's time.
2. required to coke number, photosensitivity size and time for exposure when predicting that mobile system can also predict shooting.
For the effect further understanding and be familiar with technical characteristic of the present invention and reach, describe in detail below in conjunction with preferred embodiment.
Accompanying drawing explanation
Fig. 1 is that the present invention utilizes object mobile trend to drive the embodiment schematic diagram of the method for shutter.
Fig. 2 is the schematic diagram that moving article does parabolic motion.
Fig. 3 is that the present invention utilizes object mobile trend to drive the embodiment schematic diagram of the system of shutter.
Fig. 4 is that the present invention utilizes object mobile trend to drive another embodiment schematic diagram of the system of shutter.
Main element symbol description
200: step 210: step 220: step
300: moving article 310: peak
400: inductor 401: Video Graphics Array
402: full resolution 403: the first resolution
404: the second resolutions 410: prediction mobile system
411: Kalman filter 412: particle filter
420: automatic gate control device 430: image sensing processing unit
440: external memory 500: the first image
510: the second images 520: image data
600: moving article
Embodiment
Hereinafter with reference to relevant drawings, illustrate that the object mobile trend that utilizes according to the preferred embodiment of the present invention drives the system and method for shutter, for ease of understanding, the similar elements same-sign in following embodiment indicates and illustrates.
Be illustrated in figure 1 the method schematic diagram utilizing object mobile trend to drive shutter of the present invention.In institute's diagram, step 200 is for performing image capture flow process, and wherein image capture flow process is with the first image of the first resolution acquisition moving article.In more detail, image capture flow process as to take photograph time prebrowsing system, usually user is only the state utilizing prebrowsing system to determine the object oneself taken in the case, such as mainly being taken, whether position is in the middle of photograph for object, or whether shooting object can be all held in photograph etc., in addition, user also can adjust the parameter of various camera at this moment, such as, whether will use the thin portion setting of photoflash lamp etc.
Then, step 210 analyzes the first image to judge that moving article arrives the predicted time needed for characteristic point by prediction mobile system.Here will should be mentioned that especially, characteristic point refers to a certain state defining described moving article according to user, such as moving article the most high/low point, maximum/little speed etc. in movement locus.Below enumerate the embodiment of a prediction mobile system, wherein, prediction mobile system is Kalman filter (Kalman Filter), and Kalman filter can the track of record move object, as afterwards to the foundation of moving article behavioural analysis; Also can predict the position that object occurs, follow the trail of comparison reference when mating as moving article.When using Kalman filter, usually can be divided into two kinds of stages, first stage is prediction, and second stage revises.The computing in these two stages is all come from the motion of moving article to utilize linear equation to simulate.
As (1) formula, moving article, will be relevant to time k-1 with moving article in the state of time k.Both correlations then depend on matrix F
kdefinition.For parabolic motion, state x described herein
k-1include the position of moving article, speed or acceleration etc.Through such model, Kalman filter can in the moving article state of forecast period by the next time
X
k-1calculate, as (2) formula.
x
k＝F
kx
k-1+B
ku
k+w
k(1)
For in parabolic motion, please refer to Fig. 2, Fig. 2 is the schematic diagram that moving article does parabolic motion.As shown in Figure 2, when we want to find moving article 300 peak 310, according to physical law, be the position of zero in vertical speed exactly, through the hypothesis of such characteristic point, can go out through Kalman filter prediction the predicted time that moving article 300 arrives characteristic point.
In addition, if for face rotation, just by the object state x of Kalman filter
kchange to the angle of face, angular speed or angular acceleration, use prediction face in the time of getting back to zero degree (face front).
Then step 220 performs automatic gate control flow according to predicted time, and with the second image of the second resolution acquisition moving article, wherein, second resolution is greater than the first resolution, for example, first resolution can be 640 × 480pixels, and the second resolution can be 4096 × 3072pixels.
But, due to we to take to similarly being a moving article, in the shooting of moving article, should be noted that an important problem, namely will reduce moving article and cause the fuzzy of the second image.In aforesaid problem, usually utilize higher photosensitivity (ISO) or large aperture to reduce the time for exposure.In fact, with large aperture again because have less noise when capturing the second image, preferred effect is had.
But under the shooting condition of large aperture, because its depth of field is more shallow, correctly material impact could will be had to the quality of the second image to moving article focusing.Here two kinds of situations can be distinguished into, first situation is when the movement of moving article does not change relative to camera distance, the position of focusing does not just need variation, and second situation is when the movement of moving article has a far and near relative movement relative to camera, for example, moving article originally at distance camera remotely, so initial focusing may remotely, but when moving article is constantly near camera, therefore, when moving article moves to characteristic point, cause due to the relation of large aperture providing quality of well focusing.Therefore for above-described problem, the present invention utilizes object mobile trend to drive in the method for shutter, Kalman filter also comprise according to the size of moving article, size variation, focusing from or focusing from change with obtain predicted time to coke number, make automatic gate control flow according to the second image to coke number acquisition moving article.In addition, of the present invention utilize object mobile trend drive the method for shutter can also comprise described in particle filter (Particle Filter) is revised to coke number, particle filter can, by doing multidraw before and after focusing position, utilize the trend of contrast as the foundation upgrading evaluated error and kinematic matrix.
In addition, please refer to Fig. 3 and Fig. 4, Fig. 3 is that the present invention utilizes object mobile trend to drive the embodiment schematic diagram of the system of shutter and Fig. 4 to utilize another embodiment schematic diagram of the system of object mobile trend driving shutter for the present invention.As shown in Figures 3 and 4, inductor 400 capture the first image 500 of moving article 600 can export with the first resolution 403, for example, the first resolution 403 exported with Video Graphics Array (VGA) 401 is for 640 × 480pixels, and then the first image 500 will be passed in prediction mobile system 410 and analyzes and judge that moving article 600 arrives the predicted time of characteristic point and the automatic gate control device 420 (comprising photosensitivity size and time for exposure) of camera.When arriving predicted time, inductor 400 will be converted to the second resolution 404 and according to predicting that the photosensitivity size that mobile system 410 is predicted and time for exposure are to capture the second image 510, wherein, prediction mobile system 410 is Kalman filter 411, and predict in mobile system 410 and can comprise particle filter 412, if the second resolution 404 captures with full resolution (Full) 402, the resolution of its image captured is 4096 × 3072pixels.Now, second image 510 just can form image data 520 by image sensing processing unit 430 (ISP Pipeline:Image Sensor processing pipeline), is then stored in external memory 440 by image data 520 again.
The foregoing is only and illustrate, but not for limiting interest field of the present invention.Anyly do not depart from spirit of the present invention and category, and to its equivalent modifications of carrying out or change, all should be contained in right of the present invention.
Claims (12)
1. utilize object mobile trend to drive a system for shutter, it is characterized in that, comprise:
One inductor, is used for execution one image capture flow process, and wherein said image capture flow process captures one first image of a moving article with one first resolution;
One prediction mobile system, described prediction mobile system is electrically connected described inductor, described prediction mobile system is by analyzing described first image to judge that described moving article arrives the predicted time needed for a characteristic point, wherein, the position that described characteristic point is the vertical speed of described moving article when being zero; And
One automatic gate control device, described automatic gate control device is electrically connected described prediction mobile system, wherein said automatic gate control device performs an automatic gate control flow according to described predicted time, and make described inductor capture one second image of described moving article with one second resolution, wherein, described second resolution is greater than described first resolution.
2. the system utilizing object mobile trend to drive shutter according to claim 1, it is characterized in that: described prediction mobile system is a Kalman filter, according to the position of described moving article, speed, acceleration, angle, angular speed or angular acceleration, described Kalman filter predicts that described moving article arrives the described predicted time needed for described characteristic point.
3. the system utilizing object mobile trend to drive shutter according to claim 2, it is characterized in that: described Kalman filter also according to the size of described moving article, size variation, focusing from or focusing from change with a pair coke number obtaining described predicted time, make described automatic gate control flow according to described described second image coke number being captured to described moving article.
4. the object mobile trend that utilizes according to claim 3 drives the system of shutter, it is characterized in that: described prediction mobile system also comprises a particle filter, and described particle filter is used for revising described to coke number.
5. the object mobile trend that utilizes according to claim 1 drives the system of shutter, it is characterized in that: described automatic gate control flow also comprises analyzes described moving article adjust photosensitivity size when capturing described second image and time for exposure according to described prediction mobile system.
6. the system utilizing object mobile trend to drive shutter according to claim 1, it is characterized in that: the described object mobile trend that utilizes drives the system of shutter also to comprise an image sensing processing unit, described image sensing processing unit is electrically connected described inductor, and described second image processing is an image data by described image sensing processing unit.
7. utilize object mobile trend to drive a method for shutter, it is characterized in that, comprise:
Perform an image capture flow process, wherein said image capture flow process captures one first image of a moving article with one first resolution;
Described first image is analyzed to judge that described moving article arrives the predicted time needed for a characteristic point by a prediction mobile system, wherein, the position that described characteristic point is the vertical speed of described moving article when being zero; And
Perform an automatic gate control flow according to described predicted time, and capture one second image of described moving article with one second resolution, wherein, described second resolution is greater than described first resolution.
8. the method utilizing object mobile trend to drive shutter according to claim 7, it is characterized in that: described prediction mobile system is a Kalman filter, according to the position of described moving article, speed, acceleration, angle, angular speed or angular acceleration, described Kalman filter predicts that described moving article arrives the described predicted time needed for described characteristic point.
9. the method utilizing object mobile trend to drive shutter according to claim 8, it is characterized in that: described Kalman filter also with a pair coke number obtaining described predicted time, makes described automatic gate control flow according to described described second image coke number being captured to described moving article from change from, focusing according to the size of described moving article, size variation, focusing.
10. the object mobile trend that utilizes according to claim 9 drives the method for shutter, it is characterized in that: described prediction mobile system also comprises a particle filter, and described particle filter is used for revising described to coke number.
11. methods utilizing object mobile trend to drive shutter according to claim 7, it is characterized in that: in described automatic gate control flow, also comprise according to described prediction mobile system analyze described moving article with adjust acquisition described second image time photosensitivity size and the time for exposure.
The 12. object mobile trends that utilize according to claim 7 drive the methods of shutter, it is characterized in that: in the step of described second image of described acquisition, and also comprising described second image processing by image sensing process is an image data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110157004.7A CN102821241B (en) | 2011-06-10 | 2011-06-10 | Device and method using object moving trend to drive shutter |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110157004.7A CN102821241B (en) | 2011-06-10 | 2011-06-10 | Device and method using object moving trend to drive shutter |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102821241A CN102821241A (en) | 2012-12-12 |
| CN102821241B true CN102821241B (en) | 2015-06-03 |
Family
ID=47305084
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201110157004.7A Expired - Fee Related CN102821241B (en) | 2011-06-10 | 2011-06-10 | Device and method using object moving trend to drive shutter |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102821241B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106961552B (en) * | 2017-03-27 | 2019-10-29 | 联想(北京)有限公司 | A kind of focusing control method and electronic equipment |
| CN112235514A (en) * | 2020-10-13 | 2021-01-15 | 余波 | Camera shutter speed adjusting method and device based on artificial intelligence |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO1998034400A1 (en) * | 1997-01-31 | 1998-08-06 | Sharp Kabushiki Kaisha | Scene-motion based dynamic shutter speed adjustment system and method |
| CN101370125A (en) * | 2007-08-17 | 2009-02-18 | 林嘉 | Diving auto-tracking shooting and video feedback method and system thereof |
| CN101690189A (en) * | 2007-06-18 | 2010-03-31 | 索尼株式会社 | Image processing device, image processing method, and program |
| CN101699862A (en) * | 2009-11-16 | 2010-04-28 | 上海交通大学 | High-resolution region-of-interest image acquisition method of PTZ camera |
| CN101983389A (en) * | 2008-10-27 | 2011-03-02 | 松下电器产业株式会社 | Moving body detection method and moving body detection device |
-
2011
- 2011-06-10 CN CN201110157004.7A patent/CN102821241B/en not_active Expired - Fee Related
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO1998034400A1 (en) * | 1997-01-31 | 1998-08-06 | Sharp Kabushiki Kaisha | Scene-motion based dynamic shutter speed adjustment system and method |
| CN101690189A (en) * | 2007-06-18 | 2010-03-31 | 索尼株式会社 | Image processing device, image processing method, and program |
| CN101370125A (en) * | 2007-08-17 | 2009-02-18 | 林嘉 | Diving auto-tracking shooting and video feedback method and system thereof |
| CN101983389A (en) * | 2008-10-27 | 2011-03-02 | 松下电器产业株式会社 | Moving body detection method and moving body detection device |
| CN101699862A (en) * | 2009-11-16 | 2010-04-28 | 上海交通大学 | High-resolution region-of-interest image acquisition method of PTZ camera |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102821241A (en) | 2012-12-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8891000B2 (en) | System and method of driving shutter by tendency of moving object | |
| US11216690B2 (en) | System and method for performing image processing based on a damage assessment image judgement model | |
| US10713472B2 (en) | Face location tracking method, apparatus, and electronic device | |
| US20220417590A1 (en) | Electronic device, contents searching system and searching method thereof | |
| US8345984B2 (en) | 3D convolutional neural networks for automatic human action recognition | |
| WO2020083111A1 (en) | Liveness detection method and device, electronic apparatus, storage medium and related system using the liveness detection method | |
| Ionescu et al. | Dynamic hand gesture recognition using the skeleton of the hand | |
| CN105141853B (en) | Image processing method and electronic equipment | |
| EP3800580A1 (en) | Neuromorphic vision with frame-rate imaging for target detection and tracking | |
| US9811735B2 (en) | Generic object detection on fixed surveillance video | |
| WO2021046715A1 (en) | Exposure time calculation method, device, and storage medium | |
| CN103856833A (en) | Video processing apparatus and method | |
| CN108141525A (en) | Smart image sensors with integrated memory and processor | |
| US20220198677A1 (en) | Object segmentation and feature tracking | |
| CN112889068A (en) | Neural network object recognition for image processing | |
| CN109791558B (en) | Automatic selection of micro-images | |
| US10986287B2 (en) | Capturing a photo using a signature motion of a mobile device | |
| US20200124940A1 (en) | Electronic device to autofocus on objects of interest within field-of-view of electronic device | |
| CN102821241B (en) | Device and method using object moving trend to drive shutter | |
| Kumawat et al. | Privacy-preserving action recognition via motion difference quantization | |
| CN114613006A (en) | Remote gesture recognition method and device | |
| Shi et al. | An FPGA-based smart camera for gesture recognition in HCI applications | |
| US20220366574A1 (en) | Image-capturing apparatus, image processing system, image processing method, and program | |
| CN107667522A (en) | Adjust the length of live image | |
| Makrygiannis et al. | Optimal video handling in on-line hand gesture recognition using deep neural networks |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20150603 Termination date: 20190610 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |