TW201251445A - System and method of driving shutter by an object moving tendency - Google Patents

Abstract

A system and method of driving shutter by an object moving tendency are disclosed. In this method, an image capture process is performed, wherein the image capture process captures a first image of a moving object in a first resolution. Then, a prediction moving system analyzes the first image to acquire a prediction time for the moving object to reach a feature point. Finally, an automatic shutter control process is performed according to the prediction time, and a second image with a second resolution is captured, wherein the value of the second resolution is larger than that of the first resolution. This method automatically captures the second image of the moving object when situated at the feature point by using the prediction moving system to analyze the moving object.

Description

201251445 VI. Description of the Invention: [Technical Field of the Invention] [The invention] The present invention relates to a system and method for driving a shutter, and more particularly to a system and method for driving a shutter using a trend of moving objects. [Prior Art] [0002] Today's digital cameras have gradually introduced the function of automatic shooting because of the increase in computing power. For example, some cameras can detect the position of a face, transmit it to a pan/tilt that can be moved automatically, and use the feedback between the two devices to place the subject in the picture. When the face position meets the specific After the condition, the camera will shoot automatically. [_] Because of the design that automatically drives the shutter through face detection, many recent variations and applications of this concept have emerged. For example, many cameras on the market have been incorporated into the design of the smile shutter, so that when shooting a portrait, the camera can determine the time of shooting by the subject's expression. Other similar applications include pet mode, blink detection, or face recognition, which only drive the shutter design when a known subject has a smiling expression. Some of these auto-driven shutter designs are mostly focused on faces or known subjects or behavioral applications. They are used to compare with the main body in the database. When the comparison is successful, the shutter is automatically driven. However, the above-mentioned applications are applied to static subjects, and no consideration is given to the shooting of moving objects. [0004] When shooting photos, in addition to static subjects, we often retain dynamic moments. These dynamic objects are often not limited to themes that the camera can recognize (such as faces, pets or expressions). For example, in extreme sports, the human body moves through the skateboard in the U-shaped pool, and at the highest point, various types of 100120482 form number A0101 page 4 / 18 pages 1002034641-0 201251445 sample action. If it is only by detecting the face or expression to the action of the human body at the highest point. 'It will not be able to shoot automatically [0005] For now, it is difficult to take pictures of moving objects dynamically, mainly because it is necessary to drive the shutter through human intervention and operation. A will have a delay in response time. So when you see the face you want to shoot, pressing the hurdle often misses the most exciting moment. [0006]

Under the progress of the complementary metal oxide semiconductor (C〇mplementary Metai_ 〇xide-SemiC〇nductor) process, due to the reduction of noise problems and the characteristics of high-speed sampling, the difficulty of moving object photography has gradually declined. For example, high-speed complementary metal-oxide-semiconductors typically allow resolutions of more than tens of millions of pixels to record every moment of moving objects at a rate of several to several tens of samples per second. However, such a solution can be costly at a considerable cost. Taking 10 photos per photo, taking 10 shots per second, there are two possible solutions: (1) Accelerate the design of image processing hardware, but such a design will increase the huge hardware requirements, and This design is optimized for this mode. The logic requirement may be more than ten times the amount of logic required in the normal shooting mode. This will increase the additional cost and is usually not a viable solution. (2) Use the external memory to store the unprocessed captured image first, and then use the post-processing method to read the processing from the external memory after the image is captured. However, such a method requires a relatively large memory space, and an unprocessed image requires a storage space of 100 million bytes per second (MB: Mega Byte), although compared to the aforementioned item (1). Cost 100120482 Form No. A0101 Page 5 of 18 1002034641-0 201251445 Lower, but the same cost of external memory is required. [0009] [0009] In addition, in the mobile shooting moment of the face rotation, it may be possible to use the existing face detection mechanism as the basis for driving the shutter, but such a method may have two problems The user can't successfully take the photo that the user wants: First, because the face detection is an object-matching operation, the calculation process is usually not completed in real time, so after the face is detected, the moving subject usually does not have the same posture. Second, when the face moves or rotates, it may cause a certain degree of motion blur or object obscuration (for example, when the face is rotated, the hair covers part of the face), so it may cause the face to be undetectable. Circumstances q [Invention] In view of the above, an object of the present invention is to provide a system and method for using a moving trend of an object to move a shutter to solve the problem that a moving object is difficult to photograph. The reason is that the system for driving the shutter using the movement tendency of the object according to the present invention for the above purpose includes: an inductor, a predictive movement system, and an automatic shutter control device. Induction||system_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ The image is (4) moving the object to the feature point, and (4) mentioning that the feature point is, for example, a point where the moving object has characteristics in the moving trajectory, such as the most similar point or vertical speed in the moving trajectory. In addition, the automatic door control device is electrically connected to the predictive mobile system, wherein the automatic shutter control device performs an automatic quick control process according to the predicted time, and makes the 100120482 form number Α0101 page 6/18 pages 1002034641 -0 201251445 The sensor captures the second image of the moving object with the second resolution, wherein the second resolution is greater than the first resolution. In fact, the second resolution may be 4096x3072 pixels, and the first resolution may be 640×480 pixels° [0010] The method for driving a shutter by using an object moving trend according to the present invention comprises: performing an image capturing process, wherein the image capturing stream The first image of the moving object is captured by the first resolution; the first image is analyzed by the predictive mobile system to determine the predicted time required for the moving object to reach a feature point; and the automatic shutter control process is executed at 0 and according to the predicted time. And capturing a second image of the moving object with a second resolution k, wherein the second resolution is greater than the first resolution 'for example, the first resolution may be a lower 64 〇χ 480 pixels' The second resolution may be a higher 4〇96χ3〇72 pixels. In other words, the present invention predicts the predicted time of the moving object to reach the feature point by using the predictive object system, and automatically shoots at the predicted time. For example, the Kalman filter can be used to predict the time when the moving object reaches the feature point according to the position, velocity, acceleration, angle, angular velocity or angular acceleration of the moving object. The feature point can be set according to the user's needs. ^ For example, moving objects to do __ line motion, so that you want to shoot the moving object in the most questioned ft condition 'so the user can set The moving object is photographed at a vertical speed of zero to obtain a photo of the moving object at the highest point. In fact, the Kalman wave can change the *, , distance, and focus distance according to the size and size of the moving object. Obtaining the focus value of the predetermined time causes the Λautomatic door control flow to take the second image of the moving object according to the focus value. The 100120482 form number A0101 can also be corrected by particle etching. Page 7 of 18 The focus value of 1002034641-0 201251445. In addition, in the automatic shutter control process, for example, the result of analyzing the moving object by the predicted mobile system is adjusted to adjust the sensitivity and exposure time of the second scene image. [0011] In the step of taking the second image, the J ^^USP Pipeline: Image Sensor processing pipeline is used to process the second image into image data, and the image data can be saved to the external memory. Body to retain image data. [0012] As described above, the system and method for driving a shutter using the moving tendency of an object according to the present invention can have the following advantages: (1) The system and method for driving a shutter using the moving tendency of the object of the present invention are transmitted through prediction The system predicts the time when the moving object arrives at the feature point and automatically shoots it at the predicted time, so there is no need to pass the human operation' and avoid the error of the human reaction time. (2) Predictive mobile system can predict the focus value, sensitivity and exposure time required for shooting^

[0014] For a better understanding and understanding of the technical features and the efficacies of the present invention, the preferred embodiments and the detailed description are as follows. [Embodiment] Hereinafter, a system and a method for driving a shutter by using a moving tendency of an object according to a preferred embodiment of the present invention will be described with reference to the related drawings. For ease of understanding, the same components in the following embodiments are denoted by the same symbols. To illustrate. Please refer to Fig. 1. Fig. 1 is a schematic view showing a method for driving a shutter by using an object moving tendency according to the present invention.

100120482 Form No. A0I01 Page 8 of 18 100203464 Bu 0 [0015] 201251445 Capture the machine, in which the image capture process captures the first image of the moving object at the first resolution. In more detail, the image capture process is, for example, a preview system when a photo is generally taken. Usually, in this case, the user only determines the state of the object that he or she photographed by using the preview system, for example, whether the main object to be photographed is located in the middle of the photo. 'Or whether the object can be king. k into the photo, etc. In addition, the user can also adjust the parameters of various cameras at this time, such as whether to use the flash or the like to set the details [0016]

The receiver Ο [0017] 7 analyzes the first image by the predictive mobile system to break the side time required to move the object to the feature point. What is specifically mentioned here is that the feature transferee defines a certain state of the moving object, such as the highest/lower point of the moving object in the motion trajectory, the maximum/small speed, and the like. We cite here - an embodiment of a predictive mobile system in which a 'predictive mobile system such as a Kalman filter (Kai Britus Fut(7)' Kalman chopper can record the trajectory of a moving object as a basis for behavioral analysis of moving objects; It is also possible to pre-send (10)^ as a moving object Wei match_comparison reference. When using the Carl@chopper, it is usually divided into two phases, the first phase is the correction. The motion from the animal piece is simulated using a linear equation. As in (1), the state of the moving object at time k will be related to the moving object at time k-1. The correlation between the two depends on the matrix F. Taking parabolic motion as an example, the state described here ^1 includes moving the position, velocity, or acceleration of the object. Through this __, the card filter can move the object state for the next time in the prediction phase. : 100120482 Form No. A0101 Page 9 of 18 Page 1002034641-0 201251445 Calculated as in (2).

Xfc = FfcXfc_i + Β^ιι,ι: + w*: (1) (2) [0018] In the case of parabolic motion, see '2nd &cloth<Fig. 2, parabola for moving objects Schematic diagram of the movement. In the second sorcerer ^ ^ coin Z map, when we want to find the highest point 310 of the moving object 300, according to the laws of physics, it is known that the vertical velocity is zero, and the assumption of such feature points can pass through Kalman The filter and the waver predict the predicted time of the moving object 3_ to the feature point. [0019] In addition, we also propose to change the object state xk of the Kalman chopper to the angle, angular velocity or angular acceleration of the face with the example of the face rotation, so as to predict that the face is returning to zero (human) Face face) time. [0020] Next, step 220 performs an automatic shutter control process according to the predicted time, and captures a second image of the moving object by a second resolution, wherein the second resolution is greater than the first resolution, for example, _ The resolution can be 6 4 〇

X480 pixels, and the second resolution can be 4096x3072 Q pixels 〇[0021] However, since the object we want to shoot is a moving object, we need to notice an important problem in the shooting of moving objects, that is, to reduce the movement. The blurring of the second image caused by the object. In the foregoing problems, a higher sensitivity (ISO) or a large aperture is generally utilized to reduce the exposure time. In fact, using a large aperture will result in better results because there will be less noise when capturing the second image. 100120482 Form No. A0101 Page 10 of 18 1002034641-0 201251445 [0022] -fa s . Nomin's shooting condition T, because of its depth of field, can it be correct, the object will focus on the second image Quality has an important impact. This is divided into two cases. The first case is that when the moving object moves to the camera distance, the position of the focus does not need to be changed. The first case is when the moving object moves farther and closer to the camera. When 'for example, 'the moving object is originally broken from the camera' so the initial focus may be far away, but when the moving object is not close to the camera', so when the moving object moves to the feature point, it cannot be due to the twilight_relation Provides good dragon quality. Therefore, the problem of the opening of the needle door is that the moving tendency of the object is driven fast. In the method, the Kalman filter further includes changing according to the size J of the moving object, the focusing distance or the focusing distance to obtain the predetermined time ", The value 'the automatic shutter control process extracts the first image of the moving object according to the focus value. In addition, the method for utilizing the movement trend of the object to drive the Shaanxi gate of the present invention may further comprise modifying the particle filter by a particle filter. The focus value 'particle chopper can be multi-sampled after setting the focus bit Q' to use the trend of contrast as the basis for updating the estimation error and the motion matrix. [0023] 〇^ 卜 'Please refer to pictures 3 and 4 3 is a schematic view of an embodiment of a system for driving a shutter using object movement tendency according to the present invention, and FIG. 4 is a schematic view showing another embodiment of a system for driving a shutter using object movement tendency according to the present invention. In FIG. 4, the first image 500 of the moving object 600 captured by the sensor 400 is output at a first resolution 403, for example, 'video graphics array. The first resolution 403 of the (VGA) 4〇i output is 640 x 48 〇 pixels, and then the first image 500 is transmitted to the predicted mobile 100120482. * Single apostrophe A0101 Page 11 / 18 pages 1002034641-0 201251445 System 41 0 analyzes and judges the predicted time of the moving object 600 reaching the feature point and the camera's automatic shutter control device 420 (including the sensitivity level and exposure time). When the predicted time is reached, the sensor 4〇〇 is converted to The second resolution 404 and the second image 51〇 are captured according to the magnitude and exposure time predicted by the predicted mobile system 4丨〇, wherein the predicted mobile system 410 is, for example, a Kalman filter 411, and the mobile system is predicted The particle filter 412 may be further included in the 410. The second resolution is obtained by, for example, full resolution (Full) 402, and the resolution of the captured image is, for example, 4096 x 3072 pixels. At this time, the second image 51 is It can be transmitted through the image sensing processing device 430 (ISP Pipeline: Image 〇

The sensor processing pipeline is formed to form image data 52, and then the image data 520 is stored in the external memory 44. [0025] [0026] The above is only Senna, (4) is the limiter. Any equivalent modifications or alterations to the present invention without departing from the spirit and scope of the present invention are intended to be included in the scope of the appended claims. [Simple description of the map]

BRIEF DESCRIPTION OF THE DRAWINGS Figure 1 is a schematic illustration of an embodiment of a method of driving a shutter using object movement trends. U Figure 2 is a fish diagram of a parabolic motion of a moving object. Figure 3 is a schematic illustration of an embodiment of a system for utilizing object movement trend to drive a shutter in accordance with the present invention. Figure 4 is a schematic illustration of another embodiment of a system for utilizing object movement trend to drive a shutter of the present invention. [Main component symbol description] 200: Step 100120482 Form number A0101 Page 12/18 pages 1002034641-0 201251445 Ο: Step: Step: Moving object: Highest point: Sensor: Video graphics array: Full resolution: First resolution Degree: second resolution: predictive mobile system: Kalman filter: particle filter: automatic shutter control device: image sensing processing device: external memory: first image: second image: image data: moving object 100120482 Form No. 1010101 Page 13 of 18 Page 1002034641-0

Claims (1)

201251445 VII. Patent application scope: 1. A system for driving a shutter by using a moving trend of an object, comprising: a sensor 'for performing an image capturing process', wherein the image capturing process captures a first resolution a predictive mobile system electrically connected to the sensor, wherein the predictive mobile system analyzes the first image to determine a prediction of the moving object to reach a feature point And an automatic shutter control device electrically connected to the predictive mobile system, wherein the automatic shutter control device performs an automatic shutter control process according to the predicted time, and causes the sensor to be a second The resolution captures a second image of the moving object, wherein the second resolution is greater than the first resolution. 2. A system for driving a shutter using an object movement trend as described in claim 1, wherein the feature point is a position at which the vertical velocity of the moving object is zero. 3. The system for driving a shutter using an object movement trend as described in claim 1, wherein the predictive mobile system is a Kalman filter. The Kalman chopper is based on the position of the moving object. The velocity, acceleration, angle, angular velocity, or angular acceleration is used to predict the predicted time required for the moving object to reach the feature point. 4. The system of claim 3, wherein the Kalman filter further comprises changing the size, size, focus distance or focus distance of the moving object to obtain the predetermined time. One of the focus values causes the automatic shutter control process to capture the second image of the moving object according to the focus value. </ RTI> <RTIgt; Ic 1 e F i 11 er ), the particle waver is used to correct the focus value. 6. The system of claim 1, wherein the automatic shutter control process further comprises: adjusting the sensitivity of the moving object to adjust the sensitivity of the second image according to the predicted moving system. And exposure time. 7. The system of claim 1, wherein the system for moving shutters using object movement trends further comprises an ISP Pipeline: Image Sensor processing pipeline device. The image sensing processing device is electrically connected to the sensor, and the image sensing processing device processes the second image into an image data. 8 . A method for driving a shutter by using an object movement trend, comprising: performing an image capture process, wherein the image capture process captures a first image of a moving object at a first resolution; Predicting that the mobile system analyzes the first image to determine a predicted time required for the moving object to reach a feature point; and performing an automatic shutter control process according to the predicted time, and capturing one of the moving objects by a second resolution a second image, wherein the second resolution is greater than the first resolution. 9. A method of driving a shutter using an object movement trend as described in claim 8 wherein the feature point is a position at which the vertical velocity of the moving object is zero. 10. The method of using the object movement trend to drive the shutter 100120482 as shown in claim 8 of the patent application, Form No. A0101, page 15 of 18, 1002034641-0 201251445, wherein the prediction mobile system is a Neumann filter (K a 1 ma η Fl Iter) 'The Kalman filter is used to predict the predicted time required for the moving object to reach the feature point based on the position, velocity, acceleration, angle, angular velocity or angular acceleration of the moving object. 11 'A method for driving a shutter by using an object movement trend as described in claim 1 wherein the Kalman chopper further includes a change according to a size, a size change, a focus distance, and a focus distance of the moving object to obtain the reservation. The time_focus value enables the automatic shutter control process to capture the second image of the moving object according to the focus value. 12. The method of claim 11, wherein the predictive movement system further comprises a particle filter, wherein the particle filter is used to correct the focus value. The method for driving a shutter by using an object movement trend according to claim 8, wherein the automatic shutter control process further comprises: analyzing the moving object adjustment operation according to the predicted moving system; and taking the second image Degree and exposure time. 14. The method for driving a shutter by using an object movement trend according to claim 8, wherein the step of capturing the second image further comprises: ISP Pipeline: Image Sensor processing pipe line The second image is processed as an image data. 100120482 Form No. A0101 Page 16 of 18 1002034641-0