TW201251445A - System and method of driving shutter by an object moving tendency - Google Patents
System and method of driving shutter by an object moving tendency Download PDFInfo
- Publication number
- TW201251445A TW201251445A TW100120482A TW100120482A TW201251445A TW 201251445 A TW201251445 A TW 201251445A TW 100120482 A TW100120482 A TW 100120482A TW 100120482 A TW100120482 A TW 100120482A TW 201251445 A TW201251445 A TW 201251445A
- Authority
- TW
- Taiwan
- Prior art keywords
- image
- moving object
- moving
- resolution
- shutter
- Prior art date
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/64—Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/667—Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/73—Circuitry for compensating brightness variation in the scene by influencing the exposure time
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Studio Devices (AREA)
- Exposure Control For Cameras (AREA)
Abstract
Description
201251445 六、發明說明: 【發明所屬之技術領域】 [own] 本發明是有關於一種驅動快門的系統及方法,特別是一 種利用物件移動趨勢驅動快門的系統及方法。 【先前技術] [0002] 現今數位相機,因為運算能力的增加,已逐漸引入自動 拍攝的功能。舉例而言,有些相機可透過偵測人臉位置 ,將其傳輸到可自動移動的雲臺,並利用這兩個裝置間 的互相反饋,將主體置放在畫面當中,當人臉位置滿足 特定條件後,相機就會自動拍攝。 [_] 因為有著這樣透過人臉偵測自動驅動快門的設計,近來 許多關於這樣概念的變形及應用也應運而生。舉例來說 ,市場上已經有許多相機已納入微笑快門的設計,使得 在拍攝人像時’可以透過拍攝主體的表情由相機決定拍 攝的時間。其他類似的應用還包括如寵物模式、眨眼偵 測或是人臉辨識,只在已知主體人物出現微笑表情時才 驅動快門的設計。這一些自動驅動快門設計,大多集中 在人臉或是已知主體或行為的應用,使用上都是透過與 資料庫内主體做比對,當比對成功後再自動驅動快門。 然而’上開所述皆疋應用在靜態的主體,並未對移動物 件的拍攝做考慮。 [0004] 在拍攝相片時’除了靜態的主體,我們也常保留動態的 瞬間,這一些動態的物件往往不限定於相機可以辨識的 主題(如人臉、寵物或表情)。舉例而言,在極限運動中 ,人體透過滑板在U型池中移動,並在最高點做出各式各 100120482 表單編號A0101 第4頁/共18頁 1002034641-0 201251445 樣動作。若是僅透過偵測人臉或表情 到人體在最高點所做出之動作。 ’將無法自動拍攝 [0005] 依目前而言,動態 拍攝移動物,還是 的相片是較難拍攝的,主要是因為要 需要透過人為的介人與操作來驅動快 門其中A會有反應時間的延遲,因此當看到想要拍 攝的晝面時,按下快Η往往已經錯失最精彩的一刻。 [0006]201251445 VI. Description of the Invention: [Technical Field of the Invention] [The invention] The present invention relates to a system and method for driving a shutter, and more particularly to a system and method for driving a shutter using a trend of moving objects. [Prior Art] [0002] Today's digital cameras have gradually introduced the function of automatic shooting because of the increase in computing power. For example, some cameras can detect the position of a face, transmit it to a pan/tilt that can be moved automatically, and use the feedback between the two devices to place the subject in the picture. When the face position meets the specific After the condition, the camera will shoot automatically. [_] Because of the design that automatically drives the shutter through face detection, many recent variations and applications of this concept have emerged. For example, many cameras on the market have been incorporated into the design of the smile shutter, so that when shooting a portrait, the camera can determine the time of shooting by the subject's expression. Other similar applications include pet mode, blink detection, or face recognition, which only drive the shutter design when a known subject has a smiling expression. Some of these auto-driven shutter designs are mostly focused on faces or known subjects or behavioral applications. They are used to compare with the main body in the database. When the comparison is successful, the shutter is automatically driven. However, the above-mentioned applications are applied to static subjects, and no consideration is given to the shooting of moving objects. [0004] When shooting photos, in addition to static subjects, we often retain dynamic moments. These dynamic objects are often not limited to themes that the camera can recognize (such as faces, pets or expressions). For example, in extreme sports, the human body moves through the skateboard in the U-shaped pool, and at the highest point, various types of 100120482 form number A0101 page 4 / 18 pages 1002034641-0 201251445 sample action. If it is only by detecting the face or expression to the action of the human body at the highest point. 'It will not be able to shoot automatically [0005] For now, it is difficult to take pictures of moving objects dynamically, mainly because it is necessary to drive the shutter through human intervention and operation. A will have a delay in response time. So when you see the face you want to shoot, pressing the hurdle often misses the most exciting moment. [0006]
在互補式金屬氧化物半導體(C〇mplementary Metai_ 〇xide-SemiC〇nductor)製程的進步下,因其雜訊問題 的減少及高速取樣的特點,移動物件攝影的困難度也逐 漸下降中’以目前的技術為例,高速的互補式金屬氧化 物半導體通常可以允許-千萬以上的晝素的解析度,以 每秒取樣數張到數十張的速度,記錄移動物件的每一個 瞬間。但是,這樣的解決方法需要花費相當大的代價才 可行。以一千萬畫素的相片,每秒拍攝十張為例,有兩 種可能的解決方案: (1)將影像處理硬體的設計加速,但這樣的設計會增加龐 大的硬體需求,且此設計係針對此一模式做最佳化,其 邏輯的需求可能是一般拍攝模式下所需邏輯數量的十倍 以上,這樣會使得額外成本增加,通常不是一個可行的 方案。 (2)利用外部記憶體將未經處理的拍攝影像先儲存下來, 再透過後處理的方式,在影像擷取之後從外部記憶體讀 出處理。但這樣的方式需要相當龐大的記憶體空間,單 就未處理的影像,每秒就需要100百萬位元組(MB : Mega Byte)的儲存空間,雖然相較於前述第(1)項的成本支出 100120482 表單編號A0101 第5頁/共18頁 1002034641-0 201251445 較低,但是一樣需要額外付出外部記憶體的成本。 [0007] [0008] [0009] 另外,在人臉轉動瞬間的移動拍攝方面,或許可以利用 現有人臉偵測的機制,作為驅動快門的依據,但這樣的 方法可能會有兩個問題而造成無法成功拍攝使用者想要 的相片:第一、因為人臉偵測是屬於物件匹配的運算, 演算過程通常無法即時完成,所以在人臉偵測到之後, 移動主體通常已經不是存在同一姿勢。第二、當人臉移 動或轉動時,可能會造成一定程度的移動模糊或是物件 的遮蔽(例如人臉轉動時,頭髮遮住部份人臉),因此有 可能造成無法偵測人臉的情況發生q 【發明内容】 有鑑於此,本發明之目的就是在提供一種利用物件移動 趨勢駆動快門的系統及方法,以解決移動物件難以拍攝 的問題。 緣是,為達上述目的’依本發明之利用物件移動趨勢驅 動快門的系統’包含:感應器、預測移動系統以及自動 快門控制裝置。感應||制_行影賴取流程,其中 影像操取餘似[解析度齡移動物件之第一影像 ,另外,賴移動“係電性連接影賴取系統,其中 預測移動系統係分析第—影像以㈣移動物件到達特徵 點所而之則相,這裡要㈣提到的是,特徵點係例 如移動物件在移動軌跡中比較具有特徵的點 ,例如移動 軌跡中的最同點或是垂直速度為零的位置。此外,自動 决門控制裝置係電性連接預測移動係統,其中自動快門 控制裝置係依據預測時間執行自動快Η控制流程 ,並使 100120482 表單編號Α0101 第6頁/共18頁 1002034641-0 201251445 感應器以第二解析度擷取移動物件之第二影像,其中, 第二解析度係大於第一解析度。實際上,第二解析度可 以是4096x3072 pixels,第一解析度可以是640x480 pixels ° [0010] 依本發明之利用物件移動趨勢驅動快門的方法,包含: 執行影像擷取流程,其中影像擷取流程係以第一解析度 擷取移動物件之第一影像;藉由預測移動系統分析第一 影像以判斷移動物件到達一特徵點所需之預測時間;以 0 及依據預測時間執行自動快門控制流程,並以第二解析 k 度擷取移動物件之第二影像,其中,第二解析度係大於 第一解析度’舉例來說’第一解析度可以是較低的64〇χ 480 pixels’第二解析度可以是較高的4〇96χ3〇72 pixels。換言之,本發明係利用預測物件系統預測所述 之移動物件到達特徵點的預測時間,並在預測時間自動 拍攝。其中,預測移動系統係例如以卡爾曼濾波器實現 ,卡爾曼濾波器可以依據移動物件之位置、速度、加速 〇 度、角度、角速度或角加速度預測移動物件到達特徵點 的時間,特徵點可依據使用者所需來設^舉例來說, 移動物件做__線運動,使时想要拍攝移動物件在 最问點的ft况’因此使用者就可以設定移動物件在垂直 速度為零時拍攝,以取得移動物件在最高點的相片。實 際上’卡爾曼據波器更可以依據移動物件之大小、大小 變化對*、、、距離、對焦距離變化以取得預定時間之對焦 值使Λ自動决門控制流程依據該對焦值操取該移動物 件之該第二影像。其中,亦可透過粒子渡刻修正所述 100120482 表單編號A0101 第7頁/共18頁 1002034641-0 201251445 之對焦值。另外,自動快門控制流程中,例如更包含兌 據預測移動系統分析移動物件之結果調整操取第二景《像 時的感光度大小及曝光時間。 [0011] 仕调取第二影像之步驟中 ------掛 J ^^USP Pipeline : Image Sensor processing pipeline),將第二影像處理為影像資料,並且可將餐 像資料儲存至外部記憶體以保留影像資料。 [0012] 承上所述,依本發明之利用物件移動趨勢驅動快門的系 統及方法,其可具有下述優點: (1) 本發明之利用物件移動趨勢驅動快門的系統及方法係 透過預測移動系統以預測移動物件到達特徵點的預測時糸 間,並在預測時間自動拍攝,因此不需再透過人為操作 ’並且避免了人體反應時間的誤差。 (2) 預測移動系統更可以預測拍攝時所需要的對焦值、感 光度大小及曝光時間^Under the progress of the complementary metal oxide semiconductor (C〇mplementary Metai_ 〇xide-SemiC〇nductor) process, due to the reduction of noise problems and the characteristics of high-speed sampling, the difficulty of moving object photography has gradually declined. For example, high-speed complementary metal-oxide-semiconductors typically allow resolutions of more than tens of millions of pixels to record every moment of moving objects at a rate of several to several tens of samples per second. However, such a solution can be costly at a considerable cost. Taking 10 photos per photo, taking 10 shots per second, there are two possible solutions: (1) Accelerate the design of image processing hardware, but such a design will increase the huge hardware requirements, and This design is optimized for this mode. The logic requirement may be more than ten times the amount of logic required in the normal shooting mode. This will increase the additional cost and is usually not a viable solution. (2) Use the external memory to store the unprocessed captured image first, and then use the post-processing method to read the processing from the external memory after the image is captured. However, such a method requires a relatively large memory space, and an unprocessed image requires a storage space of 100 million bytes per second (MB: Mega Byte), although compared to the aforementioned item (1). Cost 100120482 Form No. A0101 Page 5 of 18 1002034641-0 201251445 Lower, but the same cost of external memory is required. [0009] [0009] In addition, in the mobile shooting moment of the face rotation, it may be possible to use the existing face detection mechanism as the basis for driving the shutter, but such a method may have two problems The user can't successfully take the photo that the user wants: First, because the face detection is an object-matching operation, the calculation process is usually not completed in real time, so after the face is detected, the moving subject usually does not have the same posture. Second, when the face moves or rotates, it may cause a certain degree of motion blur or object obscuration (for example, when the face is rotated, the hair covers part of the face), so it may cause the face to be undetectable. Circumstances q [Invention] In view of the above, an object of the present invention is to provide a system and method for using a moving trend of an object to move a shutter to solve the problem that a moving object is difficult to photograph. The reason is that the system for driving the shutter using the movement tendency of the object according to the present invention for the above purpose includes: an inductor, a predictive movement system, and an automatic shutter control device. Induction||system_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ The image is (4) moving the object to the feature point, and (4) mentioning that the feature point is, for example, a point where the moving object has characteristics in the moving trajectory, such as the most similar point or vertical speed in the moving trajectory. In addition, the automatic door control device is electrically connected to the predictive mobile system, wherein the automatic shutter control device performs an automatic quick control process according to the predicted time, and makes the 100120482 form number Α0101 page 6/18 pages 1002034641 -0 201251445 The sensor captures the second image of the moving object with the second resolution, wherein the second resolution is greater than the first resolution. In fact, the second resolution may be 4096x3072 pixels, and the first resolution may be 640×480 pixels° [0010] The method for driving a shutter by using an object moving trend according to the present invention comprises: performing an image capturing process, wherein the image capturing stream The first image of the moving object is captured by the first resolution; the first image is analyzed by the predictive mobile system to determine the predicted time required for the moving object to reach a feature point; and the automatic shutter control process is executed at 0 and according to the predicted time. And capturing a second image of the moving object with a second resolution k, wherein the second resolution is greater than the first resolution 'for example, the first resolution may be a lower 64 〇χ 480 pixels' The second resolution may be a higher 4〇96χ3〇72 pixels. In other words, the present invention predicts the predicted time of the moving object to reach the feature point by using the predictive object system, and automatically shoots at the predicted time. For example, the Kalman filter can be used to predict the time when the moving object reaches the feature point according to the position, velocity, acceleration, angle, angular velocity or angular acceleration of the moving object. The feature point can be set according to the user's needs. ^ For example, moving objects to do __ line motion, so that you want to shoot the moving object in the most questioned ft condition 'so the user can set The moving object is photographed at a vertical speed of zero to obtain a photo of the moving object at the highest point. In fact, the Kalman wave can change the *, , distance, and focus distance according to the size and size of the moving object. Obtaining the focus value of the predetermined time causes the Λautomatic door control flow to take the second image of the moving object according to the focus value. The 100120482 form number A0101 can also be corrected by particle etching. Page 7 of 18 The focus value of 1002034641-0 201251445. In addition, in the automatic shutter control process, for example, the result of analyzing the moving object by the predicted mobile system is adjusted to adjust the sensitivity and exposure time of the second scene image. [0011] In the step of taking the second image, the J ^^USP Pipeline: Image Sensor processing pipeline is used to process the second image into image data, and the image data can be saved to the external memory. Body to retain image data. [0012] As described above, the system and method for driving a shutter using the moving tendency of an object according to the present invention can have the following advantages: (1) The system and method for driving a shutter using the moving tendency of the object of the present invention are transmitted through prediction The system predicts the time when the moving object arrives at the feature point and automatically shoots it at the predicted time, so there is no need to pass the human operation' and avoid the error of the human reaction time. (2) Predictive mobile system can predict the focus value, sensitivity and exposure time required for shooting^
[0013] [0014] 茲為使責審查委員對本發明之技術特徵及所達到之功效 有更進一步之瞭解與認識,謹佐以較佳之實施例及配合 詳細之說明如後。 【實施方式】 以下將參照相關圖式,說明依本發明較佳實施例之利用 物件移動趨勢驅動快門的系統及方法,為使便於理解, 下述實施例中之相同元件係以相同之符號標示來說明。 請參閱第1圖,第1圖係為本發明之利用物件移動趨勢驅 動快門的方法之示意圖°第1圖中’步驟200係執行影像[0014] For a better understanding and understanding of the technical features and the efficacies of the present invention, the preferred embodiments and the detailed description are as follows. [Embodiment] Hereinafter, a system and a method for driving a shutter by using a moving tendency of an object according to a preferred embodiment of the present invention will be described with reference to the related drawings. For ease of understanding, the same components in the following embodiments are denoted by the same symbols. To illustrate. Please refer to Fig. 1. Fig. 1 is a schematic view showing a method for driving a shutter by using an object moving tendency according to the present invention.
100120482 表單編號A0I01 第8頁/共18頁 100203464卜0 [0015] 201251445 擷取机私,其中影像擷取流程係以第一解析度擷取移動 物件之第一影像。更詳細的說,影像擷取流程係例如一 般要拍攝相片時的預覽系統,通常在此情況下使用者僅 是和用預覽系統確定自己拍攝的物件的狀態,例如主要 被拍攝物件是否位於相片中間’或是拍攝物件是否能夠 王。k入相片中等等,另外,使用者亦可在此時調整各 種相機的參數,例如是否要使用閃光燈等等的細部設定 [0016]100120482 Form No. A0I01 Page 8 of 18 100203464 Bu 0 [0015] 201251445 Capture the machine, in which the image capture process captures the first image of the moving object at the first resolution. In more detail, the image capture process is, for example, a preview system when a photo is generally taken. Usually, in this case, the user only determines the state of the object that he or she photographed by using the preview system, for example, whether the main object to be photographed is located in the middle of the photo. 'Or whether the object can be king. k into the photo, etc. In addition, the user can also adjust the parameters of various cameras at this time, such as whether to use the flash or the like to set the details [0016]
接者 Ο [0017] 7 係藉由預測移動系統分析第一影像以列斷 移動物件到達特徵點所需之侧時間。這邊要特別提到 的是’特徵轉依據者定義所述之移動物件之某〜 狀態,例如移動物件在運動軌跡中最高/低點、最大/小 速度等。吾人在此舉出—預測移動系統之實施例,其中 ’預測移動系統係例如卡爾曼濾波器(Kai贿Fut⑺ ’卡爾曼遽波器可以記錄移動物件的軌跡,作為事 移動物件行為分析的依據;也可以預_件出⑽^ ,作為移動物件魏匹配_比較參考。在運用卡爾@ 遽波器時,通常會分為兩種階段,第 第-個階段是修正。此兩個階段的運算都是來自於 動物件的運動利用線性方程式模擬而來。 如⑴式,移動物件在時間k的狀態,將會和移動物件在 時間k-1時有關。而兩者的相關性則有賴於矩陣F的 。以拋物線運動為例,在此所述之狀態^ 1包^移動物 件的位置、速度或加速料。透過這__,卡” 滤波器可以在預測階段將下—個時間的移動物件狀態: 100120482 表單編號A0101 第9頁/共18頁 1002034641-0 201251445 計算出來,如(2)式。The receiver Ο [0017] 7 analyzes the first image by the predictive mobile system to break the side time required to move the object to the feature point. What is specifically mentioned here is that the feature transferee defines a certain state of the moving object, such as the highest/lower point of the moving object in the motion trajectory, the maximum/small speed, and the like. We cite here - an embodiment of a predictive mobile system in which a 'predictive mobile system such as a Kalman filter (Kai Britus Fut(7)' Kalman chopper can record the trajectory of a moving object as a basis for behavioral analysis of moving objects; It is also possible to pre-send (10)^ as a moving object Wei match_comparison reference. When using the Carl@chopper, it is usually divided into two phases, the first phase is the correction. The motion from the animal piece is simulated using a linear equation. As in (1), the state of the moving object at time k will be related to the moving object at time k-1. The correlation between the two depends on the matrix F. Taking parabolic motion as an example, the state described here ^1 includes moving the position, velocity, or acceleration of the object. Through this __, the card filter can move the object state for the next time in the prediction phase. : 100120482 Form No. A0101 Page 9 of 18 Page 1002034641-0 201251445 Calculated as in (2).
Xfc = FfcXfc_i + Β^ιι,ι: + w*: (1) (2) [0018] 在以拋物線運動為例中’請參閱第2圄 布 <圖,第2圖係為移動 物件做拋物線運動之示意圖。在第2闇士 ^ ^ 币Z圖中,當我們想要尋 找移動物件300最高點310時,根據物理定律可知,就是 在垂直速度為零的位置,透過這樣特徵點的假設’可以 透過卡爾曼濾、波器預測出移動物件3_達特徵點的預測 時間。 [0019] 除此之外,吾人更提出以人臉轉動的例子,將卡爾曼遽 波器的物件狀態xk更改為人臉的角度、角速度或角加速 度,藉以預測人臉在回到零度(人臉正面)的時間。 [0020] 接著步驟220依據預測時間執行自動快門控制流程,並以 第二解析度擷取移動物件之第二影像’其中,第二解析 度係大於第一解析度’舉例而言_’第一解析度可以是6 4 〇Xfc = FfcXfc_i + Β^ιι,ι: + w*: (1) (2) [0018] In the case of parabolic motion, see '2nd &cloth<Fig. 2, parabola for moving objects Schematic diagram of the movement. In the second sorcerer ^ ^ coin Z map, when we want to find the highest point 310 of the moving object 300, according to the laws of physics, it is known that the vertical velocity is zero, and the assumption of such feature points can pass through Kalman The filter and the waver predict the predicted time of the moving object 3_ to the feature point. [0019] In addition, we also propose to change the object state xk of the Kalman chopper to the angle, angular velocity or angular acceleration of the face with the example of the face rotation, so as to predict that the face is returning to zero (human) Face face) time. [0020] Next, step 220 performs an automatic shutter control process according to the predicted time, and captures a second image of the moving object by a second resolution, wherein the second resolution is greater than the first resolution, for example, _ The resolution can be 6 4 〇
x480 pixels,而第二解析度可以是4096x3072 Q pixels 〇 [0021] 然而,由於我們要拍攝的對像是一個移動物件,在移動 物件的拍攝中需要注意到一個重要的問題,也就是要降 低移動物件所造成第二影像的模糊。在前述的問題中, 通常利用較高的感光度(ISO)或大光圈以降低曝光時間。 實際上,用大光圈又因為掏取第二影像時會有較少的雜 訊,會有較佳的效果。 100120482 表單編號A0101 第10頁/共18頁 1002034641-0 201251445 [0022] -fa s . 野銘說相的拍攝條件T,因其景深錢,可否正確 裡可、物件對焦將會對第二影像的品質有重要影響。這 區分成兩種情況,第一個情況為當移動物件的移 ^於相機距離沒有改變時,對焦的位置就不需變動 第-個情況為當移動物件的移動相對於相機有遠近 遠^移動時’舉例來說’移動物件原本在距離相機較 斷’所以最初對焦可能在較遠處,然而當移動物件不 靠近相機’因此當移動物件移動到特徵點時,由於 〇 光_關係而導致無法提供很好的龍品質。因此針 門上開所述之問題,本發明之則物件移動趨勢驅動快 、方法中,卡爾曼濾波器更包含依據移動物件之大小 J變化、對焦距離或對焦距離變化以取得預定時間 士“、、值’使自動快門控制流程依據對焦值擷取移動物 之第—影像。此外,本發明之利用物件移動趨勢驅動 陕門的方法更可以包含藉由粒子濾波器(Particle Fil_ ter)修正所述之對焦值’粒子攄波器可以透過在對焦位 Q 置則後做多點取樣’利用對比度的趨勢作為更新估計誤 差以及運動矩陣的依據。 [0023] 〇 ^ 卜’請參閱第3及4圖’第3圖係為本發明之利用物件移 動趨勢驅動快門的系統之實施例之示意圖以及第4圖係為 本發明之利用物件移動趨勢驅動快門的系統之另一實施 例之示意圖。在第3及4圖中,感應器400所擷取移動物件 600的第一影像500會以第一解析度403輸出,舉例而言 ’以視頻圖形陣列(VGA)4〇i輸出的第一解析度403係640 x48〇 pixels,接著第一影像500就會被傳遞至預測移動 100120482 *單鵠號A0101 第11頁/共18頁 1002034641-0 201251445 系統41 0中分析並判斷移動物件6 0 0到達特徵點的預測時 間及相機的自動快門控制裝置420(包含感光度大小和曝 光時間)。當到達預測時間時’感應器4〇〇就會轉換為以 第二解析度404以及依據預測移動系統4丨〇所預測的感光 度大小和曝光時間以擷取第二影像51〇,其中,預測移動 系統410係例如為卡爾曼濾波器411,並且預測移動系統 410内可以更包含粒子滤波器412,第二解析度係例如以 全解析度(Full)402擷取,其所擷取之影像之解析度係 例如4096x3072 pixels。此時,第二影像51〇就可以透 過影像感測處理裝置430(ISP Pipeline : Image 〇X480 pixels, and the second resolution can be 4096x3072 Q pixels 〇[0021] However, since the object we want to shoot is a moving object, we need to notice an important problem in the shooting of moving objects, that is, to reduce the movement. The blurring of the second image caused by the object. In the foregoing problems, a higher sensitivity (ISO) or a large aperture is generally utilized to reduce the exposure time. In fact, using a large aperture will result in better results because there will be less noise when capturing the second image. 100120482 Form No. A0101 Page 10 of 18 1002034641-0 201251445 [0022] -fa s . Nomin's shooting condition T, because of its depth of field, can it be correct, the object will focus on the second image Quality has an important impact. This is divided into two cases. The first case is that when the moving object moves to the camera distance, the position of the focus does not need to be changed. The first case is when the moving object moves farther and closer to the camera. When 'for example, 'the moving object is originally broken from the camera' so the initial focus may be far away, but when the moving object is not close to the camera', so when the moving object moves to the feature point, it cannot be due to the twilight_relation Provides good dragon quality. Therefore, the problem of the opening of the needle door is that the moving tendency of the object is driven fast. In the method, the Kalman filter further includes changing according to the size J of the moving object, the focusing distance or the focusing distance to obtain the predetermined time ", The value 'the automatic shutter control process extracts the first image of the moving object according to the focus value. In addition, the method for utilizing the movement trend of the object to drive the Shaanxi gate of the present invention may further comprise modifying the particle filter by a particle filter. The focus value 'particle chopper can be multi-sampled after setting the focus bit Q' to use the trend of contrast as the basis for updating the estimation error and the motion matrix. [0023] 〇^ 卜 'Please refer to pictures 3 and 4 3 is a schematic view of an embodiment of a system for driving a shutter using object movement tendency according to the present invention, and FIG. 4 is a schematic view showing another embodiment of a system for driving a shutter using object movement tendency according to the present invention. In FIG. 4, the first image 500 of the moving object 600 captured by the sensor 400 is output at a first resolution 403, for example, 'video graphics array. The first resolution 403 of the (VGA) 4〇i output is 640 x 48 〇 pixels, and then the first image 500 is transmitted to the predicted mobile 100120482. * Single apostrophe A0101 Page 11 / 18 pages 1002034641-0 201251445 System 41 0 analyzes and judges the predicted time of the moving object 600 reaching the feature point and the camera's automatic shutter control device 420 (including the sensitivity level and exposure time). When the predicted time is reached, the sensor 4〇〇 is converted to The second resolution 404 and the second image 51〇 are captured according to the magnitude and exposure time predicted by the predicted mobile system 4丨〇, wherein the predicted mobile system 410 is, for example, a Kalman filter 411, and the mobile system is predicted The particle filter 412 may be further included in the 410. The second resolution is obtained by, for example, full resolution (Full) 402, and the resolution of the captured image is, for example, 4096 x 3072 pixels. At this time, the second image 51 is It can be transmitted through the image sensing processing device 430 (ISP Pipeline: Image 〇
Sensor processing pipeline)以形成影像資料52〇, 接著再將影像資料520儲存至外部記憶體44〇中。 [0024] [0025] [0026] 以上所述僅絲娜,㈣為限難者。任何未脫離本 發明之精神與料,*對其崎之等效修改或變更,均 應包含於後附之申請專利範圍中。 【圖式簡單說明】The sensor processing pipeline is formed to form image data 52, and then the image data 520 is stored in the external memory 44. [0025] [0026] The above is only Senna, (4) is the limiter. Any equivalent modifications or alterations to the present invention without departing from the spirit and scope of the present invention are intended to be included in the scope of the appended claims. [Simple description of the map]
第1圖係為本發明之利用物件移動趨勢驅動快門的方法之 實施例之示意圖。 U 第2圖係移動物件做拋物線運動之示魚圖。 第3圖係為本發明之利用物件移動趨勢驅動快門的系統之 實施例之示意圖。 第4圖係為本發明之利用物件移動趨勢驅動快門的系統之 另一實施例之示意圖。 【主要元件符號說明】 200 :步驟 100120482 表單編號A0101 第12頁/共18頁 1002034641-0 201251445 Ο :步驟 :步驟 :移動物件 :最高點 :感應器 :視頻圖形陣列 :全解析度 :第一解析度 :第二解析度 :預測移動系統 :卡爾曼慮波器 :粒子濾波器 :自動快門控制裝置 :影像感測處理裝置 :外部記憶體 :第一影像 :第二影像 :影像資料 :移動物件 100120482 表單編號Α0101 第13頁/共18頁 1002034641-0BRIEF DESCRIPTION OF THE DRAWINGS Figure 1 is a schematic illustration of an embodiment of a method of driving a shutter using object movement trends. U Figure 2 is a fish diagram of a parabolic motion of a moving object. Figure 3 is a schematic illustration of an embodiment of a system for utilizing object movement trend to drive a shutter in accordance with the present invention. Figure 4 is a schematic illustration of another embodiment of a system for utilizing object movement trend to drive a shutter of the present invention. [Main component symbol description] 200: Step 100120482 Form number A0101 Page 12/18 pages 1002034641-0 201251445 Ο: Step: Step: Moving object: Highest point: Sensor: Video graphics array: Full resolution: First resolution Degree: second resolution: predictive mobile system: Kalman filter: particle filter: automatic shutter control device: image sensing processing device: external memory: first image: second image: image data: moving object 100120482 Form No. 1010101 Page 13 of 18 Page 1002034641-0
Claims (1)
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW100120482A TW201251445A (en) | 2011-06-10 | 2011-06-10 | System and method of driving shutter by an object moving tendency |
US13/243,415 US8891000B2 (en) | 2011-06-10 | 2011-09-23 | System and method of driving shutter by tendency of moving object |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW100120482A TW201251445A (en) | 2011-06-10 | 2011-06-10 | System and method of driving shutter by an object moving tendency |
Publications (1)
Publication Number | Publication Date |
---|---|
TW201251445A true TW201251445A (en) | 2012-12-16 |
Family
ID=47292892
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
TW100120482A TW201251445A (en) | 2011-06-10 | 2011-06-10 | System and method of driving shutter by an object moving tendency |
Country Status (2)
Country | Link |
---|---|
US (1) | US8891000B2 (en) |
TW (1) | TW201251445A (en) |
Families Citing this family (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2013034167A (en) | 2011-06-28 | 2013-02-14 | Sony Corp | Information processing device, and information processing method and program |
CN105409197A (en) * | 2013-03-15 | 2016-03-16 | 趣普科技公司 | Apparatus and methods for providing persistent companion device |
US20150314454A1 (en) | 2013-03-15 | 2015-11-05 | JIBO, Inc. | Apparatus and methods for providing a persistent companion device |
US9100572B2 (en) * | 2013-05-24 | 2015-08-04 | Xerox Corporation | Methods and systems for confidence-based image processing |
ITTO20130534A1 (en) * | 2013-06-28 | 2014-12-28 | St Microelectronics Srl | PROCEDURE AND SYSTEM FOR AUTOFOCUS, EQUIPMENT AND CORRESPONDENT COMPUTER PRODUCT |
USD746886S1 (en) | 2014-05-23 | 2016-01-05 | JIBO, Inc. | Robot |
CN105409195B (en) * | 2014-05-23 | 2019-08-20 | 华为技术有限公司 | Photographic method and device |
US9986155B2 (en) * | 2014-09-05 | 2018-05-29 | Htc Corporation | Image capturing method, panorama image generating method and electronic apparatus |
US9973681B2 (en) * | 2015-06-24 | 2018-05-15 | Samsung Electronics Co., Ltd. | Method and electronic device for automatically focusing on moving object |
CN107071333A (en) * | 2017-05-19 | 2017-08-18 | 深圳天珑无线科技有限公司 | Method of video image processing and video image processing device |
CN111108743B (en) * | 2017-09-20 | 2021-07-20 | 富士胶片株式会社 | Image pickup control device, image pickup control method, and recording medium |
CN109186539A (en) * | 2018-08-06 | 2019-01-11 | 合肥移顺信息技术有限公司 | A kind of throwing object in high sky height detection method and its bearing calibration |
EP3975543A4 (en) * | 2019-06-13 | 2022-07-13 | Sony Group Corporation | Image capturing device, image capturing control method, and program |
CN110933303B (en) * | 2019-11-27 | 2021-05-18 | 维沃移动通信(杭州)有限公司 | Photographing method and electronic equipment |
KR20210098292A (en) * | 2020-01-31 | 2021-08-10 | 삼성전자주식회사 | Electronic device including camera and operating method thereof |
Family Cites Families (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH0868934A (en) * | 1994-08-31 | 1996-03-12 | Nikon Corp | Automatic focusing device |
EP0956695B1 (en) * | 1997-01-31 | 2002-11-06 | Sharp Kabushiki Kaisha | Scene-motion based dynamic shutter speed adjustment system and method |
-
2011
- 2011-06-10 TW TW100120482A patent/TW201251445A/en unknown
- 2011-09-23 US US13/243,415 patent/US8891000B2/en not_active Expired - Fee Related
Also Published As
Publication number | Publication date |
---|---|
US8891000B2 (en) | 2014-11-18 |
US20120314123A1 (en) | 2012-12-13 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
TW201251445A (en) | System and method of driving shutter by an object moving tendency | |
JP6790177B2 (en) | How to select frames for video sequences, systems and equipment | |
US8994847B2 (en) | Digital camera and image capturing method | |
US20210014411A1 (en) | Method for image processing, electronic device, and computer readable storage medium | |
JP4708479B2 (en) | System and method for realizing motion-driven multi-shot image stabilization | |
EP2525565B1 (en) | Digital photographing apparatus and method of controlling the same to increase continuous shooting speed for capturing panoramic photographs | |
US8654201B2 (en) | Method for deblurring an image | |
JP4274233B2 (en) | Imaging apparatus, image processing apparatus, image processing method therefor, and program causing computer to execute the method | |
CN106713768B (en) | People's scape image composition method, system and computer equipment | |
JP2018525853A (en) | Smart image sensor with integrated memory and processor | |
US20080231721A1 (en) | Image capture systems and methods | |
CN103856833A (en) | Video processing apparatus and method | |
US9111129B2 (en) | Subject detecting method and apparatus, and digital photographing apparatus | |
TWI543615B (en) | Image processing method and electronic apparatus using the same | |
WO2020001219A1 (en) | Image processing method and apparatus, storage medium, and electronic device | |
JP6892524B2 (en) | Slow motion video capture based on target tracking | |
KR101469544B1 (en) | Image processing method and apparatus, and digital photographing apparatus | |
EP3218756B1 (en) | Direction aware autofocus | |
EP2320377A1 (en) | Fluttering illumination system and method for encoding the appearance of a moving object | |
CN102821241B (en) | Device and method using object moving trend to drive shutter | |
JP2009124210A (en) | Image pickup apparatus, image pickup method, image searching apparatus and image searching method | |
US20130236055A1 (en) | Image analysis device for calculating vector for adjusting a composite position between images | |
CN107431756B (en) | Method and apparatus for automatic image frame processing possibility detection | |
US20240196091A1 (en) | Image capturing device and method | |
KR20160109603A (en) | Image photographing apparatus and methods for photographing image |