TWI440952B - Autofocus system - Google Patents

Autofocus system Download PDF

Info

Publication number
TWI440952B
TWI440952B TW101117486A TW101117486A TWI440952B TW I440952 B TWI440952 B TW I440952B TW 101117486 A TW101117486 A TW 101117486A TW 101117486 A TW101117486 A TW 101117486A TW I440952 B TWI440952 B TW I440952B
Authority
TW
Taiwan
Prior art keywords
focus
value
unit
converted
conversion
Prior art date
Application number
TW101117486A
Other languages
Chinese (zh)
Other versions
TW201348837A (en
Inventor
Tung Chan Tsai
Homer H Chen
Original Assignee
Univ Nat Taiwan
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Univ Nat Taiwan filed Critical Univ Nat Taiwan
Priority to TW101117486A priority Critical patent/TWI440952B/en
Priority to US13/491,409 priority patent/US8571403B2/en
Publication of TW201348837A publication Critical patent/TW201348837A/en
Application granted granted Critical
Publication of TWI440952B publication Critical patent/TWI440952B/en

Links

Description

自動對焦系統Autofocus system

  本發明係有關自動對焦,特別是關於一種可快速估算合焦位置的自動對焦系統。The present invention relates to autofocus, and more particularly to an autofocus system that can quickly estimate the focus position.

  相機的自動對焦主要包含對焦評估(focus measurement)及搜尋策略(search strategy)兩部分。其中,對焦評估根據輸入影像以產生相應的對焦值(focus value),而各個鏡頭位置與相應對焦值可得到一對焦曲線(focus profile);搜尋策略則是根據得到的對焦值來引導鏡頭以找到最大對焦值所在的鏡頭位置,亦即合焦(in-focus)位置。The camera's auto focus mainly includes two parts: focus measurement and search strategy. Wherein, the focus evaluation is based on the input image to generate a corresponding focus value, and each lens position and the corresponding focus value can obtain a focus profile; the search strategy is to guide the lens according to the obtained focus value to find The position of the lens where the maximum focus value is located, that is, the in-focus position.

  就目前所提出的各種傳統搜尋策略而言,普遍存在以下的缺點。為了抵抗影像雜訊以增進自動對焦的準確度,對焦評估所產生的對焦曲線於最大對焦值附近會變得更陡峭,且陡峭區域變得更小。此種對焦曲線將使得傳統搜尋策略難以設計,或者造成搜尋速度的減慢。此外,傳統搜尋策略一般都需要使用很多的參數,以決定目前鏡頭位置究竟位於對焦曲線的哪一個部分。該些參數不但難以決定,且往往無法適用於複雜度相異的不同場景;而且,一旦換了對焦評估方法,該些參數必須重新決定。再者,對於一些規則導向的搜尋策略,例如費布納西(Fibonacci)搜尋策略,必須對鏡頭起始位置作一些假設,因而使得此類型搜尋策略不能應用到數位攝影機的自動對焦。As far as various traditional search strategies are proposed, the following shortcomings are common. In order to resist image noise to improve the accuracy of autofocus, the focus curve produced by the focus evaluation becomes steeper near the maximum focus value, and the steep area becomes smaller. Such a focus curve will make traditional search strategies difficult to design or slow down the search speed. In addition, traditional search strategies generally require a number of parameters to determine which part of the focus curve the current lens position is. These parameters are not only difficult to determine, but often cannot be applied to different scenarios with different complexity; and, once the focus evaluation method is changed, these parameters must be re-determined. Furthermore, for some rule-oriented search strategies, such as the Fibonacci search strategy, some assumptions must be made about the starting position of the shot, thus making this type of search strategy unapplied to the autofocus of a digital camera.

  因此,亟需提出一種新穎的自動對焦機制,用以解決上述傳統自動對焦所產生的問題。Therefore, there is a need to propose a novel autofocus mechanism to solve the problems caused by the above conventional autofocus.

  鑑於上述,本發明實施例的目的之一在於提出一種自動對焦系統,用以快速估算得到合焦位置,大幅降低運算量,或減少經驗性參數的使用。In view of the above, one of the objects of embodiments of the present invention is to provide an autofocus system for quickly estimating a focus position, greatly reducing the amount of computation, or reducing the use of empirical parameters.

  根據本發明實施例,自動對焦系統包含對焦評估單元、對焦轉換單元及合焦位置估算單元。對焦評估單元接收一影像,並據以產生一相應對焦值。對焦轉換單元接收對焦評估單元所提供的對焦值,並對其進行轉換以得到一相應的轉換後之對焦值。合焦位置估算單元根據數個轉換後之對焦值及相應的數個鏡頭位置,以解析(analytical)方式得到一合焦位置。According to an embodiment of the invention, an autofocus system includes a focus evaluation unit, a focus conversion unit, and a focus position estimating unit. The focus evaluation unit receives an image and generates a corresponding focus value accordingly. The focus conversion unit receives the focus value provided by the focus evaluation unit and converts it to obtain a corresponding converted focus value. The focus position estimating unit obtains a focus position in an analytical manner according to the plurality of converted focus values and the corresponding plurality of lens positions.

  第一圖顯示本發明實施例之自動對焦系統100的方塊圖,其可適用於一般影像擷取裝置,例如相機或攝影機。在本實施例中,對焦評估(focus measurement)單元11接收一影像,並據以產生一相應對焦值(focus value),其值越大表示影像越清晰,反之,對焦值越小則表示影像越模糊。本實施例之對焦評估單元11可使用一般對焦評估技術來實施,例如高通濾波器,但不限定於此。由於清晰影像會比模糊影像具有較多的高頻成分,因此清晰影像經過高通濾波器後會有較高的對焦值,而模糊影像經過高通濾波器後會有較低的對焦值。對焦評估單元11可以使用硬體或軟體方式來實施,其所產生的對焦值可以從影像直接運算得到,也可間接從影像的頻率成分運算得到。The first figure shows a block diagram of an autofocus system 100 in accordance with an embodiment of the present invention that can be applied to a general image capture device, such as a camera or camera. In this embodiment, the focus measurement unit 11 receives an image and generates a corresponding focus value. The larger the value, the clearer the image, and the smaller the focus value, the more the image is displayed. blurry. The focus evaluation unit 11 of the present embodiment can be implemented using a general focus evaluation technique, such as a high pass filter, but is not limited thereto. Since a clear image has more high-frequency components than a blurred image, a clear image will have a higher focus value after passing through the high-pass filter, and the blurred image will have a lower focus value after passing through the high-pass filter. The focus evaluation unit 11 can be implemented in a hardware or software manner, and the focus value generated can be directly calculated from the image or indirectly calculated from the frequency component of the image.

  上述對焦評估單元11之操作可配合驅動單元10(例如伺服馬達)來執行。驅動單元10可用以移動影像擷取裝置的鏡頭(lens)至某一鏡頭位置,以得到相應的影像,因而使得對焦評估單元11可據以得到相應的對焦值。若將複數個鏡頭位置及所對應的對焦值作圖,可得到對焦曲線(focus profile),如第二圖所例示。在對焦曲線中,最大對焦值所在的鏡頭位置,通常所對應的影像是最清晰的,此位置稱為合焦(in-focus)位置。反之,在對焦值較小的區域,所對應的影像是比較模糊的,稱之為離焦(out-of-focus)區域。值得注意的是,如第二圖所例示的對焦曲線,其中平緩的離焦區域所佔比例遠比鄰近合焦位置的陡峭區域來得大,因此可用以估算合焦位置的資訊太少,因而無法快速且準確的估算出合焦位置。The operation of the above-described focus evaluation unit 11 can be performed in conjunction with the drive unit 10 (for example, a servo motor). The driving unit 10 can be used to move the lens of the image capturing device to a certain lens position to obtain a corresponding image, thereby enabling the focus evaluation unit 11 to obtain a corresponding focus value. If a plurality of lens positions and corresponding focus values are plotted, a focus profile can be obtained, as illustrated in the second figure. In the focus curve, the position of the lens where the maximum focus value is located is usually the clearest image. This position is called the in-focus position. On the contrary, in the area where the focus value is small, the corresponding image is relatively blurred, which is called an out-of-focus area. It is worth noting that, as shown in the second figure, the focus defocus area is much larger than the steep area near the focus position, so the information available to estimate the focus position is too small to be Quickly and accurately estimate the focus position.

  鑑於此,本實施例使用對焦轉換單元12,其接收對焦評估單元11所提供的對焦值,並對其進行轉換,因而得到相應的轉換後之對焦值(transformed focus value)。接下來,合焦位置估算單元13根據數個轉換後之對焦值及相應的數個鏡頭位置,以解析(analytical)方式快速得到合焦位置。本實施例之對焦轉換單元12及合焦位置估算單元13可使用硬體或軟體方式來實施。In view of this, the present embodiment uses the focus conversion unit 12, which receives the focus value supplied from the focus evaluation unit 11, and converts it, thereby obtaining a corresponding converted focus value. Next, the focus position estimating unit 13 quickly obtains the focus position in an analytical manner according to the plurality of converted focus values and the corresponding number of lens positions. The focus conversion unit 12 and the focus position estimating unit 13 of the present embodiment can be implemented using a hardware or software.

  第三圖顯示本發明實施例之對焦轉換建立系統300的方塊圖,用以提供對焦轉換單元12(第一圖)進行對焦值轉換之依據。在本實施例中,對焦轉換建立系統300主要包含一轉換建立單元31,其接收對焦評估單元11所提供的對焦曲線(如第二圖所例示),將其轉換而得到轉換後之對焦曲線(transformed focus profile)。根據本發明實施例的特徵之一,轉換後之對焦曲線可以被一可解析的數學式來描述。在本說明書中,所謂“可解析數學描述(analytical mathematical expression)”係指一種包含基本數學運算的數學描述,該基本數學運算例如加、減、乘、除或指冪(exponentiation)。可解析數學描述可以為閉合型式(closed-form)數學描述或代數(algebraic)數學描述,但不限定於此。轉換建立單元31所產生的轉換後之對焦曲線則提供給對焦轉換單元12(第一圖),據以進行對焦值的轉換。The third figure shows a block diagram of the focus conversion establishing system 300 of the embodiment of the present invention for providing a basis for the focus conversion unit 12 (first image) to perform focus value conversion. In the present embodiment, the focus conversion establishing system 300 mainly includes a conversion establishing unit 31 that receives the focus curve provided by the focus evaluation unit 11 (as illustrated in the second figure), and converts it to obtain a converted focus curve ( Transformed focus profile). According to one of the features of embodiments of the present invention, the converted focus curve can be described by a resolvable mathematical formula. In the present specification, the term "analytical mathematical expression" refers to a mathematical description containing basic mathematical operations such as addition, subtraction, multiplication, division or exponentiation. The parsable mathematical description may be a closed-form mathematical description or an algebraic mathematical description, but is not limited thereto. The converted focus curve generated by the conversion establishing unit 31 is supplied to the focus conversion unit 12 (first map), whereby the conversion of the focus value is performed.

  轉換後之對焦曲線所具有的可解析數學描述特徵可使用程式設計(programming)方式來實施,也可使用數值表格(table)方式以記載轉換前之對焦值與相應的轉換後之對焦值。該數值表格可儲存於影像擷取裝置的記憶體(例如非揮發性記憶體)。The parsable mathematical description feature of the converted focus curve can be implemented by using a programming method, or a table can be used to record the focus value before conversion and the corresponding converted focus value. The value table can be stored in the memory of the image capture device (eg, non-volatile memory).

  第四圖例示轉換建立單元31(第三圖)所產生的轉換後之對焦曲線。根據本發明實施例的特徵之一,轉換後之對焦曲線(第四圖)可將原始對焦曲線(第二圖)的陡峭區域予以擴展,並減少了原本的平緩區域。藉此,可用以估算合焦位置的資訊量增加了,使得合焦位置估算單元13(第一圖)得以使用解析方式快速且準確的估算出合焦位置,且可大量減少估算所需的運算量。以第四圖所例示轉換後之對焦曲線為例,合焦位置估算單元13可使用數學解析方式得到最小值,其相應鏡頭位置即表示合焦位置。The fourth figure illustrates the converted focus curve generated by the conversion establishing unit 31 (third map). According to one of the features of the embodiments of the present invention, the converted focus curve (fourth map) can expand the steep region of the original focus curve (second map) and reduce the original flat region. Thereby, the amount of information that can be used to estimate the focus position is increased, so that the focus position estimating unit 13 (first map) can quickly and accurately estimate the focus position using the analytical method, and can greatly reduce the amount of calculation required for the estimation. . Taking the converted focus curve illustrated in the fourth figure as an example, the focus position estimating unit 13 can obtain the minimum value using a mathematical analysis method, and the corresponding lens position indicates the focus position.

  由於本發明實施例可快速地估算得到合焦位置,因此,驅動單元10即可據以快速地移動鏡頭至合焦位置。此外,本實施例使用數學解析方式以得到合焦位置,其運算簡單,因而得以大量的降低運算量,且減少經驗性參數的使用。另外,本實施例所使用的對焦值轉換可以在影像擷取裝置出廠前就決定好,一旦決定後,就可應用於各種不同的景物。再者,因為本發明實施例沒有任何對焦評估的假設,因此可適用於各種對焦評估技術所產生的對焦值上。相較於傳統自動對焦方法係直接使用對焦評估所產生的對焦值來搜尋合焦位置,本實施例則是先將對焦值進行轉換,再根據轉換後之對焦值來估算合焦位置。本實施例的轉換後之對焦曲線可被可解析的數學式來描述,使得鏡頭即使在離焦位置時,也能夠準確估算合焦位置,以達到快速自動對焦的目的。Since the embodiment of the present invention can quickly estimate the focus position, the drive unit 10 can quickly move the lens to the focus position. In addition, the present embodiment uses a mathematical analysis method to obtain a focus position, which is simple in operation, thereby greatly reducing the amount of calculation and reducing the use of empirical parameters. In addition, the focus value conversion used in the embodiment can be determined before the image capturing device leaves the factory, and once determined, it can be applied to various different scenes. Furthermore, since the embodiment of the present invention does not have any assumption of focus evaluation, it can be applied to the focus value generated by various focus evaluation techniques. Compared with the conventional autofocus method, the focus value generated by the focus evaluation is directly used to search for the focus position. In this embodiment, the focus value is first converted, and then the focus position is estimated according to the converted focus value. The converted focus curve of the present embodiment can be described by a resolvable mathematical formula, so that the lens can accurately estimate the focus position even in the defocus position to achieve the purpose of fast autofocus.

  以上所述僅為本發明之較佳實施例而已,並非用以限定本發明之申請專利範圍;凡其它未脫離發明所揭示之精神下所完成之等效改變或修飾,均應包含在下述之申請專利範圍內。The above description is only the preferred embodiment of the present invention, and is not intended to limit the scope of the present invention; all other equivalent changes or modifications which are not departing from the spirit of the invention should be included in the following Within the scope of the patent application.

100...自動對焦系統100. . . Autofocus system

10...驅動單元10. . . Drive unit

11...對焦評估單元11. . . Focus evaluation unit

12...對焦轉換單元12. . . Focus conversion unit

13...合焦位置估算單元13. . . Focusing position estimation unit

300...對焦轉換建立系統300. . . Focus conversion system

31...轉換建立單元31. . . Conversion establishment unit

第一圖顯示本發明實施例之自動對焦系統的方塊圖。
第二圖例示對焦曲線。
第三圖顯示本發明實施例之對焦轉換建立系統的方塊圖。
第四圖例示第三圖之轉換建立單元所產生的轉換後之對焦曲線。
The first figure shows a block diagram of an autofocus system in accordance with an embodiment of the present invention.
The second figure illustrates the focus curve.
The third figure shows a block diagram of a focus conversion establishing system in accordance with an embodiment of the present invention.
The fourth figure illustrates the converted focus curve generated by the conversion establishing unit of the third figure.

100...自動對焦系統100. . . Autofocus system

10...驅動單元10. . . Drive unit

11...對焦評估單元11. . . Focus evaluation unit

12...對焦轉換單元12. . . Focus conversion unit

13...合焦位置估算單元13. . . Focusing position estimation unit

Claims (6)

一種自動對焦系統,包含:
   一對焦評估單元,接收一影像並據以產生一相應對焦值;
   一對焦轉換單元,接收該對焦評估單元所提供的對焦值,並對其進行轉換以得到一相應的轉換後之對焦值;及
   一合焦位置估算單元,根據數個轉換後之對焦值及相應的數個鏡頭位置,以解析(analytical)方式得到一合焦位置。
An autofocus system comprising:
a focus evaluation unit that receives an image and generates a corresponding focus value accordingly;
a focus conversion unit receives the focus value provided by the focus evaluation unit and converts it to obtain a corresponding converted focus value; and a focus position estimation unit, according to the plurality of converted focus values and corresponding A plurality of lens positions are obtained in an analytical manner to obtain a focus position.
如申請專利範圍第1項所述之自動對焦系統,更包含:
   一轉換建立單元,接收該對焦評估單元所提供的對焦曲線,將其轉換以得到轉換後之對焦曲線,其提供給該對焦轉換單元,據以進行該對焦值的轉換。
The autofocus system as described in claim 1 of the patent scope further includes:
A conversion establishing unit receives the focus curve provided by the focus evaluation unit, converts it to obtain a converted focus curve, and supplies the focus conversion unit to the focus conversion unit to perform conversion of the focus value.
如申請專利範圍第2項所述之自動對焦系統,其中該轉換後之對焦曲線可以被一可解析的數學式來描述。The autofocus system of claim 2, wherein the converted focus curve can be described by a resolvable mathematical formula. 如申請專利範圍第2項所述之自動對焦系統,其中該轉換後之對焦曲線以一數值表格記載轉換前之對焦值與相應的轉換後之對焦值。The autofocus system of claim 2, wherein the converted focus curve records the focus value before the conversion and the corresponding converted focus value in a numerical value table. 如申請專利範圍第4項所述之自動對焦系統,其中該數值表格儲存於一影像擷取裝置的記憶體中。The autofocus system of claim 4, wherein the value table is stored in a memory of an image capture device. 如申請專利範圍第1項所述之自動對焦系統,更包含:
一驅動單元,用以移動一鏡頭至某一鏡頭位置,以得到相應的影像,因而使得該對焦評估單元可據以得到相應的對焦值。
The autofocus system as described in claim 1 of the patent scope further includes:
a driving unit for moving a lens to a certain lens position to obtain a corresponding image, thereby enabling the focus evaluation unit to obtain a corresponding focus value.
TW101117486A 2010-05-14 2012-05-16 Autofocus system TWI440952B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
TW101117486A TWI440952B (en) 2012-05-16 2012-05-16 Autofocus system
US13/491,409 US8571403B2 (en) 2010-05-14 2012-06-07 Autofocus system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW101117486A TWI440952B (en) 2012-05-16 2012-05-16 Autofocus system

Publications (2)

Publication Number Publication Date
TW201348837A TW201348837A (en) 2013-12-01
TWI440952B true TWI440952B (en) 2014-06-11

Family

ID=50157373

Family Applications (1)

Application Number Title Priority Date Filing Date
TW101117486A TWI440952B (en) 2010-05-14 2012-05-16 Autofocus system

Country Status (1)

Country Link
TW (1) TWI440952B (en)

Also Published As

Publication number Publication date
TW201348837A (en) 2013-12-01

Similar Documents

Publication Publication Date Title
US9313419B2 (en) Image processing apparatus and image pickup apparatus where image processing is applied using an acquired depth map
WO2011158498A1 (en) Image capture device and image capture method
TWI538512B (en) Method for adjusting focus position and electronic apparatus
WO2007058100A1 (en) In-focus detector
US20140376781A1 (en) Image processing device, method of controlling image processing device, and program for causing computer to execute the same method
JPWO2012132486A1 (en) Imaging apparatus, imaging method, program, and program storage medium
JP2007192859A (en) Focusing controller and imaging apparatus
JP6351234B2 (en) Automatic focusing device, control method for automatic focusing device, control program for automatic focusing device, and storage medium
US20160165124A1 (en) Image auto-focusing method and camera using same
TWI557688B (en) System and method for performing depth estimation utilizing defocused pillbox images
CN104364608A (en) Distance measurement device and distance measurement method
TWI524107B (en) Method of auto-focus
CN102520503A (en) Method for quickly focusing high-definition image acquisition equipment
TWI544249B (en) Method for searching position in auto-focus
US20130141537A1 (en) Methodology For Performing Depth Estimation With Defocused Images Under Extreme Lighting Conditions
US9020280B2 (en) System and method for evaluating focus direction under various lighting conditions
TWI440952B (en) Autofocus system
JP2002122776A (en) Autofocus controller, digital still camera and digital video camera equipped with the same, autofocus control method and recording medium having autofocus control program recorded thereon
US8571403B2 (en) Autofocus system
JP7107191B2 (en) Imaging control device, imaging device, and imaging control program
TW201638622A (en) Automatic focusing method and image capturing device utilizing the same
TWI588557B (en) Auto focus method
JP6486453B2 (en) Image processing apparatus, image processing method, and program
JP2014056260A (en) Camera
KR20110137053A (en) Method for deciding failure of auto-focus

Legal Events

Date Code Title Description
MM4A Annulment or lapse of patent due to non-payment of fees