TWI408612B - Method and system for dynamically and simultaneously determining the relative relation between moving objects - Google Patents

Method and system for dynamically and simultaneously determining the relative relation between moving objects Download PDF

Info

Publication number
TWI408612B
TWI408612B TW98132443A TW98132443A TWI408612B TW I408612 B TWI408612 B TW I408612B TW 98132443 A TW98132443 A TW 98132443A TW 98132443 A TW98132443 A TW 98132443A TW I408612 B TWI408612 B TW I408612B
Authority
TW
Taiwan
Prior art keywords
image
feature
relative relationship
value
dynamic
Prior art date
Application number
TW98132443A
Other languages
Chinese (zh)
Other versions
TW201112133A (en
Inventor
Ya Hui Tsai
Yun Te Su
Chun Sheng Wang
Yu Ting Lin
Yen Chang Lin
Original Assignee
Ind Tech Res Inst
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ind Tech Res Inst filed Critical Ind Tech Res Inst
Priority to TW98132443A priority Critical patent/TWI408612B/en
Publication of TW201112133A publication Critical patent/TW201112133A/en
Application granted granted Critical
Publication of TWI408612B publication Critical patent/TWI408612B/en

Links

Abstract

The present invention provides a method for dynamically and simultaneously determining the characteristic relation between moving objects, which comprises steps of: establishing a relation between the image acquiring distance and a image characteristic associated with an object; acquiring an image with respect to a moving apparatus having the object disposed thereon; finding a image area corresponding to the object and determining an image characteristic associated with the object within the image area. Finally, a step is performed to determine the image acquired distance with respect to the object according to the established relation. By means of the foregoing determining method, the present invention further provides a determining system, disposed on the moving apparatus, for acquiring the image of the other moving apparatus, thereby determining the relative relation between the two moving apparatus for being the basis of the safety measure.

Description

動態即時相對關係辨識方法與系統Dynamic instant relative relationship identification method and system

本發明係有關一種影像辨識技術,尤其是指一種根據影像特徵判斷兩物體間的相對關係之一種動態即時相對關係辨識方法與系統。The invention relates to an image recognition technology, in particular to a dynamic instant relative relationship identification method and system for judging the relative relationship between two objects according to image features.

目前市面上雖然有許多種行車記錄裝置,但是都受到記憶體大小的限制,只能儲存最新數分鐘到一兩小時的資料。但若遇上車禍、意外,駕駛很有可能無法關閉影像記錄的功能(例如昏迷、送醫,或是不能動彈等狀況),導致記錄裝置持續運作,而蓋掉記錄車禍發生時的資料,使得最關鍵時刻的影像反而消失而無法提供參考。若讓行車記錄器隨著車輛的移動而開機,則此記錄器就無法在停等紅燈或是路邊停車時提供關鍵影像;尤其是路邊停車時,若被誤撞,則肇事者大多會逃逸,此時關鍵影像將會成為索賠與判定肇事當時情況的重要依據。Although there are many kinds of driving recording devices on the market, they are limited by the size of the memory, and can only store the latest minutes to one or two hours of data. However, in the event of a car accident or accident, driving may not be able to turn off the function of image recording (such as coma, medical treatment, or inability to move), causing the recording device to continue to operate, and to cover the data when the accident occurred. The image at the most critical moment disappeared and could not be used as a reference. If the driving recorder is turned on with the movement of the vehicle, the recorder cannot provide key images when stopping waiting for a red light or parking on the road; especially when the roadside parking is accidentally hit, most of the perpetrators Will escape, at this time the key image will become an important basis for the claim and the circumstances of the anecdote.

而在習用技術中,例如日本公開申請案JP2009032143揭露了一種減輕事故發生時證據資料消失風險的行車記錄器,在該技術中,於車輛行進間擷取車輛前方的影像訊號,將該影像訊號轉成動畫影像資訊而記錄於記憶體中。該技術藉由將動畫影像分割成複數個靜止影像,然後當事故發生時,可以將對應發生時間點的靜止影像,利用無線網路送出。In the conventional technology, for example, Japanese laid-open application JP2009032143 discloses a driving recorder for reducing the risk of disappearing of evidence data in the event of an accident, in which the image signal in front of the vehicle is captured during the travel of the vehicle, and the image signal is converted. The animation image information is recorded in the memory. The technique divides an animated image into a plurality of still images, and then, when an accident occurs, a still image corresponding to the occurrence time point can be sent out using a wireless network.

另外,中華民國專利公開號TW200409051也揭露了一種記錄影像以保障車禍發生時的資料真實性的技術。在該技術中,採用攝影機與距離偵測分開的做法,利用偵測器偵測車輛週邊的物體,如果物體太過接近,則啟動攝影機開始錄影。In addition, the Republic of China Patent Publication No. TW200409051 also discloses a technique for recording images to ensure the authenticity of data in the event of a car accident. In this technique, the camera is separated from the distance detection, and the detector is used to detect objects around the vehicle. If the object is too close, the camera is started to start recording.

本發明提供一種動態即時相對關係辨識方法與系統,其係利用影像偵測與周環環境中可動裝置的相對關係,並根據相對關係啟動對應的機制以警示駕駛員或者是對可能產生意外的狀況進行影像的儲存。The invention provides a dynamic instant relative relationship identification method and system, which utilizes the relative relationship between image detection and a movable device in a circumferential environment, and activates a corresponding mechanism according to the relative relationship to alert the driver or to a situation that may cause an accident. Store images.

本發明提供一種動態即時相對關係辨識方法與系統,其係利用影像擷取裝置擷取週邊環境中車輛的影像,並於該影像中偵測車牌的特徵,並且根據車牌特徵估測車輛的速度與距離,同時環境偵測攝影機也偵測紅綠燈與速限號誌等環境資訊,藉此判斷是否有可能對我車造成危害。The invention provides a dynamic instant relative relationship identification method and system, which uses an image capturing device to capture images of vehicles in a surrounding environment, and detects the characteristics of the license plate in the image, and estimates the speed of the vehicle according to the license plate characteristics. At the same time, the environmental detection camera also detects environmental information such as traffic lights and speed limit signals to determine whether it is likely to cause harm to my car.

本發明提供一種動態即時相對關係辨識方法與系統,其係以視覺影像記錄,不需依賴其他額外的設備,針對與其他車輛的距離、速度或加速度的狀態進行偵測,即時記錄影像,本發明可以依照環境動態(例如:紅綠燈號、兩車間的距離、速度與加速度或者是速限)調整紀錄參數的門檻值。The invention provides a dynamic instant relative relationship identification method and system, which is recorded by visual images, does not need to rely on other additional equipment, detects the state of distance, speed or acceleration with other vehicles, and instantly records images, the present invention The threshold value of the recorded parameter can be adjusted according to environmental dynamics (for example: traffic light number, distance between two workshops, speed and acceleration, or speed limit).

在一實施例中,本發明提供一種動態即時相對關係辨識方法,其係包括有下列步驟:建立一影像擷取裝置之影像擷取距離與一特徵物所具有之一影像特徵的特徵關係;擷取一可動裝置之一影像,該可動裝置上具有該特徵物;於該影像中偵測該特徵物之影像區域;於影像區域中決定關於特徵物之一偵測影像特徵;以及根據偵測影像特徵於該特徵關係中決定該影像擷取裝置與該特徵物間的相對關係。在另一實施例中,可以根據該相對關係啟動警示或錄影的機制。In an embodiment, the present invention provides a dynamic instant relative relationship identification method, which includes the following steps: establishing an image capture distance of an image capture device and a feature relationship of an image feature of a feature; Taking an image of a movable device having the feature; detecting an image region of the feature in the image; determining an image feature for detecting one of the features in the image region; and detecting the image according to the detected image The feature determines the relative relationship between the image capturing device and the feature in the feature relationship. In another embodiment, a mechanism for alerting or recording can be initiated based on the relative relationship.

在另一實施例中,本發明更提供一種動態車輛即時相對關係辨識方法,其係包括有下列步驟:建立一影像擷取裝置之影像擷取距離與車牌所具有之一影像特徵的特徵關係;擷取一第一車輛之一影像,該第一車輛上具有一車牌;於該影像中偵測該車牌之影像區域;於影像區域中決定關於車牌之一偵測影像特徵;以及根據偵測影像特徵於該特徵關係中決定該影像擷取裝置與該車牌間的相對關係。在另一實施例中,可以根據該相對關係啟動警示或錄影的機制。In another embodiment, the present invention further provides a dynamic vehicle instantaneous relative relationship identification method, which comprises the steps of: establishing a feature relationship between an image capturing distance of an image capturing device and an image feature of the license plate; Taking an image of a first vehicle having a license plate; detecting an image area of the license plate in the image; determining an image feature of one of the license plates in the image area; and detecting the image according to the detected image The feature determines the relative relationship between the image capturing device and the license plate in the feature relationship. In another embodiment, a mechanism for alerting or recording can be initiated based on the relative relationship.

在另一實施例中,本發明更提供一種動態即時相對關係辨識系統,其係包括有:一資料庫,其係存有影像擷取距離與一特徵物所具有之一影像特徵的特徵關係;一影像擷取裝置,其係擷取外在環境中關於具有該特徵物之一可動裝置的一影像;一控制單元,其係與該資料庫以及該影像擷取裝置相連接,該控制單元係於該影像中偵測該特徵物之影像區域,然後於影像區域中決定關於特徵物之一偵測影像特徵,再根據偵測影像特徵於該特徵關係中決定該影像擷取裝置與該特徵物間的相對關係。In another embodiment, the present invention further provides a dynamic instant relative relationship identification system, which includes: a database that stores a feature relationship between an image capture distance and an image feature of a feature; An image capturing device that captures an image of a movable device having the feature in an external environment; a control unit coupled to the database and the image capturing device, the control unit Detecting an image area of the feature in the image, and then determining, in the image area, detecting image features of one of the features, and determining the image capturing device and the feature according to the detected image feature according to the detected image feature The relative relationship between the two.

為使 貴審查委員能對本發明之特徵、目的及功能有更進一步的認知與瞭解,下文特將本發明之裝置的相關細部結構以及設計的理念原由進行說明,以使得 審查委員可以了解本發明之特點,詳細說明陳述如下:In order to enable the reviewing committee to have a further understanding and understanding of the features, objects and functions of the present invention, the related detailed structure of the device of the present invention and the concept of the design are explained below so that the reviewing committee can understand the present invention. Features, detailed descriptions are as follows:

請參閱圖一所示,該圖係為本發明之動態即時相對關係辨識方法第一實施例流程示意圖。在本實施例中,該方法包括有下列步驟:首先以步驟20建立一影像擷取裝置之影像擷取距離與一特徵物所具有之一影像特徵的特徵關係。在本步驟中,主要是利用特徵物影像所具有的影像特徵會隨著與影像擷取裝置間的距離的不同而有所改變的特性,先建立一個特徵關係。以特徵物為車牌為例(但不以此為限),如圖二A所示,該圖係為影像擷取裝置與車牌位置關係示意圖。該車牌90係設置於車輛91上面,在該車輛91前方有一影像擷取裝置92,其設置之高度為H(90cm),與車牌的距離為D(80cm~300cm),以及攝影角度為θ(17度)。隨著影像擷取距離的改變,對於同樣大小的擷取影像98中關於該車輛91之大小也會隨之改變,如圖二C與圖二D所示。其中圖二C之影像擷取距離係大於圖二D之影像擷取距離。關於影像擷取距離與該特徵物之間的相對關係,如下表一所示。如圖二B所示,其中表一中的車牌寬度(上)為W1 ,車牌寬度(下)為W2 ,車牌高度為h,其單位為像素(pixel)。而步驟20中的影像特徵即為表一中的車牌寬度、車牌高度、面積、平均寬度或平均面積等。Please refer to FIG. 1 , which is a schematic flowchart of a first embodiment of a dynamic instant relative relationship identification method according to the present invention. In this embodiment, the method includes the following steps: First, in step 20, a feature relationship between an image capturing distance of an image capturing device and an image feature of a feature is established. In this step, a characteristic relationship is first established by utilizing the characteristics that the image features of the feature image change with the distance from the image capturing device. Taking the feature as the license plate as an example (but not limited thereto), as shown in FIG. 2A, the figure is a schematic diagram of the relationship between the image capturing device and the license plate position. The license plate 90 is disposed on the vehicle 91. An image capturing device 92 is disposed in front of the vehicle 91. The height of the license plate is set to H (90 cm), the distance from the license plate is D (80 cm to 300 cm), and the photographing angle is θ ( 17 degrees). As the image capture distance changes, the size of the vehicle 91 for the same size captured image 98 will also change, as shown in FIG. 2C and FIG. 2D. The image capturing distance of Figure 2C is greater than the image capturing distance of Figure 2D. The relative relationship between the image capturing distance and the feature is shown in Table 1 below. As shown in FIG. 2B, the license plate width (top) in Table 1 is W 1 , the license plate width (bottom) is W 2 , the license plate height is h, and the unit is pixel (pixel). The image features in step 20 are the license plate width, license plate height, area, average width or average area in Table 1.

根據表一之特徵關係可以得到如圖三A與圖三B所示的結果,其中圖三A代表影像擷取距離與平均寬度之關係曲線,而圖三B代表影像擷取距離與平均面積之關係曲線。根據圖三A或圖三B的曲線,可以用來對照不同的影像擷取距離下,車牌的影像特徵大小。至於平均寬度與平均面積係由於影像擷取裝置相對於車牌具有一傾角θ,因此車牌的上寬度與下寬度就會有所差異。至於是否要利用平均寬度與平均面積作為影像特徵,係屬於使用者的需要而定。另外,有了圖三A或圖三B的曲線之後,即可利用數學擬合的演算法,建立關於曲線的方程式。根據資料點建立擬合關係式係屬於習用之技術,在此不作贅述。According to the characteristic relationship of Table 1, the results shown in FIG. 3A and FIG. 3B can be obtained, wherein FIG. 3A represents the relationship between the image capturing distance and the average width, and FIG. 3B represents the image capturing distance and the average area. Relationship lines. According to the curve of FIG. 3A or FIG. 3B, it can be used to compare the image feature size of the license plate under different distances of different images. As for the average width and the average area, since the image capturing device has an inclination angle θ with respect to the license plate, the upper width and the lower width of the license plate may differ. Whether or not to use the average width and the average area as image features depends on the needs of the user. In addition, after having the curve of FIG. 3A or FIG. 3B, an algorithm for mathematical fitting can be used to establish an equation about the curve. It is a customary technique to establish a fitting relationship according to the data points, and no further description is made here.

再回到圖一所示,步驟20之後,接著以步驟21擷取一可動裝置之一影像,該可動裝置上具有該特徵物。在步驟20所建立之相對關係之後,即可對任一具有該特徵物之可動物體擷取影像,並根據該影像中關於該特徵物的影像特徵,決定出影像擷取裝置與特徵物間的距離。因此,在步驟21取得可動裝置之影像之後,即以步驟22於該影像中偵測該特徵物之影像區域。在本步驟中,主要是對步驟21所擷取的影像進行辨識,以找到對應該特徵物的影像區域。在步驟22中,主要是依邊界強度搜尋候選區塊,並將該候選區塊的邊界作為對應該特徵物影像的邊界。Returning to FIG. 1, after step 20, an image of one of the movable devices is captured by step 21, and the movable device has the feature. After the relative relationship established in step 20, an image of any animal having the feature can be captured, and an image between the image capturing device and the feature is determined according to the image feature of the feature in the image. distance. Therefore, after the image of the movable device is obtained in step 21, the image area of the feature is detected in the image in step 22. In this step, the image captured in step 21 is mainly identified to find an image area corresponding to the feature. In step 22, the candidate block is mainly searched according to the boundary strength, and the boundary of the candidate block is taken as the boundary corresponding to the feature image.

決定該影像區域之後,接著以步驟23在影像區域中決定關於特徵物之一偵測影像特徵。本步驟係為當有了該影像區域的位置之後,即可利用影像處理的得到關於該特徵區域的寬度、平均寬度、高度、面積或者是平均面積等作為關於該特徵物影像的偵測影像特徵。得到該偵測影像特徵之後,即可進行步驟24,根據偵測影像特徵,於該特徵關係中決定該影像擷取裝置與該特徵物間的相對關係。在步驟24中,主要是利用步驟20所建立的相對關係曲線所對應的方程式,根據步驟23所決定的偵測影像特徵,帶入該方程式中,即可以得到對應影像擷取距離。此外,步驟24中的相對關係除了影像擷取距離之外,更可以為該特徵物與該影像擷取裝置間的相對速度或者是相對加速度。至於要判斷與特徵物的相對速度與加速度只需要對兩個時間點根據該特徵關係取得距離的變化,即可算出相對速度。同樣地,兩個時間點的相對速度差即為相對加速度。After determining the image area, step 23 is then used to determine image characteristics for one of the features in the image area. In this step, after the position of the image area is obtained, the width, average width, height, area, or average area of the feature area can be obtained by using image processing as the detected image feature of the feature image. . After the detected image feature is obtained, step 24 is performed, and according to the detected image feature, the relative relationship between the image capturing device and the feature is determined in the feature relationship. In step 24, the equation corresponding to the relative relationship curve established in step 20 is used, and the detected image feature determined in step 23 is brought into the equation, and the corresponding image capturing distance can be obtained. In addition, the relative relationship in step 24 may be a relative speed or a relative acceleration between the feature and the image capturing device, in addition to the image capturing distance. As for judging the relative velocity and acceleration of the feature, it is only necessary to obtain a change in the distance according to the feature relationship at two time points, and the relative velocity can be calculated. Similarly, the relative speed difference between the two time points is the relative acceleration.

請參閱圖四所示,該圖係為本發明之動態即時相對關係辨識方法第二實施例流程示意圖。該方法3包括有下列步驟,首先以步驟30建立一影像擷取裝置之影像擷取距離與車牌所具有之一影像特徵的特徵關係。本步驟的方式與步驟20相同,只不過特徵物為車牌,因為車牌的大小固定,因此可以事先建立影像擷取距離與車牌的特徵尺寸、形狀或面積等屬性的關係,其係如步驟20所述,在此不做贅述。接著進行步驟31,擷取一第一車輛之一影像,該第一車輛上具有一車牌。如圖五A所示,該影像擷取裝置92係設置於一第二車輛910上,本實施例中,該影像擷取裝置92係設置於第二車輛910之後方,以擷取後方第一車輛911的影像,雖然圖五A之實施例係為設置在第二車輛910後方以擷取後方來車的影像,但亦可以設置於車輛前方(如第一車輛911所示)或者是左右兩側等位置,其係可根據實際之需要而定並不以圖五A之實施例為限。Referring to FIG. 4, the figure is a schematic flowchart of a second embodiment of a dynamic instant relative relationship identification method according to the present invention. The method 3 includes the following steps. First, in step 30, a feature relationship between an image capturing distance of an image capturing device and an image feature of the license plate is established. The method of this step is the same as that of step 20, except that the feature is a license plate. Because the size of the license plate is fixed, the relationship between the image capturing distance and the characteristic size, shape or area of the license plate can be established in advance, as shown in step 20. As mentioned, I will not repeat them here. Then, in step 31, an image of one of the first vehicles is captured, and the first vehicle has a license plate. As shown in FIG. 5A, the image capturing device 92 is disposed on a second vehicle 910. In the embodiment, the image capturing device 92 is disposed behind the second vehicle 910 to capture the rear first. The image of the vehicle 911 is an image provided in the rear of the second vehicle 910 to capture the rear vehicle, but may be disposed in front of the vehicle (as shown by the first vehicle 911) or on the left and right. The position of the side, which may be determined according to actual needs and not limited to the embodiment of FIG. 5A.

再回到圖四所示,步驟31之後以步驟32於該影像中偵測該車牌之影像區域。請參閱圖五B所示,該圖係為在特定距離下所擷取的車輛影像示意圖。在圖五B之該影像97中,具有車牌的影像,因此利用影像處理演算法根據邊界強度搜尋候選區塊93,以作為步驟32之影像區域。接著以步驟33於影像區域中決定關於車牌之一偵測影像特徵。在本步驟中,在得到了關於車牌的影像區域之後,即對該影像區域中關於該車牌的尺寸特徵進行偵測,可以偵測的特徵包括了車牌的寬度、高度或者是面積作為該偵測影像特徵,如果影像擷取裝置相對於被擷取的車牌而言具有傾角,如圖二A所示,則可以用平均寬度或者是平均面積作為車牌的偵測影像特徵。Returning to FIG. 4, after step 31, the image area of the license plate is detected in the image by step 32. Please refer to FIG. 5B, which is a schematic diagram of the vehicle image taken at a certain distance. In the image 97 of FIG. 5B, there is an image of the license plate, so the candidate block 93 is searched for the image area according to the boundary strength by the image processing algorithm. Then, in step 33, it is determined in the image area that the image feature is detected with respect to one of the license plates. In this step, after obtaining the image area of the license plate, the size feature of the license plate is detected in the image area, and the detectable features include the width, height or area of the license plate as the detection. The image feature, if the image capture device has an angle of inclination with respect to the captured license plate, as shown in FIG. 2A, the average width or the average area may be used as the detected image feature of the license plate.

接著,以步驟34根據偵測影像特徵於該特徵關係中決定該影像擷取裝置與該車牌間的相對關係。由於在步驟30中已經建立了影像擷取裝置之影像擷取距離與車牌間的特徵關係,根據該關係可以用數學方程式擬合對應該特徵關係曲線的方程式。根據該擬合的方程式,可以得到對應該偵測影像特徵的影像擷取距離以作為步驟34的相對關係結果。由於影像擷取裝置係設置於第二車輛上,因此步驟34所得到的距離即可作為圖五A中的兩輛車輛間的距離L。步驟34中之相對關係除了影像擷取距離之外,亦可為兩車輛間的相對速度或者是示相對加速度等關係。至於相對速度或相對加速度的資訊則可以根據兩個不同時間點間的時間差ΔT所得到的距離差ΔL得知兩車輛間的相對速度,再由兩不同時間點的速度差即可得到相對加速度。由於第二車輛的車速為已知,因此根據相對速度即可得到後方車輛(第一車輛)的車速。Then, in step 34, the relative relationship between the image capturing device and the license plate is determined according to the detected image feature in the feature relationship. Since the image capturing distance of the image capturing device and the characteristic relationship between the license plates have been established in step 30, according to the relationship, the equation corresponding to the characteristic relationship curve can be fitted by the mathematical equation. According to the fitted equation, the image capturing distance corresponding to the image feature can be obtained as a result of the relative relationship of step 34. Since the image capturing device is disposed on the second vehicle, the distance obtained in step 34 can be used as the distance L between the two vehicles in FIG. The relative relationship in step 34 may be a relative speed between the two vehicles or a relative acceleration, in addition to the image capturing distance. As for the relative speed or the relative acceleration information, the relative speed between the two vehicles can be known from the distance difference ΔL obtained by the time difference ΔT between two different time points, and the relative acceleration can be obtained from the speed difference between the two different time points. Since the vehicle speed of the second vehicle is known, the vehicle speed of the rear vehicle (first vehicle) can be obtained according to the relative speed.

有了車輛間的相對關係,即可再進行步驟35,根據該相對關係決定是否為一關鍵時刻,如果是該關鍵時刻則以步驟36進行一處理動作。反之則回到步驟31。步驟35中的關鍵時刻係為該相對關係是否超過特定值或特定範圍(距離、相對速度或相對加速度),例如:如果當第一車輛與第二車輛間的距離小於了安全剎車的距離時的時間點,即為關鍵時刻之意。至於特定值或特定範圍係可事先設定而儲存,或者是根據根據環境狀態而自動調整。而步驟36中,如圖五A所示,該處理動作可以為發出警示訊息通知第二車輛910的駕駛人或者是控制第二車輛910中的影像擷取裝置92擷取第一車輛911的影像(靜態或者是動態錄影)然後將該關於第一車輛911的影像儲存起來,以作為將來發生事故的重要證明資訊。此外,警示與記錄影像亦可以同時進行。With the relative relationship between the vehicles, step 35 can be performed to determine whether it is a critical moment based on the relative relationship, and if it is the critical moment, a processing operation is performed in step 36. Otherwise, go back to step 31. The key moment in step 35 is whether the relative relationship exceeds a specific value or a specific range (distance, relative speed or relative acceleration), for example, if the distance between the first vehicle and the second vehicle is less than the distance of the safety brake The point in time is the meaning of the key moment. As for the specific value or the specific range, it can be set in advance and stored, or it can be automatically adjusted according to the environmental state. In step 36, as shown in FIG. 5A, the processing action may be an alert message to notify the driver of the second vehicle 910 or control the image capturing device 92 in the second vehicle 910 to capture the image of the first vehicle 911. (Static or dynamic recording) The image of the first vehicle 911 is then stored as an important proof of future accidents. In addition, warnings and recorded images can also be performed simultaneously.

另外,在步驟32之後亦可以同步進行步驟37,利用一影像辨識程序對該影像區域內的車牌內容進行辨識,並將該辨識內容儲存下來,以作為輔助判斷之依據。請參閱圖六所示,該圖係為本發明之辨識車牌影像內容流程示意圖。該辨識方法4首先以步驟40,提供一資料庫,該資料庫內建立有複數個已知標準樣品影像。如圖七A所示,該圖係為已知樣品影像大小示意圖。該已知樣品影像5之大小以使用者需要而定,例如:130(pixels)x130(pixels),但不以此為限。在該已知樣品影像5內之像素上形成標準影像區域50。該標準影像區域50係由複數個像素500與501所構成,以形成該已知樣品影像所要代表之字元、數字、文字或者是圖案。請參閱圖七B所示,在本實施例中係以數字1來作說明,利用在該已知樣品影像5區域內給予每一個像素500與501一適當之灰度值以形成標準影像區域50,而勾勒出數字1的外形。然後在該標準影像區域50內決定特定的像素501(斜線區域的像素)以給予特定的權值。灰度值,權值之大小係可根據需要而定並無一定限制,也就是說每一個權值大小可以不相同或者是相同,在本實施例中該權值係為正值。前述該標準影像區域50內之每一個像素500與501所具有之灰度值以及權值即為該第一特徵值。In addition, after step 32, step 37 may be synchronously performed, and an image recognition program is used to identify the license plate content in the image area, and the identification content is stored as a basis for assisting the judgment. Please refer to FIG. 6 , which is a schematic diagram of the process of recognizing license plate image content according to the present invention. The identification method 4 first provides, in step 40, a database in which a plurality of known standard sample images are created. As shown in Fig. 7A, the figure is a schematic view of the size of a known sample image. The size of the known sample image 5 is determined by the user, for example, 130 (pixels) x 130 (pixels), but not limited thereto. A standard image area 50 is formed on the pixels within the known sample image 5. The standard image area 50 is composed of a plurality of pixels 500 and 501 to form characters, numbers, characters or patterns to be represented by the known sample image. Referring to FIG. 7B, in the present embodiment, the number 1 is used to describe a suitable gray level value for each pixel 500 and 501 in the region of the known sample image 5 to form a standard image area 50. And outline the shape of the number 1. A particular pixel 501 (pixel of the shaded area) is then determined within the standard image area 50 to give a particular weight. The value of the gradation value and the weight value may be determined according to requirements, that is, each weight value may be different or the same. In this embodiment, the weight value is a positive value. The gray value and the weight value of each of the pixels 500 and 501 in the standard image area 50 are the first feature value.

如圖七C所示,在該已知樣品影像內決定一非標準影像區域51。所謂非標準影像區域51是表示該標準影像區域50所形成之文字容易被誤認的文字內容。例如,數字「1」在影像中容易被誤認為英文字母「I」或者是「L」甚至是字母「E」等。因此對於可能造成被誤認的相關像素位置510(點區域的像素)及給予適當的灰度值以及權值以作為對應像素510之第二特徵值。在本實施例中,構成該非標準影像區域51之像素510位置係可根據該標準影像區域50容易被誤認的字元、數字或文字等來決定,並無一定之規則。而灰度值與權值之大小係可根據需要而定,本實施例中,該非標準影像區域內51之權值係為負值。As shown in Figure VIIC, a non-standard image area 51 is determined within the known sample image. The non-standard image area 51 is a character content indicating that the character formed by the standard video area 50 is easily misidentified. For example, the number "1" is easily mistaken for the English letter "I" or "L" or even the letter "E" in the image. Therefore, the relevant pixel position 510 (pixel of the dot area) that may be misidentified and the appropriate gray value and weight are given as the second feature value of the corresponding pixel 510. In the present embodiment, the position of the pixel 510 constituting the non-standard image area 51 can be determined based on characters, numerals, characters, and the like which are easily misidentified by the standard image area 50, and there is no rule. The value of the gray value and the weight may be determined according to requirements. In this embodiment, the weight of 51 in the non-standard image area is a negative value.

如圖七D所示,該圖係為另一已知標準影像示意圖。該圖係為根據數字0所建立之已知樣品影像5a。該已知樣品影像5a,也同樣具有一標準影像區域以及一非標準影像區域。該標準影像區域中的每一個像素所構成之圖案即為數字「0」。同樣地,該非標準影像區域中的每一個像素所構成之圖案,則代表數字「0」容易被誤認的文字,例如:字母「Q」或數字「8」。至於建立已知標準影像之非標準區域之方式,係可藉由影像軟體,例如:小畫家來處理,但不以此為限。前述為本發明所謂標準影像的產生過程,根據前述之方式依序建立不同文字或數字所代表之已知樣品影像,例如:0~9、A~Z以及a~z等,存入資料庫內。As shown in Fig. 7D, the figure is another schematic diagram of a known standard image. This figure is a known sample image 5a established according to the number 0. The known sample image 5a also has a standard image area and a non-standard image area. The pattern formed by each pixel in the standard image area is the number "0". Similarly, the pattern formed by each pixel in the non-standard image area represents a character that is easily misidentified by the number “0”, for example, the letter “Q” or the number “8”. The way to establish a non-standard area of a known standard image can be handled by an image software, such as a small painter, but not limited thereto. The foregoing is a process for generating a so-called standard image according to the present invention, and sequentially creates known sample images represented by different characters or numbers according to the foregoing manner, for example, 0~9, A~Z, and a~z, and stored in the database. .

再回到圖六所示,接著進行步驟41,於重組影像中擷取一特徵影像。例如:以圖八A為例,經由含有車輛影像中擷取出關於車牌的影像區域94,其中的每一個未辨識的文字所對應的區域即為該特徵影像。然後將該特徵影像進行正規化以調整該特徵影像之尺寸大小以及角度,使得該特徵影像之大小與該已知樣品影像之大小一致,以利後續的辨識。在步驟41中,所擷取的特徵影像95為該車輛識別資訊之第一碼文字。然後進行步驟42將該特徵影像中每一個像素之一第三特徵值分別與在資料庫中該複數個已知樣品影像中每一個像素所對應的第一特徵值或第二特徵值進行一演算以得到該特徵影像對應該複數個已知樣品影像所分別具有之一相似度值。Returning to FIG. 6, proceeding to step 41, a feature image is captured in the reconstructed image. For example, taking FIG. 8A as an example, the image area 94 corresponding to the license plate is taken out from the image of the vehicle, and the area corresponding to each unidentified character is the feature image. The feature image is then normalized to adjust the size and angle of the feature image such that the size of the feature image is consistent with the size of the known sample image for subsequent recognition. In step 41, the captured feature image 95 is the first code text of the vehicle identification information. Then performing step 42 to perform a calculation on the third feature value of each pixel in each of the feature images and the first feature value or the second feature value corresponding to each pixel of the plurality of known sample images in the database. To obtain the feature image, one of the plurality of known sample images has a similarity value.

請參閱圖八B所示,該圖係為特徵影像95示意圖。利用該特徵影像即可與每一個已知樣品影像進行演算而得到對應之相似度值Cuv 。該演算方式係為正規相關比對法或者是近似度比對法等,但不以此為限。以正規相關比對法為例,其演算式如下式(1)所示。正規相關比對法(normalized correlation matching)主要是計算特徵影像和與已知樣品影像間之關係,將每個影像中之內灰度值之標準偏差視為一向量在與權值進行乘積,用以決定何者為最佳的匹配位置,標準化互相關係數介於-1到1之間,越接近於1表示相似性越高;當Cuv 為最高時,其為最佳匹配位置。Please refer to FIG. 8B, which is a schematic diagram of the feature image 95. Using the feature image, each known sample image can be calculated to obtain a corresponding similarity value C uv . The calculation method is a formal correlation comparison method or an approximation comparison method, but is not limited thereto. Taking the formal correlation comparison method as an example, the calculation formula is as shown in the following formula (1). The normalized correlation matching is mainly to calculate the relationship between the feature image and the known sample image. The standard deviation of the gray value in each image is regarded as a vector and multiplied by the weight. In order to determine which is the best matching position, the normalized cross-correlation coefficient is between -1 and 1, the closer to 1 is, the higher the similarity is; when Cuv is the highest, it is the best matching position.

其中,ui 係為該已知標準影像中之每一個像素所具有之灰度值,vi 係為該特徵影像中之每一個像素所具有之灰度值。係為該已知標準影像中所有像素所具有之灰度平均值,係為該特徵影像中所有像素之灰度平均值。wi 係為該已知樣品影像中標準影像區域中以及非標準影像區域中像素所代表的權值,至於其他區域之像素其權值為1。Where u i is the gray value of each pixel in the known standard image, and v i is the gray value of each pixel in the feature image. Is the grayscale average of all pixels in the known standard image. Is the grayscale average of all pixels in the feature image. The w i is the weight represented by the pixels in the standard image area and the non-standard image area in the known sample image, and the pixels of other areas have a weight of 1.

根據式(1)將圖八B之每一像素與已知樣品影像之每一像素進行演算。例如:將圖八B之影像與圖七C之已知樣品影像(代表數字1)以及圖七D之已知樣品影像(代表數字0)分別進行演算,即可得到圖八B之特徵影像關於圖七C與圖七D之相似度值Cuv 。再回到圖六所示,得到相似度值之後,再以步驟43與44將重組影像95中的所有文字逐一擷取成特徵影像,然後重複步驟42進行比對。接著以步驟45彙整關於該特徵影像與該複數個已知樣品影像比對所產生之複數個相似度值。在本步驟中,可以對相似度值進行排序,由可能性最高之辨識結果排序至最低的結果。最後再以步驟46將該複數個相似度值排序輸出可能之複數種辨識比對結果,以具有七碼之車牌為例,如圖八A所示,該圖係為車牌影像示意圖。經過辨識方法4的流程之後,即可得到如圖九之排序結果。在圖九中,總共輸出了四種可能的結果,每一種可能結果代表車牌內容可能的字元組合。第一種可能結果的每一碼所具有的相似度最高,然後依序排列形成第二、第三以及第四種可能的結果。以第一可能結果為例,經過分析出來的可能車牌為0695-0A,其中第1碼”0”其經過演算後的相似度為52,第2碼”6”其經過演算後的相似度為72,第3碼”9”其經過演算後的相似度為67,第4碼”5”其經過演算後的相似度為72,第5碼為”-”,第6碼”0”其經過演算後的相似度為63,第7碼”A”其經過演算後的相似度為76。當然,使用者亦可以根據圖九的結果,再根據目視該待辨識影像,自行決定出其他可能的車牌號碼組合以供相關單位進行確認。Each pixel of FIG. 8B is calculated with each pixel of the known sample image according to equation (1). For example, the image of Figure 8B and the known sample image of Figure 7C (representative number 1) and the known sample image of Figure 7D (representative number 0) are calculated separately, and the characteristic image of Figure 8B can be obtained. Figure 7C and Figure 7D have similarity values C uv . Returning to FIG. 6, after obtaining the similarity value, all the characters in the reconstructed image 95 are successively extracted into feature images by steps 43 and 44, and then step 42 is repeated for comparison. Then, in step 45, a plurality of similarity values generated by comparing the feature image with the plurality of known sample images are summarized. In this step, the similarity values can be sorted, and the most likely identification results are sorted to the lowest result. Finally, in step 46, the plurality of similarity values are sorted to output a plurality of possible identification comparison results, and the license plate having seven codes is taken as an example. As shown in FIG. 8A, the figure is a schematic diagram of the license plate image. After the process of the method 4 is identified, the sort result of FIG. 9 can be obtained. In Figure IX, a total of four possible outcomes are output, each of which represents a possible combination of characters for the license plate content. Each code of the first possible result has the highest degree of similarity and is then sequentially arranged to form the second, third, and fourth possible outcomes. Taking the first possible result as an example, the possible license plate analyzed is 0695-0A, wherein the similarity after the calculation of the first code “0” is 52, and the similarity after the second code “6” is calculated. 72, the third code "9" has a similarity after the calculation of 67, the fourth code "5" after the calculation has a similarity of 72, the fifth code is "-", the sixth code "0" is passed The similarity after the calculation is 63, and the similarity after the calculation of the 7th code "A" is 76. Of course, the user can also determine other possible license plate number combinations for the relevant units to confirm according to the results of FIG.

請參閱圖十所示,該圖係為本發明之動態即時相對關係辨識系統實施例示意圖。該辨識系統6包括有:一資料庫60、一第一影像擷取裝置61、一控制單元62以及一警示單元63。該辨識系統6係設置於一移動載具上,該移動載具係可為輪型車輛,例如:兩輪或者是四輪的輪型車輛(如圖五A中之第二車輛910)等,但不以此為限。該資料庫60,其係存有影像擷取距離與一特徵物所具有之一影像特徵的特徵關係,亦即儲存圖一或圖四中步驟20與步驟30所建立之資訊或關係曲線擬合函數。該資料庫60係為一儲存媒體所構成,例如:磁性儲存媒體、光儲存媒體或者是記憶體等。該第一影像擷取裝置61,其係擷取外在環境中關於具有該特徵物之一可動裝置的一影像,在本實施例中,該可動裝置係為如圖五A中之第一車輛911,而該特徵物為車牌90,但不以此為限。只要是可動之物體,且具有需要辨識與記錄之特徵的情形,都可以應用。該控制單元62,其係與該資料庫60以及該第一影像擷取裝置61相連接,該控制單元62係進行圖一的步驟22~24或圖四中的步驟32至34的步驟,以於該影像中偵測該特徵物之影像區域,然後於影像區域中決定關於特徵物之一偵測影像特徵,再根據偵測影像特徵於該特徵關係中決定該影像擷取裝置與該特徵物間的相對關係。其詳細之步驟係如前所述,在此不做贅述。Please refer to FIG. 10, which is a schematic diagram of an embodiment of a dynamic instant relative relationship identification system of the present invention. The identification system 6 includes a database 60, a first image capturing device 61, a control unit 62, and a warning unit 63. The identification system 6 is disposed on a mobile vehicle, and the mobile vehicle can be a wheel type vehicle, for example, a two-wheel or four-wheel type vehicle (such as the second vehicle 910 in FIG. 5A). But not limited to this. The database 60 stores a feature relationship between the image capturing distance and an image feature of a feature, that is, the information or relationship curve established by the steps 20 and 30 in the storage chart 1 or FIG. function. The database 60 is constructed as a storage medium, such as a magnetic storage medium, an optical storage medium, or a memory. The first image capturing device 61 is configured to capture an image of a movable device having the feature in an external environment. In the embodiment, the movable device is the first vehicle in FIG. 5A. 911, and the feature is the license plate 90, but not limited thereto. It can be applied as long as it is a movable object and has a feature that needs to be recognized and recorded. The control unit 62 is connected to the database 60 and the first image capturing device 61. The control unit 62 performs the steps of steps 22-24 of FIG. 1 or steps 32 to 34 of FIG. Detecting an image area of the feature in the image, and then determining, in the image area, detecting image features of one of the features, and determining the image capturing device and the feature according to the detected image feature according to the detected image feature The relative relationship between the two. The detailed steps are as described above and will not be described here.

當該控制單元決定出相對關係之後,可以根據相對關係之狀態亦即步驟35中的判斷方式,啟動警示單元63發出警訊以提醒駕駛或者是將該第一影像擷取裝置61所擷取的影像以靜態(單一相片)的方式或者是動態錄影的方式記錄於儲存單元64中。此外,該控制單元62更可以連接一第二影像擷取裝置65,其係可設置在車輛的前方或者是左右兩側,以可以擷取到外在環境中標誌(例如:速限)或者號誌(紅綠燈)的影像。該控制單元62更可以辨識該第二影像擷取裝置65所擷取的影像,以判斷該當燈號為紅燈或者是該移動載具之速度接近或超過該速限時,藉由該警示單元63發出警示訊息。該控制單元62根據該紅綠燈信號狀態與速限號誌影像,以判斷該當燈號是否為紅燈或者是該可動裝置之速度接近或超過該速限時,將該第一影像擷取裝置61與第二影像擷取裝置62所擷取之影像予以記錄於該儲存單元64。以作為將來事故發生時,證明後方來車超速或對向或要轉向的車輛闖紅燈的輔助證明依據。After the control unit determines the relative relationship, the warning unit 63 may be activated to issue a warning to remind the driver or to capture the first image capturing device 61 according to the state of the relative relationship, that is, the determining manner in step 35. The image is recorded in the storage unit 64 in a static (single photo) manner or in a dynamic video recording manner. In addition, the control unit 62 can be connected to a second image capturing device 65, which can be disposed in front of the vehicle or on the left and right sides, so as to capture an external environment (for example, a speed limit) or a number. Image of Zhi (traffic light). The control unit 62 can further identify the image captured by the second image capturing device 65 to determine whether the warning unit 63 is used when the light is red or the speed of the moving vehicle approaches or exceeds the speed limit. Send a warning message. The control unit 62 determines, according to the traffic signal state and the speed limit number image, whether the light source is red or the speed of the movable device approaches or exceeds the speed limit, and the first image capturing device 61 The image captured by the image capturing device 62 is recorded in the storage unit 64. As a supporting evidence for the red light of the vehicle that is overspeeded or opposite or to be turned at the time of the accident.

惟以上所述者,僅為本發明之實施例,當不能以之限制本發明範圍。即大凡依本發明申請專利範圍所做之均等變化及修飾,仍將不失本發明之要義所在,亦不脫離本發明之精神和範圍,故都應視為本發明的進一步實施狀況。However, the above is only an embodiment of the present invention, and the scope of the present invention is not limited thereto. It is to be understood that the scope of the present invention is not limited by the spirit and scope of the present invention, and should be considered as a further embodiment of the present invention.

2...動態即時相對關係辨識方法2. . . Dynamic instant relative relationship identification method

20~24...步驟20~24. . . step

3...動態即時相對關係辨識方法3. . . Dynamic instant relative relationship identification method

30~37...步驟30~37. . . step

4...辨識方法4. . . Identification method

40~46...步驟40~46. . . step

5...樣品影像5. . . Sample image

50...標準影像區域50. . . Standard image area

500、501...像素500, 501. . . Pixel

51...非標準影像區域51. . . Non-standard image area

510...像素510. . . Pixel

6...辨識系統6. . . Identification system

60...資料庫60. . . database

61...第一影像擷取裝置61. . . First image capturing device

62...控制單元62. . . control unit

63...警示單元63. . . Warning unit

64...儲存單元64. . . Storage unit

65...第二影像擷取裝置65. . . Second image capturing device

90...車牌90. . . License plate

91...車輛91. . . vehicle

910...第二車輛910. . . Second vehicle

911...第一車輛911. . . First vehicle

92...影像擷取裝置92. . . Image capture device

93...候選區塊93. . . Candidate block

94...影像區域94. . . Image area

95...特徵影像95. . . Feature image

97、98...影像97, 98. . . image

圖一係為本發明之動態即時相對關係辨識方法第一實施例流程示意圖。FIG. 1 is a schematic flow chart of a first embodiment of a dynamic instant relative relationship identification method according to the present invention.

圖二A係為影像擷取裝置與車牌位置關係示意圖。Figure 2A is a schematic diagram showing the relationship between the image capturing device and the license plate position.

圖二B係為車牌影像示意圖。Figure 2B is a schematic diagram of the license plate image.

圖二C與圖二D係為不同影像擷取距離所擷取之車輛影像示意圖。Figure 2C and Figure 2D are schematic diagrams of vehicle images taken from different image capturing distances.

圖三A代表影像擷取距離與平均寬度之關係曲線。Figure 3A represents the relationship between image capture distance and average width.

圖三B代表影像擷取距離與平均面積之關係曲線。Figure 3B represents the relationship between image capture distance and average area.

圖四係為本發明之動態即時相對關係辨識方法第二實施例流程示意圖。FIG. 4 is a schematic flow chart of a second embodiment of a dynamic instant relative relationship identification method according to the present invention.

圖五A係為兩車輛間的相位位置關係示意圖。Figure 5A is a schematic diagram of the phase position relationship between two vehicles.

圖五B係為在特定距離下所擷取的車輛影像示意圖。Figure 5B is a schematic diagram of the vehicle image taken at a specific distance.

圖六係為本發明之辨識車牌影像內容流程示意圖。FIG. 6 is a schematic diagram of the process of recognizing license plate image content according to the present invention.

圖七A至圖七D係為產生已知標準影像示意圖。Figures 7A through 7D are schematic diagrams showing the generation of known standard images.

圖八A係為重組影像及其特徵影像示意圖。Figure 8A is a schematic diagram of a reconstructed image and its feature image.

圖八B係為特徵影像示意圖。Figure 8B is a schematic diagram of a feature image.

圖九係為本發明之關於載具識別號碼可能之輸出結果排序示意圖。Figure 9 is a schematic diagram showing the possible output results of the vehicle identification number according to the present invention.

圖十係為本發明之動態即時相對關係辨識系統實施例示意圖。Figure 10 is a schematic diagram of an embodiment of a dynamic instant relative relationship identification system of the present invention.

2...動態即時相對關係辨識方法2. . . Dynamic instant relative relationship identification method

20~24...步驟20~24. . . step

Claims (34)

一種動態即時相對關係辨識方法,其係包括有下列步驟:建立一影像擷取裝置之影像擷取距離與一特徵物所具有之一影像特徵的特徵關係;擷取一可動裝置之一影像,該可動裝置上具有該特徵物;於該影像中偵測該特徵物之影像區域;於影像區域中決定關於特徵物之一偵測影像特徵;以及根據偵測影像特徵於該特徵關係中決定該影像擷取裝置與該特徵物間的相對關係。A dynamic instant relative relationship identification method includes the steps of: establishing a feature relationship between an image capture distance of an image capture device and an image feature of a feature; capturing an image of a movable device, The movable device has the feature; the image area of the feature is detected in the image; the image feature is determined in one of the features in the image area; and the image is determined in the feature relationship according to the detected image feature The relative relationship between the device and the feature is captured. 如申請專利範圍第1項所述之動態即時相對關係辨識方法,其中該相對關係包括有距離、以及影像擷取距離以判斷距離隨時間之變化率。The dynamic instant relative relationship identification method as described in claim 1, wherein the relative relationship includes a distance and an image capturing distance to determine a rate of change of the distance with time. 如申請專利範圍第1項所述之動態即時相對關係辨識方法,其係更包括有當該相對關係超過一特定值時,啟動影像儲存的步驟。The method for identifying a dynamic real-time relative relationship as described in claim 1 further includes the step of initiating image storage when the relative relationship exceeds a specific value. 如申請專利範圍第1項所述之動態即時相對關係辨識方法,其係更包括有辨視該影像區域之內容的一步驟,其中辨識該影像區域所具有之內容更包括有下列步驟:提供一資料庫,其內具有複數個已知樣品影像,每一個已知樣品影像分別具有一標準影像區域以及至少一非標準影像區域,其中該標準影像區域內之像素分別具有對應之一第一特徵值,而該非標準影像區域內的像素則分別對應有一第二特徵值;於該影像區域內擷取至少一特徵影像;將每一個特徵影像中之每一個像素之一第三特徵值分別與該複數個已知樣品影像中每一個像素所對應的第一特徵值或第二特徵值進行一演算以得到該特徵影像對應該複數個已知樣品影像所分別具有之一相似度值;彙整關於該特徵影像與該複數個已知樣品影像比對所產生之複數個相似度值;以及將該複數個相似度值排序輸出可能之複數種辨識比對結果。The method for identifying a dynamic real-time relative relationship as described in claim 1 further includes a step of discriminating the content of the image area, wherein identifying the content of the image area further comprises the following steps: providing a a database having a plurality of known sample images, each of the known sample images having a standard image area and at least one non-standard image area, wherein the pixels in the standard image area respectively have a corresponding first characteristic value The pixels in the non-standard image area respectively correspond to a second feature value; at least one feature image is captured in the image region; and a third feature value of each of the pixels in each feature image is respectively associated with the complex number Performing a calculation on the first eigenvalue or the second eigenvalue corresponding to each pixel in the known sample image to obtain a similarity value of the plurality of known sample images corresponding to the feature image; And comparing a plurality of similarity values generated by the image to the plurality of known sample images; and ranking the plurality of similarity values The sequence output may be a plurality of identification alignment results. 如申請專利範圍第4項所述之動態即時相對關係辨識方法,其中該演算可為正規相關比對法或近似度比對法。For example, the dynamic instant relative relationship identification method described in claim 4, wherein the calculus may be a formal correlation comparison method or an approximation comparison method. 如申請專利範圍第4項所述之動態即時相對關係辨識方法,其中於每一已知樣品影像係對應到一數字或者是字元之影像。The dynamic instant relative relationship identification method according to claim 4, wherein each known sample image corresponds to a number or a character image. 如申請專利範圍第4項所述之動態即時相對關係辨識方法,其中該第一特徵值與該第二特徵值係分別為權值與灰度值之組合,該第三特徵值係為灰度值。The method for identifying a dynamic real-time relative relationship as described in claim 4, wherein the first feature value and the second feature value are respectively a combination of a weight value and a gray value, and the third feature value is a gray level. value. 如申請專利範圍第1項所述之動態即時相對關係辨識方法,其中該影像特徵係為該特徵物之尺寸、面積或形狀。The dynamic instant relative relationship identification method according to claim 1, wherein the image feature is a size, an area or a shape of the feature. 如申請專利範圍第1項所述之動態即時相對關係辨識方法,其中該偵測影像特徵係為可動裝置上之該特徵物之尺寸、面積或形狀。The dynamic instant relative relationship identification method according to claim 1, wherein the detected image feature is a size, an area or a shape of the feature on the movable device. 一種動態車輛即時相對關係辨識方法,其係包括有下列步驟:建立一影像擷取裝置之影像擷取距離與車牌所具有之一影像特徵的特徵關係;擷取一第一車輛之一影像,該第一車輛上具有一車牌;於該影像中偵測該車牌之影像區域;於影像區域中決定關於車牌之一偵測影像特徵;以及根據偵測影像特徵於該特徵關係中決定該影像擷取裝置與該車牌間的相對關係。A method for identifying a real-time relative relationship of a dynamic vehicle, comprising the steps of: establishing a feature relationship between an image capturing distance of an image capturing device and an image feature of the license plate; and capturing an image of the first vehicle, The first vehicle has a license plate; the image area of the license plate is detected in the image; the image feature is determined in one of the license plates in the image area; and the image capture is determined according to the detected image feature in the feature relationship The relative relationship between the device and the license plate. 如申請專利範圍第10項所述之動態即時相對關係辨識方法,其中該相對關係包括有距離、以及影像擷取距離以判斷距離隨時間之變化率。The method for identifying a dynamic real-time relative relationship as described in claim 10, wherein the relative relationship includes a distance and an image capturing distance to determine a rate of change of the distance with time. 如申請專利範圍第10項所述之動態即時相對關係辨識方法,其係更包括有當該相對關係超過一特定值時,啟動影像儲存的步驟。The method for identifying a dynamic real-time relative relationship as described in claim 10, further comprising the step of initiating image storage when the relative relationship exceeds a specific value. 如申請專利範圍第10項所述之動態即時相對關係辨識方法,其係更包括有辨視該影像區域之內容的一步驟,該辨識該影像區域所具有之內容更包括有下列步驟:提供一資料庫,其內具有複數個已知樣品影像,每一個已知樣品影像分別具有一標準影像區域以及至少一非標準影像區域,其中該標準影像區域內之像素分別具有對應之一第一特徵值,而該非標準影像區域內的像素則分別對應有一第二特徵值;於該影像區域內擷取至少一特徵影像;將每一個特徵影像中之每一個像素之一第三特徵值分別與該複數個已知樣品影像中每一個像素所對應的第一特徵值或第二特徵值進行一演算以得到該特徵影像對應該複數個已知樣品影像所分別具有之一相似度值;彙整關於該特徵影像與該複數個已知樣品影像比對所產生之複數個相似度值;以及將該複數個相似度值排序輸出可能之複數種辨識比對結果。The method for identifying a dynamic real-time relative relationship as described in claim 10, further comprising a step of discriminating the content of the image area, wherein the identifying the content of the image area further comprises the following steps: providing a a database having a plurality of known sample images, each of the known sample images having a standard image area and at least one non-standard image area, wherein the pixels in the standard image area respectively have a corresponding first characteristic value The pixels in the non-standard image area respectively correspond to a second feature value; at least one feature image is captured in the image region; and a third feature value of each of the pixels in each feature image is respectively associated with the complex number Performing a calculation on the first eigenvalue or the second eigenvalue corresponding to each pixel in the known sample image to obtain a similarity value of the plurality of known sample images corresponding to the feature image; And comparing a plurality of similarity values generated by the image to the plurality of known sample images; and ranking the plurality of similarity values The output may be plural kinds of identification than the results. 如申請專利範圍第13項所述之動態即時相對關係辨識方法,其中該演算可為正規相關比對法或近似度比對法。For example, the dynamic real-time relative relationship identification method described in claim 13 may be a normal correlation comparison method or an approximation comparison method. 如申請專利範圍第13項所述之動態即時相對關係辨識方法,其中於每一已知樣品影像係對應到一數字或者是字元之影像。The dynamic instant relative relationship identification method according to claim 13, wherein each known sample image corresponds to a number or a character image. 如申請專利範圍第13項所述之動態即時相對關係辨識方法,其中該第一特徵值與該第二特徵值係分別為權值與灰度值之組合,該第三特徵值係為灰度值。The dynamic instant relative relationship identification method according to claim 13, wherein the first feature value and the second feature value are respectively a combination of a weight value and a gray value, and the third feature value is a gray level. value. 如申請專利範圍第10項所述之動態即時相對關係辨識方法,其中該影像特徵係為該車牌之尺寸、面積或形狀。The dynamic instant relative relationship identification method according to claim 10, wherein the image feature is the size, area or shape of the license plate. 如申請專利範圍第10項所述之動態即時相對關係辨識方法,其中該偵測影像特徵係為該第一車輛上之車牌之尺寸、面積或形狀。The dynamic instant relative relationship identification method according to claim 10, wherein the detected image feature is a size, an area or a shape of a license plate on the first vehicle. 如申請專利範圍第10項所述之動態即時相對關係辨識方法,其係更包括有擷取紅綠燈信號狀態與速限號誌影像以進行辨識之步驟。For example, the dynamic instant relative relationship identification method described in claim 10 further includes the steps of capturing the traffic signal state and the speed limit number image for identification. 如申請專利範圍第19項所述之動態即時相對關係辨識方法,其係更包括有當燈號為紅燈或者是該第一車輛之速度接近或超過該速限時啟動影像儲存機制之一步驟。The method for identifying a dynamic real-time relative relationship as described in claim 19, further comprising the step of starting the image storage mechanism when the light is red or when the speed of the first vehicle approaches or exceeds the speed limit. 如申請專利範圍第19項所述之動態即時相對關係辨識方法,其中該影像擷取裝置係設置於一第二車輛上,動態即時相對關係辨識方法更包括有該當燈號為紅燈或者是該第二車輛之速度接近或超過該速限時發出警示訊息。The method for identifying a dynamic real-time relative relationship as described in claim 19, wherein the image capturing device is disposed on a second vehicle, and the dynamic instant relative relationship identification method further comprises: the light source is a red light or the A warning message is issued when the speed of the second vehicle approaches or exceeds the speed limit. 一種動態即時相對關係辨識系統,其係包括有:一資料庫,其係存有影像擷取距離與一特徵物所具有之一影像特徵的特徵關係;一第一影像擷取裝置,其係擷取外在環境中關於具有該特徵物之一可動裝置的一影像;一控制單元,其係與該資料庫以及該第一影像擷取裝置相連接,該控制單元係於該影像中偵測該特徵物之影像區域,然後於影像區域中決定關於特徵物之一偵測影像特徵,再根據偵測影像特徵於該特徵關係中決定該第一影像擷取裝置與該特徵物間的相對關係。A dynamic instant relative relationship identification system includes: a database storing a feature relationship between an image capture distance and an image feature of a feature; a first image capture device, the system Taking an image of the movable device having the feature in the external environment; a control unit connected to the database and the first image capturing device, wherein the control unit detects the image in the image The image area of the feature is then determined in the image area to detect image features of one of the features, and then the relative relationship between the first image capturing device and the feature is determined according to the detected image feature. 如申請專利範圍第22項所述之動態即時相對關係辨識系統,其中該相對關係包括有距離、以及影像擷取距離以判斷距離隨時間之變化率。For example, the dynamic instant relative relationship identification system described in claim 22, wherein the relative relationship includes a distance and an image capturing distance to determine a rate of change of the distance with time. 如申請專利範圍第23項所述之動態即時相對關係辨識系統,其中該資料庫內更具有複數個已知樣品影像,每一個已知樣品影像分別具有一標準影像區域以及至少一非標準影像區域,其中該標準影像區域內之像素分別具有對應之一第一特徵值,而該非標準影像區域內的像素則分別對應有一第二特徵值。The dynamic real-time relative relationship identification system described in claim 23, wherein the database further has a plurality of known sample images, each of the known sample images having a standard image area and at least one non-standard image area. The pixels in the standard image area respectively have a corresponding one of the first feature values, and the pixels in the non-standard image area respectively correspond to a second feature value. 如申請專利範圍第24項所述之動態即時相對關係辨識系統,其中該控制單元係於該影像區域內擷取至少一特徵影像,然後將每一個特徵影像中之每一個像素之一第三特徵值分別與該複數個已知樣品影像中每一個像素所對應的第一特徵值或第二特徵值進行一演算以得到該特徵影像對應該複數個已知樣品影像所分別具有之一相似度值,彙整關於該特徵影像與該複數個已知樣品影像比對所產生之複數個相似度值以及將該複數個相似度值排序輸出可能之複數種辨識比對結果。The dynamic real-time relative relationship identification system according to claim 24, wherein the control unit captures at least one feature image in the image region, and then selects one of each of the feature images. Performing a calculation on the first eigenvalue or the second eigenvalue corresponding to each pixel of the plurality of known sample images to obtain a similarity value of the plurality of known sample images respectively. And integrating a plurality of similarity values generated by comparing the feature image with the plurality of known sample images and sorting the plurality of similarity values to output a plurality of possible comparison comparison results. 如申請專利範圍第25項所述之動態即時相對關係辨識系統,其中該演算可為正規相關比對法或近似度比對法。For example, the dynamic real-time relative relationship identification system described in claim 25, wherein the calculus may be a formal correlation comparison method or an approximation comparison method. 如申請專利範圍第25項所述之動態即時相對關係辨識系統,其中於每一已知樣品影像係對應到一數字或者是字元之影像。The dynamic instant relative relationship identification system of claim 25, wherein each known sample image corresponds to a number or a character image. 如申請專利範圍第25項所述之動態即時相對關係辨識系統,其中該第一特徵值與該第二特徵值係分別為權值與灰度值之組合,該第三特徵值係為灰度值。The dynamic instant relative relationship identification system according to claim 25, wherein the first feature value and the second feature value are respectively a combination of a weight value and a gray value, and the third feature value is a gray level. value. 如申請專利範圍第22項所述之動態即時相對關係辨識系統,其中該影像特徵係為該特徵物之尺寸、面積或形狀。The dynamic instant relative relationship identification system of claim 22, wherein the image feature is the size, area or shape of the feature. 如申請專利範圍第22項所述之動態即時相對關係辨識系統,其中該偵測影像特徵係為可動裝置上之該特徵物之尺寸、面積或形狀。The dynamic instant relative relationship identification system of claim 22, wherein the detected image feature is a size, an area or a shape of the feature on the movable device. 如申請專利範圍第22項所述之動態即時相對關係辨識系統,其係設置於一移動載具上。The dynamic real-time relative relationship identification system described in claim 22 is disposed on a mobile vehicle. 如申請專利範圍第22項所述之動態即時相對關係辨識系統,其係更包括一第二影像擷取裝置更擷取紅綠燈信號狀態與速限號誌影像。For example, the dynamic instant relative relationship identification system described in claim 22 further includes a second image capturing device that further captures the traffic signal state and the speed limit number image. 如申請專利範圍第32項所述之動態即時相對關係辨識系統,其中該控制單元根據該紅綠燈信號狀態與速限號誌影像以判斷該當燈號為紅燈或者是該移動載具之速度接近或超過該速限時藉由一警示單元發出警示訊息。The dynamic real-time relative relationship identification system according to claim 32, wherein the control unit determines whether the light is red or the speed of the mobile vehicle is close to or based on the traffic signal state and the speed limit image. When the speed limit is exceeded, a warning message is sent by a warning unit. 如申請專利範圍第32項所述之動態即時相對關係辨識系統,其中該控制單元根據該紅綠燈信號狀態與速限號誌影像以判斷該當燈號為紅燈或者是該可動裝置之速度接近或超過該速限時將該第一影像擷取裝置與第二影像擷取裝置所擷取之影像予以記錄。The dynamic real-time relative relationship identification system according to claim 32, wherein the control unit determines, according to the traffic signal state and the speed limit number image, whether the light is red or the speed of the movable device is close to or exceeds At the time limit, the images captured by the first image capturing device and the second image capturing device are recorded.
TW98132443A 2009-09-25 2009-09-25 Method and system for dynamically and simultaneously determining the relative relation between moving objects TWI408612B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW98132443A TWI408612B (en) 2009-09-25 2009-09-25 Method and system for dynamically and simultaneously determining the relative relation between moving objects

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW98132443A TWI408612B (en) 2009-09-25 2009-09-25 Method and system for dynamically and simultaneously determining the relative relation between moving objects

Publications (2)

Publication Number Publication Date
TW201112133A TW201112133A (en) 2011-04-01
TWI408612B true TWI408612B (en) 2013-09-11

Family

ID=44909154

Family Applications (1)

Application Number Title Priority Date Filing Date
TW98132443A TWI408612B (en) 2009-09-25 2009-09-25 Method and system for dynamically and simultaneously determining the relative relation between moving objects

Country Status (1)

Country Link
TW (1) TWI408612B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI706336B (en) * 2018-11-19 2020-10-01 中華電信股份有限公司 Image processing device and method for detecting and filtering text object

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI457864B (en) * 2012-06-04 2014-10-21 Htc Corp Warning method for moving vehicles and electronic device and computer program product using the method
TWI454723B (en) 2013-03-15 2014-10-01 Ind Tech Res Inst An identifying device, an identifying system and a method for wireless apparatus

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW226454B (en) * 1993-11-02 1994-07-11 Ind Tech Res Inst Pattern recognition method for car plate
TWM287983U (en) * 2005-09-29 2006-02-21 Regiant Technologies Co Ltd Traffic monitoring system

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW226454B (en) * 1993-11-02 1994-07-11 Ind Tech Res Inst Pattern recognition method for car plate
TWM287983U (en) * 2005-09-29 2006-02-21 Regiant Technologies Co Ltd Traffic monitoring system

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI706336B (en) * 2018-11-19 2020-10-01 中華電信股份有限公司 Image processing device and method for detecting and filtering text object

Also Published As

Publication number Publication date
TW201112133A (en) 2011-04-01

Similar Documents

Publication Publication Date Title
CN109800633B (en) Non-motor vehicle traffic violation judgment method and device and electronic equipment
TWI384408B (en) Method and system for identifying image and outputting identification result
TWI410879B (en) Method and system for identifying image and outputting identification result
CN108372785B (en) Image recognition-based automobile unsafe driving detection device and detection method
JP5297078B2 (en) Method for detecting moving object in blind spot of vehicle, and blind spot detection device
TWI381321B (en) Method for image recombination of multiple images and identifying image and system for identifying image and outputting identification result
CN102765365B (en) Pedestrian detection method based on machine vision and pedestrian anti-collision warning system based on machine vision
WO2020087743A1 (en) Non-motor vehicle traffic violation supervision method and apparatus and electronic device
EP1671216B1 (en) Moving object detection using low illumination depth capable computer vision
CN106647776B (en) Method and device for judging lane changing trend of vehicle and computer storage medium
US9662977B2 (en) Driver state monitoring system
JP3987057B2 (en) Vehicle periphery monitoring device
US11273841B2 (en) Method and apparatus for spoofing prevention
CN103548069B (en) For the method and apparatus identifying possible colliding object
CN110610137B (en) Method and device for detecting vehicle running state, electronic equipment and storage medium
JP2017220076A (en) Vehicle type discrimination device and vehicle type discrimination method
US11417108B2 (en) Two-wheel vehicle riding person number determination method, two-wheel vehicle riding person number determination system, two-wheel vehicle riding person number determination apparatus, and program
JP6818626B2 (en) Vehicle type discrimination device, vehicle type discrimination method, and vehicle type discrimination system
Bhowmick et al. Stereo vision based pedestrians detection and distance measurement for automotive application
TWI408612B (en) Method and system for dynamically and simultaneously determining the relative relation between moving objects
KR101236234B1 (en) Detection system of road line using both laser sensor and camera
Islam et al. Bangla license plate detection, recognition and authentication with morphological process and template matching
CN102043941B (en) Dynamic real-time relative relationship identification method and system
CN113408364B (en) Temporary license plate recognition method, system, device and storage medium
JP6602595B2 (en) Vehicle type identification device and vehicle type identification method