TWI645997B - Obstacle detection credibility evaluation method - Google Patents

Obstacle detection credibility evaluation method Download PDF

Info

Publication number
TWI645997B
TWI645997B TW106144708A TW106144708A TWI645997B TW I645997 B TWI645997 B TW I645997B TW 106144708 A TW106144708 A TW 106144708A TW 106144708 A TW106144708 A TW 106144708A TW I645997 B TWI645997 B TW I645997B
Authority
TW
Taiwan
Prior art keywords
obstacle
score
current
different
detection result
Prior art date
Application number
TW106144708A
Other languages
Chinese (zh)
Other versions
TW201927608A (en
Inventor
李傳仁
黃瀚文
許立佑
Original Assignee
財團法人車輛研究測試中心
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 財團法人車輛研究測試中心 filed Critical 財團法人車輛研究測試中心
Priority to TW106144708A priority Critical patent/TWI645997B/en
Application granted granted Critical
Publication of TWI645997B publication Critical patent/TWI645997B/en
Publication of TW201927608A publication Critical patent/TW201927608A/en

Links

Abstract

一種障礙物偵測可信度評估方法,由一處理單元來實施,包含:(A)在接收到一當前影像後,利用一第一分類方法獲得一指示出該第一分類方法所偵測到的障礙物的第一當前障礙物偵測結果,且利用一第二分類方法獲得一指示出該第二分類方法所偵測到的障礙物的第二當前障礙物偵測結果;(B)判定該第一與第二當前障礙物偵測結果是否存在至少一不同的障礙物;及(C)當判定出該第一當前障礙物偵測結果與該第二當前障礙物偵測結果存在該至少一不同的障礙物時,獲得至少一分別對應該至少一不同的障礙物的懲罰分數,並將一信心度分數減去該至少一懲罰分數。An obstacle detection reliability evaluation method is implemented by a processing unit, comprising: (A) after receiving a current image, using a first classification method to obtain an indication that the first classification method detects a first current obstacle detection result of the obstacle, and using a second classification method to obtain a second current obstacle detection result indicating the obstacle detected by the second classification method; (B) determining Whether the first and second current obstacle detection results have at least one different obstacle; and (C) determining that the first current obstacle detection result and the second current obstacle detection result are present at least When a different obstacle is obtained, at least one penalty score corresponding to at least one different obstacle is obtained, and a confidence score is subtracted from the at least one penalty score.

Description

障礙物偵測可信度評估方法Obstacle detection credibility evaluation method

本發明是有關於一種影像資料處理,特別是指一種障礙物偵測可信度評估方法。The invention relates to an image data processing, in particular to an obstacle detection reliability evaluation method.

隨著攝影機的普及與電腦視覺領域的發展,智慧型影像監控的應用為人類生活帶來安全與便利,例如應用於智慧型先進駕駛輔助系統(Advanced Driver Assistance Systems ,ADAS)利用影像辨識技術對攝影機所拍攝之影像進行障礙物之偵測,以警告駕駛危險的道路狀況,並在某些情況下將車輛減速或停止。With the popularity of cameras and the development of computer vision, the application of intelligent image surveillance brings safety and convenience to human life, such as the application of advanced identification assistance systems (ADAS) to image cameras. The captured image is detected as an obstacle to warn of dangerous road conditions and, in some cases, to slow or stop the vehicle.

然而,實際道路屬於較複雜環境,容易受到外在環境因素的介入影響,當攝影機受到外在環境因素的介入影響(例如,對向車道之車輛的車燈直射、逆光或攝影機鏡頭汙染)時,所拍攝之影像中的障礙物紋理及輪廓亦會受到影響,進而導致障礙物之偵測失準。然而,現有之ADAS系統的障礙物偵測方法僅會輸出障礙物的偵測結果,並不會提供其偵測結果的可信度,此將導致使用者誤以為ADAS系統之偵測結果的準確度極高,而過於相信並依賴ADAS系統的偵測結果。However, the actual road is a relatively complex environment and is susceptible to the intervention of external environmental factors. When the camera is affected by external environmental factors (for example, direct light from a vehicle facing the lane, backlighting, or contamination of the camera lens), The texture and contour of the obstacles in the captured image will also be affected, resulting in inaccurate detection of obstacles. However, the obstacle detection method of the existing ADAS system only outputs the detection result of the obstacle, and does not provide the reliability of the detection result, which will cause the user to mistakenly believe that the detection result of the ADAS system is accurate. Extremely high, and too convinced and rely on the detection results of the ADAS system.

因此,本發明的目的,即在提供一種能適時提供障礙物偵測之可信度的評估方法。Accordingly, it is an object of the present invention to provide an evaluation method that provides credibility of obstacle detection in a timely manner.

於是,本發明障礙物偵測可信度評估方法,由一電連接一儲存單元與一影像拍攝單元的處理單元來實施,該儲存單元儲存有一信心度分數,該影像拍攝單元持續地拍攝並傳送一連串影像至該處理單元,該障礙物偵測可信度評估方法包含一步驟(A)、一步驟(B),及一步驟(C)。Therefore, the obstacle detection reliability evaluation method of the present invention is implemented by a processing unit electrically connected to a storage unit and an image capturing unit, the storage unit stores a confidence score, and the image capturing unit continuously captures and transmits A series of images are sent to the processing unit, and the obstacle detection reliability evaluation method includes a step (A), a step (B), and a step (C).

在該步驟(A)中,在該處理單元接收到來自該影像拍攝單元的一當前影像後,該處理單元根據該當前影像利用一第一分類方法獲得並儲存一指示出該第一分類方法所偵測到的障礙物的第一當前障礙物偵測結果,且根據該當前影像利用一第二分類方法獲得並儲存一指示出該第二分類方法所偵測到的障礙物的第二當前障礙物偵測結果。In the step (A), after the processing unit receives a current image from the image capturing unit, the processing unit obtains and stores, according to the current image, a first classification method to indicate the first classification method. a first current obstacle detection result of the detected obstacle, and obtaining and storing a second current obstacle indicating the obstacle detected by the second classification method by using a second classification method according to the current image Object detection results.

在該步驟(B)中,該處理單元判定該第一當前障礙物偵測結果與該第二當前障礙物偵測結果是否存在至少一不同的障礙物。In the step (B), the processing unit determines whether the first current obstacle detection result and the second current obstacle detection result have at least one different obstacle.

在該步驟(C)中,當該處理單元判定出該第一當前障礙物偵測結果與該第二當前障礙物偵測結果存在該至少一不同的障礙物時,該處理單元至少根據該至少一不同的障礙物,獲得至少一分別對應該至少一不同的障礙物的懲罰分數,並將該信心度分數減去該至少一懲罰分數,以更新該信心度分數。In the step (C), when the processing unit determines that the first current obstacle detection result and the second current obstacle detection result have the at least one different obstacle, the processing unit is based at least according to the at least A different obstacle obtains at least one penalty score corresponding to at least one different obstacle, and subtracts the confidence score from the at least one penalty score to update the confidence score.

本發明之功效在於:藉由該處理單元判定該第一當前障礙物偵測結果與該第二當前障礙物偵測結果是否存在至少一不同的障礙物,以判定是否獲得該至少一懲罰分數,並在獲得該至少一懲罰分數後,將該信心度分數減去該至少一懲罰分數,以更新該信心度分數。The effect of the present invention is that the processing unit determines whether the first current obstacle detection result and the second current obstacle detection result have at least one different obstacle to determine whether the at least one penalty score is obtained. And after obtaining the at least one penalty score, the confidence score is subtracted from the at least one penalty score to update the confidence score.

參閱圖1,說明用來實施本發明障礙物偵測可信度評估方法之一實施例的一系統100。該系統100包含一儲存單元11、一影像拍攝單元12,及一電連接該儲存單元11及該影像拍攝單元12的處理單元13。該影像拍攝單元12持續地拍攝並傳送一連串影像至該處理單元13。該儲存單元11儲存有一信心度分數如,100分、一障礙物對分數的第一查找表、一障礙物對分數的第二查找表、一對應於一第一分類方法的第一懲罰權重,及一對應於一第二分類方法的第二懲罰權重。其中,該第一查找表包含多個相關於實際障礙物與該影像拍攝單元12之距離的障礙物距離、多個相關於障礙物之種類的障礙物種類、及多個分別對應於該等障礙物距離與該等障礙物種類的分數,表1示例出該第一查找表。該第二查找表包含多個相關於障礙物在一影像中之位置的障礙物位置、及多個分別對應於該等障礙物位置的分數,表2示例出該第二查找表。 表1 <TABLE border="1" borderColor="#000000" width="85%"><TBODY><tr><td> 障礙物種類 障礙物距離 </td><td> 人 </td><td> 車 </td></tr><tr><td> 10公尺 </td><td> 100 </td><td> 70 </td></tr><tr><td> 30公尺 </td><td> 70 </td><td> 40 </td></tr><tr><td> 50公尺 </td><td> 40 </td><td> 10 </td></tr></TBODY></TABLE>表2 <TABLE border="1" borderColor="#000000" width="85%"><TBODY><tr><td> 障礙物位置 </td><td> 分數 </td></tr><tr><td> 中心 </td><td> 1000 </td></tr><tr><td> 中心偏邊緣 </td><td> 50 </td></tr><tr><td> 邊緣 </td><td> 0 </td></tr></TBODY></TABLE>Referring to Figure 1, a system 100 for implementing one embodiment of the obstacle detection confidence assessment method of the present invention is illustrated. The system 100 includes a storage unit 11 , an image capturing unit 12 , and a processing unit 13 electrically connected to the storage unit 11 and the image capturing unit 12 . The image capturing unit 12 continuously captures and transmits a series of images to the processing unit 13. The storage unit 11 stores a confidence score such as 100 points, a first lookup table of an obstacle pair score, a second lookup table of an obstacle pair score, and a first penalty weight corresponding to a first classification method. And a second penalty weight corresponding to a second classification method. The first lookup table includes a plurality of obstacle distances related to the distance between the actual obstacle and the image capturing unit 12, a plurality of obstacle types related to the type of the obstacle, and a plurality of obstacles respectively corresponding to the obstacles The object distance and the scores of the obstacle categories, Table 1 illustrates the first lookup table. The second lookup table includes a plurality of obstacle positions related to the position of the obstacle in an image, and a plurality of scores respectively corresponding to the obstacle positions, and Table 2 illustrates the second lookup table. Table 1  <TABLE border="1" borderColor="#000000" width="85%"><TBODY><tr><td> Obstacle type obstacle distance</td><td> person</td><td> Car</td></tr><tr><td> 10 meters</td><td> 100 </td><td> 70 </td></tr><tr><td> 30 Ruler</td><td> 70 </td><td> 40 </td></tr><tr><td> 50 meters</td><td> 40 </td><td> 10 </td></tr></TBODY></TABLE> Table 2  <TABLE border="1" borderColor="#000000" width="85%"><TBODY><tr><td> Obstacle position</td><td> Score</td></tr><tr ><td> Center</td><td> 1000 </td></tr><tr><td> Center edge </td><td> 50 </td></tr><tr>< Td> edge</td><td> 0 </td></tr></TBODY></TABLE>

參閱圖1及圖2,說明該系統100如何執行本發明障礙物偵測可信度評估方法之該實施例。以下詳細說明該實施例所包含的步驟。Referring to Figures 1 and 2, an embodiment of how the system 100 performs the obstacle detection confidence assessment method of the present invention will be described. The steps involved in this embodiment are described in detail below.

在步驟21中,該處理單元13在接收到來自該影像拍攝單元12的一當前影像後,該處理單元13根據該當前影像利用該第一分類方法獲得並儲存一指示出該第一分類方法所偵測到的障礙物的第一當前障礙物偵測結果(見圖3),且根據該當前影像利用該第二分類方法獲得並儲存一指示出該第二分類方法所偵測到的障礙物的第二當前障礙物偵測結果(見圖4)。值得注意的是,在本實施例中,該第一分類方法是以梯度方向直方圖(Histogram of oriented gradient, HOG)及對數加權模式(Logarithm Weighted Patterns, LWP)獲得該當前影像的輪廓紋理,並以支援向量機(support vector machine, SVM)偵測障礙物,該第二分類方法是以深度學習(deep learning)的卷積神經網路(Convolutional Neural Networks, CNN)偵測障礙物,但不以此為限。不論是該第一分類方法,還是該第二分類方法,兩者在偵測障礙物時,不僅會偵測出障礙物,還會偵測出障礙物位於該當前影像的位置,並標記出所偵測出的障礙物的種類(見圖3、4),故該第一當前障礙物偵測結果與該第二當前障礙物偵測結果皆包含所偵測到之障礙物、所偵測到之障礙物位於該當前影像的位置,以及所偵測到之障礙物的種類。In step 21, after receiving a current image from the image capturing unit 12, the processing unit 13 obtains and stores an indication of the first classification method by using the first classification method according to the current image. a first current obstacle detection result of the detected obstacle (see FIG. 3), and using the second classification method according to the current image to obtain and store an obstacle indicating the second classification method The second current obstacle detection result (see Figure 4). It should be noted that, in this embodiment, the first classification method obtains the contour texture of the current image by using a histogram of oriented gradient (HOG) and a logarithm weighted pattern (LWP), and The obstacle is detected by a support vector machine (SVM), which is a deep learning convolutional neural network (CNN) to detect obstacles, but not This is limited. Regardless of the first classification method or the second classification method, when detecting obstacles, the two not only detect obstacles but also detect obstacles located at the current image and mark the detected objects. The type of obstacle detected (see Figures 3 and 4), so the first current obstacle detection result and the second current obstacle detection result both contain the detected obstacle and the detected obstacle The location of the obstacle at the current image and the type of obstacle detected.

在步驟22中,該處理單元13判定該第一當前障礙物偵測結果與該第二當前障礙物偵測結果是否存在至少一不同的障礙物。當該處理單元13判定出該第一當前障礙物偵測結果與該第二當前障礙物偵測結果存在該至少一不同的障礙物時,進行步驟23;而當該處理單元13判定出該第一當前障礙物偵測結果與該第二當前障礙物偵測結果不存在該至少一不同的障礙物時,進行步驟24。In step 22, the processing unit 13 determines whether the first current obstacle detection result and the second current obstacle detection result have at least one different obstacle. When the processing unit 13 determines that the first current obstacle detection result and the second current obstacle detection result have the at least one different obstacle, proceed to step 23; and when the processing unit 13 determines the first When a current obstacle detection result and the second current obstacle detection result do not exist the at least one different obstacle, proceed to step 24.

在步驟23中,該處理單元13根據該至少一不同的障礙物獲得至少一分別對應該至少一不同的障礙物的懲罰分數,並將該信心度分數減去該至少一懲罰分數,以更新該儲存單元11儲存的該信心度分數。在本實施例中,假設存在N個不同的障礙物,N≧1,步驟23包含子步驟231~236(見圖5),但不以此為限。In step 23, the processing unit 13 obtains at least one penalty score corresponding to at least one different obstacle according to the at least one different obstacle, and subtracts the confidence score from the at least one penalty score to update the The confidence score stored by the storage unit 11. In this embodiment, it is assumed that there are N different obstacles, N≧1, and step 23 includes sub-steps 231-236 (see FIG. 5), but not limited thereto.

再參閱圖1及圖5,進一步示例說明子步驟231~236。Referring again to Figures 1 and 5, sub-steps 231-236 are further illustrated.

在子步驟231中,初始時,該處理單元13針對第1個不同的障礙物來判定該第一當前障礙物偵測結果是否存在第1個不同的障礙物,也就是i=1。In sub-step 231, initially, the processing unit 13 determines, for the first different obstacle, whether the first current obstacle detection result has a first different obstacle, that is, i=1.

在子步驟232中,該處理單元13判定該第一當前障礙物偵測結果是否存在第i個不同的障礙物。當該處理單元13判定出該第一當前障礙物偵測結果不存在第i個不同的障礙物時,進行步驟233;而當該處理單元13判定出該第一當前障礙物偵測結果存在第i個不同的障礙物時,進行步驟234。In sub-step 232, the processing unit 13 determines whether the first current obstacle detection result has an i-th different obstacle. When the processing unit 13 determines that the first current obstacle detection result does not have the i-th different obstacle, step 233 is performed; and when the processing unit 13 determines that the first current obstacle detection result exists When i are different obstacles, proceed to step 234.

在子步驟233中,該處理單元13根據該第i個不同的障礙物獲得一對應該第i個不同的障礙物,且作為該至少一懲罰分數中之一者的第一懲罰分數,並將該信心度分數減去該第一懲罰分數,以更新該儲存單元11儲存的該信心度分數。在本實施例中,該處理單元13係先根據該第i個不同的障礙物位於該當前影像之位置利用一已知的影像距離估算方法,估算出該第i個不同的障礙物所對應之實際障礙物與該影像拍攝單元12之距離,接著根據所估算出的該第i個不同的障礙物所對應之該實際障礙物與該影像拍攝單元12之距離、該第i個不同的障礙物之種類,配合該第一查找表,獲得一對應於該第i個不同的障礙物之分數,再將所獲得之分數乘上該第一懲罰權重來獲得該第一懲罰分數;然而,在其他實施方式中,該處理單元13亦可根據該第i個不同的障礙物之其他屬性如,障礙物位置等配合相關於其他障礙物屬性及分數的另一查找表,來獲得對應於該第i個不同的障礙物之分數,再將所獲得之分數乘上該第一懲罰權重來獲得該第一懲罰分數;甚至該處理單元13也可不需配合該第一查找表而將該第i個不同的障礙物設定為該預設分數,再將該預設分數乘上該第一懲罰權重來獲得該第一懲罰分數,並不以此為限。值得一提的是,由於本發明之特徵並不在於熟知此技藝者所已知的影像距離估算方法,為了簡潔,故在此省略了他們的細節。In sub-step 233, the processing unit 13 obtains a pair of i-th different obstacles according to the i-th different obstacle, and as the first penalty score of one of the at least one penalty score, and The confidence score is subtracted from the first penalty score to update the confidence score stored by the storage unit 11. In this embodiment, the processing unit 13 first estimates a corresponding i-th obstacle according to the position of the current image by using the i-th different obstacle at a position of the current image. The distance between the actual obstacle and the image capturing unit 12, and then according to the estimated distance between the actual obstacle and the image capturing unit 12 corresponding to the i-th different obstacle, the i-th different obstacle a type, matching the first lookup table, obtaining a score corresponding to the i-th different obstacle, and multiplying the obtained score by the first penalty weight to obtain the first penalty score; however, in other In an embodiment, the processing unit 13 may also obtain another corresponding lookup table related to other obstacle attributes and scores according to other attributes of the i-th different obstacles, such as obstacle positions, etc., to obtain corresponding to the i-th a score of a different obstacle, and multiplying the obtained score by the first penalty weight to obtain the first penalty score; even the processing unit 13 may not need to cooperate with the first lookup table to Different obstacles set as the default score, then the pre-multiplied by the fraction first punishment weights to get the first score of punishment, it is not limited thereto. It is to be noted that since the present invention is not characterized by well-known image distance estimation methods known to those skilled in the art, their details are omitted herein for the sake of brevity.

在子步驟234中,該處理單元13根據該第i個不同的障礙物獲得一對應該第i個不同的障礙物,且作為該至少一懲罰分數中之一者的第二懲罰分數,並將該信心度分數減去該第二懲罰分數,以更新該儲存單元11儲存的該信心度分數。在本實施例中,該處理單元13係先根據該第i個不同的障礙物位於該當前影像之位置利用該影像距離估算方法,估算出該第i個不同的障礙物所對應之實際障礙物與該影像拍攝單元12之距離,接著根據所估算出的該第i個不同的障礙物所對應之該實際障礙物與該影像拍攝單元12之距離、該第i個不同的障礙物之種類,配合該第一查找表,獲得一對應於該第i個不同的障礙物之分數,再將所獲得之分數乘上該第二懲罰權重來獲得該第二懲罰分數;然而,在其他實施方式中,該處理單元13亦可根據該第i個不同的障礙物之其他屬性如,障礙物位置等配合相關於其他障礙物屬性及分數的另一查找表,來獲得對應於該第i個不同的障礙物之分數,再將所獲得之分數乘上該第二懲罰權重來獲得該第二懲罰分數;甚至該處理單元13也可不需配合該第一查找表而將該第i個不同的障礙物設定為該預設分數,再將該預設分數乘上該第二懲罰權重來獲得該第二懲罰分數,並不以此為限。In sub-step 234, the processing unit 13 obtains a pair of i-th different obstacles according to the i-th different obstacle, and as a second penalty score of one of the at least one penalty score, and The confidence score is subtracted from the second penalty score to update the confidence score stored by the storage unit 11. In this embodiment, the processing unit 13 first estimates the actual obstacle corresponding to the i-th different obstacle by using the image distance estimation method according to the position of the i-th different obstacle located at the current image. The distance from the image capturing unit 12, and then according to the estimated distance of the actual obstacle corresponding to the image capturing unit 12 corresponding to the i-th different obstacle, the type of the i-th different obstacle, Matching the first lookup table, obtaining a score corresponding to the i-th different obstacle, and multiplying the obtained score by the second penalty weight to obtain the second penalty score; however, in other embodiments The processing unit 13 may also obtain another lookup table corresponding to other obstacle attributes and scores according to other attributes of the i-th different obstacles, such as obstacle positions, etc., to obtain corresponding to the i-th different Obscuring the score, multiplying the obtained score by the second penalty weight to obtain the second penalty score; even the processing unit 13 may not need to cooperate with the first lookup table to make the i-th difference Obstacle has been set for the preset score, then the pre-multiplied by the fraction of a second to get that punishment weight fraction of a second punishment, it is not limited thereto.

接續子步驟233及234之後的子步驟235中,該處理單元13判斷該第i個不同的障礙物是否為第N個不同的障礙物,亦即判斷是否i=N。當該處理單元13判定出該第i個不同的障礙物為第N個不同的障礙物時,進行步驟24;而當該處理單元13判定出該第i個不同的障礙物不為第N個不同的障礙物時,進行子步驟236。In sub-step 235 following sub-steps 233 and 234, the processing unit 13 determines whether the i-th different obstacle is the Nth different obstacle, that is, whether i=N. When the processing unit 13 determines that the i-th different obstacle is the Nth different obstacle, proceed to step 24; and when the processing unit 13 determines that the i-th different obstacle is not the Nth Substep 236 is performed for different obstacles.

在子步驟236中,該處理單元13對於第i+1個不同的障礙物,亦即將i設為i+1。之後,重複子步驟232~236直到i=N。In sub-step 236, the processing unit 13 sets i to i+1 for the i+1th different obstacle. Thereafter, sub-steps 232-236 are repeated until i=N.

在步驟24中,該處理單元13根據該處理單元13根據一前一影像所獲得的一指示出該第一分類方法所偵測到的障礙物的第一前一障礙物偵測結果,與該第一當前障礙物偵測結果,判定該第一前一障礙物偵測結果與該第一當前障礙物偵測結果是否存在至少一不同的障礙物,當該處理單元13判定出該第一前一障礙物偵測結果與該第一當前障礙物偵測結果存在該至少一不同的障礙物時,進行步驟25;而當該處理單元13判定出該第一前一障礙物偵測結果與該第一當前障礙物偵測結果不存在該至少一不同的障礙物時,進行步驟26。In step 24, the processing unit 13 determines, according to a previous image obtained by the processing unit 13, a first previous obstacle detection result of the obstacle detected by the first classification method, and the a first current obstacle detection result, determining whether the first previous obstacle detection result and the first current obstacle detection result have at least one different obstacle, when the processing unit 13 determines the first front When an obstacle detection result and the first current obstacle detection result have the at least one different obstacle, proceed to step 25; and when the processing unit 13 determines the first previous obstacle detection result and the When the first current obstacle detection result does not exist in the at least one different obstacle, proceed to step 26.

在步驟25中,該處理單元13根據該至少一不同的障礙物、該第二查找表及該第一懲罰權重獲得至少一對應該至少一不同的障礙物的第三懲罰分數,並將該信心度分數減去該至少一第三懲罰分數,以更新該儲存單元11儲存的該信心度分數。在本實施例中,對於每一不同的障礙物,該處理單元13係先根據該不同的障礙物於該當前影像或該前一影像的位置配合該第二查找表,獲得一對應於該不同的障礙物之分數,再將所獲得之分數乘上該第一懲罰權重來獲得該第三懲罰分數;然而,在其他實施方式中,該處理單元13亦可根據該不同的障礙物之其他屬性如,障礙物種類或障礙物距離等配合相關於其他障礙物屬性及分數的另一查找表,來獲得對應於該不同的障礙物之分數,再將所獲得之分數乘上該第一懲罰權重來獲得該第三懲罰分數;甚至該處理單元13也可不需配合該第二查找表而將每一不同的障礙物皆設定為同一預設分數,再將該預設分數乘上該第一懲罰權重來獲得該第三懲罰分數,並不以此為限。舉例來說,若該第一前一障礙物偵測結果指示出一障礙物甲及一障礙物乙,而該第一當前障礙物偵測結果指示出該障礙物甲及一障礙物丙,則該處理單元13判定該第一前一障礙物偵測結果與該第一當前障礙物偵測結果存在該障礙物乙及該障礙物丙之兩個不同的障礙物。In step 25, the processing unit 13 obtains at least one third penalty score corresponding to at least one different obstacle according to the at least one different obstacle, the second lookup table, and the first penalty weight, and the confidence The degree score is subtracted from the at least one third penalty score to update the confidence score stored by the storage unit 11. In this embodiment, for each different obstacle, the processing unit 13 first matches the second lookup table according to the position of the current image or the previous image by the different obstacle, to obtain a corresponding to the difference. a score of the obstacle, and multiplying the obtained score by the first penalty weight to obtain the third penalty score; however, in other embodiments, the processing unit 13 may also be based on other attributes of the different obstacle For example, an obstacle type or an obstacle distance or the like is matched with another lookup table related to other obstacle attributes and scores to obtain a score corresponding to the different obstacle, and the obtained score is multiplied by the first penalty weight. To obtain the third penalty score; even the processing unit 13 may set each different obstacle to the same preset score without matching the second lookup table, and then multiply the preset score by the first penalty. Weighting to obtain the third penalty score is not limited to this. For example, if the first previous obstacle detection result indicates an obstacle A and an obstacle B, and the first current obstacle detection result indicates the obstacle A and an obstacle C, then The processing unit 13 determines that the first previous obstacle detection result and the first current obstacle detection result have two obstacles different from the obstacle B and the obstacle C.

在步驟26中,該處理單元13根據該處理單元13根據該前一影像所獲得的一指示出該第二分類方法所偵測到的障礙物的第二前一障礙物偵測結果,與該第二當前障礙物偵測結果,判定該第二前一障礙物偵測結果與該第二當前障礙物偵測結果是否存在至少一不同的障礙物,當該處理單元13判定出該第二前一障礙物偵測結果與該第二當前障礙物偵測結果存在該至少一不同的障礙物時,進行步驟27;而當該處理單元13判定出該第二前一障礙物偵測結果與該第二當前障礙物偵測結果不存在該至少一不同的障礙物時,進行步驟28。In step 26, the processing unit 13 determines, according to the previous image, a second previous obstacle detection result of the obstacle detected by the second classification method, and the processing unit 13 a second current obstacle detection result, determining whether the second previous obstacle detection result and the second current obstacle detection result have at least one different obstacle, when the processing unit 13 determines the second front When an obstacle detection result and the second current obstacle detection result have the at least one different obstacle, proceed to step 27; and when the processing unit 13 determines the second previous obstacle detection result and the When the second current obstacle detection result does not exist in the at least one different obstacle, proceed to step 28.

在步驟27中,該處理單元13根據該至少一不同的障礙物、該第二查找表及該第二懲罰權重獲得至少一對應該至少一不同的障礙物的第四懲罰分數,並將該信心度分數減去該至少一第四懲罰分數,以更新該儲存單元11儲存的該信心度分數。在本實施例中,對於每一不同的障礙物,該處理單元13係先根據該不同的障礙物於該當前影像或該前一影像的位置配合該第二查找表,獲得一對應於該不同的障礙物之分數,再將所獲得之分數乘上該第二懲罰權重來獲得該第四懲罰分數;然而,在其他實施方式中,該處理單元13亦可根據該不同的障礙物之其他屬性如,障礙物種類或障礙物距離等配合相關於其他障礙物屬性及分數的另一查找表,來獲得對應於該不同的障礙物之分數,再將所獲得之分數乘上該第二懲罰權重來獲得該第四懲罰分數;甚至該處理單元13也可不需配合該第二查找表而將每一不同的障礙物皆設定為同一預設分數,再將該預設分數乘上該第二懲罰權重來獲得該第四懲罰分數,並不以此為限。要特別注意的是,在本實施例中,步驟22、23是在步驟24~27之前,在其他實施方式中,步驟24~27可在步驟22、23之前,亦即在步驟26的判定結果為否定時,執行步驟22,在步驟22的判定結果為否定時,執行步驟28。In step 27, the processing unit 13 obtains at least one fourth penalty score corresponding to at least one different obstacle according to the at least one different obstacle, the second lookup table, and the second penalty weight, and the confidence The score is subtracted from the at least one fourth penalty score to update the confidence score stored by the storage unit 11. In this embodiment, for each different obstacle, the processing unit 13 first matches the second lookup table according to the position of the current image or the previous image by the different obstacle, to obtain a corresponding to the difference. a score of the obstacle, and multiplying the obtained score by the second penalty weight to obtain the fourth penalty score; however, in other embodiments, the processing unit 13 may also be based on other attributes of the different obstacle For example, an obstacle type or an obstacle distance or the like is matched with another lookup table related to other obstacle attributes and scores to obtain a score corresponding to the different obstacle, and the obtained score is multiplied by the second penalty weight. To obtain the fourth penalty score; even the processing unit 13 may set each different obstacle to the same preset score without matching the second lookup table, and then multiply the preset score by the second penalty. Weighting to obtain the fourth penalty score is not limited to this. It should be particularly noted that in the present embodiment, steps 22 and 23 are before steps 24 to 27, and in other embodiments, steps 24 to 27 may be before steps 22 and 23, that is, the determination result in step 26. If it is negative, step 22 is performed, and when the result of the determination in step 22 is negative, step 28 is performed.

在步驟28中,該處理單元13輸出該信心度分數,且繼而將該信心度分數重設為100。值得一提的是,在本實施例中,若該信心度分數為負數時,該處理單元13會將其校正為0後再輸出,但不限於此,該處理單元13也可直接輸出帶負號的該信心度分數。In step 28, the processing unit 13 outputs the confidence score and then resets the confidence score to 100. It is worth mentioning that, in this embodiment, if the confidence score is negative, the processing unit 13 corrects it to 0 and outputs it again, but is not limited thereto, and the processing unit 13 can also directly output a negative The confidence score of the number.

由於該第三懲罰分數及該第四懲罰分數是相關於該第一前一障礙物偵測結果與該第一當前障礙物偵測結果的不同的障礙物,及該第二前一障礙物偵測結果與該第二當前障礙物偵測結果的不同的障礙物,該第三懲罰分數及該第四懲罰分數相關於不同的障礙物於該前一影像或該當前影像的位置,以判別是否為該不同的障礙物於不同的時間進出該影像拍攝單元12的拍攝範圍,或是該系統100之偵測發生嚴重失誤的情況。且由於該第一分類方法對應於該第一懲罰分數及該第三懲罰分數,該第二分類方法對應於該第二懲罰分數及該第四懲罰分數,故該第一懲罰分數及該第三懲罰分數對應該第一懲罰權重,該第二懲罰分數及該第四懲罰分數對應該第二懲罰權重,該第一懲罰權重例如為0.2,該第二懲罰權重例如為0.8。The third penalty score and the fourth penalty score are different obstacles related to the first previous obstacle detection result and the first current obstacle detection result, and the second previous obstacle detection The third penalty score and the fourth penalty score are related to the position of the different obstacle in the previous image or the current image to determine whether the obstacle is different from the second current obstacle detection result. The shooting range of the image capturing unit 12 is entered and exited at different times for the different obstacles, or the system 100 detects a serious error. And because the first classification method corresponds to the first penalty score and the third penalty score, the second classification method corresponds to the second penalty score and the fourth penalty score, so the first penalty score and the third The penalty score corresponds to the first penalty weight, and the second penalty score corresponds to the second penalty weight, the first penalty weight is, for example, 0.2, and the second penalty weight is, for example, 0.8.

參閱圖1、圖6及圖7,以下將配合一個應用範例,來說明本發明障礙物偵測可信度評估方法之實施例,圖6示例出該前一影像,其包含一障礙物A、一障礙物B,及一障礙物C,圖7示例出該處理單元13根據該前一影像利用該第一分類方法所獲得的第一前一障礙物偵測結果,該第一前一障礙物偵測結果指示出該障礙物A位於該前一影像及該當前影像的中間,種類為車,距離該影像拍攝單元12十公尺,及該障礙物B位於該前一影像的邊緣,種類為車,距離該影像拍攝單元12三十公尺,圖8示例出該處理單元13根據該前一影像利用該第二分類方法所獲得的第二前一障礙物偵測結果,該第二前一障礙物偵測結果指示出該障礙物A位於該前一影像及該當前影像的中間,種類為車,距離該影像拍攝單元12十公尺、該障礙物B位於該前一影像的邊緣,種類為車,距離該影像拍攝單元12三十公尺,及該障礙物C位於該前一影像及該當前影像的中間偏邊緣,種類為人,距離該影像拍攝單元12三十公尺。圖9示例出該當前影像,其包含該障礙物A及該障礙物C,圖10示例出該處理單元13根據該當前影像利用該第一分類方法所獲得的第一當前障礙物偵測結果,該第一當前障礙物偵測結果指示出該障礙物A位於該當前影像及該當前影像的中間,種類為車,距離該影像拍攝單元12十公尺,圖11示例出該處理單元13根據該當前影像利用該第二分類方法所獲得的第二當前障礙物偵測結果,該第二當前障礙物偵測結果指示出該障礙物A位於該當前影像的中間,種類為車,距離該影像拍攝單元12十公尺,及該障礙物C位於該當前影像的中間偏邊緣,種類為人,距離該影像拍攝單元12三十公尺。Referring to FIG. 1 , FIG. 6 and FIG. 7 , an embodiment of the obstacle detection reliability evaluation method of the present invention will be described below with reference to an application example. FIG. 6 illustrates the previous image, which includes an obstacle A, An obstacle B, and an obstacle C, FIG. 7 illustrates a first previous obstacle detection result obtained by the processing unit 13 by using the first classification method according to the previous image, the first previous obstacle The detection result indicates that the obstacle A is located in the middle of the previous image and the current image, and the type is a car, which is 12 meters away from the image capturing unit, and the obstacle B is located at the edge of the previous image, and the type is The vehicle is located 30 meters away from the image capturing unit 12, and FIG. 8 illustrates a second preceding obstacle detecting result obtained by the processing unit 13 by using the second sorting method according to the previous image, the second previous one The obstacle detection result indicates that the obstacle A is located in the middle of the previous image and the current image, and the type is a car. The image capturing unit is 12 meters away from the image capturing unit, and the obstacle B is located at the edge of the previous image. For the car, from the image capture 12 30 meters, and the obstacle is located in the C before a current image and the center partial edge image, the type of human, 30 meters from the 12 image capture unit. FIG. 9 illustrates the current image, which includes the obstacle A and the obstacle C. FIG. 10 illustrates a first current obstacle detection result obtained by the processing unit 13 according to the current image by using the first classification method. The first current obstacle detection result indicates that the obstacle A is located in the middle of the current image and the current image, and the type is a car, which is 12 meters away from the image capturing unit. FIG. 11 illustrates that the processing unit 13 according to the The current current image uses the second current obstacle detection result obtained by the second classification method, and the second current obstacle detection result indicates that the obstacle A is located in the middle of the current image, and the type is a car, and the image is taken from the image. The unit 12 is ten meters, and the obstacle C is located at the middle edge of the current image, and the type is human, 30 meters away from the image capturing unit 12.

如步驟233所示,該處理單元13根據該第一當前障礙物偵測結果所指示出該不同的障礙物(該障礙物C)的障礙物種類與障礙物距離,及該第一查找表,獲得對應該障礙物C的分數(由於障礙物種類為人且障礙物距離為三十公尺,故該分數為70),再將所獲得之分數(亦即,70)乘上該第一懲罰權重(亦即,0.2)來獲得該第一懲罰分數(亦即,0.2×70=14),該處理單元13並更新該信心度分數為100-14=86。如步驟25所示,該處理單元13根據該不同的障礙物(該障礙物B)於該前一影像的位置,及該第二查找表獲得對應該障礙物B的分數(由於該障礙物B位於邊緣,故該分數為0),再將所獲得之分數(亦即,0)乘上該第一懲罰權重來獲得該第三懲罰分數(亦即,0.2×0=0),該處理單元13更新該信心度分數為86-0=86。如步驟27所示,該處理單元13根據該不同的障礙物(該障礙物B)於該前一影像的位置,及該第二查找表獲得對應該障礙物B的第分數(由於該障礙物B位於邊緣,故該分數為0),再將所獲得之分數(亦即,0)乘上該第二懲罰權重(亦即,0.8)來獲得該第四懲罰分數(亦即,0.8×0=0),該處理單元13並更新該信心度分數為86-0=86。最後在步驟28中,該處理單元13輸出的該信心度分數為86。As shown in step 233, the processing unit 13 indicates the obstacle type and the obstacle distance of the different obstacle (the obstacle C) according to the first current obstacle detection result, and the first lookup table. Obtain a score corresponding to the obstacle C (since the obstacle type is human and the obstacle distance is 30 meters, so the score is 70), and then multiply the obtained score (that is, 70) by the first penalty The weight (i.e., 0.2) is used to obtain the first penalty score (i.e., 0.2 x 70 = 14), and the processing unit 13 updates the confidence score to 100-14 = 86. As shown in step 25, the processing unit 13 obtains a score corresponding to the obstacle B according to the position of the previous image and the second lookup table according to the different obstacle (because of the obstacle B) Located at the edge, so the score is 0), and then the obtained score (ie, 0) is multiplied by the first penalty weight to obtain the third penalty score (ie, 0.2×0=0), the processing unit 13 update the confidence score to 86-0=86. As shown in step 27, the processing unit 13 obtains the first score corresponding to the obstacle B according to the position of the previous image and the second lookup table according to the different obstacle (the obstacle B) (due to the obstacle) B is at the edge, so the score is 0), and the obtained score (ie, 0) is multiplied by the second penalty weight (ie, 0.8) to obtain the fourth penalty score (ie, 0.8×0). =0), the processing unit 13 updates the confidence score to 86-0=86. Finally, in step 28, the confidence score output by the processing unit 13 is 86.

綜上所述,本發明障礙物偵測可信度評估方法,藉由該處理單元13判定該第一前一障礙物偵測結果與該第一當前障礙物偵測結果是否存在至少一不同的障礙物、該第二前一障礙物偵測結果與該第二當前障礙物偵測結果是否存在至少一不同的障礙物,及該第一當前障礙物偵測結果與該第二當前障礙物偵測結果是否存在至少一不同的障礙物,以判定是否獲得該至少一第一懲罰分數、該至少一第二懲罰分數、該至少一第三懲罰分數,及該至少一第四懲罰分數,並在獲得懲罰分數後,將該信心度分數減去懲罰分數,以更新並輸出該信心度分數,藉此,提供障礙物偵測結果之可信度給駕駛參考,故確實能達成本發明的目的。In summary, the obstacle detection reliability evaluation method of the present invention is determined by the processing unit 13 determining whether the first previous obstacle detection result and the first current obstacle detection result are at least one different. Whether the obstacle, the second previous obstacle detection result and the second current obstacle detection result have at least one different obstacle, and the first current obstacle detection result and the second current obstacle detection result Determining whether there is at least one different obstacle to determine whether to obtain the at least one first penalty score, the at least one second penalty score, the at least one third penalty score, and the at least one fourth penalty score, and After the penalty score is obtained, the confidence score is subtracted from the penalty score to update and output the confidence score, thereby providing the reliability of the obstacle detection result to the driving reference, so that the object of the present invention can be achieved.

惟以上所述者,僅為本發明的實施例而已,當不能以此限定本發明實施的範圍,凡是依本發明申請專利範圍及專利說明書內容所作的簡單的等效變化與修飾,皆仍屬本發明專利涵蓋的範圍內。However, the above is only the embodiment of the present invention, and the scope of the invention is not limited thereto, and all the simple equivalent changes and modifications according to the scope of the patent application and the patent specification of the present invention are still Within the scope of the invention patent.

100‧‧‧系統100‧‧‧ system

11‧‧‧儲存單元11‧‧‧ storage unit

12‧‧‧影像拍攝單元12‧‧‧Image Capture Unit

13‧‧‧處理單元13‧‧‧Processing unit

21~28‧‧‧步驟21~28‧‧‧Steps

231~236‧‧‧子步驟231~236‧‧‧ substeps

A‧‧‧障礙物A‧‧‧ obstacles

B‧‧‧障礙物B‧‧‧ obstacles

C‧‧‧障礙物C‧‧‧ obstacles

本發明的其他的特徵及功效,將於參照圖式的實施方式中清楚地呈現,其中:  圖1一方塊圖,示例地繪示一用來實施本發明障礙物偵測可信度評估方法之一實施例的系統;  圖2是一流程圖,說明本發明障礙物偵測可信度評估方法之該實施例;  圖3是一示意圖,說明一第一當前障礙物偵測結果;  圖4是一示意圖,說明一第二當前障礙物偵測結果;  圖5是一流程圖,搭配圖2說明該實施例的一步驟23的子步驟;  圖6是一示意圖,說明一前一影像;  圖7是一示意圖,搭配圖6說明一第一前一障礙物偵測結果;  圖8是一示意圖,搭配圖6說明一第二前一障礙物偵測結果;  圖9是一示意圖,說明一當前影像;  圖10是一示意圖,搭配圖9說明另一第一當前障礙物偵測結果;及  圖11是一示意圖,搭配圖9說明另一第二當前障礙物偵測結果。Other features and effects of the present invention will be apparent from the following description of the drawings. FIG. 1 is a block diagram illustrating an exemplary method for evaluating the reliability of obstacle detection in the present invention. FIG. 2 is a flow chart illustrating the embodiment of the obstacle detection reliability evaluation method of the present invention; FIG. 3 is a schematic diagram illustrating a first current obstacle detection result; FIG. A schematic diagram illustrating a second current obstacle detection result; FIG. 5 is a flow chart, and FIG. 2 illustrates a sub-step of a step 23 of the embodiment; FIG. 6 is a schematic diagram illustrating a previous image; It is a schematic diagram, with FIG. 6 illustrating a first previous obstacle detection result; FIG. 8 is a schematic diagram, with FIG. 6 illustrating a second previous obstacle detection result; FIG. 9 is a schematic diagram illustrating a current image. FIG. 10 is a schematic diagram showing another first current obstacle detection result in conjunction with FIG. 9; and FIG. 11 is a schematic diagram, and FIG. 9 illustrates another second current obstacle detection result.

Claims (10)

一種障礙物偵測可信度評估方法,由一電連接一儲存單元與一影像拍攝單元的處理單元來實施,該儲存單元儲存有一信心度分數,該影像拍攝單元持續地拍攝並傳送一連串影像至該處理單元,該障礙物偵測可信度評估方法包含以下步驟:(A)在接收到來自該影像拍攝單元的一當前影像後,根據該當前影像利用一第一分類方法獲得並儲存一指示出該第一分類方法所偵測到的障礙物的第一當前障礙物偵測結果,且根據該當前影像利用一第二分類方法獲得並儲存一指示出該第二分類方法所偵測到的障礙物的第二當前障礙物偵測結果;(B)判定該第一當前障礙物偵測結果與該第二當前障礙物偵測結果是否存在至少一不同的障礙物;及(C)當判定出該第一當前障礙物偵測結果與該第二當前障礙物偵測結果存在該至少一不同的障礙物時,至少根據該至少一不同的障礙物,獲得至少一分別對應該至少一不同的障礙物的懲罰分數,並將該信心度分數減去該至少一懲罰分數,以更新該信心度分數。 An obstacle detection reliability evaluation method is implemented by a processing unit electrically connected to a storage unit and an image capturing unit, the storage unit stores a confidence score, and the image capturing unit continuously captures and transmits a series of images to The processing unit, the obstacle detection reliability evaluation method includes the following steps: (A) after receiving a current image from the image capturing unit, obtaining and storing an indication according to the current image by using a first classification method a first current obstacle detection result of the obstacle detected by the first classification method, and obtaining and storing, according to the current image, a second classification method, indicating that the second classification method detects a second current obstacle detection result of the obstacle; (B) determining whether the first current obstacle detection result and the second current obstacle detection result have at least one different obstacle; and (C) determining When the first current obstacle detection result and the second current obstacle detection result have the at least one different obstacle, at least according to the at least one different obstacle Obtaining at least a fraction of at least respectively should punish a different obstacles, and minus the confidence score for the punishment of at least a fraction, to update the confidence score. 如請求項1所述的障礙物偵測可信度評估方法,其中,步驟(C)包括以下子步驟:(C-1)當判定出該第一當前障礙物偵測結果與該第二當前障礙物偵測結果存在該至少一不同的障礙物時,對於該至少一不同的障礙物之每一者,判定該第一當前障礙物 偵測結果是否不存在該不同的障礙物;(C-2)當判定出該第一當前障礙物偵測結果不存在該不同的障礙物時,至少根據該不同的障礙物獲得一作為該至少一懲罰分數中之一者的第一懲罰分數,並將該信心度分數減去該第一懲罰分數,以更新該信心度分數;及(C-3)當判定出該第一當前障礙物偵測結果存在該不同的障礙物時,至少根據該不同的障礙物獲得一作為該至少一懲罰分數中之一者的第二懲罰分數,並將該信心度分數減去該第二懲罰分數,以更新該信心度分數。 The obstacle detection reliability evaluation method according to claim 1, wherein the step (C) comprises the following substeps: (C-1) determining the first current obstacle detection result and the second current When the obstacle detection result has the at least one different obstacle, determining the first current obstacle for each of the at least one different obstacle Detecting whether the different obstacles are not present; (C-2) when it is determined that the first current obstacle detection result does not exist the different obstacles, at least according to the different obstacles, obtaining at least one a first penalty score of one of the penalty scores, and subtracting the confidence score from the first penalty score to update the confidence score; and (C-3) when determining the first current obstacle detection When the different obstacle exists in the measurement result, at least a second penalty score as one of the at least one penalty score is obtained according to the different obstacle, and the confidence score is subtracted from the second penalty score to Update the confidence score. 如請求項2所述的障礙物偵測可信度評估方法,該儲存單元還儲存有一障礙物對分數的第一查找表、一對應於該第一分類方法的第一懲罰權重,及一對應於該第二分類方法的第二懲罰權重,該第一查找表包含多個相關於一實際障礙物與該影像拍攝單元之距離的障礙物距離,及多個分別對應於該等障礙物距離的分數,其中:在步驟(A)中,該第一當前障礙物偵測結果與該第二當前障礙物偵測結果皆包含所偵測到之障礙物,及所偵測到之障礙物位於該當前影像的位置;在步驟(C-2)中,該處理單元係先根據該不同的障礙物位於該當前影像的位置,估算出該不同的障礙物所對應之實際障礙物與該影像拍攝單元之距離,並根據所估算出的距離及該第一查找表,獲得一對應於該不同的障礙物之分數,再將所獲得之分數乘上該第一懲罰權重以獲得該第一懲罰分數;及 在步驟(C-3)中,該處理單元係先根據該不同的障礙物位於該當前影像的位置,估算出該不同的障礙物所對應之實際障礙物與該影像拍攝單元之距離,並根據所估算出的距離及該第一查找表,獲得一對應於該不同的障礙物之分數,再將所獲得之分數乘上該第二懲罰權重以獲得該第二懲罰分數。 The obstacle detection reliability evaluation method according to claim 2, wherein the storage unit further stores a first lookup table of the obstacle pair score, a first penalty weight corresponding to the first classification method, and a corresponding The second penalty weight of the second classification method, the first lookup table includes a plurality of obstacle distances related to a distance between an actual obstacle and the image capturing unit, and a plurality of obstacle distances respectively corresponding to the obstacle distances a score, wherein: in the step (A), the first current obstacle detection result and the second current obstacle detection result both include the detected obstacle, and the detected obstacle is located in the The position of the current image; in the step (C-2), the processing unit first estimates the actual obstacle corresponding to the different obstacle and the image capturing unit according to the position of the different obstacle at the current image. a distance, and according to the estimated distance and the first lookup table, obtaining a score corresponding to the different obstacle, and multiplying the obtained score by the first penalty weight to obtain the first penalty score; and In the step (C-3), the processing unit first estimates the distance between the actual obstacle corresponding to the different obstacle and the image capturing unit according to the position of the different obstacle at the current image, and according to The estimated distance and the first lookup table obtain a score corresponding to the different obstacle, and multiply the obtained score by the second penalty weight to obtain the second penalty score. 如請求項2所述的障礙物偵測可信度評估方法,該儲存單元還儲存有一障礙物對分數的第一查找表、一對應於該第一分類方法的第一懲罰權重,及一對應於該第二分類方法的第二懲罰權重,該第一查找表包含多個障礙物種類,及多個分別對應於該等種類的分數,其中:在步驟(A)中,該第一當前障礙物偵測結果與該第二當前障礙物偵測結果皆包含所偵測到之障礙物,及所偵測到之障礙物的種類;在步驟(C-2)中,該處理單元係根據該不同的障礙物的種類及該第一查找表,獲得一對應於該不同的障礙物之分數,再將所獲得之分數乘上該第一懲罰權重以獲得該第一懲罰分數;及在步驟(C-3)中,該處理單元係根據該不同的障礙物的種類及該第一查找表,獲得一對應於該不同的障礙物之分數,再將所獲得之分數乘上該第二懲罰權重以獲得該第二懲罰分數。 The obstacle detection reliability evaluation method according to claim 2, wherein the storage unit further stores a first lookup table of the obstacle pair score, a first penalty weight corresponding to the first classification method, and a corresponding The second penalty weight of the second classification method, the first lookup table includes a plurality of obstacle categories, and a plurality of scores respectively corresponding to the categories, wherein: in step (A), the first current obstacle The object detection result and the second current obstacle detection result both include the detected obstacle and the type of the detected obstacle; in step (C-2), the processing unit is based on the Different types of obstacles and the first lookup table, obtaining a score corresponding to the different obstacles, and multiplying the obtained score by the first penalty weight to obtain the first penalty score; and at the step ( In C-3), the processing unit obtains a score corresponding to the different obstacle according to the type of the different obstacle and the first lookup table, and multiplies the obtained score by the second penalty weight. Obtain the second penalty score. 如請求項1所述的障礙物偵測可信度評估方法,在步驟(A)後,還包含以下步驟: (D)根據一前一影像所獲得的一指示出該第一分類方法所偵測到的障礙物的第一前一障礙物偵測結果與該第一當前障礙物偵測結果,判定該第一前一障礙物偵測結果與該第一當前障礙物偵測結果是否存在至少一不同的障礙物;(E)當判定出該第一前一障礙物偵測結果與該第一當前障礙物偵測結果存在該至少一不同的障礙物時,至少根據該至少一不同的障礙物獲得至少一對應該至少一不同的障礙物的第三懲罰分數,並將該信心度分數減去該至少一第三懲罰分數,以更新該信心度分數。 The method for evaluating the obstacle detection reliability described in claim 1 further comprises the following steps after the step (A): (D) determining, according to a first image obtained by the first image, a first previous obstacle detection result of the obstacle detected by the first classification method and the first current obstacle detection result Whether the first obstacle detection result and the first current obstacle detection result have at least one different obstacle; (E) determining the first previous obstacle detection result and the first current obstacle Detecting that at least one different obstacle exists, at least one third penalty score corresponding to at least one different obstacle is obtained according to the at least one different obstacle, and the confidence score is subtracted from the at least one The third penalty score is to update the confidence score. 如請求項5所述的障礙物偵測可信度評估方法,該儲存單元還儲存有一障礙物對分數的第二查找表,該第二查找表包含多個相關於障礙物位於一影像之位置的障礙物位置,及多個分別對應於該等障礙物位置的分數,其中:在步驟(A)中,該第一當前障礙物偵測結果與該第二當前障礙物偵測結果皆包含所偵測到之障礙物,及所偵測到之障礙物位於該當前影像的位置;及在步驟(E)中,該處理單元係根據該不同的障礙物位於該當前影像或該前一影像的位置及該第二查找表,獲得一對應於該不同的障礙物之分數,再根據獲得之該分數獲得該第三懲罰分數。 The obstacle detection reliability evaluation method according to claim 5, wherein the storage unit further stores a second lookup table of the obstacle pair score, wherein the second lookup table includes a plurality of positions related to the obstacle located at an image. a position of the obstacle, and a plurality of scores respectively corresponding to the positions of the obstacles, wherein: in the step (A), the first current obstacle detection result and the second current obstacle detection result both include Detecting the obstacle and the detected obstacle is located at the current image; and in step (E), the processing unit is located in the current image or the previous image according to the different obstacle The location and the second lookup table obtain a score corresponding to the different obstacle, and then obtain the third penalty score according to the obtained score. 如請求項1所述的障礙物偵測可信度評估方法,在步驟(A)後,還包含以下步驟:(F)根據一前一影像所獲得的一指示出該第二分類方 法所偵測到的障礙物的第二前一障礙物偵測結果與該第二當前障礙物偵測結果,判定該第二前一障礙物偵測結果與該第二當前障礙物偵測結果是否存在至少一不同的障礙物;(G)當判定出該第二前一障礙物偵測結果與該第二當前障礙物偵測結果存在該至少一不同的障礙物時,至少根據該至少一不同的障礙物獲得至少一對應該至少一不同的障礙物的第四懲罰分數,並將該信心度分數減去該至少一第四懲罰分數,以更新該信心度分數。 The method for evaluating the obstacle detection reliability according to claim 1, further comprising the following steps after the step (A): (F) indicating the second classification party according to an indication obtained by the previous image. Determining the second previous obstacle detection result and the second current obstacle detection result by the second previous obstacle detection result of the obstacle detected by the method and the second current obstacle detection result Whether there is at least one different obstacle; (G) at least according to the at least one when it is determined that the second previous obstacle detection result and the second current obstacle detection result have the at least one different obstacle The different obstacles obtain at least one fourth penalty score that should be at least one different obstacle, and subtract the confidence score from the at least one fourth penalty score to update the confidence score. 如請求項7所述的障礙物偵測可信度評估方法,該儲存單元還儲存有一障礙物對分數的第二查找表,該第二查找表包含多個相關於障礙物位於一影像之位置的障礙物位置,及多個分別對應於該等障礙物位置的分數,其中:在步驟(A)中,該第一當前障礙物偵測結果與該第二當前障礙物偵測結果皆包含所偵測到之障礙物,及所偵測到之障礙物位於該當前影像的位置;及在步驟(G)中,該處理單元係根據該不同的障礙物位於該當前影像或該前一影像的位置及該第二查找表,獲得一對應於該不同的障礙物之分數,再根據獲得之該分數獲得該第四懲罰分數。 The obstacle detection reliability evaluation method according to claim 7, wherein the storage unit further stores a second lookup table of the obstacle pair score, wherein the second lookup table includes a plurality of positions related to the obstacle located at an image. a position of the obstacle, and a plurality of scores respectively corresponding to the positions of the obstacles, wherein: in the step (A), the first current obstacle detection result and the second current obstacle detection result both include The detected obstacle and the detected obstacle are located at the current image; and in step (G), the processing unit is located in the current image or the previous image according to the different obstacle The location and the second lookup table obtain a score corresponding to the different obstacle, and then obtain the fourth penalty score according to the obtained score. 如請求項1所述的障礙物偵測可信度評估方法,其中,在步驟(A)中,該第一分類方法是以輪廓紋理偵測障礙物,該第二分類方法是以深度學習偵測障礙物。 The obstacle detection reliability evaluation method according to claim 1, wherein in the step (A), the first classification method detects obstacles by contour texture, and the second classification method is deep learning detection. Measure obstacles. 如請求項9所述的障礙物偵測可信度評估方法,其中,在 步驟(A)中,該第一分類方法是以梯度方向直方圖及對數加權模式獲得該當前影像輪廓紋理,並以支援向量機偵測障礙物,該第二分類方法是以深度學習的卷積神經網路偵測障礙物。 The obstacle detection reliability evaluation method according to claim 9, wherein In the step (A), the first classification method obtains the current image contour texture by a gradient direction histogram and a logarithmic weighting mode, and detects an obstacle by a support vector machine, and the second classification method is a convolution of deep learning. The neural network detects obstacles.
TW106144708A 2017-12-20 2017-12-20 Obstacle detection credibility evaluation method TWI645997B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW106144708A TWI645997B (en) 2017-12-20 2017-12-20 Obstacle detection credibility evaluation method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW106144708A TWI645997B (en) 2017-12-20 2017-12-20 Obstacle detection credibility evaluation method

Publications (2)

Publication Number Publication Date
TWI645997B true TWI645997B (en) 2019-01-01
TW201927608A TW201927608A (en) 2019-07-16

Family

ID=65803579

Family Applications (1)

Application Number Title Priority Date Filing Date
TW106144708A TWI645997B (en) 2017-12-20 2017-12-20 Obstacle detection credibility evaluation method

Country Status (1)

Country Link
TW (1) TWI645997B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI698811B (en) * 2019-03-28 2020-07-11 國立交通大學 Multipath convolutional neural networks detecting method and system

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2085944A1 (en) * 2006-11-10 2009-08-05 Aisin Seiki Kabushiki Kaisha Driving assistance device, driving assistance method, and program
TWI559267B (en) * 2015-12-04 2016-11-21 Method of quantifying the reliability of obstacle classification
CN107240299A (en) * 2017-07-20 2017-10-10 北京纵目安驰智能科技有限公司 Autonomous land vehicle is to mobile object identification and the method for vehicle obstacle-avoidance

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2085944A1 (en) * 2006-11-10 2009-08-05 Aisin Seiki Kabushiki Kaisha Driving assistance device, driving assistance method, and program
TWI559267B (en) * 2015-12-04 2016-11-21 Method of quantifying the reliability of obstacle classification
CN107240299A (en) * 2017-07-20 2017-10-10 北京纵目安驰智能科技有限公司 Autonomous land vehicle is to mobile object identification and the method for vehicle obstacle-avoidance

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI698811B (en) * 2019-03-28 2020-07-11 國立交通大學 Multipath convolutional neural networks detecting method and system

Also Published As

Publication number Publication date
TW201927608A (en) 2019-07-16

Similar Documents

Publication Publication Date Title
US11763568B2 (en) Ground plane estimation in a computer vision system
JP7163129B2 (en) Object tracking method and apparatus
CN105335955B (en) Method for checking object and object test equipment
US9070023B2 (en) System and method of alerting a driver that visual perception of pedestrian may be difficult
US10755124B2 (en) Passenger counting device, system, method and program, and vehicle movement amount calculation device, method and program
CN108604405A (en) The object being locally blocked is detected using environment and depth order
CN105627932A (en) Distance measurement method and device based on binocular vision
CN110263920B (en) Convolutional neural network model, training method and device thereof, and routing inspection method and device thereof
JP2019124683A (en) Method and device for estimating rate of object and image processor
US9298995B2 (en) Red-eye determination device
CN108491810A (en) Vehicle limit for height method and system based on background modeling and binocular vision
CN108470356A (en) A kind of target object fast ranging method based on binocular vision
WO2022126522A1 (en) Object recognition method, apparatus, movable platform, and storage medium
CN107016348A (en) With reference to the method for detecting human face of depth information, detection means and electronic installation
JP2021033510A (en) Driving assistance device
CN111386530A (en) Vehicle detection method and apparatus
US11080562B1 (en) Key point recognition with uncertainty measurement
CN113284120B (en) Height-limiting measuring method and device
CN109960990B (en) Method for evaluating reliability of obstacle detection
TWI645997B (en) Obstacle detection credibility evaluation method
CN104471436B (en) The method and apparatus of the variation of imaging scale for computing object
US10467486B2 (en) Method for evaluating credibility of obstacle detection
CN111105465B (en) Camera device calibration method, device, system electronic equipment and storage medium
US20130142388A1 (en) Arrival time estimation device, arrival time estimation method, arrival time estimation program, and information providing apparatus
CN113269761A (en) Method, device and equipment for detecting reflection