TW201119897A - Monitor device and method for monitoring driving - Google Patents

Monitor device and method for monitoring driving Download PDF

Info

Publication number
TW201119897A
TW201119897A TW98141156A TW98141156A TW201119897A TW 201119897 A TW201119897 A TW 201119897A TW 98141156 A TW98141156 A TW 98141156A TW 98141156 A TW98141156 A TW 98141156A TW 201119897 A TW201119897 A TW 201119897A
Authority
TW
Taiwan
Prior art keywords
steering wheel
driver
area
driving
image
Prior art date
Application number
TW98141156A
Other languages
Chinese (zh)
Other versions
TWI478836B (en
Inventor
Ying-Chuan Tsai
Original Assignee
Hon Hai Prec Ind Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hon Hai Prec Ind Co Ltd filed Critical Hon Hai Prec Ind Co Ltd
Priority to TW098141156A priority Critical patent/TWI478836B/en
Publication of TW201119897A publication Critical patent/TW201119897A/en
Application granted granted Critical
Publication of TWI478836B publication Critical patent/TWI478836B/en

Links

Landscapes

  • Traffic Control Systems (AREA)

Abstract

A monitor device for monitoring driving is provided. The monitor device may be installed in a car. The monitor device may include a camera, a setting module, an activating button, a controlling module, an identifying module, and a determining module. The monitor device may be used to determine if a driver of the car drives the car under a safe mode, and alarm the driver if the driver drives the car under a unsafe mode. A related method for monitoring driving is also provided. By utilizing the monitor and the related method, accidents may be reduced.

Description

201119897 六、發明說明: 【發明所屬之技術領域】 [0001] 本發明涉及一種監控裝置及方法,尤其涉及一種駕駛監 控裝置及方法。 【先前技術·】 ; [0002] 由於駕駛員的不當操作所導致的交通安全事故時有發生 ,而導致駕駛員發生不當操作通常包括疲勞駕駛、酒後 駕車等。如何識別駕駛員在開車時是否處於清醒狀態並 做出相應的預警對減少交通安全事故有重要的意義。 〇 【發明内容】 [0003] 鑒於以上内容,有必要提供一種駕駛監控裝置及方法, 可識別駕駛員在開車時是否處於清醒狀態且是否合理駕 駛以便做出相應的預警。201119897 VI. Description of the Invention: [Technical Field] [0001] The present invention relates to a monitoring device and method, and more particularly to a driving monitoring device and method. [Prior Art·]; [0002] Traffic safety accidents caused by improper operation of the driver sometimes occur, and the driver's improper operation usually includes fatigue driving, drunk driving, and the like. How to identify whether the driver is awake when driving and make corresponding warnings is of great significance for reducing traffic safety accidents. SUMMARY OF THE INVENTION [0003] In view of the above, it is necessary to provide a driving monitoring device and method that can recognize whether a driver is awake when driving and whether it is reasonably driven to make a corresponding warning.

II

[0004] 一種駕駛監控裝置,該駕駛監控裝置安裝於汽車内,所 述駕駛監控裝置包括:攝像頭,用於拍攝影像;設置模 組,用於設置所述攝像頭的第一角度以拍攝駕駛員臉部 Q ,設置第一閥值以判斷駕駛員是否處於清醒狀態,設置 所述攝像頭的第二角度以拍攝方向盤,設置劃分依據將 方向盤區域劃分成多個部分,並設置駕駛員左右手分別 在方向盤區域的標準位置以判斷是否合理駕駛;啟動按 鈕,用於在被按壓後發送第一指令;控制模組,用於接 收該第一指令並控制所述攝像頭移至第一角度並開啟對 駕駛人的臉部進行拍攝;識別模組,用於獲取所拍攝的 臉部影像,識別該臉部影像中的臉部區域,從識別的臉 部區域中計算出眼睛區域,並計算所述眼睛區域的高度 098141156 表單編號A0101 第3頁/共28頁 0982070615-0 201119897 和長度之間的比值;判斷模組,用於在所述比值小於或 等於第一閥值時確定駕駛員處於非清醒狀態,並發送第 二指令至所述控制模組;所述控制模組,還用於根據該 第二指令控制所述攝像頭移至第二角度拍攝方向盤位置 的第一影像;所述識別模組,還用於獲取第一影像,識 別該第一影像中的方向盤區域及手部區域,依據劃分依 據對所識別的方向盤區域進行劃分,並確定該手部區域 所在的方向盤區域的位置;所述判斷模組,還用於判斷 所確定的手部區域所佔的方向盤區域的位置是否符合設 置的標準位置,從而判斷該駕駛員當前是否合理駕駛; 及預警模組,用於在確定駕駛員並非合理駕駛時發出預 警以提示駕駛員注意。 [0005] 一種駕駛監控方法,應用於汽車的駕駛監控裝置中,該 駕駛監控裝置包括攝像頭以及啟動按鈕,該方法包括: 設置所述攝像頭的第一角度以拍攝駕駛員臉部,設置第 一閥值以判斷駕駛員是否處於清醒狀態,設置所述攝像 頭的第二角度以拍攝方向盤,設置劃分依據將方向盤區 域劃分成多個部分,並設置駕駛員左右手分別在方向盤 區域的標準位置以判斷是否合理駕駛;在所述啟動按鈕 被按壓後發送第一指令;根據該第一指令控制所述攝像 頭移至第一角度並開啟對駕駛員的臉部進行拍攝;獲取 所拍攝的臉部影像,識別該影像中的臉部區域,並從識 別的臉部區域中計算出眼睛區域;計算所述眼睛區域的 高度和長度之間的比值,在所述比值小於或等於第一閥 值時確定該駕駛員處於非清醒狀態,並發送第二指令; 098141156 表單編號A0101 第4頁/共28頁 0982070615-0 201119897 根據該第二指令控制所述攝像頭移至第二角度拍攝方向 盤位置的第一影像;獲取該第一影像,識別該第一影像 中的方向盤區域及手部區域*依據劃分依據對所識別的 方向盤區域進行劃分,並確定該手部區域所在的方向盤 區域的位置;判斷所確定的手部區域所佔的方向盤區域 的位置是否符合設置的標準位置,從而判斷該駕駛員當 前是否合理駕駛;及在確定駕駛員並非合理駕駛時發出 預警以提示駕駛員注意。 [0006] ❹ [0007][0004] A driving monitoring device installed in a car, the driving monitoring device comprising: a camera for capturing an image; and a setting module for setting a first angle of the camera to photograph a driver's face Part Q, setting a first threshold to determine whether the driver is in an awake state, setting a second angle of the camera to photograph the steering wheel, setting a division basis to divide the steering wheel area into a plurality of parts, and setting the left and right hands of the driver respectively in the steering wheel area a standard position to determine whether the driving is reasonable; a start button for transmitting the first command after being pressed; a control module for receiving the first command and controlling the camera to move to the first angle and opening the driver The face is photographed; the recognition module is configured to acquire the captured facial image, identify the facial region in the facial image, calculate the eye region from the recognized facial region, and calculate the height of the eye region 098141156 Form No. A0101 Page 3 of 28 0982070615-0 201119897 The ratio between the length and the length; Determining that the driver is in a non-awake state when the ratio is less than or equal to the first threshold, and sending a second command to the control module; the control module is further configured to control the camera according to the second instruction Moving to a second angle to capture a first image of a steering wheel position; the identification module is further configured to acquire a first image, identify a steering wheel area and a hand area in the first image, and identify the recognized steering wheel area according to the division basis Dividing and determining the position of the steering wheel area where the hand area is located; the determining module is further configured to determine whether the determined position of the steering wheel area occupied by the hand area meets the set standard position, thereby determining the driving Whether the driver is currently driving reasonably; and an early warning module is used to alert the driver when it is determined that the driver is not driving reasonably. [0005] A driving monitoring method is applied to a driving monitoring device of an automobile, the driving monitoring device includes a camera and a start button, the method comprising: setting a first angle of the camera to photograph a driver's face, and setting a first valve The value is used to determine whether the driver is in the awake state, the second angle of the camera is set to photograph the steering wheel, the division direction is set to divide the steering wheel area into a plurality of parts, and the standard position of the left and right hands of the driver in the steering wheel area is set to determine whether it is reasonable. Driving; transmitting a first command after the start button is pressed; controlling the camera to move to a first angle according to the first command and starting to shoot a face of the driver; acquiring the captured face image, identifying the a face region in the image, and calculating an eye region from the recognized face region; calculating a ratio between a height and a length of the eye region, determining the driver when the ratio is less than or equal to a first threshold In a non-awake state, and send a second command; 098141156 Form No. A0101 Page 4 of 28 0982070615-0 201119897, according to the second instruction, controlling the camera to move to the first image of the second angle shooting steering wheel position; acquiring the first image, identifying the steering wheel area and the hand area in the first image according to the division basis Defining the identified steering wheel area and determining the position of the steering wheel area where the hand area is located; determining whether the determined position of the steering wheel area occupied by the hand area conforms to the set standard position, thereby determining whether the driver is currently reasonable Driving; and alerting the driver when it is determined that the driver is not driving reasonably. [0006] ❹ [0007]

GG

[0008] 相較於習知技術,所述的駕駛監控裝置及駕驶監控方法 ,可識別駕駛員在開車時是否處於清醒狀態且是否合理 駕駛,以便做出相應的預警,從而減少交通安全事故。 【實施方式】 如圖1所示,是本發明駕駛監控裝置的較佳實施方式的運 行環境圖。所述駕駛監控裝置2安裝於汽車1中,所述汽 車1還包括方向盤3、油門4以及其他未示於圖1中的裝置 ,例如:刹車、喇叭等。所述駕駛監控裝置2用於監控駕 駛員當前是否合理駕駛,並在確定駕駛員並非合理駕駛 時(例如,駕駛員處於瞌睡狀態),發出預警信號,若 在設置時間内駕駛員並未調整為合理駕駛則直接切斷油 門4以保障行車安全。 如圖2所示,是本發明駕駛監控裝置的較佳實施方式的功 能模組圖。在本較佳實施方式中,所述的駕駛監控裝置2 包括處理器22、攝像頭24、啟動按鈕26、揚聲器28以及 儲存裝置29。所述處理器22用於執行所述駕駛監控裝置2 中安裝或嵌入的各類軟體。 098141156 表單編號A0101 第5頁/共28頁 0982070615-0 201119897 [0009] 所述攝像頭24用於根據指令拍攝影像以便進行分析。 [0010] 所述啟動按鈕26用於啟動所述駕駛監控裝置2,該啟動按 鈕在被駕駛員按壓後即發出第一指令以開啟所述攝像頭 24進行拍攝。 [0011] 所述揚聲器28可播放預先錄製的語音以預警駕駛員注意 安全。 [0012] 所述的儲存裝置29用於儲存各類資料,例如,用戶所設 置的各項資料、預先錄製的語音(可參照下文的詳細介 紹)等。 [0013] 在本較佳實施方式中,所述的駕駛監控裝置2還包括設置 模組200、控制模組202、識別模組204、判斷模組206以 及預警模組208。 [0014] 所述的設置模組200,用於設置多個參數,包括:所述攝 像頭24的第一角度以拍攝駕駛員臉部、所述攝像頭24的 第二角度以拍攝方向盤3、第一閥值以判斷駕駛員是否處 於清醒狀態、劃分依據以將方向盤區域劃分成多個部分 、以及駕駛員左右手分別在方向盤區域的標準位置以判 斷是否合理駕駛等。上述設置的參數可存入所述的儲存 裝置29。 [0015] 在本較佳實施方式中,所述的劃分依據是根據經過方向 盤3的圓心的互相垂直的兩條軸線將該方向盤區域劃分為 左上、左下、右上以及右下四個部分(參考圖3所示的方 向盤3示意圖)。 098141156 表單編號A0101 第6頁/共28頁 0982070615-0 201119897 [0016] [0017] [0018] [0019] Ο [0020] [0021] Ο [0022] [0023] 在本較佳實施方式中,所述的駕駛員左右手分別在方向 盤區域的標準位置是左手位於左上位窨 ι且右手位於右下 位置’或者左手位於左下位置且右手位於右上位置。 在其他實施方式中,方向盤區域的劃分以及雙手在方向 盤區域的標準位置可根制戶需求或個人習慣進行調整 ’例如方向盤區域可分成九部分等。 所述的啟動按鈕26在被按壓後發送第—指令。 所述的控制模組202,用於接收該第一指令並控制所述攝 像頭24移至第一角度並開啟對駕駛人的臉部進行拍攝。 所述的識別模組204,用於獲取所拍攝的臉部影像, 別該臉部影像中的臉部區域。首先’識別模組2〇4利 色理論’根據臉部膚色範圍,將臉部定位出來。所述臉 部膚色範圍的判斷公式如下:Compared with the prior art, the driving monitoring device and the driving monitoring method can identify whether the driver is in a awake state when driving and whether it is reasonably driving, so as to make a corresponding early warning, thereby reducing traffic safety accidents. [Embodiment] As shown in Fig. 1, it is an operational environment diagram of a preferred embodiment of the driving monitoring device of the present invention. The driving monitoring device 2 is mounted in a car 1, which further includes a steering wheel 3, a throttle 4, and other devices not shown in Fig. 1, such as brakes, horns, and the like. The driving monitoring device 2 is configured to monitor whether the driver is currently driving reasonably, and to provide an early warning signal when determining that the driver is not driving reasonably (for example, the driver is in a doze state), if the driver does not adjust to If driving reasonably, the throttle 4 will be cut off directly to ensure safe driving. 2 is a functional block diagram of a preferred embodiment of the driving monitoring device of the present invention. In the preferred embodiment, the driving monitoring device 2 includes a processor 22, a camera 24, a start button 26, a speaker 28, and a storage device 29. The processor 22 is configured to execute various types of software installed or embedded in the driving monitoring device 2. 098141156 Form No. A0101 Page 5 of 28 0982070615-0 201119897 [0009] The camera 24 is used to take an image according to an instruction for analysis. [0010] The start button 26 is used to activate the driving monitoring device 2, and after the pressing button is pressed by the driver, a first command is issued to turn on the camera 24 for shooting. [0011] The speaker 28 can play pre-recorded voice to alert the driver to safety. [0012] The storage device 29 is configured to store various types of materials, for example, various materials set by the user, pre-recorded voices (refer to the following detailed description), and the like. [0013] In the preferred embodiment, the driving monitoring device 2 further includes a setting module 200, a control module 202, an identification module 204, a determining module 206, and an early warning module 208. [0014] The setting module 200 is configured to set a plurality of parameters, including: a first angle of the camera 24 to capture a driver's face, a second angle of the camera 24 to capture the steering wheel 3, first The threshold is used to determine whether the driver is in the awake state, the division basis to divide the steering wheel area into a plurality of parts, and the left and right hands of the driver respectively in the standard position of the steering wheel area to determine whether the driving is reasonable or the like. The parameters set above can be stored in the storage device 29. [0015] In the preferred embodiment, the division is based on dividing the steering wheel area into four parts of upper left, lower left, upper right, and lower right according to two mutually perpendicular axes passing through the center of the steering wheel 3 (refer to the figure). Figure 3 shows the steering wheel 3). 098141156 Form No. A0101 Page 6 / Total 28 Page 0992070615-0 201119897 [0016] [0019] [0020] [0022] [0022] In the preferred embodiment, The standard position of the left and right hands of the driver in the steering wheel area is that the left hand is in the upper left position 窨ι and the right hand is in the lower right position 'or the left hand is in the lower left position and the right hand is in the upper right position. In other embodiments, the division of the steering wheel area and the standard position of the hands in the steering wheel area can be adjusted to the needs of the household or personal habits. For example, the steering wheel area can be divided into nine sections or the like. The start button 26 sends a first command after being pressed. The control module 202 is configured to receive the first command and control the camera 24 to move to a first angle and turn on a photograph of a driver's face. The identification module 204 is configured to acquire the captured facial image and the facial region in the facial image. First, the 'identification module 2〇4 color theory' locates the face according to the facial skin color range. The formula for determining the skin color range of the face is as follows:

Ski\olor^)4UiCr(X,y)€SkinCr]n[C'^ [otherwise ο 如果Skinc〇i〇r(x,y)為1,則表示其被分類為臉部膚色 部分並設定為白色,否則,則被分類為非驗部膚色部分 並設定為黑色。將臉部定位出來後’所述的識別模組204 計算所述臉部的最大包圍集,確定所述臉部區域,即將 所述臉部區域限定在一個矩形中’所述臉部區域的範圍 將作為臉部特徵點取樣的依據。 所述的識別模組204還用於從識別的臉部區域中計算出眼 098141156 表單編號A0101 第7頁/共28頁 0982070615-0 201119897 睛區域。首先,定位出眼睛的區域,利用Sobel演算法對 所述眼睛區域的邊緣進行增強、加黑處理,獲得增強處 理後的眼睛影像;對所述增強處理後的眼睛影像進行二 值化處理;對經過二值化處理後的眼睛影像的邊緣進行 圖元點的取樣,獲取所述眼睛的取樣點;利用Snake演算 法,對所述眼睛的取樣點進行處理,獲取所述眼睛的輪 廓;計算所述眼睛輪廓的最大包圍集,以確定所述眼睛 區域,即將所述眼睛區域限定在一個矩形中;確定該眼 睛區域的高度(H)與長度(W)。 [0024] 所述的識別模組204進一步用於計算所述眼睛區域的高度 和長度之間的比值(H/W)。 [0025] 所述的判斷模組206,用於比較所述比值和第一閥值,並 根據比較結果判斷駕駛員是否處於清醒狀態。若所述比 值大於第一閥值,則所述判斷模組206確定駕駛員處於清 醒狀態,否則,若所述比值小於或等於第一閥值,則確 定駕駛員處於非清醒狀態。 [0026] 在第一實施方式中,所述的預警模組208在確定駕駛員處 於非清醒狀態後即發出預警以提示駕駛員注意,該預警 包括利用所述揚聲器28播放預先錄製的語音,例如“請 小心開車、注意安全”等語音提示。所述的預警模組208 ,還可進一步切斷油門4使得該汽車1減速並停下來。用 戶可根據個人要求對預警模組208的功能進行設置,例如 僅選擇語音提示、僅切斷油門4、或者上述兩種的組合。 例如,可通過控制一個與油門4相連的制動閘實現對油門 4的切斷。 098141156 表單編號A0101 第8頁/共28頁 0982070615-0 201119897 [0027] 在第二實施方式中’所述的判斷模組206還用於在確定駕 駛員處於非清醒狀態後發送第二指令至所述控制模組202 [0028] 所述控制模組202,還用於根據該第二指令控制所述攝像 頭24移至第二角度拍攝方向盤3的位置的第一影像。 [0029] 所述識別模組204,還用於獲取該第一影像,識別該第一 影像中的方向盤區域及手部區域,依據劃分依據對所識 別的方向盤區域進行劃分,並確定該手部區域所在的方 向盤區域的位置。 [0030] 所述的識別模組204可用樣板匹配的方式,用已知的樣板 .... ..::1.... . 和經過處理的影像作交錯關聯,相似程度高的會被顯示 出來,例如,預先儲存多個方向盤3的影像以及駕駛員雙 手放在該方向盤3的不同位置的影像於所述儲存裝置29中 ’以便與所獲取的方向盤3的影像進行比對,從而確認駕 駛員雙手在方向盤區域的不同位置。 Q [〇〇31]所述設置模組200還可預先設置一個比例,所述的識別模 組204通過識別駕駛員的左手或右手在方向 盤區域的一個 位置所佔的比例是否超過該設置的比例,從而確定該位 置是否為該左手或右手所在的方向盤區域的位置。 [0032] 所述判斷模組2〇6 ’還用於判斷所確定的手部區域所佔的 方向盤區域的位置是否符合設置的標準位置,從而判斷 該駕駛員當前是否合理駕駛。 [0033] #所確定的手部區域所佔的方向盤區域的位置符合設置 的‘準位置’㈣定讀駕駛員當前為合理駕駛,否則, 098141156 表單編號A0101 衷 9 頁/共 28 頁 0982070615-0 201119897 即為不合理駕駛。 [〇〇34] 所述的預警模組208,還用於在確定駕駛員並非合理駕駛 時發出預警以提示駕驶員注意。如上所述’所述的預警 模組2 0 8,還可進一步切斷油門4使得該汽車1減速並停下 來。用戶可根據個人要求對預警模組208的功能進行設置 t0035] 在第三實施方式中,所述的駕駛監控裝置2還包括計時器 209 ° [QQ36] 所述設置模組2〇〇,還用於預先設置一個時間間隔。 [〇〇37] 上述確定駕駛員並非合理駕駛時,所述計時器209啟動進 行計時。同時,該預警模組208也發出語音預警。 [()()38] 所述控制模組2〇2,還用於在計時達到所設置的時間間隔 後在第二角度拍攝方向盤3的位置的第二影像。 [〇〇39]所述識別模組204 ,還用於獲取該第二影像,識別該第二 影像中的方向盤區域及手部區域,依據劃分依據對所識 別的方向盤區域進行劃分,並確定該手部區域所在的方 向盤區域的位置。Ski\olor^)4UiCr(X,y)€SkinCr]n[C'^ [otherwise ο If Skinc〇i〇r(x,y) is 1, it is classified as part of the skin color and set to white. Otherwise, it is classified as a non-inspected skin color portion and set to black. After the face is positioned, the recognition module 204 calculates a maximum enclosing set of the face, and determines the face area, that is, the face area is limited to a rectangle. Will be used as the basis for sampling the facial feature points. The identification module 204 is further configured to calculate an eye 098141156 from the identified face area, form number A0101, page 7 of 28, 0982070615-0, 201119897. First, the region of the eye is located, and the edge of the eye region is enhanced and blackened by the Sobel algorithm to obtain an enhanced eye image; the enhanced processed eye image is binarized; Performing sampling of the pixel points on the edge of the binarized eye image to acquire sampling points of the eye; using a Snake algorithm, processing the sampling points of the eye to obtain the contour of the eye; A maximum bounding set of eye contours is defined to define the eye region, ie, the eye region is defined in a rectangle; the height (H) and length (W) of the eye region are determined. [0024] The identification module 204 is further configured to calculate a ratio (H/W) between the height and the length of the eye region. [0025] The determining module 206 is configured to compare the ratio and the first threshold, and determine whether the driver is in an awake state according to the comparison result. If the ratio is greater than the first threshold, the determination module 206 determines that the driver is in an awake state, otherwise, if the ratio is less than or equal to the first threshold, then the driver is determined to be in a non-awake state. In the first embodiment, the early warning module 208 issues an early warning to prompt the driver to pay attention after determining that the driver is in the non-awake state, and the warning includes playing the pre-recorded voice by using the speaker 28, for example, Voice prompts such as "Please drive carefully, pay attention to safety". The warning module 208 can further cut off the throttle 4 so that the car 1 decelerates and stops. The user can set the function of the early warning module 208 according to individual requirements, such as selecting only voice prompts, cutting only the throttle 4, or a combination of the two. For example, the shutoff of the throttle 4 can be achieved by controlling a brake connected to the throttle 4. 098141156 Form No. A0101 Page 8 / Total 28 Page 0992070615-0 201119897 [0027] In the second embodiment, the determination module 206 is further configured to send a second instruction to the driver after determining that the driver is in a non-awake state. The control module 202 is further configured to control, according to the second instruction, the first image of the position where the camera 24 moves to the second angle shooting steering wheel 3 . [0029] The identification module 204 is further configured to acquire the first image, identify a steering wheel area and a hand area in the first image, divide the identified steering wheel area according to the division basis, and determine the hand The location of the steering wheel area where the area is located. [0030] The identification module 204 can be interlaced with a known template by using a template matching method, and a processed image is interleaved, and a similar degree is high. Displayed, for example, pre-storing images of the plurality of steering wheels 3 and images of the driver's hands on different positions of the steering wheel 3 in the storage device 29 for comparison with the acquired images of the steering wheel 3, thereby Confirm that the driver's hands are in different positions in the steering wheel area. Q [〇〇31] The setting module 200 may further set a ratio, and the identification module 204 recognizes whether the proportion of the left or right hand of the driver in a position of the steering wheel area exceeds the set ratio. To determine if the location is the location of the steering wheel area where the left or right hand is located. [0032] The determining module 2〇6′ is further configured to determine whether the determined position of the steering wheel area occupied by the hand area conforms to the set standard position, thereby determining whether the driver is currently driving reasonably. [0033] #The determined hand area occupies the position of the steering wheel area in accordance with the set 'quasi-position' (4) The driver is currently driving reasonably, otherwise, 098141156 Form No. A0101 9 pages/28 pages 0992070615-0 201119897 is unreasonable driving. [〇〇34] The early warning module 208 is further configured to issue an early warning to prompt the driver to pay attention when determining that the driver is not driving reasonably. The warning module 208 as described above can further cut off the throttle 4 so that the car 1 decelerates and stops. The user can set the function of the early warning module 208 according to individual requirements. t0035] In the third embodiment, the driving monitoring device 2 further includes a setting module 2〇〇 of the timer 209 ° [QQ36], and is also used. Set a time interval in advance. [〇〇37] When it is determined above that the driver is not driving reasonably, the timer 209 starts timing. At the same time, the early warning module 208 also issues a voice alert. [()() 38] The control module 2〇2 is further configured to capture a second image of the position of the steering wheel 3 at a second angle after the time interval is reached. The identification module 204 is further configured to acquire the second image, identify a steering wheel area and a hand area in the second image, divide the identified steering wheel area according to the division basis, and determine the The location of the steering wheel area where the hand area is located.

[0040] 所述判斷额m,_於所確㈣手部 方向盤區域的位置是否符合設置的標準位置,^ :=是否在預警後且經過設置的時間間隔後‘ [0041] 098141156 的方向盤區域的 置的標準位置,則所过 义判斷模組206確定1 表單編號A0101 第〗 頁/共28頁 0982070615-0 201119897 [0042] [0043] [0044] Ο [0045] [0046] G [0047] [0048] 後且經過設置的時間間隔後仍然沒有調整為合理駕駛, 則所述預警模組208,還用於在確定駕駛員仍然非合理駕 駛時切斷油門4,從而使得該汽車1減速並停下來。 如圖4所示,是本發明駕駛監控方法的參數設置流程圖。 步驟S2,所述的設置模組200設置所述攝像頭24的第一角 度以拍攝駕駛員臉部,以及設置所述攝像頭24的第二角 度以拍攝方向盤3。 步驟S4,所述的設置模組200設置第一閥值以判斷駕駛員 是否處於清醒狀態。 步驟S6,所述的設置模組200設置劃分依據以將方向盤區 域劃分成多個部分。在本較佳實施方式中,所述的劃分 依據是根據經過方向盤3的圓心的互相垂直的兩條軸線將 該方向盤區域劃分為左上、左下、右上以及右下四個部 分(參考圖3所示的方向盤3示意圖)。 步驟S8,所述的設置模組200設置駕駛員左右手分別在方 向盤區域的標準位置以判斷是否合理駕駛等。在本較佳 實施方式中,所述的駕駛員左右手分別在方向盤區域的 標準位置是左手位於左上位置且右手位於右下位置,或 者左手位於左下位置且右手位於右上位置。 步驟S10,所述的設置模組200設置時間間隔以查看駕駛 員是否調整成合理駕駛。 在其他實施方式中,方向盤區域的劃分以及雙手在方向 盤區域的標準位置可根據用戶需求或個人習慣進行調整 098141156 表單編號A0101 第11頁/共28頁 0982070615-0 201119897 ,例如方向盤區域可分成九部分等。 [0049] 如圖5所示,是本發明駕駛監控方法的第一實施方式的流 程圖。首先,步驟S12,所述的啟動按鈕26在被按壓後發 送第一指令至所述控制模組202。 [0050] 步驟S14,所述控制模組202接收該第一指令並控制所述 攝像頭24移至第一角度並開啟對駕駛員的臉部進行拍攝 〇 [0051] 步驟S16,所述識別模組204獲取所拍攝的臉部影像,並 識別該臉部影像中的臉部區域。 [0052] 步驟S18,所述識別模組204從識別的臉部區域中計算出 眼睛區域,並計算所述眼睛區域的高度和長度之間的比 值。 [0053] 步驟S20,所述判斷模組206判斷所述比值是否大於第一 閥值。若所述比值大於第一閥值,表示該駕駛員處於清 醒狀態,流程返回至步驟S1 4。 [0054] 若所述比值小於或等於第一閥值,於步驟S22,所述判斷 模組206確定駕駛員處於非清醒狀態。 [0055] 步驟S24,所述預警模組208發出預警以提示駕駛員注意 ,該預警包括利用所述揚聲器28播放預先錄製的語音, 例如“請小心開車、注意安全”等語音提示。所述的預 警模組208還可進一步切斷油門4使得該汽車1減速並停下 來。用戶可根據個人要求對預警模組208的功能進行設置 ,例如僅選擇語音提示、僅切斷油門4、或者上述兩種的 098141156 表單編號A0101 第12頁/共28頁 0982070615-0 201119897 組合。 [0056] 如圖6所示,是本發明駕駛監控方法的第二實施方式的流 程圖。此第二實施方式的流程圖是基於如圖5所示的第一 實施方式的流程圖中的步驟S12至S22。 [0057] 首先’步驟S30 ’所述的判斷模組2〇6在確定駕駛員處於 非清醒狀態後發送第二指令至所述控制模組2〇2。 [0〇58]步驟S32,所述控制模組2〇2根據該第二指令控制所述攝 像頭24移至第二角度拍攝方向盤3的位置的第一影像。 [〇〇59]步驟S34,所述識別模組204獲取該第一影像,識別該第 —影像中的方向盤區域及手部區域。 [〇〇6〇]步驟S36,所述識別模組204依據劃分依據對所識別的方 向盤區域進行劃分,並確定該手部區域所在的方向盤區 域的位置。 C〇〇61]步驟S38,所述判斷模組206判斷所確定的手部區域所佔 的方向盤區域的位置是否符合設置的標準位置,從而判 斷該駕驶員當前是否合理駕駛。 [0062]若所確定的手部區域所佔的方向盤區域的位置符合設置 的標準位置,則可確定該駕駛員當前為合理駕駛,流程 結束。 ⑽63]若所確定的手部區織所佔的方向盤區域的位置符合設置 的標準位置,於步驟S4〇,所述的判斷模組2〇6確定駕駛 員並非合理駕駛。 [0064] 098141156 步驟S42,所述的預警模組208發出預警以提示駕駛員注 表單編號A0101 第丨3頁/共28頁 0982070615-0 201119897 意,該預警包括利用所述揚聲器28播放預先錄製的語音 所述的預警模組208 ’還可進一步切斷油門4使得該汽車1 減速並停下來。用戶可根據個人要求對預警模組208的功 能進行設置。 [0065] 如圖7所示,是本發明駕駛監控方法的第三實施方式的流 程圖。此第二實施方式的流程圖是基於如圖6所示的第二 實施方式的流程圖中的步驟S30至S40。 [0066] [0067] [0068] [0069] 步驟S50 ’在確定駕駛員並非合理駕驶時,所述計時器 209啟動進行計時,該預警模組208也發出語音預警。 步驟S52,所述控制模組202在計時達到所設置的時間間 隔後在第二角度拍攝方向盤3的位置的第二影像。 步驟S54,所述識別模組204獲取該第二影像,識別該第 二影像中的方向盤區域及手部區域。 步驟S56,所述識別模組204依據劃分依據對所識別的方 向盤區域進行劃分,並確定該手部區域所在的方向盤區 域的位置。[0040] The judgment amount m, _ is determined according to whether the position of the hand wheel area of the hand conforms to the set standard position, ^ := whether after the warning and after the set time interval '[0041] 119141156 of the steering wheel area If the standard position is set, then the foreign judgment module 206 determines 1 form number A0101 page / total 28 page 0982070615-0 201119897 [0044] [0044] [0046] [0046] [0047] 0048] After the set time interval is still not adjusted to drive reasonably, the early warning module 208 is further configured to cut off the throttle 4 when determining that the driver is still unreasonably driving, thereby causing the car 1 to slow down and stop. . As shown in FIG. 4, it is a flow chart of parameter setting of the driving monitoring method of the present invention. In step S2, the setting module 200 sets a first angle of the camera 24 to photograph a driver's face, and sets a second angle of the camera 24 to photograph the steering wheel 3. In step S4, the setting module 200 sets a first threshold to determine whether the driver is in an awake state. In step S6, the setting module 200 sets a division basis to divide the steering wheel area into a plurality of parts. In the preferred embodiment, the division is based on dividing the steering wheel area into four parts of upper left, lower left, upper right, and lower right according to two mutually perpendicular axes passing through the center of the steering wheel 3 (refer to FIG. 3). Steering wheel 3 schematic). In step S8, the setting module 200 sets the standard position of the left and right hands of the driver in the direction of the steering wheel area to determine whether the driving is reasonable or the like. In the preferred embodiment, the standard position of the left and right hands of the driver in the steering wheel area is that the left hand is in the upper left position and the right hand is in the lower right position, or the left hand is in the lower left position and the right hand is in the upper right position. In step S10, the setting module 200 sets a time interval to check whether the driver adjusts to a reasonable driving. In other embodiments, the division of the steering wheel area and the standard position of the hands in the steering wheel area can be adjusted according to user needs or personal habits. 098141156 Form No. A0101 Page 11 / 28 pages 0982070615-0 201119897 , for example, the steering wheel area can be divided into nine Part and so on. [0049] As shown in FIG. 5, it is a flowchart of the first embodiment of the driving monitoring method of the present invention. First, in step S12, the start button 26 sends a first command to the control module 202 after being pressed. [0050] Step S14, the control module 202 receives the first command and controls the camera 24 to move to the first angle and starts shooting the face of the driver. [0051] Step S16, the recognition module 204 acquires the captured facial image and recognizes the facial region in the facial image. [0052] Step S18, the recognition module 204 calculates an eye region from the recognized face region, and calculates a ratio between the height and the length of the eye region. [0053] Step S20, the determining module 206 determines whether the ratio is greater than a first threshold. If the ratio is greater than the first threshold, indicating that the driver is in the awake state, the flow returns to step S14. [0054] If the ratio is less than or equal to the first threshold, in step S22, the determining module 206 determines that the driver is in a non-awake state. [0055] Step S24, the early warning module 208 issues an early warning to prompt the driver to pay attention. The early warning includes playing the pre-recorded voice by using the speaker 28, for example, “Please drive carefully, pay attention to safety” and other voice prompts. The pre-alarm module 208 can further cut off the throttle 4 to cause the car 1 to slow down and stop. The user can set the function of the early warning module 208 according to individual requirements, for example, only select the voice prompt, only cut off the throttle 4, or the above two types of 098141156 form number A0101 page 12 / 28 pages 0982070615-0 201119897 combination. [0056] As shown in Fig. 6, a flow chart of a second embodiment of the driving monitoring method of the present invention. The flowchart of this second embodiment is based on steps S12 to S22 in the flowchart of the first embodiment shown in Fig. 5. [0057] First, the determination module 2〇6 described in the 'step S30' sends a second command to the control module 2〇2 after determining that the driver is in the non-awake state. [058] In step S32, the control module 2〇2 controls the first image of the position where the camera head 24 is moved to the second angle shooting steering wheel 3 according to the second command. [〇〇59] Step S34, the recognition module 204 acquires the first image, and identifies a steering wheel area and a hand area in the first image. [〇〇6〇] In step S36, the recognition module 204 divides the identified steering wheel area according to the division basis, and determines the position of the steering wheel area where the hand area is located. In step S38, the determination module 206 determines whether the determined position of the steering wheel area occupied by the hand area conforms to the set standard position, thereby judging whether the driver is currently driving reasonably. [0062] If the determined position of the steering wheel area occupied by the hand area conforms to the set standard position, it can be determined that the driver is currently driving reasonably and the flow ends. (10) 63] If the determined position of the steering wheel area occupied by the hand region conforms to the set standard position, the determining module 2〇6 determines that the driver is not driving reasonably in step S4. [0064] 098141156 Step S42, the early warning module 208 issues an early warning to prompt the driver to note the form number A0101, page 3/28 pages 0992070615-0 201119897, the warning includes playing the pre-recorded with the speaker 28. The alert module 208' described in the voice can further cut off the throttle 4 to cause the car 1 to slow down and stop. The user can set the function of the early warning module 208 according to individual requirements. [0065] As shown in Fig. 7, is a flow chart of a third embodiment of the driving monitoring method of the present invention. The flowchart of this second embodiment is based on steps S30 to S40 in the flowchart of the second embodiment shown in Fig. 6. [0069] [0069] Step S50' When the driver is determined not to drive reasonably, the timer 209 initiates timing, and the alert module 208 also issues a voice alert. In step S52, the control module 202 captures the second image of the position of the steering wheel 3 at the second angle after the time interval is reached. In step S54, the recognition module 204 acquires the second image, and identifies a steering wheel area and a hand area in the second image. In step S56, the identification module 204 divides the identified steering wheel area according to the division basis, and determines the location of the steering wheel area where the hand area is located.

[0070] 步驟S58 ’所述判斷模㈣6判斷所確定的手部區域所佔 的方向盤區域的位置是否符合設置的標準位置,從而判 斷該駕駛員是否在預警後且經過設置的時間間隔後調整 為合理駕駛。 [0071] 098141156 若所衫的手部區域所㈣ 的標準位置,則確定#产 付口6: &錢駛貝在《後錄過設置 間間隔後調整為合理駕駛,流程結束。 編號 A0101 第14 頁/共28頁 0982070615-0 201119897 [0072] 若所確定的手部區域所佔的方向盤區域的位置不符合設 置的標準位置,於步驟S60,所述判斷模組206確定該駕 駛員在預警後且經過設置的時間間隔後仍然沒有調整為 合理駕駛,所述預警模組208切斷油門4,從而使得該汽 車1減速並停下來,然後,流程結束。 [0073] 綜上所述,本發明符合發明專利要件,爰依法提出專利 申請。惟,以上所述者僅為本發明之較佳實施方式,本 發明之範圍並不以上述實施方式為限,舉凡熟悉本案技 藝之人士援依本發明之精神所作之等效修飾或變化,皆 〇 應涵蓋於以下申請專利範圍内。 【圖式簡單說明】 [0074] 圖1是本發明駕駛監控裝置的較佳實施方式的運行環境圖 〇 [0075] 圖2是本發明駕駛監控裝置的較佳實施方式的功能模組圖 〇 [0076] 圖3是本發明駕駛監控裝置的較佳實施方式的方向盤區域 〇 切分示意圖。 [0077] 圖4是本發明駕駛監控方法的參數設置流程圖。 [0078] 圖5是本發明駕駛監控方法的第一實施方式的流程圖。 [0079] 圖6是本發明駕駛監控方法的第二實施方式的流程圖。 [0080] 圖7是本發明駕駛監控方法的第三實施方式的流程圖。 【主要元件符號說明】 [0081] 汽車 1 098141156 表單編號A0101 第15頁/共28頁 0982070615-0 201119897 [0082] 駕駛監控裝置2 [0083] 處理器22 [0084] 攝像頭2 4 [0085] 啟動按鈕 26 [0086] 揚聲器28 [0087] 儲存裝置 29 [0088] 設置模組 200 [0089] 控制模組 202 [0090] 識別模組 204 [0091] 判斷模組 206 [0092] 預警模組 208 [0093] 計時器209 [0094] 方向盤3 [0095] 油門4 098141156 表單編號A0101 第16頁/共28頁 0982070615-0[0070] Step S58' The determination module (4) 6 determines whether the position of the steering wheel area occupied by the determined hand area conforms to the set standard position, thereby determining whether the driver is adjusted after the warning period and after the set time interval is Drive reasonably. [0071] 098141156 If the standard position of the hand area of the shirt (4) is determined, it is determined that the payout port 6: & money is adjusted to a reasonable driving after the interval between the settings is recorded, and the process ends. No. A0101, page 14 / page 28 0982070615-0 201119897 [0072] If the determined position of the steering wheel area occupied by the hand area does not meet the set standard position, the determining module 206 determines the driving in step S60. After the warning and after the set time interval has not been adjusted to drive reasonably, the warning module 208 cuts off the throttle 4, causing the car 1 to decelerate and stop, and then the process ends. [0073] In summary, the present invention complies with the requirements of the invention patent and submits a patent application according to law. However, the above description is only the preferred embodiment of the present invention, and the scope of the present invention is not limited to the above-described embodiments, and equivalent modifications or variations made by those skilled in the art in light of the spirit of the present invention are 〇 should be covered by the following patent application. BRIEF DESCRIPTION OF THE DRAWINGS [0074] FIG. 1 is a diagram showing the operational environment of a preferred embodiment of the driving monitoring device of the present invention. [0075] FIG. 2 is a functional block diagram of a preferred embodiment of the driving monitoring device of the present invention. 3076 is a schematic diagram of a steering wheel region 〇 segmentation of a preferred embodiment of the driving monitoring device of the present invention. 4 is a flow chart of parameter setting of the driving monitoring method of the present invention. 5 is a flow chart of a first embodiment of the driving monitoring method of the present invention. 6 is a flow chart of a second embodiment of the driving monitoring method of the present invention. 7 is a flow chart of a third embodiment of the driving monitoring method of the present invention. [Main component symbol description] [0081] Automobile 1 098141156 Form No. A0101 Page 15 / Total 28 page 0992070615-0 201119897 [0082] Driving monitoring device 2 [0083] Processor 22 [0084] Camera 2 4 [0085] Start button 26 [0086] speaker 28 [0087] storage device 29 [0088] control module 202 [0089] identification module 204 [0091] determination module 206 [0092] early warning module 208 [0093] Timer 209 [0094] Steering wheel 3 [0095] Throttle 4 098141156 Form number A0101 Page 16 of 28 page 0982070615-0

Claims (1)

201119897 七、申請專利範圍: 1 . 一種駕駛監控裝置,該駕駛監控裝置安裝於汽車内,所述 駕駛監控裝置包括: 攝像頭,用於拍攝影像; 設置模組,用於設置所述攝像頭的第一角度以拍攝駕駛員 臉部,設置第一閥值以判斷駕駛員是否處於清醒狀態,設 置所述攝像頭的第二角度以拍攝方向盤,設置劃分依據將 方向盤區域劃分成多個部分,並設置駕駛員左右手分別在 方向盤區域的標準位置以判斷是否合理駕駛; Ο 啟動按鈕,用於在被按壓後發送第一指令; 控制模組,用於接收該第一指令並控制所述攝像頭移至第 一角度並開啟對駕駛人的臉部進行拍攝; 識別模組,用於獲取所拍攝的臉部影像,識別該臉部影像 中的臉部區域,從識別的臉部區域中計算出眼睛區域,並 計算所述眼睛區域的高度和長度之間的比值; 判斷模組,用於在所述比值小於或等於第一閥值時確定駕 駛員處於非清醒狀態,並發送第二指令至所述控制模組; 〇 所述控制模組,還用於根據該第二指令控制所述攝像頭移 至第二角度拍攝方向盤位置的第一影像; 所述識別模組,還用於獲取第一影像,識別該第一影像中 的方向盤區域及手部區域,依據劃分依據對所識別的方向 盤區域進行劃分,並確定該手部區域所在的方向盤區域的 位置; 所述判斷模組,還用於判斷所確定的手部區域所佔的方向 098141156 表單編號A0101 第17頁/共28頁 0982070615-0 201119897 盤區域的位置是否符合設置的標準位置,從而判斷該駕駛 員當前是否合理駕駛;及 預警模組,用於在確定駕駛員並非合理駕駛時發出預警以 提示駕駛員注意。 2 .如申請專利範圍第1項所述的駕駛監控裝置,所述的劃分 依據是根據經過方向盤圓心的互相垂直的兩條轴線將該方 向盤區域劃分為左上、左下 '右上以及右下四個部分,並 且所述的駕駛員左右手分別在方向盤區域的標準位置是左 手位於左上位置且右手位於右下位置,或者左手位於左下 位置且右手位於右上位置。 3 .如申請專利範圍第1項所述的駕駛監控裝置,所述設置模 組還用於設置一個比例,所述的識別模組還用於在駕駛員 的左手或右手在方向盤區域的一個位置所佔的比例超過該 設置的比例時^確定該位置即為該左手或右手所在的方向 盤區域的位置。 4 .如申請專利範圍第1項所述的駕駛監控裝置,所述駕駛監 控裝置還包括揚聲器,所述預警模組用於令該揚聲器發出 預警信號或播放預先錄製的語音以提示駕駛員注意。 5 .如申請專利範圍第1項所述的駕駛監控裝置,所述駕駛監 控裝置還包括計時器: 所述設置模組,還用於設置一個時間間隔; 所述計時器,用於在確定駕駛員並非合理駕駛時啟動進行 計時; 所述控制模組,還用於在計時達到所設置的時間間隔後在 第二角度拍攝方向盤位置的第二影像; 所述識別模組,還用於獲取該第二影像,識別該第二影像 098141156 表單編號A0101 第18頁/共28頁 0982070615-0 201119897 中的方向盤區域及手部區域,依據劃分依據對所識別的方 向盤區域進行劃分,並確定該手部區域所在的方向盤區域 的位置; 所述判斷模組,還用於判斷所確定的手部區域所佔的方向 盤區域的位置是否符合設置的標準位置,從而判斷該駕駛 員當前是否合理駕駛;及 所述預警模組,還用於在確定駕駛員並非合理駕駛時切斷 油門。 6 . —種駕駛監控方法,應用於汽車的駕駛監控裝置中,該駕 駛監控裝置包括攝像頭以及啟動按鈕,該方法包括: 設置所述攝像頭的第一角度以拍攝駕駛員臉部,設置第一 閥值以判斷駕驶員是否處於清醒狀態,設置所述攝像頭的 第二角度以拍攝方向盤,設置劃分依據將方向盤區域劃分 成多個部分,並設置駕駛員左右手分別在方向盤區域的標 準位置以判斷是否合理駕駛; 在所述啟動按鈕被按壓後發送第一指令; 根據該第一指令控制所述攝像頭移至第一角度並開啟對駕 駛員的臉部進行拍攝; 獲取所拍攝的臉部影像,識別該影像中的臉部區域,並從 識別的臉部區域中計算出眼睛區域; 計算所述眼睛區域的高度和長度之間的比值,在所述比值 小於或等於第一閥值時確定該駕駛員處於非清醒狀態,並 發送第二指令; 根據該第二指令控制所述攝像頭移至第二角度拍攝方向盤 位置的第一影像; 獲取該第一影像,識別該第一影像中的方向盤區域及手部 098141156 表單編號A0101 第19頁/共28頁 0982070615-0 201119897 區域,依據劃分依據對所識別的方向盤區域進行劃分,並 確定該手部區域所在的方向盤區域的位置; 判斷所確定的手部區域所佔的方向盤區域的位置是否符合 設置的標準位置,從而判斷該駕駛員當前是否合理駕駛; 及 在確定駕駛員並非合理駕駛時發出預警以提示駕駛員注意 0 7 .如申請專利範圍第6項所述的駕駛監控方法,所述的劃分 依據是根據經過方向盤圓心的互相垂直的兩條軸線將該方 向盤區域劃分為左上、左下、右上以及右下四個部分,並 且所述的駕駛員左右手分別在方向盤區域的標準位置是左 手位於左上位置且右手位於右下位置,或者左手位於左下 位置且右手位於右上位置。 8 .如申請專利範圍第6項所述的駕駛監控方法,該方法還包 括: 設置一個比例;及 在駕駛員的左手或右手在方向盤區域的一個位置所佔的比 例超過該設置的比例時,確定該位置即為該左手或右手所 在的方向盤區域的位置。 9 .如申請專利範圍第6項所述的駕駛監控方法,所述發出的 預警包括通過駕駛監控裝置的揚聲器發出預警信號或播放 預先錄製的語音以提示駕駛員注意。 10 .如申請專利範圍第6項所述的駕駛監控方法,該方法還包 括: 設置一個時間間隔; 在確定駕駛員並非合理駕駛時啟動進行計時; 098141156 表單編號A0101 第20頁/共28頁 0982070615-0 201119897 在計時達到所設置的時間間隔後在第二角度拍攝方向盤位 置的第二影像; 獲取該第二影像,識別該第二影像中的方向盤區域及手部 區域,依據劃分依據對所識別的方向盤區域進行劃分,並 確定該手部區域所在的方向盤區域的位置; 判斷所確定的手部區域所佔的方向盤區域的位置是否符合 設置的標準位置,從而判斷該駕駛員當前是否合理駕駛; 及 在確定駕駛員並非合理駕駛時切斷油門。 ❹ Ο 098141156 表單編號Α0101 第21頁/共28頁 0982070615-0201119897 VII. Patent application scope: 1. A driving monitoring device installed in a car, the driving monitoring device comprising: a camera for capturing an image; and a setting module for setting the first of the camera Angle to capture the driver's face, set the first threshold to determine whether the driver is in the awake state, set the second angle of the camera to shoot the steering wheel, set the division basis to divide the steering wheel area into multiple parts, and set the driver The left and right hands are respectively in the standard position of the steering wheel area to determine whether the driving is reasonable; Ο the start button is used to send the first command after being pressed; the control module is configured to receive the first command and control the camera to move to the first angle And starting to shoot the driver's face; the recognition module is configured to acquire the captured facial image, identify the facial region in the facial image, calculate the eye region from the recognized facial region, and calculate a ratio between a height and a length of the eye region; a determination module for using the ratio Or determining that the driver is in a non-awake state, and sending a second command to the control module; or the control module is further configured to control the camera to move to the second according to the second instruction The first image of the steering wheel position is captured by the angle; the identification module is further configured to acquire the first image, identify the steering wheel area and the hand area in the first image, and divide the identified steering wheel area according to the division basis, and Determining the position of the steering wheel area where the hand area is located; the determining module is further configured to determine the direction of the determined hand area 098141156 Form No. A0101 Page 17 / 28 pages 0982070615-0 201119897 Whether the position meets the set standard position to determine whether the driver is currently driving reasonably; and an early warning module for alerting the driver when determining that the driver is not driving reasonably. 2. The driving monitoring device according to claim 1, wherein the division is based on dividing the steering wheel area into upper left and lower left 'upper right and lower right according to two mutually perpendicular axes passing through the center of the steering wheel. In part, and the standard position of the left and right hands of the driver in the steering wheel area is that the left hand is in the upper left position and the right hand is in the lower right position, or the left hand is in the lower left position and the right hand is in the upper right position. 3. The driving monitoring device according to claim 1, wherein the setting module is further configured to set a ratio, and the identification module is further used for a position of the driver's left or right hand in the steering wheel area. When the proportion exceeds the set ratio, it is determined that the position is the position of the steering wheel area where the left or right hand is located. 4. The driving monitoring device of claim 1, wherein the driving monitoring device further comprises a speaker, the warning module for causing the speaker to emit an early warning signal or to play a pre-recorded voice to alert the driver. 5. The driving monitoring device of claim 1, wherein the driving monitoring device further comprises a timer: the setting module is further configured to set a time interval; and the timer is used to determine driving The controller is not used to start timing when driving reasonably; the control module is further configured to capture a second image of the steering wheel position at a second angle after the time interval is reached; the identification module is further configured to acquire the second image The second image identifies the steering wheel area and the hand area in the second image 098141156 Form No. A0101, page 18/28 pages 0982070615-0 201119897, and divides the identified steering wheel area according to the division basis, and determines the hand The position of the steering wheel area where the area is located; the determining module is further configured to determine whether the position of the steering wheel area occupied by the determined hand area meets the set standard position, thereby determining whether the driver is currently driving reasonably; The early warning module is also used to cut off the throttle when it is determined that the driver is not driving reasonably. 6. A driving monitoring method for use in a driving monitoring device for a vehicle, the driving monitoring device comprising a camera and a start button, the method comprising: setting a first angle of the camera to photograph a driver's face, and setting a first valve The value is used to determine whether the driver is in the awake state, the second angle of the camera is set to photograph the steering wheel, the division direction is set to divide the steering wheel area into a plurality of parts, and the standard position of the left and right hands of the driver in the steering wheel area is set to determine whether it is reasonable. Driving; transmitting a first command after the start button is pressed; controlling the camera to move to a first angle according to the first command and starting to shoot a face of the driver; acquiring the captured face image, identifying the a face region in the image, and calculating an eye region from the recognized face region; calculating a ratio between a height and a length of the eye region, determining the driver when the ratio is less than or equal to a first threshold In a non-awake state, and sending a second instruction; controlling the camera according to the second instruction Moving the head to the second image to capture the first image of the steering wheel position; acquiring the first image, identifying the steering wheel area and the hand 098141156 in the first image, Form No. A0101, page 19/28 pages 0992070615-0 201119897 area, according to Dividing the division of the identified steering wheel area and determining the position of the steering wheel area where the hand area is located; determining whether the determined position of the steering wheel area occupied by the hand area conforms to the set standard position, thereby determining the driver Whether it is reasonable to drive at present; and to provide an early warning to prompt the driver to pay attention when determining that the driver is not driving reasonably. The driving monitoring method described in claim 6 is based on mutual mutual passing through the center of the steering wheel. The two vertical axes divide the steering wheel area into four parts: upper left, lower left, upper right, and lower right, and the standard position of the left and right hands of the driver in the steering wheel area is that the left hand is in the upper left position and the right hand is in the lower right position, or The left hand is in the lower left position and the right hand is in the upper right position. . 8. The driving monitoring method according to claim 6, wherein the method further comprises: setting a ratio; and when the proportion of the left or right hand of the driver in a position of the steering wheel area exceeds the set ratio, Determining the location is the location of the steering wheel area where the left or right hand is located. 9. The driving monitoring method of claim 6, wherein the issuing the warning comprises issuing an early warning signal through a speaker of the driving monitoring device or playing a pre-recorded voice to alert the driver. 10. The driving monitoring method according to claim 6, wherein the method further comprises: setting a time interval; starting timing when determining that the driver is not driving reasonably; 098141156 Form No. A0101 Page 20 of 28 0982070615 -0 201119897 capturing a second image of the steering wheel position at a second angle after the time interval reaches the set time interval; acquiring the second image, identifying the steering wheel area and the hand area in the second image, and identifying according to the division basis Dividing the steering wheel area and determining the position of the steering wheel area where the hand area is located; determining whether the determined position of the steering wheel area occupied by the hand area conforms to the set standard position, thereby determining whether the driver is currently driving reasonably; And cut off the throttle when it is determined that the driver is not driving reasonably. ❹ 098 098141156 Form No. Α0101 Page 21 of 28 0982070615-0
TW098141156A 2009-12-02 2009-12-02 Monitor device and method for monitoring driving TWI478836B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW098141156A TWI478836B (en) 2009-12-02 2009-12-02 Monitor device and method for monitoring driving

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW098141156A TWI478836B (en) 2009-12-02 2009-12-02 Monitor device and method for monitoring driving

Publications (2)

Publication Number Publication Date
TW201119897A true TW201119897A (en) 2011-06-16
TWI478836B TWI478836B (en) 2015-04-01

Family

ID=45044999

Family Applications (1)

Application Number Title Priority Date Filing Date
TW098141156A TWI478836B (en) 2009-12-02 2009-12-02 Monitor device and method for monitoring driving

Country Status (1)

Country Link
TW (1) TWI478836B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI582707B (en) * 2012-01-19 2017-05-11 Utechzone Co Ltd In-vehicle eye control method

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1937763A (en) * 2005-09-19 2007-03-28 乐金电子(昆山)电脑有限公司 Sleepy sensing device for mobile communication terminal and its sleepy driving sensing method
JP4922715B2 (en) * 2006-09-28 2012-04-25 タカタ株式会社 Occupant detection system, alarm system, braking system, vehicle

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI582707B (en) * 2012-01-19 2017-05-11 Utechzone Co Ltd In-vehicle eye control method

Also Published As

Publication number Publication date
TWI478836B (en) 2015-04-01

Similar Documents

Publication Publication Date Title
CN102069710B (en) Device and method for monitoring driving
TWI434239B (en) Pre-warning method for rear coming vehicle which switches lane and system thereof
JP6303907B2 (en) Driver monitoring device
WO2019029195A1 (en) Driving state monitoring method and device, driver monitoring system, and vehicle
JP5125745B2 (en) Driving support device and driving support method
JP5082834B2 (en) Aside look detection device and method, and program
US20160262682A1 (en) Driver monitoring apparatus
JP2000268297A (en) Safety drive evaluation device
JP2006308375A (en) Infrared ray using type eye position detection device
TW201621760A (en) Method and device for indicating a passenger hailing a vehicle
JP5830944B2 (en) Vehicle driving support apparatus and vehicle driving support method
WO2013157466A1 (en) Smoking detection device, method and program
WO2012160830A1 (en) Sleepiness-estimating device and sleepiness-estimating method
US20130257620A1 (en) Device and method for detecting driver's attention through interactive voice questioning
CN112238859A (en) Driving support device
US20140118131A1 (en) Monitoring and warning system for vehicles
JP2008171065A (en) Sleepiness detection device
KR20190105308A (en) Apparatus and method for preventing pedestrian accidents for vehicle
JP2005108033A (en) Driver condition determination device and method
JPH09267686A (en) Device for sensing braking of preceding vehicle and vehicle control device
JP2011145922A (en) Vehicle speed control device
TWI478836B (en) Monitor device and method for monitoring driving
CN108859967B (en) Intelligent interior rearview mirror device for vehicle and using method thereof
JP2020069898A (en) Vehicle control system
KR102494530B1 (en) Camera Apparatus Installing at a Car for Detecting Drowsy Driving and Careless Driving and Method thereof

Legal Events

Date Code Title Description
MM4A Annulment or lapse of patent due to non-payment of fees