TW201416998A - User recognition and confirmation device and method, and central control system for vehicles using the same - Google Patents

User recognition and confirmation device and method, and central control system for vehicles using the same Download PDF

Info

Publication number
TW201416998A
TW201416998A TW101138995A TW101138995A TW201416998A TW 201416998 A TW201416998 A TW 201416998A TW 101138995 A TW101138995 A TW 101138995A TW 101138995 A TW101138995 A TW 101138995A TW 201416998 A TW201416998 A TW 201416998A
Authority
TW
Taiwan
Prior art keywords
user
image frame
confirmation
unit
expression
Prior art date
Application number
TW101138995A
Other languages
Chinese (zh)
Other versions
TWI490792B (en
Inventor
Liang-Chi Chiu
Yu-Han Chen
Ming-Tsan Kao
Original Assignee
Pixart Imaging Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Pixart Imaging Inc filed Critical Pixart Imaging Inc
Priority to TW101138995A priority Critical patent/TWI490792B/en
Publication of TW201416998A publication Critical patent/TW201416998A/en
Application granted granted Critical
Publication of TWI490792B publication Critical patent/TWI490792B/en

Links

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R25/00Fittings or systems for preventing or indicating unauthorised use or theft of vehicles
    • B60R25/20Means to switch the anti-theft system on or off
    • B60R25/25Means to switch the anti-theft system on or off using biometry
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/59Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/174Facial expression recognition
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00Indexing scheme relating to image or video recognition or understanding
    • G06V2201/10Recognition assisted with metadata

Abstract

There is provided a user recognition and confirmation device including an image sensor, a face recognition unit, a display unit and an expression recognition unit. The image sensor is configured to capture a first image frame and a second image frame. The face recognition unit is configured to recognize a user ID according to the first image frame. The display unit shows an ID information of the user ID. The expression recognition unit is configured to confirm a user expression according to the second image frame and to output a confirm signal. There is further provided a user recognition and confirmation method and a central control system for vehicles.

Description

使用者辨識及確認裝置、方法以及使用該裝置之車用中央控制系統 User identification and confirmation device, method and vehicle central control system using the same

本發明係關於一種互動系統,特別是關於一種使用者辨識及確認裝置、方法以及使用該裝置之車用中央控制系統。 The present invention relates to an interactive system, and more particularly to a user identification and validation device, method, and vehicle central control system using the same.

目前生物辨識技術已廣泛應用於身分辨識,一般生物資料(biological information)例如包括臉部、聲紋、指紋及瞳孔等,其中由於人臉辨識技術不需使用者採取任何相應動作,因此使用上最為方便。 At present, biometric technology has been widely used in identity recognition. Generally, biological information includes face, voiceprint, fingerprint and pupil, etc., because face recognition technology does not require the user to take any corresponding action, so the most used Convenience.

例如WO2011/121688公開了一種人臉辨識裝置,包含一取像單元、一區域偵測單元、一特徵擷取單元、一距離估測單元及一特徵更新單元。該區域偵測單元從該取像單元所擷取的影像中偵測一預設區域;該特徵擷取單元擷取該預設區域之一特徵量;該距離估測單元估測該取像單元與該預設區域間之一距離;該特徵更新單元相對應該距離更新該特徵量,藉以達成高辨識精度。 For example, WO2011/121688 discloses a face recognition device, which comprises an image capturing unit, an area detecting unit, a feature capturing unit, a distance estimating unit and a feature updating unit. The area detecting unit detects a preset area from the image captured by the image capturing unit; the feature capturing unit captures a feature quantity of the preset area; the distance estimating unit estimates the image capturing unit a distance from the preset area; the feature update unit updates the feature quantity corresponding to the distance, thereby achieving high recognition accuracy.

表情辨識技術為目前發展中的新技術,可用以偵測不同心情狀態的表情,例如生氣、恐懼、厭惡、高興、無表情、悲傷和驚訝等。例如美國專利公開第2012169895揭示一種採用Hierarchical Temporal Memory(HTM)架構的辨識器的人臉影像擷取方法與 裝置,其辨識一目標影像以得到一表情狀態並可應用於數位相機、視訊攝影機(Web Cam)、網路攝影機(IP Cam)或監視攝影機等影像擷取裝置。 Expression recognition technology is a new technology in development that can be used to detect expressions of different mood states, such as anger, fear, disgust, happiness, expressionlessness, sadness and surprise. For example, US Patent Publication No. 2012169895 discloses a face image capturing method using an identifier of a Hierarchical Temporal Memory (HTM) architecture and The device recognizes a target image to obtain an expression state and can be applied to an image capturing device such as a digital camera, a Web Cam, an IP Cam, or a surveillance camera.

本發明據以提出一種使用者辨識及確認裝置、方法及使用該裝置之車用中央控制系統,其可先利用人臉辨識單元辨識出一使用者身分再利用表情辨識單元確認該使用者身分的正確性,藉此使用者無須以肢體進行任何操作即可完成辨識及確認程序。 The present invention provides a user identification and confirmation device and method, and a vehicle central control system using the same, which can first recognize a user identity by using a face recognition unit and then use the expression recognition unit to confirm the identity of the user. Correctness, whereby the user can complete the identification and confirmation process without any manipulation of the limb.

本發明之一目的在提供一種使用者辨識及確認裝置、方法以及使用該裝置之車用中央控制系統,其可利用人臉辨識技術辨識使用者身分並利用表情辨識技術進行身分確認。 It is an object of the present invention to provide a user identification and confirmation device and method, and a vehicle central control system using the same, which can recognize a user identity using face recognition technology and perform identity recognition using an expression recognition technology.

本發明另一目的在提供一種使用者辨識及確認裝置、方法以及使用該裝置之車用中央控制系統,其可應用於各種車用電子裝置的自動設定。 Another object of the present invention is to provide a user identification and confirmation device and method, and a vehicle central control system using the same, which can be applied to automatic setting of various vehicle electronic devices.

本發明提供一種使用者辨識及確認裝置,包含一影像感測單元、一人臉辨識單元、一顯示單元及一表情辨識單元。該影像感測單元用以擷取一第一影像圖框及一第二影像圖框。該人臉辨識單元用以根據該第一影像圖框辨識一使用者身分。該顯示單元顯示該使用者身分之一身分資訊。該表情辨識單元用以根據該第二影像圖框確認一使用者表情並輸 出一確認信號。 The invention provides a user identification and confirmation device, comprising an image sensing unit, a face recognition unit, a display unit and an expression recognition unit. The image sensing unit is configured to capture a first image frame and a second image frame. The face recognition unit is configured to identify a user identity according to the first image frame. The display unit displays one identity information of the user identity. The expression recognition unit is configured to confirm a user expression and lose according to the second image frame A confirmation signal is issued.

本發明另提供一種車用中央控制系統,包含一影像感測單元、一人臉辨識單元、一顯示單元、一表情辨識單元及一控制單元。該影像感測單元用以擷取一第一影像圖框及一第二影像圖框。該人臉辨識單元用以根據該第一影像圖框辨識一使用者身分。該顯示單元顯示該使用者身分之一身分資訊。該表情辨識單元用以根據該第二影像圖框確認一使用者表情並輸出一確認信號。該控制單元根據該確認信號讀取該使用者身分相關之一駕駛設定。 The invention further provides a central control system for a vehicle, comprising an image sensing unit, a face recognition unit, a display unit, an expression recognition unit and a control unit. The image sensing unit is configured to capture a first image frame and a second image frame. The face recognition unit is configured to identify a user identity according to the first image frame. The display unit displays one identity information of the user identity. The expression recognition unit is configured to confirm a user expression according to the second image frame and output a confirmation signal. The control unit reads one of the driver settings related to the user identity based on the confirmation signal.

本發明另提供一種使用者辨識及確認方法,包含下列步驟:以一影像感測單元擷取一第一影像圖框;根據該第一影像圖框辨識一使用者身分;以一顯示單元顯示該使用者身分之一身分資訊;以該影像感測單元擷取一第二影像圖框;根據該第二影像圖框確認一使用者表情並產生一確認信號;以及根據該確認信號控制至少一電子裝置。 The present invention further provides a user identification and confirmation method, comprising the steps of: capturing a first image frame by an image sensing unit; identifying a user identity according to the first image frame; displaying the content by a display unit One of the identity information of the user; the second image frame is captured by the image sensing unit; a user's expression is confirmed according to the second image frame and a confirmation signal is generated; and at least one electronic device is controlled according to the confirmation signal Device.

一實施例中,該人臉辨識單元另可判斷該第一影像圖框中是否存在一使用者及/或判斷該第一影像圖框中複數使用者中一欲辨識使用者。 In one embodiment, the face recognition unit may further determine whether a user exists in the first image frame and/or determine that one of the plurality of users in the first image frame is to identify the user.

一實施例中,該使用者辨識及確認裝置另包含一儲存單元用以儲存至少一使用者之身分資訊、使用者表情相關的表情資料以及設定資訊。 In one embodiment, the user identification and confirmation device further includes a storage unit for storing at least one user identity information, user expression related expression data, and setting information.

一實施例中,該顯示單元可透過畫面及/或聲音顯示該身分資訊。 In one embodiment, the display unit can display the identity information through a screen and/or a sound.

一實施例中,該使用者辨識及確認方法另包含下列步驟:以該影像感測單元擷取一第三影像圖框;根據該第三影像圖框確認一使用者表情並產生一儲存信號;以及根據該儲存信號更新該至少一電子裝置之一設定資訊。 In an embodiment, the user identification and confirmation method further comprises the steps of: capturing a third image frame by the image sensing unit; confirming a user expression according to the third image frame and generating a storage signal; And updating one of the setting information of the at least one electronic device according to the storage signal.

本發明之使用者辨識及確認裝置、方法及車用中央控制系統中,該使用者身分可根據一使用者表情自動確認而無須使用者透過肢體來完成。此外,當使用者欲更新設定資訊時,也可透過表情辨識來達成。 In the user identification and confirmation device, method and vehicle central control system of the present invention, the user identity can be automatically confirmed according to a user's expression without the user having to perform through the limb. In addition, when the user wants to update the setting information, it can also be achieved through expression recognition.

為了讓本發明之上述和其他目的、特徵、和優點能更明顯,下文將配合所附圖示,作詳細說明如下。於本發明之說明中,相同的構件係以相同的符號表示,於此合先敘明。 The above and other objects, features, and advantages of the present invention will become more apparent from the accompanying drawings. In the description of the present invention, the same components are denoted by the same reference numerals and will be described in the foregoing.

請參照第1圖所示,其顯示本發明實施例之使用者辨識及確認裝置之方塊示意圖。使用者辨識及確認裝置1包含一影像感測單元11、一人臉辨識單元12、一儲存單元13、一顯示單元14、一表情辨識單元15、一控制單元16及一電子裝置17。本實施例中,該人臉辨識單元12、該表情辨識單元15 及該控制單元16例如可由一數位處理器(DSP)等能夠處理數位資料的處理器來實現,而該數位處理器則預先內建有人臉辨識演算法及表情辨識演算法。 Please refer to FIG. 1 , which shows a block diagram of a user identification and confirmation device according to an embodiment of the present invention. The user identification and confirmation device 1 includes an image sensing unit 11, a face recognition unit 12, a storage unit 13, a display unit 14, an expression recognition unit 15, a control unit 16, and an electronic device 17. In this embodiment, the face recognition unit 12 and the expression recognition unit 15 The control unit 16 can be implemented, for example, by a processor capable of processing digital data such as a digital processor (DSP), and the digital processor is pre-built with a face recognition algorithm and an expression recognition algorithm.

本發明實施例之使用者辨識及確認裝置1用以先辨識一使用者身分後,再根據一使用者表情確認該使用者身分的正確與否,藉以相對控制至少一電子裝置17。一種實施例中,該使用者辨識及確認裝置1可應用於車用中央控制系統(central control system),以自動根據各使用者的使用習慣進行相對應的駕駛設定,所述駕駛設定例如包含一座位位置、一鏡面角度、一空調溫度、一音響設定、一方向盤高度、一燈光設定及一衛星定位設定至少其中之一,但並不以此為限。然而,本發明實施例之使用者辨識及確認裝置1並不限定適用於車用中央控制系統,只要是能夠讓使用者利用表情針對所辨識出的使用者身分進行確認之人機介面系統(human-machine interface system)均可。 The user identification and confirmation device 1 of the embodiment of the present invention is configured to identify a user identity first, and then confirm the correctness of the user identity according to a user expression, thereby relatively controlling at least one electronic device 17. In one embodiment, the user identification and confirmation device 1 can be applied to a central control system for automatically performing corresponding driving settings according to the usage habits of the users, and the driving settings include, for example, one. At least one of the seat position, a mirror angle, an air conditioning temperature, an audio setting, a steering wheel height, a lighting setting, and a satellite positioning setting are not limited thereto. However, the user identification and confirmation device 1 of the embodiment of the present invention is not limited to a central control system for a vehicle, and is a human-machine interface system that allows a user to confirm the recognized user identity by using an expression. -machine interface system).

該影像感測單元11例如可為一CCD影像感測器、一CMOS影像感測器或其他影像感測裝置,用以擷取一第一影像圖框F1及一第二影像圖框F2;其中,該影像感測單元11例如可以固定的取樣頻率擷取影像。例如第1圖中,該影像感測單元11以一視野FOV(field of view)擷取一使用者8的影像。 The image sensing unit 11 can be, for example, a CCD image sensor, a CMOS image sensor or other image sensing device for capturing a first image frame F1 and a second image frame F2. The image sensing unit 11 can capture an image, for example, at a fixed sampling frequency. For example, in FIG. 1 , the image sensing unit 11 captures an image of the user 8 by a field of view (FOV).

該人臉辨識單元12用以根據該第一影像圖框F1辨識一使用者身分;其中,該人臉辨識單元12利用演算法計算出人臉特徵後,則從該儲存單元13搜尋相對應的使用者身分並傳輸至該顯示單元14進行顯示。可以了解的是,該第一影像圖框F1包含一人臉影像時,該人臉辨識單元12才據以辨識該使用者身分。 The face recognition unit 12 is configured to identify a user identity according to the first image frame F1. After the face recognition unit 12 calculates the face feature by using an algorithm, the corresponding search result is searched from the storage unit 13. The user identity is transmitted to the display unit 14 for display. It can be understood that when the first image frame F1 includes a face image, the face recognition unit 12 can identify the user identity accordingly.

該顯示單元14例如可為一液晶顯示器(LC display)並包含一顯示畫面141及/或一揚聲裝置(speaker)142,如第2圖所示,用以顯示該使用者身分之一身分資訊ID,但亦可為其他種類顯示器。藉此,該顯示單元14可透過畫面及/或聲音顯示該身分資訊ID;其中,該畫面例如可為使用者的照片、圖像或文字等,並無特定限制。 The display unit 14 can be, for example, a liquid crystal display (LC display) and includes a display screen 141 and/or a speaker 142. As shown in FIG. 2, the display unit 14 displays information about the identity of the user. ID, but can also be other types of displays. The display unit 14 can display the identity information ID through a screen and/or a voice. The screen can be, for example, a user's photo, image, or text, and is not particularly limited.

該表情辨識單元15用以根據該第二影像圖框F2確認一使用者表情並輸出一確認信號Sc;其中,該表情辨識單元15利用演算法計算出表情特徵後,則從該儲存單元13搜尋該使用者表情相關的表情資料以進行比對。換句話說,該儲存單元13已儲存有至少一使用者之該身分資訊ID以及該使用者表情相關的表情資料。本發明實施例中,所述使用者表情較佳為一高興表情,但並不以此為限,亦可為生氣、恐懼、厭惡、驚訝、悲傷及無表情等,可 根據不同使用者自行設定。 The expression recognition unit 15 is configured to confirm a user expression according to the second image frame F2 and output a confirmation signal Sc. After the expression recognition unit 15 calculates the expression feature by using an algorithm, the expression recognition unit 15 searches for the expression unit. The expression data related to the expression of the user is compared. In other words, the storage unit 13 has stored the identity information ID of at least one user and the expression data related to the user's expression. In the embodiment of the present invention, the user's expression is preferably a happy expression, but not limited thereto, and may be angry, fearful, disgusted, surprised, sad, and expressionless. Set according to different users.

該控制單元16根據該確認信號Sc控制至少一電子裝置17之一設定狀態;其中,該設定狀態與該使用者身分相關而由相對應使用者所自行設定。該設定狀態可為該電子裝置17的運作設定,例如運作強度、運作時間及/或運作指向性等並預先儲存於該儲存單元13中;其中,該設定狀態根據不同的電子裝置17而有所不同。 The control unit 16 controls a setting state of at least one electronic device 17 according to the confirmation signal Sc; wherein the setting state is related to the user identity and is set by the corresponding user. The setting state may be an operation setting of the electronic device 17, such as operation intensity, operation time, and/or operational directivity, and is pre-stored in the storage unit 13; wherein the setting state is different according to different electronic devices 17 different.

如上所述,由於該第二影像圖框F2係提供該使用者8進行身分資訊ID的確認,因此該影像感測單元11於該顯示單元14顯示該身分資訊ID後,才擷取該第二影像圖框F2。然而,這並不限定成該影像感測單元11於擷取完該第一影像圖框F1後到該顯示單元14顯示該身分資訊ID期間,該影像感測單元11即停止運作,根據不同的應用該影像感測單元11在擷取該第一影像圖框F1後可被設定為持續運作或停止運作,直到該表情辨識單元15確認出該使用者表情為止。 As described above, since the second image frame F2 provides the user 8 to confirm the identity information ID, the image sensing unit 11 captures the second information after the display unit 14 displays the identity information ID. Image frame F2. However, this is not limited to the image sensing unit 11 stopping the operation of the image sensing unit 11 after the first image frame F1 is captured and the display unit 14 displays the identity information ID, according to different The image sensing unit 11 can be set to continue to operate or stop after the first image frame F1 is captured until the expression recognition unit 15 confirms the user's expression.

一實施例中,該影像感測單元11於該使用者辨識及確認裝置1完成開機程序後即開始持續運作以持續擷取該第一影像圖框F1。因此,該人臉辨識單元12較佳可另判斷該第一影像圖框F1中是否存在一使用者8;當該第一影像圖框F1中不存在任何使 用者影像,則重新擷取一張第一影像圖框F1;當該第一影像圖框F1存在一使用者影像,該人臉辨識單元12才根據該第一影像圖框F1辨識一使用者身分。 In an embodiment, the image sensing unit 11 continues to operate after the user identification and confirmation device 1 completes the booting process to continuously capture the first image frame F1. Therefore, the face recognition unit 12 preferably determines whether there is a user 8 in the first image frame F1; when there is no such thing in the first image frame F1 The user image captures a first image frame F1; when the user image is present in the first image frame F1, the face recognition unit 12 identifies a user according to the first image frame F1. identity.

一實施例中,該人臉辨識單元12可另判斷該第一影像圖框F1中複數使用者中一欲辨識使用者。例如當該第一影像圖框F1中同時存在有複數使用者影像時,該人臉辨識單元12可辨識一最靠近使用者為該欲辨識使用者;其中,所述最靠近例如可根據使用者影像之大小、對比及清晰度等方式來進行辨識。此外,該欲辨識使用者亦可根據其他方式認定,例如使用者影像的位置等。當該欲辨識使用者被辨識出後,該人臉辨識單元12才進行使用者身分辨識。此外,該人臉辨識單元12亦可對複數使用者均進行身分辨識並同時顯示於該顯示單元14上,然後使用者8再透過該表情辨識單元15確認一欲辨識使用者的身分資訊ID。 In an embodiment, the face recognition unit 12 can further determine that one of the plurality of users in the first image frame F1 is to identify the user. For example, when there are multiple user images in the first image frame F1, the face recognition unit 12 can identify a closest user as the user to be identified; wherein the closest is, for example, based on the user. The size, contrast and sharpness of the image are used for identification. In addition, the user who wants to identify may also be identified according to other methods, such as the location of the user's image. When the user to be identified is recognized, the face recognition unit 12 performs user identification. In addition, the face recognition unit 12 can also identify the plurality of users and display them on the display unit 14, and then the user 8 can confirm the identity information ID of the user to be identified through the expression recognition unit 15.

例如,當該使用者辨識及確認裝置1應用於一車用中央控制系統時,如第3圖所示,該影像感測單元11較佳相對於一駕駛座設置。例如,該影像感測單元11可設置於一後照鏡91或一中央控制台(central control panel)92,但並不以此為限,只要是設置於能夠擷取駕駛臉部影像的位置即可。 For example, when the user identification and confirmation device 1 is applied to a central control system for a vehicle, as shown in FIG. 3, the image sensing unit 11 is preferably disposed relative to a driver's seat. For example, the image sensing unit 11 can be disposed on a rear view mirror 91 or a central control panel 92, but is not limited thereto, as long as it is disposed at a position capable of capturing a driver's face image. can.

參照第1及3圖所示,使用本發明之使用者辨 識及確認裝置1之一車用中央控制系統包含該影像感測單元11、該人臉辨識單元12、該儲存單元13、該顯示單元14、該表情辨識單元15及該控制單元16。該影像感測單元11用以擷取該第一影像圖框F1及該第二影像圖框F2;該人臉辨識單元12用以根據該第一影像圖框F1辨識一使用者身分;該顯示單元14顯示該使用者身分之一身分資訊ID;該表情辨識單元15用以根據該第二影像圖框F2確認一使用者表情並輸出一確認信號Sc;該控制單元16則根據該確認信號Sc讀取該使用者身分相關的駕駛設定。本實施中,除了設定狀態係相關於駕駛設定,例如一座位、一鏡面、一空調、一音響、一方向盤、一燈光及一衛星定位系統至少其中之一的電子裝置的設定外,其餘運作方式均類似於第1圖及其相關說明,故於此不再贅述。因此,本實施例中該儲存單元13則至少儲存有至少一使用者之身分資訊、使用者表情相關的表情資料以及不同車用電子裝置相關的駕駛設定等。 Referring to Figures 1 and 3, the user using the present invention The vehicle central control system of the identification and confirmation device 1 includes the image sensing unit 11, the face recognition unit 12, the storage unit 13, the display unit 14, the expression recognition unit 15, and the control unit 16. The image sensing unit 11 is configured to capture the first image frame F1 and the second image frame F2; the face recognition unit 12 is configured to identify a user identity according to the first image frame F1; the display The unit 14 displays an ID information ID of the user identity. The expression recognition unit 15 is configured to confirm a user expression according to the second image frame F2 and output an acknowledgement signal Sc. The control unit 16 is based on the confirmation signal Sc. Read the driving settings related to the user's identity. In this implementation, the setting operation is related to the driving setting, such as the setting of an electronic device of at least one of a seat, a mirror, an air conditioner, an audio, a steering wheel, a light, and a satellite positioning system, and the remaining operation modes. Both are similar to FIG. 1 and related descriptions, and thus will not be described again. Therefore, in the embodiment, the storage unit 13 stores at least one user's identity information, user expression-related expression data, and driving settings related to different vehicle electronic devices.

此外,本發明之使用者辨識及確認裝置1還可根據使用者表情來更新至少一電子裝置的設定資訊。例如此處仍以車用中央控制系統為例,該影像感測單元11可擷取一第三影像圖框,該表情辨識單元15可根據該第三影像圖框確認一使用者表情並產生一儲存信號至該控制單元16,該控制單元16 則可根據該儲存信號儲存該至少一電子裝置之目前設定資訊至該儲存單元13以進行設定資訊的更新,例如更新一座位位置、一鏡面角度、一空調溫度、一音響設定、一方向盤高度、一燈光設定及一衛星定位設定至少其中之一。可以了解的是,此更新設定資訊步驟例如可進入一資料更新模式時才執行,該資料更新模式可根據使用者的指示進入或該表情辨識單元15完成身分資訊ID確認後直接進入,並無特定限制。 In addition, the user identification and confirmation device 1 of the present invention can also update the setting information of at least one electronic device according to the user's expression. For example, the image sensing unit 11 can take a third image frame, and the expression recognition unit 15 can confirm a user expression according to the third image frame and generate a Storing a signal to the control unit 16, the control unit 16 And storing, according to the storage signal, current setting information of the at least one electronic device to the storage unit 13 for updating the setting information, such as updating a seat position, a mirror angle, an air conditioning temperature, an audio setting, a steering wheel height, At least one of a light setting and a satellite positioning setting. It can be understood that the update setting information step is performed, for example, when entering a data update mode, and the data update mode can be directly entered according to the user's instruction or the expression recognition unit 15 completes the identity information ID confirmation, and is not specified. limit.

請參照第4圖所示,其顯示本發明實施例之使用者辨識及確認方法之流程圖,包含下列步驟:以一影像感測單元擷取一第一影像圖框(步驟S21);根據該第一影像圖框辨識一使用者身分(步驟S22);以一顯示單元顯示該使用者身分之一身分資訊(步驟S23);以該影像感測單元擷取一第二影像圖框(步驟S24);根據該第二影像圖框確認一使用者表情並產生一確認信號(步驟S25);根據該確認信號控制至少一電子裝置(步驟S26);以該影像感測單元擷取一第三影像圖框(步驟S27);根據該第三影像圖框確認一使用者表情並產生一儲存信號(步驟S28);以及根據該儲存信號更新該至少一電子裝置之一設定資訊(步驟S29);其中,當本實施例之使用者辨識及確認方法應用於一車用中央控制系統時,所述電子裝置例如包含一座位、一鏡面、一空調、一音響、一方向 盤、一燈光及一衛星定位系統至少其中之一,但並不以此為限。本實施例中各步驟已詳細描述於第1、3圖及其相關說明,故於此不再贅述,第4圖例如進一步說明了各步驟的實施順序。 Referring first to FIG. 4, which shows a flowchart of the user identification and confirmation method of the embodiment of the embodiment of the present invention, comprising the following steps of: an image sensing unit capturing a first image frame (step S 21); The the first image frame to identify an identity of the user (step S 22); displaying one of the user identity identifiable information (step S 23) to a display unit; in the image sensing unit capturing a second image frame (step S 24); a user to confirm the expression according to the second image frame and generates an acknowledgment signal (step S 25); to the image sensing unit; the acknowledgment signal controlling at least one electronic device (step S 26) in accordance with Extracting a third image frame (step S27 ); confirming a user expression according to the third image frame and generating a storage signal (step S28 ); and updating one of the at least one electronic device according to the storage signal Setting information (step S29 ); wherein, when the user identification and confirmation method of the embodiment is applied to a central control system for a vehicle, the electronic device includes, for example, a seat, a mirror, an air conditioner, an audio, and a Steering wheel, one light At least one of light and a satellite positioning system, but not limited to this. The steps in this embodiment have been described in detail in FIGS. 1 and 3 and their related descriptions, and thus will not be described again herein. FIG. 4 further illustrates the implementation sequence of each step.

請參照第4A圖所示,其顯示本發明實施例之使用者辨識及確認方法之另一流程圖,其介於第4圖中步驟S21及步驟S22間以另行判斷該第一影像圖框F1中是否存在一使用者(步驟S211);當該第一影像圖框F1中不存在任何使用者,則回到步驟S21重新擷取一張第一影像圖框F1;當該第一影像圖框F1中存在一使用者,該人臉辨識單元12才根據該第一影像圖框F1辨識一使用者身分。 Referring to Figure 4A, it shows another flow chart of the method of user identification and confirmation of the embodiment of the present invention embodiment, interposed in FIG. 4 and step S 21 to step S 22 Room otherwise determining the first image in FIG. whether there is a user (step S 211) in the frame F1; when the first image frame F1 in the absence of any user, the process returns to step S 21 again capturing a first image frame F1; when the second A user is present in an image frame F1, and the face recognition unit 12 recognizes a user identity based on the first image frame F1.

請參照第4B圖所示,其顯示本發明實施例之使用者辨識及確認方法之另一流程圖,其介於第4圖中步驟S21及步驟S22間以另行判斷該第一影像圖框F1中是否存在複數使用者(步驟S212);當該第一影像圖框F1中不存在任何使用者,則回到步驟S21重新擷取一張第一影像圖框F1;當該第一影像圖框F1中存在複數使用者,該人臉辨識單元12先判斷該第一影像圖框F1中複數使用者中一欲辨識使用者(步驟S213)後,再辨識該欲辨識使用者之一使用者身分(步驟S22);其中,如前所述該欲辨識使用者可根據一使用者距離或一使用者位置來認定。 Referring to Figure 4B, it shows another flow chart of the method of user identification and confirmation of the embodiment of the present invention embodiment, interposed in FIG. 4 and step S 21 to step S 22 Room otherwise determining the first image in FIG. whether there is a plurality of users (step S 212) in the frame F1; when the first image frame F1 in the absence of any user, the process returns to step S 21 again capturing a first image frame F1; when the second A plurality of users are present in an image frame F1. The face recognition unit 12 first determines that one of the plurality of users in the first image frame F1 is to identify the user (step S213 ), and then identifies the user to be identified. one of the user identity (step S 22); wherein, as previously described the user may want to identify a user identified according to the distance or position of a user.

參照第5圖所示,其顯示本發明另一實施例之使用者辨識及確認裝置之方塊示意圖。第5圖與第1圖之差異在於,第5圖中該第二影像圖框F2係先傳送至該人臉辨識單元12後再傳送至該表情辨識單元15,其他部分則與第1圖相類似。例如一實施例中,當該顯示單元14表示該身分資訊ID後,該人臉辨識單元12才將該第二影像圖框F2傳送至該表情辨識單元15。另一實施例中,該人臉辨識單元12通知該顯示單元14表示該身分資訊ID時,便將該影像感測器11擷取之影像圖框(即第二影像圖框F2)傳送至該表情辨識單元15,其可在該顯示單元14表示該身分資訊ID的同時或之後進行表情辨識。另一實施例中,該人臉辨識單元12及該表情辨識單元15可使用相同的影像圖框來執行各自的辨識工作,亦即該第一影像圖框F1及該第二影像圖框F2可為同一張影像圖框。 Referring to Figure 5, there is shown a block diagram of a user identification and verification device in accordance with another embodiment of the present invention. The difference between FIG. 5 and FIG. 1 is that the second image frame F2 in FIG. 5 is first transmitted to the face recognition unit 12 and then transmitted to the expression recognition unit 15, and the other portions are compared with the first image. similar. For example, in the embodiment, after the display unit 14 indicates the identity information ID, the face recognition unit 12 transmits the second image frame F2 to the expression recognition unit 15. In another embodiment, when the face recognition unit 12 notifies the display unit 14 of the identity information ID, the image frame captured by the image sensor 11 (ie, the second image frame F2) is transmitted to the The expression recognition unit 15 can perform expression recognition while the display unit 14 indicates the identity information ID. In another embodiment, the face recognition unit 12 and the expression recognition unit 15 can perform the respective identification operations using the same image frame, that is, the first image frame F1 and the second image frame F2 can be Is the same image frame.

綜上所述,習知人臉辨識技術及表情辨識技術使用不同演算法並具有不同應用。本發明另提出一種使用者辨識及確認裝置(第1圖)及使用者辨識及確認方法(第4圖),用以透過使用者表情確認使用者身分的正確與否,並可應用於車用中央控制系統以排除不同駕駛具有不同駕駛設定所造成的不便。 In summary, the conventional face recognition technology and expression recognition technology use different algorithms and have different applications. The present invention further provides a user identification and confirmation device (Fig. 1) and a user identification and confirmation method (Fig. 4) for confirming the correctness of the user's identity through the user's expression, and can be applied to the vehicle. The central control system eliminates the inconvenience caused by different driving settings with different driving settings.

雖然本發明已以前述實施例揭示,然其並非用 以限定本發明,任何本發明所屬技術領域中具有通常知識者,在不脫離本發明之精神和範圍內,當可作各種之更動與修改。因此本發明之保護範圍當視後附之申請專利範圍所界定者為準。 Although the present invention has been disclosed in the foregoing embodiments, it is not In order to limit the invention, it is possible to make various changes and modifications without departing from the spirit and scope of the invention. Therefore, the scope of the invention is defined by the scope of the appended claims.

1‧‧‧使用者辨識及確認裝置 1‧‧‧User identification and confirmation device

11‧‧‧影像感測單元 11‧‧‧Image sensing unit

12‧‧‧人臉辨識系統 12‧‧‧Face Recognition System

13‧‧‧儲存單元 13‧‧‧ storage unit

14‧‧‧顯示單元 14‧‧‧Display unit

141‧‧‧顯示畫面 141‧‧‧Display screen

142‧‧‧揚聲裝置 142‧‧‧ Speakers

15‧‧‧表情辨識單元 15‧‧‧Expression unit

16‧‧‧控制單元 16‧‧‧Control unit

17‧‧‧電子裝置 17‧‧‧Electronic devices

F1‧‧‧第一影像圖框 F1‧‧‧ first image frame

F2‧‧‧第二影像圖框 F2‧‧‧Second image frame

ID‧‧‧身分資訊 ID‧‧‧ID information

Sc‧‧‧確認信號 Sc‧‧‧Confirmation signal

8‧‧‧使用者 8‧‧‧Users

9‧‧‧車輛 9‧‧‧ Vehicles

91‧‧‧後照鏡 91‧‧‧ rearview mirror

92‧‧‧中央控制台 92‧‧‧Central console

S21~S29‧‧‧步驟 S 21 ~S 29 ‧‧‧Steps

FOV‧‧‧影像感測單元之視野 FOV‧‧‧Image Sensing Unit Vision

第1圖顯示本發明實施例之使用者辨識及確認裝置之方塊示意圖。 FIG. 1 is a block diagram showing a user identification and confirmation apparatus according to an embodiment of the present invention.

第2圖顯示本發明實施例之使用者辨識及確認裝置中,顯示單元顯示身分資訊之示意圖。 FIG. 2 is a schematic diagram showing the display unit displaying the identity information in the user identification and confirmation device according to the embodiment of the present invention.

第3圖顯示本發明實施例之使用者辨識及確認裝置適用於車用中央控制系統之示意圖。 Figure 3 is a schematic diagram showing the user identification and confirmation device of the embodiment of the present invention applied to a central control system for a vehicle.

第4圖顯示本發明實施例之使用者辨識及確認方法之流程圖。 FIG. 4 is a flow chart showing a method for user identification and confirmation according to an embodiment of the present invention.

第4A~4B圖顯示本發明實施例之使用者辨識及確認方法之另一流程圖。 4A-4B are another flow chart showing a method for user identification and confirmation according to an embodiment of the present invention.

第5圖顯示本發明另一實施例之使用者辨識及確認裝置之方塊示意圖。 FIG. 5 is a block diagram showing a user identification and confirmation apparatus according to another embodiment of the present invention.

1‧‧‧使用者辨識及確認裝置 1‧‧‧User identification and confirmation device

11‧‧‧影像感測單元 11‧‧‧Image sensing unit

12‧‧‧人臉辨識單元 12‧‧‧Face recognition unit

13‧‧‧儲存單元 13‧‧‧ storage unit

14‧‧‧顯示單元 14‧‧‧Display unit

15‧‧‧表情辨識單元 15‧‧‧Expression unit

16‧‧‧控制單元 16‧‧‧Control unit

17‧‧‧電子裝置 17‧‧‧Electronic devices

8‧‧‧使用者 8‧‧‧Users

Claims (23)

一種使用者辨識及確認裝置,包含:一影像感測單元,用以擷取一第一影像圖框及一第二影像圖框;一人臉辨識單元,用以根據該第一影像圖框辨識一使用者身分;一顯示單元,顯示該使用者身分之一身分資訊;及一表情辨識單元,用以根據該第二影像圖框確認一使用者表情並輸出一確認信號。 A user identification and confirmation device includes: an image sensing unit for capturing a first image frame and a second image frame; and a face recognition unit for identifying one according to the first image frame a user's identity; a display unit for displaying identity information of the user identity; and an expression recognition unit for confirming a user's expression and outputting a confirmation signal according to the second image frame. 依申請專利範圍第1項之使用者辨識及確認裝置,另包含一儲存單元用以儲存至少一使用者之該身分資訊以及該使用者表情相關的表情資料。 The user identification and confirmation device according to the first aspect of the patent application includes a storage unit for storing the identity information of at least one user and the expression data related to the user's expression. 依申請專利範圍第1項之使用者辨識及確認裝置,另包含一控制單元根據該確認信號控制至少一電子裝置之一設定狀態。 According to the user identification and confirmation device of the first aspect of the patent application, the control unit further comprises a control unit controlling the setting state of one of the at least one electronic device according to the confirmation signal. 依申請專利範圍第3項之使用者辨識及確認裝置,其中該設定狀態與該使用者身分相關。 The user identification and confirmation device according to item 3 of the patent application scope, wherein the setting state is related to the user identity. 依申請專利範圍第3或4項之使用者辨識及確認裝置,另包含一儲存單元用以儲存該設定狀態。 The user identification and confirmation device according to item 3 or 4 of the patent application scope further includes a storage unit for storing the setting state. 依申請專利範圍第1項之使用者辨識及確認裝置,其中該影像感測單元於該顯示單元顯示該身分資訊後擷取該第二影像圖框。 According to the user identification and confirmation device of the first aspect of the patent application, the image sensing unit captures the second image frame after the display unit displays the identity information. 依申請專利範圍第1項之使用者辨識及確認裝置,其中該人臉辨識單元另判斷該第一影像圖框中是否存在一使用者。 According to the user identification and confirmation device of the first aspect of the patent application, the face recognition unit further determines whether a user exists in the first image frame. 依申請專利範圍第1項之使用者辨識及確認裝置,其中該人臉辨識單元另判斷該第一影像圖框中複數使用者中一欲辨識使用者。 According to the user identification and confirmation device of the first aspect of the patent application, the face recognition unit further determines that one of the plurality of users in the first image frame is to identify the user. 依申請專利範圍第1項之使用者辨識及確認裝置,其中該第一影像圖框及該第二影像圖框為同一張影像圖框。 According to the user identification and confirmation device of the first aspect of the patent application, the first image frame and the second image frame are the same image frame. 一種車用中央控制系統,包含:一影像感測單元,用以擷取一第一影像圖框及一第二影像圖框;一人臉辨識單元,用以根據該第一影像圖框辨識一使用者身分;一顯示單元,顯示該使用者身分之一身分資訊;一表情辨識單元,用以根據該第二影像圖框確認一使用者表情並輸出一確認信號;以及一控制單元,根據該確認信號讀取該使用者身分相關之一駕駛設定。 A central control system for a vehicle includes: an image sensing unit for capturing a first image frame and a second image frame; and a face recognition unit for identifying a use according to the first image frame a display unit for displaying identity information of the user identity; an expression recognition unit for confirming a user expression according to the second image frame and outputting a confirmation signal; and a control unit according to the confirmation The signal reads one of the driving settings associated with the user's identity. 依申請專利範圍第10項之車用中央控制系統,其中該影像感測單元相對一駕駛座設置。 According to the vehicle central control system of claim 10, wherein the image sensing unit is disposed relative to a driver's seat. 依申請專利範圍第10項之車用中央控制系統,其中該駕駛設定包含一座位位置、一鏡面角度、一空 調溫度、一音響設定、一方向盤高度、一燈光設定及一衛星定位設定至少其中之一。 According to the vehicle central control system of claim 10, wherein the driving setting includes a seat position, a mirror angle, and an empty At least one of temperature adjustment, an audio setting, a steering wheel height, a lighting setting, and a satellite positioning setting. 依申請專利範圍第10項之車用中央控制系統,另包含一儲存單元用以儲存至少一使用者之該身分資訊、該使用者表情相關的表情資料以及該駕駛設定。 According to the vehicle central control system of claim 10, the storage unit further includes a storage unit for storing the identity information of at least one user, the expression data related to the expression of the user, and the driving setting. 依申請專利範圍第10項之車用中央控制系統,其中該影像感測單元於該顯示單元顯示該身分資訊後擷取該第二影像圖框。 According to the vehicle central control system of claim 10, the image sensing unit captures the second image frame after the display unit displays the identity information. 依申請專利範圍第10項之車用中央控制系統,其中該人臉辨識單元另判斷該第一影像圖框中是否存在一使用者。 According to the vehicle central control system of claim 10, the face recognition unit further determines whether a user exists in the first image frame. 依申請專利範圍第10項之車用中央控制系統,其中該人臉辨識單元另判斷該第一影像圖框中複數使用者中一欲辨識使用者。 According to the vehicle central control system of claim 10, the face recognition unit further determines that one of the plurality of users in the first image frame is to identify the user. 依申請專利範圍第10項之車用中央控制系統,其中該顯示單元透過畫面及/或聲音顯示該身分資訊。 According to the vehicle central control system of claim 10, the display unit displays the identity information through a screen and/or a sound. 依申請專利範圍第10項之車用中央控制系統,其中該第一影像圖框及該第二影像圖框為同一張影像圖框。 According to the vehicle central control system of claim 10, the first image frame and the second image frame are the same image frame. 一種使用者辨識及確認方法,包含下列步驟:以一影像感測單元擷取一第一影像圖框;根據該第一影像圖框辨識一使用者身分;以一顯示單元顯示該使用者身分之一身分資訊;以該影像感測單元擷取一第二影像圖框; 根據該第二影像圖框確認一使用者表情並產生一確認信號;以及根據該確認信號控制至少一電子裝置。 A user identification and confirmation method includes the steps of: capturing a first image frame by an image sensing unit; identifying a user identity according to the first image frame; displaying the user identity by a display unit a body information; capturing a second image frame by the image sensing unit; Determining a user's expression according to the second image frame and generating an acknowledgement signal; and controlling the at least one electronic device according to the confirmation signal. 依申請專利範圍第19項之使用者辨識及確認方法,其中該電子裝置包含一座位、一鏡面、一空調、一音響、一方向盤、一燈光及一衛星定位系統至少其中之一。 According to the user identification and confirmation method of claim 19, the electronic device comprises at least one of a seat, a mirror, an air conditioner, an audio, a steering wheel, a light and a satellite positioning system. 依申請專利範圍第19項之使用者辨識及確認方法,另包含:判斷該第一影像圖框中是否存在一使用者;及/或判斷該第一影像圖框中複數使用者中一欲辨識使用者。 According to the user identification and confirmation method of claim 19, the method further comprises: determining whether a user exists in the first image frame; and/or determining that one of the plurality of users in the first image frame is to be identified user. 依申請專利範圍第19項之使用者辨識及確認方法,另包含:以該影像感測單元擷取一第三影像圖框;根據該第三影像圖框確認一使用者表情並產生一儲存信號;以及根據該儲存信號更新該至少一電子裝置之一設定資訊。 According to the user identification and confirmation method of claim 19, the method further comprises: capturing a third image frame by the image sensing unit; confirming a user expression according to the third image frame and generating a storage signal And updating one of the at least one electronic device setting information according to the stored signal. 依申請專利範圍第19項之使用者辨識及確認方法,其中該第一影像圖框及該第二影像圖框為同一張影像圖框。 According to the user identification and confirmation method of claim 19, the first image frame and the second image frame are the same image frame.
TW101138995A 2012-10-22 2012-10-22 User recognition and confirmation device and method, and central control system for vehicles using the same TWI490792B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW101138995A TWI490792B (en) 2012-10-22 2012-10-22 User recognition and confirmation device and method, and central control system for vehicles using the same

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
TW101138995A TWI490792B (en) 2012-10-22 2012-10-22 User recognition and confirmation device and method, and central control system for vehicles using the same
US14/047,682 US20140112554A1 (en) 2012-10-22 2013-10-07 User recognition and confirmation device and method, and central control system for vehicles using the same
US16/252,769 US11222197B2 (en) 2012-10-22 2019-01-21 User recognition and confirmation method
US17/534,870 US20220083765A1 (en) 2012-10-22 2021-11-24 Vehicle device setting method

Publications (2)

Publication Number Publication Date
TW201416998A true TW201416998A (en) 2014-05-01
TWI490792B TWI490792B (en) 2015-07-01

Family

ID=50485378

Family Applications (1)

Application Number Title Priority Date Filing Date
TW101138995A TWI490792B (en) 2012-10-22 2012-10-22 User recognition and confirmation device and method, and central control system for vehicles using the same

Country Status (2)

Country Link
US (3) US20140112554A1 (en)
TW (1) TWI490792B (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9805260B2 (en) 2014-07-09 2017-10-31 Pixart Imaging Inc. Vehicle safety system and operating method thereof
TWI647728B (en) * 2017-04-07 2019-01-11 致伸科技股份有限公司 Vehicle control device and method thereof
WO2021203385A1 (en) * 2020-04-09 2021-10-14 华为技术有限公司 Method and device for generating instruction unit group

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101552873B1 (en) * 2014-05-08 2015-09-14 현대자동차주식회사 Vehicle, Terminal and method for controlling the vehicle
US10769434B2 (en) * 2015-12-22 2020-09-08 Gentex Corporation Mirror assembly incorporating a scanning apparatus
US20180099612A1 (en) * 2016-10-06 2018-04-12 Gentex Corporation Rearview assembly with occupant detection
CN106407957A (en) * 2016-11-04 2017-02-15 四川诚品电子商务有限公司 Courthouse image acquisition alarm apparatus
US20190176837A1 (en) * 2017-12-08 2019-06-13 Tesla, Inc. Personalization system and method for a vehicle based on spatial locations of occupants' body portions
GB2572317A (en) * 2018-03-06 2019-10-02 Skoogmusic Ltd Control apparatus and method
CN109398310B (en) * 2018-09-26 2021-01-29 中创博利科技控股有限公司 Unmanned automobile
CN110758325A (en) * 2019-10-23 2020-02-07 上海能塔智能科技有限公司 Face authentication method and device for vehicle, storage medium, terminal and automobile
WO2022021050A1 (en) * 2020-07-28 2022-02-03 深圳市大疆创新科技有限公司 Terminal device control method and apparatus, and storage medium

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7768380B2 (en) * 1994-05-09 2010-08-03 Automotive Technologies International, Inc. Security system control for monitoring vehicular compartments
US7359529B2 (en) * 2003-03-06 2008-04-15 Samsung Electronics Co., Ltd. Image-detectable monitoring system and method for using the same
KR20050089272A (en) * 2004-03-04 2005-09-08 삼성전자주식회사 Key for vehicle having memory and method for controlling a vehicle using the same
JP4087400B2 (en) * 2005-09-15 2008-05-21 株式会社東芝 Spoken dialogue translation apparatus, spoken dialogue translation method, and spoken dialogue translation program
CN101089905A (en) * 2006-06-16 2007-12-19 鸿富锦精密工业(深圳)有限公司 Vehicle safety system
US20080029214A1 (en) * 2006-08-04 2008-02-07 Zephyros, Inc. Multiple or single stage cure adhesive material and method of use
US7751597B2 (en) * 2006-11-14 2010-07-06 Lctank Llc Apparatus and method for identifying a name corresponding to a face or voice using a database
JP5402018B2 (en) * 2009-01-23 2014-01-29 株式会社ニコン Display device and imaging device
JP5483899B2 (en) * 2009-02-19 2014-05-07 株式会社ソニー・コンピュータエンタテインメント Information processing apparatus and information processing method
CN102034334B (en) * 2009-09-28 2012-12-19 财团法人车辆研究测试中心 Driver monitoring method and monitoring system thereof
CN102549543A (en) * 2009-10-05 2012-07-04 惠普发展公司,有限责任合伙企业 User interface
KR101172213B1 (en) * 2010-12-08 2012-08-07 현대자동차주식회사 System and Method for face identification
TW201226245A (en) * 2010-12-31 2012-07-01 Altek Corp Vehicle apparatus control system and method thereof
TWI476704B (en) * 2011-03-30 2015-03-11 Pixart Imaging Inc Recognizing devices and methods
CN202320178U (en) * 2011-10-21 2012-07-11 同致电子企业股份有限公司 Vehicle detection warning system

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9805260B2 (en) 2014-07-09 2017-10-31 Pixart Imaging Inc. Vehicle safety system and operating method thereof
US10192110B2 (en) 2014-07-09 2019-01-29 Pixart Imaging Inc. Vehicle safety system and operating method thereof
TWI647728B (en) * 2017-04-07 2019-01-11 致伸科技股份有限公司 Vehicle control device and method thereof
WO2021203385A1 (en) * 2020-04-09 2021-10-14 华为技术有限公司 Method and device for generating instruction unit group

Also Published As

Publication number Publication date
TWI490792B (en) 2015-07-01
US11222197B2 (en) 2022-01-11
US20190156111A1 (en) 2019-05-23
US20140112554A1 (en) 2014-04-24
US20220083765A1 (en) 2022-03-17

Similar Documents

Publication Publication Date Title
TWI490792B (en) User recognition and confirmation device and method, and central control system for vehicles using the same
RU2669575C2 (en) Electronic device controlling method and device and terminal
US7853051B2 (en) Recognizing apparatus and method, recording media, and program
US10162998B2 (en) Wearable glasses, control method thereof, and vehicle control system
KR20150003591A (en) Smart glass
JP2007329784A (en) Imaging apparatus, method for controlling the same, and computer program
JPWO2012117508A1 (en) Information processing apparatus, method, and program
JP6391708B2 (en) Method and apparatus for acquiring iris image, and iris identification device
JP2012123804A (en) System and method for facial identification
US10061995B2 (en) Imaging system to detect a trigger and select an imaging area
US20140152549A1 (en) System and method for providing user interface using hand shape trace recognition in vehicle
WO2018046015A1 (en) Alarm method, device and terminal for vehicle
CN111163906A (en) Mobile electronic device and operation method thereof
CN107832726B (en) User identification and confirmation device and vehicle central control system
EP3157233A1 (en) Handheld device, method for operating the handheld device and computer program
CN111142655A (en) Interaction method, terminal and computer readable storage medium
KR20180070264A (en) Obtaining method for Panning shot image and Electronic device supporting the same
CN107548483B (en) Control method, control device, system and motor vehicle comprising such a control device
US20200201442A1 (en) Gesture operation device and gesture operation method
WO2018148897A1 (en) Driver identity identification method and device
CN112182256A (en) Object identification method and device and vehicle
JP2010188744A (en) Device, method and program for supporting parking
KR102324001B1 (en) Position and posture detection method and device, electronic device and storage medium
US20200160748A1 (en) Cognitive snapshots for visually-impaired users
JP2007314023A (en) Driving support system