US20140112554A1 - User recognition and confirmation device and method, and central control system for vehicles using the same - Google Patents
User recognition and confirmation device and method, and central control system for vehicles using the same Download PDFInfo
- Publication number
- US20140112554A1 US20140112554A1 US14/047,682 US201314047682A US2014112554A1 US 20140112554 A1 US20140112554 A1 US 20140112554A1 US 201314047682 A US201314047682 A US 201314047682A US 2014112554 A1 US2014112554 A1 US 2014112554A1
- Authority
- US
- United States
- Prior art keywords
- user
- image frame
- recognition
- expression
- unit
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- G06K9/00302—
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R25/00—Fittings or systems for preventing or indicating unauthorised use or theft of vehicles
- B60R25/20—Means to switch the anti-theft system on or off
- B60R25/25—Means to switch the anti-theft system on or off using biometry
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/174—Facial expression recognition
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V2201/00—Indexing scheme relating to image or video recognition or understanding
- G06V2201/10—Recognition assisted with metadata
Definitions
- This disclosure generally relates to an interactive system and, more particularly, to a user recognition and confirmation device and method, and a central control system for vehicles using the same.
- biological information includes the information of, for example, face, voice print, finger print and pupil, wherein in the face recognition as a user does not need to take any corresponding action, it is the most convenient technology for operation.
- World Patent No. WO2011/121688 discloses a face recognition device which includes an image capture unit, a region detection unit, a feature value extraction unit, a distance estimation unit and a feature value update unit.
- the region detection unit is for detecting a predetermined region in the image captured by the image capture unit.
- the feature value extraction unit is for extracting a feature value of the predetermined region.
- the distance estimation unit is for estimating a distance between the image capture unit and the predetermined region.
- the feature value update unit is for updating the feature value according to the distance. As a result, it is able to realize high recognition accuracy.
- the expression recognition technology is a new technology in development that is able to detect different facial expressions in different moods, such as anger, terror, dislike, happiness, expressionless, sadness, surprise and so on.
- U.S. Patent Pub. No. 2012169895 discloses a method and apparatus for capturing facial expressions that employ a recognizer implemented by using a Hierarchical Temporal Memory (MTM) recognizer. The method recognizes a target image so as to obtain an expression status and can be applied to the image capturing devices such as a digital camera, Web Cam, IP Cam or Monitor camera.
- MTM Hierarchical Temporal Memory
- the present disclosure provides a user recognition and confirmation device and method, and a central control system for vehicles using the same that may recognize a user ID at first by using a face recognition unit and then confirm the accuracy of the user ID through an expression recognition unit. In this manner, the user may accomplish the recognition and the confirmation procedures without using body motion.
- the present disclosure provides a user recognition and confirmation device and method, and a central control system for vehicles using the same that may recognize the user ID using face recognition technology and confirm the user ID using expression recognition technology.
- the present disclosure further provides a user recognition and confirmation device and method, and a central control system for vehicles using the same that may be applied to automatic settings of various electronic devices for vehicles.
- the present disclosure provides a user recognition and confirmation device including an image sensing unit, a face recognition unit, a display unit and an expression recognition unit.
- the image sensing unit is configured to capture a first image frame and a second image frame.
- the face recognition unit is configured to recognize a user ID according to the first image frame.
- the display unit is configured to show ID information of the user ID.
- the expression recognition unit is configured to confirm a user expression according to the second image frame and output a confirm signal.
- the present disclosure further provides a central control system for vehicles including an image sensing unit, a face recognition unit, a display unit, an expression recognition unit and a control unit.
- the image sensing unit is configured to capture a first image frame and a second image frame.
- the face recognition unit is configured to recognize a user ID according to the first image frame.
- the display unit is configured to show ID information of the user ID.
- the expression recognition unit is configured to confirm a user expression according to the second image frame and output a confirm signal.
- the control unit is configured to read a driver setting associated with the user ID according to the confirm signal.
- the present disclosure further provides a user recognition and confirmation method including the steps of: capturing a first image frame with an image sensing unit; recognizing a user ID according to the first image frame; showing ID information of the user ID with a display unit; capturing a second image frame with the image sensing unit; confirming a user expression according to the second image frame and generating a confirm signal; and controlling at least one electronic device according to the confirm signal.
- the face recognition unit may be further configured to identify whether there is a user existing in the first image frame and/or identify a user to be recognized within a plurality of users in the first image frame.
- the user recognition and confirmation device further includes a storage unit configured to save ID information of at least one user, expression data associated with the user expression and setting information.
- the display unit may show the ID information via screen and/or sound.
- the user recognition and confirmation method further includes the steps of: capturing a third image frame with the image sensing unit; confirming a user expression according to the third image frame and generating a saving signal; and updating setting information of the at least one electronic device according to the saving signal.
- the user ID may be automatically confirmed through a user expression not through body motion of the user.
- the updating may also be implemented through the expression recognition.
- FIG. 1 shows a schematic block diagram of the user recognition and confirmation device according to an embodiment of the present disclosure.
- FIG. 2 shows a schematic diagram of the ID information shown by the display unit of the user recognition and confirmation device according to the embodiment of the present disclosure.
- FIG. 3 shows a schematic diagram of the central control system for vehicles to which the user recognition and confirmation device according to the embodiment of the present disclosure applies.
- FIG. 4 shows a flow chart of the user recognition and confirmation method according to an embodiment of the present disclosure.
- FIGS. 4A to 4B respectively show another flow chart of the user recognition and confirmation method according to the embodiment of the present disclosure.
- FIG. 5 shows a schematic block diagram of the user recognition and confirmation device according to another embodiment of the present disclosure.
- the user recognition and confirmation device 1 includes an image sensing unit 11 , a face recognition unit 12 , a storage unit 13 , a display unit 14 , an expression recognition unit 15 , a control unit 16 and an electronic device 17 .
- the face recognition unit 12 , the expression recognition unit 15 and the control unit 16 may be implemented by processors capable of processing digital data such as a digital signal processor (DSP), and the face recognition algorithm and expression recognition algorithm may be previously built in the digital signal processor.
- DSP digital signal processor
- the user recognition and confirmation device 1 is configured to recognize a user ID at first and then confirm whether the user ID is correct or not according to a user expression so as to accordingly control at least one electronic device 17 .
- the user recognition and confirmation device 1 may be applied to a central control system for vehicles so as to perform corresponding driver settings according to the use habit of every driver, wherein the driver settings may include a seat position, a mirror angle, an air conditioner temperature, an audio setting, a steering wheel height, a light setting and a GPS (global positioning system) setting, but not limited to.
- the user recognition and confirmation device 1 according to the embodiment of the present disclosure in not limited to be applied to the central control system for vehicles. It may be applied to any human-machine interface system that may perform the confirmation of the recognized user ID according to the facial expression of the user.
- the image sensing unit 11 may be a CCD image sensor, a CMOS image senor or the like.
- the image sensing unit 11 is configured to capture a first image frame F 1 and a second image frame F 2 , wherein the image sensing unit 11 may capture images at a fixed capturing frequency. For example in FIG. 1 , the image sensing unit 11 captures images of a user 8 with a field of view (FOV).
- FOV field of view
- the face recognition unit 12 is configured to recognize a user ID according to the first image frame F 1 , wherein after the face feature(s) is calculated using algorithm, the face recognition unit 12 searches the corresponding user ID in the storage unit 13 and transmits the searched user ID to the display unit 14 for displaying. It is appreciated that the face recognition unit 12 may start to recognize the user ID only when the first image frame F 1 includes a face image.
- the display unit 14 may be, for example, a liquid crystal display and has a display screen 141 and/or a speaker 142 as shown in FIG. 2 for showing ID information of the user ID.
- the display unit 14 may also be other types of display. In this manner, the display unit 14 may show the ID information via screen and/or sound, wherein the screen may show the user's picture, drawing or words without any limitation.
- the expression recognition unit 15 is configured to confirm a user expression according to the second image frame F 2 and output a confirm signal Sc, wherein after the expression feature(s) is calculated using algorithm, the expression recognition unit 15 searches the expression data associated with the user expression in the storage unit 13 for comparison.
- the storage unit 13 may previously save ID information of at least one user and the expression data associated with the user expression.
- said user expression is preferably a happiness expression, but not limited to.
- the user expression may be set according to different users, e.g. anger, terror, dislike, surprise, sadness or expressionless.
- the control unit 16 may control a setting of at least one electronic device 17 according to the confirm signal Sc, wherein the setting is associated with the user ID and may be set by the related user himself or herself.
- the setting may be the operational setting of the electronic device 17 , e.g. operational strength, operational interval and/or operational directivity, and previously saved in the storage unit 13 , wherein the setting may be different according to different electronic devices 17 .
- the image sensing unit 11 may capture the second image frame F 2 after the display unit 14 has shown the ID information.
- the present disclosure is not limited that the image sensing unit 11 stops its operation in a time interval after the image sensing unit 11 capturing the first image frame F 1 and before the display unit 14 showing the ID information. According to different applications the image sensing unit 11 may continuously operate or be disabled after the first image frame F 1 is captured till the expression recognition unit 15 recognizes the user expression.
- the image sensing unit 11 starts to operate to continuously capture the first image frame F 1 after the starting procedure of the user recognition and confirmation device 1 is accomplished. Therefore, preferably the face recognition unit 12 may be further configured to identify whether there is a user 8 existing in the first image frame F 1 . When there is no user image in the first image frame F 1 , a new first image frame F 1 is captured. When there is a user image existing in the first image frame F 1 , the face recognition unit 12 starts to recognize a user ID according to the first image frame F 1 .
- the face recognition unit 12 may be further configured to identify a user to be recognized within a plurality of users in the first image frame F 1 . For example, when a plurality of user images are existing in the first image frame F 1 simultaneously, the face recognition unit 12 may select a closest user as the user to be recognized, wherein said closest may be identified according to the size, contrast and clearness of the user image. In addition, the user to be recognized may also be identified according to other ways, e.g. the position of the user image. After the user to be recognized is identified, the face recognition unit 12 starts to perform the user ID recognition. In addition, the user recognition unit 12 may also perform the user ID recognition on all of the plurality of users and show the recognized results on the display unit 14 simultaneously. Then, the user 8 may confirm the ID information of a user to be recognized via the expression recognition unit 15 .
- the image sensing unit 11 is preferably disposed opposite to a driver seat.
- the image sensing unit 11 may be disposed on a rear view mirror 91 or on a central control panel 92 , but not limited to. It may also be disposed at any suitable position as long as the driver's face image can be captured.
- a central control system for vehicles employing the user recognition and confirmation device 1 of the present disclosure includes the image sensing unit 11 , the face recognition unit 12 , the storage unit 13 , the display unit 14 , the expression recognition unit 15 and the control unit 16 .
- the image sensing unit 11 is configured to capture the first image frame F 1 and the second image frame F 2 .
- the face recognition unit 12 is configured to recognize a user ID according to the first image frame F 1 .
- the display unit 14 is configured to show ID information of the user ID.
- the expression recognition unit 15 is configured to confirm a user expression according to the second image frame F 2 and output a confirm signal Sc.
- the control unit 16 is configured to read the driver setting associated with the user ID according to the confirm signal Sc.
- the setting is related to the driver setting, e.g. the setting(s) of the electronic device including at least one of a seat, a mirror, an air conditioner, an audio equipment, a steering wheel, a light and a GPS system
- the storage unit 13 at least saves the ID information of at least one user, the expression data associated with the user expression and the driver setting(s) associated with different electronic devices for vehicles.
- the user recognition and confirmation device 1 of the present disclosure may also be able to update the setting information of at least one electronic device according to the user expression.
- a central control system for vehicles is still used as an example herein, for example the image sensing unit 11 may capture a third image frame and the expression recognition unit 15 may confirm a user expression according to the third image frame and generate a saving signal to the control unit 16 .
- the control unit 16 then saves the current setting information of the at least one electronic device into the storage unit 13 according to the saving signal so as to update the setting information, e.g. updating at least one of a seat position, a mirror angle, an air conditioner temperature, an audio setting, a steering wheel height, a light setting and a GPS setting.
- the step of updating the setting information may be performed when a data update mode is entered, and the data update mode may be entered according to an instruction from the user or directly entered after the expression recognition unit 15 finishes the confirmation of the ID information without any limitation.
- FIG. 4 it shows a flow chart of the user recognition and confirmation method according to the embodiment of the present disclosure, which includes the steps of: capturing a first image frame with an image sensing unit (Step S 21 ); recognizing a user ID according to the first image frame (Step S 22 ); showing ID information of the user ID with a display unit (Step S 23 ); capturing a second image frame with the image sensing unit (Step S 24 ); confirming a user expression according to the second image frame and generating a confirm signal (Step S 25 ); controlling at least one electronic device according to the confirm signal (Step S 26 ); capturing a third image frame with the image sensing unit (Step S 27 ); confirming a user expression according to the third image frame and generating a saving signal (Step S 28 ); and updating setting information of the at least one electronic device according to the saving signal (Step S 29 ); wherein when the user recognition and confirmation method of this embodiment is applied to a central control system for vehicles, said electronic device may be
- FIG. 4A it shows another flow chart of the user recognition and confirmation method according to the embodiment of the present disclosure that may be arranged between the Steps S 21 and S 22 of FIG. 4 so as to identify whether there is a user appearing in the first image frame F 1 (Step S 211 ).
- the process returns to the Step S 21 to capture a new first image frame F 1 .
- the face recognition unit 12 starts to recognize a user ID according to the first image frame F 1 .
- FIG. 4B it shows another flow chart of the user recognition and confirmation method according to the embodiment of the present disclosure that may be arranged between the Steps S 21 and S 22 of FIG. 4 so as to identify whether there are a plurality of users appearing in the first image frame F 1 (Step S 212 ).
- Step S 212 the process returns to the Step S 21 to capture a new first image frame F 1 .
- the face recognition unit 12 identifies a user to be recognized within the plurality of users in the first image frame F 1 at first (Step S 213 ) and then recognizes a user ID of the user to be recognized (Step S 22 ), wherein as mentioned above the user to be recognized may be identified according to a user distance or a user position.
- FIG. 5 it shows a schematic block diagram of the user recognition and confirmation device according to another embodiment of the present disclosure.
- the second image frame F 2 is firstly transmitted to the face recognition unit 12 and then transmitted to the expression recognition unit 15 , and other parts are similar to FIG. 1 .
- the face recognition unit 12 sends the second image frame F 2 to the expression recognition unit 15 .
- the face recognition unit 12 informs the display unit 14 to show the ID information, the image frame captured by the image sensing unit 11 (i.e.
- the second image frame F 2 is sent to the expression recognition unit 15 , and the expression recognition may be performed at the same time the display unit 14 is showing the ID information or after the ID information has been shown.
- the face recognition unit 12 and the expression recognition unit 15 may perform respective recognition operations using the same image frame; i.e. the first image frame F 1 and the second image frame F 2 may be the same image frame.
- the present disclosure further provides a user recognition and confirmation device ( FIG. 1 ) and a user recognition and confirmation method ( FIG. 4 ) that may confirm whether the user ID is correct or not through the user expression and may be applied to the central control system for vehicles so as to eliminate the inconvenience caused by different driver settings associated with different drivers.
Landscapes
- Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Mechanical Engineering (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Collating Specific Patterns (AREA)
- User Interface Of Digital Computer (AREA)
- Studio Devices (AREA)
- Image Analysis (AREA)
Abstract
A user recognition and confirmation device includes an image sensing unit, a face recognition unit, a display unit and an expression recognition unit. The image sensing unit captures a first image frame and a second image frame. The face recognition unit is configured to recognize a user ID according to the first image frame. The display unit is configured to show ID information of the user ID. The expression recognition unit is configured to confirm a user expression according to the second image frame and output a confirm signal. There is further provided a user recognition and confirmation method and a central control system for vehicles.
Description
- This application claims the priority benefit of Taiwan Patent Application Serial Number 101138995, filed on Oct. 22, 2012, the full disclosure of which is incorporated herein by reference.
- 1. Field of the Disclosure
- This disclosure generally relates to an interactive system and, more particularly, to a user recognition and confirmation device and method, and a central control system for vehicles using the same.
- 2. Description of the Related Art
- Presently the biological recognition technology has been widely applied to the ID recognition. Generally biological information includes the information of, for example, face, voice print, finger print and pupil, wherein in the face recognition as a user does not need to take any corresponding action, it is the most convenient technology for operation.
- For example, World Patent No. WO2011/121688 discloses a face recognition device which includes an image capture unit, a region detection unit, a feature value extraction unit, a distance estimation unit and a feature value update unit. The region detection unit is for detecting a predetermined region in the image captured by the image capture unit. The feature value extraction unit is for extracting a feature value of the predetermined region. The distance estimation unit is for estimating a distance between the image capture unit and the predetermined region. The feature value update unit is for updating the feature value according to the distance. As a result, it is able to realize high recognition accuracy.
- The expression recognition technology is a new technology in development that is able to detect different facial expressions in different moods, such as anger, terror, dislike, happiness, expressionless, sadness, surprise and so on. For example, U.S. Patent Pub. No. 2012169895 discloses a method and apparatus for capturing facial expressions that employ a recognizer implemented by using a Hierarchical Temporal Memory (MTM) recognizer. The method recognizes a target image so as to obtain an expression status and can be applied to the image capturing devices such as a digital camera, Web Cam, IP Cam or Monitor camera.
- Accordingly, the present disclosure provides a user recognition and confirmation device and method, and a central control system for vehicles using the same that may recognize a user ID at first by using a face recognition unit and then confirm the accuracy of the user ID through an expression recognition unit. In this manner, the user may accomplish the recognition and the confirmation procedures without using body motion.
- The present disclosure provides a user recognition and confirmation device and method, and a central control system for vehicles using the same that may recognize the user ID using face recognition technology and confirm the user ID using expression recognition technology.
- The present disclosure further provides a user recognition and confirmation device and method, and a central control system for vehicles using the same that may be applied to automatic settings of various electronic devices for vehicles.
- The present disclosure provides a user recognition and confirmation device including an image sensing unit, a face recognition unit, a display unit and an expression recognition unit. The image sensing unit is configured to capture a first image frame and a second image frame. The face recognition unit is configured to recognize a user ID according to the first image frame. The display unit is configured to show ID information of the user ID. The expression recognition unit is configured to confirm a user expression according to the second image frame and output a confirm signal.
- The present disclosure further provides a central control system for vehicles including an image sensing unit, a face recognition unit, a display unit, an expression recognition unit and a control unit. The image sensing unit is configured to capture a first image frame and a second image frame. The face recognition unit is configured to recognize a user ID according to the first image frame. The display unit is configured to show ID information of the user ID. The expression recognition unit is configured to confirm a user expression according to the second image frame and output a confirm signal. The control unit is configured to read a driver setting associated with the user ID according to the confirm signal.
- The present disclosure further provides a user recognition and confirmation method including the steps of: capturing a first image frame with an image sensing unit; recognizing a user ID according to the first image frame; showing ID information of the user ID with a display unit; capturing a second image frame with the image sensing unit; confirming a user expression according to the second image frame and generating a confirm signal; and controlling at least one electronic device according to the confirm signal.
- In one aspect, the face recognition unit may be further configured to identify whether there is a user existing in the first image frame and/or identify a user to be recognized within a plurality of users in the first image frame.
- In one aspect, the user recognition and confirmation device further includes a storage unit configured to save ID information of at least one user, expression data associated with the user expression and setting information.
- In one aspect, the display unit may show the ID information via screen and/or sound.
- In one aspect, the user recognition and confirmation method further includes the steps of: capturing a third image frame with the image sensing unit; confirming a user expression according to the third image frame and generating a saving signal; and updating setting information of the at least one electronic device according to the saving signal.
- In the user recognition and confirmation device and method, and the central control system for vehicles of the present disclosure, the user ID may be automatically confirmed through a user expression not through body motion of the user. In addition, when the user desires to update the setting information, the updating may also be implemented through the expression recognition.
- Other objects, advantages, and novel features of the present disclosure will become more apparent from the following detailed description when taken in conjunction with the accompanying drawings.
-
FIG. 1 shows a schematic block diagram of the user recognition and confirmation device according to an embodiment of the present disclosure. -
FIG. 2 shows a schematic diagram of the ID information shown by the display unit of the user recognition and confirmation device according to the embodiment of the present disclosure. -
FIG. 3 shows a schematic diagram of the central control system for vehicles to which the user recognition and confirmation device according to the embodiment of the present disclosure applies. -
FIG. 4 shows a flow chart of the user recognition and confirmation method according to an embodiment of the present disclosure. -
FIGS. 4A to 4B respectively show another flow chart of the user recognition and confirmation method according to the embodiment of the present disclosure. -
FIG. 5 shows a schematic block diagram of the user recognition and confirmation device according to another embodiment of the present disclosure. - It should be noted that, wherever possible, the same reference numbers will be used throughout the drawings to refer to the same or like parts.
- Referring to
FIG. 1 , it shows a schematic block diagram of the user recognition and confirmation device according to an embodiment of the present disclosure. The user recognition andconfirmation device 1 includes animage sensing unit 11, aface recognition unit 12, astorage unit 13, adisplay unit 14, anexpression recognition unit 15, acontrol unit 16 and anelectronic device 17. In this embodiment, theface recognition unit 12, theexpression recognition unit 15 and thecontrol unit 16 may be implemented by processors capable of processing digital data such as a digital signal processor (DSP), and the face recognition algorithm and expression recognition algorithm may be previously built in the digital signal processor. - The user recognition and
confirmation device 1 according to the embodiment of the present disclosure is configured to recognize a user ID at first and then confirm whether the user ID is correct or not according to a user expression so as to accordingly control at least oneelectronic device 17. In one embodiment, the user recognition andconfirmation device 1 may be applied to a central control system for vehicles so as to perform corresponding driver settings according to the use habit of every driver, wherein the driver settings may include a seat position, a mirror angle, an air conditioner temperature, an audio setting, a steering wheel height, a light setting and a GPS (global positioning system) setting, but not limited to. However, the user recognition andconfirmation device 1 according to the embodiment of the present disclosure in not limited to be applied to the central control system for vehicles. It may be applied to any human-machine interface system that may perform the confirmation of the recognized user ID according to the facial expression of the user. - The
image sensing unit 11 may be a CCD image sensor, a CMOS image senor or the like. Theimage sensing unit 11 is configured to capture a first image frame F1 and a second image frame F2, wherein theimage sensing unit 11 may capture images at a fixed capturing frequency. For example inFIG. 1 , theimage sensing unit 11 captures images of auser 8 with a field of view (FOV). - The
face recognition unit 12 is configured to recognize a user ID according to the first image frame F1, wherein after the face feature(s) is calculated using algorithm, theface recognition unit 12 searches the corresponding user ID in thestorage unit 13 and transmits the searched user ID to thedisplay unit 14 for displaying. It is appreciated that theface recognition unit 12 may start to recognize the user ID only when the first image frame F1 includes a face image. - The
display unit 14 may be, for example, a liquid crystal display and has adisplay screen 141 and/or aspeaker 142 as shown inFIG. 2 for showing ID information of the user ID. Thedisplay unit 14 may also be other types of display. In this manner, thedisplay unit 14 may show the ID information via screen and/or sound, wherein the screen may show the user's picture, drawing or words without any limitation. - The
expression recognition unit 15 is configured to confirm a user expression according to the second image frame F2 and output a confirm signal Sc, wherein after the expression feature(s) is calculated using algorithm, theexpression recognition unit 15 searches the expression data associated with the user expression in thestorage unit 13 for comparison. In other words, thestorage unit 13 may previously save ID information of at least one user and the expression data associated with the user expression. In the embodiment of the present disclosure, said user expression is preferably a happiness expression, but not limited to. The user expression may be set according to different users, e.g. anger, terror, dislike, surprise, sadness or expressionless. - The
control unit 16 may control a setting of at least oneelectronic device 17 according to the confirm signal Sc, wherein the setting is associated with the user ID and may be set by the related user himself or herself. The setting may be the operational setting of theelectronic device 17, e.g. operational strength, operational interval and/or operational directivity, and previously saved in thestorage unit 13, wherein the setting may be different according to differentelectronic devices 17. - As mentioned above, as the second image frame F2 is for the confirmation of a user ID of the
user 8, theimage sensing unit 11 may capture the second image frame F2 after thedisplay unit 14 has shown the ID information. However, the present disclosure is not limited that theimage sensing unit 11 stops its operation in a time interval after theimage sensing unit 11 capturing the first image frame F1 and before thedisplay unit 14 showing the ID information. According to different applications theimage sensing unit 11 may continuously operate or be disabled after the first image frame F1 is captured till theexpression recognition unit 15 recognizes the user expression. - In one embodiment, the
image sensing unit 11 starts to operate to continuously capture the first image frame F1 after the starting procedure of the user recognition andconfirmation device 1 is accomplished. Therefore, preferably theface recognition unit 12 may be further configured to identify whether there is auser 8 existing in the first image frame F1. When there is no user image in the first image frame F1, a new first image frame F1 is captured. When there is a user image existing in the first image frame F1, theface recognition unit 12 starts to recognize a user ID according to the first image frame F1. - In one embodiment, the
face recognition unit 12 may be further configured to identify a user to be recognized within a plurality of users in the first image frame F1. For example, when a plurality of user images are existing in the first image frame F1 simultaneously, theface recognition unit 12 may select a closest user as the user to be recognized, wherein said closest may be identified according to the size, contrast and clearness of the user image. In addition, the user to be recognized may also be identified according to other ways, e.g. the position of the user image. After the user to be recognized is identified, theface recognition unit 12 starts to perform the user ID recognition. In addition, theuser recognition unit 12 may also perform the user ID recognition on all of the plurality of users and show the recognized results on thedisplay unit 14 simultaneously. Then, theuser 8 may confirm the ID information of a user to be recognized via theexpression recognition unit 15. - For example, when the user recognition and
confirmation device 1 is applied to a central control system for vehicles as shown inFIG. 3 , theimage sensing unit 11 is preferably disposed opposite to a driver seat. For example, theimage sensing unit 11 may be disposed on arear view mirror 91 or on acentral control panel 92, but not limited to. It may also be disposed at any suitable position as long as the driver's face image can be captured. - Referring to
FIGS. 1 and 3 , a central control system for vehicles employing the user recognition andconfirmation device 1 of the present disclosure includes theimage sensing unit 11, theface recognition unit 12, thestorage unit 13, thedisplay unit 14, theexpression recognition unit 15 and thecontrol unit 16. Theimage sensing unit 11 is configured to capture the first image frame F1 and the second image frame F2. Theface recognition unit 12 is configured to recognize a user ID according to the first image frame F1. Thedisplay unit 14 is configured to show ID information of the user ID. Theexpression recognition unit 15 is configured to confirm a user expression according to the second image frame F2 and output a confirm signal Sc. Thecontrol unit 16 is configured to read the driver setting associated with the user ID according to the confirm signal Sc. In this embodiment, in addition to that the setting is related to the driver setting, e.g. the setting(s) of the electronic device including at least one of a seat, a mirror, an air conditioner, an audio equipment, a steering wheel, a light and a GPS system, other operations are similar to those ofFIG. 1 and corresponding descriptions, and thus details thereof are not repeated herein. Therefore, in this embodiment thestorage unit 13 at least saves the ID information of at least one user, the expression data associated with the user expression and the driver setting(s) associated with different electronic devices for vehicles. - In addition, the user recognition and
confirmation device 1 of the present disclosure may also be able to update the setting information of at least one electronic device according to the user expression. A central control system for vehicles is still used as an example herein, for example theimage sensing unit 11 may capture a third image frame and theexpression recognition unit 15 may confirm a user expression according to the third image frame and generate a saving signal to thecontrol unit 16. Thecontrol unit 16 then saves the current setting information of the at least one electronic device into thestorage unit 13 according to the saving signal so as to update the setting information, e.g. updating at least one of a seat position, a mirror angle, an air conditioner temperature, an audio setting, a steering wheel height, a light setting and a GPS setting. It is appreciated that the step of updating the setting information may be performed when a data update mode is entered, and the data update mode may be entered according to an instruction from the user or directly entered after theexpression recognition unit 15 finishes the confirmation of the ID information without any limitation. - Referring to
FIG. 4 , it shows a flow chart of the user recognition and confirmation method according to the embodiment of the present disclosure, which includes the steps of: capturing a first image frame with an image sensing unit (Step S21); recognizing a user ID according to the first image frame (Step S22); showing ID information of the user ID with a display unit (Step S23); capturing a second image frame with the image sensing unit (Step S24); confirming a user expression according to the second image frame and generating a confirm signal (Step S25); controlling at least one electronic device according to the confirm signal (Step S26); capturing a third image frame with the image sensing unit (Step S27); confirming a user expression according to the third image frame and generating a saving signal (Step S28); and updating setting information of the at least one electronic device according to the saving signal (Step S29); wherein when the user recognition and confirmation method of this embodiment is applied to a central control system for vehicles, said electronic device may be at least one of a seat, a mirror, an air conditioner, an audio equipment, a steering wheel, a light and a GPS system, but not limited to. Details of every step of this embodiment have been described inFIGS. 1 and 3 and corresponding descriptions and thus they are not repeated herein.FIG. 4 describes an embodiment of the performing sequence of every step. - Referring to
FIG. 4A , it shows another flow chart of the user recognition and confirmation method according to the embodiment of the present disclosure that may be arranged between the Steps S21 and S22 ofFIG. 4 so as to identify whether there is a user appearing in the first image frame F1 (Step S211). When there is no user appearing in the first image frame F1, the process returns to the Step S21 to capture a new first image frame F1. When there is a user appearing in the first image frame F1, theface recognition unit 12 starts to recognize a user ID according to the first image frame F1. - Referring to
FIG. 4B , it shows another flow chart of the user recognition and confirmation method according to the embodiment of the present disclosure that may be arranged between the Steps S21 and S22 ofFIG. 4 so as to identify whether there are a plurality of users appearing in the first image frame F1 (Step S212). When there is no user appearing in the first image frame F1, the process returns to the Step S21 to capture a new first image frame F1. When there are a plurality of users appearing in the first image frame F1, theface recognition unit 12 identifies a user to be recognized within the plurality of users in the first image frame F1 at first (Step S213) and then recognizes a user ID of the user to be recognized (Step S22), wherein as mentioned above the user to be recognized may be identified according to a user distance or a user position. - Referring to
FIG. 5 , it shows a schematic block diagram of the user recognition and confirmation device according to another embodiment of the present disclosure. The difference betweenFIG. 5 andFIG. 1 is that inFIG. 5 the second image frame F2 is firstly transmitted to theface recognition unit 12 and then transmitted to theexpression recognition unit 15, and other parts are similar toFIG. 1 . For example in one embodiment, after thedisplay unit 14 has shown the ID information, theface recognition unit 12 sends the second image frame F2 to theexpression recognition unit 15. In another embodiment, when theface recognition unit 12 informs thedisplay unit 14 to show the ID information, the image frame captured by the image sensing unit 11 (i.e. the second image frame F2) is sent to theexpression recognition unit 15, and the expression recognition may be performed at the same time thedisplay unit 14 is showing the ID information or after the ID information has been shown. In another embodiment, theface recognition unit 12 and theexpression recognition unit 15 may perform respective recognition operations using the same image frame; i.e. the first image frame F1 and the second image frame F2 may be the same image frame. - As mentioned above, the conventional face recognition technology and the expression recognition technology use different algorithms and have different applications. Therefore, the present disclosure further provides a user recognition and confirmation device (
FIG. 1 ) and a user recognition and confirmation method (FIG. 4 ) that may confirm whether the user ID is correct or not through the user expression and may be applied to the central control system for vehicles so as to eliminate the inconvenience caused by different driver settings associated with different drivers. - Although the disclosure has been explained in relation to its preferred embodiment, it is not used to limit the disclosure. It is to be understood that many other possible modifications and variations can be made by those skilled in the art without departing from the spirit and scope of the disclosure as hereinafter claimed.
Claims (20)
1. A user recognition and confirmation device, comprising:
an image sensing unit configured to capture a first image frame and a second image frame;
a face recognition unit configured to recognize a user ID according to the first image frame;
a display unit configured to show ID information of the user ID; and
an expression recognition unit configured to confirm a user expression according to the second image frame and output a confirm signal.
2. The user recognition and confirmation device as claimed in claim 1 , further comprising a storage unit configured to save ID information of at least one user and expression data associated with the user expression.
3. The user recognition and confirmation device as claimed in claim 1 , further comprising a control unit configured to control a setting of at least one electronic device according to the confirm signal.
4. The user recognition and confirmation device as claimed in claim 3 , wherein the setting is associated with the user ID.
5. The user recognition and confirmation device as claimed in claim 3 , further comprising a storage unit configured to save the setting.
6. The user recognition and confirmation device as claimed in claim 1 , wherein the image sensing unit captures the second image frame after the display unit shows the ID information.
7. The user recognition and confirmation device as claimed in claim 1 , wherein the face recognition unit is further configured to identify whether there is a user existing in the first image frame.
8. The user recognition and confirmation device as claimed in claim 1 , wherein the face recognition unit is further configured to identify a user to be recognized within a plurality of users in the first image frame.
9. A central control system for vehicles, comprising:
an image sensing unit configured to capture a first image frame and a second image frame;
a face recognition unit configured to recognize a user ID according to the first image frame;
a display unit configured to show ID information of the user ID;
an expression recognition unit configured to confirm a user expression according to the second image frame and output a confirm signal; and
a control unit configured to read a driver setting associated with the user ID according to the confirm signal.
10. The central control system as claimed in claim 9 , wherein the image sensing unit is disposed opposite to a driver seat.
11. The central control system as claimed in claim 9 , wherein the driver setting comprises at least one of a seat position, a mirror angle, an air conditioner temperature, an audio setting, a steering wheel height, a light setting and a GPS setting.
12. The central control system as claimed in claim 9 , further comprising a storage unit configured to save ID information of at least one user, expression data associated with the user expression and the driver setting.
13. The central control system as claimed in claim 9 , wherein the image sensing unit captures the second image frame after the display unit shows the ID information.
14. The central control system as claimed in claim 9 , wherein the face recognition unit is further configured to identify whether there is a user existing in the first image frame.
15. The central control system as claimed in claim 9 , wherein the face recognition unit is further configured to identify a user to be recognized within a plurality of users in the first image frame.
16. The central control system as claimed in claim 9 , wherein the display unit shows the ID information through at least one of a screen and a sound.
17. A user recognition and confirmation method, comprising:
capturing a first image frame with an image sensing unit;
recognizing a user ID according to the first image frame;
showing ID information of the user ID with a display unit;
capturing a second image frame with the image sensing unit;
confirming a user expression according to the second image frame and generating a confirm signal; and
controlling at least one electronic device according to the confirm signal.
18. The user recognition and confirmation method as claimed in claim 17 , wherein the electronic device comprises at least one of a seat, a mirror, an air conditioner, an audio equipment, a steering wheel, a light and a GPS system.
19. The user recognition and confirmation method as claimed in claim 17 , further comprising at least one of:
identifying whether there is a user in the first image frame; and
identifying a user to be recognized within a plurality of users in the first image frame.
20. The user recognition and confirmation method as claimed in claim 17 , further comprising:
capturing a third image frame with the image sensing unit;
confirming a user expression according to the third image frame and generating a saving signal; and
updating setting information of the at least one electronic device according to the saving signal.
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US16/252,769 US11222197B2 (en) | 2012-10-22 | 2019-01-21 | User recognition and confirmation method |
US17/534,870 US11847857B2 (en) | 2012-10-22 | 2021-11-24 | Vehicle device setting method |
US18/386,603 US20240071136A1 (en) | 2012-10-22 | 2023-11-03 | Vehicle device setting method |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW101138995 | 2012-10-22 | ||
TW101138995A TWI490792B (en) | 2012-10-22 | 2012-10-22 | User recognition and confirmation device and method, and central control system for vehicles using the same |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/252,769 Division US11222197B2 (en) | 2012-10-22 | 2019-01-21 | User recognition and confirmation method |
Publications (1)
Publication Number | Publication Date |
---|---|
US20140112554A1 true US20140112554A1 (en) | 2014-04-24 |
Family
ID=50485378
Family Applications (4)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/047,682 Abandoned US20140112554A1 (en) | 2012-10-22 | 2013-10-07 | User recognition and confirmation device and method, and central control system for vehicles using the same |
US16/252,769 Active 2033-11-30 US11222197B2 (en) | 2012-10-22 | 2019-01-21 | User recognition and confirmation method |
US17/534,870 Active 2034-03-18 US11847857B2 (en) | 2012-10-22 | 2021-11-24 | Vehicle device setting method |
US18/386,603 Pending US20240071136A1 (en) | 2012-10-22 | 2023-11-03 | Vehicle device setting method |
Family Applications After (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/252,769 Active 2033-11-30 US11222197B2 (en) | 2012-10-22 | 2019-01-21 | User recognition and confirmation method |
US17/534,870 Active 2034-03-18 US11847857B2 (en) | 2012-10-22 | 2021-11-24 | Vehicle device setting method |
US18/386,603 Pending US20240071136A1 (en) | 2012-10-22 | 2023-11-03 | Vehicle device setting method |
Country Status (2)
Country | Link |
---|---|
US (4) | US20140112554A1 (en) |
TW (1) | TWI490792B (en) |
Cited By (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9428055B2 (en) * | 2014-05-08 | 2016-08-30 | Hyundai Motor Company | Vehicle, terminal communicating with the vehicle, and method of controlling the vehicle |
CN106407957A (en) * | 2016-11-04 | 2017-02-15 | 四川诚品电子商务有限公司 | Courthouse image acquisition alarm apparatus |
US20170177935A1 (en) * | 2015-12-22 | 2017-06-22 | Gentex Corporation | Mirror assembly incorporating a scanning apparatus |
US20180099612A1 (en) * | 2016-10-06 | 2018-04-12 | Gentex Corporation | Rearview assembly with occupant detection |
CN108734152A (en) * | 2018-06-28 | 2018-11-02 | 北京云识图信息技术有限公司 | Personnel's basic information integral collecting device |
US10192110B2 (en) | 2014-07-09 | 2019-01-29 | Pixart Imaging Inc. | Vehicle safety system and operating method thereof |
CN109398310A (en) * | 2018-09-26 | 2019-03-01 | 深圳万智联合科技有限公司 | A kind of pilotless automobile |
US20190176837A1 (en) * | 2017-12-08 | 2019-06-13 | Tesla, Inc. | Personalization system and method for a vehicle based on spatial locations of occupants' body portions |
GB2572317A (en) * | 2018-03-06 | 2019-10-02 | Skoogmusic Ltd | Control apparatus and method |
Families Citing this family (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
TWI647728B (en) * | 2017-04-07 | 2019-01-11 | 致伸科技股份有限公司 | Vehicle control device and method thereof |
US10867161B2 (en) * | 2017-09-06 | 2020-12-15 | Pixart Imaging Inc. | Auxiliary filtering device for face recognition and starting method for electronic device |
CN110758325A (en) * | 2019-10-23 | 2020-02-07 | 上海能塔智能科技有限公司 | Face authentication method and device for vehicle, storage medium, terminal and automobile |
CN112689826B (en) * | 2020-04-09 | 2021-12-17 | 华为技术有限公司 | Method and device for generating instruction unit group |
CN112912882A (en) * | 2020-07-28 | 2021-06-04 | 深圳市大疆创新科技有限公司 | Control method and device of terminal equipment and storage medium |
Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20070061152A1 (en) * | 2005-09-15 | 2007-03-15 | Kabushiki Kaisha Toshiba | Apparatus and method for translating speech and performing speech synthesis of translation result |
US20080029214A1 (en) * | 2006-08-04 | 2008-02-07 | Zephyros, Inc. | Multiple or single stage cure adhesive material and method of use |
US20080112598A1 (en) * | 2006-11-14 | 2008-05-15 | Lctank Llc | Apparatus and method for indentifying a name coressponding to a face or voice using a database |
US20080292146A1 (en) * | 1994-05-09 | 2008-11-27 | Automotive Technologies International, Inc. | Security System Control for Monitoring Vehicular Compartments |
US20100194906A1 (en) * | 2009-01-23 | 2010-08-05 | Nikon Corporation | Display apparatus and imaging apparatus |
US20110317874A1 (en) * | 2009-02-19 | 2011-12-29 | Sony Computer Entertainment Inc. | Information Processing Device And Information Processing Method |
US20120030596A1 (en) * | 2009-10-05 | 2012-02-02 | David H Hanes | User interface |
US20120148117A1 (en) * | 2010-12-08 | 2012-06-14 | Hyundai Motor Company | System and method for facial identification |
Family Cites Families (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7359529B2 (en) * | 2003-03-06 | 2008-04-15 | Samsung Electronics Co., Ltd. | Image-detectable monitoring system and method for using the same |
KR20050089272A (en) * | 2004-03-04 | 2005-09-08 | 삼성전자주식회사 | Key for vehicle having memory and method for controlling a vehicle using the same |
CN101089905A (en) * | 2006-06-16 | 2007-12-19 | 鸿富锦精密工业(深圳)有限公司 | Vehicle safety system |
CN102034334B (en) * | 2009-09-28 | 2012-12-19 | 财团法人车辆研究测试中心 | Driver monitoring method and monitoring system thereof |
TW201226245A (en) * | 2010-12-31 | 2012-07-01 | Altek Corp | Vehicle apparatus control system and method thereof |
TWI476704B (en) * | 2011-03-30 | 2015-03-11 | Pixart Imaging Inc | Recognizing devices and methods |
CN202320178U (en) * | 2011-10-21 | 2012-07-11 | 同致电子企业股份有限公司 | Vehicle detection warning system |
-
2012
- 2012-10-22 TW TW101138995A patent/TWI490792B/en active
-
2013
- 2013-10-07 US US14/047,682 patent/US20140112554A1/en not_active Abandoned
-
2019
- 2019-01-21 US US16/252,769 patent/US11222197B2/en active Active
-
2021
- 2021-11-24 US US17/534,870 patent/US11847857B2/en active Active
-
2023
- 2023-11-03 US US18/386,603 patent/US20240071136A1/en active Pending
Patent Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20080292146A1 (en) * | 1994-05-09 | 2008-11-27 | Automotive Technologies International, Inc. | Security System Control for Monitoring Vehicular Compartments |
US20070061152A1 (en) * | 2005-09-15 | 2007-03-15 | Kabushiki Kaisha Toshiba | Apparatus and method for translating speech and performing speech synthesis of translation result |
US20080029214A1 (en) * | 2006-08-04 | 2008-02-07 | Zephyros, Inc. | Multiple or single stage cure adhesive material and method of use |
US20080112598A1 (en) * | 2006-11-14 | 2008-05-15 | Lctank Llc | Apparatus and method for indentifying a name coressponding to a face or voice using a database |
US20100194906A1 (en) * | 2009-01-23 | 2010-08-05 | Nikon Corporation | Display apparatus and imaging apparatus |
US20110317874A1 (en) * | 2009-02-19 | 2011-12-29 | Sony Computer Entertainment Inc. | Information Processing Device And Information Processing Method |
US20120030596A1 (en) * | 2009-10-05 | 2012-02-02 | David H Hanes | User interface |
US20120148117A1 (en) * | 2010-12-08 | 2012-06-14 | Hyundai Motor Company | System and method for facial identification |
Cited By (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9428055B2 (en) * | 2014-05-08 | 2016-08-30 | Hyundai Motor Company | Vehicle, terminal communicating with the vehicle, and method of controlling the vehicle |
US10192110B2 (en) | 2014-07-09 | 2019-01-29 | Pixart Imaging Inc. | Vehicle safety system and operating method thereof |
US20170177935A1 (en) * | 2015-12-22 | 2017-06-22 | Gentex Corporation | Mirror assembly incorporating a scanning apparatus |
US10769434B2 (en) * | 2015-12-22 | 2020-09-08 | Gentex Corporation | Mirror assembly incorporating a scanning apparatus |
US20180099612A1 (en) * | 2016-10-06 | 2018-04-12 | Gentex Corporation | Rearview assembly with occupant detection |
CN106407957A (en) * | 2016-11-04 | 2017-02-15 | 四川诚品电子商务有限公司 | Courthouse image acquisition alarm apparatus |
US20190176837A1 (en) * | 2017-12-08 | 2019-06-13 | Tesla, Inc. | Personalization system and method for a vehicle based on spatial locations of occupants' body portions |
US11465631B2 (en) * | 2017-12-08 | 2022-10-11 | Tesla, Inc. | Personalization system and method for a vehicle based on spatial locations of occupants' body portions |
GB2572317A (en) * | 2018-03-06 | 2019-10-02 | Skoogmusic Ltd | Control apparatus and method |
CN108734152A (en) * | 2018-06-28 | 2018-11-02 | 北京云识图信息技术有限公司 | Personnel's basic information integral collecting device |
CN109398310A (en) * | 2018-09-26 | 2019-03-01 | 深圳万智联合科技有限公司 | A kind of pilotless automobile |
Also Published As
Publication number | Publication date |
---|---|
US20240071136A1 (en) | 2024-02-29 |
TWI490792B (en) | 2015-07-01 |
US20190156111A1 (en) | 2019-05-23 |
TW201416998A (en) | 2014-05-01 |
US20220083765A1 (en) | 2022-03-17 |
US11222197B2 (en) | 2022-01-11 |
US11847857B2 (en) | 2023-12-19 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11222197B2 (en) | User recognition and confirmation method | |
JP4633043B2 (en) | Image processing device | |
US7853051B2 (en) | Recognizing apparatus and method, recording media, and program | |
WO2019214201A1 (en) | Live body detection method and apparatus, system, electronic device, and storage medium | |
US20170154221A1 (en) | Video categorization method and apparatus, and storage medium | |
JP5662670B2 (en) | Image processing apparatus, image processing method, and program | |
JP2012123804A (en) | System and method for facial identification | |
KR20150055543A (en) | Gesture recognition device and gesture recognition device control method | |
CN103916592A (en) | Apparatus and method for photographing portrait in portable terminal having camera | |
US20140152549A1 (en) | System and method for providing user interface using hand shape trace recognition in vehicle | |
JP2012226665A (en) | Information processing device, processing method thereof, program and imaging apparatus | |
CN106682736A (en) | Image identification method and apparatus | |
JP2005318546A (en) | Image recognition system, image recognition method, and image recognition program | |
EP3381180B1 (en) | Photographing device and method of controlling the same | |
US20130162792A1 (en) | Notifying system and method | |
CN107832726B (en) | User identification and confirmation device and vehicle central control system | |
JP2008026999A (en) | Obstacle detection system and obstacle detection method | |
CN110246206B (en) | Eyebrow penciling assisting method, device and system | |
CN107548483B (en) | Control method, control device, system and motor vehicle comprising such a control device | |
CN113873165A (en) | Photographing method and device and electronic equipment | |
CN112182256A (en) | Object identification method and device and vehicle | |
CN114071005B (en) | Object detection method, electronic device and computer-readable storage medium | |
US11790692B2 (en) | Method for behaviour recognition, electronic equipment, and storage medium | |
JP2015126369A (en) | Imaging apparatus | |
JP2013007851A (en) | Imaging apparatus |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: PIXART IMAGING INC., JAPAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:CHIU, LIANG-CHI;CHEN, YU-HAN;KAO, MING-TSAN;REEL/FRAME:031357/0536 Effective date: 20120924 |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |