US7466847B2 - Driver's appearance recognition system - Google Patents
Driver's appearance recognition system Download PDFInfo
- Publication number
- US7466847B2 US7466847B2 US11/100,497 US10049705A US7466847B2 US 7466847 B2 US7466847 B2 US 7466847B2 US 10049705 A US10049705 A US 10049705A US 7466847 B2 US7466847 B2 US 7466847B2
- Authority
- US
- United States
- Prior art keywords
- driver
- appearance recognition
- current
- camera
- setup value
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related, expires
Links
- 238000000034 method Methods 0.000 claims abstract description 114
- 230000008569 process Effects 0.000 claims abstract description 111
- 238000001514 detection method Methods 0.000 claims abstract description 82
- 238000005286 illumination Methods 0.000 claims abstract description 53
- 230000005855 radiation Effects 0.000 claims description 41
- 238000005259 measurement Methods 0.000 claims description 5
- 238000012545 processing Methods 0.000 abstract description 71
- 230000006870 function Effects 0.000 description 38
- 230000008859 change Effects 0.000 description 9
- 210000000744 eyelid Anatomy 0.000 description 5
- 210000001747 pupil Anatomy 0.000 description 5
- 239000000284 extract Substances 0.000 description 4
- 238000006243 chemical reaction Methods 0.000 description 3
- 230000007423 decrease Effects 0.000 description 3
- 230000003247 decreasing effect Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 208000016339 iris pattern Diseases 0.000 description 2
- 230000002265 prevention Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 1
- 230000001815 facial effect Effects 0.000 description 1
- 210000003128 head Anatomy 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 239000013589 supplement Substances 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R25/00—Fittings or systems for preventing or indicating unauthorised use or theft of vehicles
- B60R25/20—Means to switch the anti-theft system on or off
- B60R25/25—Means to switch the anti-theft system on or off using biometry
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R25/00—Fittings or systems for preventing or indicating unauthorised use or theft of vehicles
- B60R25/20—Means to switch the anti-theft system on or off
- B60R25/25—Means to switch the anti-theft system on or off using biometry
- B60R25/255—Eye recognition
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T1/00—General purpose image data processing
Definitions
- the present invention relates to a system to recognize driver's appearance using a vehicle driver's face image captured by a camera.
- the present invention is used for car antitheft systems, usability improvement systems, or accident prevention systems.
- an individual authentication system using face images extracts a pupil's iris pattern from driver's face images captured by a camera.
- the system collates the extracted pattern with a previously registered iris pattern (e.g., see Patent Document 1).
- user recognition control means allows an engine to start in order to use the individual authentication for protecting the car against theft.
- the environment such as in-vehicle units is configured for a user in order to use the individual authentication for improving the usability.
- Non-Patent Document 1 As another technical field, there is known a face authentication system (e.g., see Non-Patent Document 1) to ensure the security management of entry to or exit from rooms such as offices.
- the user recognition control means uses a camera to capture shading such as face images and identifies the shading as a feature quantity attributed to an individual.
- the system collates the feature quantity with a previously registered feature quantity to implement the individual authentication.
- the feature quantity represents shading patterns, the gradient amount of shading changes, and the like, in the vicinity of facial parts.
- closed-eye detection means extracts an eye portion from the face image captured by a camera.
- the system chronologically detects whether the eye is opened or closed based on the number of pixels between upper and lower eyelids.
- the system uses determination means to determine whether or not a driver falls asleep at the wheel based on a detection result from the closed-eye detection means (e.g., see Patent Document 2).
- infrared light radiation means such as a light emitting diode.
- the infrared light radiation means radiates infrared light to a user's face.
- the present invention relates to a system which can be mounted on a vehicle capable of performing both the above-mentioned individual authentication and closed-eye detection using face images.
- the individual authentication and the closed-eye detection using face images both use a camera to obtain face images by radiating infrared light. Accordingly, the camera, the infrared light radiation means, and the like can be shared.
- the infrared light radiation means such as a light emitting diode is used to apply a specified current and provide constant illumination intensity.
- Current supply means supplies the infrared light radiation means with a constant current to provide specified illumination intensity.
- the current supply means is previously assigned a current value to be supplied to the infrared light radiation means.
- the individual authentication requires a higher illumination intensity than the closed-eye detection for the following reason.
- Feature quantities need to be strictly detected on an individual authentication system that identifies shades in a face image to be the feature quantity attributed to an individual.
- the feature quantity varies with face images when the light is applied to the entire face and when the west sunlight is applied to a half of the driver's face in the evening.
- the above-mentioned individual authentication system requires somewhat controlled illumination environment so that the constant feature quantity can be obtained from face images.
- the closed-eye detection system just requires the illumination intensity so controlled as to be able to capture an eye's outline and detect the eye's inside movement.
- the infrared light radiation means needs to be supplied with a current value large enough to provide the illumination intensity needed for the individual authentication.
- the closed-eye detection aims at preventing drivers from falling asleep at the wheel. Accordingly, the closed-eye detection is always performed while a driver is driving the vehicle.
- the infrared light radiation means such as the light emitting diode.
- the service life of the infrared light radiation means becomes short.
- Such problem is not limited to the case of equipping vehicles with the system performing the individual authentication and the closed-eye detection.
- the problem also occurs in a system to perform a plurality of appearance authentications differing in necessary illumination intensities on face images used for the driver's appearance recognition.
- the problem becomes particularly remarkable for the case of equipping a vehicle with the individual authentication system and the closed-eye detection. That is, the former is a function that needs to strictly detect the face image's feature quantity.
- the latter is a function that need not strictly detect the face image's feature quantity.
- the present invention has been made in consideration of the foregoing. It is therefore an object of the present invention to provide a driver's appearance recognition system which performs a plurality of driver's appearance authentications and is capable of prolonging the service life of infrared light radiation means.
- a driver's appearance recognition system is provided with the following.
- a camera is included for capturing a face image of a driver's face.
- Infrared light radiation means is included for radiating an infrared ray to the driver's face and changing illumination intensity according to the amount of supplied current when the camera captures the face image.
- Appearance recognition control means is included for, based on a face image captured by the camera, executing a first driver's appearance recognition process to recognize a driver's appearance and a second driver's appearance recognition process different from the first driver's appearance recognition process and for controlling the camera and the infrared light radiation means.
- current amount control means is included for providing control that a first setup value is defined for a setup value of current supplied to the infrared light radiation means when the appearance recognition control means executes the driver's appearance recognition process and that a second setup value different from the first setup value is defined for a setup value of current supplied to the infrared light radiation means when the appearance recognition control means executes the second driver's appearance recognition process.
- the current supply means supplies the constant amount of current supplied to the infrared light radiation means.
- the amount of current is configured so that the illumination intensity for the infrared light radiation means becomes equal to that for a first or second driver's appearance recognition process whichever requires a high illumination intensity.
- the system does not have control means capable of changing the amount of current to two or more setup values.
- Such system supplies a large current to the infrared light radiation means during image capture not only for the driver's appearance recognition process requiring a high illumination intensity, but also for the other driver's appearance recognition process not requiring a high illumination intensity.
- the present invention can use the current control means to change the amount of current supplied to the infrared light radiation means according to the types of the driver's appearance recognition processes. Accordingly, the present invention can change the illumination intensity for capturing face images through the camera to illumination intensities needed for various types of driver's appearance recognition processes.
- the present invention can use the current amount control means to increase the amount of current supplied to the infrared light radiation means so as to increase the illumination intensity during the image capture.
- the amount of current supplied to the infrared light radiation means can be made smaller than that for execution of the first driver's appearance recognition process. This aims at ensuring the illumination intensity required for the second driver's appearance recognition process.
- An image may be captured for the second driver's appearance recognition process not requiring so high illumination intensity as the first driver's appearance recognition process.
- the present invention can decrease the amount of current supplied to the infrared light radiation means compared to the system not having the current amount control means.
- the present invention can extend the service life of the infrared light radiation means compared to the system not having the current amount control means.
- FIG. 1 shows the configuration of a driver's appearance recognition system according to a first embodiment of the present invention
- FIG. 2 is a flowchart of the prior art showing a driver's appearance recognition process according to the first embodiment
- FIG. 3 is a flowchart showing a driver's appearance recognition process according to a second embodiment of the present invention.
- FIG. 4 shows the configuration of a driver's appearance recognition system according to a third embodiment of the present invention.
- FIG. 5 is a flowchart showing a driver's appearance recognition process according to the third embodiment.
- the driver's appearance recognition system performs individual authentication and closed-eye detection.
- FIG. 1 shows the configuration of the driver's appearance recognition system according to a first embodiment of the present invention.
- the system comprises a weight detection switch 1 as riding detection means; a camera 2 ; a near infrared ray light emitting diode 3 as infrared light radiation means; a near infrared ray light emitting diode's current control circuit 4 as current amount control means; and an image processing circuit 5 as appearance recognition control means.
- the near infrared ray light emitting diode 3 is referred to as the near infrared ray LED 3 .
- the near infrared ray light emitting diode's current control circuit 4 is referred to as the LED current control circuit 4 .
- the weight detection switch 1 detects the presence of a driver and is built in a driver's seat surface. When detecting the driver, the weight detection switch 1 issues a signal notifying this detection to the image processing circuit 5 .
- the camera 2 is represented as the near infrared ray camera 2 , for example, and captures face images of the driver sitting in the driver's seat.
- the camera 2 is positioned in the car interior so as to be able to capture the face of the driver sitting in the driver's seat.
- the camera 2 is mounted on an instrument panel as shown in FIG. 1 and is placed at a hardly recognizable position far back from the panel front.
- the camera 2 can be disposed near a face outlet of an air conditioner at the center of the instrument panel. However, the camera 2 can be appropriately installed at such a position as to capture the driver's face from the front. It is more preferable to position the camera in front of the driver's seat than the center of the instrument panel.
- the camera 2 operates by receiving an operation instruction signal from the image processing circuit 5 .
- the camera 2 outputs the driver's face image to the image processing circuit 5 .
- the near infrared ray LED 3 radiates a near infrared ray to the driver's face. Like the camera 2 , the near infrared ray LED 3 is also installed on the instrument panel and is positioned near the camera 2 . According to the embodiment, a plurality of near infrared ray LEDs 3 is disposed at both sides of the camera 2 .
- the plurality of near infrared ray LEDs 3 is disposed at both sides of the camera 2 because a near infrared ray needs to be symmetrically, i.e., evenly radiated to the driver's face.
- the near infrared ray LED 3 lights when supplied with current from the LED current control circuit 4 .
- a control circuit (not shown) is used to control the near infrared ray LED 3 so as to light in interlock with a shutter of the camera 2 .
- the camera captures 30 frames of image per second. Accordingly, the near infrared ray LED 3 lights each time the camera 2 acquires one frame of image. That is, the near infrared ray LED 3 starts lighting synchronously with shutter opening and stops lighting synchronously with shutter closing.
- the LED current control circuit 4 controls the amount of current applied to the near infrared ray LED 3 and is mounted on a vehicle.
- the LED current control circuit 4 can switch between a plurality of current values supplied to the near infrared ray LED 3 .
- the plurality of current values is configured in accordance with functions provided for the image processing circuit 5 .
- the embodiment supplies a high current to the near infrared ray LED 3 when performing the individual authentication.
- the embodiment supplies a low current to the near infrared ray LED 3 when performing the closed-eye detection.
- the low-current value is smaller than a current value for the individual authentication and is large enough to provide the illumination intensity for performing the closed-eye detection.
- the LED current control circuit 4 receives an instruction signal from the image processing circuit 5 to change setup current values supplied to the near infrared ray LED 3 .
- the LED current control circuit 4 can also change setup current values so as to fine-tune the illumination intensity of the near infrared ray LED 3 by receiving an instruction signal from the image processing circuit 5 .
- the fine-tuning is performed when a face image obtained by the camera 2 shows an illumination intensity outside a specified range and the camera 2 obtains another face image as a feedback. That is, the fine-tuning function is performed only when the face image's illumination intensity is too low or high.
- the fine-tuning function differs from the function to change setup current values in accordance with an individual authentication process or a closed-eye detection process.
- the image processing circuit 5 has functions to perform the individual authentication process and the closed-eye detection process.
- the individual authentication process and the closed-eye detection process are equivalent to two driver's appearance recognition processes.
- the image processing circuit 5 is mounted on a vehicle and mainly comprises a DSP (Digital Signal Processor), a CPU, memory, and a voltage conversion circuit.
- DSP Digital Signal Processor
- the DSP receives an operation instruction signal from the CPU, processes a face image input from the camera 2 , and performs the individual authentication or the closed-eye detection.
- the CPU controls the entire system. That is, the CPU outputs operation instruction signals to the camera 2 , the LED current control circuit 4 , and the DSP. Based on the operation instruction signals, the LED current control circuit 4 changes the setup current value.
- the camera 2 obtains a driver's face image and outputs it to the image processing circuit 5 .
- the DSP performs individual verification or closed-eye detection.
- the memory temporarily stores a face image input from the camera 2 .
- the memory previously stores driver's feature quantity used for the individual authentication.
- the DSP processes the face image temporarily stored in the memory to detect the feature quantity.
- the DSP collates the detected feature quantity with the driver's feature quantity previously stored in the memory.
- the voltage conversion circuit converts a voltage supplied from a battery into a necessary voltage. Via the voltage conversion circuit, the battery supplies necessary voltages to the camera 2 , the near infrared ray LED 3 , the LED current control circuit 4 , the CPU of the image processing circuit 5 , the DSP, and the like.
- the image processing circuit 5 is so configured that the weight detection switch 1 inputs passenger detection signals to the CPU.
- the ECU (not shown) inputs a signal notifying this state change.
- the image processing circuit 5 becomes standby.
- the weight detection switch 1 may input a passenger detection signal.
- the image processing circuit 5 allows the CPU to output start instruction signals to the camera 2 , the LED current control circuit 4 , and the DSP.
- FIG. 2 shows a flowchart of the driver's appearance recognition process executed by the image processing circuit 5 .
- a door ECU supplies the image processing circuit 5 with a signal notifying this state change. Based on this signal, the image processing circuit 5 is supplied with power from the battery and becomes ready for operation.
- the weight detection switch 1 inputs a passenger detection signal to the image processing circuit 5 at Step 11 .
- the CPU of the image processing circuit 5 , the DSP, and the like receive the passenger detection signal to start.
- the CPU outputs a startup instruction signal to the camera 2 and the LED current control circuit 4 .
- the camera 2 and the LED current control circuit 4 start.
- the CPU outputs an instruction signal to the LED current control circuit 4 so as to specify high current output.
- the LED current control circuit 4 assigns a high current value to the setup value of a current supplied to the near infrared ray LED 3 .
- the individual authentication process starts. That is, the CPU outputs an instruction signal notifying acquisition of a driver's face image to the camera 2 and the near infrared ray LED 3 . Consequently, the near infrared ray LED 3 radiates a near infrared ray to the driver's face. The camera 2 captures the driver's face.
- the LED current control circuit 4 is set to the high current value.
- the near infrared ray LED 3 is supplied with a high current from the LED current control circuit 4 . Therefore, the camera 2 can acquire the driver's face image under environment where the high illumination intensity is available.
- the face image captured by the camera 2 is output from the camera 2 and is input to the image processing circuit 5 .
- the DSP executes the individual authentication process using the face image input to the image processing circuit 5 .
- This face image process is similar to Non-Patent Document 1, for example.
- the DSP detects face's positions from the face image.
- the DSP detects a plurality of face's feature points as a range of the feature quantity to be detected.
- the DSP extracts the feature quantity specific to the driver from each feature point.
- the DSP collates the extracted feature quantity with the feature quantity previously stored in the memory.
- Step 18 it is determined whether or not the authentication is complete. That is, the DSP determines whether or not the collation at Step 17 succeeds.
- the CPU When the DSP determines that the collation is successful, the CPU outputs an instruction signal to allow the engine to start to an engine ECU (not shown). This terminates the individual authentication process by the image processing circuit 5 .
- Step 15 When the DSP determines that the collation is unsuccessful, the engine is not allowed to start. The process returns to Step 15 and repeats Steps 15 through 17 until the collation is determined to be successful at Step 18 .
- the collation may fail because of the illumination intensity of the face image captured by the camera 2 .
- the CPU of the image processing circuit 5 outputs an instruction signal to the LED current control circuit 4 .
- this signal adjusts the current value of the current supplied to the near infrared ray LED 3 so as to be slightly higher or lower than the setup current value during the individual authentication.
- the illumination intensity of the near infrared ray LED 3 is optimally adjusted for the individual authentication.
- the CPU of the image processing circuit 5 outputs an instruction signal to the camera 2 to adjust a diaphragm of the camera 2 . This can also adjust the face image's illumination intensity.
- This fine-adjustment is performed not only at Step 18 where the collation is determined to be unsuccessful, but also at Step 16 . That is, the memory previously stores the range of illumination intensity needed for face images used for the individual authentication process.
- the DSP determines whether or not the face image's illumination intensity input to the image processing circuit 5 is within the range of illumination intensity stored in the memory. When the DSP determines that the input face image's illumination intensity is inappropriate, the CPU outputs instruction signals to the LED current control circuit 4 and the camera 2 . This adjusts the illumination intensity of the near infrared ray LED 3 and a diaphragm value of the camera 2 .
- the CPU When the authentication is determined to be successful at Step 18 , the CPU outputs an instruction signal to allow the engine to start. At Step 19 , the completion of the individual authentication process is followed by preparation of the closed-eye detection process.
- the CPU outputs an instruction signal to the LED current control circuit 4 so as to output a low current.
- the LED current control circuit 4 allocates a low current value as the setup value supplied to the near infrared ray LED 3 .
- Step 20 the closed-eye detection process starts.
- the closed-eye detection process is repeated at a specified cycle while the driver is driving the vehicle.
- Step 15 the CPU of the image processing circuit 5 outputs an instruction signal to the camera 2 and the near infrared ray LED 3 so as to notify acquisition of the driver's face image.
- the near infrared ray LED 3 is supplied with a low current from the LED current control circuit 4 because the circuit 4 is set to the low current value.
- the face image captured by the camera 2 is output from the camera 2 to the image processing circuit 5 .
- the face image is input to the image processing circuit 5 .
- the DSP executes the closed-eye detection process using the face image input to the image processing circuit 5 .
- the closed-eye detection process is similar to the process as described in Patent Document 2.
- the closed-eye detection process uses software that differs from the software used for the individual authentication process at Step 17 .
- the DSP receives an instruction from the CPU of the image processing circuit 5 and detects the face position from the face image input from the camera 2 . Further, the DSP extracts an eye section and detects the number of black pixels between upper and lower eyelids. At this time, the face position detection can use the result obtained at Step 16 .
- the DSP chronologically detects whether the driver's eye is opened or closed. Based on the chronologically detected state of the opened or closed eye, the DSP determines whether or not the driver is drowsy. This determination is performed periodically. Generally, when a person blinks, the eyelids are closed 0.1 second, for example. When the eyelids are closed 0.4 second or more, for example, the DSP determines the driver to be drowsy.
- the DSP can be allowed to determine whether or not the driver is drowsy as follows. For example, the system measures the driver's blink speed and the period of time the eyes remain closed for five minutes from the time when the driver starts driving. The measurement result is previously stored in the memory of the image processing circuit 5 . The DSP compares a detection result from the closed-eye detection process with the measurement result already stored in the memory. In this manner, it is possible to determine whether or not the driver is drowsy.
- the CPU When the DSP determines that the driver is drowsy, the CPU receives a signal notifying this state and outputs an alarm instruction signal to a buzzer (not shown). The buzzer then sounds an alarm to alert the driver.
- the CPU of the image processing circuit 5 determines at Step 23 whether or not to terminate the closed-eye detection process itself. That is, it is determined whether or not the engine stops. At this time, it is determined whether or not an ignition switch supplies a signal to stop the engine. When the engine is determined to stop, the process proceeds to Step 24 . When the engine is determined not to stop, the closed-eye detection process continues at Step 21 .
- Step 24 the CPU outputs a stop instruction signal to the camera 2 , the near infrared ray LED 3 , the LED current control circuit 4 , and the DSP. Consequently, the system stops and becomes standby.
- the driver opens the door, locks it, and leaves the vehicle.
- the door ECU inputs a signal to the image processing circuit 5 so as to notify the door is locked.
- the CPU issues an instruction to turn off the power of the system.
- the driver's appearance recognition system comprises the camera 2 , the near infrared ray LED 3 , the LED current control circuit 4 , and the image processing circuit 5 .
- the image processing circuit 5 has a function to execute the individual authentication process and the closed-eye detection process.
- the individual authentication process requires high illumination intensity for face images.
- the closed-eye detection process requires lower illumination intensity for face images than the individual authentication.
- the LED current control circuit 4 receives an instruction signal from the image processing circuit 5 and performs the following functions.
- the LED current control circuit 4 specifies a large current value of current supplied to the near infrared ray LED 3 .
- the LED current control circuit 4 specifies a smaller current value of current supplied to the near infrared ray LED 3 than that for the individual authentication process.
- the system according to the embodiment can use the LED current control circuit 4 to supply a large current to the near infrared ray LED 3 .
- This aims at increasing the illumination intensity when the camera 2 captures images.
- the system according to the embodiment can use the LED current control circuit 4 to supply the near infrared ray LED 3 with the smaller amount of current than that for execution of the individual authentication process. This aims at providing the closed-eye detection process with the necessary illumination intensity when the camera 2 captures images.
- a system having no current amount control means can only supply the specified amount of current to the near infrared ray LED.
- the embodiment can change current values in accordance with the functions of the image processing circuit 5 . Compared to the system having no current amount control means, the embodiment can extend the service life of the near infrared ray LED 3 .
- the embodiment supplies a large amount of current to the image processing circuit 5 when it executes the individual authentication process. Since the individual authentication is executed once when the driver gets into the vehicle, and is completed in several seconds, it is considered that applying a large amount of current to the near infrared ray LED 3 causes little influence on the service life.
- This embodiment adds a timer function to the image processing circuit 5 according to the first embodiment. That is, the second embodiment supplements the image processing circuit 5 with a function to monitor the continuation time of the individual authentication process.
- the timer measures a time lapse from Step 15 .
- the first embodiment described the example where the image processing circuit 5 executes the individual authentication process for the purpose of permitting the engine to start.
- the second embodiment will describe an example where the image processing circuit 5 executes the individual authentication process for the purpose of conforming the environment of in-vehicle units to user's requirements.
- FIG. 3 shows a flowchart of the driver's appearance recognition process executed by the image processing circuit 5 according to the second embodiment of the present invention.
- Step 31 is added between Steps 14 and 15 .
- Step 32 is added to determine a time over state when the determination at Step 18 results in No.
- Step 14 After execution of Step 14 , a timer on the image processing circuit 5 starts at Step 31 . Immediately after the timer starts, the individual authentication process starts at Step 15 .
- Steps 16 , 17 , and 18 are executed like the first embodiment.
- the process proceeds to Step 19 like the first embodiment.
- the process proceeds to Step 32 .
- Step 32 the process determines whether or not the time measured by the timer reaches a specified time value. Any time value can be specified. The specified time value is previously stored in the image processing circuit 5 . When the specified time value is not reached, the determination results in No. The process proceeds to Step 15 and repeats Steps 16 through 18 .
- Step 32 When the time measured by the timer at Step 32 reaches the specified time value, the determination results in YES. The process proceeds to Step 19 without completing the individual authentication process.
- the embodiment When the collation is unsuccessful after lapse of the specified time, the embodiment forcibly stops the individual authentication process and proceeds to the next step. The subsequent steps are the same as those for the first embodiment.
- the timer is reset when the authentication is determined to be complete at Step 18 or when the time over state is determined at Step 32 , i.e., when the individual authentication terminates.
- the image processing circuit 5 has no timer function. Accordingly, the individual authentication process is repeated from Steps 15 through 18 until the collation is determined to be successful at Step 18 . Under this condition, a high current is applied to the near infrared ray LED 3 . That is, the near infrared ray LED 3 is continuously subject to a high load. This is unfavorable from the viewpoint of extending the service life of the near infrared ray LED 3 .
- the second embodiment uses the timer on the image processing circuit 5 to monitor the continuation time of the individual authentication. When the individual authentication is not completed within a specified time, the individual authentication process is terminated.
- the second embodiment can help prevent the near infrared ray LED 3 from being continuously subject to a high load condition and deter the near infrared ray LED 3 from decreasing its service life.
- the second embodiment can extend the service life of the near infrared ray LED 3 .
- FIG. 4 shows the configuration of the driver's appearance recognition system according to a third embodiment of the present invention.
- the outside light is normally radiated to the driver's face.
- the near infrared ray LED 3 radiates the infrared light to the driver, the outside light and the infrared light from the near infrared ray LED 3 are radiated to the driver's face.
- the outside light illuminance is high, sufficient illumination intensity is available from the driver's face despite reduction of the illumination intensity for the near infrared ray LED 3 .
- the third embodiment adds an outside light illuminance sensor 6 to the system according to the first embodiment of the present invention.
- the third embodiment further adds a control function to the image processing circuit 5 and the LED current control circuit 4 according to the first embodiment. This control function suppresses the amount of current supplied to the near infrared ray LED 3 in the case of high illuminance from the outside light illuminating the driver's face.
- the outside light illuminance sensor 6 detects the illuminance of the outside light illuminating the driver's face.
- the outside light illuminance sensor 6 is disposed at a position capable of detecting the illuminance of the outside light illuminating the driver's face. As shown in FIG. 4 , for example, the outside light illuminance sensor 6 is disposed at the top of the instrument panel.
- the outside light illuminance sensor 6 is configured to output a detection result to the image processing circuit 5 .
- the image processing circuit 5 Based on a detection result from the outside light illuminance sensor 6 , the image processing circuit 5 outputs an instruction signal for setting the amount of current to the LED current control circuit 4 so as to optimize the amount of current supplied to the near infrared ray LED 3 .
- FIG. 5 shows part of a flowchart for the driver's appearance recognition process according to the third embodiment of the present invention.
- Steps 41 through 44 in FIG. 5 equivalent to a modification of Step 14 among the other steps described in the first embodiment.
- the outside light illuminance sensor 6 After execution of Steps 11 through 13 in FIG. 2 , the outside light illuminance sensor 6 outputs a detection result at Step 41 as shown in FIG. 5 .
- Step 42 the process determines whether or not the detected illuminance supplied from the outside light illuminance sensor 6 is greater than or equal to a specified value.
- Step 43 the process outputs an instruction signal to the LED current control circuit 4 so that a high current should be output to the near infrared ray LED 3 .
- the LED current control circuit 4 receives this instruction signal and assigns a high current value to the setup value for the current supplied to the near infrared ray LED 3 .
- Step 43 is the same as Step 14 in FIG. 2 referenced for the first embodiment.
- the above-mentioned high current value signifies the setup value for a current supplied to the near infrared ray LED 3 so as to obtain the illumination intensity needed to execute the individual authentication.
- the above-mentioned high current value is the same as that described in the first embodiment. Thereafter, the process proceeds to Step 15 in FIG. 2 .
- Step 42 When the detected illuminance supplied from the outside light illuminance sensor 6 is greater than or equal to a specified value at Step 42 , the determination result is determined to be YES. The process proceeds to Step 44 . At Step 44 , the process outputs an instruction signal to the LED current control circuit 4 so that a low current should be output to the near infrared ray LED 3 .
- the LED current control circuit 4 receives this instruction signal and assigns a low current value to the setup value for the current supplied to the near infrared ray LED 3 .
- the low current value is a current value that is lower than the high current value specified at Step 43 .
- the low current value is configured so that the outside light and the infrared light from the near infrared ray LED 3 can provide the driver's face with the illumination intensity needed to execute the individual authentication. Any value can be assigned to the specified illuminance value to be used as the determination reference at Step 42 . The low current value is determined based on this specified value. The process then proceeds to Step 15 in FIG. 2 .
- the system has the outside light illuminance sensor 6 to measure the illuminance near the driver's face. There may be a case of determining a high illuminance from the outside light illuminating the driver's face.
- the system controls the setup current value for the LED current control circuit 4 so that the image processing circuit 5 suppresses the amount of current supplied to the near infrared ray LED 3 .
- the first embodiment provides the system that always supplies a high current to the near infrared ray LED 3 during the individual authentication.
- the third embodiment can decrease the current supplied to the near infrared ray LED 3 .
- the third embodiment can more reliably extend the service life of the near infrared ray LED 3 compared to the system provided by the first embodiment.
- the third embodiment can extend the service life of the near infrared ray LED 3 also for the following reason. That is, the near infrared ray LED 3 is generally characterized in that a permissible current highly depends on the temperature. The higher the ambient temperature, the lower the permissible current. The permissible current signifies the amount of current allowed to be used for a specified period of time. For this reason, the service life of the near infrared ray LED 3 is extremely shortened when the near infrared ray LED 3 is used by supplying it with a current exceeding the permissible current.
- the automobile body interior temperature rises mainly due to incoming direct sunlight.
- the interior temperature is considered to become high.
- the embodiment lowers the specified current value for the LED current control circuit 4 when a detection result from the outside light illuminance sensor 6 exceeds the specified value, i.e., when the automobile body interior temperature is high.
- the third embodiment can extend the service life of the near infrared ray LED 3 by ensuring the sufficient illumination intensity on the driver's face.
- a visible light cut filter can be attached to the outside light illuminance sensor 6 so as to improve the sensitivity of the outside light illuminance sensor 6 to near infrared components.
- a visible light cut film can be used to cover the outside light illuminance sensor 6 .
- the third embodiment has described the example of replacing Step 14 in FIG. 2 referenced for the first embodiment with the steps as shown in FIG. 5 . It is also possible to replace Step 19 in FIG. 2 with the steps as shown in FIG. 5 according to the third embodiment.
- the image processing circuit 5 determines whether or not the detected illuminance is greater than or equal to the specified value.
- the image processing circuit 5 can be also allowed to simply determine whether or not the detected illuminance exceeds the specified value.
- the image processing circuit 5 may have a plurality of functions that execute appearance recognition processes to recognize the driver's appearance using face images. These appearance recognition processes may need different illumination intensities on the driver's face. In such case, the present invention is also applicable.
- the image processing circuit 5 has the functions of executing the individual authentication and the closed-eye detection. Further, the image processing circuit 5 can also have a function of detecting driver's face directions to prevent the driver from looking aside and a function of detecting pupil's directions, for example.
- the former function detects positions of eyes and nose from a driver's face image captured by the camera 2 .
- the detection result is used to further detect a distance between eyes and a triangular shape formed by connecting positions of two eyes and the nose.
- a face image captured by the camera 2 is characterized as follows.
- the distance between two eyes is longer on the driver's face directed front than that on the driver's face directed sideways.
- the system forms different triangles by connecting positions of driver's two eyes and nose depending on whether his or her face is directed front or sideways.
- the system detects directions of the driver's face based on distances between the eyes and changes in the triangular shape. As a result, the system determines whether or not the driver looks aside.
- the latter function detects eye positions from driver's face images captured by the camera 2 , for example.
- the detection result is used to further detect positions of the tail and the head of the eye and the pupil.
- This detection result is further used to detect where the pupil's center is directed, i.e., the pupil's direction. Based on this result, it is determined whether or not the driver looks aside.
- the present invention is applicable when the image processing circuit 5 has at least two of these functions.
- the function of performing the individual authentication needs the highest illumination intensity. Compared to the function of performing the individual authentication, the remaining three functions need lower illumination intensities.
- the present invention can provide the maximum effect when it is applied to a system in which the image processing circuit 5 has the function of executing the individual authentication and any of the other functions as mentioned above.
- the above-mentioned embodiments use the closed-eye detection method of determining eye opening or closing based on the number of continuous black pixels between upper and lower eyelids.
- the other methods can be employed.
- another closed-eye detection method can determine eye opening or closing by detecting an iris as described in BACKGROUND OF THE INVENTION of Patent Document 2.
- the LED current control circuit 4 and the image processing circuit 5 are described as independent apparatuses. It is also possible to build the LED current control circuit 4 and the image processing circuit 5 into one electrical control unit.
- the above-mentioned embodiments provide the example of using the weight detection switch 1 as riding detection means.
- the present invention is not limited thereto and permits the other means to be used.
- an infrared ray sensor disposed on the instrument panel can be used as the riding detection means.
- the above-mentioned embodiments provide the example of hiding the camera 2 in the instrument panel.
- the camera 2 can be provided in a room mirror.
- the above-mentioned embodiments provide the example of using the near infrared ray LED 3 to radiate the infrared light. It is also possible to allow the LED to radiate not only the infrared light, but also light belonging to the infrared ray wavelength region.
- the above-mentioned embodiments provide the example of using the near infrared ray LED 3 as the infrared light radiation means.
- the other infrared light radiation means can be used if they radiate infrared rays and change the illumination intensity according to the amount of current supplied.
- an incandescent lamp can be used as the infrared light radiation means.
Landscapes
- Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Mechanical Engineering (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Oral & Maxillofacial Surgery (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Image Input (AREA)
- Image Processing (AREA)
- Burglar Alarm Systems (AREA)
- Traffic Control Systems (AREA)
- Image Analysis (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
Abstract
Description
-
- Patent Document 1: JP-2000-168502A
- Patent document 2: JP-H6-32154A
- Non-patent Document: “Face authentication” by OMRON.
Claims (4)
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2004117931A JP4059224B2 (en) | 2004-04-13 | 2004-04-13 | Driver appearance recognition system |
JP2004-117931 | 2004-04-13 |
Publications (2)
Publication Number | Publication Date |
---|---|
US20050226472A1 US20050226472A1 (en) | 2005-10-13 |
US7466847B2 true US7466847B2 (en) | 2008-12-16 |
Family
ID=35060601
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/100,497 Expired - Fee Related US7466847B2 (en) | 2004-04-13 | 2005-04-07 | Driver's appearance recognition system |
Country Status (2)
Country | Link |
---|---|
US (1) | US7466847B2 (en) |
JP (1) | JP4059224B2 (en) |
Cited By (25)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20060245623A1 (en) * | 2005-04-11 | 2006-11-02 | Sarnoff Corporation | Method and apparatus for providing strobed image capture |
US20080048887A1 (en) * | 2006-08-24 | 2008-02-28 | Takata Corporation | Vehicle occupant detection system |
US20080118113A1 (en) * | 2006-11-21 | 2008-05-22 | Jung Sung Uk | Method and apparatus for detecting eyes in face region |
US20080212850A1 (en) * | 2007-02-08 | 2008-09-04 | Aisin Seiki Kabushiki Kaisha | Eyelid detection apparatus and programs therefor |
US20090244288A1 (en) * | 2008-03-31 | 2009-10-01 | Aisin Seiki Kabushiki Kaisha | Imaging apparatus and lighting apparatus for imaging |
US20100014759A1 (en) * | 2006-12-04 | 2010-01-21 | Aisin Seiki Kabushiki Kaisha | Eye detecting device, eye detecting method, and program |
US20100254571A1 (en) * | 2007-11-09 | 2010-10-07 | Aisin Seiki Kabushiki Kaisha | Face image pickup device and method |
US20130050462A1 (en) * | 2011-08-25 | 2013-02-28 | Denso Corporation | Face image detection apparatus |
US8644564B1 (en) * | 2010-11-30 | 2014-02-04 | Bally Gaming, Inc. | Safe illumination for computerized facial recognition |
US20140071293A1 (en) * | 2012-09-12 | 2014-03-13 | Google Inc. | Method and device for authintication of live human faces using infra red images |
US8781171B2 (en) * | 2012-10-24 | 2014-07-15 | Honda Motor Co., Ltd. | Object recognition in low-lux and high-lux conditions |
US20170374261A1 (en) * | 2009-06-03 | 2017-12-28 | Flir Systems, Inc. | Smart surveillance camera systems and methods |
US10366296B2 (en) | 2016-03-31 | 2019-07-30 | Princeton Identity, Inc. | Biometric enrollment systems and methods |
US10373008B2 (en) | 2016-03-31 | 2019-08-06 | Princeton Identity, Inc. | Systems and methods of biometric analysis with adaptive trigger |
US10425814B2 (en) | 2014-09-24 | 2019-09-24 | Princeton Identity, Inc. | Control of wireless communication device capability in a mobile device with a biometric key |
US10430676B2 (en) | 2014-06-23 | 2019-10-01 | Denso Corporation | Apparatus detecting driving incapability state of driver |
US10452936B2 (en) | 2016-01-12 | 2019-10-22 | Princeton Identity | Systems and methods of biometric analysis with a spectral discriminator |
US10474914B2 (en) * | 2014-06-23 | 2019-11-12 | Denso Corporation | Apparatus detecting driving incapability state of driver |
US10484584B2 (en) | 2014-12-03 | 2019-11-19 | Princeton Identity, Inc. | System and method for mobile device biometric add-on |
US10503987B2 (en) | 2014-06-23 | 2019-12-10 | Denso Corporation | Apparatus detecting driving incapability state of driver |
US10507798B1 (en) * | 2017-11-07 | 2019-12-17 | Nick Sebastian | Automobile security system |
US10607096B2 (en) | 2017-04-04 | 2020-03-31 | Princeton Identity, Inc. | Z-dimension user feedback biometric system |
US10875499B2 (en) | 2014-09-19 | 2020-12-29 | Navigation Solutions, Llc | Vehicle occupant authentication system |
US10902104B2 (en) | 2017-07-26 | 2021-01-26 | Princeton Identity, Inc. | Biometric security systems and methods |
US12093044B2 (en) | 2014-04-30 | 2024-09-17 | Hyundai Motor Company | Automatic driving vehicle and program for automatic driving vehicle |
Families Citing this family (53)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP4849460B2 (en) * | 2005-10-14 | 2012-01-11 | ミツビシ・エレクトリック・リサーチ・ラボラトリーズ・インコーポレイテッド | How to recognize faces in images |
JP4853063B2 (en) * | 2006-03-15 | 2012-01-11 | オムロン株式会社 | User device, communication device, authentication system, authentication method, authentication program, and recording medium |
JPWO2007119818A1 (en) * | 2006-04-14 | 2009-08-27 | 日本電気株式会社 | Function unlocking system, function unlocking method, and function unlocking program |
JP4561703B2 (en) * | 2006-07-06 | 2010-10-13 | 株式会社デンソー | Face recognition device and automobile user hospitality system using the same |
JP5122782B2 (en) * | 2006-09-19 | 2013-01-16 | 株式会社デンソー | Mounting structure for vehicle driver's camera |
DE102008006973B4 (en) * | 2007-02-02 | 2017-03-02 | Denso Corporation | Projector and image capture device |
KR101600632B1 (en) * | 2007-09-24 | 2016-03-09 | 애플 인크. | Embedded authentication systems in an electronic device |
US8600120B2 (en) | 2008-01-03 | 2013-12-03 | Apple Inc. | Personal computing device control using face detection and recognition |
JP4888838B2 (en) | 2008-05-12 | 2012-02-29 | トヨタ自動車株式会社 | Driver imaging device and driver imaging method |
DE102008031697B4 (en) | 2008-07-04 | 2023-08-24 | Bayerische Motoren Werke Aktiengesellschaft | Device and method for object identification |
US20100039682A1 (en) * | 2008-08-18 | 2010-02-18 | Waterloo Industries, Inc. | Systems And Arrangements For Object Identification |
JP2010111292A (en) * | 2008-11-06 | 2010-05-20 | Panasonic Electric Works Co Ltd | Vehicular control device |
JP2010117487A (en) * | 2008-11-12 | 2010-05-27 | Fujinon Corp | Autofocus system |
JP2011142500A (en) * | 2010-01-07 | 2011-07-21 | Toyota Motor Corp | Imaging apparatus |
US10580088B2 (en) | 2010-03-03 | 2020-03-03 | The Western Union Company | Vehicle travel monitoring and payment systems and methods |
US8407144B2 (en) * | 2010-03-18 | 2013-03-26 | The Western Union Company | Vehicular-based transactions, systems and methods |
JP2012147279A (en) * | 2011-01-13 | 2012-08-02 | Spectr Design Kk | Near-infrared imaging apparatus |
JP2014515847A (en) | 2011-03-25 | 2014-07-03 | ティーケー ホールディングス インク. | Driver alertness determination system and method |
US8705812B2 (en) * | 2011-06-10 | 2014-04-22 | Amazon Technologies, Inc. | Enhanced face recognition in video |
US9002322B2 (en) | 2011-09-29 | 2015-04-07 | Apple Inc. | Authentication with secondary approver |
US8769624B2 (en) | 2011-09-29 | 2014-07-01 | Apple Inc. | Access control utilizing indirect authentication |
US9633186B2 (en) * | 2012-04-23 | 2017-04-25 | Apple Inc. | Systems and methods for controlling output of content based on human recognition data detection |
US11209961B2 (en) | 2012-05-18 | 2021-12-28 | Apple Inc. | Device, method, and graphical user interface for manipulating user interfaces based on fingerprint sensor inputs |
JP6106979B2 (en) * | 2012-07-25 | 2017-04-05 | 株式会社デンソー | Condition monitoring device and optical member |
EP2860960B1 (en) * | 2012-07-25 | 2020-10-14 | Denso Corporation | State monitoring device |
JP6119136B2 (en) * | 2012-07-25 | 2017-04-26 | 株式会社デンソー | Condition monitoring device |
JP2014059684A (en) * | 2012-09-17 | 2014-04-03 | Denso Corp | State monitoring device |
US9264596B2 (en) * | 2012-10-26 | 2016-02-16 | Sensormatic Electronics, LLC | Security camera system and method for eliminating video aberrations from excessive IR illumination |
US9898642B2 (en) | 2013-09-09 | 2018-02-20 | Apple Inc. | Device, method, and graphical user interface for manipulating user interfaces based on fingerprint sensor inputs |
JP6107595B2 (en) * | 2013-10-23 | 2017-04-05 | 株式会社デンソー | Condition monitoring device |
US10043185B2 (en) | 2014-05-29 | 2018-08-07 | Apple Inc. | User interface for payments |
CN104757981A (en) * | 2015-03-16 | 2015-07-08 | 于莹光 | Method and device for high-sensitively receiving and transmitting integrated infrared detection of driver's fatigue |
KR20230004905A (en) | 2015-11-10 | 2023-01-06 | 루미리즈 홀딩 비.브이. | Adaptive light source |
DK179186B1 (en) | 2016-05-19 | 2018-01-15 | Apple Inc | REMOTE AUTHORIZATION TO CONTINUE WITH AN ACTION |
WO2018000184A1 (en) * | 2016-06-28 | 2018-01-04 | Intel Corporation | Iris or other body part identification on a computing device |
US20180005057A1 (en) * | 2016-07-01 | 2018-01-04 | Hyundai Motor Company | Apparatus and method for capturing face image of decreased reflection on spectacles in vehicle |
CN106335469B (en) * | 2016-09-04 | 2019-11-26 | 深圳市云智易联科技有限公司 | Vehicle-mounted authentication method, system, car-mounted device, mobile terminal and server |
DK179471B1 (en) | 2016-09-23 | 2018-11-26 | Apple Inc. | Image data for enhanced user interactions |
JP6278106B2 (en) * | 2016-12-28 | 2018-02-14 | 株式会社デンソー | Condition monitoring device and optical member |
JP6655036B2 (en) * | 2017-03-15 | 2020-02-26 | 株式会社Subaru | VEHICLE DISPLAY SYSTEM AND VEHICLE DISPLAY SYSTEM CONTROL METHOD |
KR102185854B1 (en) | 2017-09-09 | 2020-12-02 | 애플 인크. | Implementation of biometric authentication |
KR102389678B1 (en) | 2017-09-09 | 2022-04-21 | 애플 인크. | Implementation of biometric authentication |
JP6676084B2 (en) | 2018-02-01 | 2020-04-08 | 株式会社Subaru | Vehicle occupant monitoring device |
KR102677096B1 (en) | 2018-05-04 | 2024-06-21 | 구글 엘엘씨 | Adapting automated assistant based on detected mouth movement and/or gaze |
CN108647662A (en) * | 2018-05-17 | 2018-10-12 | 四川斐讯信息技术有限公司 | A kind of method and system of automatic detection face |
US11170085B2 (en) | 2018-06-03 | 2021-11-09 | Apple Inc. | Implementation of biometric authentication |
JP2021179453A (en) * | 2018-08-21 | 2021-11-18 | シャープ株式会社 | Imaging device |
US11100349B2 (en) | 2018-09-28 | 2021-08-24 | Apple Inc. | Audio assisted enrollment |
US10860096B2 (en) | 2018-09-28 | 2020-12-08 | Apple Inc. | Device control using gaze information |
JP7031998B2 (en) * | 2019-04-19 | 2022-03-08 | 矢崎総業株式会社 | Audio control system and audio control method |
CN110182175A (en) * | 2019-05-28 | 2019-08-30 | 北京汽车股份有限公司 | Control method for vehicle, device, system and vehicle |
US11068701B2 (en) * | 2019-06-13 | 2021-07-20 | XMotors.ai Inc. | Apparatus and method for vehicle driver recognition and applications of same |
DE102020123927A1 (en) | 2020-09-15 | 2022-03-17 | Audi Aktiengesellschaft | Method for recognizing a driver of a motor vehicle and motor vehicle as being alive |
Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH0632154A (en) | 1992-07-18 | 1994-02-08 | Nissan Motor Co Ltd | Driver's condition detector |
US5729619A (en) * | 1995-08-08 | 1998-03-17 | Northrop Grumman Corporation | Operator identity, intoxication and drowsiness monitoring system and method |
JPH1097691A (en) | 1996-09-20 | 1998-04-14 | Oki Electric Ind Co Ltd | Security device |
JP2000168502A (en) | 1998-12-03 | 2000-06-20 | Honda Motor Co Ltd | User recognizing device for vehicle |
JP2000280780A (en) | 1999-03-31 | 2000-10-10 | Toshiba Corp | Driver state detecting system |
US20020134835A1 (en) * | 2001-03-26 | 2002-09-26 | Kennedy James M. | Remote indicia reading system |
JP2002288670A (en) | 2001-03-22 | 2002-10-04 | Honda Motor Co Ltd | Personal authentication device using facial image |
JP2003095067A (en) | 2001-09-20 | 2003-04-03 | Toshiba Corp | Antitheft system and its method |
JP2003256813A (en) | 2002-03-05 | 2003-09-12 | Toshiba Corp | Operator monitoring device |
US6751340B2 (en) * | 1998-10-22 | 2004-06-15 | Francine J. Prokoski | Method and apparatus for aligning and comparing images of the face and body from different imagers |
-
2004
- 2004-04-13 JP JP2004117931A patent/JP4059224B2/en not_active Expired - Fee Related
-
2005
- 2005-04-07 US US11/100,497 patent/US7466847B2/en not_active Expired - Fee Related
Patent Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH0632154A (en) | 1992-07-18 | 1994-02-08 | Nissan Motor Co Ltd | Driver's condition detector |
US5729619A (en) * | 1995-08-08 | 1998-03-17 | Northrop Grumman Corporation | Operator identity, intoxication and drowsiness monitoring system and method |
JPH1097691A (en) | 1996-09-20 | 1998-04-14 | Oki Electric Ind Co Ltd | Security device |
US6751340B2 (en) * | 1998-10-22 | 2004-06-15 | Francine J. Prokoski | Method and apparatus for aligning and comparing images of the face and body from different imagers |
JP2000168502A (en) | 1998-12-03 | 2000-06-20 | Honda Motor Co Ltd | User recognizing device for vehicle |
JP2000280780A (en) | 1999-03-31 | 2000-10-10 | Toshiba Corp | Driver state detecting system |
JP2002288670A (en) | 2001-03-22 | 2002-10-04 | Honda Motor Co Ltd | Personal authentication device using facial image |
US20020134835A1 (en) * | 2001-03-26 | 2002-09-26 | Kennedy James M. | Remote indicia reading system |
JP2003095067A (en) | 2001-09-20 | 2003-04-03 | Toshiba Corp | Antitheft system and its method |
JP2003256813A (en) | 2002-03-05 | 2003-09-12 | Toshiba Corp | Operator monitoring device |
Non-Patent Citations (2)
Title |
---|
Notice of Reasons for Rejection dated on Jul. 13, 2007 in corresponding Japanese Patent application No. 2004-117931 (and English translation). |
www.face-id.jp "Face authentication" by OMRON (Discussed on p. 3 of the spec.), copyright 2004. |
Cited By (50)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7542628B2 (en) * | 2005-04-11 | 2009-06-02 | Sarnoff Corporation | Method and apparatus for providing strobed image capture |
US20090232418A1 (en) * | 2005-04-11 | 2009-09-17 | Dominick Lolacono | Method and Apparatus For Providing Strobed Image Capture |
US20060245623A1 (en) * | 2005-04-11 | 2006-11-02 | Sarnoff Corporation | Method and apparatus for providing strobed image capture |
US7657127B2 (en) * | 2005-04-11 | 2010-02-02 | Sarnoff Corporation | Method and apparatus for providing strobed image capture |
US20080048887A1 (en) * | 2006-08-24 | 2008-02-28 | Takata Corporation | Vehicle occupant detection system |
US7929734B2 (en) * | 2006-11-21 | 2011-04-19 | Electronics And Telecommunications Research Institute | Method and apparatus for detecting eyes in face region |
US20080118113A1 (en) * | 2006-11-21 | 2008-05-22 | Jung Sung Uk | Method and apparatus for detecting eyes in face region |
US8498449B2 (en) | 2006-12-04 | 2013-07-30 | Aisin Seiki Kabushiki Kaisha | Eye detecting device, eye detecting method, and program |
US20100014759A1 (en) * | 2006-12-04 | 2010-01-21 | Aisin Seiki Kabushiki Kaisha | Eye detecting device, eye detecting method, and program |
US20080212850A1 (en) * | 2007-02-08 | 2008-09-04 | Aisin Seiki Kabushiki Kaisha | Eyelid detection apparatus and programs therefor |
US8351658B2 (en) * | 2007-02-08 | 2013-01-08 | Aisin Seiki Kabushiki Kaisha | Eyelid detection apparatus and programs therefor |
US20100254571A1 (en) * | 2007-11-09 | 2010-10-07 | Aisin Seiki Kabushiki Kaisha | Face image pickup device and method |
US8295559B2 (en) * | 2007-11-09 | 2012-10-23 | Aisin Seiki Kabushiki Kaisha | Face image pickup device and method |
US20090244288A1 (en) * | 2008-03-31 | 2009-10-01 | Aisin Seiki Kabushiki Kaisha | Imaging apparatus and lighting apparatus for imaging |
US8368758B2 (en) | 2008-03-31 | 2013-02-05 | Aisin Seiki Kabushiki Kaisha | Imaging apparatus and lighting apparatus for imaging |
US10970556B2 (en) * | 2009-06-03 | 2021-04-06 | Flir Systems, Inc. | Smart surveillance camera systems and methods |
US20170374261A1 (en) * | 2009-06-03 | 2017-12-28 | Flir Systems, Inc. | Smart surveillance camera systems and methods |
US8644564B1 (en) * | 2010-11-30 | 2014-02-04 | Bally Gaming, Inc. | Safe illumination for computerized facial recognition |
US20140147024A1 (en) * | 2010-11-30 | 2014-05-29 | Bally Gaming, Inc. | Safe illumination for computerized facial recognition |
US9177193B2 (en) * | 2010-11-30 | 2015-11-03 | Bally Gaming, Inc. | Safe illumination for computerized facial recognition |
US20160055372A1 (en) * | 2010-11-30 | 2016-02-25 | Bally Gaming, Inc. | Safe illumination for computerized facial recognition |
US10346674B2 (en) * | 2010-11-30 | 2019-07-09 | Bally Gaming, Inc. | Safe illumination for computerized facial recognition |
US20130050462A1 (en) * | 2011-08-25 | 2013-02-28 | Denso Corporation | Face image detection apparatus |
US8797394B2 (en) * | 2011-08-25 | 2014-08-05 | Denso Corporation | Face image capturing apparatus |
US20140071293A1 (en) * | 2012-09-12 | 2014-03-13 | Google Inc. | Method and device for authintication of live human faces using infra red images |
US9469251B2 (en) | 2012-10-24 | 2016-10-18 | Honda Motor Co., Ltd. | Object recognition in low-lux and high-lux conditions |
US9852332B2 (en) | 2012-10-24 | 2017-12-26 | Honda Motor Co., Ltd. | Object recognition in low-lux and high-lux conditions |
US9302621B2 (en) | 2012-10-24 | 2016-04-05 | Honda Motor Co., Ltd. | Object recognition in low-lux and high-lux conditions |
US8781171B2 (en) * | 2012-10-24 | 2014-07-15 | Honda Motor Co., Ltd. | Object recognition in low-lux and high-lux conditions |
US12093044B2 (en) | 2014-04-30 | 2024-09-17 | Hyundai Motor Company | Automatic driving vehicle and program for automatic driving vehicle |
US11820383B2 (en) | 2014-06-23 | 2023-11-21 | Denso Corporation | Apparatus detecting driving incapability state of driver |
US10430676B2 (en) | 2014-06-23 | 2019-10-01 | Denso Corporation | Apparatus detecting driving incapability state of driver |
US10474914B2 (en) * | 2014-06-23 | 2019-11-12 | Denso Corporation | Apparatus detecting driving incapability state of driver |
US10503987B2 (en) | 2014-06-23 | 2019-12-10 | Denso Corporation | Apparatus detecting driving incapability state of driver |
US10572746B2 (en) | 2014-06-23 | 2020-02-25 | Denso Corporation | Apparatus detecting driving incapability state of driver |
US10936888B2 (en) | 2014-06-23 | 2021-03-02 | Denso Corporation | Apparatus detecting driving incapability state of driver |
US10909399B2 (en) | 2014-06-23 | 2021-02-02 | Denso Corporation | Apparatus detecting driving incapability state of driver |
US10875499B2 (en) | 2014-09-19 | 2020-12-29 | Navigation Solutions, Llc | Vehicle occupant authentication system |
US10425814B2 (en) | 2014-09-24 | 2019-09-24 | Princeton Identity, Inc. | Control of wireless communication device capability in a mobile device with a biometric key |
US10484584B2 (en) | 2014-12-03 | 2019-11-19 | Princeton Identity, Inc. | System and method for mobile device biometric add-on |
US10452936B2 (en) | 2016-01-12 | 2019-10-22 | Princeton Identity | Systems and methods of biometric analysis with a spectral discriminator |
US10762367B2 (en) | 2016-01-12 | 2020-09-01 | Princeton Identity | Systems and methods of biometric analysis to determine natural reflectivity |
US10643087B2 (en) | 2016-01-12 | 2020-05-05 | Princeton Identity, Inc. | Systems and methods of biometric analysis to determine a live subject |
US10643088B2 (en) | 2016-01-12 | 2020-05-05 | Princeton Identity, Inc. | Systems and methods of biometric analysis with a specularity characteristic |
US10943138B2 (en) | 2016-01-12 | 2021-03-09 | Princeton Identity, Inc. | Systems and methods of biometric analysis to determine lack of three-dimensionality |
US10373008B2 (en) | 2016-03-31 | 2019-08-06 | Princeton Identity, Inc. | Systems and methods of biometric analysis with adaptive trigger |
US10366296B2 (en) | 2016-03-31 | 2019-07-30 | Princeton Identity, Inc. | Biometric enrollment systems and methods |
US10607096B2 (en) | 2017-04-04 | 2020-03-31 | Princeton Identity, Inc. | Z-dimension user feedback biometric system |
US10902104B2 (en) | 2017-07-26 | 2021-01-26 | Princeton Identity, Inc. | Biometric security systems and methods |
US10507798B1 (en) * | 2017-11-07 | 2019-12-17 | Nick Sebastian | Automobile security system |
Also Published As
Publication number | Publication date |
---|---|
US20050226472A1 (en) | 2005-10-13 |
JP2005301742A (en) | 2005-10-27 |
JP4059224B2 (en) | 2008-03-12 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7466847B2 (en) | Driver's appearance recognition system | |
US8823792B2 (en) | Wakefulness level estimation apparatus | |
US20200346602A1 (en) | System for detecting occupant of vehicle and system for controlling illumination inside vehicle | |
US20050047628A1 (en) | Driver certifying system | |
US20070195990A1 (en) | Vision-Based Seat Belt Detection System | |
US20070229662A1 (en) | Object detecting system and method | |
JPH08290751A (en) | Sensor system and safety system for vehicle | |
JP5761046B2 (en) | Anti-glare control device | |
US10824886B2 (en) | Occupant monitoring device for vehicle | |
JP2006248363A (en) | Driver lighting system, driver photographing device and driver monitoring device | |
US6335687B1 (en) | Locked-in person saving apparatus | |
US10427642B2 (en) | Method for operating an identification system for a motor vehicle | |
JP2003260933A (en) | Automatic glare controlling device | |
JP2009201756A (en) | Information processor and information processing method, and program | |
US7295123B2 (en) | Method for detecting a person in a space | |
JP5368771B2 (en) | Crew monitoring device | |
CN107933461B (en) | In-vehicle identification fusion device and method based on single camera | |
US20130120574A1 (en) | State monitor apparatus | |
US7463166B2 (en) | Control system for the operation of presence detection devices and method therefor | |
JP4628666B2 (en) | In-vehicle camera system | |
CN112088110A (en) | Method for illuminating a seat in a vehicle | |
JP4193001B1 (en) | Vehicle security system | |
KR20220157791A (en) | Method for adjusting safebelt height and apparatus for the same | |
EP4129795B1 (en) | System for preventing drunk driving and method for controlling the same | |
EP4328090A1 (en) | Auto dimming mirror |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: DENSO CORPORATION, JAPAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:KOMURA, TAKASHI;REEL/FRAME:016458/0937 Effective date: 20050317 |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
FEPP | Fee payment procedure |
Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
FPAY | Fee payment |
Year of fee payment: 4 |
|
FEPP | Fee payment procedure |
Free format text: PAYER NUMBER DE-ASSIGNED (ORIGINAL EVENT CODE: RMPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
FPAY | Fee payment |
Year of fee payment: 8 |
|
FEPP | Fee payment procedure |
Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
LAPS | Lapse for failure to pay maintenance fees |
Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
STCH | Information on status: patent discontinuation |
Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362 |
|
FP | Lapsed due to failure to pay maintenance fee |
Effective date: 20201216 |