WO2022270205A1

WO2022270205A1 - Facial authentication device for driver and facial authentication program

Info

Publication number: WO2022270205A1
Application number: PCT/JP2022/021391
Authority: WO
Inventors: 貴洋石川; 祐樹古市
Original assignee: 株式会社デンソー
Priority date: 2021-06-25
Filing date: 2022-05-25
Publication date: 2022-12-29
Also published as: JPWO2022270205A1

Abstract

This facial authentication device (7) for a driver comprises: an image acquisition unit (21) that acquires a facial image of a driver; a first software execution unit (22) that executes, in a predetermined cycle, unsuitable driving state detection software for determining whether a driver is in a suitable driving state or an unsuitable driving state; a second software execution unit (23) that executes facial authentication software for determining substitution of the driver; a substitutability state determination unit (24) for determining whether it is possible to substitute the driver; and a software execution control unit (25) that, when it is determined by the determination result of the substitutability state determination unit that it is possible to substitute the driver, causes the facial authentication software to be executed.

Description

Driver's face authentication device and face authentication program

Cross-reference to related applications

This application is based on Japanese Application No. 2021-105740 filed on June 25, 2021, and the contents thereof are incorporated herein.

The present disclosure relates to a driver's face authentication device and a face authentication program.

For example, an occupant condition monitoring system that monitors the condition of occupants in vehicles such as automobiles is provided. A driver state monitoring system for monitoring the state of a driver includes an imaging unit that captures an image of the area around the headrest of the driver's seat, and an illumination unit that illuminates the area around the headrest of the driver's seat. The driver condition monitoring system captures an image of the area around the driver's face illuminated by light with an imaging unit while the driver is seated in the driver's seat, analyzes the face image of the driver included in the captured image, and detects the driver. (see, for example, Patent Document 1).

Japanese Patent No. 6372388

The driver condition monitoring system judges, for example, looking aside, closed eyes, drowsiness, etc. from the facial image, and judges whether the driver is in a suitable driving condition or unsuitable driving condition based on the judgment result. When the driver condition monitoring system identifies that the driver is unsuitable for driving, for example, the driver abnormality response system (hereinafter referred to as EDSS (Emergency Driving Stop System)) is activated, or driving by automatic driving or by advanced driving support system or disable the running rule.

The driver condition monitoring system periodically (for example, 30 times/second) executes software for detecting the unsuitable driving condition for determining whether the driver is in an appropriate driving condition or an unsuitable driving condition. In addition, it is assumed that the driver condition monitoring system periodically executes face recognition software for judging driver change at a predetermined cycle. However, in a configuration in which the driving unsuitable state detection software and the face authentication software are each periodically executed, the frequency of executing both software increases, the amount of calculation increases steadily, and the high-spec It is necessary to install a microcomputer.

An object of the present disclosure is to prevent an increase in the steady amount of computation while appropriately determining whether the driver is in a suitable driving state or an unsuitable driving state.

According to one aspect of the present disclosure, the image acquisition unit acquires the face image of the driver. The first software execution unit executes, at predetermined intervals, driving unsuitable state detection software for determining whether the driver is in an appropriate driving state or an unsuitable driving state. The second software execution unit executes face recognition software for judging driver change. The change possible situation determination unit determines whether or not the situation is such that a driver change is possible. The software execution control unit causes the face authentication software to be executed when it is determined that the driver can be changed according to the determination result of the change possible state determination unit.

Instead of running the face recognition software regularly, we decided to run the face recognition software on the condition that it was determined that it was possible to change drivers. By executing the software for detecting unsuitable driving conditions at predetermined intervals, it is possible to appropriately determine whether the driver is in an appropriate or unsuitable condition for driving. By doing so, it is possible to reduce the frequency of running face recognition software. As a result, it is possible to appropriately determine whether the driver is in the appropriate driving state or in the unsuitable driving state, while avoiding an increase in the steady amount of calculation. That is, by not executing the face authentication software in a situation where there is no possibility of a driver change, it is possible to avoid a constant increase in the amount of computation.

The above and other objects, features and advantages of the present disclosure will become more apparent from the following detailed description with reference to the accompanying drawings. The drawing is
FIG. 1 shows one embodiment and is a functional block diagram of a driver state monitoring system, FIG. 2 is a diagram showing the relationship between sensor behavior and driver behavior; FIG. 3 is a diagram showing the relationship between sensor behavior and driver behavior; FIG. 4 is a timing chart, FIG. 5 is a timing chart, FIG. 6 is a timing chart, FIG. 7 is a timing chart, FIG. 8 is a timing chart, FIG. 9 is a flow chart, FIG. 10 is a diagram showing a notification screen when a face image is saved; FIG. 11 is a diagram showing a notification screen when sending a face image; FIG. 12 is a diagram showing a notification screen when changing drivers. FIG. 13 is a diagram showing a notification screen when the face image is saved after driver change, FIG. 14 is a diagram showing a notification screen at the time of face image transmission after driver change.

An embodiment will be described below with reference to the drawings.
A vehicle is equipped with a driver status monitoring system including a driver status monitor (registered trademark) (hereinafter referred to as DSM (Driver Status Monitor)) as a passenger status monitoring system for monitoring the status of passengers. The driver condition monitoring system judges inattentiveness, closed eyes, drowsiness, etc. based on the degree of drooping of the eyelids, the degree of opening of the pupil, the direction of the line of sight, the speed of movement of the line of sight, etc. from the face image, and determines the driver's suitable driving based on the judgment results. It is determined whether it is in an appropriate state or an unsuitable driving state. When the driver state monitoring system determines that the driver is in an unsuitable state for driving, for example, it activates EDSS or disables automatic driving or advanced driving support system driving.

As shown in FIG. 1, the driver state monitoring system 1 includes a control device 2, a driver state recognition device 3, a vehicle information recognition device 4, a driving environment recognition device 5, and an HMI (Human Machine Interface) 6. . The driver's face authentication device 7 is configured as part of the driver state monitoring system 1 and includes a control device 2 and a driver state recognition device 3 .

The driver state recognition device 3 includes a driver camera 31, an LED 32, a buckle sensor 33, a door open/close sensor 34, a seating sensor 35, an electronic key interior detection sensor 36, a handle touch sensor 37, and a handle torque sensor 38. and The driver camera 31 is a camera having an image sensor such as a CCD (Charge Coupled Device) or CMOS (Complementary Metal Oxide Semiconductor), and is arranged on the upper surface of the instrument panel, the meter panel, the rearview mirror, the steering column, and the like. . The driver camera 31 outputs the captured image to the control device 2 with the vicinity of the headrest of the driver's seat taken as the imaging direction. A plurality of driver cameras 31 may be provided, and a plurality of driver cameras 31 may be configured to perform imaging operations in synchronization.

The LED 32 emits near-infrared light around the headrest of the driver's seat. That is, when the driver is seated in the driver's seat, near-infrared light emitted from the LED 32 is emitted around the driver's face, and the driver's camera 31 captures an image of the area around the driver's face irradiated with the near-infrared light. . The number of LEDs 32 may be plural, and the configuration may be such that a plurality of LEDs 32 perform lighting operations in synchronization.

The buckle sensor 33 detects whether or not the convex portion on the seat belt side is stuck in the concave portion on the buckle side, and outputs the detection result to the control device 2 . The door open/close sensor 34 detects the open/close state of the door and outputs the detection result to the control device 2 . The seating sensor 35 detects the pressure distribution of the driver's seat and outputs the detected pressure distribution to the control device 2 . The electronic key vehicle interior detection sensor 36 detects whether or not the electronic key is present in the vehicle interior, and outputs the detection result to the control device 2 . The handle touch sensor 37 detects the gripping state of the handle and outputs the detection result to the control device 2 . The steering wheel torque sensor 38 detects the steering force of the steering wheel and outputs the detection result to the control device 2 .

The vehicle information recognition device 4 includes a vehicle speed sensor 41 , a steering angle sensor 42 , an accelerator sensor 43 , a brake sensor 44 and a shift sensor 45 . Vehicle speed sensor 41 detects the vehicle speed and outputs the detected vehicle speed to control device 2 . The steering angle sensor 42 detects the steering angle of the steering wheel and outputs the detected steering angle to the control device 2 . The accelerator sensor 43 detects the amount of operation of the accelerator pedal and outputs the detected amount of operation to the control device 2 . The brake sensor 44 detects the amount of operation of the brake pedal and outputs the detected amount of operation to the control device 2 . The shift sensor 45 detects the state of the shift position and outputs the detected state of the shift position to the control device 2 .

The driving environment recognition device 5 includes a front camera 51 , a rear camera 52 , a front sensor 53 , a rear sensor 54 , a navigation device 55 and a G sensor 56 . The front camera 51 outputs the captured image to the control device 2 with the front of the vehicle including the marking lines painted on the road surface as the imaging direction. The rearward camera 52 outputs the imaged image to the control device 2 with the rearward direction of the vehicle as the imaging direction. The front sensor 53 is a sensor such as a millimeter wave sensor, radar, or lidar (LiDAR (Light Detection and Ranging, Laser Imaging Detection and Ranging)), detects an object such as a preceding vehicle or a pedestrian in front of the vehicle, and detects the object. The result is output to the control device 2. The rearward sensor 54 is a sensor such as a millimeter wave sensor, radar, or lidar, detects objects such as a following vehicle or a pedestrian behind the vehicle, and outputs the detection result to the control device 2 . The driving environment recognition device 5 calculates the relative speed to the vehicle ahead based on the distance to the vehicle ahead detected by the front sensor 53, and calculates the relative speed to the vehicle behind based on the distance to the following vehicle detected by the rear sensor 54. Calculate the relative velocity of

The navigation device 55 determines the current vehicle position by measuring GPS position coordinates based on GPS signals transmitted from GPS (Global Positioning System) satellites, and calculates a route from the determined current vehicle position to the destination. , and performs navigation processing such as guiding the calculated route. The satellite positioning system is not limited to GPS, and various GNSS (Global Navigation Satellite Systems) such as GLONASS, Galileo, BeiDou, and IRNSS can be adopted. The G sensor 56 detects three-dimensional acceleration of the vehicle in the longitudinal direction, the lateral direction, and the vertical direction, and outputs the detection results to the control device 2 . The G sensor 56 may be a sensor included in the navigation device 55, or may be a sensor installed for other purposes.

The HMI 6 includes a display 61, a speaker 62, and a cancel switch 63. The display 61 has a flat display such as a liquid crystal display or an organic EL (Electro-Luminescence) display, and a touch panel is formed on the front surface of the flat display. When the display 61 detects a touch operation on the touch panel from the driver or passenger, the display 61 performs screen control such as switching screens or displaying icons on the screen according to the touch operation.

The display 61 displays, as one of the displayed information, a status indicating the degree of the driver's posture collapse in five stages. The lower the number, the lower the degree of collapse, indicating that the driver's posture is normal and the driver is in a suitable driving state suitable for driving. The higher the number, the higher the degree of collapse, indicating that the driver's posture is abnormal. , indicates that the driver is in a driving unsuitable state unsuitable for driving. The control device 2 displays the status on the display 61 by outputting a driver status signal indicating the status of the driver to the display 61 . The status is displayed on the display 61 so that the driver can grasp his or her driving posture.

The speaker 62 is a speaker shared with the navigation device 55, the audio device, and the like. The control device 2 outputs a driver status signal indicating the status of the driver to the speaker 62 , thereby outputting the status by voice from the speaker 62 . The driver can grasp his or her driving posture by outputting the status by voice from the speaker 62 .

The cancel switch 63 is a switch that temporarily stops detection of the driver's state. If the cancel switch 63 is operated before the trip, detection of the driver's state is stopped during one trip period immediately after the operation. Further, when the cancel switch 63 is operated during a trip, detection of the driver's state is stopped during the period during which the cancel switch 63 is operated or for a certain period of time (about several seconds) after the cancel switch 63 is operated. That is, for example, by operating the cancel switch 63 in advance when the driver performs an action of picking up an object, even if the driver's posture changes, it will not be erroneously detected as being unsuitable for driving.

The control device 2 is composed of a microcomputer having a CPU (Central Processing Unit), ROM (Read Only Memory), RAM (Random Access Memory), and I/O (Input/Output). The microcomputer executes a computer program stored in a non-transitional physical storage medium, executes processing corresponding to the computer program, and controls overall operation of the driver state monitoring system 1 . Microcomputer is synonymous with processor. In the driver state monitoring system 1, the non-transitional physical storage medium may share hardware with other computer resources.

The control device 2 connects the driver state recognition device 3, the vehicle information recognition device 4, the driving environment recognition device 5, and the HMI 6 with a CAN (Controller Area Network) (registered trademark) or the like via a wired connection or a wireless LAN or Bluetooth (registered trademark). Data communication is possible by wireless connection such as.

The control device 2 includes an image acquisition unit 21, a first software execution unit 22, a second software execution unit 23, a shift availability determination unit 24, a software execution control unit 25, a face image storage unit 26, a face and an image transmission unit 27 . These units 21 to 27 correspond to functions executed by the face detection program. That is, the control device 2 performs the functions of the units 21 to 27 by executing the face detection program.

The image acquisition unit 21 receives the image captured by the driver camera 31 from the driver camera 31 and acquires the face image of the driver captured by the driver camera 31 .

The first software execution unit 22 executes software for detecting the unsuitable driving state for determining whether the driver is in an appropriate driving state or an unsuitable driving state at predetermined intervals. That is, the first software execution unit 22 executes software for detecting an unsuitable driving state at a predetermined cycle, so that the first software execution unit 22 detects the driver's face image based on the degree of eyelid drooping, the degree of pupil opening, the direction of the line of sight, the speed of movement of the line of sight, and the like. Thus, it becomes possible to determine whether the driver is looking aside, with closed eyes, drowsiness, or the like.

The second software execution unit 23 executes face recognition software for determining driver change. The second software execution unit 23 registers the face image of the driver to be compared when executing the face authentication software in the following pattern. As a first pattern, the second software execution unit 23 executes the face recognition software for judging driver change for the first time after the ignition has been switched from off to on. to register. When the face authentication software is to be executed after the face image of the current driver is registered, the second software execution unit 23 stores the face image of the registered driver and the driver when it is determined that the driver can be changed. is compared with the face image of the person, and it is determined whether or not the person is the same person. If the second software execution unit 23 determines that the person is the same person, the second software execution unit 23 continues using the registered face image of the driver for the next determination, and if it determines that the person is not the same person, discards the registered face image of the driver. , newly register the face image of the driver when it is determined that the driver can be changed.

As a second pattern, when the second software execution unit 23 receives the face image of the driver transmitted from the server after the ignition has been switched from off to on, the received face image of the driver is registered. When the second software execution unit 23 executes the face authentication software after registering the face image of the driver received from the server, in this case also, the face image of the registered driver and the fact that the driver can be changed are displayed. The face image of the driver at the time of determination is compared to determine whether or not the person is the same person. If the second software execution unit 23 determines that the person is the same person, the second software execution unit 23 continues using the registered face image of the driver for the next determination, and if it determines that the person is not the same person, discards the registered face image of the driver. , newly register the face image of the driver when it is determined that the driver can be changed.

As a third pattern, the second software execution unit 23, if there is a face image of a registered driver in the past ride, and if the elapsed time from the registration date and time to the current date and time is less than a predetermined period, the registered driver Continue to use the driver's facial image. When the second software execution unit 23 executes the face authentication software after this, in this case also, the registered face image of the driver and the face of the driver when it is determined that the driver can be changed The image is compared to determine whether or not the person is the same person. If the second software execution unit 23 determines that the person is the same person, the second software execution unit 23 continues using the registered face image of the driver for the next determination, and if it determines that the person is not the same person, discards the registered face image of the driver. , newly register the face image of the driver when it is determined that the driver can be changed.

The change possible situation determination unit 24 determines whether or not the situation is such that it is possible to change the driver. The alternation availability determination unit 24 periodically acquires CAN signals from various sensors, identifies the behavior of the various sensors based on the acquired CAN signals, and determines the behavior of the various sensors as shown in FIGS. Then, the behavior of the driver that can cause the driver change is determined, and it is determined whether or not the driver change is possible. Various sensors to determine driver behavior that may cause a driver change include a vehicle speed sensor that detects vehicle speed, an accelerator sensor that detects the state of the accelerator pedal, a brake sensor that detects the state of the brake pedal, and a seat belt that detects the state of the seat belt. Door open/close sensor that detects the open/closed state of the door, Seat sensor that detects whether the driver is seated, Electronic key interior detection sensor that detects the presence of the electronic key inside the vehicle, Detects the state of the shift position It is a shift sensor or the like, which determines the behavior of the driver that can cause a driver change based on one detection result or a combination of several detection results. Other than these sensors, for example, a sensor that detects the operation of the parking brake may be used. Sensors not referenced in the behavior of various sensors may be in any state. For example, when the vehicle speed sensor is not referenced, the vehicle speed sensor detects 0 km/h (indicating that the vehicle is stopped). , or 50 km/h (indicating running) may be detected. That is, if the circumstantial evidence flag is established from the behavior of various sensors, the second software execution unit 23 executes the face recognition software regardless of whether the vehicle is running or stopped.

When the change possible situation determining unit 24 determines that the driver change is possible, the circumstantial evidence flag is established, and when it is determined that the driver change is not possible, the circumstantial evidence flag is not established. Specifically, as shown in FIGS. 2 and 3, the change possible situation determining unit 24 determines that the driver change is possible in the following cases (a) to (f), and flags the situation evidence flag. Establish FIG. 2 and FIG. 3 are examples of several cases in which the behavior of a driver that can cause a change of driver is determined from the behavior of various sensors, and the present invention is not limited to this.

(a) "Change from door closed state to door open state", "change from seating sensor ON state to seating sensor OFF state", "change from seating sensor OFF state to seating sensor ON state", "door closed state to door open state" (b) While the door is kept closed (restraint condition), the "change from the seating sensor ON state to the seating sensor OFF state" and the "change from the seating sensor OFF state to the seating sensor ON state" are detected. When detected sequentially

(c) Without a seating sensor, while maintaining the door closed state and buckle sensor off state (restraint condition), "change from shift position P state to shift position D state", "shift position D state after the above" (d) The seating sensor is not installed, and "change from buckle sensor ON state to buckle sensor OFF state", "change from door closed state to door open state", "door When the "change from open state to door closed state" and "change from buckle sensor off state to buckle sensor on state" are detected sequentially

(e) Seating sensor is not installed and the door is kept closed (restraint condition), "change from buckle sensor ON state to buckle sensor OFF state", "change from buckle sensor OFF state to buckle sensor ON state" (f) Seat sensor and buckle sensor are not installed, "change from door closed state to door open state", "change from state where the electronic key is present inside the vehicle to state where the electronic key is present outside the vehicle", When the electronic key changes from being outside the vehicle to being inside the vehicle, and then from the door open to the door closed.

On the other hand, even if the change possible state determination unit 24 sequentially detects "change from the door closed state to the door open state" and "change from the door open state to the door closed state" while maintaining the seating sensor ON state, for example, , it is determined that the driver change is not possible, and the circumstantial evidence flag is not established.

The software execution control unit 25 causes the first software execution unit 22 to execute the software for detecting the unsuitable driving state at a predetermined cycle. In addition, the software execution control unit 25 determines that the driver change is possible based on the determination result of the change possible state determination unit 24 instead of causing the second software execution unit 23 to execute the face authentication software at a predetermined cycle. Execute it as a condition.

In this case, the software execution control unit 25 executes the driving unsuitable state detection software and the face authentication software in the following pattern so that the face recognition software is executed while the driving unsuitable state detection software is not being executed. to adjust. As shown in FIG. 4, the software execution control unit 25 executes the unsuitable driving state detection software at a cycle of 33 [msec], and executes the unsuitable driving state detection software at a time of 28 [msec]. .

(1) When the circumstantial evidence flag is established while the software for detecting the unsuitable driving state is not executed The software execution control unit 25, as shown in FIG. When it is determined that the circumstantial evidence flag is established, execution of the face authentication software is started immediately after it is determined that the circumstantial evidence flag is established.

(2) When the circumstantial evidence flag is established during execution of the software for detecting the unsuitable driving state The software execution control unit 25, as shown in FIG. If determined, the face authentication software is started after the execution of the driving unsuitable state detection software is finished.

(3) When a request to run unsuitable driving state detection software occurs while face authentication software is running (Part 1)
As shown in FIG. 7, when the software execution control unit 25 determines that an execution request for software for detecting an unsuitable driving state is generated during execution of the face authentication software, it interrupts the execution of the software for face authentication and detects the unsuitable driving state. Start running detection software. The software execution control unit 25 restarts the execution of the face authentication software after finishing the execution of the driving unsuitable state detection software.

(4) When a request to run unsuitable driving state detection software occurs while face authentication software is running (Part 2)
As shown in FIG. 8, when the software execution control unit 25 determines that an execution request for software for detecting an unsuitable state for driving is generated during execution of face authentication software, the software execution control unit 25 continues execution of the face authentication software, and performs the next driving. Cancels execution of inappropriate state detection software.

The facial image storage unit 26 stores the driver's facial image when the circumstantial evidence flag is established by the shift possible situation determination unit 24 . The facial image transmission unit 27 transmits the facial image of the driver to the server when the circumstantial evidence flag is established by the shift possible situation determination unit 24 .

Next, the operation of the above configuration will be described with reference to FIGS. 9 to 14. FIG.
The control device 2 starts the driver state monitoring process when the conditions for starting the driver state monitoring process are met, for example, when the ignition is switched from off to on. The condition for starting the driver status monitoring process is not limited to, for example, that the ignition has been switched from off to on, and may be that the driver has performed a predetermined operation. When the control device 2 starts the driver state monitoring process, it periodically acquires CAN signals from various sensors (S1), determines the behavior of the driver based on the behavior of the various sensors, and determines whether it is possible to change the driver. It is determined whether or not (S2, corresponding to the procedure for determining the possible replacement situation).

When the control device 2 determines that the driver change is not possible (S2: NO), it does not set the circumstantial evidence flag and determines whether the conditions for terminating the driver status monitoring process are met (S3). When the control device 2 determines that the conditions for ending the driver state monitoring process are satisfied, for example, because the ignition is switched from ON to OFF (S3: YES), the control device 2 ends the driver state monitoring process. The termination condition of the driver status monitoring process is not limited to, for example, that the ignition is switched from on to off, and may be that the driver performs a predetermined operation. For example, if the control device 2 determines that the ignition is still on and the conditions for terminating the driver state monitoring process are not satisfied (S3: NO), the control device 2 returns to step S1, and repeats step S1 and subsequent steps.

On the other hand, when the control device 2 determines that the driver change is possible (S2: YES), it establishes a situation evidence flag (S4), saves the driver's face image (S5), and saves the driver's face image. It notifies that it has been saved (S6). As shown in FIG. 10 , the control device 2 causes the display 61 to display a notification screen when the face image is saved, and outputs a notification sound when the face image is saved from the speaker 62 . A driver can recognize that the face image is saved by displaying a notification screen when the face image is saved on the display 61 and outputting a notification sound when the face image is saved from the speaker 62.例文帳に追加

The control device 2 causes the driver's facial image to be transmitted to the server (S7), and notifies that the driver's facial image has been transmitted to the server (S8). As shown in FIG. 11 , the control device 2 causes the display 61 to display a notification screen when the face image is transmitted, and causes the speaker 62 to output a notification sound when the face image is transmitted. A notification screen when the face image is transmitted is displayed on the display 61, and a notification sound when the face image is transmitted is output from the speaker 62, so that the driver can grasp that the face image has been transmitted.

The control device 2 determines whether or not a condition for starting execution of the face authentication software is satisfied (S9). YES) to start execution of face authentication software (S10, corresponding to software execution control procedure). If the control device 2 determines that the conditions for starting execution of the face authentication software are not met (S9: NO), it waits until the conditions are met. In this case, the control device 2 controls (1) when the circumstantial evidence flag is established while the software for detecting the unsuitable driving state is not executed, and (2) when the circumstantial evidence flag is established while the software for detecting the unsuitable driving state is executed. (3) When the execution request for the unsuitable driving state detection software is generated while the face authentication software is running (Part 1), (4) When the driving unsuitable state detection software is running while the face recognition software is running When an execution request is generated (part 2), the face authentication software is executed according to the situation.

When the execution of the face recognition software is completed, the control device 2 determines the face recognition result, determines whether the current face recognition result and the previous face recognition result are the same person, and determines whether the driver has changed. It is determined whether or not (S11). When the control device 2 determines that the current face recognition result and the previous face recognition result are the same person, and determines that the driver has not changed (S11: NO), the end condition of the driver status monitoring process is set. Establishment is determined (S3).

When the control device 2 determines that the current face recognition result and the previous face recognition result are not the same person, and determines that the driver has changed (S11: YES), it notifies the driver change (S12). As shown in FIG. 12 , the control device 2 causes the display 61 to display a notification screen when the driver is changed, and causes the speaker 62 to output a notification sound when the driver is changed. The driver can grasp that the system has correctly recognized the driver change by displaying a notification screen at the time of the driver change on the display 61 and outputting the notification sound at the time of the driver change from the speaker 62.例文帳に追加

The control device 2 saves the face image of the driver after the change (S13), and notifies that the face image of the driver after the change has been saved (S14). The face image of the driver stored in this manner is used as the face image registered in the first pattern described above. As shown in FIG. 13 , the control device 2 causes the display 61 to display a notification screen when the face image is saved after the driver change, and causes the speaker 62 to output a notification sound when the face image is saved after the driver change. For the driver, the display 61 displays a notification screen for saving the face image after the driver change, and the speaker 62 outputs a notification sound for saving the face image after the driver change, thereby saving the face image after the change. It is possible to grasp what has been done.

The control device 2 causes the face image of the driver after the change to be transmitted to the server (S15), and notifies that the face image of the driver after the change has been transmitted to the server (S16). The face image of the driver transmitted to the server in this way is used as the face image registered in the above-described second pattern. As shown in FIG. 14, the control device 2 causes the display 61 to display a notification screen when the face image is transmitted after the driver change, and outputs notification sound from the speaker 62 when the face image is transmitted after the driver change). For the driver, the display 61 displays a notification screen when the face image is to be sent after the driver change, and the notification sound when the face image is to be sent after the driver change is output from the speaker 62, thereby transmitting the face image after the change. It is possible to grasp what has been done.

In the above, various screens are displayed on the display 61 and various sounds are output from the speaker 62 as notifications to the driver. It is also possible to simply output.

As described above, according to this embodiment, the following effects can be obtained.
In the face detection device 7 of the driver, the face recognition software is executed on the condition that it is determined that the driver can be changed instead of executing the face recognition software periodically. By executing the software for detecting unsuitable driving conditions at predetermined intervals, it is possible to appropriately determine whether the driver is in an appropriate or unsuitable condition for driving. By doing so, it is possible to reduce the frequency of running face recognition software. As a result, it is possible to appropriately determine whether the driver is in the appropriate driving state or in the unsuitable driving state, while avoiding an increase in the steady amount of calculation. That is, by not executing the face authentication software in a situation where there is no possibility of a driver change, it is possible to avoid a constant increase in the amount of computation.

　The face recognition software is run while the unsuitable driving state detection software is not running. By executing the face recognition software without affecting the execution of the unsuitable driving state detection software at a predetermined cycle, it is possible to appropriately determine whether the vehicle is in a suitable driving state or an unsuitable driving state. can be secured.

Although the present disclosure has been described with reference to examples, it is understood that it is not limited to those examples or structures. The present disclosure also includes various modifications and modifications within the equivalent range. In addition, various combinations and configurations, as well as other combinations and configurations including single elements, more, or less, are within the scope and spirit of this disclosure.

The controller and techniques described in this disclosure may be implemented by a dedicated computer provided by configuring a processor and memory programmed to perform one or more functions embodied by the computer program. can be Alternatively, the controller and techniques described in this disclosure may be implemented by a dedicated computer provided by configuring the processor with one or more dedicated hardware logic circuits. Alternatively, the controller and techniques described in this disclosure can be implemented by a combination of a processor and memory programmed to perform one or more functions and a processor configured with one or more hardware logic circuits. It may also be implemented by one or more dedicated computers configured. The computer program may also be stored as computer-executable instructions on a computer-readable non-transitional tangible storage medium.

Claims

an image acquisition unit (21) for acquiring a facial image of the driver;
a first software execution unit (22) for executing, at predetermined intervals, software for detecting an unsuitable driving state for determining whether the driver is in an appropriate driving state or an unsuitable driving state;
a second software execution unit (23) for executing face recognition software for judging driver change;
A change possible situation determination unit (24) that determines whether or not the driver change is possible;
A software execution control unit (25) for executing the software for face authentication when it is determined that the driver can be changed according to the determination result of the change possible state determination unit.
　The driver's face authentication device according to claim 1, wherein the software execution control unit causes the face authentication software to be executed while the driving unsuitable state detection software is not being executed.
3. The software execution control unit according to claim 2, wherein the software execution control unit starts execution of the face recognition software when it is specified that the driver can be changed while the software for detecting the unsuitable driving state is not being executed. Driver face recognition device.
The software execution control unit, when it is specified that a driver change is possible during execution of the unsuitable driving state detection software, executes the face authentication software after completing the execution of the unsuitable driving state detection software. 3. The driver's face authentication device according to claim 2, which initiates the execution of.
The software execution control unit suspends execution of the face authentication software and detects the driving unsuitable state when an execution request for the software for detecting the unsuitable state for driving is generated during execution of the software for face authentication. 3. The driver's face authentication device according to claim 2, wherein execution of software is started, and execution of said face authentication software is resumed after finishing execution of said driving unsuitable state detection software.
The software execution control unit, when an execution request for the software for detecting the state of unsuitable driving is generated while the software for face authentication is being executed, causes the execution of the software for face recognition to continue, and detects the next unsuitable state for driving. 3. The driver's face authentication device according to claim 2, which cancels the execution of the software.
The alternation possible state determination unit includes a buckle sensor that detects the state of the seat belt, a door open/close sensor that detects the open/closed state of the door, a seating sensor that detects the seated state of the driver, and a state that the electronic key is present in the vehicle compartment. electronic key interior detection sensor, steering wheel touch sensor that detects the hand grip state of the steering wheel, steering wheel torque sensor that detects the steering force of the steering wheel, vehicle speed sensor that detects the vehicle speed, steering angle sensor that detects the steering angle of the steering wheel, accelerator Whether it is possible to change drivers based on the detection result of at least one of an accelerator sensor that detects the state of the pedal, a brake sensor that detects the state of the brake pedal, and a shift sensor that detects the state of the shift position. 7. The driver's face authentication device according to any one of claims 1 to 6, which determines whether or not
A facial image storage unit (26) for storing the facial image of the driver,
8. The facial image storage unit according to any one of claims 1 to 7, wherein the facial image storage unit stores the facial image of the driver when it is determined by the determination result of the driver replacement possible situation determination unit that the driver can be replaced. A facial recognition device for the described driver.
A facial image transmission unit (27) for transmitting the facial image of the driver to a server,
9. The facial image transmission unit according to any one of claims 1 to 8, wherein the facial image transmission unit transmits the facial image of the driver to the server when it is determined that the driver can be changed according to the determination result of the driver change possible state determination unit. 1. The driver's face authentication device described in 1.
A first software execution unit (22) that executes software for detecting an unsuitable driving state for determining whether the driver is in an appropriate driving state or an unsuitable driving state at predetermined intervals, and face recognition for determining driver change. to the driver's face authentication device (7) comprising a second software execution unit (23) that executes the software of
a change possible situation determination procedure for determining whether or not a driver change is possible;
and a software execution control procedure for executing the software for face authentication when it is determined that the driver can be changed according to the determination result of the procedure for determining whether the driver can be changed.