DE112016007536T5 - Vehicle mounted image authentication device - Google Patents

Abstract

A region determining unit (3) for determining whether a detected facial area is within an area designated for authenticating an occupant seated on a front seat of a vehicle, a face orientation detecting unit (4) for detecting an orientation of a person's face based on position information in a captured image of an element of the face of the person which has been detected, when it is determined that the facial area is within the designated area, a face orientation determination unit (5) for determining whether the orientation of the face the person who has been detected is within a range of the facial orientation set for authenticating the occupant seated in the front seat of the vehicle, and an authentication processing unit (6) for composing characteristic information of the captured one An image of the facial area having characteristic information of a captured image for authentication which has been accumulated in advance and for authenticating the person whose facial area is detected when it is determined that the orientation of the person's face is within the designated area of the facial orientation ,

Description

TECHNICAL AREA

The present invention relates to a vehicle-mounted technology for authenticating an occupant of the vehicle.

BACKGROUND ART

There is a system for mapping an occupant seated on a driver's seat of a vehicle or occupants seated in the driver's seat and a passenger seat, performing face authentication of the occupant using, for example, a captured image and providing a service suitable for the user authenticated inmates.

For example, as a system for performing face authentication for the occupant seated in the driver's seat, Patent Literature 1 describes a driver specifying system in which when a trigger occurs; For example, when sitting on the driver's seat of the vehicle is detected by a setting sensor, when a door of the vehicle is locked, when the door of the vehicle is closed, when a seat belt of the driver's seat of the vehicle is fastened, when the vehicle starts driving, or when the vehicle stops, an in-vehicle camera acquires a captured image of a driver's face, and the obtained captured image is used for facial authentication of the driver.

In the case of performing face authentication of the occupants seated in the driver's seat and the passenger's seat in the driver specifying system described in Patent Literature 1, moreover, a plurality of in-vehicle cameras with the in-vehicle camera for capturing an image of the occupant in the driver's seat and The in-vehicle camera prepares for picking up an image of the occupant in the front-passenger seat, or a single wide-angle camera capable of picking up an image of the driver's seat and the passenger's seat is used to capture an image of the occupants of the driver's seat and the passenger seat.

CITATION

Patent Literature

Patent Literature 1: JP 2015-71319 A

SUMMARY OF THE INVENTION

TECHNICAL PROBLEM

In the above-described technology described in Patent Literature 1, the captured image of the face of the occupant is obtained after the trigger such as the detection by the setting sensor occurs, so that when the driver's seat and the passenger seat (Engl .: passenger seat) seated inmates are represented by respective different cameras, an erroneous authentication (Engl .: authentication) for authenticating an image of a person different from the occupant does not occur frequently. In the above-described technology described in Patent Literature 1, when the occupant in the driver's seat and the occupant in the front passenger's seat are imaged with a camera, a passenger sitting in a rear seat or a person near one Window and outside the vehicle in the image, and there is a problem that authentication based on the image with the occupant or the person who has been taken is performed, and thus the erroneous authentication occurs.

The present invention is accomplished in order to solve the above-described problem, and it is an object of blocking an occurrence of erroneous authentication in which an authentication process for the person other than the occupants to be authenticated is performed in the captured image of an imaging area. in which the occupants seated in the driver's seat and the passenger seat can be displayed simultaneously.

THE SOLUTION OF THE PROBLEM

A vehicle-mounted image authentication apparatus according to the present invention is provided with: a face detection unit for detecting a facial area in which a person's face is located, from a captured image in which an imaging area is imaged, in which an occupant sitting on a driver's seat and a passenger seated in a passenger seat may be simultaneously depicted in a vehicle; a face member detecting unit for detecting an element of the person's face from the captured image of the facial area detected by the face detecting unit; a region determining unit for determining whether the facial region detected by the face detecting unit is located within an area that authenticates each of the occupants seated in the driver's seat and the passenger seat has been established; a face orientation detecting unit for, when the area determining unit determines that the facial area is within the designated area, detecting an orientation of the person's face based on position information in the captured image of the element of the person's face passing through the face element Detection unit has been detected; a face orientation determination unit for determining whether the orientation of the face of the person detected by the face orientation detection unit is within a range of face orientation set for authenticating each of the occupants seated on the driver seat and the passenger seat; and an authentication processing unit for, when the face orientation determination unit determines that the orientation of the face of the person is within the designated area of the face orientation, collating the characteristic information of the captured image of the face area with characteristic information of a face taken image for authentication, which has been accumulated in advance, and authenticating the person whose facial area is detected.

ADVANTAGEOUS EFFECTS OF THE INVENTION

According to the present invention, it is possible to block an occurrence of erroneous authentication in which an authentication process for the person other than the occupants to be authenticated is performed in the captured image of an imaging area in which the occupants seated in the driver's seat and the passenger seat simultaneously can be pictured.

list of figures

• 1 FIG. 10 is a block diagram illustrating an embodiment of a vehicle-mounted image authentication apparatus according to a first embodiment. FIG.
• 2 FIG. 10 is a view of an interior of a vehicle equipped with the vehicle-mounted image authentication apparatus according to the first embodiment, as viewed from above. FIG.
• 3A and 3B FIG. 11 is views each illustrating a hardware configuration example of the vehicle-mounted image authentication apparatus according to the first embodiment. FIG.
• 4 FIG. 13 is a view of the interior of the vehicle equipped with the vehicle-mounted image authentication apparatus according to the first embodiment as viewed from the front, the view illustrating a region designated by a region designation unit. FIG.
• 5A and 5B FIG. 15 is views each illustrating an example of an angle range set by a face orientation determination unit of the vehicle-mounted image authentication apparatus.
• 6 FIG. 10 is a flowchart illustrating an operation of the vehicle-mounted image authentication apparatus according to the first embodiment. FIG.
• 7 FIG. 10 is a block diagram illustrating another embodiment of the vehicle-mounted image authentication apparatus according to the first embodiment. FIG.
• 8th FIG. 10 is a flowchart illustrating another operation of the vehicle-mounted image authentication apparatus according to the first embodiment. FIG.
• 9 FIG. 10 is a block diagram illustrating an embodiment of a vehicle-mounted image authentication apparatus according to a second embodiment. FIG.
• 10 FIG. 10 is a flowchart illustrating an operation of the vehicle-mounted image authentication apparatus according to the second embodiment. FIG.
• 11 FIG. 10 is a block diagram illustrating an embodiment of a vehicle-mounted image authentication apparatus according to a third embodiment. FIG.
• 12 FIG. 10 is a flowchart illustrating an operation of the vehicle-mounted image authentication apparatus according to the third embodiment. FIG.
• 13 FIG. 10 is a block diagram illustrating an embodiment of a vehicle-mounted image authentication apparatus according to a fourth embodiment. FIG.
• 14 FIG. 10 is a flowchart illustrating an operation of the vehicle-mounted image authentication apparatus according to the fourth embodiment. FIG.
• 15 FIG. 10 is a block diagram illustrating an embodiment of a vehicle-mounted image authentication apparatus according to a fifth embodiment. FIG.
• 16 FIG. 10 is a flowchart illustrating an operation of the vehicle-mounted image authentication apparatus according to the fifth embodiment. FIG.

DESCRIPTION OF THE EMBODIMENTS

A mode for carrying out the present invention will hereinafter be described with reference to the accompanying drawings in order to describe the present invention in more detail.

First embodiment

1 FIG. 10 is a block diagram illustrating an embodiment of a vehicle-mounted image authentication apparatus. FIG 100 illustrated according to a first embodiment.

The vehicle-mounted image authentication device 100 is provided with a face detection unit 1 a face element detection unit 2 , a region determination unit 3 , a face orientation detection unit 4 , a face orientation determination unit 5 and an authentication processing unit 6 , In addition, the vehicle-mounted image authentication device is 100 with a camera 200 , a storage device 300 and a control device 400 connected.

In addition to the in 1 illustrated embodiment is also possible such that the vehicle-mounted image authentication device 100 with at least one of the camera 200 and the storage device 300 is provided.

2 is a view of an interior of a vehicle 500 associated with the vehicle-mounted image authentication device 100 equipped, as seen from above.

The camera 200 is formed, for example, from a wide-angle camera or the like and is arranged in a position where at least occupants 503 and 504 sitting on a driver's seat 501 or a passenger seat 502 can be pictured at the same time. A through the camera 200 captured image is sent to the face detection unit 1 the vehicle-mounted image authentication device 100 entered. In an example in 2 is an imaging area of the camera 200 through an area A specified. In the area A are in addition to the occupants 503 and 504 on the driver's seat 501 or the passenger seat 502 sit, persons X and Y that are not subject to authentication. Hereinafter, an embodiment for suppressing the vehicle-mounted image authentication apparatus will be described 100 the people X and Y using the captured image of the persons X and Y authenticated.

The face detection unit 1 analyzes this from the camera 200 input captured image and detects a region (hereinafter referred to as a facial region) in which a person's face is taken and a characteristic information of the captured image of the facial region. The face detection unit 1 sets a rectangle that surrounds the face area on the captured image and obtains coordinate values of vertices of the specified rectangle. The through the face detection unit 1 The coordinate values obtained are the coordinate values in the captured image. The face detection unit 1 gives the obtained characteristic information and coordinate values of the picked-up image of the facial area to the facial element detection unit 2 and the authentication processing unit 6 out. The face detection unit 1 gives the obtained coordinate values of the facial area to the area designation unit 3 out. Here, the characteristic information of the captured image is, for example, contrast values of portions of eyes, a nose, a mouth, and cheeks after normalizing a size of the face and the like.

The face element detection unit 2 detects an element (hereinafter referred to as a face element) that constitutes the person's face within that of the face detection unit 1 entered facial area. The facial element is for example the eyes, nose, mouth, ears, hairstyle and the like. The face element detection unit 2 The coordinate value of the area in which the detected facial element is acquired is obtained from the coordinate values of the facial area which are from the face detection unit 1 have been / is. The through the face element detection unit 2 The coordinate values obtained are also the coordinate values in the captured image. The face element detection unit 2 may obtain the coordinate values of a whole area in which each face element is drawn, or only the coordinate values of a contour of the area in which each element is drawn. The face element detection unit 2 gives the coordinate values of the detected face element to the face orientation detection unit 4 out.

The area determination unit 3 determines whether the coordinate values of the facial area, which (s) of the face detection unit 1 are / are located within an area that has been previously set to authenticate an occupant seated in a front seat of the vehicle. Here, the front seat of the vehicle is at least one of the driver's seat and the passenger's seat of the vehicle. The area determination unit 3 leads a territorial determination in order to be able to authenticate both a person sitting in the driver's seat and a person sitting in the passenger's seat of the vehicle.

The area determination unit 3 stores coordinate values of the area set to authenticate an occupant seated in the driver's seat and coordinate values of the area set for authenticating an occupant seated in the front passenger seat in a buffer or storage area (not illustrated).

In determining that the coordinate values of the facial area are not within the predetermined area, the area designation unit 3 the face element detection unit 2 to stop a capture process.

In determining that the coordinate values of the facial area are within the predetermined area, the area designation unit gives 3 this determination result to the face orientation detection unit 4 out. This in advance in the area determining unit 3 specified area will be described later in detail.

When the determination result that the coordinate values of the facial area are within the predetermined area is given by the area designation unit 3 is entered, the face orientation detection unit detects 4 an orientation of the face based on the coordinate values of the facial element, which is from the facial element detection unit 2 have been / is. A detection process of the face orientation detection unit 4 will be described later in detail. The face orientation detection unit 4 gives the detected orientation of the face to the face orientation determination unit 5 out.

The face orientation determination unit 5 determines whether the orientation of the face, through the face orientation detection unit 4 has been detected within an angular range set in advance for authenticating an occupant seated in the front seat of the vehicle. The face orientation determination unit 5 stores in advance the angle range which has been set for authenticating an occupant seated in the driver's seat, and the angle range which has been set for authenticating a passenger sitting in the passenger seat, in a buffer or storage area (not illustrated). In determining that the face orientation is within the predetermined angle range, the face orientation determination unit gives 5 this determination result to the authentication processing unit 6 out. The angular range, in advance, in the face orientation determination unit 5 will be described later in detail.

When the determination result that the face orientation is within the predetermined angle range is from the face orientation determination unit 5 is entered, represents the authentication processing unit 6 the characteristic information of the captured image of the facial area obtained by the face detection unit 1 has been input, with characteristic information of a captured image for authentication, registered in the storage device 300 , together and authenticates the person whose image of the facial area is taken. The authentication processing unit 6 gives the authentication result to the control device 400 out. When the authentication processing unit 6 For example, if the person whose image of the facial area is being photographed authenticates, the authentication processing unit obtains an ID assigned to the person in advance from the storage device 300 and gives the obtained ID as the authentication result to the control device 400 out.

On the other hand, when the authentication processing unit 6 can not authenticate the person whose image of the facial area is being taken, the authentication processing unit gives information indicating that the person is not in the storage device 300 is registered to the control device 400 for example, as the authentication result.

In the storage device 300 is registered a characteristic information of a face of a user of the vehicle, with the vehicle-mounted image authentication device 100 Is provided. The user of the vehicle includes the occupant who is likely to drive the vehicle and the occupant who is likely to be sitting in the passenger seat. The characteristic information of the face, registered in the storage device 300 , is a characteristic information of a picture in advance using the camera 200 or characteristic information of an image taken in advance using another imaging device. In addition, the storage device stores 300 the characteristic information of the face of each user in association with information specifying the corresponding user, for example the ID. Diverse informational elements may be defined as the ones associated with the characteristic information of the face are stored.

The control device 400 is a device that incorporates the vehicle mounted image authentication device 100 equipped vehicle controls. The control device 400 For example, a control device that adjusts a position and a tilt of the seat from the driver's seat and the passenger's seat includes a control device that controls an acoustic device and the like. On the basis of the authentication processing unit 6 entered authentication result performs the control device 400 suitable control for the authenticated occupant, for example control of the position and inclination of the seat preferred by the user, preferred acoustic conditions by the user and the like.

Next, a hardware configuration example of the vehicle-mounted image authentication apparatus will be described 100 described.

3A and 3B FIG. 15 are views each showing the hardware configuration example of the vehicle-mounted image authentication apparatus 100 according to the first embodiment.

The face detection unit 1 , the facial element detection unit 2 , the area determination unit 3 , the face orientation detection unit 4 , the facial orientation determination unit 5 and the authentication processing unit 6 the vehicle-mounted image authentication device 100 can be a processing circuit 100a which is a dedicated hardware, as in 3A illustrated, or a processor 100b its one in a store 100c stored program executes, as in 3B illustrated.

When the face detection unit 1 , the facial element detection unit 2 , the area determination unit 3 , the face orientation detection unit 4 , the facial orientation determination unit 5 and the authentication processing unit 6 the dedicated hardware are as in 3A illustrates corresponds to the processing circuit 100a for example, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an application specific integrated circuit (ASIC), a Field Programmable Gate Array (FPGA), or a combination thereof. Each of the functions of the face detection unit 1 , the facial element detection unit 2 , the area determination unit 3 , the face orientation capture unit 4 , the face orientation determination unit 5 and the authentication processing unit 6 may be realized by the processing circuit, or the functions of the units may be collectively implemented by a processing circuit.

When the face detection unit 1 , the facial element detection unit 2 , the area determination unit 3 , the face orientation detection unit 4 , the facial orientation determination unit 5 and the authentication processing unit 6 the processor 100b are, as in 3B illustrates, the functions of the units are implemented by software, firmware, or a combination of software and hardware. The software or firmware is described as one or more programs and in memory 100c saved. By reading and executing the in the memory 100c stored programs implemented by the processor 100b the functions of the face detection unit 1 , the facial element detection unit 2 , the area determination unit 3 , the face orientation capture unit 4 , the face orientation determination unit 5 and the authentication processing unit 6 , That is, the face detection unit 1 , the facial element detection unit 2 , the area determination unit 3 , the face orientation detection unit 4 , the facial orientation determination unit 5 and the authentication processing unit 6 with the memory 100c for storing the programs that actually execute each step in 6 which will be described later, when executed by the processor 100b , It may also be noted that the programs allow a computer to perform procedures or procedures of the face detection unit 1 , the facial element detection unit 2 , the area determination unit 3 , the face orientation capture unit 4 , the face orientation determination unit 5 and the authentication processing unit 6 perform.

Here is the processor 100b For example, a central processing unit (CPU), a processing unit, an arithmetic apparatus, a processor, a microprocessor, a microcomputer, a digital signal processor (DSP), or the like.

The memory 100c For example, a nonvolatile or volatile semiconductor memory such as a random access memory (RAM), a read only memory (ROM), a flash memory, an erasable programmable ROM (EPROM), and an electric EPROM (EEPROM) ), a magnetic disk, such as a hard disk and a flexible disk, or an optical disk, such as a minidisc, a compact disc (CD) and a digital versatile disc (DVD).

Note that some of the features of the face detection unit 1 , the facial element detection unit 2 , the area determination unit 3 , the face orientation capture unit 4 , the face orientation determination unit 5 and the authentication processing unit 6 may be implemented by the dedicated hardware, and some of which may be implemented by the software or firmware. In this way, the processing circuitry 100a in the vehicle-mounted image authentication device 100 Implement the functions described above through hardware, software, firmware or a combination thereof.

Next, the area which has been set in advance for authenticating the occupant in the area determining unit 3 , in detail with reference to 4 described.

4 FIG. 12 is a view of the interior of the vehicle that is in communication with the vehicle-mounted image authentication device. FIG 100 according to the first embodiment, as seen from the front, the view being that in the area determining unit 3 specified area illustrates.

In 4 a case is assumed where the inmates 503 and 504 in the driver's seat 501 or the passenger seat 502 in the vehicle 500 sit, and the inmates 503 and 504 are indicated by dashed lines.

A first pillar 505 is located on an outside of the driver's seat 501 , and a second pillar 506 located on an outside of the passenger seat 502 , A rectangular area 507 is an area that is in the area-determining unit 3 has been set to the on the driver's seat 501 to authenticate seated occupants. The rectangular area 508 is an area that is in the area-determining unit 3 has been set to the in the passenger seat 502 to authenticate seated occupants. The rectangular areas 507 and 508 are set to incorrect authentication of the person outside the vehicle X and in a backseat 500 sitting person Y to suppress.

Although a case where the rectangular area as in 4 As an example, as illustrated, the area to be determined is not limited to the rectangle.

The rectangular area 507 is about a headrest 501 of the driver's seat 501 set around. A position on a ceiling side in the vehicle interior of the rectangular area 507 is set, a position spatially by a predetermined distance (for example, about 15 cm) from an upper part of the headrest 501 of the driver's seat 501 to be removed to the ceiling in the vehicle interior. A position on a vehicle outside of the rectangular area 507 is set, a position spatially by a predetermined distance (for example, about 20 cm) from a side surface of a backrest 501b of the driver's seat 501 to be removed to the vehicle exterior. A position on one side of the passenger seat 502 of the rectangular area 507 is set, a position spatially distant by a predetermined distance (for example, about 10 cm) from the side surface of the backrest 501b of the driver's seat 501 to the passenger seat 502 to be.

The rectangle area is similar 508 around a headrest 502a the passenger seat 502 set around. A position on the ceiling side in the vehicle interior of the rectangular area 508 is set, a position spatially by a predetermined distance (for example, about 15 cm) from an upper part of the headrest 502a the passenger seat 502 to be removed to the ceiling in the vehicle interior. A position on the vehicle outside of the rectangular area 508 is set, a position spatially by a predetermined distance (for example, about 20 cm) from a side surface of a backrest 502b the passenger seat 502 to be removed to the vehicle exterior. A position on the side of the driver's seat 501 of the rectangular area 508 is set, a position spatially by a predetermined distance (for example, about 10 cm) from the side surface of the backrest 502b the passenger seat 502 to the driver's seat 501 to be away.

The distances from the headrests 501 and 502a to the ceiling in the vehicle interior and the predetermined distances from the seat backs 501b and 502b are values that have been appropriately determined so that the faces of the person outside the vehicle and the person in the back seat do not enter the area. Note that the definition of the rectangular areas described above 507 and 508 is merely an example, and various determinations can be suitably applied as long as they are the faulty authentication of the faces of the person outside the vehicle 500 and the person in the back seat of the vehicle 500 can suppress.

Next, the angle range that has been set in advance to authenticate the occupant in the face orientation determination unit 5 , described in detail.

5A and 5B FIG. 15 are views each illustrating an example of the angular range set in the face orientation determination unit. FIG 5 the vehicle-mounted image authentication device 100 ,

The one in the face orientation determination unit 5 Specified angular range includes the angular range in a width direction of the vehicle and the angular range in a height direction of the vehicle.

5A FIG. 12 is a vehicle interior view of the vehicle associated with the vehicle-mounted image authentication device. FIG 100 according to the first embodiment, as seen from above, the view illustrating the angular range in the width direction of the vehicle included in the face orientation determination unit 5 has been established. 5B FIG. 11 is a view of a person sitting in the vehicle with the vehicle-mounted image authentication device. FIG 100 According to the first embodiment, as seen from the side, the view illustrating the angle range in a height direction of the vehicle included in the face orientation determination unit 5 has been established.

With reference to 5A First, the angle range in the width direction of the vehicle described in the face orientation determination unit will be described 5 has been established.

The angular range in the width direction of the vehicle, that for the driver's seat 501 seated inmates 503 has been set, is an area passing through an area B between a straight line 509a and a straight line 509b is specified. Straight 509a is a straight line that has been obtained by moving a straight line 509c who have a middle position 503a between right and left eyes of the occupant 503 and a third pillar 510 in the front links, to the outside of the vehicle 500 by θa ° (for example, 10 °, 20 °, or the like). Straight 509b is a straight line that has been obtained by moving a straight line 509d that the middle position 503a between the right and left eyes of the occupant 503 and the center of a lens of the camera 200 connects to the side of the passenger seat 502 by θb ° (for example, 10 °, 20 °, or the like). Note that the straights 509c and 509d around θa ° or θb ° around the center position 503a between the right and left eyes of the occupant 503 are shifted.

Similarly, the angular range in the width direction of the vehicle, that for the on the passenger seat 502 seated inmates 504 has been established, an area passing through an area C between a straight line 511a and a straight line 511b is specified. Straight 511a is a straight line that has been obtained by moving a straight line 511c who have a middle position 504a between right and left eyes of the occupant 504 and a fourth pillar 512 in the front of the passenger seat 502 connects to the outside of the vehicle 500 around θc ° (for example, 10 °, 20 °, or the like). Straight 511b is a straight line that has been obtained by moving a straight line 511d that the middle position 504a between the right and left eyes of the occupant 504 and the center of the lens of the camera 200 connects, to the side of the driver's seat 501 by θd ° (for example, 10 °, 20 °, or the like). Note that the straights 511c and 511d around θc ° or θd ° around the center position 504a between the right and left eyes of the occupant 504 are shifted.

Next, the angle range in the height direction of the vehicle that is in the face orientation determination unit 5 has been set, with reference to 5B described.

The angle range for each of the driver's seat 501 seated inmates 503 and the passenger seat 502 seated inmates 504 has been set, is an area that passes through an area D in 5B is specified. The area D is an area of θe ° to the ceiling side of the vehicle 500 and θf ° to a bottom of the vehicle 500 around each of the straights 503b and 504b around, passing through a midpoint between the eyebrow / forehead and a tip of the nose of a corresponding one of the occupants 503 and 504 happens and is parallel to a road on which the vehicle 500 moves.

If the inmate 503 is visually recognized in the area B and the area D, the face orientation determining unit determines 5 that the facial orientation of the occupant 503 within the angle range that has been set in advance to authenticate the occupant. If the inmate 504 visually in the area C and the area D is detected, similarly determines the face orientation determination unit 5 that the facial orientation of the occupant 504 within the angle range that has been set in advance to authenticate the occupant.

Next, an operation of the vehicle-mounted image authentication apparatus will be described 100 described.

6 FIG. 10 is a flowchart illustrating the operation of the vehicle-mounted image authentication apparatus 100 illustrated according to the first embodiment.

The face detection unit 1 analyzes the captured image taken by the camera 200 has been entered, and performs a face area detection process (step ST1 ). If the facial area is not detected (step ST1 : NO), repeats the face detection unit 1 the capture process at step ST1 , On the other hand, when the facial area is detected (step ST1 : YES), receives the face detection unit 1 the coordinate values of the corner points of the rectangular area surrounding the detected face area (step ST2 ).

The face element detection unit 2 captures the facial features from the captured image of the step ST1 covered facial area (step ST3 ). At step ST3 detects, for example, the facial element detection unit 2 the facial features set in advance (for example, the eyes, nose, mouth, and ears) in a predetermined order. The face element detection unit 2 obtains the coordinate values of the facial features that are shown in step ST3 have been detected (step ST4 ). The face element detection unit 2 performs the processes described above in steps ST3 and ST4 while the determination process in the step to be described later ST5 is carried out. The face element detection unit 2 temporarily stores the obtained coordinate values of the facial elements in a buffer (not shown) or the like.

The area determination unit 3 determines whether the rectangle area containing the coordinate values given in step ST2 have been obtained as having the vertices located within the area set in advance for authenticating the occupant seated in the front seat of the vehicle (step ST5 ). When the rectangle area surrounding the face area is not within the area set in advance for authenticating the occupant seated in the front seat of the vehicle (step ST5 : NO) becomes the facial element detection unit 2 instructed to stop the capture process (step ST6 ), and the processing returns to the process at step ST1 back.

On the other hand, if the rectangle area surrounding the face area is within the area designated for authenticating the occupant seated in the front seat of the vehicle (step ST5 : YES), the face orientation detection unit detects 4 the facial orientation of the person whose image of the facial area is captured, based on a positional relationship and a change of a time series of the coordinate values of the facial elements, by the processes in steps ST3 and ST4 recorded and received (step ST7 ).

The face orientation determination unit 5 determines if the at step ST7 is detected face orientation within the angular range set for authenticating the occupant seated in the front seat of the vehicle (step ST8 ). If the face orientation is not within the specified angle range (step ST8 : NO), the processing returns to the process at step ST1 back.

On the other hand, if the face orientation is within the specified angle range (step ST8 : YES), represents the authentication processing unit 6 the characteristic information of the captured image of the facial area, which is from the face detection unit 1 has been input, with the characteristic information of the captured image for authentication, registered in the storage device 300 , together and performs the authentication process for the person whose facial image is captured (step ST9 ). The authentication processing unit 6 gives an authentication result at step ST9 to the control device 400 from (step ST10), and the processing is ended.

If the camera 200 between the driver's seat and the passenger's seat, and each of the occupants sitting in the driver's seat and the occupant sitting in the front passenger's seat, as in 4 and 5 is authenticated, there is a case where the face detection unit 1 detected a plurality of facial areas.

As described above, according to the first embodiment, it is configured to be provided with a face detection unit 1 for detecting a facial area in which a person's face is located and characteristic facial area information from a captured image, in which an imaging area in which an occupant sitting in a driver's seat and an occupant seated in a passenger's seat of a vehicle can be imaged , is mapped to a facial element detection unit 2 for analyzing the captured image of the detected facial area and detecting an element of the person's face, a region determining unit 3 for determining whether the detected face area is within an area set to authenticate an occupant seated on a front seat of the vehicle, a face orientation detection unit 4 for calculating an orientation of the face of the person based on position information in the captured image of the detected element of the person's face, a face orientation determination unit 5 for determining whether the calculated orientation of the person's face is within a range of the facial orientation that has been determined to authenticate the occupant seated in the front seat of the vehicle, and an authentication processing unit 6 for, when it is determined that the calculated orientation of the face is within the predetermined range of the facial orientation, compiling the characteristic information of the captured image of the facial area with characteristic information of a captured image for authentication which has been accumulated in advance, and authenticating the person whose facial area is detected so that it is possible to extract the facial image of the person to be authenticated, for authenticating even if a person different from the person to be authenticated is imaged in the captured image. Therefore, even if there is a single vehicle-mounted camera, it is possible to authenticate the occupant sitting in the driver's seat and the passenger sitting in the front passenger's seat. In addition, it is possible to prevent the authentication process from being performed for a person who exists in a position unsuitable for authentication.

In the first embodiment described above, the configuration in which the face orientation determining unit is described 5 determines whether the orientation of the face of the person is within the range of the face orientation that has been set to authenticate the occupant seated in the front seat of the vehicle, and if it is determined that it is within the designated area of the face orientation, authenticates the authentication processing unit 6 the person whose facial area is detected. The authentication processing unit 6 may also be configured to authenticate the person whose facial area is detected based on, for example, whether the person's eyes are open, in addition to the orientation of the person's face described above. 7 illustrates the configuration of the vehicle-mounted image authentication device 100 that authenticates the person on the basis of whether the person's eyes are open, in addition to the orientation of the person's face.

7 FIG. 12 is a block diagram illustrating another embodiment of the vehicle-mounted image authentication apparatus. FIG 100 illustrated according to the first embodiment.

7 Fig. 13 illustrates an example configured by adding an eye opening determination unit 5a to the face orientation determination unit 5 the vehicle-mounted image authentication device 100 , in the 1 is illustrated. Here, the same reference numerals as in FIG 1 used the same or corresponding components as those of the above-described vehicle-mounted image authentication apparatus 100 and their description is omitted or simplified.

The face element detection unit 2 detects, for example, eye corners, upper eyelids, and lower eyelids in addition to the eyes, nose, mouth, ears, and hairstyle as the facial features within that of the face detection unit 1 entered facial area. The face element detection unit 2 Gives the coordinate values of the detected facial elements to the face orientation detection unit 4 and the eye opening determination unit 5a out.

The face orientation determination unit 5 determines whether the through the face orientation detection unit 4 is detected orientation of the face within an angular range set in advance for authenticating the occupant seated in the front seat of the vehicle. If the face orientation determination unit 5 determines that the face orientation is within the predetermined angular range determines the eye opening determination unit 5a whether the eyes of the person are opened based on the coordinate values of the facial elements received from the facial element detection unit 2 have been entered. More specifically, the eye opening determination unit determines 5a whether the person's eyes are open, using the coordinate values regarding the eyes, such as eyes, corner of the eye, upper eyelids and lower eyelids. For example, when differences between the coordinate values of the upper eyelids and lower eyelids are equal to or larger than a threshold, the eye opening determination unit determines 5a that the eyes of the person are open. The face orientation determination unit 5 indicates the determination result on the face orientation and the determination result on whether the eyes are open to the authentication processing unit 6 out.

When the determination result that the face orientation is within the predetermined angle range is from the face orientation determination unit 5 is inputted, and the determination result that the eyes of the person are opened from the eye opening determination unit 5a is entered, represents the authentication processing unit 6 the characteristic information of the captured image of the face detection unit 1 input facial area with the characteristic information of the captured image for authentication, registered in the storage device 300 , together and authenticate the person whose facial image is taken. The authentication processing unit 6 gives the authentication result to the control device 400 out.

Next, the operation of the vehicle-mounted image authentication apparatus will be described 100 for determining whether the person's eyes are open, in addition to the orientation of the person's face.

8th FIG. 10 is a flowchart illustrating another operation of the vehicle-mounted image authentication apparatus. FIG 100 illustrated according to the first embodiment. Note that, hereinafter, the same steps as those of the vehicle-mounted image authentication apparatus described above 100 the same reference numerals as in FIG 6 are used and their description is omitted or simplified.

At step ST8 when it is determined that the face orientation is within the specified angle range (step ST8 : YES) determines the eye opening determination unit 5a whether the person's eyes are open (step ST8a ). If the person's eyes are not open (step ST8a : NO), the processing returns to the process at step ST1 back. On the other hand, if the person's eyes are open (step ST8a : YES), represents the authentication processing unit 6 the characteristic information of the captured image of the face detection unit 1 input facial area with the characteristic information of the captured image for authentication, registered in the storage device 300 , together and performs the authentication process for the person whose facial image is captured (step ST9 ). The authentication processing unit 6 gives an authentication result at step ST9 to the control device 400 from (step ST10), and the processing is ended.

As described above, the eye opening determination unit 5a provided for determining whether the eyes of the person are opened, for example, based on the position information in the captured image of the element of the person's face, which is detected by the facial element detection unit 2 has been detected, and the authentication processing unit 6 is configured to authenticate the person when the orientation of the face of the person is within the designated area of the face orientation, and the eye opening determination unit 5a determines that the person's eyes are open, so that it becomes possible to prevent the authentication process from being performed for the person or person who is closing the eyes at an unsuitable location for authentication.

Second embodiment

In a second embodiment, an embodiment is described for repeating an authentication process a plurality of times until a person whose facial area image is captured is authenticated.

9 FIG. 10 is a block diagram illustrating an embodiment of a vehicle-mounted image authentication apparatus. FIG 100A illustrated according to the second embodiment.

The vehicle-mounted image authentication device 100A According to the second embodiment, it is configured by adding a termination determination unit 6a to an authentication processing unit 6 a vehicle-mounted image authentication device 100 which has been described in the first embodiment.

Hereinafter, the same reference numerals as the same or corresponding components as those used in the first embodiment are used as those of the vehicle-mounted image authentication apparatus 100 according to the first embodiment, and the description thereof is omitted or simplified.

When the authentication processing unit 6 it is not the person whose picture of the facial area is being recorded that determines the termination determination unit 6a whether the authentication process is repeated a prescribed number of times or during a prescribed period. The termination determination unit 6a For example, the number of times by the authentication processing unit counts 6 and stores the counted frequency in a temporary storage area (not shown) such as a buffer. If the stored frequency is smaller than the prescribed frequency, the scheduling determining unit indicates 6a a face detection unit 1 to repeat the authentication process.

The termination determination unit 6a may also include shift position information from, for example, a vehicle 500 and determine whether a shift position is different from a stop position (P) to a different stop position (unlike P) moves. The termination determination unit 6a has the face detection unit 1 to repeat the authentication process during a period until the vehicle's shift position 500 moves to the different stop position (other than P).

The termination determination unit 6a may also include vehicle speed information, for example from the vehicle 500 get and determine if a vehicle speed of the vehicle 500 1 km / h or higher reached. The termination determination unit 6a has the face detection unit 1 to repeat the authentication process during a period until the vehicle speed of the vehicle 500 1 km / h or higher reached.

Next, an operation of the vehicle-mounted image authentication apparatus will be described 100A described.

10 FIG. 10 is a flowchart illustrating the operation of the vehicle-mounted image authentication apparatus 100A illustrated according to the second embodiment. Note that the flowchart in 10 a case illustrates where the termination determination unit 6a determined on the basis of the frequency of the compilation process.

Note that hereinafter, the same steps as those of the vehicle-mounted image authentication apparatus 100 according to the first embodiment, the same reference numerals as those in FIG 6 are used and their description is omitted or simplified.

At step ST9 when the authentication processing unit 6 performs the authentication process, determines the termination determination unit 6a whether the person whose image of the facial area is being recorded is authenticated (step ST11 ). When it is determined that the person whose image of the facial area is being recorded is authenticated (step ST11 : YES), the processing goes to a process at step ST10 ,

On the other hand, if it is determined that the person whose image of the facial area is being recorded is not being authenticated (step ST11 : NO) adds the termination determination unit 6a "1" to the frequency of compilation (step ST12 ) and determines whether the frequency of composition after the addition is equal to or greater than a prescribed frequency (step ST13 ). If the frequency of authentication is less than a prescribed frequency (step ST13 : NO), indicates the termination determination unit 6a the face detection unit 1 to re-execute the authentication process (step ST14 ). On the other hand, if the frequency of authentication is equal to or greater than a prescribed frequency (step ST13 : YES), the processing proceeds to the process at step ST10 ,

As described above, according to the second embodiment, the termination determination unit 6a provided to when the authentication processing unit 6 can not authenticate the person whose face area is detected, determining whether the frequency of authentication or an authentication time in the authentication processing unit 6 reaches a prescribed frequency or a prescribed time, and, at the time of non-reaching, instructing the face detection unit 1 it is possible to recapture the facial area so that, if the time of taking the picture of the person is not appropriate, it is possible to execute the authentication process again for the picture taken at an appropriate time. When the person in the vehicle 500 If, for example, hair hangs over the face and the person can not be authenticated from the captured image, the authentication process can be re-executed based on the new captured image. As a result, it is possible to suppress a problem that the user can not be authenticated even though the user is in the storage device 300 is registered.

Third embodiment

In a third embodiment, an embodiment for changing a composition threshold of an authentication processing unit 6 described on the basis of a detected facial orientation.

11 FIG. 10 is a block diagram illustrating an embodiment of a vehicle-mounted image authentication apparatus. FIG 100B illustrated according to the third embodiment.

The vehicle-mounted image authentication device 100B According to the third embodiment, it is configured by adding a collation threshold determination unit 7 to the vehicle-mounted image authentication apparatus described in the first embodiment 100 ,

Here, the same reference numerals as those used in the first embodiment are used the same or corresponding components as those of the vehicle-mounted image authentication device 100 according to the first embodiment, and the description thereof is omitted or simplified.

When an authentication processing unit 6 a characteristic information of a captured image of a facial area received from the face detection unit 1 has been input, with characteristic information of a captured image for authentication, registered in a storage device 300 , Composes, is in a case where the orientation of the face at the time of registration in the storage device 300 close to the orientation of the face of the recorded image of the facial area, a degree of coincidence is calculated to be high. On the other hand, if the orientation of the face at the time of registration in the storage device 300 is different from the orientation of the face of the captured image of the facial area, the authentication processing unit calculates 6 the coincidence degree to be low. The authentication processing unit 6 performs the authentication based on whether the calculated coincidence degree is equal to or greater than the aggregation threshold. Therefore, depending on the facial orientation of the captured image of the facial area, there is a case where the authentication processing unit 6 authenticating the same person, and a case of non-authenticating the same person.

Therefore, the collation threshold determination unit determines 7 the collation threshold when the authentication processing unit 6 performs authentication depending on the facial orientation of the recorded image of the facial area.

It is first assumed that the storage device 300 stores the characteristic information of the face of each user in association with information specifying the corresponding user and information indicating the facial orientation of the captured image for authentication to the corresponding user.

When a determination result that the face orientation is within a predetermined angular range is from a face orientation determination unit 5 is input, receives the collation threshold determination unit 7 the characteristic information of the captured image for authentication used for compilation and the information indicating the facial orientation of the captured image for authentication from the storage device 300 , The collation threshold determination unit 7 for authentication compares the facial orientation of the captured image with the facial orientation of the captured image of the facial area, which is detected by the face orientation determination unit 5 has been determined to be within the predetermined angular range. The collation threshold determination unit 7 sets the collation threshold higher than a prescribed value if / how angles of the face orientation of the captured image for authentication and the facial orientation of the captured image of the facial area are closer. On the other hand, the collation threshold determination unit sets 7 the collation threshold lower than the prescribed value if / how the angles of the facial orientation of the captured image for authentication and the facial orientation of the captured image of the facial area are different.

On the basis of the composition threshold determination unit 7 set compilation threshold provides the authentication processing unit 6 the characteristic information of the recorded image of the facial area obtained by the face detection unit 1 has been entered with the characteristic information of the captured image for authentication by the composition threshold determination unit 7 from the storage device 300 has been obtained, and performs an authentication process for the person whose facial image is captured.

The collation threshold determination unit 7 can determine the aggregation threshold based on conditions different from the facial orientation. For example, the collation threshold determination unit determines 7 the collation threshold based on a relationship between the coordinate values in the captured image of the facial area and the coordinate values of the facial area in the captured image for authentication, which is in the storage device 300 are registered / is. More specifically, the collation threshold determination unit 7 determine the collation threshold based on the position of the facial area in the image. If the position of the facial area is on an edge of the captured image, there is a possibility of mapping the face from the side, so that the collation threshold determination unit 7 the compilation threshold specifies to be lower than the prescribed value.

Next, an operation of the vehicle-mounted image authentication apparatus will be described 100B described.

12 FIG. 10 is a flowchart illustrating the operation of the vehicle-mounted image authentication apparatus 100B illustrated according to the third embodiment. Note that hereinafter, the same steps as those of the vehicle-mounted image authentication apparatus 100 according to the first embodiment, the same reference numerals as in FIG 6 are used and their description is omitted or simplified.

Also, there are in the flow chart of 12 a case where the collation threshold determination unit 7 determines the composition threshold based on the facial orientation of the captured image of the facial region.

At step ST8 when it is determined that the face orientation is within the specified angle range (step ST8 : YES), obtains the collation threshold determination unit 7 the characteristic information of the captured image for authentication and the information indicating the facial orientation of the captured image for authentication from the storage device 300 (Step ST21 ). The collation threshold determination unit 7 compares the facial orientation of the captured image to the authentication that you did in step ST21 has been obtained with the facial orientation provided by the face orientation detection unit 4 has been detected to determine the composition threshold (step ST22 ). Note that the collation threshold determination unit 7 that through the face orientation detection unit 4 detected face orientation via the face orientation determination unit 5 receives.

Based on the at step ST22 certain aggregate threshold is provided by the authentication processing unit 6 the characteristic information of the captured image of the facial area, which is from the face detection unit 1 has been entered, with the characteristic information of the captured image for authentication, the step ST21 and performs the authentication process for the person whose image of the facial area is being recorded (step ST9A ). The authentication processing unit 6 gives an authentication result at step ST9A to the control device 400 out (step ST10 ), and processing is terminated.

As described above, according to the third embodiment, the collation threshold determination unit becomes 7 provided for determining the collation threshold based on at least one of the position in the captured image of the facial region and the orientation of the face of the person passing through the face orientation detection unit 4 has been detected, and the authentication processing unit 6 is configured to compose the characteristic information of the captured image of the facial area which is detected by the face detection unit 1 has been detected with the characteristic information of the captured image for authentication which has been accumulated in advance, and for authenticating the person on the basis of whether the composition result is equal to or greater than the composition threshold, so as to make it possible to satisfy the conditions Position and the face orientation in the captured image in facilitating the authentication process easier. Moreover, even if the position and the facial orientation in the captured image in performing the authentication process are different from those in the captured image for authentication, the authentication performance can be improved.

Note that although a case where the authentication face face for each captured image has been accumulated for authentication is described as an example in the above-described third embodiment, when the image is taken for authentication at a predetermined face orientation angle, it is also possible to change the face orientation angle in the storage device 300 to register. In addition, when the image is taken at the predetermined face orientation angle, the collation threshold determination unit 7 hold the face orientation angle.

Note that, although the configuration obtained by adding the collation threshold determination unit 7 to the authentication processing unit 6 the vehicle-mounted image authentication device 100 In the third embodiment described above, in the first embodiment described above, it is also possible to set the collation threshold determining unit 7 to the authentication processing unit 6 the vehicle-mounted image authentication device 100A to add further, the in the second embodiment has been described.

Fourth embodiment

In a fourth embodiment, an embodiment for starting an authentication process with detection of a certain vehicle state as a trigger is described.

13 FIG. 10 is a block diagram illustrating an embodiment of a vehicle-mounted image authentication apparatus. FIG 100C illustrated according to the fourth embodiment.

The vehicle-mounted image authentication device 100C According to the fourth embodiment, it is configured by adding a vehicle information obtaining unit 8th and a vehicle state determination unit 9 to a vehicle-mounted image authentication apparatus described in the first embodiment 100 ,

Here, the same reference numerals as the same or corresponding components as those used in the first embodiment are the same as those of the vehicle-mounted image authentication apparatus 100 according to the first embodiment, and the description thereof is omitted or simplified.

The vehicle information obtaining unit 8th receives vehicle information from, for example, a vehicle sensor, a navigation device, a GPS receiver (not illustrated), and the like. The vehicle information includes, for example, information indicating unlocking and locking of a door, information indicating opening and closing of the door, information indicating attachment and detachment of a seat belt, information indicating ON or OFF. Indicates a state of ignition, information indicating an ON or OFF state of a human sensor, information indicating a position of a gearshift lever, information indicative of a vehicle speed, information indicating a vehicle speed Indicates guidance state of a navigation device, position information of the vehicle, and the like. The vehicle information obtaining unit 8th receives at least one of these elements of the vehicle information and gives the same to the vehicle state determination unit 9 out.

The vehicle state determination unit 9 References the vehicle information provided by the vehicle information obtaining unit 8th has been obtained, and upon detecting that the vehicle state reaches a state which has been set in advance for authenticating an occupant, a face detection unit 1 to perform a face detection process from a captured image.

In the example of the vehicle information described above, the vehicle state determination unit 9 the face detection unit 1 to perform the face detection process of the captured image upon detecting any of unlocking the door, opening the door, attaching the seatbelt, turning ON the ignition, turning ON the human sensor, moving the gearshift lever to a driving position, the 0 km / h exceeding vehicle speed, a start of the guidance of the navigation device, a departure of the vehicle from home and the like.

Next, a hardware configuration example of the vehicle-mounted image authentication apparatus will be described 100C described. Note that views each represent the hardware configuration example of the vehicle-mounted image authentication apparatus 100C of the fourth embodiment, the same as those illustrated in the first embodiment 3A and 3B are and are therefore not illustrated. In addition, the description of the same components as that of the first embodiment will be omitted.

The vehicle information obtaining unit 8th and the vehicle state determination unit 9 in the vehicle-mounted image authentication device 100C can / can a processing circuit 100a which is a dedicated hardware, as in 3A illustrated, or a processor 100b that executes a program that is in a memory 100c is stored as in 3B illustrated.

When the vehicle information obtaining unit 8th and the vehicle state determination unit 9 the processor 100b are, as in 3B The functions of the vehicle information obtaining unit are also illustrative 8th and the vehicle state determination unit 9 implemented by software, firmware or a combination of software and hardware. The software or firmware is described as one or more programs and in the memory 100c saved. The processor 100b implements the functions of the vehicle information obtaining unit 8th and the vehicle state determination unit 9 by reading and executing in the memory 100c stored programs. That is, the vehicle information obtaining unit 8th and the vehicle state determination unit 9 with the memory 100c for storing the programs that actually execute each step in 14 is illustrated, the to be described later when going through the processor 100b is performed. It may also be said that the programs enable a computer to perform procedures or procedures of the vehicle information obtaining unit 8th and the vehicle state determination unit 9 perform.

Note that some of the functions of the vehicle information obtaining unit 8th and the vehicle state determination unit 9 may be implemented by the dedicated hardware, and some of which may be implemented by the software or firmware. In this way, the processing circuitry 100a in the vehicle-mounted image authentication device 100C Implement the functions described above through hardware, software, firmware or a combination thereof.

Next, an operation of the vehicle-mounted image authentication apparatus will be described 100C described.

14 FIG. 10 is a flowchart illustrating the operation of the vehicle-mounted image authentication apparatus 100C illustrated according to the fourth embodiment.

The vehicle state determination unit 9 Referenced by the vehicle information obtaining unit 8th obtained vehicle information and determines whether the vehicle state becomes a predetermined state (step ST31 ). When the vehicle state does not become the predetermined state (step ST31 : NO) repeats the vehicle state determination unit 9 the process at step ST31 , On the other hand, when the vehicle state becomes the predetermined state (step ST31 : YES), indicates the vehicle state determination unit 9 the face detection unit 1 to perform a face region detection process (step ST32 ). Thereafter, the vehicle-mounted image authentication device performs 100C Processes of step ST1 until step ST10 by.

Although it is described above, that in a region determining unit 3 Fixed area is set in advance, note that in the area-determining unit 3 fixed area may be a fixed area or may be an area which may be set depending on a type of vehicle information, by the vehicle state determining unit 9 has been referenced.

For example, this will be in the area determination unit 3 fixed area changed between a case where the vehicle state determination unit 9 the authentication process starts with a detection of the opening of the door as the trigger, and a case where the vehicle state determination unit 9 starts the authentication process with detection of attaching the seat belt as the trigger.

When the vehicle state determination unit 9 the detection of opening the door used as the trigger, are in the area determination unit 3 determined to be closer to a door on a driver's seat side and a door on a passenger seat side. On the other hand, when the vehicle state determination unit 9 the detection of fastening the seatbelt used as the trigger, in the area-determining unit 3 be determined to be in the vicinity of headrests of the driver's seat and the passenger seat.

The area determination unit 3 accumulates the setting areas depending on the vehicle conditions detected by the vehicle state determining unit 9 as the triggers are used in advance, and reads out the setting area depending on the determination result obtained from the vehicle state determining unit 9 has been entered. Alternatively, the vehicle state determination unit 9 the determination areas accumulate depending on the vehicle conditions, and the designation area depending on the determination result for the area designation unit 3 establish.

By setting for determination by the area designation unit 3 of the area used depending on the vehicle state, it is possible to perform a determination process on whether the face area exists in a position always suitable for the authentication process.

As described above, according to the fourth embodiment, the vehicle state determination unit becomes 9 provided for referencing the vehicle information of the vehicle and instructing the face detection unit 1 to detect the facial area in determining that the vehicle state of the vehicle becomes the state that has been set to authenticate the occupant seated in the front seat of the vehicle so that even if a person different from the person to be authenticated in the captured image is, it is possible to extract a face image of the person to be authenticated and perform authentication when the vehicle state becomes the specified vehicle state, and to prevent the authentication process from being performed for a person who exists in a position unsuitable for authentication is. Even if only Therefore, if there is a single vehicle-mounted camera, it is possible to authenticate the occupant seated in the front seat of the vehicle.

According to the fourth embodiment, the area for authenticating the occupant seated in the front seat of the vehicle, which has been set in the area designating unit, is configured to be the fixed area or the area determined depending on the type of the vehicle information which is determined by the vehicle state determination unit 9 has been referenced so that it is possible to perform the determining process of determining whether the face area is currently in the position suitable for the authentication process.

Although the configuration that has been obtained by adding the vehicle information obtaining unit 8th and the vehicle state determination unit 9 to the vehicle-mounted image authentication apparatus described in the first embodiment 100 In the fourth embodiment described above, note that it is also possible to have the vehicle information obtaining unit 8th and the vehicle state determination unit 9 to the vehicle-mounted image authentication apparatus described in the second embodiment 100A add.

Fifth embodiment

In a fifth embodiment, an embodiment is described for specifying a composition threshold for an authentication process based on vehicle information.

15 FIG. 10 is a block diagram illustrating an embodiment of a vehicle-mounted image authentication apparatus. FIG 100D illustrated according to the fifth embodiment.

The vehicle-mounted image authentication device 100D According to the fifth embodiment, it is configured by adding a vehicle information obtaining unit 8th and a vehicle state determination unit 9 to a vehicle-mounted image authentication apparatus described in the first embodiment 100 and by further adding a collation threshold determination unit 7a to an authentication processing unit 6 ,

Hereinafter, the same reference numerals as those used in the first, third and fourth embodiments are the same or corresponding components as those of the vehicle-mounted image-authentication apparatuses 100 . 100B and 100C according to the first, third and fourth embodiments, and the description thereof is omitted or simplified.

The vehicle state determination unit 9 references position information of a vehicle received from the vehicle information obtaining unit 8th has been entered, and notifies, upon detecting that the vehicle is at a predetermined specific point, the composition threshold determination unit 7a in the authentication processing unit 6 about the detection together with the position information of the point.

A storage device 300 stores characteristic information of a face of each user, information (for example, an ID) for specifying each user, and position information of the specific point in association with each other.

When a determination result that a face orientation is within a predetermined angular range is from a face orientation determination unit 5 is input, the collation threshold determination unit references 7a the storage device 300 and searches for a user who has the position information that coincides with the position information received from the vehicle state determination unit 9 has been reported. When searching for the user, the collation threshold determining unit performs 7a a process of setting the collation threshold for the searched user to be lower than a prescribed value.

On the basis of the composition threshold determination unit 7a set compilation threshold provides the authentication processing unit 6 characteristic information of a captured image of a facial area, which is from a face detection unit 1 has been input with characteristic information of a captured image for authentication obtained from the storage device 300 , together and performs the authentication process for a person whose image of the facial area is being recorded.

For example, if a current position information of the vehicle indicates that the vehicle When it is located at the home of the user who owns the vehicle, it is contemplated that an occupant seated in a front seat of the vehicle is often a family member of the user owning the vehicle. Therefore, the vehicle state determination unit references 9 the position information of the vehicle and, upon detecting that the vehicle is at the home of the user who owns the vehicle as the pre-set point, notifies the collation threshold determination unit 7a about the registration together with the position information of the home. The collation threshold determination unit 7a references the storage device 300 for searching for the user to whom the home location information is assigned, and performs the process of setting the collation threshold for the searched user to be lower than the prescribed value. On the basis of the composition threshold determined by the composition threshold determination unit 7a has been set to be lower than the prescribed value, the collation threshold set for the user owning the vehicle and the user's family leads the authentication processing unit 6 the authentication process for the person whose facial image is taken.

Next, an operation of the vehicle-mounted image authentication apparatus will be described 100D described.

16 FIG. 10 is a flowchart illustrating the operation of the vehicle-mounted image authentication apparatus 100 illustrated according to the fifth embodiment.

The vehicle state determination unit 9 Referenced by the vehicle information obtaining unit 8th obtained vehicle information and determines whether the vehicle state becomes a predetermined state (step ST31 ). When the vehicle state does not become the predetermined state (step ST31 : NO) repeats the vehicle state determination unit 9 the process at step ST31 , On the other hand, when the vehicle state becomes the predetermined state (step ST31 : YES), the processing goes to a process at step ST32 , Parallel with processes at and after step ST32 references the vehicle state determination unit 9 the position information of the vehicle generated by the vehicle information obtaining unit 8th has been obtained, and determines whether the vehicle is at the predetermined specific point (step ST41 ).

If the vehicle is not at the specific point (step ST41 : NO), the processing proceeds to step ST9b , On the other hand, if the vehicle is at the specific point (step ST41 : YES) notifies the vehicle state determination unit 9 the collation threshold determination unit 7a in the authentication processing unit 6 that the vehicle is at the specific point and notifies the same about the position information of the vehicle (step ST42 ). Thereafter, the processing proceeds to a process at step ST43 ,

The processes of step ST1 until step ST8 are performed and if the face orientation is within the specified angle range (step ST8 : YES), the collation threshold determination unit references 7a the storage device 300 and determines whether there is a user to whom the position information corresponding to the position information of the vehicle shown in step ST42 has been reported (step ST43 ). If there is not such a user (step ST43 : NO), processing moves to a process at step ST9b , On the other hand, if there is the user (step ST43 : YES), sets the collation threshold determination unit 7a the aggregate threshold for the user sought to be lower than the prescribed value (step ST44 ). If the compilation threshold at step ST44 is set, based on the composition threshold, the authentication processing unit 6 the characteristic information of the captured image of the facial area, which is from the face detection unit 1 has been input, with the characteristic information of the captured image for authentication, registered in the storage device 300 , together and performs the authentication process for the person whose facial image is being captured (step ST9b ); then there is the authentication processing unit 6 an authentication result at step ST9b to the control device 400 out (step ST10 ), and processing is terminated.

If the composition threshold is set to be lower than the prescribed value, at step ST9b , the authentication process is performed by applying the aggregation threshold that has been set to be lower. Thus, if the vehicle is at the specific point, such as the user's home, the collection threshold for the registered family may be set low, and therefore the family is more likely to be authenticated.

As described above, according to the fifth embodiment, the collation threshold determination unit becomes 7b provided for determining on the basis of the determination result by the vehicle state determination unit 9 in that the vehicle is at the specific point, the aggregation threshold, and the authentication processing unit 6 is configured to compose the characteristic information of the captured image of the facial area which is detected by the Face detection unit 1 has been detected with the characteristic information of the captured image for authentication accumulated in advance and for authenticating the person on the basis of whether the composition result is equal to or greater than the composition threshold, and the composition threshold determination unit 7b is configured to determine, based on the determination result by the vehicle state determination unit 9 that the vehicle is at the specific point, the composition threshold, so that it becomes possible to facilitate the condition in performing the authentication process when the vehicle is at the specific point.

Although the embodiment obtained by adding the collation threshold determination unit 7a , the vehicle information obtaining unit 8th and the vehicle state determination unit 9 to the vehicle-mounted image authentication apparatus described in the first embodiment 100 In the fifth embodiment described above, note that it is also possible to have the vehicle information obtaining unit 8th and the vehicle state determination unit 9 to the vehicle-mounted image authentication apparatus described in the third embodiment 100B and the function of the collation threshold determination unit 7a to the composition threshold determination unit 7 add.

Other than the above description, in the present invention, the embodiments may be freely combined, any component of each embodiment may be modified, or any component in each embodiment may be omitted without departing from the scope of the invention.

INDUSTRIAL APPLICABILITY

Since the vehicle-mounted image authentication apparatus according to the present invention can extract the face image of the person to be authenticated from the captured image in which the face of the person to be authenticated and the face of a person different from the person to be authenticated can be imaged and authenticated , it is suitable to be used in the vehicle or the like, which is controlled and used for each user to improve the authentication accuracy of the user.

LIST OF REFERENCE NUMBERS

1

Face detection unit

2

Face element detection unit

3

Area determining unit

4

Face orientation detection unit

5

Face orientation determining unit

5a

Eye opening determination unit

6

Authentication processing unit

6a

Termination determination unit

7, 7a

Compilation threshold determination unit

8th

Vehicle information obtaining unit

9

Vehicle condition determination unit

100, 100A, 100B, 100C, 100D

vehicle-mounted image authentication device

200

camera

300

storage device

400

control device

500

vehicle

501

driver's seat

502

passenger seat

503, 504

inmate

QUOTES INCLUDE IN THE DESCRIPTION

This list of the documents listed by the applicant has been generated automatically and is included solely for the better information of the reader. The list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions.

Cited patent literature

• JP 2015071319A [0005]

Claims (11)

A vehicle mounted image authentication device, comprising: a face detection unit for detecting a facial area in which a person's face is located and characteristic face area information from a captured image in which an imaging area is depicted, in which an occupant sitting on a driver's seat and a passenger sitting in a passenger's seat Inmates can be mapped in a vehicle at the same time; a face element detection unit for detecting an element of the person's face from the captured image of the facial area detected by the face detection unit; a region determining unit for determining whether the facial region detected by the face detecting unit is located within an area designated for authenticating each of the occupants seated in a front seat of the vehicle; a face orientation detecting unit for, when the area determining unit determines that the facial area is within the designated area, detecting an orientation of the face of the person based on position information in the captured image of the element of the person's face passing through the face element Detection unit has been detected; a face orientation determination unit for determining whether the orientation of the face of the person detected by the face orientation detection unit is within a range of face orientation set for authenticating each of the occupants seated in the front seat of the vehicle; and an authentication processing unit for, when the face orientation determination unit determines that the orientation of the face of the person is within the designated area of face orientation, composing the characteristic information of the captured image of the face area with characteristic information of a captured image for authentication which has been accumulated in advance is, and authenticating the person whose facial area is detected. Vehicle-mounted image authentication device according to Claim 1 comprising: an eye opening determination unit for determining whether eyes of the person are opened based on the position information in the captured image of the element of the face of the person detected by the facial element detection unit, the authentication processing unit authenticating the person, when the orientation of the face of the person is within the predetermined range of the face orientation, and the eye opening determination unit determines that the eyes of the person are opened. Vehicle-mounted image authentication device according to Claim 1 comprising: a termination determination unit for, if the authentication processing unit can not authenticate the person whose facial area is detected, determining whether a frequency of authentication or an authentication time in the authentication processing unit reaches a prescribed frequency or a prescribed time, and a time of non-reaching, instructing the face detection unit to re-detect the face area. Vehicle-mounted image authentication device according to Claim 1 image processing apparatus comprising: a composition threshold determination unit for determining a composition threshold on the basis of at least one of a position in the captured image of the facial area and the orientation of the face of the person detected by the facial orientation detection unit, wherein the authentication processing unit receives the characteristic information the collected image of the facial area detected by the face detection unit is assembled with the characteristic information of the captured image for authentication that has been accumulated in advance, and the person authenticates on a basis thereof whether a composition result is equal to or greater than the compilation threshold is. Vehicle-mounted image authentication device according to Claim 1 vehicle status determination unit for referencing vehicle information of the vehicle and instructing the face detection unit to detect the face area, upon determining that a vehicle state of the vehicle becomes a state that is for authenticating each of the occupants seated in the front seat of the vehicle has been established. Vehicle-mounted image authentication device according to Claim 5 wherein the area for authenticating each of the occupants seated in the front seat of the vehicle, which has been set in the area determining unit, is a fixed area or an area determined depending on a type of the vehicle information determined by the vehicle state Determining unit has been referenced. Vehicle-mounted image authentication device according to Claim 5 comprising: a termination determination unit for, if the authentication processing unit can not authenticate the person whose facial area is detected, determining whether a frequency of authentication or an authentication time in the authentication processing unit reaches a prescribed frequency or a prescribed time, and a time of non-reaching, instructing the face detection unit to re-detect the face area. Vehicle-mounted image authentication device according to Claim 5 image processing apparatus comprising: a composition threshold determination unit for determining a composition threshold on the basis of at least one of a position in the captured image of the facial area and the orientation of the face of the person detected by the facial orientation detection unit, wherein the authentication processing unit receives the characteristic information the collected image of the facial area detected by the face detection unit is assembled with the characteristic information of the captured image for authentication that has been accumulated in advance, and the person authenticates on a basis thereof whether a composition result is equal to or greater than the compilation threshold is. Vehicle-mounted image authentication device according to Claim 5 comprising: a composition threshold determination unit for determining a composition threshold based on a determination result by the vehicle state determination unit that the vehicle is at a specific point, wherein the authentication processing unit obtains the characteristic information of the captured image of the facial area provided by the face detection unit has been detected, assembles the characteristic information of the captured image for authentication accumulated in advance, and authenticates the person on a basis thereof as to whether a merge result is equal to or greater than the merge threshold. Vehicle-mounted image authentication device according to Claim 5 wherein the vehicle information referenced by the vehicle state determining unit includes at least one of information indicative of unlocking and locking a door of the vehicle, information indicating opening and closing of the door of the vehicle, information indicating attachment and detachment of a vehicle A seat belt of the vehicle indicates, information indicating an ON or OFF state of ignition of the vehicle, information indicating an ON or OFF state of a human sensor of the vehicle, information indicating a position of a gearshift lever of the vehicle , information indicating vehicle speed of the vehicle, information indicating a guidance state of a navigation device of the vehicle, and position information of the vehicle. Vehicle-mounted image authentication device according to Claim 1 vehicle comprising: a camera for imaging the imaging area, in which the occupant seated in the driver's seat and the occupant seated in the passenger seat can be simultaneously imaged in the vehicle.

Images