WO2020194489A1

WO2020194489A1 - Exposure control device and exposure control method

Info

Publication number: WO2020194489A1
Application number: PCT/JP2019/012738
Authority: WO
Inventors: 吉本　忠文; 昇吾米山; 篤松本
Original assignee: 三菱電機株式会社
Priority date: 2019-03-26
Filing date: 2019-03-26
Publication date: 2020-10-01
Also published as: JP6873351B2; JPWO2020194489A1

Abstract

The purpose of the present invention is to perform appropriate exposure control when a portion of the eye cannot be imaged due to the reflection of external light. An exposure control device according to the present invention comprises an eye detection unit (12) for detecting the outer canthus and inner corner of the eye from the image of the eye of a vehicle occupant captured by a camera (21), an edge detection unit (13) for detecting the edge of an eyelid between the outer canthus and inner corner as a detection edge from the captured image, a difference detection unit (14) for detecting a difference between the detection edge and a reference edge, and an exposure control unit (15) for performing exposure control so that the difference between the detection edge and the reference edge becomes smaller.

Description

Exposure control device and exposure control method

The present invention relates to exposure control when imaging the eyes of a vehicle occupant.

There is an occupant monitoring system that detects the inattentive state or dozing state from the position of the occupant's eyes or the opening of the eyelids and warns the occupant. In such an occupant monitoring system, the eyes of the occupant are photographed by a camera mounted on the vehicle, and the state of the occupant is detected using the photographed image. However, when the occupant is wearing spectacles, there is a problem that external light is reflected on the lens of the spectacles and it is not possible to properly take an image of the eyes.

For such a problem, Patent Document 1 proposes a technique for adjusting the exposure when external light reflection is detected.

Japanese Unexamined Patent Publication No. 2013-175914

However, in the technique of Patent Document 1, the presence or absence of external light reflection is determined by whether or not the eyes can be detected from the captured image. Therefore, even if the eyes are partially hidden by the reflection of external light, if the eyes can be roughly detected, the exposure control is not performed and the eye detection accuracy is not improved.

The present invention has been made to solve the above problems, and an object of the present invention is to perform appropriate exposure control when a part of the eye cannot be photographed due to external light reflection.

The exposure control device of the present invention detects an eye detection unit that detects the outer and inner corners of the eyes from an image of the eyes of a vehicle occupant by a camera, and an edge of the eyelid between the outer and inner corners of the eye from the captured image as a detection edge. An edge detection unit for detecting an edge, a difference detection unit for detecting a difference between the detection edge and the reference edge, and an exposure control unit for performing exposure control so that the difference between the detection edge and the reference edge becomes small are provided.

Since the exposure control device of the present invention performs exposure control so that the difference between the detection edge and the reference edge becomes small, it is possible to perform appropriate exposure control when a part of the eye cannot be photographed due to external light reflection. Objectives, features, aspects, and advantages of the present invention will be made clearer by the following detailed description and accompanying drawings.

It is a block diagram which shows the structure of the exposure control apparatus of Embodiment 1. FIG. It is a flowchart which shows the operation of the exposure control apparatus of Embodiment 1. It is a figure which shows the shooting range of a camera. It is a figure which shows the detection edge in the state which there is no external light reflection. It is a figure which shows the image taken by the camera with the outside light reflection. It is a figure which shows the detection edge detected by the edge detection part from the photographed image of FIG. It is a figure which shows the method of exposure control. It is a figure which shows the image taken by the camera after exposure control. It is a flowchart which shows the operation of the difference detection part of Embodiment 2 in step S104 of FIG. It is a flowchart which shows the operation of the exposure control part of Embodiment 2 in step S105 of FIG. It is a block diagram which shows the structure of the exposure control apparatus of Embodiment 3. It is a figure which shows the photographed image before the exposure control by the exposure control apparatus of Embodiment 3. It is a figure which shows the photographed image after exposure control. It is a block diagram which shows the structure of the exposure control apparatus of Embodiment 4. It is a figure which shows the hardware composition of the exposure control apparatus. It is a figure which shows the hardware composition of the exposure control apparatus. It is a figure which shows the configuration example of the exposure control apparatus by a vehicle and a server.

<A. Embodiment 1>
<A-1. Configuration>
FIG. 1 is a block diagram showing the configuration of the exposure control device 101 of the first embodiment. The exposure control device 101 is a device that controls the exposure of the camera 21 so that the camera 21 can appropriately photograph the eyes of the occupants of the vehicle. Hereinafter, in the present specification, a vehicle equipped with a camera 21 for which the exposure control device performs exposure control is simply referred to as a "vehicle".

The camera 21 is mounted on the vehicle and captures the facial image of the occupant. As shown in FIG. 2, the shooting range 31 of the camera 21 is a range including the face of the occupant 32. Here, the occupant photographed by the camera 21 is typically a driver, but may be an occupant other than the driver.

The image acquisition unit 11 acquires the captured image of the camera 21 and outputs it to the eye detection unit 12.

The eye detection unit 12 acquires a photographed image from the image acquisition unit 11 and detects the outer and inner corners of the occupant's eyes from the photographed image.

The edge detection unit 13 acquires a captured image and detection information of the outer and inner corners of the eye from the eye detection unit 12, and detects the edge shape of the eyelid between the outer and inner corners of the eye as a detection edge from the information.

The difference detection unit 14 acquires the detection edge from the edge detection unit 13 and compares the detection edge with the reference edge to detect the difference between the two. The reference edge is an edge prepared in advance as an edge shape of a general eyelid. Since there are individual differences in the shape of the eyes, for example, the fineness and size of the eyes, a plurality of patterns are usually prepared for the reference edge, and the difference detection unit 14 extracts the reference edge closest to the detection edge and both. To compare. The closer the detection edge is to the reference edge, the more correctly the camera 21 can capture the eyes of the occupant, and it can be said that the exposure is appropriate. If the occupant is wearing spectacles and the lens of the spectacles reflects external light, it is difficult to accurately detect the edge of the eyelid in the area where the external light is reflected. The detection edge deviates from the reference edge.

The exposure control unit 15 acquires the difference between the detection edge and the reference edge from the difference detection unit 14, and controls the exposure of the camera 21 in the direction in which the difference becomes smaller.

<A-2. Operation>
FIG. 2 is a flowchart showing the operation of the exposure control device 101. The flow of FIG. 2 starts at the timing when the accessory power of the vehicle is turned on and the camera 21 starts shooting, and is repeated while the vehicle is running.

First, the image acquisition unit 11 acquires the captured image of the camera 21 (step S101). FIG. 3 shows the shooting range 31 of the camera 21. As shown in FIG. 3, the photographing range 31 is a range including the face of the occupant 32. Next, the eye detection unit 12 detects the outer and inner corners of the eye from the captured image (step S102). Then, the edge detection unit 13 detects the edge of the eyelid between the outer and inner corners of the eye from the captured image (step S103). The edge detected here is referred to as a detection edge. Next, the difference detection unit 14 compares the detection edge with the reference edge and detects the difference between the two (step S104). Finally, the exposure control unit 15 controls the exposure of the camera 21 so that the difference between the detection edge and the reference edge becomes small, in other words, the detection edge approaches the reference edge (step S105).

<A-3. Effect>
As described above, the exposure control device 101 of the first embodiment includes an eye detection unit 12 that detects the outer and inner corners of the eyes from the captured image of the eyes of the vehicle occupant by the camera 21, and the outer corners of the eyes from the captured image. The edge detection unit 13 that detects the edge of the eyelid between the inner corners of the eye as the detection edge, the difference detection unit 14 that detects the difference between the detection edge and the reference edge, and the difference between the detection edge and the reference edge are reduced. It includes an exposure control unit 15 that controls exposure. Therefore, according to the exposure control device 101, even if a part of the eye cannot be photographed due to external light reflection on the lens of the spectacles worn by the occupant, the entire eye is photographed by performing appropriate exposure control. Can be done.

<B. Embodiment 2>
<B-1. Configuration>
The configuration of the exposure control device 102 of the second embodiment is the same as the configuration of the exposure control device 101 of the first embodiment shown in FIG.

<B-2. Operation>
FIG. 4 shows the detection edge 42 in the absence of external light reflection. If the lens 41 of the spectacles does not reflect external light, the entire eye is clearly captured in the captured image, so that the edge detection unit 13 can accurately detect the edge of the eyelid. The edge detection unit 13 detects the edge of the eyelid at five detection points 421-425, and the solid line connecting the detection points 421-425 is the detection edge 42. In FIG. 4, the reference point 431-435 corresponding to the detection point 421-425 and the reference edge 43 connecting the reference points 431-435 are shown by dotted lines. Of the reference edges 43, the points corresponding to the detection points 421-425 are the reference points 431-435. Corresponding to detection points 421-425 means, for example, that the lateral position is equal to detection points 421-425. In FIG. 4, the detection points 421-425 are detected with high accuracy and coincide with the reference points 431-435. In this case, the exposure control unit 15 does not change the current exposure control.

FIG. 5 shows an image taken by the camera 21 in a state where there is external light reflection. In FIG. 5, in the lens 41 of the spectacles, the region where external light reflection occurs is referred to as region 44, and the region where external light reflection does not occur is referred to as region 45. Since the face portion overlapping the region 44 does not appear in the captured image, the edge detection unit 13 cannot accurately detect the edge of the eyelid.

FIG. 6 shows the detection edge 42 detected by the edge detection unit 13 from the captured image of FIG. The detection points 421,422,425 in the region 45 coincide with the corresponding reference points 431,432,435, but the detection points 423,424 in the region 44 do not coincide with the corresponding reference points 433,434. From this, the exposure control unit 15 determines that external light reflection occurs at the detection points 423 and 424, and that external light reflection does not occur at the detection points 421, 422 and 425. The detection points 423 and 424 in the region where external light reflection occurs are referred to as first detection points, and the detection points 421, 422 and 425 in the region where external light reflection does not occur are referred to as second detection points.

The exposure control unit 15 controls the exposure of the camera 21 based on the brightness of the first detection point and the brightness of the second detection point. The brightness of each detection point can be measured from the captured image. As the simplest method, one detection point is selected from each of the first detection point and the second detection point, and the average brightness of the selected detection points is used as a reference. In the example of FIG. 7, the detection point 423 is selected as the first detection point, and the detection point 421 is selected as the second detection point.

Alternatively, the exposure control unit 15 calculates the average brightness LA1 of the detection points 423 and 424 which are the first detection points and the average brightness LA2 of the detection points 421, 422 and 425 which are the second detection points. Then, the exposure control of the camera 21 is performed with reference to the average value of the average brightness LA1 and the average brightness LA2. The exposure control unit 15 is performed by adjusting the exposure time or the aperture value of the camera 21 or adjusting the amount of light of the floodlight 22. A plurality of adjustment methods listed above may be combined. The floodlight 22 is mounted on the vehicle and irradiates the occupants with light.

FIG. 8 shows a captured image of the camera 21 after exposure control. Although the brightness of the entire photographing region is reduced by the exposure control, it is possible to detect the eyes even in the region 44 where the external light reflection has occurred.

The overall operation flow of the exposure control device 102 is as shown in FIG. FIG. 9 is a flowchart showing the operation of the difference detection unit 14 of the exposure control device 102 in step S104 of FIG. Hereinafter, the operation of the difference detection unit 14 will be described with reference to FIG. The edge detection unit 13 detects the edge of the eyelid between the inner and outer corners of the eye at a plurality of detection points (step S103 in FIG. 2). After that, the difference detection unit 14 selects one detection point (step S1401), and performs the following processing on the selected detection point. That is, the difference detection unit 14 determines whether or not the distance between the detection point and the reference point is equal to or greater than a predetermined threshold value (step S1402). When the distance between the detection point and the reference point is equal to or greater than the threshold value, the difference detection unit 14 sets the detection point as the first detection point (step S1403). On the other hand, when the distance between the detection point and the reference point is less than the threshold value, the difference detection unit 14 sets the detection point as the second detection point (step S1404).

Next, the difference detection unit 14 determines whether or not the processing has been completed for all the detection points (step S1405). If there are unprocessed detection points, the difference detection unit 14 returns to step S1401, and if the processing is completed for all the detection points, the difference detection unit 14 proceeds to step S105.

FIG. 10 is a flowchart showing the operation of the exposure control unit 15 of the exposure control device 102 in step S105 of FIG. Hereinafter, the operation of the exposure control unit 15 will be described with reference to FIG. The exposure control unit 15 calculates the average brightness LA1 of the first detection point (step S1501). In the example of FIG. 7, the first detection points are

detection points

423 and 424. Next, the exposure control unit 15 calculates the average brightness LA2 of the second detection point (step S1502). In the example of FIG. 7, the second detection point is the

detection point

421, 422, 425.

Next, the exposure control unit 15 calculates the reference luminance LS = (LA1 + LA2) / 2 (step S1503). As described above, the exposure control unit 15 sets the average value of the average luminance LA1 at the first detection point and the average luminance LA2 at the second detection point as the reference luminance LS. Then, the exposure control unit 15 controls the exposure of the camera 21 based on the reference luminance LS (step S1504).

<B-3. Modification example>
In the above, it has been described that the edge detection unit 13 detects the edge of the eyelid at a plurality of detection points. Although five detection points are shown in FIG. 4 and the like, the number of detection points is not limited to five. Further, the edge detection unit 13 may detect not only the upper eyelid but also the edge of the lower eyelid, or may detect both the edge of the upper eyelid and the edge of the lower eyelid.

Further, in the above, the exposure control unit 15 sets the average value of the average brightness LA1 at the first detection point and the average brightness LA2 at the second detection point as the reference brightness LS, but sets the reference brightness LS by another method. Is also good. For example, the exposure control unit 15 may use the median brightness of the first detection point and the second detection point as the reference brightness LS, or the median brightness of the first detection point and the median brightness of the second detection point. The average value of and may be used as the reference luminance LS.

<B-4. Effect>
In the exposure control device 102 of the second embodiment, the edge detection unit 13 detects the detection edge at a plurality of detection points. Then, the exposure control unit 15 is a second detection point in which the brightness of the first detection point, which is a detection point whose distance from the corresponding point of the reference edge is equal to or greater than the threshold value, and the distance between the corresponding point of the reference edge are less than the threshold value. The exposure of the camera 21 is controlled based on the brightness of the detection point. This exposure control makes it possible to photograph the eyes at both the first detection point and the second detection point. Therefore, even if there is external light reflection, it is possible to appropriately detect eye information.

Further, the exposure control unit 15 controls the exposure of the camera 21 based on the average value of the average brightness of the first detection point and the average brightness of the second detection point. This exposure control makes it possible to photograph the eyes at both the first detection point and the second detection point.

Alternatively, the exposure control unit 15 controls the exposure of the camera 21 based on the average value of the median brightness of the first detection point and the median brightness of the second detection point. This exposure control makes it possible to photograph the eyes at both the first detection point and the second detection point.

Alternatively, the exposure control unit 15 controls the exposure of the camera 21 based on the median value of the brightness of the first detection point and the brightness of the second detection point. This exposure control makes it possible to photograph the eyes at both the first detection point and the second detection point.

<C. Embodiment 3>
<C-1. Configuration>
FIG. 11 is a block diagram showing the configuration of the exposure control device 103 according to the third embodiment. The exposure control device 103 includes an eye information detection unit 16 in addition to the configurations of the exposure control devices 101 and 102 of the first and second embodiments. Since the configuration of the exposure control device 103 other than the eye information detection unit 16 is the same as that of the exposure control devices 101 and 102, the description thereof will be omitted.

The eye information detection unit 16 acquires the captured image of the camera 21 from the image acquisition unit 11 and detects the eye information from the captured image. The eye information is, for example, the direction of the line of sight or the opening degree of the eyelids, and is used to grasp the state of the driver. The driver's condition is, for example, inattentive driving or dozing driving.

According to the exposure control device 103, even if the lens of the spectacles worn by the occupant reflects external light, the exposure control unit 15 performs appropriate exposure control, so that the eye information can be accurately obtained from the captured image after the exposure control. Can be detected.

<C-2. Operation>
The eye information detection unit 16 may detect eye information only from the captured image after exposure control, or exposes and controls a portion of the eye information detected from the captured image before exposure control where external light reflection occurs. It may be supplemented with the eye information detected from the later captured image. The complementation of eye information will be described below.

FIG. 12 shows an image taken before exposure control by the exposure control device 103. Since the external light reflection occurs in the region 44, the eye information detection unit 16 can detect the information of the eye portion overlapping the region 45, but cannot detect the information of the eye portion overlapping the region 44 with high accuracy. FIG. 13 shows a captured image after exposure control. In the captured image of FIG. 13, eyes are reflected in both the area 44 and the area 45, and the eye information detection unit 16 can detect the information of the eye portion in the area 45 with high accuracy.

The eye information detection unit 16 complements the eye information that could not be detected from the captured image before the exposure control from the captured image after the exposure control. For example, when the eye information is the edge of the eyelid, the eye information is complemented by replacing the detection points 4231 and 4241 shown in FIG. 13 with the detection points 423 and 424 shown in FIG. Do.

When the eye information includes information other than the edge of the eyelid, such as pupil information, the eye information detection unit 16 estimates the region 44 where external light reflection occurs from the detection points 4231 and 4241, which are the second detection points. .. For example, the eye information detection unit 16 may estimate a certain region including the detection points 4231 and 4241, specifically, a region along the vertical direction of the lens 41 as a region 44 in which external light reflection occurs. Alternatively, when the edge detection unit 13 detects the edges of both the upper eyelid and the lower eyelid, the eye information detection unit 16 reflects external light on the region connecting the second detection points extracted from both edges. May be estimated as the region 44 where As a result, the region 44 where the external light reflection has occurred can be accurately estimated.

Then, the eye information detection unit 16 complements the eye information detected from the region estimated to have caused external light reflection in the captured image with the eye information detected from the captured image before the exposure control. As a result, the eye information detection unit 16 can obtain accurate eye information.

<C-3. Effect>
The exposure control device 103 includes an eye information detection unit 16 that detects eye information including eyelid shape information from a captured image. Therefore, according to the exposure control device 103, the eye information can be detected with high accuracy even when there is external light reflection.

Further, the eye information detection unit 16 complements the eye information detected from the captured image before the exposure control by the exposure control device 103 with the eye information detected from the captured image after the exposure control. As a result, eye information can be detected with high accuracy even when there is external light reflection.

<D. Embodiment 4>
<D-1. Configuration>
FIG. 14 is a block diagram showing the configuration of the exposure control device 104 according to the fourth embodiment. The exposure control device 104 includes a state detection unit 17 in addition to the exposure control device 103 of the third embodiment. Since the configuration of the exposure control device 104 other than the state detection unit 17 is the same as that of the exposure control device 103, the description thereof will be omitted.

The state detection unit 17 detects the driver's state based on the eye information detected by the eye information detection unit 16. For example, the state detection unit 17 detects whether or not the driver is inattentive driving based on the direction of the driver's line of sight detected as eye information. Alternatively, the state detection unit 17 detects whether or not the driver is dozing based on the edge of the driver's eyelids detected as eye information. As a result, for example, when the driver is in a state unsuitable for driving, a warning can be given through a display device or a voice output device mounted on the vehicle.

<D-2. Effect>
The exposure control device 104 includes a state detection unit that detects the state of the occupant based on eye information. Therefore, even if the occupant is wearing glasses, the state of the occupant can be accurately detected.

<E. Hardware configuration>
In the exposure control device 101-104 described above, the image acquisition unit 11, the eye detection unit 12, the edge detection unit 13, the difference detection unit 14, the exposure control unit 15, the eye information detection unit 16, and the state detection unit 17 are shown in FIG. It is realized by the processing circuit 51 shown in. That is, the processing circuit 51 includes an image acquisition unit 11, an eye detection unit 12, an edge detection unit 13, a difference detection unit 14, an exposure control unit 15, an eye information detection unit 16, and a state detection unit 17 (hereinafter, “image acquisition unit”). It is referred to as "11 mag"). Dedicated hardware may be applied to the processing circuit 51, or a processor that executes a program stored in the memory may be applied. The processor is, for example, a central processing unit, a processing unit, an arithmetic unit, a microprocessor, a microcomputer, a DSP (Digital Signal Processor), or the like.

When the processing circuit 51 is dedicated hardware, the processing circuit 51 may be, for example, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC (Application Specific Integrated Circuit), or an FPGA (Field-Programmable). GateArray), or a combination of these. Each of the functions of each part such as the parts may be realized by a plurality of processing circuits 51, or the functions of each part may be collectively realized by one processing circuit.

When the processing circuit 51 is a processor, the functions of the image acquisition unit 11 and the like are realized by combining software and the like (software, firmware or software and firmware). Software and the like are described as programs and stored in memory. As shown in FIG. 16, the processor 52 applied to the processing circuit 51 realizes the functions of each part by reading and executing the program stored in the memory 53. That is, when the exposure control device 101-104 is executed by the processing circuit 51, the step of detecting the outer and inner corners of the eyes from the captured image of the eyes of the vehicle occupant by the camera 21 and the outer and inner corners of the eyes from the captured image. The step of detecting the eyelids in between as the detection edge, the step of detecting the difference between the detection edge and the reference edge, and the step of controlling the exposure of the camera so that the difference between the detection edge and the reference edge becomes small. A memory 53 for storing a program to be executed as a result is provided. In other words, it can be said that this program causes the computer to execute the procedure or method of the image acquisition unit 11 or the like. Here, the memory 53 includes, for example, non-volatile such as RAM (RandomAccessMemory), ROM (ReadOnlyMemory), flash memory, EPROM (ErasableProgrammableReadOnlyMemory), and EPROM (ElectricallyErasableProgrammableReadOnlyMemory). Or with volatile semiconductor memory, HDD (Hard Disk Drive), magnetic disk, flexible disk, optical disk, compact disk, mini disk, DVD (Digital Versatile Disk) and its drive device, or any storage medium that will be used in the future. There may be.

The configuration in which each function of the image acquisition unit 11 and the like is realized by either hardware or software has been described above. However, the present invention is not limited to this, and a configuration may be configured in which a part of the image acquisition unit 11 or the like is realized by dedicated hardware and another part is realized by software or the like. For example, the image acquisition unit 11 realizes its function by a processing circuit as dedicated hardware, and other than that, the processing circuit 51 as a processor 52 reads and executes a program stored in the memory 53 to execute the function. It is possible to realize.

As described above, the processing circuit can realize each of the above-mentioned functions by hardware, software, or a combination thereof.

Further, although the exposure control device 101-104 has been described above as an in-vehicle device, it is installed in an in-vehicle device, a PND (Portable Navigation Device), a communication terminal (for example, a mobile terminal such as a mobile phone, a smartphone, and a tablet), and the like. It can also be applied to a system constructed as a system by appropriately combining the functions of various applications and servers. In this case, each function or each component of the exposure control device 101-104 described above may be distributed and arranged in each device for constructing the system, or may be centrally arranged in any device. May be good. FIG. 17 shows a configuration example of the exposure control device 103 by the vehicle 71 and the server 72. In this configuration example, the image acquisition unit 11, the exposure control unit 15, and the eye information detection unit 16 are arranged in the vehicle 71, and the eye detection unit 12, the edge detection unit 13, and the difference detection unit 14 are arranged in the server 72.

It should be noted that, within the scope of the present invention, each embodiment can be freely combined, and each embodiment can be appropriately modified or omitted. Although the present invention has been described in detail, the above description is exemplary in all embodiments and the invention is not limited thereto. It is understood that a myriad of variations not illustrated can be envisioned without departing from the scope of the invention.

11 image acquisition unit, 12th detection unit, 13 edge detection unit, 14 difference detection unit, 15 exposure control unit, 16th information detection unit, 17 state detection unit, 21 camera, 22 floodlight, 101-104 exposure control device.

Claims

An eye detection unit that detects the outer and inner corners of the eyes from images taken by the camera of the occupant of the vehicle,
An edge detection unit that detects the edge of the eyelid between the outer corner of the eye and the inner corner of the eye as a detection edge from the captured image.
A difference detection unit that detects the difference between the detection edge and the reference edge,
An exposure control unit that controls exposure so that the difference between the detection edge and the reference edge becomes small is provided.
Exposure control device.
The edge detection unit detects the detection edge at a plurality of detection points,
The exposure control unit is at the detection point where the distance between the brightness of the first detection point, which is the detection point whose distance from the corresponding point of the reference edge is equal to or greater than the threshold value, and the distance between the corresponding point of the reference edge is less than the threshold value. The exposure of the camera is controlled based on the brightness of a second detection point.
The exposure control device according to claim 1.
The exposure control unit controls the exposure of the camera based on the average value of the average brightness of the first detection point and the average brightness of the second detection point.
The exposure control device according to claim 2.
The exposure control unit controls the exposure of the camera based on the average value of the median brightness of the first detection point and the median brightness of the second detection point.
The exposure control device according to claim 2.
The exposure control unit controls the exposure of the camera based on the median value of the brightness of the first detection point and the brightness of the second detection point.
The exposure control device according to claim 2.
An eye information detection unit that detects eye information, which is the information of the eyes, from the captured image is further provided.
The exposure control device according to claim 1.
The eye information detection unit complements the eye information detected from the captured image before exposure control by the exposure control device with the eye information detected from the captured image after exposure control.
The exposure control device according to claim 6.
A state detection unit that detects the state of the occupant based on the eye information is further provided.
The exposure control device according to claim 6.
The outer and inner corners of the eyes are detected from the images taken by the camera of the occupant of the vehicle.
The eyelid between the outer corner of the eye and the inner corner of the eye is detected as a detection edge from the captured image.
The difference between the detection edge and the reference edge is detected,
The exposure of the camera is controlled so that the difference between the detection edge and the reference edge becomes small.
Exposure control method.