JP6865906B2 - Display control device and display control method - Google Patents

Description

The present invention relates to a display control device and a display control method for controlling a display device that displays a peripheral image obtained by imaging the surroundings of a vehicle.

In recent years, as a substitute for physical mirrors such as rear-view mirrors and side mirrors, camera monitoring systems (CMS) such as electronic mirror devices that display images taken by a camera directed backward from a vehicle on a display device have been proposed. Various techniques have been proposed for such CMS.

For example, in Patent Document 1, the pupil diameter of the driver when looking at the display device is acquired from the image of the driver using the driver monitoring system (DMS), and the acquired pupil diameter and the diameter stored in advance are used. A technique for controlling the brightness of a display device based on the difference has been proposed. According to such a technology, the brightness of the display device is controlled so as not to be too bright or too dark for the driver, so that the driver can see the captured image with an appropriate brightness. Become.

JP-A-2018-43724

For example, in an electronic mirror device, the driver may want to instantly see an image of a display device provided in the vehicle interior to check the rear while driving while looking at the outside of the vehicle, which is relatively bright in the daytime. is there. However, in the prior art, since the brightness of the display device is controlled from the time when the driver looks at the display device, it may not be possible to appropriately control the brightness of the display device. As a result, the brightness of the display device may not be appropriate for the driver, and the image of the display device may be difficult for the driver to see.

Therefore, the present invention has been made in view of the above problems, and an object of the present invention is to provide a technique capable of quickly controlling the brightness of a display device.

The display control device according to the present invention is a display control device that controls a display device that displays a peripheral image obtained by imaging the surroundings of the vehicle, and acquires a facial feature amount based on an image of the driver's face of the vehicle. Peripheral image brightness, which is the brightness of the peripheral image displayed on the display device, based on the acquisition unit and the specific facial feature amount, which is the facial feature amount acquired by the acquisition unit when the driver is not looking at the peripheral image. It is provided with a control unit for controlling the above.

According to the present invention, the peripheral image which is the brightness of the peripheral image displayed on the display device based on the specific facial feature amount which is the facial feature amount acquired by the acquisition unit when the driver is not looking at the peripheral image. Control the brightness. According to such a configuration, the brightness of the display device can be controlled quickly.

The objects, features, embodiments and advantages of the present invention will be made clearer by the following detailed description and accompanying drawings.

It is a block diagram which shows the structure of the display control device which concerns on Embodiment 1. FIG. It is a block diagram which shows the structure of the display control device which concerns on Embodiment 2. FIG. It is a block diagram which shows the structure of DMS which concerns on Embodiment 2. FIG. It is a block diagram which shows the structure of the CMS image processing apparatus which concerns on Embodiment 2. FIG. It is a block diagram which shows the structure of the display device which concerns on Embodiment 2. FIG. It is a flowchart which shows the operation of the display control device which concerns on Embodiment 2. FIG. It is a flowchart which shows the operation of the display control device which concerns on modification 1. It is a flowchart which shows the operation of the display control device which concerns on modification 1. It is a block diagram which shows the structure of the CMS image processing apparatus which concerns on modification 2. It is a block diagram which shows the hardware composition of the display control device which concerns on other modification. It is a block diagram which shows the hardware composition of the display control device which concerns on other modification. It is a block diagram which shows the structure of the server which concerns on other modification. It is a block diagram which shows the structure of the communication terminal which concerns on other modification.

<Embodiment 1>
FIG. 1 is a block diagram showing a configuration of a display control device 1 according to a first embodiment of the present invention. Hereinafter, the vehicle on which the display control device 1 is mounted and which is the subject of attention will be described as “own vehicle”.

The display control device 1 of FIG. 1 is connected to the image pickup device 31 and the display device 32 by wire or wirelessly. The display control device 1, the image pickup device 31, and the display device 32 constitute, for example, a camera monitoring system (CMS). Hereinafter, the image pickup device 31 and the display device 32 will be described before the display control device 1 is described.

The image pickup device 31 is a device that images the periphery of the own vehicle, and for example, a camera mounted on the own vehicle is applied. In the following description, the image pickup device 31 takes an image of the rear side of the own vehicle as the vicinity of the own vehicle, but for example, the front or side of the own vehicle may be imaged as the vicinity of the own vehicle. The image around the own vehicle obtained by the image pickup device 31 capturing the peripheral image is transmitted to the display control device 1 as a peripheral image. Although FIG. 1 shows a configuration in which the image pickup device 31 is provided separately from the display control device 1, the image pickup device 31 may be provided in the display control device 1.

The display device 32 receives the peripheral image that has been subjected to various processes by the display control device 1 and displays the peripheral image. Although FIG. 1 shows a configuration in which the display device 32 is provided separately from the display control device 1, the display device 32 may be provided in the display control device 1. Further, the display device 32 may be a display device fixed to the own vehicle or a display device brought into the own vehicle.

Next, the display control device 1 will be described. The display control device 1 of FIG. 1 includes an acquisition unit 11 and a control unit 12, and controls a display device 32 that displays a peripheral image as described below.

The acquisition unit 11 acquires the facial feature amount based on the image of the driver's face of the own vehicle. The driver is the person sitting in the driver's seat. The facial feature amount includes at least one of the driver's pupil diameter, the intensity of the light hitting the driver's face, and the driver's eye opening degree. The degree of eye opening of the driver corresponds to the ratio of the acquisition distance between the driver's upper and lower eyelids to the normal distance between the driver's upper and lower eyelids.

In FIG. 1, a driver monitoring system (DMS) (not shown) provided outside the display control device 1 acquires an image of the driver, generates a driver's facial feature amount based on the image, and acquires the driver's face feature amount. No. 11 shows a configuration for acquiring the facial feature amount from the DMS. In the case of this configuration, the acquisition unit 11 is, for example, a receiving device or an interface. However, the acquisition unit 11 is not limited to these, and the acquisition unit 11 itself may be a DMS.

The control unit 12 controls the brightness of the peripheral image displayed on the display device 32 based on the facial feature amount acquired by the acquisition unit 11 when the driver is not looking at the peripheral image. In the following description, among the facial features acquired by the acquisition unit 11 at an arbitrary time, the facial features acquired by the acquisition unit 11 when the driver is not looking at the peripheral image is referred to as "specific facial features". It may be written as. Further, the brightness of the peripheral image displayed on the display device 32 may be referred to as "peripheral image brightness". The specific facial feature amount is, for example, the facial feature amount acquired by the acquisition unit 11 when the driver is looking at the outside of the own vehicle or when looking at a part other than the display device 32 in the own vehicle interior. Including.

For example, when the specific facial feature amount includes the pupil diameter, the control unit 12 increases the brightness of the peripheral image as the pupil diameter becomes smaller. For example, when the specific facial feature amount includes the intensity of light, the control unit 12 increases the brightness of the peripheral image as the intensity of light increases. For example, when the specific facial feature amount includes the degree of eye opening, the control unit 12 increases the brightness of the peripheral image as the degree of eye opening decreases. Such a control unit 12 may be an ECU (Electronic Control Unit) or the like described later, or a CPU (Central Processing Unit) or the like described later.

The determination of whether or not the face feature amount acquired by the acquisition unit 11 is a specific face feature amount may be performed by the acquisition unit 11 or may be performed by the control unit 12.

Hereinafter, a first example in which the acquisition unit 11 determines the specific facial feature amount will be described. In this first example, the acquisition unit 11 is configured to be able to detect the driver's line-of-sight direction from the image of the driver of the own vehicle. When the acquisition unit 11 determines that the line-of-sight direction is within a predetermined range, the acquisition unit 11 determines that the facial feature amount acquired from the image is the specific facial feature amount, and the line-of-sight direction is predetermined. When it is determined that the range is out of the range, it is determined that the facial feature amount obtained from the above image is not the specific facial feature amount.

Next, a second example in which the acquisition unit 11 determines the specific facial feature amount will be described. In this second example, the acquisition unit 11 is configured to be able to detect the direction of the driver's face from the image of the driver of the own vehicle. When the acquisition unit 11 determines that the orientation of the face is within a predetermined range, the acquisition unit 11 determines that the facial feature amount acquired from the image is the specific facial feature amount, and determines the line-of-sight direction in advance. When it is determined that the range is out of the specified range, it is determined that the facial feature amount acquired from the above image is not the specific facial feature amount.

The example of determining whether or not the face feature amount acquired by the acquisition unit 11 is the specific face feature amount has been described above, but the description when the control unit 12 makes the determination is the same as the above description. .. Further, in the above description, the control unit 12 controls the peripheral image brightness based on the specific facial feature amount, but in addition to the control, the control unit 12 is acquired by the acquisition unit 11 when the driver is looking at the peripheral image. Peripheral image brightness may be controlled based on the amount of facial features.

<Summary of Embodiment 1>
According to the display control device 1 according to the first embodiment as described above, the display device 32 is based on the facial feature amount acquired by the acquisition unit 11 when the driver of the own vehicle is not looking at the peripheral image. Controls the brightness of the peripheral image displayed in. According to such a configuration, the driver can control the brightness of the peripheral image before viewing the peripheral image displayed on the display device 32. Therefore, since the brightness of the display device 32 can be controlled quickly, the driver can momentarily see the peripheral image having an appropriate brightness even when he / she sees the peripheral image momentarily.

<Embodiment 2>
FIG. 2 is a block diagram showing a configuration of a display control device 1 according to a second embodiment of the present invention. Hereinafter, among the components according to the second embodiment, the components that are the same as or similar to the above-mentioned components are designated by the same reference numerals, and different components will be mainly described.

The display control device 1 of FIG. 2 is connected to the image pickup device 31 and the display device 32 as in the first embodiment. The configuration of the image pickup device 31 and the display device 32 is substantially the same as that of the image pickup device 31 described in the first embodiment. However, the configuration of the display device 32 will be described in detail later.

The display control device 1 of FIG. 2 includes a driver monitoring system 21 (DMS21) and a CMS image processing device 22.

FIG. 3 is a block diagram showing the configuration of the DMS 21. The DMS 21 in FIG. 3 includes a DMS image pickup device 21a, a DMS image processing unit 21b, and a DMS transmission unit 21c. As described below, the DMS 21 captures an image of the driver and generates a facial feature amount of the driver based on the image. The DMS 21 is included in the concept of the acquisition unit 11 of FIG.

The DMS image pickup device 21a is, for example, a camera mounted on the own vehicle and captures an image of the driver of the own vehicle.

The DMS image processing unit 21b acquires the amount of facial features of the driver from the image of the driver captured by the DMS image pickup device 21a. The DMS image processing unit 21b of FIG. 3 includes a pupil diameter measuring unit 21b1, a facial light intensity distribution measuring unit 21b2, and an eye opening degree detecting unit 21b3. The pupil diameter measuring unit 21b1 measures the driver's pupil diameter as a facial feature amount from the driver's image. The facial light intensity distribution measuring unit 21b2 measures the intensity and distribution of the light hitting the driver's face from the driver's image, and based on the measurement result, determines the intensity of the light in the driver's eyes and around the eyes as a facial feature. Measure as a quantity. The eye opening degree detection unit 21b3 detects the driver's eye opening degree as a facial feature amount from the driver's image.

The DMS image processing unit 21b determines whether or not the acquired facial feature amount is a specific facial feature amount, that is, whether or not the acquired facial feature amount is the facial feature amount acquired by the acquisition unit 11 when the driver is not looking at the peripheral image. Judge whether or not. For the determination of the specific facial feature amount in the DMS image processing unit 21b, for example, the determination of the first example or the second example described in the first embodiment is used.

The DMS transmission unit 21c transmits the face feature amount determined to be the specific face feature amount by the DMS image processing unit 21b to the CMS image processing device 22.

FIG. 4 is a block diagram showing the configuration of the CMS image processing device 22. The CMS image processing device 22 of FIG. 4 includes an image receiving unit 22a, an image processing unit 22b, an image transmitting unit 22c, a DMS processing result receiving unit 22d, a face feature determination unit 22e, an illuminance data receiving unit 22f, and the like. It includes an illuminance determination unit 22g, an image brightness setting unit 22h, and an image brightness data transmission unit 22i. As described below, the CMS image processing device 22 generates image brightness data for controlling the brightness of the peripheral image displayed on the display device 32 based on the specific face feature amount acquired by the DMS 21. ..

The CMS image processing device 22, the image pickup device 31, and the display device 32 constitute a CMS. Further, the illuminance data receiving unit 22f and the illuminance determination unit 22g are included in the concept of the acquisition unit 11 in FIG. 1, and the face feature determination unit 22e and the image brightness setting unit 22h are included in the concept of the control unit 12 in FIG. ..

The image receiving unit 22a receives the peripheral image transmitted from the image pickup apparatus 31 of FIG. The image processing unit 22b performs various processing on the peripheral image received by the image receiving unit 22a. The image transmission unit 22c transmits the peripheral image processed by the image processing unit 22b to the display device 32.

The DMS processing result receiving unit 22d receives the specific face feature amount transmitted from the DMS 21 in FIG. The face feature determination unit 22e determines whether or not the specific face feature amount received by the DMS processing result receiving unit 22d satisfies a specific condition. For example, the specific condition may be whether or not the specific facial feature amount includes the pupil diameter, that is, whether or not the pupil diameter is readable. Further, for example, when the specific facial feature amount includes the degree of eye opening, the specific condition may be whether or not the degree of eye opening is equal to or less than a predetermined threshold value. Further, for example, when the specific facial feature amount includes the light intensity, the specific condition may be whether or not the light intensity is equal to or higher than a predetermined threshold value. Further, for example, the specific condition may be a combination of these. The face feature determination unit 22e outputs the determination result of whether or not the specific face feature amount satisfies a specific condition and the specific face feature amount received by the DMS processing result receiving unit 22d to the image brightness setting unit 22h.

The illuminance data receiving unit 22f receives the illuminance data transmitted from the display device 32 described later. The illuminance determination unit 22g determines the illuminance around the display device 32 based on the illuminance data received by the illuminance data reception unit 22f. The illuminance around the display device 32 referred to here includes the illuminance of the display device 32. In this way, the illuminance data receiving unit 22f and the illuminance determination unit 22g cooperate to acquire the illuminance around the display device 32.

The image brightness setting unit 22h has a first table in which the specific face feature amount and the peripheral image brightness are associated in advance. The first table includes at least one of a pupil diameter-luminance table, an intensity-luminance table, and an eye opening degree-luminance table. In the pupil diameter-luminance table, the pupil diameter and the peripheral image brightness are associated in advance so that the peripheral image brightness increases as the pupil diameter decreases. In the intensity-luminance table, the light intensity and the peripheral image brightness are associated in advance so that the peripheral image brightness increases as the light intensity increases. In the eye opening degree-luminance table, the eye opening degree and the peripheral image brightness are associated in advance so that the peripheral image brightness increases as the eye opening degree decreases.

Further, the image brightness setting unit 22h has a second table including an illuminance-luminance table. In the illuminance-luminance table, the illuminance and the peripheral image brightness are associated in advance so that the peripheral image brightness increases as the illuminance around the display device 32 increases.

When the face feature determination unit 22e determines that the specific face feature amount satisfies a specific condition, the image brightness setting unit 22h determines the peripheral image brightness corresponding to the specific face feature amount output from the face feature determination unit 22e. 1 Read from the table and generate image luminance data indicating the peripheral image luminance. When the face feature determination unit 22e determines that the specific face feature amount does not satisfy the specific condition, the image brightness setting unit 22h determines the peripheral image brightness corresponding to the illuminance around the display device 32 determined by the illuminance determination unit 22g. Is read from the second table, and image brightness data indicating the peripheral image brightness is generated.

The image brightness data transmission unit 22i transmits the image brightness data generated by the image brightness setting unit 22h to the display device 32.

FIG. 5 is a block diagram showing the configuration of the display device 32. The display device 32 of FIG. 5 includes an image receiving unit 32a, a display unit 32b, an image brightness data receiving unit 32c, an image brightness control unit 32d, an image brightness adjusting unit 32e, an illuminance sensor 32f, and an illuminance data transmitting unit. It includes 32 g.

The image receiving unit 32a receives the peripheral image transmitted from the CMS image processing device 22 of FIG. The display unit 32b is, for example, a liquid crystal panel, and displays a peripheral image received by the image receiving unit 32a. The image brightness data receiving unit 32c receives the image brightness data transmitted from the CMS image processing device 22 of FIG.

The image brightness control unit 32d controls the image brightness adjustment unit 32e based on the image brightness data received by the image brightness data reception unit 32c. The image brightness adjusting unit 32e is, for example, a backlight, and the brightness of the peripheral image displayed on the display unit 32b is appropriately adjusted by the control of the image brightness control unit 32d. In this case, the image brightness data according to the second embodiment corresponds to the backlight control data. In the display device 32 of FIG. 5, the display unit 32b, the image brightness control unit 32d, and the image brightness adjustment unit 32e are individually provided, but the display unit 32b, the image brightness control unit 32d, and the image brightness are provided. Some of the adjusting portions 32e may be integrated.

The illuminance sensor 32f detects the illuminance around the display device 32. The illuminance data transmission unit 32g transmits illuminance data indicating the illuminance around the display device 32 detected by the illuminance sensor 32f to the CMS image processing device 22.

According to the above configuration, when the specific face feature amount satisfies a specific condition, the image brightness setting unit 22h controls the brightness of the peripheral image displayed on the display device 32 based on the specific face feature amount. To do. At this time, the image brightness setting unit 22h controls to match the peripheral image brightness with the brightness previously associated with the specific face feature amount in the first table.

On the other hand, when the specific facial feature amount does not satisfy the specific condition, the image brightness setting unit 22h controls the brightness of the peripheral image displayed on the display device 32 based on the illuminance around the display device 32. At this time, the image brightness setting unit 22h controls to match the peripheral image brightness with the brightness previously associated with the illuminance around the display device 32 in the second table.

<Operation>
FIG. 6 is a flowchart showing the operation of the display control device 1 according to the second embodiment.

In step S1, the CMS image processing device 22 reads out the illuminance data transmitted from the display device 32. In step S2, the CMS image processing device 22 reads out the specific face feature amount transmitted from the DMS 21.

In step S3, the face feature determination unit 22e of the CMS image processing device 22 of FIG. 4 determines whether or not the pupil diameter can be read based on the specific face feature amount. If it is determined that the pupil diameter is readable, the process proceeds to step S4, and if it is determined that the pupil diameter is unreadable, the process proceeds to step S6.

In step S4, the image brightness setting unit 22h refers to the pupil diameter-brightness table. Then, in step S5, the image brightness setting unit 22h reads the peripheral image brightness corresponding to the pupil diameter included in the specific facial feature amount from the pupil diameter-luminance table, and generates image brightness data indicating the peripheral image brightness. .. After that, the process proceeds to step S12.

In step S6, the face feature determination unit 22e determines whether or not the degree of eye opening included in the specific face feature amount is equal to or less than a predetermined threshold value. If it is determined that the eye opening degree is equal to or less than a predetermined threshold value, the process proceeds to step S7, and if it is determined that the eye opening degree is larger than the predetermined threshold value, the process proceeds to step S8. move on.

In step S7, the face feature determination unit 22e determines whether or not the intensity of light contained in the specific face feature amount is equal to or higher than a predetermined threshold value. If it is determined that the light intensity is equal to or higher than a predetermined threshold value, the process proceeds to step S10, and if it is determined that the light intensity is smaller than the predetermined threshold value, the process proceeds to step S10. Proceed to S8. When the process proceeds from step S7 to step S10, it is presumed that the driver is squinting because he / she is exposed to light in his / her eyes and feels dazzling. When the process proceeds from step S7 to step S8, the process proceeds. It is presumed that the driver is squinting due to factors other than glare.

In step S8, the image luminance setting unit 22h refers to the illuminance-luminance table. Then, in step S9, the image brightness setting unit 22h reads the peripheral image brightness corresponding to the illuminance indicated by the illuminance data from the illuminance-luminance table, and generates image brightness data indicating the peripheral image brightness. After that, the process proceeds to step S12.

In step S10, the image brightness setting unit 22h refers to the eye opening degree-brightness table. Then, in step S11, the image brightness setting unit 22h reads the peripheral image brightness corresponding to the eye opening degree included in the specific facial feature amount from the eye opening degree-luminance table, and generates image brightness data indicating the peripheral image brightness. .. After that, the process proceeds to step S12.

In step S12, the image brightness data transmission unit 22i transmits the image brightness data generated by the image brightness setting unit 22h to the display device 32. As a result, the display device 32 appropriately adjusts the peripheral image brightness based on the image brightness data. After that, the operation of FIG. 6 ends.

<Summary of Embodiment 2>
According to the display control device 1 according to the second embodiment as described above, the image brightness setting unit 22h controls to match the peripheral image brightness with the brightness previously associated with the specific face feature amount. According to such a configuration, the peripheral image brightness can be appropriately controlled with a relatively simple configuration.

Further, according to the second embodiment, when the specific facial feature amount does not satisfy the specific condition, the image brightness setting unit 22h displays the peripheral image displayed on the display device 32 based on the illuminance around the display device 32. Control the brightness of. According to such a configuration, when it is not appropriate to control the brightness of the peripheral image using the specific facial feature amount, the brightness of the peripheral image can be controlled based on the illuminance around the display device 32.

<Modification example 1>
In the explanation of the flowchart (FIG. 6) showing the operation of the display control device 1 according to the second embodiment, the facial feature amount and the specific facial feature amount include the pupil diameter, the light intensity, and the degree of eye opening. However, the facial feature amount and the specific facial feature amount may include at least one of the pupil diameter, the light intensity, and the degree of eye opening.

FIG. 7 is a flowchart showing the operation of the display control device 1 when the facial feature amount and the specific facial feature amount do not include the light intensity and the degree of eye opening but include the pupil diameter. The flowchart of FIG. 7 is the same as the flowchart in which steps S6, S7, S10, and S11 are removed from the flowchart of FIG.

FIG. 8 is a flowchart showing the operation of the display control device 1 when the facial feature amount and the specific facial feature amount do not include the pupil diameter but include the light intensity and the degree of eye opening. The flowchart of FIG. 7 is the same as the flowchart in which steps S3 to S5 are removed from the flowchart of FIG.

<Modification 2>
FIG. 9 is a block diagram showing the configuration of the CMS image processing device 22 according to the second modification. The configuration of the CMS image processing device 22 of FIG. 9 is the same as the configuration in which the operation information acquisition unit 22j is added to the configuration of the CMS image processing device 22 of FIG. The driving information acquisition unit 22j is included in the concept of the acquisition unit 11 in FIG.

The driving information acquisition unit 22j acquires the driving information of the own vehicle. The driving information is information indicating whether or not the own vehicle is driving, and is, for example, information indicating whether or not the shift lever of the own vehicle is located in the D range. The image brightness setting unit 22h controls the peripheral image brightness based on the specific facial feature amount when it is determined that the own vehicle is driving based on the driving information acquired by the driving information acquisition unit 22j. According to the display control device 1 according to the present modification 2 as described above, it is possible to suppress the control of the peripheral image brightness based on the specific face feature amount during and outside the operation.

<Modification example 3>
When the DMS 21 is configured so that a plurality of drivers can be distinguished from each other, the first table described in the second embodiment may be predetermined for each driver. Then, the driving information acquisition unit 22j may change the first table used for controlling the peripheral image brightness based on the driver identified by the DMS 21.

<Other variants>
The acquisition unit 11 and the control unit 12 of FIG. 1 described above are hereinafter referred to as “acquisition unit 11 and the like”. The acquisition unit 11 and the like are realized by the processing circuit 81 shown in FIG. That is, the processing circuit 81 uses the acquisition unit 11 to acquire the facial feature amount based on the image of the driver's face of the vehicle and the facial feature amount acquired by the acquisition unit 11 when the driver is not looking at the peripheral image. A control unit 12 that controls peripheral image brightness based on a specific facial feature amount is provided. Dedicated hardware may be applied to the processing circuit 81, or a processor that executes a program stored in the memory may be applied. Examples of the processor include a central processing unit, a processing unit, an arithmetic unit, a microprocessor, a microcomputer, a DSP (Digital Signal Processor), and the like.

When the processing circuit 81 is dedicated hardware, the processing circuit 81 may be, for example, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC (Application Specific Integrated Circuit), or an FPGA (Field Programmable Gate). Array), or a combination of these. Each of the functions of each part such as the acquisition unit 11 may be realized by a circuit in which processing circuits are dispersed, or the functions of each part may be collectively realized by one processing circuit.

When the processing circuit 81 is a processor, the functions of the acquisition unit 11 and the like are realized by combining with software and the like. The software and the like correspond to, for example, software, firmware, or software and firmware. Software and the like are described as programs and stored in memory. As shown in FIG. 11, the processor 82 applied to the processing circuit 81 realizes the functions of each part by reading and executing the program stored in the memory 83. That is, when the display control device 1 is executed by the processing circuit 81, the step of acquiring the facial feature amount based on the image of the driver's face of the vehicle and the step of acquiring the facial feature amount when the driver is not looking at the peripheral image are acquired. It includes a step of controlling the peripheral image brightness based on the specific facial feature amount, which is the facial feature amount, and a memory 83 for storing a program to be executed as a result. In other words, it can be said that this program causes the computer to execute the procedure or method of the acquisition unit 11 or the like. Here, the memory 83 is a non-volatile or non-volatile memory such as a RAM (Random Access Memory), a ROM (Read Only Memory), a flash memory, an EEPROM (Erasable Programmable Read Only Memory), or an EEPROM (Electrically Erasable Programmable Read Only Memory). Volatile semiconductor memory, HDD (Hard Disk Drive), magnetic disk, flexible disk, optical disk, compact disk, mini disk, DVD (Digital Versatile Disc), its drive device, etc., or any storage medium used in the future. You may.

The configuration in which each function of the acquisition unit 11 and the like is realized by either hardware or software has been described above. However, the present invention is not limited to this, and a configuration may be configured in which a part of the acquisition unit 11 or the like is realized by dedicated hardware and another part is realized by software or the like. For example, the acquisition unit 11 realizes its function by a processing circuit 81 as dedicated hardware, an interface, a receiver, and the like, and other than that, the processing circuit 81 as a processor 82 reads a program stored in the memory 83. It is possible to realize the function by executing it.

As described above, the processing circuit 81 can realize each of the above-mentioned functions by hardware, software, or a combination thereof.

Further, the display control device 1 described above includes a vehicle device such as a PND (Portable Navigation Device) and a navigation device, a communication terminal including a mobile terminal such as a mobile phone, a smartphone and a tablet, and at least the vehicle device and the communication terminal. It can also be applied to a display control system constructed as a system by appropriately combining the functions of an application installed in one and a server. In this case, each function or each component of the display control device 1 described above may be dispersedly arranged in each device for constructing the system, or may be centrally arranged in any of the devices. Good.

FIG. 12 is a block diagram showing the configuration of the server 91 according to this modification. The server 91 of FIG. 12 includes a communication unit 91a and a control unit 91b, and can perform wireless communication with a vehicle device 93 such as a navigation device of the vehicle 92.

The communication unit 91a, which is the acquisition unit, receives the facial feature amount based on the image of the driver's face of the vehicle 92 by performing wireless communication with the vehicle device 93.

The control unit 91b has the same function as the control unit 12 of FIG. 1 when a processor (not shown) of the server 91 or the like executes a program stored in a memory (not shown) of the server 91. That is, the control unit 91b determines the brightness of the peripheral image displayed on the vehicle device 93 based on the specific facial feature amount which is the facial feature amount acquired by the acquisition unit 11 when the driver is not looking at the peripheral image. Generates a control signal to control the brightness of a certain peripheral image. Then, the communication unit 91a transmits the control signal generated by the control unit 91b to the vehicle device 93. According to the server 91 configured in this way, the same effect as that of the display control device 1 described in the first embodiment can be obtained.

FIG. 13 is a block diagram showing the configuration of the communication terminal 96 according to this modification. The communication terminal 96 of FIG. 13 includes a communication unit 96a similar to the communication unit 91a and a control unit 96b similar to the control unit 91b, and can perform wireless communication with the vehicle device 98 of the vehicle 97. ing. The communication terminal 96 is, for example, a mobile terminal such as a mobile phone, a smartphone, or a tablet carried by the driver of the vehicle 97. According to the communication terminal 96 configured in this way, the same effect as that of the display control device 1 described in the first embodiment can be obtained.

In the present invention, each embodiment and each modification can be freely combined, and each embodiment and each modification can be appropriately modified or omitted within the scope of the invention.

Although the present invention has been described in detail, the above description is exemplary in all embodiments and the present invention is not limited thereto. It is understood that innumerable variations not illustrated can be assumed without departing from the scope of the present invention.

1 display control device, 11 acquisition unit, 12 control unit, 32 display device.

Claims (7)

It is a display control device that controls a display device that displays a peripheral image obtained by imaging the surroundings of a vehicle.
An acquisition unit that acquires a facial feature amount based on an image of the driver's face of the vehicle, and an acquisition unit.
A peripheral image that is the brightness of the peripheral image displayed on the display device based on the specific facial feature amount that is the facial feature amount acquired by the acquisition unit when the driver is not looking at the peripheral image. A display control device including a control unit that controls brightness. The display control device according to claim 1.
The specific facial feature amount is a display control device including the facial feature amount acquired by the acquisition unit when the driver is looking at the outside of the vehicle. The display control device according to claim 1.
The control unit
A display control device that controls to match the peripheral image brightness with the brightness previously associated with the specific face feature amount. The display control device according to claim 1.
The acquisition unit further acquires the driving information of the vehicle, and obtains the driving information.
The control unit
A display control device that controls the peripheral image brightness based on the specific facial feature amount when it is determined that the vehicle is driving based on the driving information acquired by the acquisition unit. The display control device according to claim 1.
The acquisition unit further acquires the illuminance of the display device, and obtains the illuminance.
The control unit
A display control device that controls the peripheral image brightness based on the illuminance acquired by the acquisition unit when the specific facial feature amount does not satisfy a specific condition. The display control device according to claim 1.
The facial feature amount is a display control device including at least one of the pupil diameter of the driver, the intensity of light hitting the driver's face, and the degree of eye opening of the driver. It is a display control method that controls a display device that displays a peripheral image obtained by imaging the surroundings of a vehicle.
The facial feature amount based on the image of the driver's face of the vehicle is acquired, and the face feature amount is acquired.
The peripheral image brightness, which is the brightness of the peripheral image displayed on the display device, is controlled based on the specific facial feature amount, which is the facial feature amount acquired when the driver is not looking at the peripheral image. , Display control method.

Images