WO2016079939A1

WO2016079939A1 - Line-of-sight-direction-region setting apparatus and line-of-sight-direction-region setting system

Info

Publication number: WO2016079939A1
Application number: PCT/JP2015/005518
Authority: WO
Inventors: 哲史野呂; 鎌田　忠; 川内　正明
Original assignee: 株式会社デンソー
Priority date: 2014-11-19
Filing date: 2015-11-03
Publication date: 2016-05-26
Also published as: JP2016099718A

Abstract

This line-of-sight-direction-region setting apparatus is provided with: a driver-line-of-sight-direction-information input unit (27) to which driver-line-of-sight direction information representing a line-of-sight direction (45) of a driver is input; an assemblage recognition unit (31) that recognizes assemblages (49, 51, 53, 55, 57, and 59) on a distribution of the line-of-sight directions on the basis of the driver-line-of-sight direction information; an assemblage determination unit (33) that determines the assemblages corresponding to a mirror on the basis of the ranking, among the assemblages, as to the number of the line-of-sight directions contained in the assemblages; and a line-of-sight-direction-region setting unit (35) that sets a line-of-sight-direction-region (61) containing at least one of the assemblages corresponding to the mirror.

Description

Gaze direction area setting device and gaze direction area setting system

Cross-reference of related applications

This application is based on Japanese Patent Application No. 2014-234661 filed on November 19, 2014, and the description is incorporated herein.

The present disclosure relates to a gaze direction area setting device and a gaze direction area setting system.

In the technique described in Patent Document 1, the number of times that the driver visually recognizes the side mirror is measured based on the fact that the driver's face faces the side mirror. When the number of times is equal to or less than a predetermined value, it is determined that the driver's attention is reduced.

JP 2014-48885 A

The face orientation when the driver visually recognizes the mirror differs depending on various factors such as the driver's physique, the driver's seating position, the driver's posture, and the vehicle type of the host vehicle. For example, the face orientation when a driver with a high sitting height visually recognizes the side mirror is downward as compared with a driver with a low sitting height.

Therefore, even if the direction of the driver's face is detected, it is difficult to accurately determine whether or not the driver is viewing the mirror at that time.

The present disclosure has been made in view of the above points, and an object thereof is to provide a gaze direction area setting device and a gaze direction area setting system that can accurately determine whether or not a driver is viewing a mirror.

A gaze direction area setting device according to a first aspect of the present disclosure includes a driver gaze direction information input unit to which driver gaze direction information representing a driver's gaze direction is input, and a collection unit in a gaze direction distribution based on the driver gaze direction information A collective unit recognition unit for recognizing a collective unit, a collective unit determining unit for judging a collective unit corresponding to the mirror based on a rank among the collective units regarding the number of gaze directions included in the collective unit, and a collective unit corresponding to the mirror A line-of-sight direction area setting unit that sets a line-of-sight direction area including at least one line of sight.

The gaze direction area setting device sets the gaze direction area based on the actual gaze direction of the driver. Therefore, for example, even if the driver's physique, the driver's seating position, the driver's posture, the vehicle type of the host vehicle, etc. are various, the gaze direction area including the gaze direction when the driver actually looks at the mirror is set with high accuracy can do.

If the line-of-sight direction area and the line-of-sight direction of the driver are compared, it is possible to accurately determine that the line-of-sight direction of the driver does not face the mirror and is looking away.

A gaze direction area setting device according to a second aspect of the present disclosure recognizes a gaze direction distribution unit based on a driver gaze direction detection unit that detects a gaze direction of a driver and a gaze direction detected by the driver gaze direction detection unit. At least one set unit corresponding to the mirror, and a set unit determining unit for determining the set unit corresponding to the mirror based on the rank between the set units regarding the number of gaze directions included in the set unit A line-of-sight direction area setting unit for setting a line-of-sight direction area including the above.

A gaze direction area setting system according to a third aspect of the present disclosure includes a driver gaze direction information output device that detects a gaze direction of a driver and outputs the driver gaze direction information, and a gaze direction area setting device according to the first aspect; including. Even with this line-of-sight direction region setting system, it is possible to accurately determine that the driver's line-of-sight direction does not face the mirror and is looking away.

The above and other objects, features, and advantages of the present disclosure will become more apparent from the following detailed description with reference to the accompanying drawings. The drawing
FIG. 1 is an explanatory diagram showing the configuration of the line-of-sight direction region setting system. FIG. 2 is a flowchart showing processing executed by the driver gaze direction information output device. FIG. 3 is a flowchart showing a gaze direction area setting process executed by the gaze direction area setting device. FIG. 4 is an explanatory diagram showing the positional relationship between the gaze direction, curved surface, and points of the driver. FIG. 5 is an explanatory diagram showing the distribution in the line-of-sight direction, FIG. 6 is a flowchart showing alarm processing executed by the line-of-sight direction region setting device, FIG. 7 is a block diagram showing the configuration of the line-of-sight direction region setting device, FIG. 8 is a flowchart showing a gaze direction area setting process executed by the gaze direction area setting device. FIG. 9 is a flowchart showing alarm processing executed by the line-of-sight direction region setting device.

Embodiments of the present disclosure will be described with reference to the drawings.

(First embodiment)
1. Configuration of Gaze Direction Area Setting System 1 A configuration of the gaze direction area setting system 1 will be described with reference to FIG. The line-of-sight direction region setting system 1 includes a driver line-of-sight direction information output device 3 and a line-of-sight direction region setting device 5. The driver gaze direction information output device 3 is provided in glasses that can be worn by the driver. When the driver wears the glasses, the driver gaze direction information output device 3 is worn on the driver's head. The line-of-sight direction region setting device 5 is an in-vehicle device. Hereinafter, the vehicle on which the line-of-sight direction area setting device 5 is mounted is referred to as the own vehicle.

The driver line-of-sight direction information output device 3 includes a driver line-of-sight direction detection unit 7, a calculation unit 9, a display 11, an input unit 13, and a communication unit 15.

The driver gaze direction detection unit 7 includes a gyro sensor 17 and an electrooculogram sensor 19. The gyro sensor 17 detects the face direction of the driver wearing the driver gaze direction information output device 3. The electrooculogram sensor 19 detects a potential difference around the eye associated with eye movement, and detects the direction of the eyeball (the direction of the line of sight) based on the driver's face direction based on the potential difference. The driver gaze direction detection unit 7 detects the driver's gaze direction by combining the driver's face direction and the eyeball direction based on the face direction. The line-of-sight direction of the driver is a direction with reference to the own vehicle.

The arithmetic unit 9 is a known computer including a CPU, RAM, ROM and the like. The arithmetic unit 9 functionally includes a wearer determination unit 21. The function of the wearer determination unit 21 will be described later.

The display 11 is composed of a liquid crystal display, an organic EL display, or the like and is capable of displaying an image. The input unit 13 includes a keyboard, a touch panel, etc., and is configured to input information. The communication unit 15 is configured to be able to perform wireless communication with the line-of-sight direction area setting device 5.

The line-of-sight direction region setting device 5 includes a speed detection unit 23, a calculation unit 25, a communication unit 27, a storage unit 29, a speaker 39, and a display 41. The communication unit 27 is an example of a driver line-of-sight direction information input unit.

Speed detection unit 23 detects the speed of the host vehicle. The arithmetic unit 25 is a known computer including a CPU, RAM, ROM, and the like. The arithmetic unit 25 functionally includes a gathering part recognition unit 31, a gathering part determination unit 33, a line-of-sight direction region setting unit 35, and an alarm unit 37. The function of each unit will be described later.

The communication unit 27 is configured to perform wireless communication with the driver line-of-sight direction information output device 3.

The storage unit 29 is composed of an HDD (Hard Disk Drive) and can store, save, and read information. The speaker 39 and the display 41 are installed in the passenger compartment of the host vehicle and are used in alarm processing described later.

2. Processing executed by the line-of-sight direction region setting system 1 (2-1) Processing executed by the driver line-of-sight direction information output device 3 Processing executed by the driver line-of-sight direction information output device 3 (particularly the arithmetic unit 9) will be described with reference to FIG. To do. In step S1 in FIG. 2, it is determined whether or not the timing for executing the processing in step S2 and subsequent steps has been reached. This timing can be, for example, a timing at which a predetermined time has elapsed since the processing after step S2 was previously executed. If the timing has been reached, the process proceeds to step S2, and if not, the process ends.

In step S2, the wearer determination unit 21 displays a message requesting ID input on the display 11. The driver of the host vehicle can input the driver ID using the input unit 13 in response to this message.

In step S3, the wearer determination unit 21 determines whether or not an ID has been input within a predetermined time after displaying the message in step S2. If there is an ID input, the process proceeds to step S4. If no ID is input, the process ends.

In step S4, the wearer determination unit 21 transmits the wearer information using the communication unit 15. The wearer information is information representing an ID input using the input unit 13.

In step S5, the driver's gaze direction detection unit 7 is used to detect the driver's gaze direction.

In step S6, the speed of the host vehicle is acquired using the communication unit 15. Note that the speed detection unit 23 of the line-of-sight direction region setting device 5 periodically detects the speed of the host vehicle and transmits it using the communication unit 27. In this step S6, the speed transmitted as described above is acquired.

In step S7, driver gaze direction information is transmitted using the communication unit 15. The driver's line-of-sight direction information is information including the driver's line-of-sight direction detected in step S5 and the speed of the host vehicle acquired in step S6. The driver's line-of-sight direction included in one driver line-of-sight direction information and the speed of the host vehicle are acquired at substantially the same timing. Each time the processes of step S5 and step S6 are performed once, one driver gaze direction information is created.

In step S8, it is determined whether or not N driver gaze direction information has been transmitted. If the transmission has been completed, the process is terminated. If the transmission has not been completed, the process proceeds to step S5. N is a positive integer, and is preferably a sufficiently large number (for example, several tens to several tens of thousands).

(2-2) Gaze Direction Area Setting Process Performed by the Gaze Direction Area Setting Device 5 The gaze direction area setting process executed by the gaze direction area setting device 5 (particularly the arithmetic unit 25) will be described with reference to FIGS. In step S <b> 1 of FIG. 3, it is determined whether or not the wearer information is received by the communication unit 27. The wearer information is transmitted by the driver gaze direction information output device 3 in step S4. If the wearer information is received, the process proceeds to step S12. If not received, the process is terminated.

In step S12, it is determined whether or not the data corresponding to the ID included in the wearer information received in step S11 is stored in the storage unit 29. If not stored, the process proceeds to step S13. If stored, the process proceeds to step S20.

In step S13, the communication unit 27 is used to receive N driver line-of-sight direction information. That is, the driver gaze direction information is input to the communication unit 27. Note that each of the N driver line-of-sight direction information is transmitted by the driver line-of-sight direction information output device 3 in step S7.

In step S14, the collective part recognition unit 31 recognizes the collective part in the gaze direction distribution based on the driver gaze direction information received in step S13. This process will be specifically described below.

As shown in FIG. 4, the line-of-sight direction 45 of the driver 43 passes through a curved surface 47 made up of a WS (wind shield) of the host vehicle and a portion further extending to the outside. The line-of-sight direction 45 of the driver 43 can be represented by a point 45 </ b> A where it passes through the curved surface 47.

In FIG. 5, N line-of-sight directions 45 included in the N driver line-of-sight direction information received in step S13 are represented as points 45A on the curved surface 47. The group of points 45A on the curved surface 47 is an example of the distribution in the line-of-sight direction. However, when the speed of the host vehicle included in the driver line-of-sight direction information is equal to or less than a predetermined threshold (for example, 5 km / h), the line-of-sight direction included in the driver line-of-sight direction information is excluded from the distribution of the line-of-sight direction.

On the curved surface 47, there are

aggregate portions

49, 51, 53, 55, 57, 59... That are portions where the points 45A are aggregated (portions where the distance between the points 45A is smaller than other portions). . The collective unit recognition unit 31 recognizes the

collective units

49, 51, 53, 55, 57, 59.

3, in step S15, the gathering unit determination unit 33 first calculates the number of gaze directions included in the gathering part for each of the

gathering parts

49, 51, 53, 55, 57, 59. Next, the order is given to the

collective portions

49, 51, 53, 55, 57, 59... In descending order of the number of gaze directions included in the collective portion. For example, the rank of the set part including the most line-of-sight directions is No. 1, and the rank of the set part including the i-th most line-of-sight directions is i (i is an integer of 2 or more). This rank is an example of the rank between the collective parts regarding the number of gaze directions included in the collective part.

Then, the collective part with the highest rank is the collective part in the line of sight when the driver sees the vanishing point (the point at infinity in front of the host vehicle) (hereinafter referred to as the collective part corresponding to the vanishing point). It is judged that. In the example illustrated in FIG. 5, the collection unit 49 is a collection unit corresponding to the vanishing point.

In step S16, the gathering part determination unit 33 judges the gathering part corresponding to the mirror based on the ranking given in step S15. Specifically, this is performed as follows. The collective portion 51 having the highest rank on the left side of the collective portion 49 corresponding to the vanishing point is a collective portion in the line-of-sight direction when the driver looks at the left mirror (hereinafter, referred to as a collective portion 51 corresponding to the left mirror). Judge that there is. In addition, the collection unit 53 having the highest rank on the right side of the collection unit 49 corresponding to the vanishing point is a collection unit in the line-of-sight direction when the driver looks at the right mirror (hereinafter referred to as a collection unit 53 corresponding to the right mirror). ). In addition, the highest-order set unit 55 above the set unit 49 corresponding to the vanishing point is the set unit in the line-of-sight direction when the driver views the indoor rearview mirror (hereinafter referred to as the set unit 55 corresponding to the indoor rearview mirror). ).

In step S17, the set unit determination unit 33 selects the set unit 57 having the highest rank below the set unit 49 corresponding to the vanishing point, and the set unit in the line-of-sight direction when the driver looks at the meter (hereinafter, corresponds to the meter). It is determined that it is a collecting unit 57).

In step S18, as shown in FIG. 5, the line-of-sight direction area setting unit 35 includes a collection unit 51 corresponding to the left mirror, a collection unit 53 corresponding to the right mirror, and a collection unit 55 corresponding to the indoor rearview mirror. A direction area 61 is set on the curved surface 47.

The line-of-sight direction area 61 is a rectangular area. The gathering part 51 corresponding to the left mirror, the gathering part 53 corresponding to the right mirror, and the gathering part 55 corresponding to the indoor rearview mirror are inscribed in the outer peripheral end of the line-of-sight direction region 61, respectively.

The gathering part 57 corresponding to the meter and the gathering part 59 corresponding to the navigation are not included in the line-of-sight direction area 61 and circumscribe the outer peripheral edge of the line-of-sight direction area 61.

Before setting the line-of-sight direction area 61 as described above, a large area as an initial stage (for example, an area of 3 m in length and width if defined by length, and an area of 180 ° in length and width if defined by angle) Is set in advance.

Returning to FIG. 3, in step S19, the gaze direction area setting unit 35 associates the gaze direction area set in step S18 with the ID included in the wearer information received in step S11, and stores it in the storage unit 29. Remember. The stored line-of-sight direction area is used in alarm processing described later.

On the other hand, if it is determined in step S12 that the corresponding data is present, the process proceeds to step S20, and the line-of-sight area associated with the ID included in the wearer information received in step S11 is read from the storage unit 29. Note that the line-of-sight direction area read in step S12 is stored in association with the ID in the previous step S19. The read line-of-sight direction area is used in alarm processing described later.

(2-3) Alarm process executed by the line-of-sight direction area setting device 5 The alarm process repeatedly executed by the line-of-sight direction area setting device 5 (especially the alarm unit 37) every predetermined time will be described with reference to FIG.

In step S21 in FIG. 6, driver gaze direction information is received using the communication unit 27. The driver line-of-sight direction information output device 3 periodically creates and transmits driver line-of-sight direction information when the processing shown in FIG. 2 is not executed.

In step S22, it is determined whether or not the driver's line-of-sight direction included in the driver line-of-sight direction information received in step S21 is outside the line-of-sight direction area. If it is outside the line-of-sight direction area, the process proceeds to step S23, and if it is within the line-of-sight direction area, this process ends.

In step S23, an alarm sound is output using the speaker 39 and an alarm message is displayed on the display 41.

3. Effects produced by the line-of-sight direction area setting system 1 The line-of-sight direction area setting device 5 sets the line-of-sight direction area based on the actual line-of-sight direction of the driver. Therefore, for example, even if the driver's physique, the driver's seating position, the driver's posture, the vehicle type of the host vehicle, etc. are various, the gaze direction area including the gaze direction when the driver actually looks at the mirror is set with high accuracy can do.

If the line-of-sight direction area and the line-of-sight direction of the driver are compared, it is possible to accurately determine that the line-of-sight direction of the driver does not face the mirror and is looking away, and appropriately perform alarm processing.

The line-of-sight direction area setting device 5 identifies the line-of-sight direction of the driver based on the face direction of the driver and the direction of the eyeball based on the face direction. Therefore, the driver's line-of-sight direction can be detected with high accuracy.

Driver gaze direction information output device 3 is mounted on the head of the driver. Therefore, it is easier to adjust the position and direction of the driver gaze direction information output device 3 than when the driver gaze direction information output device 3 is fixed to the host vehicle.

Driver gaze direction information output device 3 is provided in glasses worn by the driver. Therefore, the distance between the driver gaze direction information output device 3 and the driver's eyes is short. As a result, the line-of-sight direction of the driver can be detected with high accuracy. Further, the driver can easily attach the driver gaze direction information output device 3.

The line-of-sight direction region setting device 5 determines that the set part having the highest order on the left is the set part corresponding to the left mirror with reference to the set part corresponding to the vanishing point, and the set having the highest order on the right side The unit is determined to be the collecting unit corresponding to the right mirror, and the collecting unit having the highest rank in the upper part is determined to be the collecting unit corresponding to the indoor rearview mirror. As a result, it is possible to accurately determine the aggregate portion corresponding to the mirror.

The line-of-sight area setting device 5 excludes the line-of-sight direction when the speed of the host vehicle is equal to or less than a predetermined threshold in the distribution of the line-of-sight direction. As a result, it is possible to prevent the driver's line-of-sight direction from affecting the setting of the line-of-sight region when the vehicle is not traveling.

The line-of-sight direction area setting system 1 can automatically calibrate the line-of-sight direction area while it is being used, even if the user does not make troublesome settings.

(Second Embodiment)
1. Configuration of Gaze Direction Area Setting Device 105 A configuration of the gaze direction area setting device 105 will be described with reference to FIG. The line-of-sight direction region setting device 105 is an in-vehicle device mounted on the host vehicle. The line-of-sight direction region setting device 105 includes an arithmetic unit 125, a speed detection unit 123, a driver line-of-sight direction detection unit 107, a display 141, an input unit 113, a speaker 139, and a storage unit 129.

The arithmetic unit 125 is a known computer including a CPU, RAM, ROM, and the like. The arithmetic unit 125 functionally includes a collective part recognition unit 131, a collective part determination unit 133, a line-of-sight direction area setting unit 135, a wearer determination unit 121, and an alarm unit 137. The function of each unit will be described later.

The speed detection unit 123 detects the speed of the host vehicle. The driver gaze direction detection unit 107 includes a camera 118 fixed in the passenger compartment of the host vehicle. The camera 118 can photograph the driver's face. The driver gaze direction detection unit 107 determines the driver's face direction based on the image captured by the camera 118. Then, assuming that the driver is looking toward the front of the face, the driver detects the direction of the driver's line of sight.

The display 141, the input unit 113, the speaker 139, and the storage unit 129 are the same as the display 41, the input unit 13, the speaker 39, and the storage unit 29 in the first embodiment, respectively.

2. Processing executed by the line-of-sight direction region setting device 105 (2-1) Line-of-sight direction region setting processing executed by the line-of-sight direction region setting device 105 Line-of-sight direction region setting processing executed by the line-of-sight direction region setting device 105 (particularly the arithmetic unit 125) This will be described with reference to FIG. In step S31, it is determined whether or not it is time to execute the processes in and after step S32. This timing can be, for example, a timing at which a predetermined time has elapsed since the processing after step S32 was executed last time. If the timing has been reached, the process proceeds to step S32. If the timing has not been reached, the process ends.

In step S32, the wearer determination unit 121 displays a message requesting ID input on the display 141. In addition, the driver of the own vehicle can input ID using the input unit 113 according to this message.

In step S33, the wearer determination unit 121 determines whether or not an ID has been input within a predetermined time after displaying the message in step S32. If there is an ID input, the process proceeds to step S34. If no ID is input, the process ends.

In step S34, the wearer determination unit 121 determines whether data corresponding to the ID determined to have been input in step S33 is stored in the storage unit 129. If not stored, the process proceeds to step S35, and if stored, the process proceeds to step S45.

In step S35, the driver's line-of-sight direction detection unit 107 is used to detect the driver's line-of-sight direction.

In step S36, the speed detection unit 123 is used to detect the speed of the host vehicle. The speed of the host vehicle is detected at substantially the same timing as the driver's line-of-sight direction detected in the immediately preceding step S35. The speed of the host vehicle detected in step S36 and the driver's line-of-sight direction detected in the previous step S35 are combined to obtain driver line-of-sight direction information. That is, each time the processes of step S35 and step S36 are executed, one driver gaze direction information is created.

In step S37, it is determined whether or not N driver line-of-sight direction information has been accumulated by the processing in step S35 and step S36. If N driver line-of-sight direction information has been accumulated, the process proceeds to step S38. Otherwise, the process proceeds to step S35.

In steps S38 to S43, as in steps S14 to S19 in the first embodiment, a line-of-sight direction area is set, and the line-of-sight direction area and the ID are associated and stored in the storage unit 129. The stored line-of-sight direction area is used in alarm processing described later.

In the processing of Steps S38 to S43, the collective unit recognition unit 131, the collective unit determination unit 133, and the line-of-sight direction area setting unit 135 are the collective unit recognition unit 31, the collective unit determination unit 33, and the collective unit determination unit 33 in the first embodiment, respectively. And the same function as the line-of-sight direction region setting unit 35.

On the other hand, if it is determined in step S34 that the corresponding data exists, the process proceeds to step S45, and the line-of-sight direction area associated with the ID determined to be input in step S33 is read from the storage unit 129. Note that the line-of-sight direction area read in step S45 is stored in association with the ID in the previous step S43. The read line-of-sight direction area is used in alarm processing described later.

(2-2) Alarm process executed by the line-of-sight direction area setting device 105 The alarm process repeatedly executed by the line-of-sight direction area setting device 105 (particularly the alarm unit 137) every predetermined time will be described with reference to FIG.

9, the driver's line-of-sight direction detection unit 107 is used to detect the driver's line-of-sight direction.

In step S52, it is determined whether or not the driver's line-of-sight direction detected in step S51 is outside the line-of-sight direction area. If it is outside the line-of-sight direction area, the process proceeds to step S53, and if it is within the line-of-sight direction area, this process ends.

In step S53, an alarm sound is output using the speaker 139 and an alarm message is displayed on the display 141.

3. Effects exhibited by the line-of-sight direction region setting device 105
The gaze direction area setting device 105 detects the driver's face direction and identifies the driver's gaze direction based on the face direction. Therefore, the driver's line-of-sight direction can be detected with a simple configuration.

(Other embodiments)
As mentioned above, although embodiment of this indication was described, this indication can take various forms, without being limited to the above-mentioned embodiment.

In the first and second embodiments, the driver gaze direction detection units 7 and 107 may detect the driver's gaze direction by other methods. For example, in the first embodiment, the driver's face direction may be detected by the gyro sensor 17, and the driver's line of sight may be detected on the assumption that the driver is looking at the front of the face.

In the second embodiment, the driver's face direction and the eyeball direction based on the face direction may be detected, and the driver's gaze direction may be specified based on the face direction and the eyeball direction.

Also, the line-of-sight direction of the driver may be detected by a combination of a gyro sensor and a geomagnetic sensor.

In the first and second embodiments, the collecting unit corresponding to the left mirror, the collecting unit corresponding to the right mirror, and the collecting unit corresponding to the indoor rearview mirror may be specified by other methods. For example, except for the 2nd to 5th aggregate parts with the lowest rank (the aggregate part corresponding to the meter), the remaining 3 aggregate parts correspond to the aggregate part corresponding to the left mirror and the right mirror And a collecting unit corresponding to the indoor rearview mirror.

In the first and second embodiments, the line-of-sight direction area may be periodically updated. That is, the line-of-sight direction area may be set periodically, and the past line-of-sight direction area may be overwritten and stored. The timing at which the line-of-sight direction area is updated can be, for example, at the start of driving of the host vehicle. Further, the line-of-sight direction area may be updated every predetermined time. Further, the line-of-sight direction region may be updated with conditions. For example, the line-of-sight direction area may be updated on condition that the newly set line-of-sight direction area is smaller than the past line-of-sight direction area.

In the first embodiment, the driver line-of-sight direction information output device 3 may be other than the one provided in the glasses. For example, the driver gaze direction information output device 3 may be a mobile terminal (for example, a smartphone). In the first embodiment, the line-of-sight direction region setting device 5 may be a device other than the in-vehicle device, for example, a mobile terminal (for example, a smartphone).

In the second embodiment, the line-of-sight direction region setting device 105 may be other than the in-vehicle device, and may be, for example, a mobile terminal (for example, a smartphone). Further, part or all of the line-of-sight direction region setting device 105 may be attached to a driver (for example, the head of the driver). Of the line-of-sight direction region setting device 105, a driver line-of-sight direction detection unit 107 can be provided in a portion attached to the driver. Of the line-of-sight direction region setting device 105, a portion that is worn by the driver can be provided in glasses worn by the driver.

In the first embodiment, the driver gaze direction information output device 3 may have a part of the functions of the gaze direction area setting device 5. For example, the arithmetic unit 9 of the driver gaze direction information output device 3 may include the collective unit recognition unit 31 or may include the collective unit recognition unit 31 and the collective unit determination unit 33.

Further, the driver gaze direction information output device 3 may include a speed detection unit 23. In this case, the speed detection unit 23 includes an acceleration sensor, and can calculate the speed of the host vehicle from the integrated value of the detected acceleration.

In the first embodiment, the line-of-sight direction area setting device 5 may perform pairing with the one having the strongest communication radio wave intensity among the plurality of driver line-of-sight direction information output devices 3.

Further, the line-of-sight direction area setting device 5 may perform pairing with the driver line-of-sight direction information output device 3 whose power is turned on in accordance with an operation command from the line-of-sight direction region setting apparatus 5.

In the first and second embodiments, the line-of-sight direction region includes a part of a set part corresponding to a right mirror, a set part corresponding to a left mirror, and a set part corresponding to a room mirror. It may not include anything other than the part.

The functions of one component in the above embodiment may be distributed as a plurality of components, or the functions of a plurality of components may be integrated into one component. Further, at least a part of the configuration of the above embodiment may be replaced with a known configuration having the same function. Moreover, you may abbreviate | omit a part of structure of the said embodiment. For example, in the first embodiment, the line-of-sight direction region setting device 5 may not include the display 41 or the like.

Further, at least a part of the configuration of the above embodiment may be added to or replaced with the configuration of the other embodiment. In addition, all the aspects included in the technical idea specified only by the wording described in the claims are embodiments of the present disclosure.

In addition to the above-described line-of-sight direction area setting device and line-of-sight direction area setting system, the present invention is implemented in various forms such as a program for causing a computer to function as the line-of-sight direction area setting apparatus, a medium recording this program, and a line-of-sight direction area setting method. Disclosure can also be realized.

Although the present disclosure has been described with reference to the embodiments, it is understood that the present disclosure is not limited to the embodiments and structures. The present disclosure includes various modifications and modifications within the equivalent range. In addition, various combinations and forms, as well as other combinations and forms including only one element, more or less, are within the scope and spirit of the present disclosure.

Claims

A driver gaze direction information input unit (27) to which driver gaze direction information indicating the gaze direction (45) of the driver is input;
A set recognition unit (31) for recognizing the set (49, 51, 53, 55, 57, 59) in the distribution of the gaze direction based on the driver gaze direction information;
A set unit determination unit (33) for determining the set unit corresponding to a mirror based on the rank among the set units with respect to the number of the line-of-sight directions included in the set unit;
A line-of-sight direction area setting unit (35) for setting a line-of-sight direction area (61) including at least one or more of the collective portions corresponding to the mirror;
A gaze direction area setting device.
A driver gaze direction detection unit (107) for detecting the gaze direction (45) of the driver;
A set recognition unit (131) for recognizing the set (49, 51, 53, 55, 57, 59) in the distribution of the gaze direction based on the gaze direction detected by the driver gaze direction detection unit;
A collective part determination unit (133) for judging the collective part corresponding to a mirror based on the rank among the collective parts with respect to the number of the line-of-sight directions included in the collective part;
A line-of-sight direction area setting unit (135) for setting a line-of-sight direction area (61) including at least one or more of the collective portions corresponding to the mirror;
A gaze direction area setting device (105).
The line-of-sight area setting device according to claim 2,
The driver gaze direction detection unit is a gaze direction area setting device that detects a driver's face direction and identifies the gaze direction based on the face direction.
The line-of-sight area setting device according to claim 2,
The driver gaze direction detection unit detects the driver's face direction and the direction of the eyeball based on the face direction, and identifies the gaze direction area based on the face direction and the eyeball direction. .
The line-of-sight direction region setting device according to any one of claims 2 to 4,
At least the driver gaze direction detection unit is a gaze direction area setting device attached to a driver.
A line-of-sight direction region setting device according to any one of claims 2 to 5,
At least the driver line-of-sight direction detection unit is a line-of-sight direction area setting device mounted on a driver's head.
The line-of-sight direction region setting device according to any one of claims 2 to 6,
At least the driver gaze direction detection unit is a gaze direction area setting device provided in glasses.
The line-of-sight direction region setting device according to any one of claims 1 to 7,
The collective unit determination unit is configured to determine the collective unit having the highest rank in one direction selected from left, right, and above with reference to the collective unit having the first rank. A line-of-sight direction region setting device that determines the set portion corresponding to a mirror.
The line-of-sight direction region setting device according to any one of claims 1 to 8,
The line-of-sight direction region setting device, wherein the mirror is one or more selected from a mirror group including a right mirror, a left mirror, and a room mirror.
The line-of-sight direction region setting device according to any one of claims 1 to 9,
The line-of-sight direction area setting unit updates the line-of-sight direction area every predetermined time.
The line-of-sight direction region setting device according to any one of claims 1 to 10,
A line-of-sight direction region setting device that excludes the line-of-sight direction when the speed of the host vehicle is equal to or less than a predetermined threshold in the distribution of the line-of-sight direction.
A driver gaze direction information output device (3) for detecting a gaze direction of the driver and outputting the driver gaze direction information;
A line-of-sight direction region setting system comprising: the line-of-sight direction region setting device according to claim 1.