WO2012176535A1 - 車載機器操作装置及び報知装置 - Google Patents
車載機器操作装置及び報知装置 Download PDFInfo
- Publication number
- WO2012176535A1 WO2012176535A1 PCT/JP2012/059854 JP2012059854W WO2012176535A1 WO 2012176535 A1 WO2012176535 A1 WO 2012176535A1 JP 2012059854 W JP2012059854 W JP 2012059854W WO 2012176535 A1 WO2012176535 A1 WO 2012176535A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- vehicle
- gaze direction
- button
- vehicle device
- occupant
- Prior art date
Links
- 238000001514 detection method Methods 0.000 claims description 35
- 238000003384 imaging method Methods 0.000 claims description 4
- 238000000034 method Methods 0.000 description 38
- 230000008569 process Effects 0.000 description 21
- 230000000994 depressogenic effect Effects 0.000 description 16
- 239000000446 fuel Substances 0.000 description 11
- 230000008859 change Effects 0.000 description 9
- 238000010586 diagram Methods 0.000 description 7
- 230000003247 decreasing effect Effects 0.000 description 4
- 238000010187 selection method Methods 0.000 description 4
- 210000003128 head Anatomy 0.000 description 3
- 125000002066 L-histidyl group Chemical group [H]N1C([H])=NC(C([H])([H])[C@](C(=O)[*])([H])N([H])[H])=C1[H] 0.000 description 2
- 210000005252 bulbus oculi Anatomy 0.000 description 2
- 239000003086 colorant Substances 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 210000001747 pupil Anatomy 0.000 description 2
- 230000007423 decrease Effects 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R16/00—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for
- B60R16/02—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements
- B60R16/023—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements for transmission of signals between vehicle parts or subsystems
- B60R16/027—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements for transmission of signals between vehicle parts or subsystems between relatively movable parts of the vehicle, e.g. between steering wheel and column
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
- B60R1/12—Mirror assemblies combined with other articles, e.g. clocks
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/10—Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
- B60K35/29—Instruments characterised by the way in which information is handled, e.g. showing information on plural displays or prioritising information according to driving conditions
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/60—Instruments characterised by their location or relative disposition in or on vehicles
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
- G06V20/597—Recognising the driver's state or behaviour, e.g. attention or drowsiness
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
- B60K2360/18—Information management
- B60K2360/186—Displaying information according to relevancy
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
- B60K2360/20—Optical features of instruments
- B60K2360/21—Optical features of instruments using cameras
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
- B60K2360/77—Instrument locations other than the dashboard
- B60K2360/782—Instrument locations other than the dashboard on the steering wheel
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
- B60R1/12—Mirror assemblies combined with other articles, e.g. clocks
- B60R2001/1215—Mirror assemblies combined with other articles, e.g. clocks with information displays
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
- B60R1/12—Mirror assemblies combined with other articles, e.g. clocks
- B60R2001/1223—Mirror assemblies combined with other articles, e.g. clocks with sensors or transducers
Definitions
- the present invention relates to an in-vehicle device operating device that can operate a plurality of in-vehicle devices using the gazing direction of the occupant and a notification device that notifies the gazing direction of the vehicle occupant.
- JP 2010-105417 A discloses a technique that allows an in-vehicle device 21 to be watched by a vehicle driver to be operated by an operation input means 28 provided on a steering wheel 50. Is disclosed (summary).
- U.S. Patent Application Publication No. 2010/0324779 (hereinafter referred to as “US ⁇ 2010/0324779 A1 ”) describes an in-vehicle device (side mirror 21, room mirror 22, navigation system 23, in-vehicle phone) that is intended to be operated by a passenger. 24, an air outlet 25, and a meter panel 26) are selected by an occupant's line of sight L and operated by a common steering switch 16 (summary).
- the occupant is informed via the pilot lamps 21a, 22a, 23a, 24a, 25a, 26a that the in-vehicle device that the line of sight L points to can be operated (summary and FIG. 1).
- JP1052010-105417 ⁇ A it is necessary to specify the in-vehicle device 21 being watched by the driver.
- the in-vehicle device 21 is arranged close to the audio device and the air conditioner, the in-vehicle device 21 is installed.
- high-precision image processing is required to ensure the determination accuracy, it is necessary to use a high-resolution camera, a high-performance arithmetic unit, and the like, resulting in a high cost.
- the present invention has been made in consideration of such problems, and an object of the present invention is to provide an in-vehicle device operating device capable of preventing erroneous determination of an in-vehicle device to be operated and reducing the cost.
- Another object of the present invention is to enable easy identification of an operation target device based on a gaze direction, and allows an operator such as an occupant to recognize a gaze direction detected by the apparatus side. It is to provide a notification device.
- a vehicle-mounted device operating device includes a plurality of vehicle-mounted devices that are mounted on a vehicle and can be operated by a vehicle occupant, and a gaze direction that detects the gaze direction of the vehicle occupant based on the line-of-sight direction or face direction of the vehicle occupant Detecting means; vehicle-mounted device specifying means for specifying any one of the plurality of vehicle-mounted devices based on the gaze direction detected by the gaze direction detecting device; and the vehicle-mounted device operable by the occupant And a plurality of in-vehicle devices arranged in the vehicle width direction of the vehicle and in the vertical direction intersecting the vehicle width direction.
- the vehicle-mounted device specifying unit specifies the vehicle-mounted device group based on the gaze direction detected by the gaze direction detecting unit, and the vehicle-mounted device group is specified in a state where the vehicle-mounted device group is specified.
- the vertical direction selecting means is operated, any one of the specified in-vehicle devices is specified based on the vertical direction selected by the vertical direction selecting means.
- the in-vehicle device group in the vehicle width direction is specified based on the gazing direction of the occupant, and any one of the in-vehicle devices in the specified in-vehicle device group is specified by operating the vertical direction selection unit. Therefore, it is not necessary for the occupant to look closely at any of the in-vehicle devices to be identified, and only point the line of sight or face in the direction of the in-vehicle device group (vehicle width direction) where any of the in-vehicle devices to be identified exists. Get better.
- the vertical direction selecting means may be constituted by individual operation switches assigned corresponding to the selectable vertical directions.
- the operation target device can be reliably selected. For this reason, convenience can be improved.
- the vertical direction selecting means may also serve as an operation input means for performing a specific operation input to the specified in-vehicle device in a state where the in-vehicle device is specified by the in-vehicle device specifying means.
- the vertical direction selection means for example, device selection switch
- the operation input means for example, device operation switch
- the gaze direction detection means includes an imaging means provided in the vehicle interior so as to be able to take an image including the occupant, and a face orientation angle of the occupant in the vehicle width direction based on the image taken by the imaging means And a gaze direction of the occupant may be detected based on the face orientation angle detected by the face orientation angle detection means.
- the face direction angle in the vehicle width direction can be obtained from the image processing. Therefore, there are devices such as high-precision image processing and infrared light emitting diodes (LEDs) for performing gaze detection using pupil bright spot detection and the like. It becomes unnecessary and it is possible to further reduce the cost.
- the vertical direction selecting means is configured as a cross switch provided on a steering wheel of the vehicle, and the selectable vertical direction is assigned corresponding to the vertical direction of the cross switch in a front view of the steering wheel. Also good.
- the in-vehicle device can be operated without releasing the hand from the steering wheel, so that convenience is improved.
- the selectable direction corresponds to the vertical position of the cross key, the in-vehicle device can be selected more intuitively, and the blind operation can be further facilitated.
- Display means for displaying the in-vehicle device group specified by the in-vehicle device specifying means may be provided for each in-vehicle device group.
- the notification device includes a plurality of in-vehicle devices that are mounted on a vehicle and that can be operated by a passenger of the vehicle, and a gaze direction detection unit that detects a gaze direction of the occupant based on a gaze direction or a face direction of the occupant. And a plurality of in-vehicle devices that are arranged in the vehicle width direction of the vehicle and in the vertical direction intersecting the vehicle width direction are divided into predetermined regions in the vehicle width direction.
- the in-vehicle device specifying means for specifying any of the in-vehicle device groups and the notification for informing the in-vehicle device group specified by the in-vehicle device specifying means
- the notification means has a width equivalent to the width of each of the predetermined areas, and is arranged side by side in the vehicle width direction on the instrument panel of the vehicle.
- the information specified based on the gazing direction of the occupant among the plurality of in-vehicle device groups in the vehicle width direction is notified using the notification means.
- the notification means has a width equivalent to the width of a predetermined area corresponding to each in-vehicle device group in the vehicle width direction, and is arranged side by side in the vehicle width direction on the instrument panel. Therefore, the occupant can visually recognize the boundary and width of the predetermined area, and can recognize the switching of the specified in-vehicle device group, and in the vehicle width direction with a minimum change in line of sight or face direction. It is possible to easily identify the in-vehicle device.
- the occupant is informed by the presence of the notification means that notifies the detected gaze direction. And the gaze direction can be adjusted appropriately.
- the detection of the line-of-sight direction or face direction is It becomes better only in the vehicle width direction.
- the notification means may notify the boundary line of the predetermined area even if the in-vehicle device group is not specified by the in-vehicle device specifying means.
- the occupant can surely understand the boundary line, and it is possible to understand to which width region the specific in-vehicle device group can be selected by changing the line of sight or the face direction.
- the notification device further includes operation means provided so as to be operable by the occupant at a place different from the in-vehicle device, and the operation means can select the in-vehicle device in the vertical direction from the in-vehicle device group.
- the vehicle-mounted device specifying unit specifies the vehicle-mounted device group based on the gaze direction detected by the gaze direction detecting unit, and the vehicle-mounted device group is specified in a state where the vehicle-mounted device group is specified. Based on the up-down direction selected by the up-down direction selection means, any one of the specified in-vehicle equipment groups is specified, and the notification means is notified by the in-vehicle equipment specified by the in-vehicle equipment specification means.
- the method may be changed. Thereby, the passenger
- the notification means may be capable of adjusting the width. Thereby, even if the gaze direction detected by the gaze direction detection means is deviated from the actual gaze direction, the gaze direction can be adjusted, and it is possible to detect the gaze direction along the actual gaze direction without any sense of incongruity.
- the notification device detects a gaze direction of the occupant in the vehicle width direction based on a plurality of in-vehicle devices arranged in the vehicle width direction in the vehicle and at least one of the sight line direction and the face direction of the occupant.
- a gaze direction detection unit an in-vehicle device identification unit that identifies one or more of the in-vehicle devices corresponding to the gaze direction from the plurality of in-vehicle devices, a range in which the gaze direction can be detected, and the vehicle width direction
- An informing unit for visually informing the detected gaze direction or the gazeable area corresponding to the specified one or more in-vehicle devices among a plurality of gazeable regions set according to a plurality of on-vehicle devices;
- the notification unit is provided continuously or intermittently along the vehicle width direction for each of the plurality of gazeable regions in the lower part or the upper part of the front window or in the vicinity thereof. It is in, and having a plurality of indicators indicating the boundary of the gaze region adjacent.
- a plurality of indicators are provided for visually informing the gazeable area corresponding to the detected gaze direction or the specified one or more in-vehicle devices.
- the plurality of indicators are provided continuously or intermittently along the vehicle width direction for each of a plurality of gazeable areas at the lower part or the upper part of the front window or around the front window, and indicate the boundaries between adjacent gazeable areas. Therefore, the occupant can visually recognize the boundary and width of the gazeable area, and can recognize the change of the selected gazeable area, with the minimum change in gaze or face direction. In-vehicle equipment can be reliably identified.
- Detection can be performed only in the vehicle width direction.
- the sight line direction or face direction of the occupant is used only for specifying one or more in-vehicle devices in the vehicle width direction (for example, specifying the vertical direction is when another selection device is used)
- Detection can be performed only in the vehicle width direction.
- FIG. 1 is an overall block diagram of a vehicle equipped with an in-vehicle device operation device (notification device) according to an embodiment of the present invention. It is an external view of the front window periphery of the vehicle. It is an external appearance front view of the steering wheel of the vehicles. It is an external appearance perspective view of the door mirror of the said vehicle. It is a figure which shows the state which divided the periphery of the said front window into five area
- 12 is a flowchart of boundary line adjustment processing (S5 in FIG. 11). It is a figure explaining the adjustment method of the said boundary line. It is a figure which shows an example of the state change of the said indicator at the time of the end of adjustment from the adjustment of the said boundary line. 12 is a flowchart of normal processing (S6 in FIG. 11). It is a figure which shows an example of the state in which the detection of a gaze direction is performed normally. It is a figure which shows an example of the state which cannot detect a gaze direction. It is a figure which shows an example of the state in which the detection of the gaze direction is performed accidentally. 4 is a flowchart in which the ECU selects an operation target device.
- FIG. 6 is a diagram showing a state in which the periphery of the front window is divided into three areas as a modification of FIG. 5. It is a figure which shows the structure which used the pilot lamp instead of the indicator in the said embodiment.
- FIG. 1 is an overall block diagram of a vehicle 10 equipped with an in-vehicle device operation device 12 (hereinafter also referred to as “operation device 12”) according to an embodiment of the present invention.
- FIG. 2 is an external view around the front window 11 of the vehicle 10.
- the operating device 12 includes an occupant camera 14, a cross key 18 provided on the steering wheel 16, a plurality of in-vehicle devices 20, a gaze direction indicator 22 (hereinafter “display 22”).
- display 22 a gaze direction indicator 22
- ECU 24 electronice control unit 24
- the vehicle 10 of this embodiment is a so-called right-hand drive vehicle. Instead, the same configuration can be adopted even for a left-hand drive vehicle.
- the occupant camera 14 is installed in front of the driver in a steering column (not shown), and acquires an image of the driver's face (hereinafter referred to as “face image”).
- face image an image of the driver's face
- the position of the occupant camera 14 is not limited to this, and may be disposed around the rearview mirror 25 (FIG. 2), for example.
- the occupant camera 14 is not limited to imaging from a single direction, and may be a camera that captures images from a plurality of directions (so-called stereo camera).
- Cross key 18 The driver can specify the in-vehicle device 20 (hereinafter referred to as “operation target device”) to be operated using the cross key 18 and input the operation of the specified in-vehicle device 20.
- the cross key 18 has a center button 30, an upper button 32, a lower button 34, a left button 36 and a right button 38. Note that the cross key 18 in FIG. 2 is enlarged and displayed. The operation method of the cross key 18 will be described later.
- the plurality of in-vehicle devices 20 include a navigation device 40, an audio device 42, an air conditioner 44, a head-up display 46 (hereinafter referred to as “HUD 46”), and a hazard lamp 48. And a driver's seat 50, a door mirror 52, a rear light 54, a driver's seat side window 56, and a passenger's seat side window 58.
- the rear light 54 illuminates the rear side of the vehicle 10 with a light emitting diode (LED) under the door mirror 52.
- LED light emitting diode
- Gaze direction indicator 22 As shown in FIG. 2, the display 22 is provided on the instrument panel 59 around the lower portion of the front window 11. As will be described later, the indicator 22 can be provided at another position.
- the indicator 22 also includes a plurality of gaze direction indicators 26a to 26e (hereinafter referred to as “indicators 26a to 26e”, collectively referred to as “indicators 26”) indicating the gaze direction of the driver (occupant) in the vehicle width direction.
- Each indicator 26a to 26e is composed of a lighting device such as a light emitting diode (LED).
- LED light emitting diode
- the indicators 26 a to 26 e can be configured by the HUD 46.
- each of the indicators 26a to 26e can display a plurality of colors (for example, blue, green, yellow, and red), but may display only a single color.
- one of the indicators 26a to 26e corresponding to the driver's gaze direction is turned on, and the other indicators 26a to 26e are turned off. For this reason, the driver can grasp the gaze direction detected by the operation device 12.
- Boundary lines 28a to 28d are arranged between the adjacent indicators 26a to 26e.
- the boundary lines 28a to 28d are composed of, for example, an illumination device such as an LED, like the indicators 26a to 26e.
- a plurality of lighting elements such as LEDs arranged in the entire display 22 can be used as the indicators 26a to 26e and the boundary lines 28a to 28d.
- a configuration in which the boundary lines 28a to 28d themselves do not emit light or a configuration in which the boundary lines 28a to 28d are not provided is also possible.
- the ECU 24 controls the in-vehicle device operating device 12 (in particular, each in-vehicle device 20 in the present embodiment), and includes an input / output device 60, an arithmetic device 62, and a storage device 64 as shown in FIG.
- the arithmetic device 62 includes a gaze direction detection function 70, an in-vehicle device group specifying function 72, an individual in-vehicle device specifying function 74, and an in-vehicle device control function 76.
- each in-vehicle device 20 can be easily controlled. That is, the driver turns the line of sight or face in the vehicle width direction where the in-vehicle device 20 to be operated (hereinafter referred to as “operation target device”) exists and operates the cross key 18 to select the operation target device. It is possible to control. As will be described later, the operation target device can be specified and controlled by other methods.
- the gaze direction detection function 70 is a function that detects the gaze direction of the driver based on at least one of the driver's (occupant) face direction and the gaze direction (eyeball direction).
- the in-vehicle device group specifying function 72 is a function for specifying in-vehicle device groups (groups A to D) existing in the gaze direction detected by the gaze direction detection function 70.
- the individual in-vehicle device specifying function 74 is a function for specifying an operation target device in accordance with a driver's operation from a plurality of in-vehicle devices 20 included in the in-vehicle device group specified by the in-vehicle device group specifying function 72.
- the in-vehicle device control function 76 is a function for controlling the operation target device specified by the individual in-vehicle device specifying function 74 according to the operation input of the driver.
- the driver turns the line of sight or face in the vehicle width direction in which the operation target device exists and operates the cross key 18 to operate the operation target device. Can be controlled.
- the face direction and the line-of-sight direction are detected based on the driver's face image captured by the occupant camera 14, and the gaze direction in the vehicle width direction is determined based on these. Thereafter, the height direction (vertical direction) is specified based on the operation of the cross key 18. Thereby, the operation target device is specified.
- five directions shown in FIG. 5 are set as gaze directions in the vehicle width direction. That is, the periphery of the front window 11 is divided into five areas A1 to A5. More specifically, the center area A1, the front area A2, the right area A3, the left area A4, and the other area A5. Each in-vehicle device 20 is assigned to each of these directions (groups A to D).
- the navigation device 40, the audio device 42, and the air conditioner 44 (group A) are allocated to the area A1 in the central direction.
- “navigation” means “navigation device”
- “audio” means “audio device”
- “air conditioner” means “air conditioner”.
- HUD 46, hazard lamp 48, and seat 50 are assigned to the area A2 in the front direction.
- hazard means “hazard lamp”.
- the door mirror 52, the rear light 54 and the driver's seat side window 56 (group C) are assigned to the right area A3, and the door mirror 52, the rear light 54 and the passenger seat side window 58 (group) are assigned to the left area A4.
- D) is assigned.
- No in-vehicle device 20 is assigned to the area A5 in the other direction.
- the left and right door mirrors 52 are simultaneously unfolded and stored.
- the left and right rear lights 54 are operated simultaneously.
- the ECU 24 detects the face direction and the line-of-sight direction (relative position of the eyeball) based on the face image from the occupant camera 14, and uses these to determine the driver's gaze direction. The determination of the gaze direction can be performed from only one of the face direction and the gaze direction. Then, the ECU 24 (in-vehicle device group specifying function 72) specifies the in-vehicle device group (groups A to D) based on the determined gaze direction. Next, the operation target device is specified in accordance with the pressed button (any one of the buttons 30, 32, 34, 36, and 38) of the cross key 18. Thereafter, the operation target device is operated in accordance with the operation of the cross key 18.
- Operation target device selection method and operation example in the present embodiment show first to third operation examples of the driver 100 when the volume of the audio device 42 is changed.
- the driver 100 sees or turns his face to the area A1 (center direction) where the audio device 42 is located among the five areas A1 to A5.
- ECU24 specifies a vehicle equipment group (group A) using the gaze direction determination technique mentioned later.
- an arrow X in FIG. 6A indicates the gaze direction of the driver 100 (the same applies to the other drawings).
- the ECU 24 lights the indicator 26a corresponding to the determined gaze direction X ⁇ or the specified in-vehicle device group (group A) ⁇ .
- the indicators 26a to 26e that are turned on when the gaze direction X changes are also switched, and the indicators 26a to 26e are turned on in a color (for example, green) indicating that the operation target device is not specified.
- the driver 100 depresses the cross key 18 at a position corresponding to the positional relationship (from the top, the navigation device 40, the audio device 42, and the air conditioner 44) of the in-vehicle devices 20, and determines the operation target device. To do. That is, since the center button 30 corresponds to the audio device 42 in the cross key 18, the driver 100 depresses the center button 30. Thereby, the group A is selected, and the central indicator 26a continues to be lit regardless of the subsequent gaze direction X. The color of the indicator 26a changes according to the selected operation target device. For example, the navigation device 40 is blue, the audio device 42 is yellow, and the air conditioner 44 is red. Therefore, when the audio device 42 is selected, the indicator 26a is displayed in yellow.
- the driver 100 adjusts the volume of the audio device 42 by operating the cross key 18. That is, the volume level increases by 1 each time the upper button 32 is pressed, and the volume level decreases by 1 each time the lower button 34 is pressed. At this time, the driver 100 does not need to look at the target area (the central area A1 corresponding to the group A) or the in-vehicle device 20 (here, the audio device 42), and the operation target device (audio) while looking forward.
- the device 42) can be operated.
- the indicator 26 a corresponding to the audio device 42 continues to be lit in a color (yellow) corresponding to the audio device 42.
- the center button 30 is depressed. When the operation of the audio device 42 is finished, the indicators 26a to 26e corresponding to the newly detected gaze direction X are lit in green (color indicating that the operation target device is not specified).
- FIGS. 7A to 7C show first to third operation examples of the driver 100 when the HUD 46 is displayed and the vehicle speed and fuel consumption are confirmed.
- the driver 100 sees or turns his face to the area A2 (front direction) where the HUD 46 is located among the five areas A1 to A5.
- ECU24 specifies vehicle equipment group B (group B) using gaze direction judging technology.
- the ECU 24 lights the indicator 26b corresponding to the determined gaze direction X ⁇ or the specified in-vehicle device group (group B) ⁇ in green (color indicating that the operation target device is not specified).
- the driver 100 depresses the cross key 18 at a position corresponding to the positional relationship (from the top, the HUD 46, the hazard lamp 48, and the seat 50) of each in-vehicle device 20, and determines the operation target device. That is, since the up button 32 corresponds to the HUD 46 in the cross key 18, the driver 100 depresses the up button 32. Thereby, the front indicator 26b continues to light regardless of the subsequent gaze direction X.
- the color of the indicator 26b is a color corresponding to the selected operation target device. For example, the HUD 46 is blue, the hazard lamp 48 is yellow, and the sheet 50 is red. Therefore, when the HUD 46 is selected, the indicator 26b is displayed in blue.
- the driver 100 switches the display of the HUD 46 by operating the cross key 18. That is, every time the upper button 32 is pressed, the display of the HUD 46 is switched in the order of the vehicle speed 110 ⁇ the travel distance 112 ⁇ the fuel consumption 114 ⁇ the vehicle speed 110. On the contrary, every time the lower button 34 is pressed, the display of the HUD 46 is switched in the order of the vehicle speed 110 ⁇ the fuel consumption 114 ⁇ the travel distance 112 ⁇ the vehicle speed 110. A display other than the vehicle speed 110, the travel distance 112, and the fuel consumption 114 (eg, gasoline amount, remaining battery capacity, or travelable distance) may be performed. At this time, the driver 100 does not need to look at the target area (front area A2 corresponding to the group B) or the in-vehicle device 20 (here, the HUD 46), and can operate the HUD 46 while looking forward. .
- the target area front area A2 corresponding to the group B
- the in-vehicle device 20 here, the HUD 46
- the indicator 26b corresponding to the HUD 46 is continuously lit in the color (blue) corresponding to the HUD 46.
- the center button 30 is depressed.
- the indicators 26a to 26e corresponding to the newly detected gaze direction X are lit in green (color indicating that the operation target device is not specified).
- FIG. 8A shows first to third operation examples of the driver 100 when the passenger seat side window 58 is opened and closed.
- the driver 100 sees or turns his face to the area A4 (left direction) where the passenger seat side window 58 is located among the five areas A1 to A5.
- the vehicle equipment group D (group D) is specified using a gaze direction determination technique.
- the ECU 24 lights the indicator 26d corresponding to the determined gaze direction X ⁇ or the specified in-vehicle device group (group D) ⁇ in green (color indicating that the operation target device is not specified).
- the driver 100 depresses the cross key 18 located at a position corresponding to the positional relationship (from the top, the door mirror 52, the rear light 54, and the passenger seat side window 58) of each in-vehicle device 20, and determines the operation target device. To do. That is, since the upper button 32 and the lower button 34 correspond to the passenger seat side window 58 in the cross key 18, the driver 100 presses the upper button 32 or the lower button 34. As a result, the left indicator 26d continues to be lit regardless of the subsequent gaze direction X.
- the color of the indicator 26d is a color corresponding to the selected operation target device. For example, the door mirror 52 is blue, the rear light 54 is yellow, and the passenger seat side window 58 is red. Therefore, when the passenger seat side window 58 is selected, the indicator 26d is displayed in red.
- the vertical relationship between the door mirror 52 and the rear light 54 is reversed depending on where the reference position is placed for the passenger seat side window 58.
- the position of the driving unit (not shown) of the passenger seat side window 58 is used as a reference, but another place may be used as the reference position. Accordingly, the correspondence between the door mirror 52, the rear light 54, the passenger seat side window 58, and each button may be changed.
- the door mirror 52 is normally unfolded and retracted in a substantially horizontal direction
- the passenger seat side window 58 is opened and closed in a substantially vertical direction. It is easier to perform intuitive operations by assigning 36 and the right button 38 and assigning the upper button 32 and the lower button 34 to the passenger seat side window 58.
- the driver 100 operates the cross key 18 to open and close the passenger seat side window 58. That is, every time the lower button 34 is pressed, the passenger seat side window 58 is opened, and every time the upper button 32 is pressed, the passenger seat side window 58 is closed. At this time, the driver 100 does not have to look at the in-vehicle device 20 (here, the passenger seat side window 58), and can operate the operation target device (passenger seat side window 58) while looking forward.
- the indicator 26d corresponding to the passenger seat side window 58 continues to be lit in the color (red) corresponding to the passenger seat side window 58.
- the center button 30 is pushed down.
- the indicators 26a to 26e corresponding to the newly detected gaze direction X are lit in green (color indicating that the operation target device is not specified).
- FIG. 9 displays a list of selection methods and operation methods of each in-vehicle device 20, and FIG. 10 displays a button assignment list of each function.
- the driver 100 can easily operate the operation target device by performing the operations according to FIGS. 9 and 10.
- FIG. 11 is a flowchart for adjusting the boundary lines 28a to 28d between the indicators 26a to 26e and selecting or operating each in-vehicle device 20.
- step S ⁇ b> 1 the ECU 24 detects the gaze direction X of the driver 100 based on the face image of the driver 100 acquired by the occupant camera 14.
- step S2 the ECU 24 determines whether or not the boundary lines 28a to 28d of the indicators 26a to 26e are being adjusted. Specifically, the ECU 24 determines whether or not a flag FLG indicating whether or not the boundary lines 28a to 28d are being adjusted is 1. When the flag FLG is 0, it indicates that the boundary lines 28a to 28d are not being adjusted, and when it is 1, it indicates that the boundary lines 28a to 28d are being adjusted.
- step S3 the ECU 24 determines whether or not to start adjusting the boundary lines 28a to 28d. Specifically, the ECU 24 determines whether or not the center button 30 has been pressed for a predetermined time (for example, any time in the range of 2 to 5 seconds).
- a predetermined time for example, any time in the range of 2 to 5 seconds.
- step S2 when the boundary lines 28a to 28d are being adjusted (S2: YES), in step S5, the ECU 24 executes boundary line adjustment processing.
- the detection of the line-of-sight direction of the driver 100 can be performed using, for example, the method described in JP 2010-105417 A (see, for example, paragraphs [0014] to [0016]).
- the detection of the driver's face direction can be performed, for example, by the following method. That is, the ECU 24 (gaze direction detection function 70) detects the face center position and the left and right face edge positions based on the face image output from the occupant camera 14. Based on these detection results, for example, the face direction is calculated by approximating a human face to a cylinder shape (cylinder method).
- the face orientation is used in a broad sense, and may include not only the front side of the head but also other parts (for example, the back of the head).
- FIG. 12 is an explanatory diagram showing a state before and after adjustment of the boundary lines 28a to 28d.
- the positions of the indicators 26a to 26e can be adjusted by adjusting the boundary lines 28a to 28d.
- the areas A1 to A5 and the indicators 26a to 26e are associated with the positions of the areas A1 to A5 as they are.
- the actual gaze direction The gaze direction X can be detected along the X without any sense of incongruity.
- FIG. 13 is a flowchart of the boundary line adjustment start process (S4 in FIG. 11).
- FIG. 14 is a diagram illustrating an example of a state change of the display 22 when the boundary lines 28a to 28d are started before the start of adjustment.
- step S11 of FIG. 13 the ECU 24 sets 1 to the flag FLG. As described above, when the flag FLG is 1, it indicates that the boundary lines 28a to 28d are being adjusted.
- step S12 the ECU 24 changes the central indicator 26a to a color (for example, blue) different from the normal display color (for example, green) regardless of the gaze direction X of the driver 100 (see FIG. 12). 14).
- the ECU 24 lights the boundary lines 28a to 28d even when the in-vehicle device group (groups A to D) is not specified.
- step S13 the ECU 24 highlights the leftmost boundary line 28c in the traveling direction of the vehicle 10.
- the highlighted display for example, it is possible to change the color to a color (for example, yellow) different from the normal display color (for example, blue) and to light it.
- the width of the boundary line 28c may be thicker than usual.
- the brightness of the boundary line 28c can be made higher than normal.
- these emphasis methods can be used in combination.
- FIG. 15 is a flowchart of the boundary line adjustment process (S5 in FIG. 11).
- FIG. 16 is a diagram for explaining a method of adjusting the boundary lines 28a to 28d.
- FIG. 17 is a diagram illustrating an example of a state change of the display device 22 when the boundary lines 28a to 28d are being adjusted to the end of the adjustment.
- step S21 the ECU 24 determines whether the pressed button of the cross key 18 is the central button 30, the upper button 32, the lower button 34, the left button 36, or the right button 38.
- the ECU 24 selects the boundary lines 28a to 28d to be adjusted in step S22. That is, when the upper button 32 is depressed, the adjustment target boundary lines 28a to 28d are switched to the right (see FIG. 16). For example, if the upper button 32 is pressed when the boundary lines 28a to 28d to be adjusted are the leftmost boundary line 28c, the right boundary line 28d is selected.
- the boundary lines 28a to 28d to be adjusted are switched to the left. For example, if the down button 34 is pressed when the boundary lines 28a to 28d to be adjusted are the leftmost boundary line 28c, the boundary lines 28a to 28d do not exist on the left side, and therefore the rightmost boundary line 28b is selected. .
- step S23 the ECU 24 adjusts the positions of the boundary lines 28a to 28d to be adjusted. That is, when the left button 36 is pressed, the boundary lines 28a to 28d to be adjusted are shifted one unit to the left (see FIG. 16). When the right button 38 is depressed, the boundary lines 28a to 28d to be adjusted are shifted by one unit to the right. As shown in FIG. 16, each of the boundary lines 28a to 28d has an adjustable range. Therefore, the boundary lines 28a to 28d cannot be shifted so as to exceed the adjustable range.
- step S24 the ECU 24 turns on the indicators 26a to 26e corresponding to the gaze direction X by returning them to the normal display color (green), and in step S25, the ECU 24 Then, the highlighting of the boundary lines 28a to 28d to be adjusted ends (see FIG. 17).
- step S26 the ECU 24 sets 0 to the flag FLG. As described above, when the flag FLG is 0, it indicates that the boundary lines 28a to 28d are not adjusted.
- FIG. 18 is a flowchart of normal processing (S6 in FIG. 11).
- step S31 the ECU 24 determines whether or not the gaze direction X can be detected in step S1 of FIG.
- step S32 the ECU 24 turns on the indicators 26a to 26e corresponding to the gaze direction X.
- step S33 the ECU 24 turns off the indicators 26a to 26e.
- FIGS. 19A to 19C are first to third explanatory views for explaining the effects associated with turning on or off the indicators 26a to 26e.
- the driver 100 gaze direction X corresponds to the lit indicator 26a
- the driver 100 cannot detect the line-of-sight direction because he is wearing sunglasses 80, and the face direction cannot be detected because he is wearing the mask 82.
- the gaze direction X of the person 100 cannot be detected, none of the indicators 26a to 26e is lit. For this reason, the driver 100 can know that the gaze direction X cannot be detected. Therefore, the driver 100 can recognize the necessity to remove the sunglasses 80 or the mask 82.
- the driver 100 confirms that the in-vehicle device group is incorrectly selected according to the gaze direction X. I can know. In this case, the driver 100 recognizes that the above-described boundary lines 28a to 28d should be adjusted or that his / her gaze direction X should be corrected (in the case of FIG. 19C, the left side should be turned to the left). It becomes possible.
- step S34 the ECU 24 determines whether any button of the cross key 18 is pressed. If none of the buttons are pressed down (S34: NO), the current process ends. If any button is pressed (S34: YES), in step S35, the ECU 24 determines whether or not the operation target device is currently selected. When the operation target device is not selected (S35: NO), in step S36, the ECU 24 determines whether or not the gaze direction X can be detected in step S1 of FIG. When the gaze direction X can be detected (S36: YES), in step S37, the ECU 24 selects an operation target device according to the operation by the driver 100. If the gaze direction X cannot be detected (S36: NO), the current process is terminated.
- step S38 the ECU 24 sets the indicators 26a to 26e to be turned on and the color thereof according to the operation target device.
- step S39 the ECU 24 operates the operation target device in accordance with the operation by the driver 100.
- FIG. 20 is a flowchart (details of S37 in FIG. 18) in which the ECU 24 selects an operation target device.
- the ECU 24 checks whether the gaze direction X of the driver 100 specified in step S1 of FIG. 11 is the center, front, right, left, or other.
- step S112 the ECU 24 performs the in-vehicle device group in the central direction, that is, the group A including the navigation device 40, the audio device 42, and the air conditioner 44. And an operation target device is selected from group A.
- step S113 the ECU 24 specifies the front-mounted in-vehicle device group, that is, the group B including the HUD 46, the hazard lamp 48, and the seat 50, An operation target device is selected from group B.
- step S114 the ECU 24 performs the right direction in-vehicle device group, that is, the group C including the door mirror 52, the rear light 54, and the driver seat side window 56. And an operation target device is selected from group C.
- step S115 the ECU 24 performs the left-side vehicle-mounted device group, that is, the group D including the door mirror 52, the rear light 54, and the passenger seat side window 58. And an operation target device is selected from group D.
- the ECU 24 ends the current process without selecting any on-vehicle device 20.
- FIG. 21 is a flowchart (details of S112 in FIG. 20) for selecting the operation target device when the gaze direction X of the driver 100 is the central direction (region A1).
- the ECU 24 determines whether the pressed button of the cross key 18 is the center button 30, the upper button 32, the lower button 34, or the other.
- step S122 the ECU 24 selects the navigation device 40 and lights the central indicator 26a.
- step S123 the ECU 24 sets the navigation device 40 as an operation target device.
- step S124 the ECU 24 selects the audio device 42 and lights the center indicator 26a.
- step S125 the ECU 24 sets the audio device 42 as an operation target device.
- step S126 the ECU 24 selects the air conditioner 44 and lights the central indicator 26a.
- step S127 the ECU 24 sets the air conditioner 44 as an operation target device.
- the ECU 24 ends the current process.
- FIG. 22 is a flowchart (details of S113 in FIG. 20) for selecting the operation target device when the gaze direction X of the driver 100 is the front direction (region A2).
- the ECU 24 determines whether the pressed button of the cross key 18 is the center button 30, the upper button 32, the lower button 34, or the other.
- step S132 the ECU 24 selects the HUD 46 and lights the front indicator 26b.
- step S133 the ECU 24 turns on the HUD 46.
- step S134 the ECU 24 sets the HUD 46 as an operation target device.
- step S135 the ECU 24 selects the hazard lamp 48 and lights the front indicator 26b.
- step S136 the ECU 24 causes the hazard lamp 48 to blink.
- step S137 the ECU 24 sets the hazard lamp 48 as the operation target device.
- step S138 the ECU 24 selects the seat 50 and lights the front indicator 26b.
- step S139 the ECU 24 sets the seat 50 as an operation target device.
- the ECU 24 ends the current process.
- FIG. 23 is a flowchart (details of S114 in FIG. 20) for selecting the operation target device when the gaze direction X of the driver 100 is the right direction (region A3).
- the ECU 24 determines whether the pressed button of the cross key 18 is the central button 30, the upper button 32, the lower button 34, the left button 36, or the right button 38.
- step S142 the ECU 24 selects the driver's seat side window 56 and lights the right indicator 26c.
- step S143 the ECU 24 opens and closes the driver's seat side window 56. That is, when the lower button 34 is depressed, the driver's seat side window 56 is opened, and when the upper button 32 is depressed, the driver's seat side window 56 is closed.
- step S144 the ECU 24 sets the driver seat side window 56 as the operation target device.
- the ECU 24 When the pressed button is the left button 36, the ECU 24 confirms the state (deployed or stored) of the door mirror 52 in step S145. If the door mirror 52 is in the retracted state, the current process is terminated. If the door mirror 52 is in the unfolded state, in step S146, the ECU 24 selects both the left and right door mirrors 52 and lights the right indicator 26c.
- step S147 the ECU 24 stores the left and right door mirrors 52.
- step S148 the ECU 24 selects the left and right door mirrors 52 and turns off the right indicator 26c.
- the ECU 24 checks the state (deployed or stored) of the door mirror 52 in step S149. When the door mirror 52 is in the unfolded state, the current process is finished. If the door mirror 52 is in the retracted state, in step S150, the ECU 24 selects both the left and right door mirrors 52 and lights the right indicator 26c.
- step S151 the ECU 24 unfolds the left and right door mirrors 52.
- step S152 the ECU 24 selects the left and right door mirrors 52 and turns off the right indicator 26c.
- step S153 the ECU 24 selects the rear light 54 and lights the right indicator 26c.
- step S154 the ECU 24 turns on the rear light 54.
- step S155 the rear light 54 is set as an operation target device.
- FIG. 24 is a flowchart (details of S115 in FIG. 20) for selecting the operation target device when the gaze direction X of the driver 100 is the left direction (region A4).
- step S161 the ECU 24 determines whether the pressed button of the cross key 18 is the upper button 32, the center button 30, the lower button 34, the right button 38, or the left button 36.
- step S162 the ECU 24 selects the passenger seat side window 58 and lights the left indicator 26d.
- step S163 the ECU 24 opens and closes the passenger seat side window 58. That is, when the lower button 34 is depressed, the passenger seat side window 58 is opened, and when the upper button 32 is depressed, the passenger seat side window 58 is closed.
- step S164 the ECU 24 sets the passenger seat side window 58 as the operation target device.
- the ECU 24 confirms the state (deployed or stored) of the door mirror 52 in step S165.
- the current process is finished. If the door mirror 52 is in the retracted state, in step S166, the ECU 24 selects both the left and right door mirrors 52 and lights the left indicator 26d.
- step S167 the ECU 24 unfolds the left and right door mirrors 52.
- step S168 the ECU 24 selects the left and right door mirrors 52 and turns off the left indicator 26d.
- the ECU 24 confirms the state (deployed or stored) of the door mirror 52 in step S169. If the door mirror 52 is in the retracted state, the current process is terminated. When the door mirror 52 is in the unfolded state, in step S170, the ECU 24 selects the left and right door mirrors 52 and lights the left indicator 26d.
- step S171 the ECU 24 stores the left and right door mirrors 52.
- step S172 the ECU 24 selects the left and right door mirrors 52 and turns off the left indicator 26d.
- step S173 the ECU 24 selects the rear light 54 and lights the left indicator 26d.
- step S174 the ECU 24 turns on the rear light 54.
- step S175 the rear light 54 is set as the operation target device.
- FIG. 25 is a flowchart (details of S39 in FIG. 18) in which the ECU 24 operates the operation target device.
- the ECU 24 confirms the operation target device being selected in step S37 of FIG.
- the operation target device being selected is the navigation device 40
- the ECU 24 operates the navigation device 40 in step S182.
- the operation target device being selected is the audio device 42
- the ECU 24 operates the audio device 42 in step S183.
- the selected operation target device is the air conditioner 44
- the ECU 24 operates the air conditioner 44 in step S184.
- the ECU 24 When the operation target device being selected is the HUD 46, the ECU 24 operates the HUD 46 in step S185. If the operation target device being selected is the hazard lamp 48, the ECU 24 operates the hazard lamp 48 in step S186. If the operation target device being selected is the seat 50, the ECU 24 operates the seat 50 in step S187. If the selected operation target device is the rear light 54, the ECU 24 operates the rear light 54 in step S188. If the selected operation target device is the driver's seat side window 56, the ECU 24 operates the driver's seat side window 56 in step S189. When the operation target device being selected is the passenger seat side window 58, the ECU 24 operates the passenger seat side window 58 in step S190.
- FIG. 26 is a flowchart (details of S182 in FIG. 25) for operating the navigation device 40.
- the ECU 24 determines whether the pressed button of the cross key 18 is the center button 30, the upper button 32, the lower button 34, the left button 36, or the right button 38.
- the ECU 24 changes the scale of display of the navigation device 40 in step S202. That is, the scale is enlarged when the upper button 32 is pressed down, and the scale is reduced when the lower button 34 is pressed down.
- the ECU 24 switches the display direction of the navigation device 40 in step S203. That is, when the left button 36 is pressed down, the display direction is northward, and when the right button 38 is pressed down, the display direction is the traveling direction of the vehicle 10.
- step S204 If the pressed button is the central button 30, the ECU 24 turns off the central indicator 26a in step S204. In subsequent step S205, the ECU 24 finishes selecting the operation target device.
- FIG. 27 is a flowchart (details of S183 in FIG. 25) for operating the audio device.
- the ECU 24 determines whether the pressed button of the cross key 18 is the center button 30, the upper button 32, the lower button 34, the left button 36, or the right button 38.
- the ECU 24 adjusts the volume of the audio device 42 in step S212. That is, the volume is increased when the upper button 32 is depressed, and the volume is decreased when the lower button 34 is depressed.
- the ECU 24 switches the music selection or channel selection of the audio device 42 in step S213. That is, when the left button 36 is pressed down, it switches to the previous music or the previous broadcasting station, and when the right button 38 is pressed down, it switches to the next music or the next broadcasting station.
- step S214 If the pressed button is the central button 30, the ECU 24 turns off the central indicator 26a in step S214. In subsequent step S215, the ECU 24 finishes selecting the operation target device.
- FIG. 28 is a flowchart (details of S184 in FIG. 25) for operating the air conditioner 44.
- the ECU 24 determines whether the pressed button of the cross key 18 is the center button 30, the upper button 32, the lower button 34, the left button 36, or the right button 38.
- the ECU 24 adjusts the set temperature of the air conditioner 44 in step S222. That is, when the upper button 32 is depressed, the set temperature is increased, and when the lower button 34 is depressed, the set temperature is decreased.
- the ECU 24 adjusts the set air volume of the air conditioner 44 in step S223. That is, when the left button 36 is pressed down, the set air volume is decreased, and when the right button 38 is pressed down, the set air volume is increased.
- step S224 the ECU 24 turns off the central indicator 26a in step S224.
- step S225 the ECU 24 ends the selection of the operation target device.
- FIG. 29 is a flowchart (details of S185 in FIG. 25) for operating the HUD 46.
- the ECU 24 determines whether the pressed button of the cross key 18 is the center button 30, the upper button 32, the lower button 34, or the other.
- the ECU 24 switches display information of the HUD 46 in step S232.
- the display information is switched as follows: vehicle speed 110 ⁇ travel distance 112 ⁇ fuel consumption 114 ⁇ vehicle speed 110 ⁇ travel distance 112 (see FIG. 7C).
- the display information is switched as follows: vehicle speed 110 ⁇ fuel efficiency 114 ⁇ travel distance 112 ⁇ vehicle speed 110 ⁇ fuel efficiency 114.
- step S233 the ECU 24 turns off the front indicator 26b.
- step S234 ECU 24 turns off HUD 46.
- step S235 the ECU 24 finishes selecting the operation target device.
- the current process ends.
- FIG. 30 is a flowchart (detail of S186 in FIG. 25) for operating the hazard lamp 48.
- step S241 the ECU 24 determines whether the pressed button of the cross key 18 is the center button 30 or another button.
- step S242 If the pressed button is the center button 30, the ECU 24 turns off the hazard lamp 48 in step S242. In subsequent step S243, the ECU 24 turns off the front indicator 26b. In step S244, the ECU 24 finishes selecting the operation target device.
- the current process is terminated.
- FIG. 31 is a flowchart (details of S187 in FIG. 25) for operating the seat 50 for the driver 100.
- the ECU 24 determines whether the pressed button of the cross key 18 is the center button 30, the upper button 32, the lower button 34, the left button 36, or the right button 38.
- the ECU 24 When the pressed button is the upper button 32 or the lower button 34, the ECU 24 performs the front / rear slide adjustment of the seat 50 in step S252. That is, when the upper button 32 is pressed down, the seat 50 is advanced, and when the lower button 34 is pressed down, the seat 50 is moved backward.
- the ECU 24 adjusts the reclining angle of the seat 50 in step S253. That is, when the left button 36 is pressed down, the reclining angle is decreased, and when the right button 38 is pressed down, the reclining angle is increased.
- step S254 the ECU 24 turns off the front indicator 26b.
- step S255 the ECU 24 ends the selection of the operation target device.
- FIG. 32 is a flowchart (details of S188 in FIG. 25) for operating the rear light 54.
- step S261 the ECU 24 determines whether the pressed button of the cross key 18 is the center button 30 or another button.
- the ECU 24 turns off the rear light 54 in step S262. In subsequent step S263, the ECU 24 turns off the lighted right or left indicators 26c, 26d. In subsequent step S264, the ECU 24 ends the selection of the operation target device.
- the current process is terminated.
- FIG. 33 is a flowchart (details of S189 in FIG. 25) for operating the driver's seat side window 56.
- the ECU 24 determines whether the pressed button of the cross key 18 is the center button 30, the upper button 32, the lower button 34, or other buttons.
- the ECU 24 opens and closes the driver seat side window 56 in step S272. That is, when the lower button 34 is depressed, the driver's seat side window 56 is opened, and when the upper button 32 is depressed, the driver's seat side window 56 is closed.
- step S273 the ECU 24 turns off the right indicator 26c.
- step S274 the ECU 24 finishes selecting the operation target device.
- the current process ends.
- FIG. 34 is a flowchart (details of S190 in FIG. 25) for operating the passenger seat side window 58.
- the ECU 24 determines whether the pressed button of the cross key 18 is the center button 30, the upper button 32, the lower button 34, or other buttons.
- the ECU 24 opens and closes the passenger seat side window 58 in step S282. That is, when the lower button 34 is depressed, the passenger seat side window 58 is opened, and when the upper button 32 is depressed, the passenger seat side window 58 is closed.
- step S283 If the pressed button is the center button 30, the ECU 24 turns off the left indicator 26d in step S283. In subsequent step S284, the ECU 24 finishes selecting the operation target device.
- the current process ends.
- the in-vehicle device group (groups A to D) in the vehicle width direction is specified based on the gaze direction X of the driver 100 (occupant) and specified.
- One of the in-vehicle devices 20 in the in-vehicle device group is identified by operating the cross key 18. Therefore, the driver does not need to pay attention to any one of the in-vehicle devices 20 to be specified, and puts his / her line of sight or face in the direction (vehicle width direction) of the in-vehicle device group in which any of the in-vehicle devices 20 to be specified exists. Just turn to get better.
- the operation time can be shortened, and the operation target device can be reliably selected. For this reason, convenience can be improved.
- the cross key 18 is an operation for performing a specific operation input to the operation target device in a state where the operation target device is specified by detecting the gaze direction X of the driver 100 and operating the cross key 18. Also serves as an input means. Accordingly, it is possible to reduce the space and cost of the operation means by sharing the vertical direction selection means (for example, device selection switch) and the operation input means (for example, device operation switch). In addition, the blind operation can be facilitated.
- the vertical direction selection means for example, device selection switch
- the operation input means for example, device operation switch
- the ECU 24 detects the face direction angle of the driver 100 in the vehicle width direction based on the image acquired by the passenger camera 14, and detects the gaze direction X of the driver 100 based on the face direction angle.
- the face direction angle in the vehicle width direction can be obtained from the image processing, and therefore high-precision image processing and a device such as an infrared LED for performing line-of-sight detection using the bright spot detection of the pupil or the like become unnecessary. Further cost reduction can be achieved.
- selection of individual in-vehicle devices 20 in the specified in-vehicle device group is performed by the cross key 18 provided on the steering wheel 16, and the in-vehicle device 20 in each in-vehicle device group.
- the up / down direction for selecting is assigned in correspondence with the up / down direction of the cross key 18 (up button 32, down button 34, and center button 30).
- indicators 26a to 26d for displaying the in-vehicle device groups (groups A to D) specified in accordance with the gaze direction X of the driver 100 are provided for each in-vehicle device group (groups A to D). Yes. Thereby, it is lower than the case where the indicator 26 is provided so as to correspond to all the in-vehicle devices 20 while ensuring the accuracy of specifying the in-vehicle devices group (preventing a deviation between the state of the vehicle 10 and the recognition of the driver 100). Cost can be reduced.
- the information specified based on the gaze direction X of the driver 100 among the plurality of in-vehicle device groups (groups A to D) in the vehicle width direction is notified using the indicators 26a to 26e.
- At least the indicators 26a, 26b, and 26e have a width equivalent to the widths of the regions A1, A2, and A5 corresponding to the respective in-vehicle device groups (groups A and B) in the vehicle width direction, and are arranged on the instrument panel 59 in the vehicle width direction. Are arranged side by side. Accordingly, the driver 100 can visually recognize the boundaries and widths of the regions A1 to A5 and can recognize the switching of the specified in-vehicle device group, with minimal changes in the line of sight or face orientation. It is possible to reliably identify the in-vehicle device 20 in the vehicle width direction.
- the driver 100 can recognize the shift and adjust the gaze direction X as appropriate.
- the driver's 100 line-of-sight direction or face direction is used only for identifying the in-vehicle device group (groups A to D) in the vehicle width direction, the line-of-sight direction or face direction is detected only in the vehicle width direction. Get better. Thereby, detection of the gaze direction or the face direction in a direction other than the vehicle width direction (for example, the vertical direction) can be made unnecessary, and the detection process of the gaze direction or the face direction can be reduced.
- the boundary lines 28a to 28d of the areas A1 to A5 are displayed even if the in-vehicle device group (groups A to D) is not specified by the ECU 24 (in-vehicle device group specifying function 72).
- the device 22 notifies.
- the driver 100 can surely understand the boundary lines 28a to 28d, and it is possible to understand to which width region the line of sight or face direction can be changed to select a specific in-vehicle device group.
- the operating device 12 includes a cross key 18 that can be operated by the driver 100 in a place different from the in-vehicle device 20, and the ECU 24 (individual in-vehicle device specifying function 74) is in the detected gaze direction X.
- the in-vehicle device group (groups A to D) is specified based on one of the specified in-vehicle device groups.
- the display color of the indicators 26a to 26e is changed by the in-vehicle device 20 specified by the individual in-vehicle device specifying function 74. Accordingly, the driver 100 can immediately understand which in-vehicle device 20 is selected in one in-vehicle device group.
- the widths of the indicators 26a to 26e can be adjusted. Thereby, even if the gaze direction X detected by the gaze direction detection function 70 and the actual gaze direction X have shifted
- the plurality of indicators 26a to 26e that visually notify the areas A1 to A5 corresponding to the detected gaze direction X or the specified in-vehicle device group (groups A to D) are provided.
- the indicators 26a to 26e are continuously provided along the vehicle width direction for each of the areas A1 to A5 around the lower portion of the front window 11, and indicate the boundaries between the adjacent areas A1 to A5. Therefore, the driver 100 can visually recognize the boundaries and widths of the areas A1 to A5 and can recognize the switching of the selected areas A1 to A5, and can minimize the change in the line of sight or the face direction. Thus, it is possible to reliably identify the in-vehicle device 20 in the vehicle width direction.
- a plurality of indicators 26a that visually indicate the detected gaze direction X.
- the presence of .about.26e makes it possible for the driver 100 to recognize the shift and adjust the gaze direction X as appropriate.
- the operating device 12 was mounted in the vehicle 10, you may mount not only in this but in another object.
- the operation device 12 can be used for a moving body such as a ship or an aircraft.
- the device is not limited to a moving body, and may be another device as long as it is necessary to specify the gaze direction of the subject.
- Gaze direction detection The occupant as the detection target of the gaze direction X is not limited to the driver 100 but may be other occupants (occupants sitting in the passenger seat, occupants sitting in the rear seat, etc.).
- the periphery of the front window 11 is divided into five areas A1 to A5 (FIG. 5), but the number of areas is not limited to this.
- the periphery of the front window 11 can be divided into three areas A11 to A13.
- the vehicle width direction of the vehicle 10 is specified based on the gaze direction X, and the height direction of the vehicle 10 is specified by operating the cross key 18, but the gaze direction is determined using the indicators 26a to 26e.
- the present invention is not limited to this.
- the height direction of the vehicle 10 can be specified based on the gaze direction X (at least one of the face direction and the line-of-sight direction).
- only one in-vehicle device 20 included in the height direction can be set, and the in-vehicle device 20 can be specified as the vehicle width direction is specified.
- the indicators 26a to 26e can be arranged in the vertical direction, and the gaze direction X in the vertical direction can be notified by the indicators 26a to 26e.
- the operation target device is specified using the flowcharts of FIGS. 11, 18, and 20 to 24, but the in-vehicle device group (groups A to D) in the vehicle width direction of the vehicle 10 is specified, From the viewpoint of specifying the operation target device in the height direction of the vehicle 10, the method for specifying the operation target device is not limited to this.
- the method for specifying the operation target device is not limited to this.
- the indicators 26a to 26d are turned on in correspondence with the selected operation target device. However, the indicators 26a to 26d may not be turned on.
- the cross key 18 is used as means (operating means) operated by the driver 100 (occupant) in order to specify the operation target device.
- the cross key 18 of the above embodiment has the center button 30, the upper button 32, the lower button 34, the left button 36 and the right button 38, but the configuration of only the upper button 32 and the lower button 34 or the center button 30, only the upper button 32 and the lower button 34 may be used.
- each button may be connected (for example, a cross button as shown in FIG. 4 of JP 2010-105417 A).
- Each button of the cross key 18 of the above embodiment is a so-called push-type switch (see FIG. 3), but may be other types of switches such as a slide switch and a lever switch.
- the cross key 18 is a means (operation means) for specifying the operation target device in the in-vehicle device group (groups A to D) and a means (operation input means) for operating the specified operation target device.
- operation means for specifying the operation target device in the in-vehicle device group (groups A to D)
- operation input means for operating the specified operation target device.
- the cross key 18 is provided on the steering wheel 16, but the position where the cross key 18 is provided is not limited thereto. For example, it can be provided at any position of the steering column or the instrument panel.
- In-vehicle device 20 and in-vehicle device group In the above embodiment, as the plurality of in-vehicle devices 20, the navigation device 40, the audio device 42, the air conditioner 44, the HUD 46, the hazard lamp 48, the seat 50, the door mirror 52, the rear light 54, the driver side window 56, and the passenger seat side.
- the window 58 is mentioned, from the viewpoint of selection of the in-vehicle device 20, a plurality of in-vehicle device groups (groups) in which a plurality of in-vehicle devices that can be operated by the occupant of the vehicle 10 are arranged in the vertical direction are arranged in the vehicle width direction. If it is done, it is not limited to this.
- a plurality of in-vehicle device groups are not necessarily present in the vehicle width direction, and the present invention can be applied to a configuration in which at least one in-vehicle device group is arranged in a specific region in the vehicle width direction. It is. In other words, the present invention is applicable if the specification of the in-vehicle device group in the vehicle width direction is specified based on the gazing direction of the occupant, and the in-vehicle device 20 in the specified in-vehicle device group is specified in the operation means. Since it is possible, what is necessary is just one or more in-vehicle equipment groups including a plurality of in-vehicle equipment 20. Furthermore, a configuration in which one in-vehicle device group is provided in the vehicle width direction and a single in-vehicle device 20 is separately arranged in the vehicle width direction is also possible.
- the present invention is not limited to this as long as a plurality of in-vehicle devices that can be operated by the passenger of the vehicle 10 are arranged in the vehicle width direction. .
- the number of in-vehicle devices arranged in each of the areas A1 to A5 may be one.
- Gaze direction indicator 22 (indicators 26a to 26e)
- the indicator 22 is provided on the instrument panel 59 around the lower part of the front window 11.
- the indicator 22 is provided at or around the lower part or the upper part of the front window 11, Not limited to this.
- the display 22 can be provided on the upper portion of the front window 11. If the area of the HUD 46 is further expanded, the display 22 (indicators 26a to 26e) can be configured as a part of the HUD 46.
- the indicators 26a to 26e are continuously lit in the vehicle width direction.
- the indicators 26a to 26e are intermittent (part of them). May be provided (without lighting).
- the operation target device when the operation target device is not selected, only the indicators 26a to 26e corresponding to the gaze direction X are turned on and the other indicators 26a to 26e are turned off.
- the indicators 26a to 26e may be turned on, and only the indicators 26a to 26e corresponding to the gaze direction X may be displayed in different colors.
- the indicators 26a to 26e are provided corresponding to all of the regions A1 to A5.
- two or more indicators 26a to 26e may be provided. For example, it is not limited to this.
- the color of the indicators 26a to 26e is changed as a method for notifying the selection of the in-vehicle device 20 by the indicators 26a to 26e.
- the present invention is not limited to this.
- the selection of the in-vehicle device 20 may be notified.
- the selection of the in-vehicle device 20 can be notified by voice output from the navigation device 40.
- a combination of these may be used.
- the indicators 26a to 26e are displayed without interruption.
- the indicators 26a to 26e may be displayed only when a predetermined operation or setting for starting selection of the operation target device is performed. it can. Further, a part such as a button for performing the predetermined operation or setting may be provided.
- the gaze direction indicator 22 having the indicators 26a to 26e is used.
- other indicators or lighting units may be provided.
- four pilot lamps 126a to 126d can be provided corresponding to the regions A1 to A4. That is, a pilot lamp 126a provided in the center, a pilot lamp 126b provided in the front, a pilot lamp 126c provided on the right side, and a pilot lamp 126d provided on the left side are provided, and these pilot lamps 126a ⁇ 126d corresponds to a plurality of in-vehicle device groups A to D (groups A to D).
- the pilot lamps 126a to 126d may be used to notify the detected gaze direction X (or the corresponding area A1 to A4) and the operation state of the cross key 18 in the same manner as the indicators 26a to 26e.
- a configuration in which the indicators 26a to 26d and the pilot lamps 126a to 126d are not provided in order to reduce costs and troublesomeness, or an in-vehicle device that is currently operable can be instantaneously selected. It is also possible to provide a configuration in which the indicators 26a to 26d or the pilot lamps 126a to 126d are provided for each in-vehicle device 20 so that the in-vehicle devices 20 can be grasped.
Landscapes
- Engineering & Computer Science (AREA)
- Mechanical Engineering (AREA)
- Chemical & Material Sciences (AREA)
- Combustion & Propulsion (AREA)
- Transportation (AREA)
- Multimedia (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Description
[1-1.全体構成]
図1は、この発明の一実施形態に係る車載機器操作装置12(以下「操作装置12」ともいう。)を搭載した車両10の全体ブロック図である。図2は、車両10のフロントウィンドウ11周辺の外観図である。図1及び図2に示すように、操作装置12は、乗員カメラ14と、ステアリングホイール16に設けられた十字キー18と、複数の車載機器20と、注視方向表示器22(以下「表示器22」ともいう。)と、電子制御装置24(以下「ECU24」という。)とを有する。図2からもわかるように、本実施形態の車両10は、いわゆる右ハンドル車である。代わりに、左ハンドル車であっても同様の構成を採用することができる。
図2に示すように、乗員カメラ14は、図示しないステアリングコラムにおいて運転者の正面に設置され、運転者の顔の画像(以下「顔画像」という。)を取得する。乗員カメラ14の位置は、これに限らず、例えば、バックミラー25(図2)の周辺に配置してもよい。また、乗員カメラ14は、単一の方向から撮像するものに限らず、複数の方向から撮像するもの(いわゆるステレオカメラ)であってもよい。
運転者は、十字キー18を用いて操作対象となる車載機器20(以下「操作対象機器」という。)の特定及び特定した車載機器20の操作入力を行うことができる。図3に示すように、十字キー18は、中央ボタン30、上ボタン32、下ボタン34、左ボタン36及び右ボタン38を有する。なお、図2における十字キー18は、拡大して表示されている。十字キー18の操作方法については、後述する。
本実施形態において、複数の車載機器20(図1)には、ナビゲーション装置40と、オーディオ装置42と、エアコンディショナ44と、ヘッドアップディスプレイ46(以下「HUD46」という。)と、ハザードランプ48と、運転者用のシート50と、ドアミラー52と、後方ライト54と、運転席側ウィンドウ56と、助手席側ウィンドウ58とが含まれる。
図2に示すように、表示器22は、フロントウィンドウ11の下部周辺においてインストルメントパネル59に設けられている。後述するように、表示器22は、別の位置に設けることもできる。また、表示器22は、車幅方向における運転者(乗員)の注視方向を示す複数の注視方向インジケータ26a~26e(以下「インジケータ26a~26e」といい、「インジケータ26」と総称する。)を有する。各インジケータ26a~26eは、例えば、発光ダイオード(LED)等の照明装置から構成される。或いは、HUD46を表示器22に対応する位置にも設けることで、HUD46により各インジケータ26a~26eを構成することもできる。さらに、各インジケータ26a~26eは、複数の色(例えば、青、緑、黄及び赤)を表示可能であるが、単色のみの表示であってもよい。
ECU24は、車載機器操作装置12(本実施形態では、特に、各車載機器20)を制御するものであり、図1に示すように、入出力装置60、演算装置62及び記憶装置64を備える。演算装置62は、注視方向検出機能70と、車載機器群特定機能72と、個別車載機器特定機能74と、車載機器制御機能76とを備える。
上記のように、本実施形態では、運転者は、操作対象機器が存在する車幅方向に視線又は顔を向けると共に、十字キー18を操作することにより、操作対象機器を制御することが可能である。
[3-1.オーディオ装置42の音量を変える場合]
図6A~図6Cは、オーディオ装置42の音量を変える場合の運転者100の第1~第3動作例を示す。まず、図6Aに示すように、運転者100は、5つの領域A1~A5のうち、オーディオ装置42のある領域A1(中央方向)を見る又は顔を向ける。これにより、ECU24は、後述する注視方向判定技術を用いて車載機器群(グループA)を特定する。なお、図6A中の矢印Xは、運転者100の注視方向を示している(その他の図においても同様である。)。また、ECU24は、判定した注視方向X{又は特定した車載機器群(グループA)}に対応するインジケータ26aを点灯させる。この段階では、注視方向Xが変化すると点灯するインジケータ26a~26eも切り替わり、インジケータ26a~26eは操作対象機器が特定されていないことを示す色(例えば、緑色)で点灯する。
図7A~図7Cは、HUD46を表示し、車速や燃費を確認する場合の運転者100の第1~第3動作例を示す。まず、図7Aに示すように、運転者100は、5つの領域A1~A5のうち、HUD46のある領域A2(正面方向)を見る又は顔を向ける。これにより、ECU24は、注視方向判定技術を用いて車載機器群B(グループB)を特定する。また、ECU24は、判定した注視方向X{又は特定した車載機器群(グループB)}に対応するインジケータ26bを緑色(操作対象機器が特定されていないことを示す色)で点灯させる。
図8A~図8Cは、助手席側ウィンドウ58を開閉する場合の運転者100の第1~第3動作例を示す。まず、図8Aに示すように、運転者100は、5つの領域A1~A5のうち、助手席側ウィンドウ58のある領域A4(左方向)を見る又は顔を向ける。これにより、注視方向判定技術を用いて車載機器群D(グループD)を特定する。また、ECU24は、判定した注視方向X{又は特定した車載機器群(グループD)}に対応するインジケータ26dを緑色(操作対象機器が特定されていないことを示す色)で点灯させる。
図9は、各車載機器20の選択方法と操作方法の一覧を表示し、図10は、各機能のボタン割当一覧を表示する。運転者100は、図9及び図10に沿った操作をすることにより、操作対象機器を簡易に操作することができる。
[5-1.全体フロー]
図11は、各インジケータ26a~26e間の境界線28a~28dを調整すると共に、各車載機器20を選択又は操作するフローチャートである。ステップS1において、ECU24は、乗員カメラ14が取得した運転者100の顔画像に基づいて運転者100の注視方向Xを検出する。
運転者100の視線方向の検知は、例えば、JP 2010-105417 Aに記載の方法を用いて行うことができる(例えば、段落[0014]~[0016]参照)。
(5-3-1.概要)
図12は、境界線28a~28dの調整前後の様子を示す説明図である。図12に示すように、本実施形態では、境界線28a~28dを調整することにより、インジケータ26a~26eの位置を調整することが可能である。この際、境界線28a~28dの調整を行っても、各領域A1~A5の位置はそのままの状態で各領域A1~A5と各インジケータ26a~26eとが対応付けられる。従って、境界線28a~28dの調整により、操作装置12が検出した注視方向Xと、運転者100が意図する注視方向Xとの間にずれが生じている場合であっても、実際の注視方向Xに沿った違和感のない注視方向Xの検出が可能となる。
図13は、境界線調整開始処理(図11のS4)のフローチャートである。図14は、境界線28a~28dの調整の開始前から開始に至る際の表示器22の状態変化の一例を示す図である。
図15は、境界線調整処理(図11のS5)のフローチャートである。図16は、境界線28a~28dの調整方法を説明する図である。図17は、境界線28a~28dの調整中から調整終了時に致る際の表示器22の状態変化の一例を示す図である。
図18は、通常処理(図11のS6)のフローチャートである。ステップS31において、ECU24は、図11のステップS1において、注視方向Xを検出できているか否かを判定する。注視方向Xを検出できている場合(S31:YES)、ステップS32において、ECU24は、注視方向Xに対応するインジケータ26a~26eを点灯させる。注視方向Xを検出できていない場合(S31:NO)、ステップS33において、ECU24は、各インジケータ26a~26eを消灯させる。
(5-5-1.概要)
図20は、ECU24が操作対象機器を選択するフローチャート(図18のS37の詳細)である。ステップS111において、ECU24は、図11のステップS1で特定した運転者100の注視方向Xが、中央、正面、右、左又はその他のいずれであるかを確認する。
図21は、運転者100の注視方向Xが中央方向(領域A1)である場合に操作対象機器を選択するフローチャート(図20のS112の詳細)である。ステップS121において、ECU24は、十字キー18のうち押し下げられたボタンが中央ボタン30、上ボタン32、下ボタン34又はその他のいずれであるかを判定する。
図22は、運転者100の注視方向Xが正面方向(領域A2)である場合に操作対象機器を選択するフローチャート(図20のS113の詳細)である。ステップS131において、ECU24は、十字キー18のうち押し下げられたボタンが中央ボタン30、上ボタン32、下ボタン34又はその他のいずれであるかを判定する。
図23は、運転者100の注視方向Xが右方向(領域A3)である場合に操作対象機器を選択するフローチャート(図20のS114の詳細)である。ステップS141において、ECU24は、十字キー18のうち押し下げられたボタンが中央ボタン30、上ボタン32、下ボタン34、左ボタン36又は右ボタン38のいずれであるかを判定する。
図24は、運転者100の注視方向Xが左方向(領域A4)である場合に操作対象機器を選択するフローチャート(図20のS115の詳細)である。ステップS161において、ECU24は、十字キー18のうち押し下げられたボタンが上ボタン32、中央ボタン30、下ボタン34、右ボタン38又は左ボタン36のいずれであるかを判定する。
(5-6-1.概要)
図25は、ECU24が操作対象機器を操作するフローチャート(図18のS39の詳細)である。ステップS181において、ECU24は、図18のステップS37により選択中の操作対象機器を確認する。選択中の操作対象機器がナビゲーション装置40である場合、ステップS182において、ECU24は、ナビゲーション装置40の操作を行う。選択中の操作対象機器がオーディオ装置42である場合、ステップS183において、ECU24は、オーディオ装置42の操作を行う。選択中の操作対象機器がエアコンディショナ44である場合、ステップS184において、ECU24は、エアコンディショナ44の操作を行う。
図26は、ナビゲーション装置40の操作を行うフローチャート(図25のS182の詳細)である。ステップS201において、ECU24は、十字キー18のうち押し下げられたボタンが中央ボタン30、上ボタン32、下ボタン34、左ボタン36又は右ボタン38のいずれであるかを判定する。
図27は、オーディオ装置42の操作を行うフローチャート(図25のS183の詳細)である。ステップS211において、ECU24は、十字キー18のうち押し下げられたボタンが中央ボタン30、上ボタン32、下ボタン34、左ボタン36又は右ボタン38のいずれであるかを判定する。
図28は、エアコンディショナ44の操作を行うフローチャート(図25のS184の詳細)である。ステップS221において、ECU24は、十字キー18のうち押し下げられたボタンが中央ボタン30、上ボタン32、下ボタン34、左ボタン36又は右ボタン38のいずれであるかを判定する。
図29は、HUD46の操作を行うフローチャート(図25のS185の詳細)である。ステップS231において、ECU24は、十字キー18のうち押し下げられたボタンが中央ボタン30、上ボタン32、下ボタン34又はその他のいずれであるかを判定する。
図30は、ハザードランプ48の操作を行うフローチャート(図25のS186の詳細)である。ステップS241において、ECU24は、十字キー18のうち押し下げられたボタンが中央ボタン30又はその他のボタンのいずれであるかを判定する。
図31は、運転者100用のシート50の操作を行うフローチャート(図25のS187の詳細)である。ステップS251において、ECU24は、十字キー18のうち押し下げられたボタンが中央ボタン30、上ボタン32、下ボタン34、左ボタン36又は右ボタン38のいずれであるかを判定する。
図32は、後方ライト54の操作を行うフローチャート(図25のS188の詳細)ある。ステップS261において、ECU24は、十字キー18のうち押し下げられたボタンが中央ボタン30又はその他のボタンのいずれであるかを判定する。
図33は、運転席側ウィンドウ56の操作を行うフローチャート(図25のS189の詳細)である。ステップS271において、ECU24は、十字キー18のうち押し下げられたボタンが中央ボタン30、上ボタン32、下ボタン34又はその他のボタンのいずれであるかを判定する。
図34は、助手席側ウィンドウ58の操作を行うフローチャート(図25のS190の詳細)である。ステップS281において、ECU24は、十字キー18のうち押し下げられたボタンが中央ボタン30、上ボタン32、下ボタン34又はその他のボタンのいずれであるかを判定する。
以上説明したように、本実施形態によれば、運転者100(乗員)の注視方向Xに基づいて車幅方向の車載機器群(グループA~D)を特定すると共に、特定した車載機器群のうちいずれかの車載機器20を十字キー18の操作により特定する。従って、運転者は、特定すべきいずれかの車載機器20そのものを注視する必要は無く、特定すべきいずれかの車載機器20が存在する車載機器群の方向(車幅方向)に視線又は顔を向けるだけでよくなる。このため、車両10の前方への注意を阻害する要因を低減することが可能になると共に、操作対象機器の誤判定を防止することが可能となる。また、各車載機器20に対する注視判定が不要となるため、高精度な視線/顔向き検知技術を必要としなくなる。従って、操作装置12全体での高コスト化を防止することが可能となる。
なお、この発明は、上記実施形態に限らず、この明細書の記載内容に基づき、種々の構成を採り得ることはもちろんである。例えば、以下の構成を採用することができる。
上記実施形態では、操作装置12を車両10に搭載したが、これに限らず、別の対象に搭載してもよい。例えば、操作装置12を船舶や航空機等の移動体に用いることもできる。また、移動体に限らず、対象者の注視方向を特定することを要する装置であれば、その他の装置であってもよい。
注視方向Xの検出対象としての乗員は、運転者100に限らず、その他の乗員(助手席に座っている乗員、後部座席に座っている乗員等)であってもよい。
上記実施形態では、車両10の車幅方向の特定を注視方向Xに基づいて行い、車両10の高さ方向の特定を十字キー18の操作により行ったが、インジケータ26a~26eを用いて注視方向Xを報知する観点からすれば、これに限らない。例えば、車両10の高さ方向の特定を注視方向X(顔向き及び視線方向の少なくとも一方)に基づいて行うこともできる。或いは、高さ方向に含まれる車載機器20を1つのみ設定し、車幅方向の特定に伴って車載機器20を特定するようにすることもできる。或いは、インジケータ26a~26eを上下方向に配置し、上下方向における注視方向Xをインジケータ26a~26eにより報知することも可能である。
上記実施形態では、操作対象機器を特定するために運転者100(乗員)が操作する手段(操作手段)として、十字キー18を用いたが、車載機器群(グループA~D)において上下方向に配置されている車載機器20を特定又は選択する観点からすれば、これに限らない。例えば、上記実施形態の十字キー18は、中央ボタン30、上ボタン32、下ボタン34、左ボタン36及び右ボタン38を有していたが、上ボタン32及び下ボタン34のみの構成又は中央ボタン30、上ボタン32及び下ボタン34のみの構成であってもよい。或いは、各ボタンが連結されている構成(例えば、JP 2010-105417 Aの図4に示されるような十字ボタン)であってもよい。また、上記実施形態の十字キー18の各ボタンは、いわゆるプッシュ式スイッチの類であったが(図3参照)、スライドスイッチ、レバースイッチ等その他の種類のスイッチであってもよい。
上記実施形態では、複数の車載機器20として、ナビゲーション装置40、オーディオ装置42、エアコンディショナ44、HUD46、ハザードランプ48、シート50、ドアミラー52、後方ライト54、運転席側ウィンドウ56及び助手席側ウィンドウ58を挙げたが、車載機器20の選択の観点からすれば、車両10の乗員が操作可能な複数の車載機器が上下方向に配置された車載機器群(グループ)が車幅方向に複数配置されていれば、これに限らない。
上記実施形態では、表示器22(インジケータ26a~26e)は、フロントウィンドウ11の下部周辺においてインストルメントパネル59に設けたが、フロントウィンドウ11の下部若しくは上部又はそれらの周囲に設けられるのであれば、これに限らない。例えば、表示器22(インジケータ26a~26e)をフロントウィンドウ11の上部に設けることもできる。また、HUD46の領域をより広げた状態であれば、表示器22(インジケータ26a~26e)をHUD46の一部として構成することもできる。
Claims (12)
- 車両(10)に搭載されて前記車両(10)の乗員(100)が操作可能な複数の車載機器(20)と、
前記乗員(100)の視線方向又は顔向きに基づいて前記乗員(100)の注視方向を検出する注視方向検出手段(70)と、
前記乗員(100)により操作可能に前記車載機器(20)とは異なる場所に設けられる操作手段(18)と
を備える車載機器操作装置(12)であって、さらに、
前記車両(10)の車幅方向及び該車幅方向と交差する上下方向にそれぞれ複数配置されている前記複数の車載機器(20)が前記車幅方向において所定領域ごとに区切られた複数の車載機器群の中から、前記注視方向検出手段(70)により検出された前記注視方向に基づいて、いずれかの車載機器群を特定する車載機器特定手段(72、74)と、
前記車載機器特定手段(72、74)により特定された前記車載機器群を報知する報知手段(26a~26e)と
を備え、
前記操作手段(18)は、前記車載機器群のうち前記上下方向における前記車載機器(20)を選択可能な上下方向選択手段(30、32、34)を有し、
前記車載機器特定手段(72、74)は、前記注視方向検出手段(70)により検出された前記注視方向に基づいて前記車載機器群を特定すると共に、該車載機器群が特定された状態で前記上下方向選択手段(30、32、34)が操作された場合に、該上下方向選択手段(30、32、34)により選択された上下方向に基づいて前記特定された車載機器群のうちいずれかの車載機器(20)を特定し、
前記報知手段(26a~26e)は、それぞれの前記所定領域の幅と同等の幅を有し、前記車両(10)のインストルメントパネル(59)において前記車幅方向に並べて配置されている
ことを特徴とする車載機器操作装置(12)。 - 車両(10)に搭載されて前記車両(10)の乗員(100)が操作可能な複数の車載機器(20)と、
前記乗員(100)の視線方向又は顔向きに基づいて前記乗員(100)の注視方向を検出する注視方向検出手段(70)と、
前記注視方向検出手段(70)により検出された前記注視方向に基づいて前記複数の車載機器(20)のうちいずれかの車載機器(20)を特定する車載機器特定手段(72、74)と、
前記乗員(100)により操作可能に前記車載機器(20)とは異なる場所に設けられる操作手段(18)と
を備える車載機器操作装置(12)であって、
前記複数の車載機器(20)は、前記車両(10)の車幅方向及び該車幅方向と交差する上下方向にそれぞれ複数配置されていると共に、前記車幅方向において所定領域ごとに区切った複数の車載機器群に区分されており、
前記操作手段(18)は、前記車載機器群のうち前記上下方向における前記車載機器(20)を選択可能な上下方向選択手段(30、32、34)を有し、
前記車載機器特定手段(72、74)は、前記注視方向検出手段(70)により検出された前記注視方向に基づいて前記車載機器群を特定すると共に、該車載機器群が特定された状態で前記上下方向選択手段(30、32、34)が操作された場合に、該上下方向選択手段(30、32、34)により選択された上下方向に基づいて前記特定された車載機器群のうちいずれかの車載機器(20)を特定する
ことを特徴とする車載機器操作装置(12)。 - 請求項1又は2記載の車載機器操作装置(12)において、
前記上下方向選択手段(30、32、34)は、選択可能な前記上下方向のそれぞれに対応して割り当てられた個別の操作スイッチ(30、32、34)により構成される
ことを特徴とする車載機器操作装置(12)。 - 請求項1~3のいずれか1項に記載の車載機器操作装置(12)において、
前記上下方向選択手段(30、32、34)は、前記車載機器特定手段(72、74)により前記車載機器(20)が特定された状態において、当該特定された車載機器(20)に対する特定の操作入力を行うための操作入力手段を兼ねる
ことを特徴とする車載機器操作装置(12)。 - 請求項1~4のいずれか1項に記載の車載機器操作装置(12)において、
前記注視方向検出手段(70)は、
前記乗員(100)を含む画像を撮像可能に前記車両(10)の室内に設けられる撮像手段(14)と、
前記撮像手段(14)により撮像された前記画像に基づいて前記車幅方向における前記乗員(100)の顔向き角度を検出する顔向き角度検出手段(70)と
を備え、
前記顔向き角度検出手段(70)により検出された前記顔向き角度に基づいて前記乗員(100)の注視方向を検出する
ことを特徴とする車載機器操作装置(12)。 - 請求項1~5のいずれか1項に記載の車載機器操作装置(12)において、
前記上下方向選択手段(30、32、34)は、前記車両(10)のステアリングホイール(16)に設けられる十字スイッチ(18)として構成されると共に、前記選択可能な上下方向が前記ステアリングホイール(16)の正面視における前記十字スイッチ(18)の上下方向に対応して割り当てられる
ことを特徴とする車載機器操作装置(12)。 - 請求項1~6のいずれか1項に記載の車載機器操作装置(12)において、
前記車載機器特定手段(72、74)により特定された前記車載機器群を表示する表示手段(26a~26e、126a~126d)が、前記車載機器群ごとに設けられている
ことを特徴とする車載機器操作装置(12)。 - 車両(10)に搭載されて前記車両(10)の乗員(100)が操作可能な複数の車載機器(20)と、
前記乗員(100)の視線方向又は顔向きに基づいて前記乗員(100)の注視方向を検出する注視方向検出手段(70)と、
前記車両(10)の車幅方向及び該車幅方向と交差する上下方向にそれぞれ複数配置されている前記複数の車載機器(20)が前記車幅方向において所定領域ごとに区切られた複数の車載機器群の中から、前記注視方向検出手段(70)により検出された前記注視方向に基づいて、いずれかの車載機器群を特定する車載機器特定手段(72、74)と、
前記車載機器特定手段(72、74)により特定された前記車載機器群を報知する報知手段(26a~26e)と
を備え、
前記報知手段(26a~26e)は、それぞれの前記所定領域の幅と同等の幅を有し、前記車両(10)のインストルメントパネル(59)において前記車幅方向に並べて配置されている
ことを特徴とする報知装置(12)。 - 請求項8記載の報知装置(12)において、
前記所定領域の境界線は、前記車載機器特定手段(72、74)により前記車載機器群が特定されていなくても前記報知手段(26a~26e)が報知する
ことを特徴とする報知装置(12)。 - 請求項8又は9記載の報知装置(12)において、
前記車載機器(20)とは異なる場所において前記乗員(100)により操作可能に設けられる操作手段(18)を備え、
前記操作手段(18)は、前記車載機器群のうち前記上下方向における前記車載機器(20)を選択可能な上下方向選択手段(30、32、34)を有し、
前記車載機器特定手段(72、74)は、前記注視方向検出手段(70)により検出された前記注視方向に基づいて前記車載機器群を特定すると共に、該車載機器群が特定された状態で前記上下方向選択手段(30、32、34)により選択された上下方向に基づいて前記特定された車載機器群のうちいずれかの車載機器(20)を特定し、
前記報知手段(26a~26e)は、前記車載機器特定手段(72、74)によって特定された前記車載機器(20)によって報知方法が変更される
ことを特徴とする報知装置(12)。 - 請求項8~10のいずれか1項に記載の報知装置(12)において、
前記報知手段(26a~26e)は、前記幅を調整できる
ことを特徴とする報知装置(12)。 - 車両(10)において車幅方向に配置された複数の車載機器(20)と、
乗員(100)の視線方向及び顔向きの少なくとも一方に基づいて前記車幅方向における前記乗員(100)の注視方向を検出する注視方向検出部(70)と、
前記複数の車載機器(20)から前記注視方向に対応する1つ以上の前記車載機器(20)を特定する車載機器特定部(72、74)と、
前記注視方向の検出可能範囲であり且つ前記車幅方向において前記複数の車載機器(20)に応じて設定された複数の注視可能領域のうち、検出された前記注視方向又は特定された前記1つ以上の車載機器(20)に対応する注視可能領域を視覚的に報知する報知部(22)と
を備え、
前記報知部(22)は、フロントウィンドウ(11)の下部若しくは上部又はそれらの周囲において前記複数の注視可能領域ごとに前記車幅方向に沿って連続的又は断続的に設けられて、隣り合う注視可能領域の境界を示す複数のインジケータ(26a~26e)を有する
ことを特徴とする報知装置(12)。
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US14/124,054 US9499110B2 (en) | 2011-06-20 | 2012-04-11 | Automotive instrument operating device and alert device |
JP2013521495A JP5554879B2 (ja) | 2011-06-20 | 2012-04-11 | 車載機器操作装置及び報知装置 |
EP12803269.5A EP2708420B1 (en) | 2011-06-20 | 2012-04-11 | Automotive instrument operating device and alert device |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2011135849 | 2011-06-20 | ||
JP2011-135849 | 2011-06-20 | ||
JP2011-206857 | 2011-09-22 | ||
JP2011206857 | 2011-09-22 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2012176535A1 true WO2012176535A1 (ja) | 2012-12-27 |
Family
ID=47422382
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2012/059854 WO2012176535A1 (ja) | 2011-06-20 | 2012-04-11 | 車載機器操作装置及び報知装置 |
Country Status (4)
Country | Link |
---|---|
US (1) | US9499110B2 (ja) |
EP (1) | EP2708420B1 (ja) |
JP (1) | JP5554879B2 (ja) |
WO (1) | WO2012176535A1 (ja) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2014149640A (ja) * | 2013-01-31 | 2014-08-21 | Tokai Rika Co Ltd | ジェスチャ操作装置及びジェスチャ操作プログラム |
CN104842795A (zh) * | 2014-02-18 | 2015-08-19 | 本田技研工业株式会社 | 车载设备操作装置 |
EP3575122A1 (en) * | 2018-05-30 | 2019-12-04 | Toyota Jidosha Kabushiki Kaisha | Interior structure |
Families Citing this family (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9513702B2 (en) * | 2013-07-15 | 2016-12-06 | Lg Electronics Inc. | Mobile terminal for vehicular display system with gaze detection |
US9244532B2 (en) * | 2013-12-31 | 2016-01-26 | Immersion Corporation | Systems and methods for controlling multiple displays with single controller and haptic enabled user interface |
GB201411309D0 (en) | 2014-06-25 | 2014-08-06 | Tomtom Int Bv | Vehicular human machine interfaces |
DE102014213279A1 (de) * | 2014-07-09 | 2016-01-14 | Conti Temic Microelectronic Gmbh | System zum Erfassen einer Fahrzeugumgebung eines Kraftfahrzeuges |
KR101677648B1 (ko) | 2014-12-22 | 2016-11-18 | 엘지전자 주식회사 | 차량 제어 장치 및 그 제어 방법 |
JP6406088B2 (ja) * | 2015-03-25 | 2018-10-17 | 株式会社デンソー | 操作システム |
US20160297362A1 (en) * | 2015-04-09 | 2016-10-13 | Ford Global Technologies, Llc | Vehicle exterior side-camera systems and methods |
US10166996B2 (en) * | 2017-02-09 | 2019-01-01 | Toyota Motor Engineering & Manufacturing North America, Inc. | Systems and methods for adaptively communicating notices in a vehicle |
DE102017216465A1 (de) * | 2017-09-18 | 2019-03-21 | Bayerische Motoren Werke Aktiengesellschaft | Verfahren zur Ausgabe von Informationen zu einem Objekt eines Fortbewegungsmittels, System und Automobil |
JP6915502B2 (ja) * | 2017-11-09 | 2021-08-04 | トヨタ自動車株式会社 | ドライバ状態検出装置 |
JP6922686B2 (ja) * | 2017-11-20 | 2021-08-18 | トヨタ自動車株式会社 | 操作装置 |
US10780909B2 (en) * | 2018-08-03 | 2020-09-22 | Tesla, Inc. | User interface for steering wheel |
KR102602739B1 (ko) | 2018-09-07 | 2023-11-16 | 삼성디스플레이 주식회사 | 전자 장치 |
DE102018126829B3 (de) * | 2018-10-26 | 2020-03-26 | Motherson Innovations Company Limited | Hybrid-Innenspiegel mit Fehlererkennung, Verfahren zu dessen Betrieb sowie Fahrzeug |
US20220017016A1 (en) * | 2018-10-26 | 2022-01-20 | Motherson Innovations Company Limited | Hybrid interior mirror with error recognition |
DE102019220012A1 (de) * | 2019-12-18 | 2021-06-24 | Continental Automotive Gmbh | Verfahren zum Betreiben einer Anzeigeeinheit eines Fahrzeugs und Anzeigeeinheit |
KR20220000536A (ko) * | 2020-06-26 | 2022-01-04 | 현대자동차주식회사 | 차량 주행 제어 장치 및 방법 |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2010076602A (ja) * | 2008-09-26 | 2010-04-08 | Denso It Laboratory Inc | 車載機器制御装置および車載機器制御方法 |
JP2010105417A (ja) | 2008-10-28 | 2010-05-13 | Mitsubishi Motors Corp | 車載用電子機器 |
US20100324779A1 (en) | 2009-06-18 | 2010-12-23 | Honda Motor Co., Ltd. | Onboard unit controlling apparatus |
JP2011116248A (ja) * | 2009-12-03 | 2011-06-16 | Honda Motor Co Ltd | 注視判定装置 |
Family Cites Families (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4158483A (en) * | 1975-07-09 | 1979-06-19 | Harman International Industries, Inc. | Remote controlled rearview mirror |
NO20005119L (no) * | 2000-02-18 | 2001-08-20 | Ziad Badarneh | Interaktivt system |
US6397137B1 (en) * | 2001-03-02 | 2002-05-28 | International Business Machines Corporation | System and method for selection of vehicular sideview mirrors via eye gaze |
EP2305106A1 (en) * | 2002-02-19 | 2011-04-06 | Volvo Technology Corporation | Method for monitoring and managing driver attention loads |
US6668221B2 (en) * | 2002-05-23 | 2003-12-23 | Delphi Technologies, Inc. | User discrimination control of vehicle infotainment system |
US6859144B2 (en) * | 2003-02-05 | 2005-02-22 | Delphi Technologies, Inc. | Vehicle situation alert system with eye gaze controlled alert signal generation |
DE102004022634A1 (de) * | 2004-05-07 | 2005-12-15 | Dr.Ing.H.C. F. Porsche Ag | Abdeckungen für ein Lenkrad |
US8340368B2 (en) * | 2008-06-11 | 2012-12-25 | Hyundai Motor Company | Face detection system |
US8057288B2 (en) * | 2008-06-20 | 2011-11-15 | Nissan North America, Inc. | Contact-free vehicle air vent |
US9108513B2 (en) * | 2008-11-10 | 2015-08-18 | Volkswagen Ag | Viewing direction and acoustic command based operating device for a motor vehicle |
JP2010215194A (ja) * | 2009-03-19 | 2010-09-30 | Hyundai Motor Co Ltd | 車載機器の操作装置 |
US9292093B2 (en) * | 2010-11-18 | 2016-03-22 | Alpine Electronics, Inc. | Interface method and apparatus for inputting information with air finger gesture |
US10120438B2 (en) * | 2011-05-25 | 2018-11-06 | Sony Interactive Entertainment Inc. | Eye gaze to alter device behavior |
JP5367037B2 (ja) * | 2011-09-26 | 2013-12-11 | 本田技研工業株式会社 | 顔向き検出装置 |
-
2012
- 2012-04-11 US US14/124,054 patent/US9499110B2/en active Active
- 2012-04-11 JP JP2013521495A patent/JP5554879B2/ja not_active Expired - Fee Related
- 2012-04-11 EP EP12803269.5A patent/EP2708420B1/en not_active Not-in-force
- 2012-04-11 WO PCT/JP2012/059854 patent/WO2012176535A1/ja active Application Filing
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2010076602A (ja) * | 2008-09-26 | 2010-04-08 | Denso It Laboratory Inc | 車載機器制御装置および車載機器制御方法 |
JP2010105417A (ja) | 2008-10-28 | 2010-05-13 | Mitsubishi Motors Corp | 車載用電子機器 |
US20100324779A1 (en) | 2009-06-18 | 2010-12-23 | Honda Motor Co., Ltd. | Onboard unit controlling apparatus |
JP2011000957A (ja) * | 2009-06-18 | 2011-01-06 | Honda Motor Co Ltd | 車載機器操作装置 |
JP2011116248A (ja) * | 2009-12-03 | 2011-06-16 | Honda Motor Co Ltd | 注視判定装置 |
Non-Patent Citations (1)
Title |
---|
See also references of EP2708420A4 |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2014149640A (ja) * | 2013-01-31 | 2014-08-21 | Tokai Rika Co Ltd | ジェスチャ操作装置及びジェスチャ操作プログラム |
CN104842795A (zh) * | 2014-02-18 | 2015-08-19 | 本田技研工业株式会社 | 车载设备操作装置 |
JP2015151059A (ja) * | 2014-02-18 | 2015-08-24 | 本田技研工業株式会社 | 車載機器操作装置 |
US9552058B2 (en) | 2014-02-18 | 2017-01-24 | Honda Motor Co., Ltd. | Vehicle-mounted equipment operating device |
EP3575122A1 (en) * | 2018-05-30 | 2019-12-04 | Toyota Jidosha Kabushiki Kaisha | Interior structure |
Also Published As
Publication number | Publication date |
---|---|
EP2708420A4 (en) | 2015-05-27 |
US20140129082A1 (en) | 2014-05-08 |
EP2708420A1 (en) | 2014-03-19 |
US9499110B2 (en) | 2016-11-22 |
JP5554879B2 (ja) | 2014-07-23 |
JPWO2012176535A1 (ja) | 2015-02-23 |
EP2708420B1 (en) | 2016-08-17 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP5554879B2 (ja) | 車載機器操作装置及び報知装置 | |
JP5345660B2 (ja) | 車載機器特定装置 | |
US11479177B2 (en) | Vehicle display device, display control method, and rearview monitoring system | |
CN104842795B (zh) | 车载设备操作装置 | |
US10086845B2 (en) | Vehicle information display control device, and method for displaying automatic driving information | |
US20140195096A1 (en) | Apparatus and method for contactlessly detecting objects and/or persons and gestures and/or operating procedures made and/or carried out thereby | |
CN106448260B (zh) | 驾驶员辅助设备和包括该驾驶员辅助设备的车辆 | |
US10632917B2 (en) | Signal processing device, signal processing method, and monitoring system | |
JP4941760B2 (ja) | 車両周辺監視装置 | |
US9446712B2 (en) | Motor vehicle comprising an electronic rear-view mirror | |
US20170182936A1 (en) | Information providing apparatus | |
US8719726B2 (en) | Vehicular manipulation input apparatus | |
EP2765568A1 (en) | Warning device | |
US20140368029A1 (en) | System for providing vehicle manipulation device information | |
US10162411B2 (en) | Methods and system for operating at least one display device of a motor vehicle, and motor vehicle comprising a system for operating at least one display device | |
JP5588764B2 (ja) | 車載機器操作装置 | |
JP2011000957A (ja) | 車載機器操作装置 | |
US10315556B2 (en) | Information providing apparatus | |
JP2017162015A (ja) | 車両周辺画像表示装置 | |
JP2023038211A (ja) | 表示装置 | |
JP5954169B2 (ja) | 制御装置 | |
CN114041174A (zh) | 用于在车辆内确定车辆使用者的眼睛图像数据、眼睛位置和/或视向的装置和方法 | |
JP6523704B2 (ja) | 車内状態確認装置 | |
CN110228412A (zh) | 车辆辅助驾驶装置及车辆辅助驾驶方法 | |
US11853469B2 (en) | Optimize power consumption of display and projection devices by tracing passenger's trajectory in car cabin |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 12803269 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2013521495 Country of ref document: JP Kind code of ref document: A |
|
WWE | Wipo information: entry into national phase |
Ref document number: 14124054 Country of ref document: US |
|
REEP | Request for entry into the european phase |
Ref document number: 2012803269 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2012803269 Country of ref document: EP |
|
NENP | Non-entry into the national phase |
Ref country code: DE |