JP2009190675A - Operating device for vehicle - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an operating device for a vehicle capable of improving a user's operation feeling. <P>SOLUTION: This device comprises: a switch projection and display means for projecting and displaying a switch image in a predefined space of a vehicle so that an image of an operating switch of vehicle-mounted equipment is virtually positioned on a sight line of an occupant of a vehicle; a position detection means for detecting a position of a detection object using one part of the occupant of the vehicle as a detection object; a switch operation determination means for determining whether the operating switch of the vehicle-mounted equipment is virtually operated or not based on a position of the detection object detected by the position detection means and a change condition of the position; and a response action executing means for executing a response action corresponding to the operation to at least one part of a body of the occupant of the vehicle when the operating switch is determined virtually operated. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a vehicle operating device.

  For example, a head-up display (HUD) capable of displaying various types of information in a predetermined area on the front window of the vehicle is displayed, and images of a plurality of operation switches are displayed on the HUD, and an operation input by an operator to these operation switches There is known a vehicular display device that detects the presence or absence of the control device and controls the operation of an operation device corresponding to each operation switch in accordance with the detection result.

  In the conventional vehicle display device, each position where the images of the plurality of operation switches are displayed is fixed at a predetermined position on the front window of the vehicle, so that the operator's line of sight depends on the driving state of the vehicle. In the case of change, it is necessary to move the line of sight in order to visually recognize a plurality of operation switches on the HUD, which may be troublesome and reduce the ability of the operator to recognize the outside world. Therefore, an operation switch image is projected according to the position of the driver's eyeball and the driver's line-of-sight direction, and the operation of the in-vehicle device can be easily performed without the operator having to move the line of sight. An operation device for an in-vehicle device that can be used has been devised (see Patent Document 1).

  The present invention also relates to a command input device that accepts input of commands expressed by movements of a part of the body such as a passenger's hand, and in particular, displays a virtual image operation switch and a virtual switch that blows air toward the operation switch. The command input device has been devised to improve the operability by allowing the user to recognize which part should be operated by visual recognition of the virtual image operation switch and physical recognition by air (patent) Reference 2).

JP 2006-327526 A JP 2005-254851 A

  In the example of Patent Literature 1, there is a problem that there is no reaction force (pressing response) when an image of an operation switch such as a general mechanical switch is pressed, and the operation feeling is poor. Further, in the example of Patent Document 2, although there is an effect that can surely recognize where the switch exists, there remains a problem that there is no response. Furthermore, whether or not the operation has been accepted has to confirm the operation of the corresponding in-vehicle device.

  With the above problem as a background, an object of the present invention is to provide a vehicular operating device capable of improving a user's operational feeling.

Means for Solving the Problems and Effects of the Invention

  In order to solve the above-described problem, the vehicle operation device is configured such that the switch image is determined in advance so that the image of the operation switch of the in-vehicle device mounted on the vehicle is virtually located on the line of sight of the vehicle occupant. The switch image is projected and displayed by the switch projection display means for projecting and displaying in the space, the position detection means for detecting the position of the detection target for a part of the body of the vehicle occupant, and the switch projection display means. A switch operation determining means for determining whether or not the operation switch of the in-vehicle device is virtually operated based on the position of the detection target detected by the position detecting means and the change state of the position, Response operation executing means for executing a response operation corresponding to the operation on at least a part of the body of the vehicle occupant when it is determined that the switch for the vehicle is virtually operated; Characterized in that it obtain.

  With the above configuration, it is possible to execute a response operation that urges a reaction force (pressing response) when it is determined that the operation switch has been virtually operated, thereby improving the operational feeling of the user (occupant). It becomes possible.

  Further, the response operation executing means in the vehicle operating device of the present invention is configured to be a blowing means for blowing air to the detection target.

  In the example of Patent Document 2, since air is blown onto the operation switch (image thereof), it is only possible to recognize where the operation switch exists, but with the above configuration, the user can operate the corresponding on-vehicle device. Even without confirming, it will be understood that the operation has been accepted.

  Further, the vehicle operating device of the present invention includes an operation state acquisition unit that acquires an operation state of the blower unit, and an air volume determination unit that determines an air volume to be blown based on the acquired operation state of the blower unit. Composed.

  Even if it is the structure where air is blown to the operation switch (image thereof) as in Patent Document 2, the user can change the air volume when the operation is accepted. It is possible to recognize where the switch exists and to know that the operation has been accepted without confirming the operation of the corresponding in-vehicle device.

  Further, the air blowing means in the vehicle operating device of the present invention is configured to use a vehicle air conditioner.

  With the above configuration, the configuration of the present invention can be realized at low cost without installing a new blowing means.

  Further, the response operation executing means in the vehicle operating device of the present invention is configured to be a seat vibration means for vibrating the vehicle seat.

  Even with the above configuration, the user can recognize that the operation has been accepted without confirming the operation of the corresponding in-vehicle device.

  The vehicle operating device according to the present invention further includes a vibration state acquisition unit that acquires an operation state of the seat vibration unit, and a vibration amount determination unit that determines a vibration amount based on the acquired operation state of the seat vibration unit. Configured as follows.

  With the above configuration, even when the seat is vibrating, the amount of vibration can be changed when the operation is accepted, so that the user can accept the operation without confirming the operation of the corresponding in-vehicle device. It will be understood.

  Further, in the vehicle operating device of the present invention, the detection target that is a part of the body of the vehicle occupant is the occupant's hand or finger, and the blower means is a defroster outlet provided on the upper surface of the vehicle instrument panel. To the occupant's hands or fingers.

  With the above configuration, the operation can be performed intuitively using the hand or finger, and a reaction force against the operation of the occupant can be given to the occupant's (user) 's hand or finger by blowing air from the defroster outlet. , The operational feeling can be improved. At this time, since the air is blown from the defroster blowout port, the blown air can be blown only to the minimum necessary portion such as the hand or finger of the occupant, and the occupant is not uncomfortable.

  Hereinafter, the vehicle operating device of the present invention will be described with reference to the drawings.

  As shown in FIG. 1, the vehicular operating device 10 includes an eyeball sensor 11, an operating finger sensor 12, a retinal projection device 13, an in-vehicle device 14 including a navigation device, an acoustic device, an air conditioner 30, and the like, and an electronic device. A control unit (hereinafter referred to as an ECU) 15 and a display switch 16 are included.

  As shown in FIGS. 2 and 3, for example, the eyeball sensor 11 is provided at a position where at least a driver's eyeball can be imaged, such as a position shifted from a rearview mirror in the passenger compartment to the driver side. And an eyeball camera 11a made up of a CCD camera, a CMOS camera, or the like that can be imaged in the infrared region, and an eyeball image processing unit 11b.

  The eye camera 11a captures visible light reflected from the occupant's face or eyeball, for example, if it can be imaged in the visible light region. For example, if the image can be imaged in the infrared region, an appropriate infrared projector (not shown). ) To capture the reflection of the infrared rays emitted toward the driver's eyeball. Further, the eyeball image processing unit 11b performs predetermined image processing such as filtering and binarization processing on the visible light image or the infrared image obtained by the imaging of the eyeball camera 11a, and the pixels of the two-dimensional array Is generated and output to the ECU 15.

  For example, as shown in FIG. 3, the operation finger sensor 12 is provided at a position where at least a finger or arm, elbow, or hand (detection target of the present invention) operated by the driver such as a vehicle roof can be imaged. It is configured to include an operation finger camera 12a and an operation finger image processing unit 12b, which are composed of a stereo camera such as a CCD camera or a CMOS camera that can capture an image in the light region or near infrared region.

  The operation finger camera 12a captures visible light reflected from the driver's operation finger, for example, if it can be imaged in the visible light region. For example, if the image can be captured in the near infrared region, an appropriate near infrared projector ( The reflection from the operation finger of the driver of the near infrared ray irradiated from (not shown) is imaged. Further, the operating finger image processing unit 12b performs predetermined image processing such as filtering and binarization processing on the visible light image or the near infrared image obtained by the imaging of the operating finger camera 12a, and performs two-dimensional processing. Image data composed of pixels in the array is generated and output to the ECU 15.

As shown in FIGS. 2 and 3, for example, the retinal projection device 13 includes a plurality of devices (for example, a navigation device and an acoustic device) that constitute the in-vehicle device 14 under the control of the ECU 15 based on image data output from the eyeball sensor 11. , And air conditioner 30 etc.) A plurality of operation switch images P ₁ ,..., P _n (n is an arbitrary natural number, for example, n = 6 in FIG. 2, for example) corresponding to a plurality of input operations. Project onto the person's retina. The retinal projection device 13 corresponds to the switch projection display means of the present invention. In the example of FIG. 2, the finger of the driver shows a state of operating the switch image P _6.

  The display switch 16 is disposed at an appropriate position within a range where the driver's fingers can reach when driving the vehicle, such as a spoke portion of a steering wheel as shown in FIG. The display switch 16 is configured, for example, as a push button switch, and outputs instruction signals to the ECU 15 instructing the start and end of projection of the switch image for operation by the retinal projection device 13 in response to an input operation by the driver. That is, each time the display switch 16 is pressed, the instructions to start and end the projection are repeated alternately.

  Returning to FIG. 1, the ECU 15 is configured as well-known computer hardware including a CPU, a ROM, a RAM, a signal input / output circuit, and the like (not shown). The ECU 15 includes, for example, a line-of-sight detection unit 21, a projection control unit 22, an operation finger detection unit 23, and a device control unit 24. Each of these units performs the following operation by the operation of a related circuit (not shown) when the CPU executes a control program stored in the ROM. Moreover, ECU15 and the vehicle equipment 14 are connected so that communication is mutually possible.

  The line-of-sight detection unit 21 first performs a predetermined recognition process on the image data input from the eyeball sensor 11 using the driver's face and eyeball as a detection target, and based on the recognition result, the driver's eyeball. , The driver's line-of-sight vector (line-of-sight direction), and the target position of the line of sight are detected.

  The projection control unit 22 is positioned on the retina of the driver where the operation switch image is projected according to the position of the driver's eyeball detected by the line-of-sight detection unit 21 and the driver's line-of-sight vector (line-of-sight direction). (Projection position) is set, the projection position information is output to the device control unit 24, and the projection operation of the retinal projection device 13 is controlled according to the projection position information and the instruction signal input from the display switch 16. To do.

  When the projection control unit 22 sets the projection position of the operation switch image, for example, as shown in FIG. 3, when the operation switch image is projected on the retina of the driver, these operation switch images are displayed. It is set to be recognized by the driver when displayed on a predetermined virtual image plane VD set on the driver's line of sight Q.

  The operation finger detection unit 23 performs predetermined recognition processing on the image data input from the operation finger sensor 12 with the driver's hand or finger as a detection target, and based on the recognition result, for example, for the operation finger The camera coordinate (for example, a predetermined operation plane RD set on the optical axis R of the operation finger camera 12a) with the origin of the camera 12a as the origin is the tip of the driver's operation finger (for example, index finger). The position and the time change of the position are detected. The operating finger detection unit 23 corresponds to the position detection unit of the present invention.

  Based on the position of the tip of the driver's operation finger detected by the operation finger detection unit 23 and the time change of the position, the device control unit 24 determines which operation switch image from among the plurality of operation switch images. Detecting whether the input operation corresponding to the predetermined input operation of the plurality of predetermined input operations stored in advance for each of the plurality of operation switch images is performed, For example, the operation of the in-vehicle device 14 composed of a navigation device, an air conditioner 30, an acoustic device, or the like is controlled. The device control unit 24 corresponds to a switch operation determination unit, an operation state acquisition unit, an air volume determination unit, a vibration state acquisition unit, and a vibration amount determination unit of the present invention.

The device control unit 24 controls the in-vehicle device 14 according to the detection result for the driver's input operation performed on the operation switch image (P ₁ ,..., P _n ) selected by the driver. . Since the details of the control contents of the device control unit 24 are described in Patent Document 1, only the outline is described below.
-In a state where the operation switch image is virtually displayed on the virtual image plane VD, the driver's operation finger reciprocates at a predetermined speed or more along a predetermined pressing direction at a position where it is superimposed on the operation switch image. Is detected, it is determined that the switch image for operation is temporarily selected, and the control operation of the in-vehicle device 14 corresponding to this operation, for example, ON or OFF of the acoustic device is executed.
・ If it is detected that the driver's operating finger moves at a predetermined speed or higher along the predetermined pressing direction at the position where the driver's operating finger is superimposed on the switch image for operation, It is determined that the operation switch image has been continuously selected, and the control operation of the in-vehicle device 14 corresponding to this operation, for example, the increase or decrease of the volume of the acoustic device is executed.

  Further, the device control unit 24 detects the operation detected by the operation finger detection unit 23 when detecting the operation switch image selected by the driver and the driver's input operation performed on the operation switch image. For example, coordinate conversion from the camera coordinates with the focus of the operation finger camera 12a as the origin to the viewpoint coordinates with the driver's viewpoint as the origin is performed with respect to the position of the tip of the operator's operation finger and the time change of the position. Then, projection conversion onto a predetermined virtual image plane VD is performed.

  Returning to FIG. 1, the air conditioner 30 is a known air conditioner ECU 31 that is a well-known computer hardware including a CPU, ROM, RAM, signal input / output circuit, etc. (not shown). An air conditioner outlet direction control motor 32 that controls the direction of the outlet (35 in FIG. 2, 36 in FIG. 3, etc.) connected to the air conditioner ECU 31 and an air conditioner air volume control motor 33 (so-called blower motor). The The air conditioner 30 corresponds to the response operation executing means and the air blowing means of the present invention.

  Instead of using the air conditioner 30, a blower provided with a dedicated blower opening, a blower direction control motor, and an air volume control motor may be used.

  In addition, the device control unit 24 causes the driver to recognize that the operation switch has been operated according to the detection result for the input operation performed by the driver on the operation switch image. Responsive action for. Hereinafter, the response operation execution processing of the present invention will be described with reference to FIG.

  First, it is determined whether or not the display switch 16 is pressed and turned on (S11). When the display switch 16 is not in the ON state (S11: No), this process is terminated.

On the other hand, when the display switch 16 is turned on (S11: Yes), the position of the driver's eyeball and the driver's line-of-sight vector (line-of-sight direction) are detected from the image data output from the eyeball sensor 11, and these Based on the detection result, the operation switch image (P ₁ ,..., P _n ) is virtually displayed on a predetermined virtual image plane VD set on the driver's line of sight Q, so that the operation switch is displayed. A position (projection position) on the retina of the driver on which the image is projected is set, and projection of the operation switch image is started at this projection position (S12).

  Next, from the image data output from the operation finger sensor 12, the position of the tip of the driver's operation finger (for example, the index finger) at the camera coordinates and the time change of the position are detected, and these detection results are virtualized. Thus, the position of the driver's operation finger on the predetermined virtual image plane VD on which the operation switch image is displayed is converted into a change state of the position (S13).

Then, it is determined whether or not the predetermined input operation as described above is virtually executed for the operation switch image (P ₁ ,..., P _n ) (S14). If the predetermined input operation has not been virtually executed (S14: No), it is determined whether or not the display switch 16 has been pressed and turned on (S18).

On the other hand, when the predetermined input operation is virtually executed (S14: Yes), air is sent to the operation switch image (P ₁ ,..., P _n ) where the predetermined input operation as described above is virtually executed. The air blowing direction and the air volume for performing the above are determined (S15). This acquires the information regarding an air blowing direction and an air volume from the air conditioner 30, and determines as follows, for example based on the acquired information.
When the air conditioner 30 is not activated or the air conditioner 30 is activated but the air blowing direction is not directed to the operation switch image, a predetermined input operation is virtually executed for the air blowing direction. A predetermined air volume is set toward the operation switch image.
When the air conditioner 30 is activated and the air blowing direction is directed to the operation switch image, the air volume is set to be different from the current air volume (larger or smaller than the current air volume).

  At this time, it is also determined whether the air is blown from either the air outlet 35 or the defroster air outlet 36. A method may be used in which a blow-out port for blowing air is determined in advance or a blow-out port that is not blowing air is selected.

  Subsequently, a command is sent to the air conditioner 30 so as to perform an operation based on this information, together with information on the set air outlet, direction, and air volume. The air conditioner 30 drives and controls the air conditioner outlet direction control motor 32 and the air conditioner air volume control motor 33 based on information / commands sent from the device control unit 24 to adjust the air blowing direction and the air volume. Then, the air is blown from the air outlet 35 or the defroster air outlet 36 (S16).

  And control operation of the vehicle equipment 14 according to the predetermined input operation performed is performed (S17). That is, information on the executed predetermined input operation is sent to the in-vehicle device 14, and the in-vehicle device 14 performs an operation based on the predetermined input operation. At this time, the air blowing direction and the air volume may be returned to the state before the predetermined input operation is virtually executed. Subsequently, it is determined whether or not the display switch 16 is pressed and turned on (S18).

  If the display switch 16 is not in the ON state (S18: No), the process returns to step S14, and the processes after step S14 are executed. On the other hand, when the display switch 16 is turned on (S18: Yes), the projection of the operation switch image is terminated (S19). And the process which detects the position of a driver | operator's operating finger and the change state of this position is complete | finished (S20), and a series of processes are complete | finished.

  The response operation execution process of the present invention will be described with reference to FIG. In addition, since a present Example is a modification of the above-mentioned Example 1, it attaches | subjects the same code | symbol about the thing of the structure same as Example 1, and omits detailed description here.

  The in-vehicle device 14 includes a seat device 40. The seat device 40 is included in a well-known computer hardware including a CPU, ROM, RAM, signal input / output circuit (not shown), and a well-known vibrator or massage device connected to the seat ECU 41. A seat seat push-up motor 42 that pushes up the seat seat is configured. The seat device 40 corresponds to the response operation executing means and the seat vibration means of the present invention. A push-up motor may be provided on the backrest other than the seat.

  The response operation execution process in the configuration of FIG. 5 will be described with reference to FIG. Note that this process is a modification of FIG. 4, and steps S31 to S34 and steps S37 to S40 are the same as steps S11 to S14 and steps S17 to S20 of FIG. 4, respectively. Will be omitted.

When the predetermined input operation as described above is virtually executed on the operation switch image (P ₁ ,..., P _n : see FIG. 2) (S34: Yes), for example, the seat seat is pushed up as follows. The amount (or vibration amount) is determined (S35).
-If the seat seat push-up motor 42 is not operating, a predetermined push-up amount is used.
When the seat seat push-up motor 42 is operating, a push-up amount that is different (larger or smaller than the current push-up amount) from the current push-up amount is used.

  Then, a command is sent to the seat device 40 so as to perform an operation based on the information related to the determined amount of pushing up of the seat portion. The seat device 40 drives and controls the seat seat push-up motor 42 based on the information / command sent from the device control unit 24 (S36). And control operation of the vehicle equipment 14 according to the predetermined input operation performed is performed (S37). At this time, the push-up amount may be returned to the state before the predetermined input operation is virtually executed.

  Note that the above-described vehicle operation device may be installed on the passenger seat side so that the passenger in the passenger seat can operate it.

  Although the embodiments of the present invention have been described above, these are merely examples, and the present invention is not limited to these embodiments, and the knowledge of those skilled in the art can be used without departing from the spirit of the claims. Various modifications based on this are possible.

The block diagram which shows the structure of the operating device for vehicles (Example 1). The figure which looked at the vehicle interior of the vehicle carrying the vehicle operating device from the rear toward the front. The figure which shows an example of the arrangement position in the vehicle interior of the eyeball sensor of the operating device for vehicles, an operating finger sensor, and a retinal projection device. FIG. 9 is a flowchart for explaining response operation execution processing (first embodiment). The block diagram which shows another example of a structure of the operating device for vehicles (Example 2). FIG. 10 is a flowchart for explaining another example of the response operation execution process (second embodiment).

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 Vehicle operation apparatus 11 Eyeball sensor 11a Eyeball camera 12 Operation finger sensor 12a Operation finger camera 13 Retina projection apparatus (switch projection display means)
14 on-vehicle equipment 16 display switch 21 gaze detection unit 23 operation finger detection unit (position detection means)
24 Device control unit (switch operation determination means, operation state acquisition means, air volume determination means, vibration state acquisition means, vibration amount determination means)
30 Air conditioner (response action execution means, blower means)
40 seat device (response action execution means, seat vibration means)

Claims (7)

Switch projection display means for projecting and displaying the switch image in a predetermined space of the vehicle so that an image of an operation switch of the in-vehicle device mounted on the vehicle is virtually located on the line of sight of the occupant of the vehicle When,
Position detection means for detecting the position of the detection target, with a part of the body of the vehicle occupant as the detection target;
When the switch image is projected and displayed by the switch projection display means, based on the position of the detection target detected by the position detection means and the change state of the position, the operation switch of the in-vehicle device is A switch operation determining means for determining whether or not a virtual operation has been performed;
When it is determined that the operation switch is virtually operated, response operation executing means for executing a response operation corresponding to the operation on at least a part of the body of an occupant of the vehicle;
A vehicle operating device comprising:   The vehicle operating device according to claim 1, wherein the response operation executing unit includes a blowing unit that blows air to the detection target. An operation state obtaining unit for obtaining an operation state of the blowing unit;
An air volume determining means for determining an air volume to be blown based on the obtained operating state of the air blowing means;
The vehicle operating device according to claim 2, further comprising:   The vehicle operating device according to claim 2 or 3, wherein the air blowing means uses an air conditioner of the vehicle.   The vehicle operating device according to any one of claims 1 to 4, wherein the response operation executing means includes a seat vibration means for vibrating a seat of the vehicle. Vibration state acquisition means for acquiring an operating state of the seat vibration means;
A vibration amount determining means for determining a vibration amount based on the obtained operating state of the seat vibration means;
The vehicle operating device according to claim 5. The detection object that is a part of the body of an occupant of the vehicle is an occupant's hand or finger,
The vehicle blower according to any one of claims 2 to 6, wherein the blower blows air from a defroster outlet provided on an upper surface of an instrument panel of the vehicle to a hand or a finger of the occupant. Operating device.

Images