JP4899627B2 - Vehicle input device - Google Patents

Description

  The present invention relates to an input device for a vehicle that performs various operations by matching the position of a pointer or cursor with a desired button display position.

Conventionally, a plurality of controlled devices provided in the vehicle, a joystick operation switch that has an operable joystick and outputs a command signal according to the operation, and a display for guiding the operation of the joystick operation switch Display means for displaying and a guide screen for selecting one of the plurality of controlled devices is displayed on the display means, and based on a command signal from the joystick operation switch, one of the plurality of controlled devices is displayed. A control screen for controlling the selected controlled device based on a command signal from the joystick operation switch, and displaying a guidance screen for controlling the selected controlled device on the display unit. A vehicle-mounted remote control device is known (see, for example, Patent Document 1).
Japanese Patent Laid-Open No. 05-212272

  However, in the vehicle input device that performs various operations by matching the position of the pointer or cursor on the display device with the desired button display position as in the above-described prior art, it is caused by various vibrations input to the vehicle. Therefore, it is difficult to match the position of the pointer or cursor to the button display, and there is a problem that the operability is not good.

  Therefore, an object of the present invention is to provide an input device for a vehicle that can ensure good operability even when various vibrations are input to the vehicle.

In order to achieve the above object, a vehicle input device according to a first invention includes a movable operation member capable of inputting position information by being moved,
A reaction force generation mechanism capable of generating a physical reaction force with respect to the movement operation of the movable operation member;
Display control means for changing a relative position of a pointer or a cursor with respect to button display based on the input position information on a screen displaying a plurality of button displays corresponding to a plurality of buttons ;
A destination prediction unit that predicts a button display of a destination of a pointer or cursor based on a user's line of sight recognized based on an image of a user's face captured by a camera;
Reaction force control means for controlling the reaction force generation mechanism so that a pulling force that causes the pointer or cursor to be pulled into the position of the button display acts on the movable operation member ,
The reaction force control means is characterized in that, based on the prediction result of the movement destination prediction means, the pulling force for the button display other than the button display of the movement destination is made small or zero .

  According to the present invention, it is possible to obtain a vehicle input device that can ensure good operability even when various vibrations are input to the vehicle.

  Hereinafter, the best mode for carrying out the present invention will be described in several embodiments with reference to the drawings.

  FIG. 1 is a diagram conceptually showing the main configuration of a vehicle input device 10A according to a first embodiment of the present invention. As illustrated in FIG. 1, the vehicle input device 10 </ b> A of the present embodiment includes a reaction force operation device 40, a display 14, and a processing device 70 </ b> A.

  The reaction force operation device 40 and the display 14 are separately disposed at physically separated positions in the vehicle interior. As shown in FIG. 1, the reaction force operation device 40 and the display 14 are connected to a processing apparatus 70A composed of, for example, a microcomputer. The reaction force operation device 40 and the display 14 may be connected to the processing device 70A via a wireless communication line. The in-vehicle device 16 operated by the reaction force operation device 40 such as an audio device, a navigation device, and an air conditioner is connected to the processing device 70A.

  The display 14 is composed of a liquid crystal display or the like, and is disposed at a position where the user can easily see, preferably at a position where the driver can see without significantly changing the visual field while driving. For example, the display 14 may be disposed in the center of the upper surface of the instrument panel or may be disposed in a meter.

  The reaction force operation device 40 is disposed at a position where the user can easily operate, preferably at a position where the driver can operate by simply reaching out. For example, the reaction force operation device 40 may be disposed on the center console unit or may be disposed on the instrument panel.

  FIG. 2 is a schematic diagram illustrating an example of a main configuration of the reaction force operation device 40. A reaction force operation device 40 shown in FIG. 2 is a joystick type device, and includes a main body case 42 and a movable operation member 44 that is held by a user (operator). The movable operation member 44 is configured to be movable (swingable) in a two-dimensional region that is front-rear, left-right, and diagonal with respect to the main body case 42. The movement (moving operation) of the movable operation member 44 is detected by rotation angle sensors (rotary encoders) 46X, 46Y (see FIG. 4) or the like, and is input to the processing device 70A as a position input signal. The movable operation member 44 is made of a stick-shaped member, and has an operation switch 45 at the top. For example, the operation switch 45 may be suitable for being operated by being pushed by the thumb of the hand holding the movable operation member 44. An operation on the operation switch 45 is detected, for example, electrically or optically, and is input to the processing device 70A as an operation signal.

  The reaction force operation device 40 includes a reaction force generation mechanism 50 that can generate a physical reaction force with respect to the movement operation of the movable operation member 44.

  FIG. 3 is a schematic diagram illustrating an example of the reaction force generation mechanism 50. In FIG. 3, in order to show an example of the basic principle of the reaction force generation mechanism 50, the structure inside the main body case 42 is schematically shown in a top view. In the following description, for convenience of explanation, it is assumed that the X-axis direction corresponds to the vehicle left-right direction and the Y-axis direction corresponds to the vehicle front-rear direction.

  As shown in FIG. 3, the reaction force generating mechanism 50 includes a first motor 54 capable of rotating in the forward and reverse directions for applying a rotational reaction force about the X axis and a forward and reverse rotation for applying a rotational reaction force about the Y axis. A second motor 52. The first motor 54 and the second motor 52 are fixed to the main body case 42 with, for example, bolts or the like.

  An X-axis member 45 is connected to the output shaft of the first motor 54 via gear mechanisms 55 and 59. The X-axis member 45 is supported with respect to the main body case 42 through, for example, a bearing so as to be rotatable around the X-axis. A rotating frame 46 is fixedly supported on the X-axis member 45. The X-axis member 45 is not directly connected to the movable operation member 44. Further, the rotating frame 46 is not directly connected to the main body case 42.

  The Y-axis member 47 is supported via a bearing, for example, so as to be rotatable about the Y-axis with respect to the rotating frame 46. A movable operation member 44 is fixedly supported on the Y-axis member 47. As a result, the movable operation member 44 is supported by the rotary frame 46 via the Y-axis member 47 so as to be rotatable about the Y-axis. That is, the rotary frame 46 supports the movable operation member 44 so as to be rotatable about the Y axis. The Y-axis member 47 is connected to the output shaft of the second motor 52 via the gear mechanisms 53 and 58.

  According to the reaction force generation mechanism 50 configured as described above, when the first motor 54 is energized and rotated, the rotation frame 46 rotates about the X axis with respect to the main body case 42 via the gear mechanisms 55 and 59. At this time, since the movable operation member 44 is supported by the rotating frame 46, it rotates around the X axis with respect to the main body case 42 together with the rotating frame 46. On the other hand, when the second motor 52 is energized and rotated, the movable operation member 44 rotates about the Y axis with respect to the rotating frame 46 via the gear mechanisms 53 and 58. That is, the movable operation member 44 rotates about the Y axis with respect to the main body case 42. In this manner, the movable operation member 44 can be moved two-dimensionally with the drive of the first motor 54 and the second motor 52 with respect to the main body case 42 around the X axis, the Y axis, and combinations thereof. Become. In other words, the movable operation member 44 is controlled in the arbitrary direction on the two-dimensional plane composed of the X axis and the Y axis by controlling the energization to the first motor 54 and the second motor 52 and the driving voltage at that time. A reaction force can be applied. For example, when the movable operation member 44 is operated around the X axis and a reaction force is applied to the forward operation of the movable operation member 44, the first motor 54 is rotated clockwise. In this case, the user will have a feeling that the movable operation member 44 is difficult to move forward. The reaction force at this time may be controlled by adjusting the duty when the first motor 54 is driven. Similarly, when the reaction force is applied to the operation of the movable operation member 44 around the X axis and the operation of the movable operation member 44 is performed in the backward direction, the first motor 54 is rotated counterclockwise. Here, it should be noted that the reaction force is not necessarily positive, and may take a negative value. For example, when a negative reaction force is applied to the forward operation of the movable operation member 44, the first motor 54 may be rotated counterclockwise. In this case, the user will have a feeling that the movable operation member 44 moves (draws) without permission.

  In this embodiment, as will be described in detail later, the operability of the movable operation member 44 can be improved by appropriately controlling the reaction force of the movable operation member 44. Such reaction force control for the reaction force generating mechanism 50 is realized by the processing device 70A, and details of the control mode will be described later.

  FIG. 4 is a functional block diagram showing a main configuration centering on the processing device 70A in the vehicle input device 10A of the present embodiment. The processing device 70A includes a reaction force control unit 72A, a reaction force map storage unit 73, a position input signal processing unit 74, an operation signal processing unit 76, and a display control unit 78.

  A rotation angle sensor 46X that detects the rotation angle of the first motor 54 and a rotation angle sensor 46Y that detects the rotation angle of the second motor 52 are connected to the reaction force control unit 72A and the position input signal processing unit 74. . A first motor 54 and a second motor 52 are connected to the reaction force control unit 72A as control targets. In addition to the display 14, the display control unit 78 is connected to the in-vehicle device 16 operated by the reaction force operation device 40 such as an audio device. The rotation angle sensor 46X may detect the rotation angle of the X-axis member 45 instead of the rotation angle of the first motor 54. Similarly, the rotation angle sensor 46 </ b> Y may detect the rotation angle of the Y-axis member 47 instead of the rotation angle Y of the second motor 52.

  Hereinafter, each unit 72, 73, 74, 76, 78 of the processing apparatus 70A will be described with reference to FIG.

  The operation signal processing unit 76 detects an operation signal generated when the operation switch 45 of the reaction force operation device 40 is operated, and outputs the operation signal to the display control unit 78. The position input signal processing unit 74 processes the output signals of both the rotation angle sensor 46X and the rotation angle sensor 46Y, and detects the movement of the movable operation member 44 (movement operation mode by the user).

  The display control unit 78 is used for various in-vehicle devices 16 (for example, a navigation device) and a display in accordance with an operation signal input via the operation signal processing unit 76 (an operation signal input from the reaction force operation device 40). 14 button display image switching is controlled. In addition, the display control unit 78 responds to a position input signal input via the position input signal processing unit 74 (according to position information input from the reaction force operation device 40), and a pointer P on the display 14 is displayed. And the position of the cursor C is changed.

  FIG. 5 is a diagram illustrating an example of a button display image displayed on the display 14. As shown in FIG. 5, a button display image that supports the user's operation on the reaction force operation device 40 is displayed on the display 14 under the control of the processing device 70 </ b> A. That is, the button display image includes button displays F <b> 1 to F <b> 11 representing the buttons operated by the reaction force operation device 40. Each button is assigned a function realized by an operation on the button. For example, the buttons represented by the button displays F1 to F11 may be buttons for operating various audio function systems including, for example, an audio device, an air conditioner, and a wireless communication function. For example, in the case of an audio device, buttons represented by button displays F8 to F11 include, for example, a seek button for searching for a desired reproduction medium, a button for increasing or decreasing a reproduction output, and a mode button. It is. The button displays F1 to F9 may include symbols and characters (for example, “mail” button display F3) representing functions realized by the buttons.

  On the display 14, as shown in FIG. 5, a pointer P and a cursor C are superimposed and displayed on the button display image. The pointer P serves to indicate a virtual position of the reaction force operation device 40 on the display 14. The pointer P is moved based on a position input signal input from the reaction force operation device 40. In this example, the pointer P is moved two-dimensionally on the button display image in conjunction with a two-dimensional movement operation on the reaction force operation device 40 by the user. That is, the user can move the reaction force operation device 40 to freely move the position of the pointer P two-dimensionally.

  The cursor C serves to indicate a button that can be operated at the current position of the pointer P. A cursor C shown in FIG. 5 is located in the button display F3 and indicates that the “mail” button can be operated by the reaction force operation device 40. The cursor C moves in conjunction with the movement of the pointer P. For example, when the pointer P is moved to the position of the button display F4, the position of the cursor C is moved from the button display F3 to the button display F4.

  For example, when the user operates the operation switch 45 of the reaction force operation device 40 in the state shown in FIG. 2, the display control unit 78 responds to the button display image on the display 14 in FIG. It switches from what is shown to the button display image (not shown) only for mail. The button display image may include a plurality of similar buttons for inputting a mail address, a transmission command, and the like. As described above, a large number of button display images may be prepared, and each may have a different button display arrangement.

  Further, for example, in the state shown in FIG. 2, when the user wants to lower the volume of the music being output, the reaction force is used to move the position of the pointer P (and the position of the cursor C) to the button display F10. The movable operation member 44 of the operation device 40 will be moved diagonally right forward. In response to the position input signal input at that time, the display control unit 78 moves the positions of the pointer P and the cursor C. When the pointer P is moved to the vicinity of the button display F10, the cursor C comes to the position of the button display F10. Therefore, if the user operates the operation switch 45 of the reaction force operation device 40 at this time, the user can decrease the volume of the music. Understand that you can. At this time, when the user operates the operation switch 45 of the reaction force operation device 40, the display control unit 78 outputs an instruction to the audio device to lower the volume. Note that the display control unit 78 may decrease the volume by a certain amount each time the user operates the operation switch 45.

  The reaction force map storage unit 73 stores a reaction force map that defines a reaction force to be generated on the movable operation member 44 of the reaction force operation device 40 when the pointer P is present at each coordinate point of the button display image. Yes. A reaction force map is prepared for each button display image. In the reaction force map, the reaction force to be generated on the movable operation member 44 corresponding to each coordinate point of the button display image is such that the pointer P is drawn into the button displays F8 to F11 as shown in FIG. Size and direction are defined. This will be described with reference to FIG.

  FIG. 6 is a diagram schematically showing a reaction force distribution mode on the button display image defined by the reaction force map. The reaction force to be generated by the movable operation member 44 acts on each coordinate point when a suction force generation source (attractor) is virtually arranged on each of the button displays F8 to F11 as indicated by black circles in FIG. It may correspond to the suction force to be performed. That is, a reaction force is generated in the movable operation member 44 as if the pointer P is receiving the suction force from the suction force generation source.

  FIG. 7 is a diagram showing a distribution aspect of the reaction force expressed more visually, and FIG. 7A is a plan view visually showing an action mode of the suction force with respect to two button displays. (B) is a view visually showing the action mode of the reaction force on the movable operation member 44. FIG.

  As shown in FIG. 7A, a suction force that draws the pointer P around each button display is distributed around each button display. In FIG. 7A, the position of the pointer P is indicated by a white circle. Here, a reaction force generated in the movable operation member 44 when the position of the pointer P is moved from the position of the pointer P to the left in the drawing (when the movable operation member 44 is moved in the left direction) will be described.

  First, at the position of the pointer P shown in FIG. 7A, the movable operating member 44 has a reaction force such that the pointer P is pulled in the direction of the button display F2 by the operation of the second motor 52, that is, in the left direction. A pulling force acts. Therefore, in this case, the movable operation member 44 receives a force in the left direction when operated by the user, and the pull-in of the pointer P to the button display F2 (right button display) is realized. At this time, if the user tries to move the movable operation member 44 in the right direction, the pulling force is received as a reaction force, and a relatively large operation force is required.

  When the pointer P is pulled into the button display F2, as long as the pointer P exists in the button display F2, no reaction force is applied to the movable operation member 44. That is, in the movable operation member 44, the reaction force generated by the reaction force generation mechanism 50 is set to a minimum value (for example, zero) within a range where the position of the cursor C does not change from the button display F2. Even in this case, there is a mechanical reaction force generated by the mechanical support structure of the movable operation member 44.

  Further, when the user moves the movable operation member 44 to the left and the position of the pointer P comes near the left end portion of the button display F2, a force (right force) drawn into the button display F2 acts on the movable operation member 44. To do. When the user moves the movable operation member 44 to the left against this pulling force and the position of the pointer P exceeds the midpoint between the button display F2 and the button display F1, the movable operation member 44 is moved to the button display F1 side. A force (a leftward force) is applied to the button display F1. Accordingly, the user is promoted (assisted) by further moving operation of the movable operation member 44 in the left direction by the action of the pulling force. As shown in FIG. 7, this pulling force is reduced to the minimum value when the position of the pointer P comes within the button display F1.

  Thus, according to the present embodiment, the reaction force acting on the movable operation member 44 is such that the position of the pointer P is pulled to a position where the button is displayed, that is, a position where the button related to the button display can be operated. Be controlled. This eliminates the need for the user to match the position of the pointer P and the position of the button display by visual observation (for example, an operation for correcting a slight misalignment is unnecessary), and the operability of the movable operation member 44 is improved. . In addition, the user can feel the reaction force against the movable operation member 44 transmitted through his / her hand so that the user can easily operate the button (for example, without viewing the button display image on the display 14). I can understand that. Further, by increasing or decreasing the force that is drawn into the button display, it is possible to give a sense of moderation to the operation of the movable operation member 44.

  Further, according to the present embodiment, as described above, once the position of the pointer P is pulled into the button display, a pulling force that does not escape from the button display is applied. Even when a relatively small non-artificial force is applied to the member 44, the position of the cursor C does not change from the button display, and the state in which the button related to the button display can be operated is maintained. Accordingly, even when vibration is transmitted to the movable operation member 44 through the operator's hand due to, for example, unevenness on the road surface, the position of the pointer P does not easily deviate from the button display position, and the operator can The input operation can be continued.

  The second embodiment mainly differs from the first embodiment described above in that it includes a movement destination prediction unit that predicts button display of the movement destination of the pointer P (or cursor C). Hereinafter, the same components as those in the first embodiment are denoted by the same reference numerals, and the description thereof is omitted.

  FIG. 8 is a functional block diagram showing the main configuration centering on the processing device 70B in the vehicle input device 10B of the present embodiment. The processing device 70B includes a reaction force control unit 72B, a reaction force map storage unit 73, a position input signal processing unit 74, a movement destination prediction unit 75B, an operation signal processing unit 76, and a display control unit 78. A position input signal processing unit 74 is connected to the movement destination prediction unit 75B.

  The movement destination prediction unit 75B moves the movable operation member 44 by the operator based on the position input signal (position information input from the reaction force operation device 40) input via the position input signal processing unit 74. Predict / estimate the display of the button to move to. For example, the movement destination prediction unit 75B uses the movement vector at the time of initial movement of the movable operation member 44 (particularly, the movement vector of the pointer P when exiting from the current display button area) as the position input signal at the time of the initial movement. The button display that exists in the direction of the movement vector when the start point of the calculated movement vector is placed at the current button display position (for example, the center position) is estimated as the destination button display. Good. The movement destination prediction unit 75B notifies the reaction force control unit 72B of the button display of the estimated movement destination. The movement destination prediction unit 75B may estimate the button display of the movement destination only when a movement vector having a predetermined size or more is calculated in order to eliminate the influence of vibration or the like.

  FIG. 9 is a flowchart showing a flow of main processing realized by the reaction force control unit 72B of the present embodiment.

  In step 100, the reaction force control unit 72B determines whether or not the destination button display is predicted by the destination prediction unit 75B. That is, it is determined whether or not button display of the movement destination of the cursor C intended by the operator is predicted. If the destination button display is not predicted by the destination prediction unit 75B, the process proceeds to step 110; otherwise, the process proceeds to step 120.

  In step 110, the reaction force control unit 72B performs normal reaction force control. The normal reaction force control is a reaction force control mode similar to that of the first embodiment described above, and is based on a reaction force map (reaction force map in which an attractor is present in each button display) from the reaction force map storage unit 73. Then, the reaction force to be applied to the movable operation member 44 is determined, and the reaction force is applied to the movable operation member 44 via the reaction force generation mechanism 50 (see FIG. 6).

  In step 120, the reaction force control unit 72B moves to facilitate and support the movement of the pointer P to the button display of the movement destination predicted by the movement destination prediction unit 75B (moving operation of the movable operation member 44). Perform support reaction force control. Specifically, the reaction force control unit 72B prevents the pointer P from being drawn into button displays other than the predicted movement destination button display (particularly, other button displays around the predicted path of the pointer P). Control reaction force. For example, the reaction force control unit 72B changes the suction force from the button display other than the predicted button display of the movement destination to zero or the minimum value, and the suction force from the predicted button display of the movement destination is most effective. Control the reaction force. This movement assisting reaction force control is continuously executed until the pointer P is drawn into some button display (until a determination of YES in step 130). Here, the reason why some buttons are displayed and the destination buttons are not displayed is because the prediction may not always match the user's intention, and in that case, the button display related to the prediction is used for moving support. This is because it is not useful to continue the reaction force control.

  FIG. 10 is an explanatory diagram of the reaction assistance control for movement support executed in step 120 described above. Here, as shown in FIG. 10, it is assumed that the position of the pointer P and the cursor C is currently in the button display F1, and the user tries to move the position of the pointer P and the cursor C to the button display F10. .

  In this case, the reaction force control unit 72B virtually sets an attractor (suction force generation source) only on the button display F10 as conceptually indicated by a black circle in FIG. The reaction force is controlled so that the pulling force to the button display F2, F5, F6, etc. around the route does not act. As a result, as indicated by a solid line in FIG. 10, the operator can smoothly move the movable operation member 44 without receiving a pulling force to display other buttons. As a result, the pointer P moves to the vicinity of the button display F10 along the intended linear route, and the position of the cursor C can be moved to the button display F10. In this case, the action range of the suction force from the button display F10 may be expanded so that the pull-in to the button display F10 can be realized even from a relatively far position.

  On the other hand, in contrast to FIG. 10, when using a reaction force map that generates a pulling force in all the button displays F1 to F11 as in the case of normal reaction force control, as shown in FIG. When the member 44 is moved and the pointer P approaches the button display F2, F5, F6, etc. around the route, the force is applied to the movable operation member 44 by the suction force from the button display, and the pointer P is moved to the desired button. It is difficult to move linearly to the vicinity of the display F10. For example, as indicated by a solid line in FIG. 11, the pointer P may be drawn into the button display F2 along the route.

  Thus, according to the present embodiment, when the button display of the destination intended by the operator is predicted, the action of the suction force from the button display other than the button display is suppressed or prohibited. The operator can operate the movable operation member 44 with the intended movement (and accordingly the pointer P can be moved with the intended movement), and the operability of the movable operation member 44 is improved.

  In this embodiment, the movement destination prediction unit 75B can be superimposed on the position input signal in consideration of the natural frequency of the movable operation member 44 (or the main body case 42) in advance in order to eliminate the influence of vibration and the like. The vibration component may be filtered.

  The third embodiment is an improved example of the above-described second embodiment, and is mainly different from the above-described second embodiment in that it has a noise canceling function. Hereinafter, the same components as those in the first and second embodiments are denoted by the same reference numerals, and the description thereof is omitted.

  FIG. 12 is a functional block diagram showing a main configuration centering on the processing device 70C in the vehicle input device 10C of the present embodiment. The processing device 70C includes a reaction force control unit 72C, a reaction force map storage unit 73, a position input signal processing unit 74, a movement destination prediction unit 75C, an operation signal processing unit 76, a noise removal signal generation unit 77, A display control unit 78 is provided. The noise removal signal generation unit 77 is connected to the movement destination prediction unit 75C together with the position input signal processing unit 74.

  The noise removal signal generation unit 77 generates a noise removal signal that simulates the vibration having the opposite phase to the vibration applied to the movable operation member 44 (or the main body case 42), and supplies the noise removal signal to the movement destination prediction unit 75C. A signal applied to the movable operation member 44 may be detected based on, for example, an acceleration sensor. The noise removal signal generated by the noise removal signal generation unit 77 is input to the movement destination prediction unit 75C in synchronization with the processed position input signal from the position input signal processing unit 74.

  Based on the noise removal signal, the movement destination prediction unit 75C removes a vibration component that can be superimposed on the position input signal, and the operator moves the movable operation member 44 based on the noise-removed position input signal. Estimate the button display of the destination. The movement support reaction force control by the reaction force control unit 72C using the estimation method of the destination button display and the estimation result may be the same as in the second embodiment.

  As described above, according to the third embodiment, it is possible to accurately predict the button display of the destination intended by the operator without being affected by the vibration peculiar to the vehicle that can be applied to the movable operation member 44.

  The fourth embodiment is mainly different from the first embodiment described above in that it has a destination prediction unit that predicts the button display of the destination of the pointer P (or cursor C), and the prediction method by the destination prediction unit is as described above. Mainly different from the second embodiment. Hereinafter, the same components as those in the first embodiment are denoted by the same reference numerals, and the description thereof is omitted.

  FIG. 13 is a diagram conceptually showing the main configuration of a vehicle input device 10D according to the fourth embodiment of the present invention. As shown in FIG. 13, the vehicle input device 10 </ b> D of the present embodiment includes a reaction force operation device 40, a display 14, a camera 18, and a processing device 70 </ b> D.

  The camera 18 is, for example, a camera provided with a color or infrared sensitive CCD (charge-coupled device) sensor array. For example, it is provided at an appropriate location of the vehicle so that the front surface of the driver (for example, the face portion from the front) can be captured. For example, the camera 18 is installed at an appropriate location such as a vehicle rearview mirror, a dashboard of an instrument panel, or a steering column. The camera 18 may acquire the image of the driver in real time and supply it to the processing device 70D in a stream format of a predetermined frame period (for example, 30 fps).

  FIG. 14 is a functional block diagram showing a main configuration centering on the processing device 70D in the vehicle input device 10D of the present embodiment. The processing device 70D includes a reaction force control unit 72D, a reaction force map storage unit 73, a position input signal processing unit 74, a movement destination prediction unit 75D, an operation signal processing unit 76, a display control unit 78, and line-of-sight detection. A portion 79 is provided. The camera 18 is connected to the line-of-sight detection unit 79.

  The line-of-sight detection unit 79 recognizes the direction of the driver's line of sight by image processing on each image acquired by the camera 18 and generates information on the direction of the driver's line of sight. For example, the line-of-sight detection unit 79 first extracts representative points (feature points) near the eyes of the face from the image acquired by the camera 18. This feature extraction method may be any appropriate method, and for example, a technique based on Active Appearance Model (AAM) may be used. Then, an appropriate edge detection algorithm (for example, Sobel's edge detection algorithm) is applied to extract the feature boundaries around the eyes. Next, the line-of-sight detection unit 79 extracts the outline of the eyeball using the edge and feature points around the eye extracted as described above, and based on the position of the eyeball within the eye outline, as shown in FIG. Thus, the direction of the driver's line of sight may be detected. Since the position of the eyeball varies between individuals, a reference image corresponding to each line of sight is obtained in advance for each user by a test or the like, and the direction of the driver's line of sight is detected by comparison with the reference image. May be. The line-of-sight information detected by the line-of-sight detection unit 79 is supplied to the movement destination prediction unit 75D.

  Based on the line-of-sight information supplied from the line-of-sight detection unit 79, the movement destination prediction unit 75 </ b> D estimates the button display of the movement destination when the operator moves the movable operation member 44. For example, the movement destination prediction unit 75D may derive a vector representing the line of sight, and estimate the button display at the position on the display 14 that exists in the direction of the derived line-of-sight vector as the movement destination button display. In other words, the button display ahead of the operator's line of sight (the button display actually viewed by the operator) may be estimated as the button display of the movement destination. The movement destination prediction unit 75D notifies the reaction force control unit 72D of the estimated movement destination button display. The reaction force control for movement support by the reaction force control unit 72D using the estimation result of the button display of the movement destination may be the same as in the second embodiment.

  As described above, according to the present embodiment, when the button display of the movement destination intended by the operator is predicted as in the second embodiment, the action of the suction force from the button display other than the button display is performed. Therefore, the operator can operate the movable operation member 44 with the intended movement (and accordingly the pointer P can be moved with the intended movement), and the operability of the movable operation member 44 is improved. improves.

  The preferred embodiments of the present invention have been described in detail above. However, the present invention is not limited to the above-described embodiments, and various modifications and substitutions can be made to the above-described embodiments without departing from the scope of the present invention. Can be added.

  For example, in the above-described embodiment, both the pointer P and the cursor C are used to indicate the current position of the movable operation member 44 (virtual position on the display 14), but only one of them is used. It is also possible.

  In the above-described embodiment, the reaction force operation device 40 is a joystick-type device, but may be a mouse-type device that can input a position signal by its own movement.

  In the above-described embodiment, the suction force in the surrounding area of the button display is not different between the button displays, but the superiority or inferiority of the suction force may be set between the button displays. For example, a larger suction force may be applied to a button display related to a button having a high operation frequency or a higher importance level than a button display related to a button having a low operation frequency. Also, the distribution mode of the attractive force is not limited to the above-described embodiment. For example, the center point of each button display is regarded as a negative charge, the pointer P is regarded as a positive charge, and the positive charge at each coordinate point. It is also possible to obtain an electrostatic attractive force acting on the reaction force and to perform a reaction force control that realizes the electrostatic attractive force.

  In the above-described embodiment, the reaction force generation mechanism 50 is realized by using the two motors 54 and 52. However, other types of actuators may be used, and fluid pressure, magnetic force, or the like may be used. A reaction force may be uttered.

  In the above-described embodiment, the rotational torques of the motors 54 and 52 are changed to the rotation of the Y-axis member 47 and the X-axis member 45 (and thus the reaction force against the moving operation of the movable operation member 44). , 59, it may be converted via a mechanism using a belt, a chain, or the like.

  In addition, the second or third embodiment and the fourth embodiment do not violate each other, and can be realized by combining them.

  In the above-described embodiment, a contact sensor may be provided on the movable operation member 44, and the reaction force control units 72A to 72D may be activated only when there is a hand contact with the movable operation member 44.

It is a figure which shows notionally the main structure of 10 A of vehicle input devices which concern on Example 1 by this invention. 3 is a schematic diagram illustrating an example of a main configuration of a reaction force operation device 40. FIG. 3 is a schematic diagram illustrating an example of a reaction force generation mechanism 50. FIG. It is a functional block diagram which shows the main structures centering on 70 A of processing apparatuses. 6 is a diagram illustrating an example of a button display image displayed on a display 14. FIG. It is a figure which shows typically the distribution aspect of the reaction force on a button display image. FIG. 7A is a plan view visually showing the action mode of the suction force with respect to the display of two buttons, and FIG. 7B visually shows the action mode of the reaction force on the movable operation member 44. FIG. It is a functional block diagram which shows the main structures centering on the processing apparatus 70B in the input device 10B for vehicles of a present Example. It is a flowchart which shows the flow of the main processing implement | achieved by the reaction force control part 72B of a present Example. It is explanatory drawing of the reaction force control for movement assistance performed in step 120. FIG. It is a figure which shows the operation mode when not performing reaction force control for movement assistance as a comparative example with respect to a present Example. It is a functional block diagram which shows the main structures centering on the processing apparatus 70C in the input device 10C for vehicles of a present Example. It is a figure which shows notionally the main structure of input device 10D for vehicles which concerns on Example 4 by this invention. It is a functional block diagram which shows the main structures centering on processing apparatus 70D in the input device 10D for vehicles of a present Example. It is a figure which shows an example of a gaze detection method roughly.

Explanation of symbols

10A to 10D Vehicle input device 14 Display 18 Camera 40 Reaction force operation device 44 Movable operation member 50 Reaction force generation mechanism 70A to 70D Processing device 72A to 72D Reaction force control unit 73 Reaction force map storage unit 74 Position input signal processing unit 75B ˜75D Destination prediction unit 76 Operation signal processing unit 78 Display control unit 79 Gaze detection unit

Claims (1)

A movable operation member that can input position information by being moved, and
A reaction force generation mechanism capable of generating a physical reaction force with respect to the movement operation of the movable operation member;
Display control means for changing a relative position of a pointer or a cursor with respect to button display based on the input position information on a screen displaying a plurality of button displays corresponding to a plurality of buttons ;
A destination prediction unit that predicts a button display of a destination of a pointer or cursor based on a user's line of sight recognized based on an image of a user's face captured by a camera;
Reaction force control means for controlling the reaction force generation mechanism so that a pulling force that causes the pointer or cursor to be pulled into the position of the button display acts on the movable operation member ,
The input device for a vehicle, wherein the reaction force control means reduces or eliminates a pulling force for a button display other than the button display of the movement destination based on a prediction result of the movement destination prediction means .

Images