JP2009181423A - Operation input device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an operation input device preventing an input error and enabling more precise input. <P>SOLUTION: An operation input section 15 includes: a palm rest 21 and a hand detection sensor 23 on the top surface of a case 19; and for example, an analog resistive film touch panel 17 on the forward top surface of the case 19. The palm rest 21, on which a palm is placed when operating the touch panel 17, is a plane slightly inclined forward to a horizontal position. In particular, the touch panel 17 is inclined downward to the surface of the palm rest 21. In other words, the inclination angle of the touch panel 17 is set so that fingertips (in detail, the cushion of the fingertips) naturally touch the surface (panel face) of the touch panel 17, when placing a palm on the palm rest 21. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to an operation input device capable of manual input using, for example, a touch panel.

  Conventionally, a remote controller has been known as a device for operating an in-vehicle device such as a car navigation system, but in order to solve the difficulty of handling this remote controller (for example, finding a remote controller by hand, holding it in a hand, and inputting a button). Various techniques have been proposed.

For example, Patent Documents 1 and 2 disclose a prompter type remote control device using a touch panel and a camera. With this technology, a touch panel is provided on the armrest, etc., and a monitor is provided at a position away from the touch panel (for example, a position where the dashboard is easy to see). This is a technique for superimposing and displaying a photographed finger as it is or image-processing on a graphic user interface image (for example, a GUI image such as an operation menu) photographed by a placed camera and displayed on a monitor.
JP 2007-156950 A JP 2007-272596 A

  However, the techniques disclosed in Patent Documents 1 and 2 have a problem in that the contact area of the touch panel varies depending on the angle of the operator's finger, resulting in variations in the on-force that the operator feels. In addition, since the angle of the finger pressing the touch panel differs depending on the operator, there is also a problem that the distance from the fingertip to the touch position varies.

  For example, as shown in FIG. 13A, in an apparatus that determines the operation position of the input button on the monitor from the image of the fingertip on the touch panel, when the touch panel is pressed with the toe, ) And the fingertip position obtained from the image (that is, the operation position set inward a predetermined distance from the tip of the finger: ▽ position in the figure) may be displaced. Further, as shown in FIGS. 13B and 13C, even when the touch panel is pressed with the belly of the fingertip, the actual touch position and the fingertip position obtained from the image may vary depending on the angle of the finger. there were.

  In other words, the above-described prompter type remote control device has a problem in that an unintended input (i.e., an input error such as an input error) may occur due to variations in touch input by an operator.

  In view of the above points, an object of the present invention is to provide an operation input device that prevents input errors and enables more accurate input.

  (1) The invention according to claim 1 (operation input device) includes a finger operation input unit that detects an input position by a finger, and a palm rest unit that serves as a table for placing a palm when operating the finger operation input unit. The finger operation input unit and the palm rest unit are disposed adjacent to each other, and the surface of the finger operation input unit is inclined downward from an extension surface forward of the surface of the palm rest unit.

Since the operation input device of the present invention includes the palm rest portion on which the palm is placed, the position of the hand is stabilized, and it becomes easy to input with a fingertip to a desired position in the finger operation input portion.
In particular, in the present invention, since the surface of the finger operation input unit is inclined downward from the surface of the palm rest unit, when the palm is placed on the palm rest unit, the finger operation input unit is located at a position where the fingertip bends naturally. Yes, the tip of the fingertip naturally touches the surface of the finger operation input unit. Therefore, since the contact area where the fingertip of the driver or the like touches the finger operation input unit is always constant, the force for turning on that the driver or the like feels does not easily vary, and the touch position from the fingertip (for input) The distance to the contact position) is less likely to vary.

For this reason, in this invention, since there is little variation in touch input, there exists a remarkable effect that it is hard to generate unintended input (namely, input mistakes, such as an input mistake).
(2) In invention of Claim 2, the angle of the surface of the said finger operation input part and the extended surface of the said palm rest part is the range of 10-90 degree | times (more preferably 15-60 degree | times), It is characterized by the above-mentioned. To do.

The present invention exemplifies a preferable angle between the surface of the finger operation input unit and the extended surface of the palm rest unit.
(3) In invention of Claim 3, the surface of the said palm rest part consists of a surface of a plane, a curved surface, or those combination.

The present invention exemplifies a preferable manifestation shape of the palm rest portion. In particular, it is preferable that the surface shape of the palm rest portion is formed in a convex shape according to the curvature of the palm.
(4) The invention of claim 4 is characterized in that an intermediate portion having a flat surface, a curved surface, or a combination surface thereof is provided between the palm rest portion and the finger operation input portion.

This invention illustrates the preferable shape of the joint part between a palm rest part and a finger operation input part.
(5) The invention (operation input device) according to claim 5 includes a finger operation input unit that detects an input position by a finger, and an armrest unit that serves as a base on which an arm is placed when the finger operation input unit is operated. The surface of the finger operation input unit is inclined downward from the front surface extending from the surface of the armrest unit.

  In the operation input device of the present invention, the surface of the finger operation input unit is inclined downward from the surface of the armrest unit. Therefore, when the arm is placed on the armrest unit, the fingertip is positioned at a position where the fingertip is naturally positioned. There is an operation input unit, and the belly part of the fingertip naturally touches the surface of the finger operation input unit. Therefore, since the contact area where the fingertip of the driver or the like touches the finger operation input unit is always constant, the force for turning on that the driver or the like feels does not easily vary, and the touch position from the fingertip (for input) The distance to the contact position) is less likely to vary.

Therefore, in the present invention, since there is little variation in touch input, there is a remarkable effect that an unintended input (that is, an input error such as an input error) hardly occurs.
(6) In the invention of claim 6, the angle between the surface of the finger operation input portion and the extended surface of the armrest portion is in the range of 10 to 90 degrees (preferably 15 to 60 degrees). .

The present invention exemplifies a preferable angle between the surface of the finger operation input unit and the extended surface of the armrest unit.
(7) The invention according to claim 7 is characterized in that the surface of the finger operation input unit is a plane, a curved surface, or a combination thereof.

The present invention exemplifies a preferable manifestation shape of the finger operation input unit.
(8) The invention of claim 8 further includes a photographing device for photographing a finger on the finger operation input unit, and based on a signal from the finger operation input unit and a signal from the photographing device, the finger An input process corresponding to the input operation is performed.

  In the present invention, a signal indicating the input position from the finger operation input unit (for example, a signal indicating where the touch panel is touched and input) and a signal indicating the image of the finger from the photographing apparatus are used. From the signal, it is possible to make the input position on the finger operation input unit correspond to the position of the image of the finger displayed on the display device, for example. Therefore, for example, it is possible to easily determine which finger of the display device is operated with which finger.

  (9) In the invention of claim 9, the operation input device is a remote operation input device in which the finger operation input unit and a display device for displaying image information obtained from the photographing device are arranged apart from each other. It is characterized by that.

  In the present invention, since the finger operation input unit and the display device are arranged apart from each other, the finger operation input unit can be arranged at a natural position of the finger and the display device can be arranged at an excellent position such as visibility. . Therefore, operation of various devices is facilitated.

(10) The invention of claim 10 is characterized in that a finger image indicating a finger on the operation input surface is extracted from an image photographed by the photographing device.
That is, since the captured image shows a finger, a finger image indicating the shape of the finger can be extracted from the image. In addition to the captured finger image itself, the finger image includes, for example, an image obtained by processing the image (for example, a translucent finger image or a finger image with only an outline).

(11) In the invention of claim 11, an operation menu is displayed on the display device, and the finger image is displayed in an overlapping manner.
Thereby, since the relationship between the position of the finger and the position of the operation menu becomes clear, operation of the operation menu becomes easy. For example, it is possible to easily grasp which operation button on the display device has been operated.

(12) The invention of claim 12 is characterized in that a fingertip position which is an operation position on the display device is detected from the finger image.
For example, when a predetermined distance from the fingertip is the fingertip position for operation, the fingertip position can be obtained from the shape of the finger.

  (13) In the invention of claim 13, selection of the operation menu based on a fingertip position detected from the finger image and a signal (for example, a touch signal of a touch panel) indicating a finger operation from the finger operation input unit It is characterized by performing processing.

  In the present invention, since the finger position obtained from the finger image and the signal indicating the operation obtained from the finger operation input unit are used, for example, there are a plurality of fingers displayed on the display screen, and the fingertip position obtained from the finger image In the case where there are a plurality of, for example, the actually operated finger is selected from the coordinates obtained from the touch signal, and for example, it can be determined that the input button corresponding to the fingertip position of the finger is operated.

(14) The invention of claim 14 is characterized in that a material that transmits light that can be photographed by the photographing apparatus is used for an operation input surface on which a finger of the finger operation input unit is placed.
In the present invention, the operation input surface on which the finger is placed has translucency with respect to light such as near-infrared light. Therefore, the operation input surface is photographed from above or below the operation input surface using light transmitted through the operation input surface. By doing so, it is possible to obtain a clear image of the fingers.

  (15) In the invention of claim 15, the photographing that includes a light irradiation unit that irradiates light toward the lower surface of the operation input surface below the operation input surface and photographs the lower surface side of the operation input surface. A device is provided.

In this invention, the arrangement | positioning of the light irradiation part and imaging device for image | photographing fingers is illustrated.
(16) The invention of claim 16 includes a light irradiating unit that irradiates light toward the upper surface of the operation input surface below the operation input surface, and the operation input surface above the operation input surface. The imaging apparatus is provided for imaging the upper surface side of the camera.

In this invention, the arrangement | positioning of the light irradiation part and imaging device for image | photographing fingers is illustrated.
(17) The invention of claim 17 is characterized in that the finger operation input unit is a touch panel.

  The present invention exemplifies a finger operation input unit. Here, when an analog resistive film type touch panel is adopted as the touch panel, the finger can be positioned while the finger is lightly in contact with the finger operation input unit. Also, unintended input can be suitably prevented.

  (18) In the invention of claim 18, instead of the finger operation input unit that detects the input position by the finger, a finger operation input unit that is a single switch that performs an on / off operation according to the pressed state of the finger is used. It is characterized by that.

  The present invention exemplifies a finger operation input unit. For example, when a finger is photographed with the photographing apparatus, if the finger operation input unit is operated, it is possible to perform input processing on the assumption that the operation is performed at the position of the photographed finger. Therefore, a complicated mechanism such as a touch panel can be omitted.

  (19) The invention according to claim 19 is characterized in that the operation input device is a device used for at least one of car navigation operation, audio operation, air conditioner operation, and vein authentication.

  The present invention exemplifies the use of the operation input device, and various devices can be easily operated by operating the finger at a natural position. In addition, since the operation input device captures the finger on the finger operation input unit, it can be used for vein authentication by adjusting the illumination and the imaging direction to enable imaging of the vein.

(20) The invention of claim 20 is characterized in that the operation input device is a device used in a vehicle.
By using the operation input operation of the present invention in a vehicle, a driver or the like can suitably operate various devices mounted on the vehicle.

(21) The invention according to claim 21 is characterized in that the operation input device is arranged in at least one of a center console, a door, a seat, and a steering.
The present invention exemplifies a preferable arrangement of the operation input device. Note that the height and direction of the driver's arms and hands vary depending on the position of the operation input device (specifically, the finger operation input unit on which the hand is placed or the palm rest). Thus, the gradient of the operation input position (that is, the gradient of the finger operation input unit or the palm rest unit) may be determined as appropriate.

Next, the best mode (embodiment) of the present invention will be described.
[First Embodiment]
a) First, a schematic configuration of a car navigation device in which the operation input device of the present embodiment is used will be described.

As shown in FIG. 1, the car navigation device 1 is arranged in a vehicle cabin and includes a display device 3, an operation input device 5, and the like.
The display device 3 is a display that displays on a map for navigation or displays a menu image (menu screen) or the like for manual input. It is installed at a position visible to the driver from the driver.

  The operation input device 5 performs processing corresponding to the operation of the finger of the driver who operates the car navigation device 1, and includes an illumination device 7 that emits light, a photographing device 9 that photographs a finger and the like, A control unit 11 that performs control, an image memory 13 that stores captured images and the like, an operation input unit 15 that performs palm placement and finger input, and the like.

  Among these, the said illuminating device 7 is comprised so that light emission of infrared light (specifically near-infrared light) is possible, and what emits infrared rays directly like an infrared LED, an incandescent lamp, a Nernst Grower lamp. In addition, a light emitter such as a global, arc discharge tube, tungsten lamp or the like equipped with an infrared transmission filter is used.

As shown in FIG. 2, the illumination device 7 is disposed inside the housing 19 of the operation input unit 15 so that the emitted infrared light strikes the lower surface (back side) of the touch panel 17.
The photographing device 9 is a camera configured to be able to acquire an infrared image. Specifically, an imaging device for capturing a visible image, a reflecting mirror that reflects infrared light, a lens for condensing infrared light, or a nonlinear optical material that converts infrared light into visible light is used. It consists of an optical wavelength conversion element or the like.

  The photographing device 9 has a focus at a position where the driver's finger is displaced from the touch panel 17 toward the driver's finger, and the surface opposite to the surface of the driver's finger that is exposed to external light, that is, the touch panel 17 is arranged. Specifically, it is disposed at a position where photographing can be performed from the back side, specifically, below the touch panel 17 inside the housing 19.

  The image memory 13 stores an image (lighted image) acquired by the photographing device 9 with the lighting device 7 turned on, an image (lighted image) obtained by the photographing device 9 with the lighting device 7 turned off, and the like. It is memory.

  As shown in FIG. 3, the operation input unit 15 includes a palm rest 21 and a hand detection sensor 23 on the upper surface of the housing 19, and the touch panel 17, which is a finger operation input unit, on the front upper portion of the housing 19. I have.

  Among these, the palm rest 21 is a table on which a palm is placed when the touch panel 17 is operated, and is a plane inclined slightly downward (for example, 30 degrees) from the horizontal as shown in FIG.

  The hand detection sensor 23 is a sensor for detecting whether or not the driver's hand is placed on the operation position (that is, the palm is placed on the palm rest 21). Specifically, the hand detection sensor 23 is a micro switch or a pressure sensitive sheet. .

  The touch panel 17 is used for the driver to press and input the surface of the car navigation apparatus 1 with his / her fingers, for example, input of a destination, setting input for enlargement / reduction of display, and the like. For example, the analog resistive film type touch panel 17 is a flat plate formed of a material that transmits infrared rays, for example, an acrylic plate.

  In particular, in the present embodiment, the touch panel 17 is inclined below the surface of the palm rest 21 by, for example, 30 degrees. That is, when the palm is placed on the palm rest 21, the inclination angle of the touch panel 17 is, for example, 30 degrees so that the fingertip (specifically, the belly part of the fingertip) naturally touches the surface (panel surface) of the touch panel 17 Is set to

  Note that XY coordinates are set on the touch panel 17 so that it can be distinguished where it is touched, and correspondingly, the display screen of the display device 3 (for example, a menu screen on which a menu image is displayed) is also displayed. Similarly, XY coordinates are set.

  Therefore, for example, when the (1, 1) coordinate is touched on the touch panel 17, the display device 3 also performs processing related to the corresponding (1, 1) coordinate (for example, processing for displaying a mark or the like). Can be done.

  The control unit 11 is an electronic control device including a CPU, ROM, RAM, I / O, and the like (not shown). As will be described later, a signal (touch signal indicating input coordinates) from the touch panel 17 and photographing. A signal (image signal) from the device 9 is input, and processing for displaying an image on the display device 3 and processing for operating other devices are performed based on these signals.

Examples of other devices include devices such as an air conditioner, an audio, and a vein recognition device.
b) Next, a characteristic processing method performed by the control unit 11 will be described.

(1) Finger Image Extraction Method Here, a finger image is extracted by a method described in, for example, Japanese Patent Application Laid-Open No. 2007-272596.

  That is, in the control unit 11, when the hand detection sensor 23 is on, that is, when the driver places a finger on the touch panel 17, an image (lighted image) acquired by the photographing device 9 with the illumination device 7 turned on. ) And an image (light-off image) acquired by the photographing device 9 in a state where the lighting device 7 is turned off, a process of extracting a finger image is performed.

  More specifically, the lighting device 7 is turned on, an image (lighted image) is acquired by the photographing device 9, and the acquired lighted image is stored in the image memory 13. Next, the lighting device 7 is turned off, and an image (light-off image) is acquired by the photographing device 9, and the light-off image is stored in the image memory 13. And a driver | operator's finger is extracted based on the image (difference image) of the difference between the lighting image and the extinguishing image stored in the image memory 13.

Here, the principle of extracting the fingers of the driver based on the lit image and the unlit image will be described with reference to FIG.
When the external light illuminance is strong, as shown in FIG. 4A, the driver's finger hardly appears in the lit image, but the finger appears as a strongly shaded shadow in the unlit image. Therefore, if the difference between the two is taken, a finger image (difference image) can be obtained. On the other hand, when the illuminance of outside light is weak, as shown in FIG. For this reason, since the shadow of the finger cannot be obtained in the extinguished image, a finger image (difference image) can be obtained by taking the difference between the two.

(2) Fingertip position detection method Using the finger image extracted by the above-described method, for example, a predetermined distance from the tip of the finger toward the root side and the center in the width direction is set as the fingertip position.

  This fingertip position indicates the central part of the belly of the finger from the fingertip to the first first indirect. This is because it is considered that there is a high possibility that the touch panel 17 is pressed at a portion where the belly of the finger is most exposed.

  Accordingly, as shown in FIG. 5, the display device 3 displays a finger image (for example, a semi-transparent finger image modeled with contour enhancement), and also displays the fingertip position with an X mark superimposed thereon. . Therefore, it is possible to easily show the occupant which part is used to operate the operation button 25 and the like.

(3) Input correction method of the touch panel 17 In the case of pen input, input is made at a point with the pen tip and can be input to the touch panel 17 with high accuracy. Variations occur in the 17 detected coordinates.

  Therefore, here, a process of matching the coordinates detected by the touch panel 17 with the fingertip position detected from the image is performed. That is, when there is an input on the touch panel 17, it is processed as if there was an input with the coordinates of the fingertip position of the image instead of the coordinates of the touch panel 17.

  Specifically, for example, even when the fingertip position is present as indicated by the + mark, the actual touch position may be misaligned as indicated by the circle mark. Therefore, even if the input coordinate detected by the touch panel 17 is the position of the circle mark, the coordinate of the fingertip position of the + mark is processed (matched) as the input coordinate. As this fitting method, various methods such as adopting the fingertip position of the finger image corresponding to the touch position can be adopted (see Japanese Patent Application No. 2007-77330).

c) Next, the content of the process performed in the control part 11 is demonstrated based on a flowchart.
As shown in the flowchart of FIG. 6, in step (S) 100, a method of using the above-described difference image using camera images (lighted images and unlit images) obtained by driving the illumination device 7 and the photographing device 9. Thus, the fingertip region indicating the fingertip portion is extracted.

In the following step 110, the fingertip position is detected from the extracted finger area.
In the following step 120, as shown in FIG. 5, the fingertip position is displayed on a menu image, for example. At the same time, a translucent fingertip image is displayed superimposed on the menu image.

  In subsequent step 130, whether or not the touch panel 17 has been operated is determined by whether or not there is an input signal (touch signal) from the touch panel 17. If an affirmative determination is made here, the process proceeds to step 140, while if a negative determination is made, the process returns to step 100.

In step 140, touch coordinates indicating the touch position of the touch panel 17 are input, and a fingertip corresponding to the touch coordinates is selected based on the finger image.
In the subsequent step 150, the touch coordinates are corrected to the fingertip position of the selected finger. That is, here, it is assumed that the touch is made at the selected fingertip position (that is, the operation button 25 is operated) instead of being touched at the touch coordinates, and processing corresponding to the operation button 25 is performed. Do it.

  d) Thus, in this embodiment, while providing the palm rest 21 and the touch panel 17 in the operation input part 15, the touch panel 17 is provided so that it may incline below the surface of the palm rest 21. FIG. Therefore, when the palm is placed on the palm rest 21, the belly portion of the fingertip can naturally touch the surface of the touch panel 17.

Therefore, since the contact area where the driver's fingertip touches the touch panel 17 is always constant, the driver's feeling of turning on is less likely to vary.
Conventionally, the angle of the finger that presses the touch panel differs depending on the driver, so the distance from the fingertip to the touch position varies, but in this embodiment, the touchscreen 17 is at a position where the fingertip naturally bends. The distance is less likely to vary.

  That is, in the conventional prompter type remote control device, since there is a variation in the touch input by the driver, an unintended input (that is, an input error such as an input error) is likely to occur. However, in this embodiment, such an input error is likely to occur. And more accurate input is possible.

  Furthermore, in this embodiment, since the surface input is performed by the finger pad, the pressure applied to the touch panel 17 can be dispersed. For example, even if the user touches the touch panel 17, unintended input is unlikely to occur and is fine. Finger alignment is possible.

  In this embodiment, since the analog resistive touch panel 17 is used, unintentional input hardly occurs even when the touch panel 17 is traced, and fine finger positioning is possible. become.

  In this embodiment, the palm is placed on the fixed palm rest 21. However, the palm rest may be slidable in the front-rear direction. Thereby, there exists an advantage that operativity improves further.

Further, since the fingertip can be detected by image processing, the hand detection sensor 23 may be omitted.
[Second Embodiment]
Next, the second embodiment will be described, but the description of the same content as the first embodiment will be omitted.

As shown in FIG. 7A, the operation input device of this embodiment includes an operation input unit 35 having a touch panel 31 and a palm rest 33, as in the above-described embodiment.
In particular, in the present embodiment, the palm rest 33 is horizontal, and the upper surface of the intermediate portion 37 between the palm rest 33 and the touch panel 31 is smoothly curved.

This embodiment also has the same effect as the first embodiment.
Note that the upper surface of the intermediate portion may be bent at an obtuse angle or may be formed in multiple surfaces.
Moreover, as shown in FIG.7 (b), the inclination-angle (inclination angle from the plane which the upper surface of the palm rest 33 forms) of the touchscreen 31 can be suitably selected in 10-90 degree | times. This inclination angle is the same in other embodiments.

[Third Embodiment]
Next, the third embodiment will be described, but the description of the same contents as the first embodiment will be omitted.

  As shown in FIG. 8, the operation input device according to the present embodiment is configured such that an operation input unit 47 having a touch panel 43 and a palm rest 45 is connected in front of a horizontally extending armrest 41 (left side in the figure).

  In the present embodiment, the operation input unit 47 is greatly inclined forward as compared with the first embodiment. That is, the palm rest 45 tilts forward at a large inclination angle (for example, 30 degrees) with respect to the upper surface of the armrest 41 from the front end of the armrest 41, and the touch panel 43 extends from the front end of the palmrest 45 to the upper surface of the palmrest 45. It is inclined forward at an inclination angle similar to the form (for example, 30 degrees).

  In this embodiment, the same effect as that of the first embodiment is obtained, and the operation input unit 47 is connected to the front of the armrest 41, so that there is an advantage that the position of the finger is stabilized.

[Fourth Embodiment]
Next, the third embodiment will be described, but the description of the same contents as the first embodiment will be omitted.

  As shown in FIG. 9, the operation input device of this embodiment is provided with an operation input unit 55 having a touch panel 51 and a palm rest 53 similar to those of the first embodiment inside the door.

  In this embodiment, the position of the driver's seat and the door are separated from each other, and when the hand is extended from the handle position in the door direction (lateral direction), the palm or fingertip is positioned in a natural position. An angle is set.

  That is, the operation input unit 55 of the present embodiment is inclined backward as compared with the first embodiment, and the palm rest 53 is inclined backward by, for example, 40 degrees from the horizontal plane. Note that the touch panel 51 is inclined 30 degrees forward from the palm rest 53 as in the first embodiment.

In the present embodiment, the same effects as in the first embodiment can be obtained.
[Fifth Embodiment]
Next, a fifth embodiment will be described, but the description of the same contents as the third embodiment will be omitted.

As shown in FIG. 10, the operation input device of this embodiment is provided with an operation input unit 63 in front of the horizontally extending armrest 61 (left side in the figure).
In the present embodiment, the operation input unit 63 is provided with only a touch panel 65 without a palm rest, and the touch panel 65 is inclined forward by 60 degrees with respect to the upper surface of the armrest 61, for example.

  That is, in the present embodiment, the driver's arm is supported by the armrest 61, and the position of the palm and the inclination angle thereof are naturally determined. Therefore, only the touch panel 65 is provided at the position where the fingertip touches.

In the present embodiment, the same effects as in the third embodiment can be obtained.
[Sixth Embodiment]
Next, although the sixth embodiment will be described, description of the same contents as those of the first embodiment will be omitted.

  As shown in FIG. 11, the operation input device of the present embodiment has a curved upper surface of the operation input unit 71, that is, an upper surface of the palm rest 73, such as the surface of a mouse so as to protrude upward.

In the present embodiment, the same effects as those of the first embodiment are obtained, and when the palm is placed on the palm rest 73, there is an advantage that the position of the palm (fingertip) is stabilized.
In addition, the curve direction of the upper surface of the palm rest 73 may be only the front-rear direction or the left-right direction of the vehicle. Moreover, even if it is not a curved surface, it may be a polyhedron or a combination of a curved surface and a flat surface.

[Seventh Embodiment]
Next, the seventh embodiment will be described, but the description of the same contents as the first embodiment will be omitted.

  In this embodiment, an operation panel (not shown) capable of transmitting infrared light is arranged on the touch panel portion without using the touch panel as in the above embodiment, and the operation panel is configured as a single switch. is there. The parts other than the operation panel will be described with reference to the figure numbers in FIG.

That is, finger image processing is performed in the same manner as in the first embodiment, but when the operation panel is pressed, it is determined that an operation has been performed at a predetermined finger position.
Hereinafter, the control processing of this embodiment will be described.

  As shown in the flowchart of FIG. 12, step 200 uses a camera image (lighted image and unlit image) obtained by driving the illumination device 7 and the photographing device 9, and uses the above-described difference image to obtain a fingertip portion. Is extracted.

In the following step 210, the fingertip position is detected from the extracted finger area.
In the following step 220, the fingertip position is displayed on the menu image, and at the same time, a translucent fingertip image is displayed superimposed on the menu image.

  In the next step 230, it is determined whether or not the operation panel, which is a single switch, has been pressed or operated. If an affirmative determination is made here, the process proceeds to step 240. If a negative determination is made, the process returns to step 200.

In step 240, the fingertip position obtained by the image processing is selected as the operation position of the display device 3, and this processing is temporarily ended.
Accordingly, it is assumed that the selected fingertip position is touched in the same manner as the touch panel (that is, the operation button 25 is operated), and processing corresponding to the operation button 25 is performed.

In the present embodiment, there are advantages that the same effects as in the first embodiment can be obtained and the touch panel can be omitted.
As mentioned above, although embodiment of this invention was described, this invention is not limited to this embodiment, A various aspect can be taken.

(1) For example, an operation input unit may be provided on the handle. In this case, a palm rest and a touch panel (the touch panel is on the tip side) are provided along the circumferential direction of the handle.
(2) The operation input unit may be provided on the left and right side surfaces of the seat. In this case, a palm rest and a touch panel (the touch panel is below) are provided in the vertical direction.

It is explanatory drawing which shows the structure of the vehicle-mounted operation input device of 1st Embodiment. It is a block diagram which shows the structure of an operation input device. It is a perspective view which shows an operation input part. It is explanatory drawing which shows the extraction method of a finger image. It is explanatory drawing which displayed the finger image superimposed on the screen of the operation menu. It is a flowchart which shows the process of the operation input apparatus of 1st Embodiment. It is explanatory drawing which shows the operation input device of 2nd Embodiment, and its modification. It is explanatory drawing which shows the operation input device of 3rd Embodiment. It is explanatory drawing which shows the operation input device of 4th Embodiment. It is explanatory drawing which shows the operation input device of 5th Embodiment. It is explanatory drawing which shows the operation input device of 6th Embodiment. It is a flowchart which shows the process of the operation input apparatus of 7th Embodiment. It is explanatory drawing of a prior art.

Explanation of symbols

DESCRIPTION OF SYMBOLS 3 ... Display apparatus 5 ... Operation input apparatus 9 ... Imaging device 11 ... Control part 15, 35, 47, 55, 63, 71 ... Operation input part 17, 31, 43, 51, 65 ... Touch panel 21, 33, 45, 53 73 ... Palm rest 41, 61 ... Armrest

Claims (21)

A finger operation input unit that detects an input position by a finger; a palm rest unit that serves as a base on which a palm is placed when operating the finger operation input unit;
With
The finger operation input unit and the palm rest unit are arranged adjacent to each other,
The operation input device according to claim 1, wherein the surface of the finger operation input unit is inclined downward from a front extended surface of the surface of the palm rest unit.   The operation input device according to claim 1, wherein an angle between a surface of the finger operation input unit and an extended surface of the palm rest unit is in a range of 10 to 90 degrees.   The operation input device according to claim 1, wherein a surface of the palm rest portion is a plane, a curved surface, or a combination thereof.   The operation input device according to any one of claims 1 to 3, further comprising an intermediate portion having a flat surface, a curved surface, or a combination thereof between the palm rest portion and the finger operation input portion. . A finger operation input unit for detecting an input position by a finger;
An armrest part serving as a base for placing an arm when operating the finger operation input part;
With
The operation input device is characterized in that the surface of the finger operation input portion is inclined downward from a front surface extending from the surface of the armrest portion.   The operation input device according to claim 5, wherein an angle between a surface of the finger operation input unit and an extended surface of the armrest unit is in a range of 10 to 90 degrees.   The operation input device according to claim 1, wherein a surface of the finger operation input unit is a plane, a curved surface, or a combination thereof.   Further, the image processing apparatus includes a photographing device that photographs a finger on the finger operation input unit, and performs input processing corresponding to the input operation by the finger based on a signal from the finger operation input unit and a signal from the photographing device. The operation input device according to claim 1, wherein the operation input device is a device.   9. The remote control input device according to claim 8, wherein the operation input device is a remote operation input device in which the finger operation input unit and a display device that displays image information obtained from the imaging device are arranged apart from each other. Operation input device.   The operation input device according to claim 8 or 9, wherein a finger image indicating a finger on the operation input surface is extracted from an image photographed by the photographing device.   The operation input device according to claim 10, wherein an operation menu is displayed on the display device, and the finger image is displayed in an overlapping manner.   The operation input device according to claim 10 or 11, wherein a fingertip position that is an operation position on the display device is detected from the finger image.   The operation input device according to claim 12, wherein the operation menu selection processing is performed based on a fingertip position detected from the finger image and a signal indicating an operation by a finger from the finger operation input unit. .   The operation input device according to claim 8, wherein a material that transmits light that can be imaged by the imaging device is used for an operation input surface on which a finger of the finger operation input unit is placed. .   A light irradiation unit for irradiating light toward the lower surface of the operation input surface is provided below the operation input surface, and the photographing apparatus for photographing the lower surface side of the operation input surface is provided. Item 15. The operation input device according to Item 14.   The imaging apparatus that includes a light irradiation unit that irradiates light toward the upper surface of the operation input surface below the operation input surface, and that images the upper surface side of the operation input surface above the operation input surface. The operation input device according to claim 14, further comprising:   The operation input device according to claim 1, wherein the finger operation input unit is a touch panel.   17. The finger operation input unit that is a single switch that performs an on / off operation according to a pressed state of the finger is used instead of the finger operation input unit that detects an input position by the finger. The operation input device according to any one of the above.   The operation input device according to claim 1, wherein the operation input device is a device used for at least one of a car navigation operation, an audio operation, an air conditioner operation, and vein authentication.   The operation input device according to claim 1, wherein the operation input device is a device used in a vehicle.   The operation input device according to claim 20, wherein the operation input device is arranged in at least one of a center console, a door, a seat, and a steering.