JP2010067217A - Input device and input method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an input device having a plurality of buttons which can be easily operated by corresponding fingers. <P>SOLUTION: A hand image data holding part 23 holds hand image data. A GUI part holding part 24 holds a plurality of GUI parts. A contact area detection part 1 has an operation surface and detects a contact area between the operation surface and a hand of a user. A position coordinate data creation part 21, based on the contact area detected by the contact area detection part 1, creates fingertip position points showing a current contact finger of the user's hand. A fingertip position specification part 22 determines whether there are a plurality of fingertip position points. When there are a predetermined number of fingertip position points, a superimposed image creation part 25 creates an operation image by superimposing the predetermined number of GUI parts on the hand data to be displayed on a display part 3. When any one of a plurality of fingertip position points is tapped, an operation content determination part 26 determines operation content. A command transmission part 27 converts a the operation content determined by the operation content determination part 26 into a command and transmits it to an apparatus 4 to be operated. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an input device and an input method for a user to input a command or the like to a device, and more specifically, using a body part such as a hand based on information displayed on a display or the like by a user. The present invention relates to an input device and an input method capable of inputting commands and the like.

  With the recent increase in functionality of information equipment terminals, user interfaces that are easier for users to use are required. An example of an easy-to-use user interface is a touch panel display. A touch panel display is a device in which a user inputs a command or the like to an information device terminal or the like by manually pushing a GUI (Graphical User Interface) part displayed on the display. From this, it can be said that the touch panel display is an interface that even a beginner can operate intuitively.

  However, in a touch panel display, since a device (hereinafter referred to as an input unit) that detects a user's touch and a display unit are integrated, there is a problem that the touch panel display cannot be operated without the user's hand.

  In order to solve this problem, an input device is disclosed in which an input unit and a display unit are separated and the input unit is arranged at the user's hand (for example, Patent Documents 1 to 3). The conventional input device disclosed in Patent Literature 1 separates an input unit and a display unit, images a user's hand placed on the input unit with a camera, and displays the captured user's hand on the GUI of the display unit. Superimposed on the display. FIG. 13 is a diagram for explaining a conventional input device disclosed in Patent Document 1. In FIG. In FIG. 13, when the conventional input device displays the user's hand 52 imaged by the camera 51 on the display unit 53, it is displayed on the screen based on the XY coordinate information generated according to the movement of the operating finger. The position of the hand image 55 is moved. That is, by moving the hand to the position on the operation surface of the input unit 50 corresponding to the button of the selection menu 54 displayed on the screen and touching the position on the operation surface corresponding to the desired button, which GUI Recognize whether the button was pressed.

  Also, the conventional input device disclosed in Patent Document 2 separates the input unit and the display unit, detects the user's hand placed on the input unit, and forms a computer graphic (hereinafter referred to as CG) hand shape model. Are superimposed on the GUI of the display unit and displayed. FIG. 14 is a diagram for explaining a conventional input device disclosed in Patent Document 2. In FIG. In FIG. 14, the conventional input device detects the fingertip position and palm position of the user's hand 65 detected using the input unit 64 (touch panel) that can simultaneously acquire a plurality of contact positions of the user's hand 65 and the operation surface. Based on this, the hand shape model 66 is restored by CG. When the restored hand shape model 66 is superimposed on the GUI 63 and displayed, it is displayed on the display unit 62 based on the position of the user's hand 65 on the operation surface of the input unit 64 as in Patent Document 1. The position of the hand shape model 66 to be moved is moved.

Further, the conventional input device disclosed in Patent Document 3 separates the input unit and the display unit, images the user's hand placed on the input unit with a camera, and displays the captured user's hand image And superimposed on the GUI of the part. At this time, each button of the GUI selection menu is associated with each finger of the user's hand, and the GUI display on the display unit is changed in accordance with the movement of the user's hand in the input unit. FIG. 15 is a diagram for explaining a conventional input device disclosed in Patent Document 3. In FIG. In FIG. 15A, the conventional input device assigns the buttons C1 to C5 of the selection menu to the fingers P1 to P5, and moves the buttons C1 to C5 assigned to the fingertips together with the movement of the hand image 71 of the user. Alternatively, in FIG. 15B, the conventional input device has lines L1 to L5 connecting the buttons C1 to C5 of the selection menu whose arrangement is determined in advance by the screen design and the fingertips P1 to P5 of the hand image 71. Is displayed. According to these conventional input devices, even when the input unit is away from the display unit, the user can perform an operation while maintaining the intuitive operation feeling of the touch panel display.
Japanese Patent Laid-Open No. 10-269012 (page 19, FIG. 6, FIG. 7) JP 2006-72854 A WO 06/104132 pamphlet

  However, in the conventional input device described in Patent Document 1, there is a one-to-one correspondence between the position of the selection menu 54 on the display unit 53 and the touch position on the operation surface of the input unit 50 corresponding to the selection menu 54. is doing. For this reason, the user has to move his / her hand according to the position of the button of the selection menu 54 whose arrangement is determined in advance by the screen design. That is, the user operates the input unit 50 while confirming the positional relationship between the selection menu 54 and the hand image 55 on the display unit 53, and moves the hand image 55 to the position of the selection menu 54 that has been previously arranged. It was necessary to move the consciousness to the display unit 53 and the input unit 50. Further, when trying to assign a plurality of buttons of the selection menu 54 determined to be arranged to each finger of the user, it is necessary to change the interval and position of the finger of the hand placed on the operation surface in accordance with the arrangement of the buttons. The operation was troublesome.

  Also, in the conventional input device described in Patent Document 2, the position of the selection menu 63 on the display unit 62 and the touch position on the operation surface of the input unit 64 corresponding to the selection menu 63 correspond one-to-one. Therefore, there is a problem similar to that of Patent Document 1.

  Further, in the conventional input device described in Patent Document 3, as shown in FIG. 15A, when the buttons C1 to C5 assigned to the fingertips P1 to P5 are moved together with the movement of the hand 71, a screen is displayed in advance. The arrangement of the buttons C1 to C5 cannot be determined by the design, and the arrangement of the buttons C1 to C5 is not always easy for the user to see. Further, since the buttons C1 to C5 are displayed in a state where the user places the hand 71 on the operation surface, the buttons C1 to C5 of the selection menu are not known unless the user places the hand 71 on the operation surface. was there. Also, as shown in FIG. 15B, when displaying the lines L1 to L5 connecting the buttons C1 to C5 of the selection menu and the fingertips P1 to P5 of the hand 71, the screen is displayed by displaying the lines L1 to L5. There was a possibility of spoiling the design. Further, depending on the position of the hand 71, the lines L1 to L5 overlap each other, and there is a problem that it is difficult to understand the correspondence between the fingertips P1 to P5 of the hand 71 and the buttons C1 to C5.

  Therefore, the object of the present invention is to change the interval and position of the fingers placed on the operation surface in accordance with the arrangement of the buttons without impairing the screen design in which the arrangement of the buttons of the selection menu is predetermined. There is provided an input device and an input method capable of easily operating a predetermined number of buttons with each corresponding finger.

  The present invention is directed to an input device that provides an operation target device with a user instruction input using an operation image displayed on a display unit. In order to achieve the above object, an input device according to the present invention includes a hand image data holding unit that holds hand image data that is image data representing a hand in advance, and a plurality of GUIs assigned instructions to be given to the operation target device. A GUI part holding unit that holds parts in advance, an operation surface for a user to operate, a contact region detection unit that detects a contact region between the operation surface and the user's hand, and a contact region detection unit A position coordinate data creation unit that creates a fingertip position point that indicates a fingertip position of the user's hand that is currently in contact with the operation surface based on the contact area, and a fingertip position that determines whether there are a predetermined number of fingertip position points When there are a predetermined number of specific parts and fingertip position points, a predetermined number of GUI parts held in the GUI parts holding part and the hand image data held in the hand image data holding part are overlapped to perform user operation Used for An operation image creating unit that creates an operation image and displays the operation image on the display unit, an operation content determination unit that determines an operation content performed by the user when any of a predetermined number of fingertip position points is tapped, and an operation A command transmission unit that converts the user's operation content determined by the content determination unit into a command and transmits the command to the operation target device.

  Thereby, the input device of the present invention changes the interval and position of the fingers placed on the operation surface in accordance with the arrangement of the buttons without impairing the screen design in which the arrangement of the buttons of the selection menu is determined in advance. Since there is no need, a plurality of buttons can be operated easily with the corresponding fingers.

  Preferably, when there are a predetermined number of fingertip position points, the fingertip position specifying unit associates the fingertips of the hand image data with the predetermined number of fingertip position points based on how the fingers of the user's hand are arranged. The superimposed image creation unit associates a predetermined number of GUI parts with the fingertip of the hand image data when creating the operation image.

  The operation content determination unit calculates each distance between the predetermined number of fingertip position points and the fingertip position point where the tap operation has been performed, and among the predetermined number of fingertip position points, the calculated fingertip position with the shortest distance The fingertip corresponding to the point is identified as the fingertip that has been tapped.

  The operation content determination unit determines that the GUI part associated with the fingertip identified as having been tapped is selected, and determines the operation content assigned to the GUI part as the operation content performed by the user. .

  Preferably, the contact area detection unit is a touch pad that can independently acquire each contact point between the operation surface and the hand.

  In addition, when the area on the operation surface of the contact area detection unit is represented by the X coordinate and the Y coordinate, the contact area detection unit includes a large number of X light emission units that emit light in a direction perpendicular to the X coordinate axis, and the large number of X light emission. A number of X light-receiving units that receive the light emitted from the plurality of light-emitting units, a number of Y light-emitting units that emit light in a direction perpendicular to the Y coordinate axis, and a number of Y light-receiving units that receive the light emitted from the plurality of Y light-emitting units The structure provided with these may be sufficient.

  The contact region detection unit includes an X stripe-shaped conductive film that flows a stripe-shaped current in a direction perpendicular to the X-coordinate axis, and a Y-stripe conductive film that flows a stripe-shaped current in a direction perpendicular to the Y-coordinate axis. May be.

  Further, when the longitudinal direction of the user's hand on the operation surface of the contact area detection unit is the direction of the Y coordinate axis, and the direction orthogonal to the Y coordinate axis is the direction of the X coordinate axis, the operation content determination unit has a predetermined number of fingertip positions. Among the points, the fingertip corresponding to the fingertip position point having the closest X coordinate to the fingertip position point where the tap operation has been performed is identified as the fingertip where the tap operation has been performed.

  The area on the operation surface of the contact area detection unit is represented by the X coordinate and the Y coordinate, and the longitudinal direction of the user's hand on the operation surface of the contact area detection unit is the Y coordinate axis direction, and the direction orthogonal to the Y coordinate axis is Assuming that the direction of the X coordinate axis is, the contact area detection unit includes a number of X light emitting units that emit light in a direction perpendicular to the X coordinate axis and a number of X light receiving units that receive light emitted from the many X light emitting units. The structure provided may be sufficient. Further, the contact region detection unit may include an X stripe-shaped conductive film that causes a stripe-shaped current to flow in a direction perpendicular to the X coordinate axis.

  The present invention is also directed to a handle provided with the above-described input device.

  Furthermore, the present invention is also directed to an input method that uses an operation image displayed on a display unit to give a user instruction input to an operation surface to an operation target device. And in order to achieve the said objective, the input method of this invention is contacting the operation surface now based on the step which detects the contact area of the said operation surface and a user's hand, and the detected contact area. A step of creating a fingertip position point indicating a fingertip position of the user's hand, a step of determining whether or not there is a predetermined number of fingertip position points, and an operation target device held in advance when there are a predetermined number of fingertip position points A step of superimposing a predetermined number of GUI parts to which an instruction to be given is assigned and hand image data, which is image data representing a hand held in advance, to create an operation image used for a user operation and to display the operation image on the display unit When any of the predetermined number of fingertip position points is tapped, a step for determining the operation content performed by the user, and converting the determined user operation content into a command and sending it to the operation target device. And a step of.

  According to the input device and the input method of the present invention, the interval and position of the finger placed on the operation surface are adjusted to the arrangement of the buttons without impairing the screen design in which the arrangement of the buttons of the selection menu is determined in advance. Therefore, it is possible to easily operate a predetermined number of buttons with the corresponding fingers.

Hereinafter, an input device according to each embodiment of the present invention will be described with reference to the drawings. In each drawing, elements that are not particularly important for implementation of the present invention are omitted in view of visibility.
(First embodiment)

  FIG. 1 is a diagram illustrating a hardware configuration example of an input device 100 according to the first embodiment of the present invention. In FIG. 1, the input device 100 includes a contact area detection unit 1 and a calculation unit 2. The calculation unit 2 includes an I / O 11 that inputs and outputs data, an HDD (Hard Disk Drive) 12 that stores data, programs, and the like, a ROM 13 that stores basic programs such as BIOS, and programs and programs stored in the HDD 12. A CPU 14 that executes a program stored in the ROM 13, a RAM 15 that holds data, an image processor 17 that processes image data, a VRAM 18 that holds image data, and a bus line 16 that connects these components are provided. .

  The contact area detection unit 1 is connected to the input side of the I / O 11 and detects the contact area of the user's hand 19 that has touched the operation surface at multiple points, and the position data of the detected contact area (hereinafter referred to as contact position data). It is a touchpad that outputs. Contact position data input from the contact area detector 1 to the input side of the I / O 11 is held in the RAM 15.

  The display unit 3 is connected to the output side of the I / O 11. The display unit 3 is a display that displays an image corresponding to the image data. Further, an operation target device 4 such as a car navigation device, an audio device, and an air conditioner operated by the input device 100 is connected to the output side of the I / O 11. The calculation unit 2 outputs an instruction to the operation target device 4 based on the user instruction detected by the contact area detection unit 1.

  The HDD 12 stores a control program that causes the CPU 14 to function so that image data representing a hand (hereinafter, hand image data) is displayed on the display unit 3 together with the GUI. An ID indicating the type of the fingertip is given to the fingertip of the hand image data. It is assumed that the hand image data is stored in the RAM 15 in advance. The hand image data may be a simple representation of the shape of the fingertip of the hand, or may be a detailed imitation of the fingertip of the hand using CG or the like. Alternatively, the hand image data is not limited to the fingertip of the hand, and any image data may be used as long as the user can view the fingertip.

  Note that the control in the input device 100 is executed by hardware or the cooperation of hardware and software.

  Hereinafter, the configuration and operation of the input device 100 will be described in more detail. First, the configuration of the input device 100 will be described. FIG. 2 is a diagram illustrating an example of functional blocks of the input device 100. As shown in FIG. 2, the input device 100 includes a contact area detection unit 1 and a calculation unit 2. The calculation unit 2 includes a position coordinate data creation unit 21, a fingertip position specification unit 22, a hand image data holding unit 23, a GUI parts holding unit 24, a superimposed image creation unit 25, an operation content determination unit 26, a command And a transmission unit 27.

  In the calculation unit 2, the position coordinate data creation unit 21 generates a fingertip position point that represents the coordinates of the position of the user's fingertip on the contact region detection unit 1 from the contact position data input from the contact region detection unit 1. The fingertip position point is represented by, for example, (X, Y) coordinates on the operation surface of the contact area detection unit 1.

  The fingertip position specifying unit 22 determines whether there are four fingertip position points created by the position coordinate data creating unit 21. Then, when there are four fingertip position points, it is determined that the fingertip position point is the user's fingertip, and IDs are sequentially assigned to the fingertip position points based on how the fingers of the hand are arranged. Here, the fingertip position specifying unit 22 determines whether or not there are four fingertip position points in order to determine whether or not the user has touched the contact area detection unit 1 with four fingers. It is. Note that the fingertip position specifying unit 22 can change the number of fingertip position points to be determined to a predetermined number. For example, the fingertip position specifying unit 22 may determine whether the fingertip position point is 1 to 5 or, when considering both hands, whether the fingertip position point is 1 to 10 points. You may judge.

  The hand image data holding unit 23 holds the above-described hand image data in advance. The GUI parts holding unit 24 holds GUI parts included in the operation image displayed on the display unit 3. The GUI parts held in the GUI parts holding unit 24 are, for example, operation buttons for operating the operation target device 4.

  The superimposed image creating unit 25 superimposes a plurality of GUI parts read from the GUI part holding unit 24 and the hand image data read from the hand image data holding unit 23, and displays a display unit as an operation image used for a user operation. 3 is displayed. The superimposed image creation unit 25 changes the operation image displayed on the display unit 3 according to the user operation content determined by the operation content determination unit 26.

  The operation content determination unit 26 determines the type of operation content (user instruction) performed by the user. If the determined operation content relates to screen display, the operation content determination unit 26 transmits the user operation content to the superimposed image creation unit 25 and the command transmission unit 27. The command transmission unit 27 converts the user operation content determined by the operation content determination unit 26 into a command and transmits the command to the operation target device 4.

  Next, the operation of the input device 100 will be described. FIG. 3 is a flowchart illustrating an example of the operation of the input device 100. The following processing is executed by, for example, the CPU 14 shown in FIG. 1 developing a control program stored in the HDD 12 in the RAM 15.

  First, in step S <b> 301, the position coordinate data creation unit 21 acquires contact position data from the contact area detection unit 1. The contact position data is data representing a region where the user's hand has touched the operation surface of the contact region detection unit 1 by a point group (hereinafter referred to as a contact point group).

  Next, in step S302, the position coordinate data creation unit 21 obtains the fingertip position point using the acquired contact point group. FIG. 4 is a diagram for explaining the fingertip position points obtained in step S302. As shown in FIG. 4A, the position coordinate data creation unit 21 designates a plurality of regions by surrounding the contact point group acquired from the contact region detection unit 1 with a rectangle. The shape indicating the region is not limited to a rectangle, and may be an ellipse or another shape. And the position coordinate data creation part 21 makes the gravity center of the rectangle A a fingertip position point, for example, as shown in FIG.4 (b). The position coordinate data creation unit 21 may obtain the fingertip position point by any method, not limited to the method described above. FIG. 4C shows the fingertip position points 41 to 44 obtained by the position coordinate data creation unit 21.

  Next, in step S303, the fingertip position specifying unit 22 determines whether or not four fingertip position points have been acquired. If four fingertip position points can be acquired (Yes), the fingertip position specifying unit 22 proceeds to step S304. If four fingertip position points cannot be acquired (No), the fingertip position specifying unit 22 proceeds to step S301. Return processing. Note that the fingertip position specifying unit 22 may change the number of fingertip position points to be determined as described above. Further, in consideration of the case where the user accidentally touches the contact area detection unit 1, the fingertip position specifying unit 22 acquires four fingertip position points only when a double tap is performed instead of a single tap. You may make it determine whether it was completed.

  In step S304, the fingertip position specifying unit 22 assigns an ID to each of the acquired fingertip position points based on how the fingers of the user's hand are arranged (hand structure). For example, as shown in FIG. 4C, since four fingertip position points are obtained, IDs indicating the little finger, ring finger, middle finger, and index finger are assigned to the fingertip position points 41 to 44, respectively. Thereby, the fingertip position points 41 to 44 can be associated with the fingertips of the hand image data. Here, it is assumed that the user operates the contact area detection unit 1 with the left hand.

  Next, in step S305, the fingertip position specifying unit 22 stores the acquired fingertip position points in the RAM 15 in association with the IDs of the little finger, ring finger, middle finger, and index finger given in step S304.

  Next, in step S306, the superimposed image creating unit 25 superimposes the plurality of GUI parts read from the GUI part holding unit 24 and the hand image data read from the hand image data holding unit 23, and performs the operation by the user. The operation image to be used is displayed on the display unit 3. At this time, the superimposed image creation unit 25 associates a plurality of GUI parts with the fingertip of the hand image data.

  FIG. 5 shows an example of an operation screen displayed on the display unit 3 by the process of step S306. In FIG. 5, GUI parts 501 to 504 represent operation menus for selecting an operation target device. In this example, the DVD is selected when the GUI part 501 is selected, the CD is selected when the GUI part 502 is selected, the FM radio is selected when the GUI part 503 is selected, and the TV (TV) is selected when the GUI part 504 is selected. Becomes the operation target device 4. By selecting the operation target device 4, a lower menu for operating each operation target device 4 is displayed on the display unit 3, and each operation target device 4 is operated by selecting the lower menu by the user. can do.

  The fingers 511 to 514 constituting the hand image data are respectively displayed at lower positions corresponding to the GUI parts 501 to 504 arranged in advance as described above, and the little finger, ring finger, middle finger, and index finger are sequentially displayed. It corresponds to. By arranging the operation image in this way, the user can intuitively understand that the user can select the DVD as the operation target device 4 with the little finger, the CD with the ring finger, the FM radio with the middle finger, and the TV with the index finger. Since the hand image data is an image stored in advance in the hand image data storage unit 23, the hand image data can be displayed at a position corresponding to a GUI part arranged in advance by the screen design. The display position of the hand image data is not related to the position of the user's hand on the operation surface, and the hand image data does not move even if the user moves the hand.

  When the arrangement of the GUI parts changes depending on the screen design, the superimposed image creation unit 25 selects and reads out the corresponding hand image data from the hand image data holding unit 23, thereby the position of the GUI parts and the hand image data. The position of each finger can be adjusted. The superimposed image creating unit 25 can also change the number of GUI parts to be displayed in accordance with the number of fingertip position points determined by the fingertip position specifying unit 22.

  Returning to FIG. 3, in step S <b> 307, the input device 100 executes a process for specifying the user's operation content. Hereinafter, the process of step S307 will be described in detail with reference to FIG.

  First, in step S <b> 601, the fingertip position specifying unit 22 acquires a fingertip position point from the position coordinate data creating unit 21. Next, in step S602, the operation content determination unit 26 determines whether a single tap operation has been performed at any fingertip position point. If the operation content determination unit 26 determines that a single tap operation has been performed, the process proceeds to step S605. If the operation content determination unit 26 determines that a single tap operation has not been performed, the operation content determination unit 26 proceeds to step S603. In this example, the operation content determination unit 26 determines whether a single tap operation has been performed, but the type of tap operation to be determined may be changed. For example, the operation content determination unit 26 may determine whether an operation such as a double tap has been performed.

  In step S603, the operation content determination unit 26 determines whether or not any fingertip position point has been dragged on the operation surface. If it is determined that the drag operation has been performed, the operation content determination unit 26 proceeds to step S604, and if it is determined that the drag operation has not been performed, the operation content determination unit 26 returns the process to step S601.

  In step S604, since a drag operation is detected in step S603, the operation content determination unit 26 determines that the user operation content is a screen scroll operation. Then, the process returns to step S308 in FIG. The operation content determination unit 26 determines that the screen is scrolled when a drag operation is performed. However, the operation to be determined may be changed.

  In step S605, since the single tap is detected in step S602, the operation content determination unit 26 determines each distance between the four fingertip position points stored in the RAM 15 and the fingertip position point where the single tap is detected. Is calculated.

  Next, in step S <b> 606, the operation content determination unit 26 identifies a fingertip that has undergone a single tap operation from the fingertip position point with the shortest calculated distance. Specifically, the operation content determination unit 26 identifies the fingertip corresponding to the fingertip position point with the shortest calculated distance among the four fingertip position points as the finger that has performed the single tap operation.

  In step S607, the operation content determination unit 26 determines that the GUI part corresponding to the fingertip specified in step S606 has been selected, and specifies the operation content assigned to the GUI part. Then, the process returns to step S308 in FIG.

  In step S308 in FIG. 3, when the operation content determination unit 26 determines in step S604 that the user operation content is a screen scroll operation, the operation content determination unit 26 transmits the determined operation content to the superimposed image creation unit 25. The superimposed image creation unit 25 changes the display content of the operation screen based on the transmitted operation content.

  On the other hand, when the operation content assigned to the GUI part selected by the user in step S607 is specified, the operation content determination unit 26 transmits the specified operation content to the superimposed image creation unit 25 and the command transmission unit 27. . The superimposed image creation unit 25 changes the display content based on the user operation content specified by the operation content determination unit 26. Further, the command transmission unit 27 converts the user operation content specified by the operation content determination unit 26 into a command and transmits the command to the operation target device 4.

  As described above, according to the input device according to the first embodiment of the present invention, the button of the selection menu is associated with the fingertip, so that it is not necessary for the user to match the position of the selection menu. In addition, since it is not necessary to change the interval and position of the fingers placed on the operation surface in accordance with the arrangement of the buttons, a plurality of buttons can be easily operated with the corresponding fingers. Moreover, since the screen design of the selection menu can be used as it is, the screen design is not impaired.

(Second Embodiment)
The hardware configuration and functional blocks of the input device according to the second embodiment will be described with reference to FIGS. 1 and 2. The input device according to the second embodiment differs from the input device 100 according to the first embodiment in the configuration of the contact area detection unit. The contact area detection unit 1 according to the first embodiment is a touch pad that can acquire each contact point independently, but the contact area detection unit according to the second embodiment, as shown in FIG. Each contact point is detected by a sensor that detects an intersection between the vertical direction and the horizontal direction.

  Fig.7 (a) is a figure which shows the structural example of the contact area | region detection part 1a which concerns on the 2nd Embodiment of this invention. However, an area on the operation surface of the contact area detection unit 1a is represented by an X coordinate and a Y coordinate. The longitudinal direction of the user's hand is defined as the direction of the Y coordinate axis, and the direction orthogonal to the Y coordinate axis is defined as the direction of the X coordinate axis.

  In FIG. 7A, the contact area detection unit 1a includes a large number of light emitting units that emit light in a direction perpendicular to the X coordinate axis and a large number of light receiving units that receive light emitted from the large number of light emitting units. The contact area detection unit 1a includes a large number of light emitting units that emit light in a direction perpendicular to the Y coordinate axis, and a large number of light receiving units that receive the light emitted by the large number of light emitting units.

  For example, when the shape of the operation surface is a rectangle, the contact area detection unit 1a includes a plurality of light emitting units that emit light on one side of two sides that are parallel to the X coordinate axis and face each other, and the light emitting unit on the other side. And a large number of light receiving parts for receiving the light emitted by. In addition, the contact area detection unit 1a is parallel to the Y coordinate axis and has a large number of light emitting units that emit light on one side of two sides facing each other, and a large number of light receiving units that receive light emitted by the light emitting unit on the other side. A part. Note that the shape of the operation surface is not limited to a rectangle, and may be any shape, for example, a circle.

  When the user's hand comes into contact with the operation surface, a part of the light emitted from a large number of light emitting units is blocked by the user's hands and does not reach a part of the light receiving units. The X coordinate and Y coordinate of the region can be detected.

  FIG.7 (b) is a figure which shows the structural example of the contact area | region detection part 1b which concerns on the 2nd Embodiment of this invention. In FIG. 7B, the contact region detection unit 1b includes a substrate on which a striped conductive film that flows current in a stripe shape in the X coordinate direction and a striped conductive film that flows current in a stripe shape in the Y coordinate direction. The formed substrate is configured to overlap vertically so that the conductive films face each other through a predetermined space. In this example, the stripe-like conductive film in the X coordinate direction is overlaid on the upper side, and the stripe-like conductive film in the Y coordinate direction is overlaid on the lower side. When a hand touches the operation surface, the stripe-shaped conductive film in the X-coordinate direction and the stripe-shaped conductive film in the Y-coordinate direction that are normally separated from each other are energized at the contact position, and the contact area detection unit 1b The X coordinate and Y coordinate of the region can be detected.

  However, these contact area detectors 1a and 1b have the following problems. FIG. 8A is a diagram for explaining a problem of the contact area detection units 1a and 1b according to the second embodiment. However, an area represented by an X coordinate and a Y coordinate is referred to as an (X, Y) area. Assuming the shape of the human left hand on the operation surface of the contact area detection unit 1a, a case is assumed in which the user's fingertip is in contact at a point indicated by a black circle. Since the contact area detection units 1a and 1b are based on the detection method as described above, the (X1, Y2) area 801, the (X2, Y1) area 802, the (X3, Y1) area 803, and the (X4, Y1) In addition to the area 804, the (X1, Y1) 811, (X2, Y2) area 812, (X3, Y2) area 813, (X4, Y2) area 814 are areas where the user's fingertips are not actually touching. It will be detected. In addition, the (X2, Y1) region 802, the (X3, Y1) region 803, and the (X4, Y1) region 804 have the same Y coordinate. For example, in the case of the contact area detection unit 1a, since the Y coordinates of the ring finger, the middle finger, and the index finger are close to each other, the light emitted from the light emitting unit is blocked by these three fingers and cannot be specified separately. This is because it is only possible to detect that the area is within the wide area Y1. Further, the contact region detection unit 1b has the same problem because it is the same detection method for detecting the intersection between the vertical direction and the horizontal direction.

  In response to the above-described problem, the contact area detection units 1a and 1b solve the problem as follows. FIG. 8B is a diagram illustrating a means for solving the problems of the contact area detection units 1a and 1b according to the second embodiment. In FIG. 8B, the contact area detectors 1a and 1b detect the contact area of the user's hand on the operation surface using only the X coordinate. Since it is difficult for the contact area detection units 1a and 1b to assume that the X coordinates overlap from the shape of the human hand, it is possible to detect the contact area of the user's hand on the operation surface using only the X coordinates. It is. Therefore, in this embodiment, the processes of steps S605 and S606 shown in FIG. 6 of the first embodiment are different. The process of step S605 for obtaining the distance between each accumulated fingertip position point and the tapped fingertip position point is not necessary. In step S606, the operation content determination unit selects the fingertip corresponding to the fingertip position point having the closest X coordinate to the fingertip position point where the tap operation has been performed among the accumulated fingertip position points. Is specified.

  Moreover, the contact area detection units 1a and 1b according to the second embodiment use the fact that it is difficult to assume that the X coordinates overlap from the shape of the human hand, and thus FIG. 9 (a) and FIG. 9 (b). As shown in FIG. 4, the sensor may be configured to include only a sensor (light emitting unit and light receiving unit or stripe conductive film) that reads the X coordinate from the beginning. In the case of FIG. 9B, the substrate on which the stripe-shaped conductive film in the Y-coordinate direction is overlapped vertically, or the stripe-shaped conductive film in the Y-coordinate direction is formed on the upper substrate, and the lower substrate is formed. By combining a substrate having a conductive film formed on the entire surface, only the X coordinate can be read. By adopting these configurations, since only the X coordinate needs to be detected, the number of parts is reduced and the circuit configuration is simplified.

(Third embodiment)
In the third embodiment, an example in which the input device 100 according to the first and second embodiments described above is attached to a vehicle will be described. FIG. 10 is a diagram illustrating an example when the input device 100 is attached to the center console of the vehicle. FIG. 11 is a diagram illustrating an example when the input device 100 is attached to a vehicle handle. FIG. 12 is a diagram illustrating an example when the input device 100 is attached to an operation unit of a vehicle door. By attaching the input device 100 to the position of the vehicle as shown in FIGS. 10 to 12, the driver can perform the input operation without hindering the driving operation.

  The input device of the present invention can be used as an input device for a user to input a command to a device, and is particularly useful when it is desired to realize an operational feeling while maintaining an intuitive operational feeling of a touch panel display. It is.

The figure which shows the hardware structural example of the input device 100 which concerns on the 1st Embodiment of this invention. The figure which shows an example of the functional block of the input device 100 which concerns on the 1st Embodiment of this invention. The flowchart which shows an example of operation | movement of the input device 100 which concerns on the 1st Embodiment of this invention. The figure for demonstrating the fingertip position point calculated | required by step S302 The figure which shows an example of the operation screen displayed on the display part 3 by step S306. Flowchart for explaining detailed processing of step S307 The figure which shows the structural example of the contact area | region detection part which concerns on the 2nd Embodiment of this invention. The figure explaining the subject of the contact area detection part which concerns on 2nd Embodiment. The figure which shows the structural example of the contact area | region detection part provided only with the sensor (a light emission part and a light-receiving part, or a striped conductive film) which reads X coordinate. The figure which shows an example when the input device 100 is attached to the center console of a vehicle The figure which shows an example when the input device 100 is attached to the handle | steering-wheel of a vehicle The figure which shows an example when the input device 100 is attached to the operation part of the door of a vehicle. The figure explaining the conventional input device disclosed by patent document 1 The figure explaining the conventional input device disclosed by patent document 2 The figure explaining the conventional input device disclosed by patent document 3

Explanation of symbols

1 Contact Area Detection Unit 2 Calculation Unit 11 I / O
12 HDD
13 ROM
14 CPU
15 RAM
16 bus line 17 image processor 18 VRAM
DESCRIPTION OF SYMBOLS 21 Position coordinate data creation part 22 Fingertip position specific | specification part 23 Hand image data holding part 24 GUI parts holding part 25 Superimposed image creation part 26 Operation content determination part 27 Command transmission part 41-44 Fingertip position point 100 Input device 50, 64 Input part 51 Camera 52, 65 User's Hand 53, 62 Display Unit 54 Selection Menu 55, 71 Hand Image 63 Selection Menu 66 Hand Shape Model

Claims (13)

An input device that gives an operation target device a user instruction input using an operation image displayed on a display unit,
A hand image data holding unit for holding in advance hand image data which is image data representing a hand;
A GUI parts holding unit that holds in advance a plurality of GUI parts assigned instructions to be given to the operation target device;
A contact area detection unit that has an operation surface for the user to operate and detects a contact area between the operation surface and the user's hand;
A position coordinate data creation unit that creates a fingertip position point indicating a fingertip position of the user's hand that is currently in contact with the operation surface, based on the contact area detected by the contact area detection unit;
A fingertip position specifying unit that determines whether or not there are a predetermined number of fingertip position points;
When there are a predetermined number of fingertip position points, the predetermined number of GUI parts held in the GUI parts holding unit and the hand image data held in the hand image data holding unit are overlapped to perform user operation. An operation image to be used for creating a superimposed image creating unit to be displayed on the display unit;
An operation content determination unit that determines the operation content performed by the user when any of the predetermined number of fingertip position points is tapped;
An input device comprising: a command transmission unit that converts a user operation content determined by the operation content determination unit into a command and transmits the command to the operation target device.   The fingertip position specifying unit associates the fingertips of the hand image data with the predetermined number of fingertip position points based on how the fingers of the user's hand are arranged when there are a predetermined number of fingertip position points. The input device according to claim 1, wherein the input device is characterized.   The input device according to claim 2, wherein the superimposed image creation unit associates the predetermined number of GUI parts with a fingertip of the hand image data when creating the operation image.   The operation content determination unit calculates each distance between the predetermined number of fingertip position points and the fingertip position point where the tap operation has been performed, and the calculated distance is the shortest among the predetermined number of fingertip position points. The input device according to claim 3, wherein a fingertip corresponding to a fingertip position point is identified as a fingertip that has undergone the tap operation.   The operation content determination unit determines that the GUI part associated with the fingertip specified as having been subjected to the tap operation has been selected, and determines the operation content assigned to the GUI part as the operation content performed by the user. The input device according to claim 4, wherein:   The input device according to claim 1, wherein the contact area detection unit is a touch pad that can independently acquire contact points between the operation surface and the hand. When the area on the operation surface of the contact area detection unit is represented by the X coordinate and the Y coordinate,
The contact area detector is
A number of X light emitting units that emit light in a direction perpendicular to the X coordinate axis; a number of X light receiving units that receive light emitted by the plurality of X light emitting units;
2. The apparatus according to claim 1, comprising: a plurality of Y light emitting units that emit light in a direction perpendicular to the Y coordinate axis; and a plurality of Y light receiving units that receive light emitted from the plurality of Y light emitting units. Input device. When the area on the operation surface of the contact area detection unit is represented by the X coordinate and the Y coordinate,
The contact area detector is
An X-striped conductive film that causes a striped current to flow in a direction perpendicular to the X-coordinate axis;
The input device according to claim 1, further comprising a Y-striped conductive film that causes a striped current to flow in a direction perpendicular to the Y coordinate axis. When the longitudinal direction of the user's hand on the operation surface of the contact area detection unit is the direction of the Y coordinate axis, and the direction orthogonal to the Y coordinate axis is the direction of the X coordinate axis,
The operation content determination unit selects a fingertip corresponding to a fingertip position point having an X coordinate closest to the fingertip position point on which the tap operation has been performed among the predetermined number of fingertip position points as the fingertip on which the tap operation has been performed. The input device according to claim 7, wherein the input device is specified. An area on the operation surface of the contact area detection unit is represented by an X coordinate and a Y coordinate, and the longitudinal direction of the user's hand on the operation surface of the contact area detection unit is a Y coordinate axis direction, which is orthogonal to the Y coordinate axis. If the direction is the direction of the X coordinate axis,
The contact area detector is
2. The apparatus according to claim 1, further comprising: a plurality of X light emitting units that emit light in a direction perpendicular to the X coordinate axis; and a plurality of X light receiving units that receive light emitted from the plurality of X light emitting units. Input device. An area on the operation surface of the contact area detection unit is represented by an X coordinate and a Y coordinate, and the longitudinal direction of the user's hand on the operation surface of the contact area detection unit is a Y coordinate axis direction, which is orthogonal to the Y coordinate axis. If the direction is the direction of the X coordinate axis,
The contact area detector is
The input device according to claim 1, further comprising an X-striped conductive film that causes a striped current to flow in a direction perpendicular to the X-coordinate axis.   A handle comprising the input device according to claim 1. An input method that uses an operation image displayed on a display unit to give a user instruction input to an operation surface to an operation target device,
Detecting a contact area between the operation surface and the user's hand;
Creating a fingertip position point indicating a fingertip position of the user's hand currently in contact with the operation surface based on the detected contact area;
Determining whether there are a predetermined number of fingertip position points;
When there are a predetermined number of fingertip position points, the predetermined number of GUI parts to which an instruction to be given to the operation target device is held in advance and hand image data that is image data representing a hand held in advance are superimposed. And creating an operation image used for a user operation and displaying the operation image on the display unit;
A step of determining an operation content performed by the user when any of the predetermined number of fingertip position points is tapped;
An input method comprising: converting the determined user operation content into a command and transmitting the command to the operation target device.

Images