JPWO2009110340A1 - INPUT DEVICE, TERMINAL HAVING THE INPUT DEVICE, AND INPUT METHOD - Google Patents

Abstract

Provided is an input device and an input method that are easy for an operator to use even if the input unit on the device is small. An input unit 3 having a detection unit 2 that detects a force transmitted through the body and outputs it as detection data a when a tracing operation is performed on a part of the body that is in contact with the input device; Timer management control means 6 for generating timing for making data a time-series data and outputting it as timing data c, and converting detection data a into time-series data based on timing data c, The input data specifying means 5 for specifying the input operation and outputting the input operation as the input information specifying data d by receiving the stored data b of the database 4 and the input information specifying data d And an information presenting means 7 for displaying a function assigned to the input operation.

Description

  The present invention relates to an input device and an input method applicable to mobile devices such as mobile phones, PDAs, and notebook PCs.

There is a demand for an input device in which the input unit on the device is small in an input device in a portable device that places importance on portability and a portable device that places importance on a display unit such as a display.
As a method for reducing the space of the input unit on the device, there is a method of performing a pointer or character input operation by detecting acupressure in the X, Y, and Z axis directions. As this example, there is one in which handwritten characters are input from the acupressure change pattern using a track point (see, for example, Patent Document 1). However, in the device described in Patent Document 1, since there is no movement of the fingertip for performing the input operation, it is difficult to confirm the operation, and it is necessary to get used to input, which may cause an input error.
There is also a method of separating the detection unit from the device and arranging the detection unit independently. As an example of this, there is a device that performs input by attaching a detection unit to the body (for example, see Patent Document 2). However, in this method, it is necessary to prepare an input unit separately from the device, and the portability is not excellent. Moreover, there is also the troublesomeness of attaching the detection unit to the operator.
JP 2005-301874 A Special Table 2004-537802

The input operation when the input unit (input area) of the input device in an electronic device such as an information terminal is small is difficult to perform fine operations such as positioning and speed control in the pointing operation. This is because input in a small input area requires complicated operation of the operation system and delicate operation of the device in order to control.
Thus, an operation such as handwritten character input requires a large input area. This is because an input operation such as handwritten character input requires a large input area because it is necessary to specify an operation involving scrolling and an input start position by an absolute position. In other words, in the conventional input device, it is difficult to achieve both the scroll operation and the handwritten character input and the reduction of the input area.
On the other hand, according to the method of separating the input unit from the device and wearing it on the human body as disclosed in Patent Document 2, it is possible to meet the demand for reducing the input unit area on the device.
However, this method has the trouble of attaching the input unit to the operator, and is an obstacle when the input operation is not performed.
An object of the present invention is an input device in a portable device that places importance on portability, such as a portable device or a display unit such as a display, and an apparatus that improves the difficulty of use by reducing the input unit on the device. Is to provide.

  In order to achieve the above object, the present invention makes a part of an object come into contact with the detection unit, and the tracing operation is performed in the vicinity of the contact part of the object. Is an input device that identifies the tracing action and presents a display corresponding to the tracing action when a part of the object is touched and the contact part of the object is A detection unit that detects a force transmitted through an object when a trace is performed in the vicinity and outputs the detection data as detection data, and a timing for recording the detection data at a predetermined time interval are generated. The timer management control means for outputting this as timing data, the time series data of the detection data is created based on the detection data and the timing data, and the time series data and preset data By comparing accumulated data over scan, identifying the input operation, the input information specifying means for outputting the input operation as input information specifying data, characterized in that it has a.

  In order to achieve the above object, the present invention specifies a tracing operation when a part of an object comes into contact with the detection unit and a tracing operation is performed in the vicinity of the contact part of the object. It is an input method that presents a display according to the operation, and when a part of the object is touched and a drag is performed near the contact part of the object, the force transmitted through the object is detected, A detection step of outputting as detection data; a timing for recording the detection data at a predetermined time interval; and a timer management control step of outputting the timing data as timing data; and the detection data and the timing data Creates time-series data of detection data based on this, compares this time-series data with the stored data of a preset database, identifies the input action, and inputs the input action And executes the input information specifying step of outputting as a broadcast specific data.

  According to the present invention, the input area is provided on the human body, and the force to be input is transmitted to the detection unit of the device through the contacting body, so that the detection unit on the device can be made small. it can. And according to this invention, even if the detection part on an apparatus is made small, detailed operation is attained. This is because, according to the input method of the present invention, the moving speed and the moving amount of the pointer are changed to the operating speed and the operating moving amount, as opposed to tilting the rod-shaped object on the conventional device and pointing by the tilt angle. It is because it can be reflected in. In addition, according to the present invention, the detection unit for detecting input is small, but the input area for input can be made large. Therefore, an operation that requires scrolling and requires a large operation area, or an input start position The operation for designating the absolute position can be easily performed with high accuracy. Further, according to the present invention, since the operator performs input through his / her body, the input can be sensed by touching the body, and the input is performed at any position. Can be confirmed without looking at the input section, and the input confirmation is high. Further, the input device of the present invention does not have the trouble of winding the detection member around the body, and the detection unit for detecting the input is only in the contact portion between the device and the body, and is excellent in portability.

Next, embodiments of the present invention will be described in detail with reference to the drawings.
[First Embodiment]
FIG. 1A is a block diagram illustrating a configuration of the input device according to the first embodiment of this invention. As shown in FIG. 1 (a), the input device of the present embodiment is arranged at a position in contact with the fingertip that performs input, and outputs a plurality of detection data a when a force is detected. 2, and the detection data a are monitored and activated when it is detected that an input has been made to the detection unit 2, and a trigger is generated that becomes a timing for detecting the input at a certain time interval. When the timer management controller 6 that outputs this as timing data c, and the detection data a and timing data c are received, the detection data a is converted into time-series data for each trigger based on the trigger of the timing data c, Input information for specifying the input operation by comparing the time series data with the stored data b of the database 4 stored in advance and outputting the input operation as the input information specifying data d A constant section 5 is constituted by.

FIG. 2 is a perspective view showing an example of the input unit 3. In FIG. 2, the hatched area is the input area 1. In this example, the back of the left thumb, the back of the index finger, and a part of the back of the hand between them are set in the input area 1. . The tip of the thumb and the tip of the index finger are in contact with the detection unit 2. For example, if the finger of the right hand is traced on the input area 1, the detection unit 2 detects the force in the vertical direction and the force in the two horizontal directions that change with time. In FIG. 2, 8 is an information terminal, and 9 is its information presentation unit.
The input area 1 shown in FIG. 2 is divided into a plurality of regions as shown in FIG. To describe an example of the divided input area 1, at the index finger, is divided from the first input area 1 ₁ distributed between the joints as in the third input area 1 _3, fourth input area over the back of the hand 1 _4, the thumb, which is divided as a seventh input area 1 ₇ from the 5 input area 1 ₅ distributed between each joint.

FIG. 4 is a cross-sectional view showing a specific structure of the detection unit 2 used in the input device of the present embodiment. As shown in FIG. 4, the detection unit 2, contacts the finger of the operator, the key top 2 ₁ actually pushing is performed, is arranged below the key top 2 _1, parallel rectangular planar shape of having a plate 2 _2, and a pressure sensor 2 ₃ disposed under the four corners of the parallel plate 2 _2. With four pressure sensors 2 _3, for detecting a force of three directional components from the distribution of forces applied to the four points. That is, three component directions are detected: a force that pushes in the vertical direction from the contact surface with the fingertip, a force that slides in the fingertip direction, and two components in the horizontal plane direction of the force that slides in the finger side surface vertical direction.
In the present specification, the pushing direction, the fingertip direction, and the finger side surface vertical direction are used as follows. The push-in direction (z-direction) is a direction perpendicular to the parallel plate 2 _2. Fingertip direction (x direction) is the direction indicated by the parallel fingers parallel plate 2 _2. The finger side surface vertical direction (y direction) is a direction perpendicular to the pushing direction and the fingertip direction.
Pressure sensor 2 ₃ is fixed on the wiring board 10 for outputting the detection data of the three direction components to the outside. In FIG. 4, 11 is a housing and 12 is a base.
The input information specifying data d output from the input device shown in FIG. 1A is displayed on a monitor, for example. A configuration for this purpose is shown in FIG. In the input device shown in FIG. 1B, the information presenting means 7 receives the input information specifying data d and presents the function such as the position / motion of the pointer assigned to the motion on the information presenting device.

[Operation]
Next, the operation of the present embodiment will be described with reference to FIGS. First, when a finger is pressed into contact with the device at the fingertip, in step S101, the detection unit 2 pushes the fingertip in the vertical direction from the contact surface with the fingertip, slides the fingertip direction, and the finger side surface perpendicularly. The direction-sliding force is detected, and the three-direction components are output as detection data a as push-in data, fingertip slide data, and finger side surface vertical slide data, respectively. In step S102, when the timer management control means 6 detects that an input has been made to the detection unit 2, the timing for collecting the detection data 2 at the input information specifying means 5 and recording it as data at regular time intervals. And output as timing data c. In step S103, the input information specifying unit 5 converts the detection data a of the three-direction component into time series data based on the timing data c, and this is stored as time series data stored in the database 4 in advance. By comparing with data b, it is specified which input operation is being performed, and output as input information specifying data d. If the input device has the information presentation means 7 as shown in FIG. 1B, in step S104, the information presentation means 7 displays the pointer assigned to the specified input information specifying data d. Functions such as position and operation are displayed on the display screen.

Next, the reason why it is possible to specify which part of the finger is actually pressed when the input area is traced based on the detection data a will be described using the left index finger. Here, the description will be given using the force of the two-way component of the force of pushing in the vertical direction and the force of sliding in the fingertip direction out of the force of the three-way component detected by the detection unit 2.
FIG. 6 is a diagram showing the index finger with the input area 1 divided for each joint. As shown in FIG. 6, the input area 1 is divided into three areas from the fingertip to the first joint, from the first joint to the second joint, and from the second joint to the third joint. _1, the second input area _{1 2,} the third input area _{1 3.} In addition, since the rigidity of the fingers is maintained by the bones and the joints are connected by joints, it can be considered that the fingers are beams supported by a rotational support whose rotation angle is virtually limited at both ends. it can. Further, the lengths of the beams in the input areas 1 ₁ , 1 ₂ , and 1 ₃ are assumed to be l ₁ , l ₂ , and l ₃ , respectively.

Figure 7 is a schematic diagram showing the balance of forces when pushed in each of the input areas 1 ₁ to 1 _3. Referring to FIG. 7, the association between the two directions component and each of the input areas 1 ₁ to 1 ₃ of the sensed force by the detection unit 2 will be described.
The column i) in FIG. 7 shows a state where the first input area ₁₁ is pushed in. Because when pushed a first input area 1 ₁ not bend more at an angle connecting the first input area 1 ₁ and the second input area 1 ₂ a straight line by the moment of the first joint force, the horizontal length of the From the six conditional expressions that are established by constraint conditions, vertical length constraint conditions, horizontal force balance conditions, vertical force balance conditions, moment balance conditions around the base of the finger, and moment balance conditions around the fingertips Finding the relational expression between the force to push in, the force at the third joint that is the base of the finger, and the force that pushes in the vertical direction, which is a component of the force applied to the detector 2, and the force that slides in the horizontal direction Can do.
The horizontal length from the fingertip to the base of the finger is w, and the height is h. The angle from the horizontal direction of the first input area 1 ₁ of the shaft in the fingertip theta _1, the angle from the vertical direction of the third input area 1 ₃ axes at the base of the finger and theta _3. The pushing force works in the vertical direction, and the force is F. The position for pushing is that the middle of the beam at each of the input areas 1 ₁ to 1 _3. The horizontal force of the fingertip is F _1x , and the vertical force is F _1z . The horizontal force of the force applied to the base of the finger is F _3x , and the vertical force is F _3z .
Horizontal length constraint:
w = l ₃ sin θ ₃ + (l ₁ + l ₂ ) cos θ ₁
Vertical length constraint:
h = l ₃ cos θ ₃ + (l ₁ + l ₂ ) sin θ ₁
Horizontal force balance condition:
F _1z + F _3z = F
Normal force balance condition:
F _3x = F _1x
Balancing conditions for the moment around the base of the finger:

Balance conditions for moments around the fingertips:

By assigning appropriate values to l ₁ , l ₂ , l ₃ , θ ₁ , and θ ₃ in these balance equations, the horizontal force F _1x and the vertical force F _1z applied to the fingertips are calculated. Can do.

Similarly, when the second input area 1 ₂ performs pushing, it is possible to calculate the horizontal force F _1x and vertical force F _1z from the balance formula shown ii) of FIG. In the illustrated example, but not bent at the first joint bending at the second joint, For if pushing the second input area 1 ₂ has been performed, depending on the position and angle of application of force, the third input area 1 ₃ as if pushing is performed, the second joint sometimes maintained at an angle connecting the second input area 1 ₂ and the third input area 1 ₃ by a straight line.
For the case where the push to the third input area 1 ₃ was performed, as shown in iii) of FIG. 7 showing a state where pushing the third input area 1 _3, when pushed the third input area 1 ₃ since not bend more at an angle a second joint connecting a straight line and the second input area 1 ₂ and a third input area 1 ₃ by moment of force, balance type according to the column in FIG. 7 is satisfied, the first The calculation can be performed in the same manner as when the second input areas 1 ₁ and 1 ₂ are pushed.
Further, when the joint is kept from bending by applying a force to the finger, it is possible to assume that the entire finger is a single rigid body, and therefore it can be similarly calculated by force balance.
As described above, by assigning appropriate values to l ₁ , l ₂ , l ₃ , F, θ ₁ , and θ ₃ , the horizontal force F _1x and the vertical force F _1z are obtained in each case. Here, F _1x and F _1z in the case where the first, second, and third input areas are pushed in are respectively _expressed as F _1x (1), F _1z (1); F _1x (2), _{Assuming that} F _1z (2); F _1x (3) and F _1z (3) are expressed as shown in FIG.
F _1x (1) <F _1x (2) <F _1x (3)
F _1z (1)> F _1z (2)> F _1z (3)
Is established. Therefore,
F _1x (1) / F _1z (1) <F _1x (2) / F _1z (2) <F _1x (3) / F _1z (3)
Is established. From this, it can be seen that the input area where the push-in is performed can be specified from the ratio of the push-in data (F _1z ) and the slide data (F _1x ) of the detection data a. Accordingly, by examining the time lapse of F _1x / F _1z , it is possible to determine whether the tracing is performed from the fingertip toward the fingertip or conversely from the fingertip toward the fingertip. That is, the tracing operation can be specified.

Next, when a tracing operation is performed in each of the finger input areas 1 ₁ , 1 ₂ , and 1 ₃ shown in FIG. 6 in the left-right direction as viewed from the operator, the tracing operation is specified based on the detection data a. The reason why this is possible will be described. FIG. 8 is a diagram schematically showing the left index finger, showing the same portion as the portion shown in FIG. 6. In FIG. 8, each input area is divided into two regions. Has been. For example, the first input area 1 ₁ comprises a first input area radius side 1 ₁₁ of the center line of the finger right (as viewed from the operator), the two regions of the second input area ulna side 1 ₁₂ of the left It is divided. Second input area 1 ₂ has a first input area radius side 1 ₂₁ of the center line of the finger right (as viewed from the operator), it is divided into two regions of the second input area ulna side 1 ₂₂ of the left ing. The third input area 1 ₃ has a first input area radius side 1 ₃₁ of the center line of the finger right (as viewed from the operator), it is divided into two regions of the second input area ulna side 1 ₃₂ of the left ing. For example, when pushed the first input area radius side 1 _21, the finger side face vertical direction of the left to (ulnar side), when pushed a second input area ulna side 1 _22, the finger side face vertical direction of the right will be a force to the (radial side) is generated, by verifying the detected data a outputted, 1 ₂ the second input area, whether traced from the radial side to the ulnar side, or ulnar It is possible to determine whether it has been squeezed from the side to the rib side. First input area _{1 1} is the same for the third input area _{1 3.}

Next, an example of a method for specifying the input operation by comparing the time series data obtained from the detection data a and the timing data c with the accumulated data b of the database 4 in step S103 will be described.
FIG. 9 is a diagram showing time-series data in the pushing direction and the sliding direction (two directions) corresponding to the input operation stored in the database 4. As shown in FIG. 9, the database 4 stores time-series data as a template in association with an input operation and stored as accumulated data b.
In the left column of FIG. 9, the left index finger and the direction of the tracing operation (sliding operation) performed as an input operation on the finger are indicated by arrows. In the right column of FIG. 9, forces in three directions that change with the tracing operation are shown.
Figure 9i) is a second input area 1 ₂ If the traces to the left (as viewed from the performs input), that is starting from the second input area radius side 1 ₂₁ to the second input area ulna side 1 ₂₂ shows a case where traced and, Figure 9ii) is traced to the second input area 1 _{2 If} the traced in the right direction, that the second input area radius side 1 ₂₁ starting from the second input area ulna side 1 ₂₂ Shows the case. Further, FIG. 9Iii), when the left index traced from the finger base to the finger tip direction, i.e. the third shows the case where traces from input areas 1 ₃ to the first input area 1 _1, FIG 9Iv) is a left index If tracing the finger base direction from the fingertip, that shows a case where tracing from the first input area 1 ₁ to the third input area 1 _3. Corresponding to each tracing operation, the right column of FIG. 9 shows a specific time series pattern that can specify each tracing operation. Therefore, if the pattern of the time series data can be specified, the corresponding input operation can be specified.

The input information specifying means 5 compares the time-series data generated from the detection data a and the accumulated data b, which is the time-series data of the accumulated data b, with a DP matching algorithm, which is one of pattern recognition, and performs an input operation. To identify.
FIG. 10 is a flowchart showing an outline of processing by DP matching. First, in step S201, the distance between the elements of the time series data of the detection data a acquired for each timing data c and the accumulated data b is calculated. Subsequently, in step S202, a minimum path cost is calculated using the calculated distance between elements. Finally, in step S203, using the calculated minimum path cost, the temporary data in the accumulated data b is specified as the input pattern of the time-series detection data a, and the input operation corresponding to the time-series data is performed. Output as input information specifying data d.

Next, each step shown in FIG. 10 will be described in more detail. First, the detection data a acquired for each timing data c used in the present invention includes a force that pushes in the vertical direction from the beginning of pushing to the end of pushing (from the beginning of tracing to the end of tracing), a force that slides in the fingertip direction, and a finger side perpendicular Because it is time series data of the force to slide in the direction,
P = (p ₁ , p ₂ ,..., P _i ,..., P _I )
[I is a time series (i = 1, ..., I)], and each time series data includes the force to slide in the fingertip direction, the force to slide in the finger side surface vertical direction, the force to push in the vertical direction
_{p i = (p ix, p} iy, p iz)
It becomes.
Similarly, since the reference pattern is also time-series data of three component components,

[J is a time series (j = 1,..., J), k is a subscript representing each reference pattern], and similarly to the detection data a, the data for each time series is slid in the fingertip direction, Expresses the force to slide the finger side in the vertical direction and the force to push in the vertical direction.
r _j = (r _jx , r _jy , r _jz )
It becomes.

As shown in FIG. 11 showing the DP matching path diagram, DP matching is arranged on a lattice, and the path has a cost, the path having the smallest sum and the total cost are calculated, and the input pattern is calculated. This is a technique for finding the reference pattern closest to.
First, in step S201, the distance between elements of the time series data of the detection data a and the accumulated data b is calculated.
The cost at a grid point in (I, j) is

It is represented by This is calculated at all grid points.
Next, the minimum path cost is calculated in step S202. FIG. 12 is a diagram for explaining the minimum accumulated cost on a lattice point. Using FIG. 12, as a calculation formula of the lattice point in (I, j),

It can be expressed as. This is an equation including a symmetric path restriction. This is repeatedly obtained from small values of time series I and j.
Next, in calculating the distance between patterns in step S203,
In (I, J)

Is calculated, the inter-pattern distance between the input pattern (time series data of the detection data a) and the reference pattern (time series data of the accumulated data b) is obtained. This is applied to all the patterns stored in advance, and the input operation corresponding to the reference pattern corresponding to the smallest inter-pattern distance is specified as the input operation of the detection data a, and this is output as the input information specifying data d.

In the present embodiment, DP matching is used. However, other methods may be used as long as the method or operation for performing matching including time series is specified.
Further, when specifying the input operation, the input operation to be assigned may be changed depending on the manner of change. For example, when the change in the input area 1 per unit time is large, it may be determined that the pointer operation or the scroll operation is performed quickly or largely, and the input information specifying data d may be output.
Further, in the present embodiment, the timer management control means 6 generates the timing for recording the detection data only when the input operation to the input unit 3 is performed. The timer management control means 6 may always generate timing.
Further, in the present embodiment has been performed is described left index, the first input area 1 ₁ of the left hand index _finger, the second input area 1 _2, be an input operation to the third input area 1 ₃ except areas Similarly, the input operation can be specified based on the detection data a.
Further, the detection unit 2 is not limited to the left index finger, and the amount of information that can be acquired may be increased by adapting to the thumb or simultaneously adapting to other fingers.

In the present embodiment, the input area 1 is the back of the left hand or the back of the finger, but is not limited to the hand or finger, and may be applied to each part of the body. For example, even if a person stands on the device, performs an input operation to the knees or thighs, acquires a change in force on the sole by the detection unit 2, and associates the detection data with the input operation. Good.
Further, in this embodiment, the typical movements such as the right-handed tracing action, the left-handed tracing action, the fingertip-direction tracing action, and the finger base-direction tracing action have been described as examples. It is not limited. For example, it may be a stroking in an oblique direction or a stroking across a plurality of fingers. These tracings may be assigned to a pointer operation or a scrolling operation, or an operation such as a tap that does not change from the pushed-in position may be assigned.

Further, the detection data a and the accumulated data b of the database 4 may be handled as a ratio of the force sliding in the fingertip direction to the force in the pushing direction and the force sliding in the finger side surface vertical direction, or data of three direction components. The value of may be used as it is.
Further, when a one-way operation such as a scroll operation is performed, the two-direction component of the push-in direction and the fingertip slide direction is handled, and the ratio of the force in the fingertip slide direction to the force in the push-in direction is used. An operation such as scrolling may be performed.
In the present embodiment, the information presenting means 7 presents functions such as a scroll operation and a pointer operation on the display screen in response to the input information specifying data d. However, the present invention is not limited to this. Instead, the input information specifying data d may be received and characters, symbols, data, etc. may be presented on the display screen.
In the present embodiment, the detection unit 2 uses a combination of four pressure sensors in order to detect forces in three directions. However, a plurality of strain sensors are arranged under the key tops, 3 to detect the force of the three-direction component, or arrange a surface pressure sensor under the key top to detect the pressure distribution under the key top, and to detect 3 based on the distribution bias. Other means may be used as long as the force of the three direction components can be detected, such as obtaining the force of the direction component.
In addition, in FIG. 2, the finger to be used is the thumb and the index finger, and the terminal is used in the state where the terminal is placed. However, as shown in FIG. 13, the present invention is applied to a thin card-sized terminal. You may use it with the terminal.

In the input device of the present invention, the detection unit 2 is a small range of the fingertip, and the area exposed on the surface of the terminal is small, but the input area 1 for operating the device covers the entire finger. It is also suitable for large movements that require a stroke.
Also, when an operation such as a mouse pointing operation is performed, the absolute position of the information presentation unit 9 can be directly specified, unlike an input device that operates only a relative position change such as a track point. Input is possible.
In addition, when performing an operation that changes the position or speed of the mouse pointer as an operation, the operation control to the input area 1 corresponds to the amount of movement of the finger or the moving speed, which is intuitive. Easy to operate.
In addition, since a detection unit is provided between the device and the finger holding the device, there is no need to attach a sensor for detecting input to the body side, so there is no obstacle to operations other than operation, etc. Easy to use.

[Second Embodiment]
FIG. 14 is a block diagram showing the configuration of the input device according to the second embodiment of the present invention. As shown in FIG. 14, the input device according to the present embodiment includes a plurality of detection units 2 that detect a pressure distribution state generated on the contact surface with the fingertip when pressed, and are output by the detection unit 2. An input unit 3 that outputs detection data e, which is pressure distribution data, and is activated when the detection data e is monitored and it is detected that an input has been made to the detection unit 2, and the input is input at a certain time interval. A timer management control unit 6 that generates a trigger as a detection timing and outputs the trigger as timing data c, detection data e and timing data c, and data converted from the detection data e (in the detection unit 2) By comparing the normalized barycentric position in the pressing area) and the accumulated data f of the database 4 set in advance, the pressing position / motion is specified, and the position / motion is input information specifying data d An input information identification means 5 for and outputting, and is composed of.

Similarly to the first embodiment, the input device of the present embodiment is also compatible with the card-sized thin terminal shown in FIG. 13, and with the left hand lifting the terminal with the right hand, the input of the left thumb with the right hand The area 1 is pushed in, and the pressure distribution at which the left thumb finger presses the detection unit 2 is measured. Here, the third input area 13 is the phalanx between the base of the thumb and the first joint, the second input area 12 is the first joint, and the first input area 11 is the toe.
FIG. 15 is a plan view showing a state of the detection unit 2 mounted on the information terminal 8. As shown in FIG. 15, the detection unit 2 has pressure-sensitive sensors 23 arranged in a matrix at portions in contact with the finger surface, so that the pressure-sensitive distribution received from the finger surface can be detected from multiple points. .

Next, the operation of the input device according to this embodiment will be described. In the present embodiment, the input information specifying means 5 calculates the load center of gravity using the detection data e representing the load distribution from the finger surface, and specifies the push-in position / motion from the change in the position.
FIG. 16 is a flowchart showing the operation of the input information specifying means 5. First, in step S301, pressure surface distribution data that is a measurement value of the pressure-sensitive sensors 23 arranged in a matrix on the contact surface of the fingertip is received as detection data e.
FIG. 17 is an explanatory diagram of the pressure-sensitive distribution state of the detection unit 2. The detection unit 2 detects the state at the part in contact with the finger as a pressure-sensitive distribution. The pressure-sensitive sensors 23 for acquiring the pressure surface distribution of the detector 2 are arranged in a matrix of (1, 2,... I ... I) in the x direction and (1, 2,... J ... J) in the y direction. ing. here,
The measurement value of the detection unit 2 at the (i, j) coordinates is F _ij .

Next, in step S302, the region of the detection unit 2 with which the fingertip is in contact is cut out. Since the detection unit 2 and the finger are in an elliptical shape and are in surface contact, a rectangular region including the elliptical shape is extracted. The coordinates of the portion corresponding to the vertex at this time are P ₁ , P ₂ , P ₃ , and P ⁴ . In the rectangular region, the major axis direction of the rectangular region is the fingertip direction, and the minor axis direction is the finger side surface vertical direction. Therefore, the fingertip direction can be extracted by calculating the major axis direction of the rectangular region.
Next, in step S303, and calculates the _{P G} is a load gravity center position. P _G x direction component _{P Gx} and _{P G} y direction component _{P Gy} each of

Can be calculated as
Next, in step S304, the total load F is obtained. Total load F is

Can be calculated as
Next, in step S305, it is checked whether or not the total load exceeds a certain value. If not, the process returns to step S301, and if it exceeds, the process proceeds to step S306. Since the load center of gravity position P _G of the weighted small steps are not stable, the provided step S305, so as to use only stable data. In step S306, the center-of-gravity direction vector to the position that becomes the load center of gravity in the rectangular area is calculated. The rectangle center-of-gravity direction vector is V _G →. Starting point of the rectangle centroid direction vector in the rectangular area, and the side vertices close to the base of the finger, where the P ₁ of radius close.

Next, in step S307, a major axis direction vector and a minor axis direction vector obtained from two adjacent sides of the rectangular area are calculated. The starting points of the major axis direction vector and the minor axis direction vector are set to P1 like the rectangular center-of-gravity direction vector in S306, the rectangular major axis direction vector is V _L →, and the rectangular minor axis direction vector is V _S →.
Next, in step S308, a center-of-gravity position ratio (normalized absolute value of the major-axis direction component of the center-of-gravity direction vector V _G →) R, which is the ratio of the major-axis direction component of the center-of-gravity direction vector to the long-axis direction vector. _A center-of-gravity position ratio (normalized absolute value of the short-axis direction component of the center-of-gravity direction vector V _G →) R _S that is a ratio between _L and the short-axis direction component of the center-of-gravity direction vector and the short-axis direction vector is calculated. .

The center-of-gravity position ratio R _L in the major axis direction is obtained from the cosine of the angle formed by the rectangular major axis direction vector and the rectangular center-of-gravity direction vector, and is 0 when the center of gravity position is at the base of the finger and 1 And the normalized value. Further, the center-of-gravity position ratio R _S in the minor axis direction is obtained from the cosine of the angle formed by the rectangular minor axis direction vector and the rectangular center-of-gravity direction vector, and is 0 when the center of gravity position is on the rib side of the finger. When it is, it is a value normalized to 1. That means

Calculate as (R _L , R _S ) obtained from the calculated R _L and R _S indicates normalized barycentric position coordinates in the rectangular area.

Next, in step S309, it is monitored whether or not the timing data c is generated within a predetermined time. If the timing data c is generated, the process returns to step S301, and the load gravity center position that moves with the tracing operation is returned. Further measurements are made. If the timing data c is not issued within the predetermined time, the process proceeds to step S310, the input information is specified with reference to the accumulated data f from the database 4, and the information is output as the input information specifying data d. . This step S310 can be performed using the DP matching described with reference to FIGS. However, in the present embodiment, in step S201 in FIG. 10, the distance between elements of the time series data of the gravity center position ratios R _L and R _S calculated from the detection data e and the accumulated data f is calculated.

In the present embodiment, when the left-hand tracing operation as shown in FIG. 9i, for example, is performed on the left thumb, the center-of-gravity position ratio R _{S in} the minor axis direction is a value close to 0 from a value close to 0. ( _RL is almost constant). Further, for example, when the fingertip direction tracing operation shown in FIG. 9iii) is performed, the center-of-gravity position ratio RL changes in the major axis direction from a value close to 0 to a value close to 1 (R _S is about 0.5). Almost constant). In the present embodiment, such an input operation is specified in step S310.

In the present embodiment, in order to detect the pressure surface distribution state, the pressure-sensitive sensors 23 arranged in a matrix are used. However, if the pressure surface distribution state can be obtained, it is not arranged in a matrix. Also good. Further, the center of gravity position ratio, the side close to the base of the finger is used as a normalized value for P ₁ of the radial side of the left thumb to start, the starting point of the vector of the P _2, P _3, P ₄ Any rectangular corner can be chosen. Further, the normalized value is not limited to a normalized value such as an actual measurement value as long as it indicates the position of the center of gravity.
Further, in order to use only the stable value of the load gravity center position _RG in step S305, it is assumed that the process proceeds to the next step only when the total load F exceeds a certain reference load. In order to use the load gravity center position _RG , the use of the total load F is not limited. For example, you may make it utilize only when the area | region area of a contact surface becomes an area beyond a certain fixed value. Moreover, although the sensor which detects a value in an analog manner is used for the pressure sensor 23, a sensor which detects a digital value only for ON-OFF may be used. In this case, the load gravity center position corresponds to the area gravity center position of the contact surface region. Further, although the gravity center position ratio is used as a reference for identifying the input area 1, it is not necessary to limit to the load gravity center position as long as the load position from the finger can be specified. For example, it is also possible to treat the point showing the largest value of the pressure sensor 2 ₃ equivalent to the load center of gravity position P _G. In addition, determining the positions of P ₁ , P ₂ , P ₃ , and P ₄ that are the corner points of the rectangular area from the pressure distribution does not require recalculation for each input. For example, when it is detected that the input is previously finger to the terminal contacts in the pressure sensor 2 _3, it cuts out the contact region of the advance finger, may also be used which has been calculated from the rectangular region.
Further, the major axis direction vector and the minor axis direction vector of the rectangular area are calculated from the pressure distribution, but if the fingertip direction and the finger side surface vertical direction can be separated, the area other than the rectangle may be extracted. . For example, an elliptical region may be extracted from the pressure distribution situation, and the same calculation may be performed using the major axis direction vector and the minor axis direction vector of the ellipse.

FIG. 18 is a perspective view showing a state where an input is made to the terminal according to the embodiment of the present invention. This embodiment is an embodiment in the case where it is difficult to provide a large detection unit 2 for detecting an input on the same surface as the display unit as the display becomes larger. In the present embodiment, the present invention is applied to a full-screen terminal (the second and third embodiments also apply the present invention to a full-screen terminal). In the present embodiment, the detection unit 2 is provided on the side of the device, and the device is held so as to be wrapped from the back side, and a tracing operation to each finger is performed. In FIG. 18, the tracing operation is indicated by an arrow (the same applies to FIGS. 19 and 20). Such a tracing operation can be specified as a page turning function of an electronic book or the like. In this case, the detection unit 2 may be provided at a position where each finger is in contact with the terminal with the fingertip. For example, the detection unit 2 may be provided on the side where the thumb is in contact or the back side where the index finger is in contact. Further, in addition to the detection unit 2, a depression or the like may be formed at a position where there is no detection unit so that the posture of each finger is constant.
When the drag operation to each finger changes the function, the input area to operate is on the back side of the device, so in the normal input method for full screen terminal, where to input It is difficult to check the input status. However, in the case of the present embodiment, since the object that is in contact for the operation is a part of the body, it is possible to grasp the contact position. In other words, the present embodiment is effective for dealing with a situation where it is impossible to visually confirm at which position the operation is to be performed.

  FIG. 19 is a perspective view showing a state where an input is made to the terminal according to the embodiment of the present invention. In the present embodiment, the detection unit 2 can be provided on the display surface in contact with the thumb, or on the device side or the back surface in contact with another finger. According to the present embodiment, an operation equivalent to the scroll operation in the web connection terminal can be specified depending on how the device is held.

  FIG. 20 is a perspective view showing a state where an input is made to the terminal according to the third embodiment of the present invention. Referring to FIG. 20, it is possible to specify an operation equivalent to a mouse or cross-direction key operation using the back of the hand that can be widely used depending on how the device is held. In this case, in addition to acquiring the force of the fingertip of the thumb by the detection unit 2, the state of the force at the position where the finger contacts with each finger on the back side of the terminal may be detected.

  In the first to third embodiments, the detection unit 2 that detects input may not be in contact with the tip of the finger. For example, by making the wide area of the finger in contact with the detection unit 2 and obtaining the pressure distribution state of the surface in contact with the information terminal by the detection unit 2, the tracing operation to the surface on the back side of the finger is performed. By identifying, the scroll operation may be specified.

  While the present invention has been described with reference to the embodiments (and examples), the present invention is not limited to the above embodiments (and examples). Various changes that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention.

  This application claims priority based on Japanese Patent Application No. 2008-051867 filed on Mar. 3, 2008 and Japanese Patent Application No. 2008-166854 filed on Jun. 26, 2008. All of this is taken in here.

  Advantageous Effects of Invention According to the present invention, in an input device in a portable device that places importance on portability and a display unit such as a display, it contributes to improving the difficulty of use by reducing the input unit on the device. It can be done.

It is a block diagram which shows the structure of the input device which concerns on one embodiment of this invention. It is a perspective view which shows the external appearance of the input part 3 of FIG. It is a schematic diagram decomposed | disassembled and shown in the several area | region of the input area of FIG. It is sectional drawing which shows the structure of the detection part 2 of FIG. It is a flowchart showing the whole operation | movement of this invention. It is the schematic diagram which divided | segmented and represented the index finger which is an input area for every joint. It is a figure showing balance of force at the time of pushing in each input area. It is the figure which divided and represented the 1st-3rd input area. It is a figure which shows a response | compatibility with accumulation | storage data of a time series, and input operation | movement. It is a flowchart at the time of performing DP matching by an input information specifying means. It is a figure showing DP matching route figure. It is a figure explaining the minimum accumulated cost on a lattice point. It is a figure which shows the state which inputs into the thin terminal of the card size which applied the input device of this invention. It is a block diagram which shows the structure of the input device which concerns on the 2nd Embodiment of this invention. It is a top view which shows the structure of the detection part 2 in 2nd Embodiment. It is a flowchart which shows operation | movement of the input information specific | specification means 5 in 2nd Embodiment. It is explanatory drawing which shows the pressure-sensitive distribution state of the detection part 2 in 2nd Embodiment. It is a perspective view of Example 2 which applied this invention to the terminal of a full screen. It is a perspective view of Example 2 which applied this invention to the terminal of a full screen. It is a perspective view of Example 3 which applied this invention to the terminal of a full screen.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Input area 1 ₁ 1st input area 1 ₁₁ 1st input area radius side 1 ₁₂ 1st input area ulna side 1 ₂ 2nd input area 1 ₂₁ 2nd input area radius side 1 ₂₂ 2nd input area ulna side 1 ₃ 3 input area 1 ₃₁ 3rd input area radius side 1 ₃₂ 3rd input area ulna side 1 ₄ 4th input area 1 ₅ 5th input area 1 ₆ 6th input area 1 ₇ 7th input area 2 detector 2 ₁ key top 2 ₂ parallel plate 2 ₃ pressure sensor 3 input unit 4 database 5 input information specifying unit 6 timer management control unit 7 information presentation unit 8 information terminal 9 information presentation unit 10 wiring board 11 housing 12 base a, e detection data b, f Accumulated data c Timing data d Input information specific data

Claims (14)

When a part of an object is brought into contact with the detection unit and a tracing operation is performed in the vicinity of the contact part of the object (an operation in which a part different from the contact part of the object is slid in the vicinity of the contact part of the object) , An input device that identifies the tracing action and presents a display corresponding to the tracing action,
A detection unit that detects a force transmitted through the object and outputs it as detection data when a part of the object is touched and the tracing is performed in the vicinity of the contact part of the object;
Timer management control means for generating timing for recording the detection data at time intervals and outputting the timing data as timing data;
Create time-series data of the detection data based on the detection data and the timing data, compare the time-series data with the stored data of a preset database, specify the input operation, and input Input information specifying means for outputting the operation as input information specifying data;
An input device with.   The input device according to claim 1, wherein the function includes a pointer position presentation, a pointer operation, a scroll operation, a character handwriting operation, or a page turning function.   The detection unit is arranged so as to come into contact with the tip of the object, and detects a force transmitted through the object when a part of the object receives a pushing operation or a tracing operation by an input. The input device according to claim 1 or 2, characterized in that   The detection unit includes at least one of a force sensor capable of detecting a component in three directions, a pressure sensor capable of detecting a push distribution at a plurality of points, or a plurality of pressure sensors arranged in a planar shape. The input device according to claim 1, further comprising: an input device according to claim 1.   5. The input device according to claim 1, wherein the timer management control means always generates timing.   The timer management control means constantly monitors detection data, starts generating timing when the detection data occurs, and stops generating timing when the detection data ends. The input device described in 1.   The input information specifying means specifies an input operation by matching the accumulated data of the database with the time-series data of detection data. Input device.   The database includes a time-series change in force between the pushing direction, the fingertip sliding direction, and the finger side surface vertical sliding direction output from the detection unit, or the ratio of the force in the fingertip sliding direction to the force in the pushing direction and the pushing direction. The time series change of the ratio of the force in the finger side slide direction to the force of the finger or the time series change of the normalized gravity center position of the load on the detection unit is recorded as the accumulated data in association with the input operation. The input device according to claim 1, wherein the input device is an input device.   2. The input device according to claim 1, further comprising information presenting means for receiving the input information specifying data and displaying a predetermined symbol, data or function assigned to the input operation.   The input device according to claim 1, wherein the object is a finger.   A terminal comprising the input device according to claim 1. An input method for specifying a tracing action and presenting a display corresponding to the tracing action when a part of the object comes into contact with the detection unit and a tracing action is performed in the vicinity of the contact part of the object. ,
A detection step of detecting a force transmitted through the object and outputting it as detection data when a part of the object is touched and a trace is performed near the contact portion of the object;
A timer management control step for generating a timing for recording the detection data at time intervals and outputting the timing data as timing data;
Create time-series data of detection data based on the detection data and the timing data, compare the time-series data with the stored data of a preset database, identify the input operation, and input the operation An input information specifying step of outputting as input information specifying data is executed.   13. The input method according to claim 12, wherein the input information specifying data is received, and a predetermined symbol, data, or function assigned to the input operation is displayed.   The object in contact with the detection unit is a finger, and the vicinity of the contact unit is a region including or between the joints of the fingers to which the finger belongs or on or around the bones ahead of the joints. Item 14. The input method according to Item 12 or 13.