JP5982951B2 - Input device, input program, and input method - Google Patents

Description

  The present invention relates to an input device, an input program, and an input method.

  In recent years, mobile terminal devices such as smartphones, mobile phones, and electronic book terminals that have a touch screen have become widespread. A portable terminal device including a touch screen employs a software keyboard that displays an image of a keyboard on the touch screen and determines an input key according to the touched position. Compared to hardware keyboards, software keyboards do not have buttons for each key and the input surface is flat, and the user cannot obtain a touch when pressed. Different keys may be entered incorrectly. For this reason, various techniques for preventing erroneous input have been proposed.

  For example, there is a technique for measuring the shift amount from the center of gravity of the input key corresponding to the input coordinate to the input coordinate and changing the display position of the input key according to the measured shift amount. Further, for example, there is a technique for changing the detection area of the input key in accordance with the measured displacement amount and initializing the measured displacement amount every time the angle of the touch screen changes. In addition, for example, there is a technique for enlarging a reaction region in the right and downward direction of a switch corresponding to the near side of the line of sight when the operator's position is specified from the driver's position and the display is viewed from the lower left.

JP 2004-341813 A JP 2009-075778 A Japanese Patent Laid-Open No. 08-095708

  However, the above conventional technique has a problem that it is impossible to prevent erroneous input. For example, when the user holds the terminal with the right hand, even if the display position of the input key is changed using the amount of deviation measured when the terminal is held with the left hand, erroneous input can be prevented. There wasn't.

  The disclosed technology has been made in view of the above, and an object thereof is to provide an input device, an input program, and an input method that can prevent erroneous input.

  The technique which this application discloses is equipped with the determination part and the correction | amendment part in one aspect. The determination unit determines a holding state of the terminal provided with the touch screen. The correction unit corrects input coordinates input to the touch screen according to the holding state determined by the determination unit.

  According to one aspect of the technology disclosed in the present application, there is an effect that erroneous input can be prevented.

FIG. 1 is a block diagram illustrating a functional configuration of the input device according to the first embodiment. FIG. 2 is a diagram for explaining parameters of the input device. FIG. 3 is a diagram illustrating an example of information stored in the acceleration waveform storage unit. FIG. 4 is a diagram illustrating an example of information stored in the history storage unit. FIG. 5 is a diagram for explaining processing in which the correction unit corrects input coordinates. FIG. 6 is a flowchart showing the processing procedure of the correction processing. FIG. 7 is a flowchart illustrating the processing procedure of the determination process. FIG. 8 is a flowchart showing the processing procedure of the estimation process. FIG. 9 is a diagram for explaining an example of a correction value calculation method. FIG. 10 is a diagram illustrating an example of a computer that executes an input program.

  Hereinafter, embodiments of an input device, an input program, and an input method disclosed in the present application will be described in detail with reference to the drawings. Note that the present invention is not limited to the embodiments. Each embodiment can be appropriately combined within a range in which processing contents do not contradict each other.

  An example of a functional configuration of the input device according to the first embodiment will be described. FIG. 1 is a block diagram illustrating a functional configuration of the input device according to the first embodiment. When receiving input from the touch screen, the input device 100 estimates the terminal holding state using an acceleration sensor, and determines an input key using a history of deviation amounts recorded for each holding state.

  As illustrated in FIG. 1, the input device 100 includes, for example, an input unit 101, an output unit 102, a communication control unit 103, a storage unit 110, and a control unit 120. The input device 100 corresponds to a mobile terminal device having a touch screen such as a smartphone, a mobile phone, and an electronic book terminal.

  The input unit 101 is an input device that receives input of various types of information. For example, the input unit 101 receives an input to the touch screen from a user who uses the input device 100. The input unit 101 outputs input coordinates corresponding to the received input to the control unit 120 described later. For example, the input unit 101 corresponds to a touch screen, a keyboard, a mouse, or the like. The output unit 102 is an output device that outputs various types of information. For example, the output unit 102 corresponds to a touch screen, a display, a monitor, or the like.

  The communication control unit 103 controls communication related to various information transmitted / received to / from the network. For example, the communication control unit 103 is a network interface card (NIC).

  The storage unit 110 includes, for example, an acceleration waveform storage unit 111 and a history storage unit 112. The storage unit 110 corresponds to, for example, a semiconductor memory device such as a RAM (Random Access Memory) or a flash memory, and a storage device such as a hard disk device or an optical disk device.

  The acceleration waveform storage unit 111 stores an acceleration waveform. As an example, the acceleration waveform storage unit 111 stores time-series data of an acceleration waveform acquired by an acceleration sensor (not shown).

  Here, parameters of the input device 100 will be described. FIG. 2 is a diagram for explaining parameters of the input device 100. FIG. 2 shows a state in which the touch screen 2a of the input device 100 is directed upward. At this time, the left-right acceleration component is the X component, the vertical acceleration component is the Y component, and the front-back acceleration component is the Z component. A rotation axis parallel to the Y component direction is a roll, and a rotation axis parallel to the X component direction is a pitch.

  FIG. 3 is a diagram illustrating an example of information stored in the acceleration waveform storage unit 111. The horizontal axis in FIG. 3 indicates the passage of time, and the vertical axis indicates the acceleration. FIG. 3 shows, as an example, a case where acceleration waveforms at times before and after the time when the touch screen is touched are extracted. This is to analyze the movement of the input device 100 caused by a single key input. The acceleration component 3a in FIG. 3 indicates the X component, the acceleration component 3b indicates the Y component, and the acceleration component 3c indicates the Z component. In addition, as a technique for acquiring an acceleration waveform, for example, an existing technique described in JP 2011-214833 A can be appropriately selected and applied.

  The history storage unit 112 has a holding state when input coordinates input in the past are input, a deviation amount from the center coordinates of the input key corresponding to the input coordinates, and the input coordinates. An estimated history estimated for an input key different from the key is stored in association with each other. The description of the holding state will be described later together with the description of the determination unit 122.

  For example, each time the input unit 101 receives a key input to the touch screen, the history storage unit 112 stores a record in which the input coordinates, the input key, and the shift amount are associated with each other by the receiving unit 121 described later. be registered. In addition, for example, the history storage unit 112 is registered by the determination unit 122 described later as the holding state. Further, for example, in the history storage unit 112, the estimation history is registered by the estimation unit 123 or the correction unit 124 described later. For example, the history storage unit 112 is referred to by the determination unit 122, the estimation unit 123, and the correction unit 124.

  As an example, the history storage unit 112 stores data in which ID (Identification), time, input coordinate x, input coordinate y, key ID, input content, displacement x, displacement y, estimated content, and holding state are associated. To do. Among these, ID refers to an identifier for uniquely identifying a record registered in the history storage unit 112. Further, the time indicates an elapsed time from the time when the input device 100 is activated. The input coordinate x indicates a coordinate in the horizontal direction among coordinates that have received a key input to the touch screen. For example, the coordinates are indicated in pixel units with the upper left corner of the touch screen as the origin. The input coordinate y indicates a coordinate in the vertical direction among the coordinates that have received a key input to the touch screen. The key ID indicates an identifier for uniquely identifying the input key corresponding to the input coordinates x and y. The input content indicates the content of the input key corresponding to the input coordinates x and y. The deviation x indicates the x component of the deviation from the center coordinate of the input key to the input coordinate. The deviation y indicates the y component of the deviation from the center coordinates of the input key to the input coordinates. Further, the estimated content indicates the content of the input key that is estimated to have been originally intended to be pressed by the user of the input device 100. The holding state refers to a state in which the input device 100 is held by the user when input coordinates are input, and includes a holding method and a holding angle. This holding method classifies whether the user holds the input device 100 with one hand, whether it is held with both hands, input with the right hand, or input with the left hand. The holding angle indicates an angle at which the input device 100 is held by the user. For example, the holding angle is classified as 0 ° when the touch screen 2a of the input device 100 is turned upward and horizontal, and the right-hand thread direction of the pitch axis is classified as a positive angle. The description of the holding method and the holding angle will be described later together with the description of the determination unit 122. The input coordinates correspond to the center of gravity of the contact surface between the touch screen and the user's finger, for example. The estimated content is an example of an estimation history. Further, the deviation x and the deviation y are examples of deviation amounts.

  FIG. 4 is a diagram illustrating an example of information stored in the history storage unit 112. In the record shown in the first line of FIG. 4, the history storage unit 112 has an ID “1”, a time “5136”, an input coordinate x “354”, an input coordinate y “580”, a key ID “28”, and an input content “ k ”, a deviation x“ 11 ”, and a deviation y“ 6 ”are stored. Further, in the record shown in the first line of FIG. 4, the history storage unit 112 stores data in which the estimated content “k”, the holding method “one-hand unstable right holding”, and the holding angle “−20 to +20” are associated. Remember. That is, the record shown in the first line in FIG. 4 is a record in which the key input of ID “1” is input with input coordinates (x, y) = (354, 580) 5136 milliseconds after the input device 100 is activated. This indicates that the input key corresponding to this input coordinate is the input key “k” with the key ID “28”. Further, in the record shown in the first line of FIG. 4, the shift amount from the center coordinate to the input coordinate of the input key “k” is (x, y) = (11, 6). This indicates that the key originally intended to be input is estimated as “k”. The record shown in the first line of FIG. 4 indicates that this key input is input in the holding state of the holding method “one-hand unstable right holding” at the holding angle “−20 to +20”. Similarly, the history storage unit 112 also associates ID, time, input coordinate x, input coordinate y, key ID, input content, displacement x, displacement y, estimated content, and holding state for other records. Store the data.

  The control unit 120 includes a reception unit 121, a determination unit 122, an estimation unit 123, and a correction unit 124. The function of the control unit 120 can be realized by an integrated circuit such as an application specific integrated circuit (ASIC) or a field programmable gate array (FPGA). Further, the function of the control unit 120 can be realized, for example, by a CPU (Central Processing Unit) executing a predetermined program.

  The accepting unit 121 accepts key input. For example, the receiving unit 121 receives the input coordinates received by the input unit 101 from the input unit 101. The receiving unit 121 determines an input key corresponding to the input coordinates received from the input unit 101. The receiving unit 121 calculates a deviation amount from the determined center coordinate of the input key to the input coordinate. Then, the reception unit 121 registers the input time, input coordinates, input key, key ID of the input key, and shift amount in association with the ID in the history storage unit 112. In addition, the reception unit 121 outputs information indicating that the key input has been received to the determination unit 122.

  The determination unit 122 determines the holding state of the terminal provided with the touch screen. For example, the determination unit 122 determines whether the input is performed by the hand on the same side as the hand holding the terminal or the hand on the side different from the hand holding the terminal based on the acceleration waveform in the front and back direction of the terminal. judge. For example, the determination unit 122 determines whether the terminal is stable or unstable based on the acceleration waveform in the front-rear direction of the terminal. For example, the determination unit 122 determines whether the terminal is held by the right hand or the left hand based on the acceleration waveform in the left-right direction of the terminal.

  As one aspect, the determination unit 122 extracts an acceleration waveform at a time before and after the time when the input unit 101 receives an input from the acceleration waveform storage unit 111. Here, the time for extracting the acceleration waveform is set before the next input is received from when the finger is released from the touch screen. This is to analyze the acceleration of the input device 100 caused by a single input made to the touch screen. Then, the determination unit 122 determines a holding method and a holding angle of the input device 100 from the extracted acceleration waveform.

  Here, a process in which the determination unit 122 determines the holding method of the input device 100 will be described. For example, the determination unit 122 determines whether the input device 100 is input with “two hands” or “one hand”. Here, the case of inputting with “both hands” corresponds to the case of inputting with a hand on the side different from the hand holding the input device 100. For example, the determination unit 122 counts the number of high-frequency component peaks whose amplitudes are equal to or greater than a threshold among the Z components of the acceleration waveform extracted from the acceleration waveform storage unit 111. The amplitude of the high frequency component is, for example, 10 Hz or more. When the number of counted peaks is equal to or greater than a predetermined number, the determination unit 122 determines that the input is performed by a hand on the side different from the hand holding the input device 100, that is, input by “both hands”. On the other hand, when the number of counted peaks is less than the predetermined number, the determination unit 122 determines that the input is performed by the hand on the same side as the hand holding the input device 100, that is, input by “one hand”. Note that the number of high-frequency component peaks is counted here when the input device 100 is stably held when input by a hand on the side different from the hand holding the input device 100. This is because the above vibration contains a lot of high frequency components. On the other hand, when the input is performed by a hand on the same side as the hand holding the input device 100, the base of the thumb of the held hand moves, and thus a low frequency component due to the movement of the input device 100 is added. It becomes.

  For example, when the determination unit 122 determines that the input is performed with “one hand”, the determination unit 122 determines whether the input device 100 is held “stable” or “unstable”. Here, “stable” refers to, for example, a state in which the input device 100 is held by a finger and palm, and “unstable” refers to a state in which the input device 100 is held only by a finger. The determination unit 122 removes the low frequency component from the Y component of the acceleration waveform extracted from the acceleration waveform storage unit 111, and determines “unstable” when the peak amplitude is equal to or greater than the threshold value. On the other hand, the determination unit 122 determines “stable” when the amplitude of the peak is less than the threshold. Note that the Y component of the acceleration waveform is focused here when the input device 100 is held only by a finger, the positional relationship of the center of gravity between the holding finger and the input finger is shifted. This is because rotation in the pitch axis direction occurs when inputting, and the waveform of the Y component changes.

  Further, for example, the determination unit 122 determines whether to hold “right” held with the right hand or “left hold” held with the left hand. For example, the determination unit 122 examines the polarity and the magnitude after removing the low frequency component from the X component of the acceleration waveform extracted from the acceleration waveform storage unit 111. The determination unit 122 determines “hold right” when the polarity of the median peak is negative with respect to the extracted peak, and “hold left” when the polarity is positive. Is determined. Here, attention is paid to the polarity of the peak of the X component of the acceleration waveform because the rotation in the roll axis direction occurs around the base of the thumb of the hand holding the input device 100 when inputting to the touch screen. This is because the waveform resulting from this rotation appears in the X component of the acceleration waveform. That is, since the rotation direction of the rotation differs depending on whether it is held right or left, it is determined whether the hold is right or left by detecting the polarity of the peak of the X component of the acceleration waveform. The “right hold” here corresponds to a case where the user inputs with the right hand while holding the input device 100 with the right hand, and a case where the user inputs with the left hand while holding the input device 100 with the right hand. “Left hold” corresponds to a case where the user inputs with the left hand while holding the input device 100 with the left hand, and a case where the user inputs with the right hand while holding the input device 100 with the left hand.

  As described above, for example, the determination unit 122 determines the holding method of the input device 100. In other words, the determination unit 122 includes 6 types of “holding both hands right”, “holding both hands left”, “holding one hand stable right”, “holding one hand stable left”, “holding one hand unstable right” and “holding one hand unstable left”. Which holding method is determined from among the patterns. Then, the determination unit 122 registers the determination result in the holding method of the history storage unit 112 in FIG.

  For example, the determination unit 122 determines the holding angle. As an example, the determination unit 122 obtains the holding angle of the input device 100 by calculating the Y component and the Z component of the acceleration waveform. Then, the determination unit 122 classifies the state in which the touch screen 2a of the input device 100 is turned upward and is horizontal as 0 °, and classifies the right-handed direction of the pitch axis as a positive angle. For example, the determination unit 122 classifies into four groups of “−20 ° to + 20 °”, “+ 20 ° to + 60 °”, “+ 60 ° to +90”, and “+ 90 ° to −20”. Then, the determination unit 122 registers any one of the four classified groups in the holding angle of the history storage unit 112. Here, the determination unit 122 classifies the holding angle because the angle in the pitch axis direction is likely to change depending on the use state of the user of the input device 100, and the shift position varies depending on the holding angle. . In addition, here, a case has been described in which the determination unit 122 determines the holding angle by using the Y component and the Z component of the acceleration waveform, but the disclosed technique is not limited thereto. For example, the determination unit 122 may determine the holding angle using angle information provided from a system of the input device 100 (not shown).

  For example, the estimation unit 123 estimates an input key that is estimated to have been originally intended to be pressed by the user of the input device 100. Here, the estimation unit 123 estimates the input key because the input key that the user of the input device 100 originally wanted to press is not necessarily pressed. This is because a key different from the input key that the user wanted to do may be pressed.

  As an example, the estimation unit 123 refers to the history storage unit 112 and detects a correction key for correcting the key input from the history storage unit 112. The correction key includes, for example, a key such as a backward key and an erase key. When the estimation unit 123 detects the correction key, the estimation unit 123 determines that the input key deleted by the input of the correction key is an error, and registers information indicating that the key input is an error in the history storage unit 112. The estimation unit 123 determines that the input key input after the correction key is the input key that the user of the input device 100 originally wanted to press, and registers information to that effect in the history storage unit 112. .

  A process in which the estimation unit 123 estimates the input key will be described with reference to FIG. Here, “BS” in the history storage unit 112 in FIG. 4 corresponds to a backspace key for deleting the input key immediately before, and is an example of a correction key. Further, it is assumed that “y” is registered in the estimation content corresponding to the ID “7” in the history storage unit 112 in FIG. 4 before the estimation unit 123 performs the process of estimating the input key.

  For example, when the estimation unit 123 refers to the history storage unit 112 and detects the BS with the ID “8”, the estimation unit 123 determines that the input content “y” of the ID “7” input immediately before the BS is an error. Then, the estimation unit 123 updates the estimated content “y” of the ID “7” from “y → wrong”. The estimation unit 123 determines that the input key “t” with the ID “9” input immediately after the BS is the input key that the user of the input device 100 originally wanted to press. Then, the estimation unit 123 updates the estimated content “y → wrong” of the ID “7” to “y → wrong → t”. Here, a case has been described in which the estimation unit 123 detects the correction key and estimates the input key that the user originally wanted to input, but the disclosed technique is not limited to this. For example, the estimation unit 123 may estimate the estimation content using a predictive conversion function. For example, in the predictive conversion function, “very” may be displayed on the touch screen as a predictive conversion candidate when “yotemo” is key-input. In this case, if “very” is selected by the user, the estimation unit 123 regards “totemo” as synonymous with the input, “y” is an error, and “t” was originally input. It is determined that the key is

  For example, the correction unit 124 corrects the input coordinates input to the touch screen according to the holding state determined by the determination unit 122. Further, for example, when the deviation amount is equal to or larger than a threshold value set for each input key, the correction unit 124 refers to the history storage unit 112 and associates it with a past input coordinate having a deviation amount equal to or larger than the threshold value. The estimated history is corrected.

  As an example, the correction unit 124 refers to the history storage unit 112, and when the number of estimated histories associated with past input coordinates having a deviation amount equal to or greater than the threshold is greater than or equal to a predetermined number, the input input The input key corresponding to the coordinates is corrected to the estimation history. On the other hand, when the number of estimation histories is less than the predetermined number, the correction unit 124 corrects the input coordinates input with a preset correction value, and determines an input key corresponding to the corrected input coordinates.

  A process in which the correction unit 124 corrects the input coordinates will be described with reference to FIG. FIG. 5 is a diagram for explaining processing in which the correction unit 124 corrects input coordinates. Here, a case where the key input corresponding to the ID “11” in FIG. 4 is received by the receiving unit 121 will be described. The case where the held state of the key input accepted here is the holding method “one-hand unstable right holding” and the holding angle “−20 to +20” will be described. When a key input corresponding to the ID “11” in FIG. 4 is received by the receiving unit 121, a deviation (x, y) = (27, 33) is registered in the history storage unit 112. When the deviation amount is registered in the history storage unit 112, the correction unit 124 determines whether the registered deviation amount is equal to or greater than a threshold value. This threshold value is set in advance for each input content, for example, as a magnitude of a deviation that may cause an error in key input that the user of the input device 100 originally wanted to press. For example, when a threshold value of deviation (x, y) = (20, 20) is set and a key input having a deviation larger than these threshold values is accepted, it is estimated that the key input may be erroneous. Is done. When the deviation (x, y) = (27, 33) is registered in the history storage unit 112, the correction unit 124 determines that this key input is equal to or greater than the deviation threshold (x, y) = (20, 20). judge. The correction unit 124 corresponds to the holding method “one-hand unstable right holding” and the holding angle “−20 to +20” in the history storage unit 112 registered in the past, and the input content “y”. Records whose deviation is equal to or greater than the threshold (x, y) = (20, 20) are extracted.

  For example, the correction unit 124 extracts seven records as illustrated in FIG. The correction unit 124 determines whether or not the number of extracted records is equal to or greater than a predetermined number. Here, for example, when the predetermined number “5” is set, the correction unit 124 corrects the input key based on the extracted record. Since the estimated content of the extracted record is “y → wrong → t”, the correction unit 124 has an error in the input key “y” corresponding to the ID “11” in FIG. It is estimated that the key originally intended to be pressed is “t”. In addition, although the case where all of the extracted estimated contents are the same “y → false → t” has been described here, the estimated contents are not necessarily the same. For this reason, the correction unit 124 may use the estimated content corresponding to the record having the received input key shift and the closest one.

  On the other hand, when the number of extracted records is less than the predetermined number “5”, the correction unit 124 corrects the input coordinate input using a preset correction value. For example, the correction value (x, y) = (− 20, −20) is set in advance for each input content. For example, when the number of extracted records is less than the predetermined number “5”, the correcting unit 124 corrects the input coordinates (x, y) = (223, 529) of the input key of the received ID “11”. Add values to correct input coordinates. Then, the correction unit 124 determines an input key corresponding to the corrected coordinates (x, y) = (203, 509). As an example, the correction unit estimates that the received input key is “t”.

  Then, the correction unit 124 outputs the estimated content “t” that has been estimated. For example, the correction unit 124 outputs the estimated content to the application that has received the key input. As one aspect, when the application that has received the key input of ID “11” is mail software, the correction unit 124 outputs the estimated content “t” to the mail software as a conversion candidate by the key input. .

  Next, a processing procedure of the input device 100 according to the first embodiment will be described. FIG. 6 is a flowchart showing the processing procedure of the correction processing. FIG. 7 is a flowchart illustrating the processing procedure of the determination process. FIG. 8 is a flowchart showing the processing procedure of the estimation process. The process illustrated in FIG. 6 is executed, for example, when the reception unit 121 receives a key input.

  As illustrated in FIG. 6, when the reception unit 121 receives a key input (Yes at Step S101), the reception unit 121 registers information related to the received key input in the history storage unit 112 (Step S102). For example, the reception unit 121 determines an input key corresponding to the input coordinates received from the input unit 101. The receiving unit 121 calculates a deviation amount from the determined center coordinate of the input key to the input coordinate. Then, the reception unit 121 registers the input time, input coordinates, input key, key ID of the input key, and shift amount in association with the ID in the history storage unit 112.

  The determination unit 122 performs a determination process for determining the holding state of the input device 100 (step S103). Here, the determination process executed by the determination unit 122 will be described with reference to FIG.

  As illustrated in FIG. 7, the determination unit 122 extracts an acceleration waveform at a time before and after the time when the input unit 101 receives an input from the acceleration waveform storage unit 111 (step S <b> 201). The determination unit 122 counts the number of high-frequency component peaks whose amplitude is greater than or equal to the threshold value among the Z components of the acceleration waveform extracted from the acceleration waveform storage unit 111, and determines whether or not the counted number of peaks is greater than or equal to a predetermined number. Determination is made (step S202). When the counted number of peaks is equal to or greater than the predetermined number (Yes at Step S202), the determination unit 122 determines that the input is performed with “one hand” (Step S203). On the other hand, when the number of counted peaks is less than the predetermined number (No at Step S202), the determination unit 122 determines that the input is performed with “both hands” (Step S204), and the process proceeds to Step S208.

  Subsequently, the determination unit 122 removes the low frequency component from the Y component of the acceleration waveform extracted from the acceleration waveform storage unit 111, and determines whether or not the peak amplitude is equal to or greater than the threshold (step S205). If the peak amplitude is greater than or equal to the threshold (Yes at Step S205), the determination unit 122 determines “unstable” (Step S206). On the other hand, when the peak amplitude is less than the threshold (No at Step S205), the determination unit 122 determines “stable” (Step S207), and proceeds to the process of Step S208.

  Subsequently, the determination unit 122 determines whether the polarity of the peak of the X component of the acceleration waveform is in the plus direction after removing the low frequency component from the X component of the acceleration waveform extracted from the acceleration waveform storage unit 111. (Step S208). When the polarity is in the positive direction (Yes at Step S208), the determination unit 122 determines “hold left” (Step S209). On the other hand, when the polarity is in the minus direction (No at Step S208), the determination unit 122 determines “hold right” (Step S210). And the determination part 122 determines a holding | maintenance angle (step S211), and transfers to the process of step S104.

  Returning to the description of FIG. When the deviation amount is registered in the history storage unit 112, the correction unit 124 determines whether or not the registered deviation amount is equal to or greater than a threshold value (step S104). When the registered deviation amount is equal to or larger than the threshold (Yes at Step S104), the correction unit 124 extracts a record whose holding state and input content match the registered input key and whose deviation is equal to or larger than the threshold. (Step S105). On the other hand, when the registered deviation amount is less than the threshold (No at Step S104), the correcting unit 124 proceeds to the process at Step S101.

  The correcting unit 124 determines whether or not the number of extracted records is a predetermined number or more (step S106). When the number of extracted records is greater than or equal to the predetermined number (Yes at Step S106), the correcting unit 124 corrects the input key based on the extracted records (Step S107). On the other hand, if the number of extracted records is less than the predetermined number (No at Step S106), the correction unit 124 corrects the input coordinates that have been input with a preset correction value (Step S108). Then, the correction unit 124 estimates an input key corresponding to the corrected coordinates (step S109).

  And the correction | amendment part 124 outputs the estimated content estimated (step S110). For example, the correction unit 124 outputs the estimated content to the application that has received the key input. As one aspect, when the application that has received the key input of ID “11” is mail software, the correction unit 124 outputs the estimated content “t” to the mail software as a conversion candidate by the key input. .

  Next, the processing procedure of the estimation process will be described with reference to FIG. The processing shown in FIG. 8 is executed at predetermined time intervals, for example, while power is supplied from the power source to the illustrated devices.

  As illustrated in FIG. 8, the estimation unit 123 refers to the history storage unit 112 and detects a correction key from the history storage unit 112 (step S301). The estimation unit 123 determines whether or not the difference between the time when the correction key is received and the time of key input corrected with the correction key is less than the threshold (step S302). If it is less than the threshold (Yes at Step S302), the estimation unit 123 determines whether or not the corrected number of characters is equal to or less than a predetermined number (Step S303). When the corrected number of characters is equal to or smaller than the predetermined number (Yes at Step S303), the estimation unit 123 inputs the input key that the user of the input device 100 originally wanted to press the input key input after the correction key. The key is estimated (step S304). Then, the estimation unit 123 registers the estimated information in the history storage unit 112 (step S305).

  On the other hand, when it is equal to or greater than the threshold (No at Step S302), the estimation unit 123 ends the process. If the corrected number of characters is greater than or equal to the predetermined number (No at Step S303), the estimating unit 123 ends the process.

  Next, effects of the input device 100 according to the first embodiment will be described. The input device 100 determines the holding state of the terminal provided with the touch screen. The input device 100 corrects input coordinates input to the touch screen according to the determined holding state. For this reason, the input device 100 can prevent erroneous input. For example, since the input device 100 corrects the input coordinates input according to the holding state of the terminal, when the user holds the terminal with the right hand, the amount of deviation measured when holding the terminal with the left hand Even if the display position of the input key is changed using, erroneous input can be prevented.

  Further, for example, the input device 100 refers to the history storage unit 112, and when the number of estimated histories associated with past input coordinates having a deviation amount equal to or greater than the threshold is greater than or equal to a predetermined number, the input input The input key corresponding to the coordinates is corrected to the estimation history. Further, when the number of estimation histories is less than a predetermined number, the input device 100 corrects input coordinates input with a preset correction value, and determines an input key corresponding to the corrected input coordinates. For this reason, the input device 100 can accurately estimate the input key corresponding to the input coordinates.

  Although the embodiments of the present invention have been described so far, the present invention may be implemented in other embodiments besides the above-described embodiments. Therefore, other embodiments will be described below.

  For example, in the above-described embodiment, the case where the input device 100 corrects the input coordinates for each input key according to the holding state has been described, but the disclosed technique is not limited thereto. For example, the input device 100 may correct the input coordinates for each area of the touch screen. For example, the input device 100 may determine the correction amount according to the distance from the finger that is input to the touch screen.

  Further, for example, in the above embodiment, it has been described that the correction value used by the correction unit 124 is set in advance when the number of extracted records is less than the predetermined number. In the disclosed technique, this correction value may be set using the biological condition of the user. FIG. 9 is a diagram for explaining an example of a correction value calculation method. FIG. 9 illustrates a view of the user and the input device 100 as viewed from above. In FIG. 9, 9a indicates the user's right eye, 9b indicates the user's left eye, and 9c indicates the finger of the user who performs key input. A case where the user's effectiveness is the right eye 9a will be described. In this case, when the user tries to press the point 9e on the screen of the input device 100, the point 9e is hidden behind the finger 9c and cannot be seen. Then, since the user presses while viewing the point 9d on the finger when viewing the point 9e from the right eye 9a, the point 9f on the screen is actually pressed. That is, when the user's effect is the right eye, the distance is shifted by 9 g in the right direction from the point 9e originally intended to be pressed. For this reason, the correction unit 124 calculates a correction value corresponding to the deviation 9 g using the following equation (1).

  Zd = Yd (Ed + Md) / Gd (1)

  In equation (1), Zd corresponds to the shifted distance 9g. Yd corresponds to the finger thickness 9j. Ed corresponds to the eye position 9h. Md corresponds to a point 9e on the screen that the user wants to press. Gd corresponds to the distance from the effect 9a to the screen. For example, the correction unit 124 uses Zd calculated using Expression (1) as a correction value. Note that these parameters may be input in advance by the user, or average values may be used.

  Further, for example, among the processes described in the first embodiment, all or part of the processes described as being automatically performed can be manually performed, or have been described as being manually performed. All or a part of the processing can be automatically performed by a known method. In addition, the processing procedures, control procedures, specific names, and information including various data and parameters shown in the above-described document and drawings can be arbitrarily changed unless otherwise specified.

  Each component of the input device 100 shown in FIG. 1 is functionally conceptual and does not necessarily need to be physically configured as illustrated. That is, the specific form of distribution / integration of the input device 100 is not limited to the illustrated one, and all or a part thereof is functionally or physically distributed in an arbitrary unit according to various loads or usage conditions. -Can be integrated and configured.

[program]
FIG. 10 is a diagram illustrating an example of a computer that executes an input program. As illustrated in FIG. 10, the computer 300 includes a CPU 301 that executes various arithmetic processes, an input device 302 that receives data input from a user, and a monitor 303. The computer 300 also includes a medium reading device 304 that reads a program or the like from a storage medium, an interface device 305 for connecting to another device, and a wireless communication device 306 for connecting to another device wirelessly. The computer 300 also includes a RAM (Random Access Memory) 307 that temporarily stores various types of information and a hard disk device 308. Each device 301 to 308 is connected to a bus 309.

  The hard disk device 308 stores an extraction program having the same functions as the processing units of the determination unit 122 and the correction unit 124 illustrated in FIG. The hard disk device 308 stores various data for realizing the input program.

  The CPU 301 reads out each program stored in the hard disk device 308, develops it in the RAM 307, and executes it to perform various processes. In addition, these programs can cause the computer to function as the determination unit 122 and the correction unit 124 illustrated in FIG. 1.

  Note that the above input program is not necessarily stored in the hard disk device 308. For example, the computer 300 may read and execute a program stored in a computer-readable recording medium. The computer-readable recording medium corresponds to, for example, a portable recording medium such as a CD-ROM, a DVD disk, a USB (Universal Serial Bus) memory, a semiconductor memory such as a flash memory, a hard disk drive, and the like. Further, the program may be stored in a device connected to a public line, the Internet, a LAN (Local Area Network), a WAN (Wide Area Network), etc., and the computer 300 may read and execute the program therefrom. good.

  The following supplementary notes are further disclosed with respect to the embodiments including the above examples.

(Additional remark 1) The determination part which determines the holding | maintenance state of the terminal provided with the touch screen,
An input device comprising: a correction unit that corrects input coordinates input to the touch screen in accordance with the holding state determined by the determination unit.

(Additional remark 2) Based on the acceleration waveform of the front and back direction of the said terminal, the said determination part is input by the hand on the same side as the hand holding the said terminal, or by the hand on the side different from the hand holding the said terminal Whether the terminal is stable or unstable based on the longitudinal acceleration waveform of the terminal, and the terminal is held by the right hand based on the lateral acceleration waveform of the terminal The input device according to appendix 1, wherein any one or a plurality of determinations for determining whether to be held or to be held by the left hand are performed.

(Supplementary Note 3) The holding state when the input coordinates input in the past are input, the shift amount from the center coordinate of the input key corresponding to the input coordinate to the input coordinate, and the input coordinate is the input key A history storage unit that stores the estimated history estimated to the input key different from
The correction unit refers to the history storage unit when a deviation amount from the center coordinate of the input key corresponding to the input coordinate to the input coordinate is equal to or larger than a threshold set for each input key. The input apparatus according to appendix 1 or 2, wherein correction is made to the estimation history associated with past input coordinates having a deviation amount equal to or greater than the threshold value.

(Additional remark 4) The said correction | amendment part was input when the number of the said estimation log | history matched with the past input coordinate which has the deviation | shift amount more than the said threshold value with reference to the said log | history memory | storage part is more than predetermined number When the input key corresponding to the input coordinate is corrected to the estimated history, and the number of the estimated history is less than a predetermined number, the input coordinate input is corrected with a preset correction value, and the corrected input coordinate is set. The input device according to appendix 3, wherein a corresponding input key is determined.

(Appendix 5)
Determine the holding state of a device with a touch screen,
An input program for executing each process for correcting input coordinates input to the touch screen in accordance with the holding state determined by the determination process.

(Additional remark 6) Based on the acceleration waveform of the front and back direction of the said terminal, the process to determine is input by the hand on the same side as the hand holding the said terminal, or the hand on the side different from the hand holding the said terminal Based on the acceleration waveform in the longitudinal direction of the terminal, whether the terminal is stable or unstable, and based on the acceleration waveform in the horizontal direction of the terminal, the terminal is The input program according to appendix 5, wherein any one or a plurality of determinations for determining whether to be held or to be held by the left hand are performed.

(Supplementary note 7) In the past, when the amount of deviation from the center coordinate of the input key corresponding to the input coordinate to the input coordinate is equal to or greater than a threshold set for each input key, the correction process is performed in the past. The holding state when the input coordinates are input, the amount of deviation from the center coordinates of the input key corresponding to the input coordinates to the input coordinates, and the input keys that are different from the input keys. Supplementary note 5 or 5, wherein a correction is made to the estimated history associated with a past input coordinate having a deviation amount equal to or greater than the threshold with reference to a history storage unit that stores the estimated history in association with the estimated history. 6. The input program according to 6.

(Additional remark 8) The process to correct | amend is input when the number of the said estimation log | history matched with the past input coordinate which has the deviation | shift amount more than the said threshold value with reference to the said log | history memory | storage part is more than predetermined number. The input key corresponding to the input coordinate is corrected to the estimated history, and when the number of the estimated histories is less than the predetermined number, the input coordinate input is corrected by a preset correction value, and the corrected input coordinate is corrected. The input program according to appendix 7, wherein an input key corresponding to is determined.

(Supplementary note 9) An input method executed by a computer,
Computer
Determine the holding state of a device with a touch screen,
An input method comprising: executing each process of correcting input coordinates input to the touch screen according to the holding state determined by the determining process.

(Additional remark 10) Based on the acceleration waveform of the front and back direction of the said terminal, the process to determine is input by the hand on the same side as the hand holding the said terminal, or the hand on the side different from the hand holding the said terminal Based on the acceleration waveform in the longitudinal direction of the terminal, whether the terminal is stable or unstable, and based on the acceleration waveform in the horizontal direction of the terminal, the terminal is The input method according to appendix 9, wherein any one or a plurality of determinations for determining whether to be held or to be held by the left hand are performed.

(Additional remark 11) The said process to correct | amend is the past, when the deviation | shift amount from the center coordinate of the input key corresponding to the input coordinate to the said input coordinate is more than the threshold set for every said input key. The holding state when the input coordinates are input, the amount of deviation from the center coordinates of the input key corresponding to the input coordinates to the input coordinates, and the input keys that are different from the input keys. Supplementary note 9 or 7, wherein a correction is made to the estimated history associated with past input coordinates having a deviation amount equal to or greater than the threshold with reference to a history storage unit that stores the estimated history in association with the estimated history. The input method according to 10.

(Additional remark 12) The said process to correct | amend is input when the number of the said estimation log | history matched with the past input coordinate which has the deviation | shift amount more than the said threshold value with reference to the said log | history memory | storage part is more than predetermined number. The input key corresponding to the input coordinate is corrected to the estimated history, and when the number of the estimated histories is less than the predetermined number, the input coordinate input is corrected by a preset correction value, and the corrected input coordinate is corrected. The input method according to appendix 11, wherein an input key corresponding to is determined.

DESCRIPTION OF SYMBOLS 100 Input device 101 Input part 102 Output part 103 Communication control part 110 Storage part 111 Acceleration waveform storage part 112 History storage part 120 Control part 121 Reception part 122 Determination part 123 Estimation part 124 Correction part 300 Computer 301 CPU
302 Input Device 303 Monitor 304 Medium Reading Device 305 Interface Device 306 Wireless Communication Device 307 RAM
308 Hard disk device 309 Bus

Claims (8)

A determination unit that determines a holding state of a terminal including a touch screen by comparing the number of high-frequency component peaks whose amplitude is equal to or greater than a threshold value within a predetermined time in the acceleration waveform of the terminal ;
An input device comprising: a correction unit that corrects input coordinates input to the touch screen in accordance with the holding state determined by the determination unit. A determination unit for determining a holding state of the terminal including the touch screen;
A correction unit that corrects input coordinates input to the touch screen according to the holding state determined by the determination unit;
The holding state when the input coordinates input in the past are input, the shift amount from the center coordinate of the input key corresponding to the input coordinate to the input coordinate, and the input in which the input coordinate is different from the input key A history storage unit for storing the estimated history estimated for the key in association with each other;
Have
The correction unit refers to the history storage unit, and corresponds to the input coordinates input when the number of the estimated histories associated with past input coordinates having a deviation amount equal to or greater than a threshold is equal to or greater than a predetermined number. When the input key is corrected to the estimated history, and the number of the estimated histories is less than the predetermined number, the input coordinate input is corrected by a preset correction value, and the input key corresponding to the corrected input coordinate is An input device for determining. Whether the determination unit is input by a hand on the same side as the hand holding the terminal or by a hand on the side different from the hand holding the terminal based on the acceleration waveform in the front and back direction of the terminal And determining whether the terminal is stable or unstable based on the acceleration waveform in the front-rear direction of the terminal and determining whether the terminal is held by the right hand or the left hand based on the acceleration waveform in the left-right direction of the terminal. input device according to claim 1 or 2, characterized in that any one or more of the judgment determines is held by. The holding state when the input coordinates input in the past are input, the shift amount from the center coordinate of the input key corresponding to the input coordinate to the input coordinate, and the input in which the input coordinate is different from the input key A history storage unit that stores the estimated history estimated in association with the key;
The correction unit refers to the history storage unit when a deviation amount from the center coordinate of the input key corresponding to the input coordinate to the input coordinate is equal to or larger than a threshold set for each input key. The input device according to claim 1 , wherein the input history is corrected to the estimation history associated with past input coordinates having a deviation amount equal to or greater than the threshold value. On the computer,
The holding state of the terminal equipped with the touch screen is determined by comparing the number of high-frequency component peaks whose amplitude is greater than or equal to the threshold value within a predetermined time in the acceleration waveform of the terminal ,
An input program for executing each process for correcting input coordinates input to the touch screen in accordance with the holding state determined by the determination process. An input method performed by a computer,
Computer
The holding state of the terminal equipped with the touch screen is determined by comparing the number of high-frequency component peaks whose amplitude is greater than or equal to the threshold value within a predetermined time in the acceleration waveform of the terminal ,
An input method comprising: executing each process of correcting input coordinates input to the touch screen according to the holding state determined by the determining process. On the computer,
Determine the holding state of a device with a touch screen,
According to the determined holding state, the input coordinates input to the touch screen are corrected,
The holding state when the input coordinate is input, the amount of deviation from the center coordinate of the input key corresponding to the input coordinate to the input coordinate, and the input coordinate is estimated to be an input key different from the input key The estimated history is associated with and stored in the history storage unit
Run each process,
The correction process refers to the input storage coordinates when the number of the estimated histories associated with past input coordinates having a deviation amount equal to or greater than a threshold is greater than or equal to a predetermined number with reference to the history storage unit. When the input key to be corrected is corrected to the estimated history, and the number of the estimated histories is less than a predetermined number, the input coordinate input is corrected by a preset correction value, and the input key corresponding to the corrected input coordinate An input program characterized by determining An input method performed by a computer,
Determine the holding state of a device with a touch screen,
According to the determined holding state, the input coordinates input to the touch screen are corrected,
The holding state when the input coordinate is input, the amount of deviation from the center coordinate of the input key corresponding to the input coordinate to the input coordinate, and the input coordinate is estimated to be an input key different from the input key The estimated history is associated with and stored in the history storage unit
Execute each process,
The correction process refers to the input storage coordinates when the number of the estimated histories associated with past input coordinates having a deviation amount equal to or greater than a threshold is greater than or equal to a predetermined number with reference to the history storage unit. When the input key to be corrected is corrected to the estimated history, and the number of the estimated histories is less than a predetermined number, the input coordinate input is corrected by a preset correction value, and the input key corresponding to the corrected input coordinate An input method characterized by determining.

Images