JP2012185565A - Portable information terminal and information input method thereof - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a portable information terminal for inputting information without visualizing a display in a portable information terminal equipped with a touch panel and its character input method.SOLUTION: This portable information terminal includes: an input device for detecting the presence/absence of a contact by a user and the position of the contact point. A processor arranges a virtual input key for inputting information on the input device by defining the position of a first contact point detected by the input device as a reference position, and when detecting a second contact point due to the contact with the virtual input key on the input device, determines the information corresponding to the second contact point from a relative positional relation between the first contact point and the second contact point.

Description

  The present invention relates to a portable information terminal including a touch panel and an information input method thereof.

  In portable information terminals such as mobile phones such as smartphones and PDAs (Personal Data Assistance, Personal Digital Assistants), a display that occupies a wide area is arranged in front of the terminal, and the upper surface of the display is transparent A configuration in which a touch panel is arranged is known. In such a portable information terminal, a keyboard (software keyboard) is displayed on the display by software processing, and the user can input information such as characters and symbols by touching virtual input keys of the software keyboard.

  Incidentally, in general, a mechanical keyboard provided in a portable information terminal, a computer, or the like is provided with a marker that can be perceived with a fingertip on a specific key so that the home position at the time of operation can be confirmed.

  However, in a portable information terminal equipped with a touch panel, the display performance of the display is deteriorated, so that unevenness cannot be provided on the touch panel in accordance with the display position of the software keyboard. Therefore, the surface of the touch panel is generally transparent and flat.

  Therefore, information cannot be input while visually recognizing the display. For example, visually handicapped persons cannot confirm the position of the virtual input key because there is no unevenness that can be perceived with the fingertip on the touch panel. It is difficult to.

  In addition, about the information input method with respect to the portable information terminal provided with the mechanical keyboard, the patent document 1 and the patent document 2 are proposed, for example. Patent Document 1 describes a mobile phone that includes a plurality of auxiliary operation keys and simplifies the character input operation by selecting a character by a combination of a numeric input key and an auxiliary operation key. Patent Document 2 describes a PDA that includes a switching key and a plurality of input keys, and that simplifies the character input operation by changing the character assigned to each input key by operating the switching key. .

  Moreover, the information input method with respect to information processing apparatus provided with the touchscreen is proposed by patent documents 3-5, for example. Patent Document 3 proposes an information processing apparatus that can input information without hindering screen display by displaying only the home position (reference position) of a software keyboard arranged on a display. Patent Document 4 proposes a portable information terminal in which virtual input keys are arranged in the vicinity of the side of the display so that information can be input without obstructing screen display. Patent Document 5 proposes an input device that enables information input with one hand by arranging virtual input keys on a touch panel corresponding to the shape of the palm.

JP 2001-236169 A JP 2003-186613 A JP 2004-54589 A JP 2006-148536 A JP 2005-025489 A

  As described above, a touch panel generally used in a portable information terminal has a flat surface and no irregularities that can be perceived by a fingertip. Therefore, a visually impaired person uses a virtual input key for character input or the like. There is a problem that the position cannot be confirmed, and the information input operation using the virtual input key is difficult.

  The present invention has been made to solve the problems of the background art as described above, and in a portable information terminal equipped with a touch panel, a portable information terminal that allows a user to input information without viewing the display, and An object of the present invention is to provide a character input method.

In order to achieve the above-mentioned determination, the portable information terminal of the present invention includes an input device that detects the presence / absence of contact by a user and the position of the contact point;
By using the position of the first contact point detected by the input device as a reference position, a virtual input key for inputting information is arranged on the input device, and by touching the virtual input key on the input device A processing device that, when detecting a second contact point, determines information corresponding to the second contact point from a relative positional relationship between the first contact point and the second contact point;
Have

On the other hand, the information input method of the portable information terminal of the present invention is an information input method for inputting information to a portable information terminal including an input device that detects the presence or absence of contact by a user and the position of the contact point,
Processing equipment
Using the position of the first contact point detected by the input device as a reference position, placing a virtual input key for inputting information on the input device,
When a second contact point due to contact with the virtual input key on the input device is detected, information corresponding to the second contact point is obtained from a relative positional relationship between the first contact point and the second contact point. This is a method for discriminating.

  According to the present invention, the user can input information using the touch panel without visually recognizing the display.

It is a schematic diagram which shows an example of information input operation by the portable information terminal of this invention. It is a block diagram which shows the example of 1 structure of the portable information terminal of this invention. It is a block diagram which shows the example of 1 structure of the portable information terminal of 1st Embodiment. It is a top view which shows the external appearance of the portable information terminal of 1st Embodiment. It is a flowchart which shows the process sequence of the portable information terminal of 1st Embodiment. It is a flowchart which shows the process sequence of the portable information terminal of 2nd Embodiment.

  Next, the present invention will be described with reference to the drawings.

  FIG. 1 is a schematic diagram showing an example of information input operation by the portable information terminal of the present invention.

  When the input reference point is set on the touch panel by the user, the portable information terminal of the present invention arranges virtual input keys for inputting information based on the position of the input reference point. As shown in FIG. 1, the user first sets an input reference point by touching an arbitrary position on the touch panel with the thumb, and then uses a virtual input key arranged based on the position of the input reference point as an index finger. Characters, symbols, and the like can be input by touching with or the like (FIG. 1).

  FIG. 2 is a block diagram showing a configuration example of the portable information terminal of the present invention.

As shown in FIG. 2, the portable information terminal of the present invention is based on the input device 10 that detects the presence or absence of contact by the user and the position of the contact point, and the position of the first contact point detected by the input device 10 As a position, when a virtual input key for inputting information is arranged on the input device and a second contact point by contact with the virtual input key on the input device is detected, the first contact point and the second contact point are detected. And a processing device 20 that determines information corresponding to the second contact point from the relative positional relationship of the contact points.
(First embodiment)
FIG. 3 is a block diagram illustrating a configuration example of the portable information terminal according to the first embodiment, and FIG. 4 is a plan view illustrating an appearance of the portable information terminal according to the first embodiment.

  As shown in FIG. 3, the portable information terminal 1 according to the first embodiment includes a CPU (central processing unit) 2, a memory 3, a touch panel 4, a display 5, and a communication circuit 6. The portable information terminal 1 may include a microphone and a speaker for enabling voice communication. The speaker can also be used to prompt the user for confirmation or attention when inputting information. Further, the portable information terminal 1 may be provided with function keys for selecting, for example, power on / off, communication start / end, and other functions.

  The CPU 2 is connected to the memory 3, the touch panel 4, the display 5, and the communication circuit 6 through a bus and controls the operation of the entire portable information terminal 1 by executing processing according to various control programs. The information input method of the present invention is realized. Further, when the portable information terminal 1 is provided with a microphone, a speaker, a function key, etc., the CPU 2 is connected via a well-known interface circuit (audio processing circuit, amplifier circuit, switch, etc.) with these devices. .

  The memory 3 includes a ROM (Read Only Memory) and a RAM (Random Access Memory). In the ROM, for example, various control programs (software) executed by the CPU 2 and various data used in the processing of the CPU 2 are stored. In the RAM, for example, data necessary when the CPU 2 executes processing according to the control program is temporarily stored. The processing device 20 of the present invention shown in FIG. 2 is realized by, for example, the CPU 2 and the memory 3 shown in FIG.

  When the user's finger or the like touches a range that is effective as a touch surface, the touch panel 4 transmits data of coordinates (contact points) where there is a contact reaction to the CPU 2. The CPU 2 detects the presence / absence of the contact point and its coordinates based on the data received from the touch panel 4. The input device 10 of the present invention shown in FIG. 2 is realized by, for example, the touch panel 4 shown in FIG.

  The display 5 is a display device such as a liquid crystal panel or an organic EL panel that displays characters and images, or input reference points 41 and virtual input keys 42, which will be described later, in accordance with instructions from the CPU 2. The display 5 may be omitted when it is assumed that a visually impaired person uses it. The input reference point 41 and the virtual input key 42 may be displayed on the display 5 or may not be displayed.

  The communication circuit 6 is a known wireless circuit for transmitting and receiving information via a communication network, and enables data communication such as voice communication and electronic mail using a microphone and a speaker.

  As shown in FIG. 4, the portable information terminal 1 includes a display 5 on the front surface, and a transparent touch panel 4 is disposed so as to cover the upper surface of the display 5. A function key 7 and a microphone 61 are disposed at one end portion of the front surface of the portable information terminal 1, and a speaker 62 is disposed at the other end portion of the front surface of the portable information terminal 1.

  During an information input operation, a plurality of virtual input keys 42 are defined and arranged on the touch panel 4 based on the position of one input reference point 41 by processing by a control program. As the virtual input key 42, for example, there are 12 types of “0” to “9”, “*”, and “#” arranged in 4 rows and 3 columns as shown in FIG. Information indicating the arrangement of the virtual input keys 42 is stored in the memory 3 in advance, and the CPU 2 arranges the virtual input keys 42 according to the information.

  When the user holds the portable information terminal 1 with the left hand and performs the input operation with the right hand, the input reference point 41 may be provided, for example, diagonally to the left of the virtual input key 42 in consideration of operability. When the user holds the portable information terminal 1 with the right hand and performs an input operation with the left hand, the input reference point 41 may be provided, for example, diagonally to the lower right of the virtual input key 42. Switching between these input operations may be set using, for example, the function key 7 shown in FIG.

  4 shows an arrangement example of the input reference point 41 and the virtual input key 42 when the portable information terminal 1 is vertical (the longitudinal direction is the vertical direction in the figure), the portable information terminal 1 is horizontal. In some cases (the longitudinal direction is the horizontal direction in the figure), for example, the virtual input keys 42 may be arranged in 3 rows and 4 columns. Whether the portable information terminal 1 is vertical or horizontal can be detected using, for example, an acceleration sensor. When the mobile information terminal 1 includes an acceleration sensor, the virtual input key 42 may be disposed so as to be rotatable with respect to the input reference point 41 according to the attitude (angle) of the mobile information terminal 1. .

  Next, a method for inputting information to the portable information terminal 1 shown in FIGS. 3 and 4 will be described with reference to FIG.

  FIG. 5 is a flowchart illustrating a processing procedure of the portable information terminal according to the first embodiment. FIG. 5 shows a processing procedure of the CPU 2 at the time of inputting information to the portable information terminal 1 according to the first embodiment.

  In addition, the process of the portable information terminal 1 shown below shall be implement | achieved when CPU2 performs a process according to the control program stored in the memory 3. FIG.

  The information input operation using the input reference point 41 and the virtual input key 42 is started, for example, by an operation of the function key 7 shown in FIG.

  The user sets the portable information terminal 1 to the information input operation mode using the function keys 7 and the like, and touches the lower left corner of the touch panel 4 with the thumb.

  The CPU 2 monitors the presence or absence of the first contact point on the touch panel 4 (step S41). When the CPU 2 detects the first contact point, the coordinate is set as the input reference point 41, and the position of the input reference point 41 is used as a reference. Each virtual input key 42 is arranged on the touch panel 4 (step S42). If the first contact point cannot be detected in step S41, or if a plurality of contact points are detected, the CPU 2 issues an alarm by voice or the like using the speaker 62 (step S44), and inputs the input reference point 41 to the user. The setting operation is urged to be performed again, and the processing from step S41 is repeated. Note that the CPU 2 may notify the user of the detection of the first contact point by voice or the like using the speaker 62 even when the first contact point is detected.

  Next, the CPU 2 determines whether or not all the virtual input keys 42 can be arranged within the effective range of the touch panel 4 (step S43). When any of the virtual input keys 42 deviates from the effective range of the touch panel 4, the CPU 2 issues an alarm by voice or the like using the speaker 62 (step S44), and performs the setting operation of the input reference point 41 to the user again. While prompting, it returns to step S41 and repeats the process of steps S41-S44. Note that the CPU 2 may notify the user by voice or the like using the speaker 62 even when all the virtual input keys 42 can be arranged within the effective range of the touch panel 4.

  When all the virtual input keys 42 can be arranged within the effective range of the touch panel 4, the CPU 2 monitors the presence / absence of the second contact point on the touch panel 4 (step S45).

  The user estimates the position of the intended virtual input key 42 on the touch panel 4 based on the previously learned angle and interval between the thumb and, for example, the index finger (or another finger), and touches the position with the index finger or the like. To do.

  When detecting the second contact point, the CPU 2 specifies the virtual input key 42 touched by the user from the relative positional relationship between the input reference point 41 and the second contact point (step S46). Further, the CPU 2 notifies the user of the operation result (virtual input key touched by the user) by voice or the like using the speaker 62 (echo back: step S47). Thereafter, the operation result of the user is stored in a buffer provided in advance in the memory 3 (step S48), and the one character input process is terminated.

  If the second contact point cannot be detected in step S45, the CPU 2 returns to step S41 and repeats the processes in steps S41 to S45.

  Next, the CPU 2 determines whether or not the reaction at the second contact point has disappeared (step S49). This is a process for detecting the end of inputting one character by the user. When the user continuously inputs characters, the user can release the index finger or the like from the touch panel 4 and then touch the virtual input key 42 of the next character with the index finger or the like to input the character. In this way, when characters, symbols, etc. are continuously input, if the index finger or the like is released from the touch panel 4 and then touches the virtual input key 42 of the next character, the CPU 2 makes the virtual input key 42 touched by the user. Misjudgments can be suppressed.

  If the reaction at the second contact point has not disappeared at step S49, the CPU 2 repeats the process at step S49.

  When the reaction at the second contact point has disappeared, the CPU 2 determines whether or not the reaction at the input reference point 41 has disappeared (step S50). If the reaction at the input reference point 41 has not disappeared, the CPU 2 returns to step S41 and repeats the processes at steps S41 to S50. At this time, the user can input a plurality of characters by repeatedly touching the virtual input key 42 with an index finger or the like while keeping the thumb touching the touch panel 4. Further, by repeating the processing from step S41, the input reference point 41 is reset every time one character (one piece of information) is input. Therefore, even if the position of the input reference point 41 (thumb) changes slightly. The position of the virtual input key 42 also moves in accordance with the input reference point 41. Therefore, since the relative positional relationship between the input reference point 41 and each virtual input key 42 does not change, the positional accuracy when the user touches the virtual input key 42 can be improved.

  Note that the position correction of the virtual input key 42 accompanying the change of the input reference point 41 may be limited to only the vertical direction or the horizontal direction of the touch panel 4, for example. In that case, the processing load on the CPU 2 can be reduced. Further, the CPU 2 performs statistical processing on the position where the user actually touches each virtual input key 42 to estimate an error when the user touches, and also about the rotation direction around the input reference point 41. The position of the virtual input key 42 may be corrected. However, the actual rotational direction of the virtual input key 42 is slightly displaced from the input reference point 41, and the detection range of the virtual input key 42 has a certain area in consideration of the size of the fingertip. It is considered that the deviation of the rotation direction of the virtual input key 42 with respect to the input reference point 41 is within an allowable range as an error.

  If the response at the input reference point 41 has disappeared in step S50, the CPU 2 ends the information input process using the virtual input key 42.

  In the above description, the example in which the virtual input key 42 is arranged at a fixed position with respect to the input reference point 41 is shown. However, the relative positional relationship of the virtual input key 42 with respect to the input reference point 41 is, for example, the user's hand. You may make it selectable from several types of arrangement | sequences so that it can select according to a magnitude | size. The user himself / herself may freely set the positional relationship between the input reference point 41 and the virtual input key 42 and the interval between the virtual input keys 42 according to the size of the user's hand.

  According to the present embodiment, when the user sets the input reference point 41 using a thumb or the like, the virtual input keys are arranged based on the position of the input reference point 41. For example, the position of the intended virtual input key 42 on the touch panel 4 can be estimated based on the angle and interval of the index finger (may be another finger), and the position can be touched. Therefore, the user can input desired information such as characters and symbols to the portable information terminal 1 using the touch panel 4 without visually recognizing the display 5.

In addition, when the user continuously inputs characters and symbols, the input reference point 41 is reset every time one piece of information is input. Therefore, even if the position of the input reference point 41 (thumb) varies slightly. The position of the virtual input key 42 also moves in accordance with the input reference point 41. Therefore, since the relative positional relationship between the input reference point 41 and each virtual input key 42 does not change, the positional accuracy when the user touches the virtual input key 42 can be improved.
(Second Embodiment)
In the portable information terminal 1 according to the first embodiment, an example in which the virtual input key 42 has 12 types of characters “0” to “9”, “*”, and “#” is shown. In this case, only these characters can be input to the portable information terminal 1.

  In the portable information terminal according to the second embodiment, by simultaneously touching the virtual input key 42 with the index finger, middle finger, and ring finger, it is possible to input not only the numbers and symbols but also alphabets and other symbols. is there. In the following, an example of selecting characters and symbols using any two fingers of the index finger, middle finger, and ring finger will be described, but selecting characters, symbols, etc. using all of the index finger, middle finger, and ring finger. It is also possible to select characters, symbols, etc. using all four fingers including the little finger. Since the configuration of the portable information terminal 1 is the same as that of the first embodiment, the description thereof is omitted.

  In the portable information terminal 1 of the second embodiment, alphabets, symbols, and the like are assigned to combinations of virtual input keys 42 that the user touches simultaneously. It is assumed that alphabets, symbols, and the like corresponding to the combinations of the virtual input keys 42 are stored in advance in the memory 3 in a table format, for example, and can be read out by the CPU 2.

  The virtual input keys 42 may be combined in any way, but it is preferable to limit the virtual input keys 42 operated by each finger so as to improve the operability for the user. For example, when the user holds the portable information terminal 1 with the left hand and performs an input operation with the right hand, assuming that the virtual input keys 42 are arranged as shown in FIG. 4, the operation is performed for each column of the virtual input keys 42. It is preferable to assign a finger to perform.

  Specifically, the operation with the index finger is limited to the first column (“1”, “4”, “7”) of the virtual input key 42, and the operation with the middle finger is limited to the second column (“ 2 ”,“ 5 ”,“ 8 ”,“ 0 ”), and the operation with the ring finger may be limited to the third column (“ 3 ”,“ 6 ”,“ 9 ”) of the virtual input key 42. . When the user holds the portable information terminal 1 with the right hand and performs an input operation with the left hand, the columns operated with the index finger and the ring finger may be switched.

  Table 1 shows an example in which alphabets and symbols are assigned to each combination of the virtual input keys 42 under such restrictions.

  Table 2 shows characters (alphabets) and symbols assigned to the combinations of the virtual input keys 42 based on Table 1.

  Next, an information input operation on the portable information terminal according to the second embodiment will be described with reference to FIG.

  FIG. 6 is a flowchart illustrating a processing procedure of the portable information terminal according to the second embodiment. FIG. 6 shows a processing procedure of the CPU 2 at the time of inputting information to the portable information terminal 1 according to the second embodiment.

  In addition, the process of the portable information terminal 1 shown below shall be implement | achieved when CPU2 performs a process according to the control program stored in the memory 3. FIG.

  Processing until the user sets the input reference point 41 using the thumb (steps S41 to S44) is the same as that in the first embodiment.

  As shown in FIG. 6, when the setting of the input reference point 41 is completed, the CPU 2 monitors the presence or absence of the second contact point on the touch panel 4. At this time, in the present embodiment, it is also determined whether or not there are two second contact points on the touch panel 4 (step S55).

  The user estimates the position of the intended virtual input key 42 on the touch panel 4 based on the previously learned angles and intervals of the thumb, index finger, middle finger, and ring finger, and the virtual input keys shown in Tables 1 and 2 Based on the combination of 42, a character or symbol to be input is selected by touching the two virtual input keys 42. For example, when inputting “g”, the user may touch “4” of the virtual input key 42 with the index finger and touch “2” of the virtual input key 42 with the middle finger.

  When detecting the second contact point, the CPU 2 specifies two virtual input keys 42 touched by the user from the relative positional relationship between the input reference point 41 and the second contact point (step S56), and the virtual input key 42 Characters and symbols corresponding to the combinations are read from the memory 3. Thereafter, as in the first embodiment, the CPU 2 notifies the user of the operation result (the character selected by the user or the virtual input key touched by the user) using voice or the like using the speaker 62 (echo back: In step S47, the user's operation result is stored in a buffer provided in advance in the memory 3 (step S48), and the one character input process is terminated.

  If the second contact point cannot be detected in step S55, the CPU 2 returns to step S41 and repeats the processes of steps S41 to S43 and S55.

  Next, the CPU 2 determines whether or not the reaction at the second contact point has disappeared (step S59). This is a process for detecting the end of inputting one character by the user. When the user continues to input a character, the user can release the two fingers from the touch panel 4 and then touch the virtual input key 42 of the combination corresponding to the next character to input the character.

  If the reaction at the second contact point has not disappeared at step S59, the CPU 2 repeats the process at step S59.

  When the reaction at the second contact point has disappeared, the CPU 2 determines whether or not the reaction at the input reference point 41 has disappeared, as in the first embodiment (step S50). When the reaction of the input reference point 41 has not disappeared, the CPU 2 returns to step S41 and repeats the processes of steps S41 to S44, S55 to S56, S47 to S48, S59 and S50. At this time, the user can input a plurality of characters by repeatedly touching the virtual input key 42 with two fingers or one finger while keeping the thumb touching the touch panel 4. In addition, by repeating the processing from step S41, the first contact point is detected again and the input reference point 41 is reset, so that even if the position of the input reference point 41 (thumb) slightly varies, The position of the input key 42 also moves according to the position of the input reference point 41. Therefore, since the relative positional relationship between the input reference point 41 and each virtual input key 42 does not change, the positional accuracy when the user touches the virtual input key 42 can be improved.

  In the second embodiment, an example in which 33 types of characters and symbols are selected by a combination of two virtual input keys 42 of “0” to “9” has been described. In order to increase the number of types of symbols, the virtual input keys 42 of “*” and “#” may be used together.

  According to the second embodiment, in addition to the same effects as those of the first embodiment, more types of characters can be easily input to the portable information terminal 1.

1 portable information terminal 2 CPU
3 Memory 4 Touch Panel 5 Display 6 Communication Circuit 7 Function Key 10 Input Device 20 Processing Device 41 Input Reference Point 42 Virtual Input Key 61 Microphone 62 Speaker

Claims (9)

An input device for detecting the presence or absence of contact by the user and the position of the contact point;
By using the position of the first contact point detected by the input device as a reference position, a virtual input key for inputting information is arranged on the input device, and by touching the virtual input key on the input device A processing device that, when detecting a second contact point, determines information corresponding to the second contact point from a relative positional relationship between the first contact point and the second contact point;
A portable information terminal. The processor is
The portable information terminal according to claim 1, wherein the reference position is reset every time one piece of information is input. The processor is
The portable information terminal according to claim 1, wherein when a plurality of contact points are detected as the second contact points, information corresponding to a preset combination of the plurality of second contact points is determined.   The portable information terminal according to claim 3, wherein the second contact points are two points. An information input method for inputting information to a portable information terminal equipped with an input device for detecting presence or absence of contact by a user and a position of the contact point,
Processing equipment
Using the position of the first contact point detected by the input device as a reference position, placing a virtual input key for inputting information on the input device,
When a second contact point due to contact with the virtual input key on the input device is detected, information corresponding to the second contact point is obtained from a relative positional relationship between the first contact point and the second contact point. Information input method to determine The processing device is
6. The information input method according to claim 5, wherein the reference position is reset every time one piece of information is input. The processing device is
The information input method according to claim 5 or 6, wherein when a plurality of contact points are detected as the second contact points, information corresponding to a preset combination of the plurality of second contact points is determined.   The information input method according to claim 7, wherein the second contact point is two points. A program for executing a process of inputting information to a portable information terminal provided with an input device for detecting presence or absence of contact by a user and a position of the contact point,
In the processing equipment,
Using the position of the first contact point detected by the input device as a reference position, placing a virtual input key for inputting information on the input device,
When a second contact point due to contact with the virtual input key on the input device is detected, information corresponding to the second contact point is obtained from a relative positional relationship between the first contact point and the second contact point. A program for determining

Images