JP2014123174A - Character input program, character input device, and character input method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a technology which supports a user's character input.SOLUTION: A biological information acquiring unit 110 acquires user's biological information acquired from a sensor, such as a fingerprint sensor and a finger vein sensor. A character specification unit 130 specifies an initial undefined letter according to the acquisition of the biological information by the biological information acquiring unit 110. An operation recognition unit 140 recognizes a sliding operation by a user from change of the biological information acquired by the biological information acquiring unit 110. An operation corresponding unit 150 changes the undefined character according to the sliding operation recognized by the operation recognition unit 140.

Description

  The present invention relates to a character input program, a character input device, and a character input method that support user character input.

  Conventionally, a user inputs characters to an information processing apparatus using an input device such as a keyboard. In recent years, with the spread of smart terminals such as smartphones and tablet terminals, the number of cases where characters are input using a software keyboard displayed on a touch panel is increasing.

  A technique for starting a program associated with a fingerprint identified by a fingerprint sensor is known. A technique for generating a character code corresponding to a fingerprint identified by a fingerprint sensor is also known. There is also known a technique for outputting a key code such as a number corresponding to a combination of a pressed input key and a fingerprint read from the finger pressing the input key.

JP 2002-41169 A JP 2003-76482 A JP 2006-343812 A

  For example, when inputting characters on a small smart terminal such as a smartphone, if the software keyboard is displayed on the screen of the touch panel, the other display area becomes smaller, so the information displayed on the screen is reduced. There is a problem of end. For this reason, it is not easy to input characters while viewing the information displayed on the screen.

  Also, for example, when inputting characters using a software keyboard on a small smart terminal, etc., each key displayed on the touch panel screen is small, so there is a high possibility of erroneous touching, making it difficult for users to use. There is a problem.

  In one aspect, an object of the present invention is to provide a technique for supporting a user's character input.

  In one aspect, the disclosed program causes a computer to function as follows. That is, the program acquires the biometric information of the user obtained from the sensor in a computer on which the program is installed and executed, and the unconfirmed character that is an input that has not been determined in response to the biometric information acquisition. Is identified, the slide operation on the sensor by the user is recognized from the change of the acquired biometric information, and the process of changing the undetermined character according to the slide operation is executed.

  In one mode, it is possible to input characters with an easy operation.

It is a figure which shows the example of the external appearance of the terminal by this Embodiment. It is a figure which shows the function structural example of the terminal by this Embodiment. It is a figure which shows the hardware structural example of the computer which implement | achieves the terminal provided with the character input part by this Embodiment. It is a figure which shows the example of the finger recognition data by this Embodiment. It is a figure which shows the example of the character corresponding | compatible data by this Embodiment. It is a figure explaining the example (1) of a change of an undetermined character by this Embodiment. It is a figure explaining the example (2) of a change of the undetermined character by this Embodiment. It is a character input processing flowchart by the character input part of this Embodiment.

  Hereinafter, the present embodiment will be described with reference to the drawings.

  FIG. 1 is a diagram showing an example of the appearance of a terminal according to the present embodiment.

  A terminal 10 shown in FIG. 1 is a computer in which a user inputs characters in the example of the present embodiment. The terminal 10 shown in FIG. 1 is assumed to be a small smart terminal such as a smartphone. Note that the terminal 10 on which the user inputs characters does not necessarily have to be a smart terminal by the character input technique according to the present embodiment. For example, the terminal 10 may be a PC (Personal Computer).

  The terminal 10 includes a touch panel 11 and a sensor 12. The touch panel 11 is a device having both a display function and an input function. The sensor 12 is a device that reads biometric information of a user such as a fingerprint, a finger vein, and a palm vein. The sensor 12 may be a built-in device of the terminal 10 as shown in FIG. 1 or an external device connected to the terminal 10 through an interface.

  FIG. 2 is a diagram illustrating a functional configuration example of the terminal according to the present embodiment.

  The terminal 10 according to the present embodiment includes a character input unit 100 that supports user input of characters into the terminal 10. The character input unit 100 includes a biometric information acquisition unit 110, a finger identification unit 120, a character identification unit 130, an operation recognition unit 140, an operation correspondence unit 150, an output unit 160, a finger recognition information storage unit 170, and a character correspondence information storage unit 180. Prepare.

  The finger recognition information storage unit 170 is a storage unit that stores finger recognition information in which correspondence between a user's finger and biological information is recorded. The character correspondence information storage unit 180 is a storage unit that stores character correspondence information in which correspondence between a user's finger and a character is recorded.

  The biometric information acquisition unit 110 acquires user biometric information obtained from the sensor 12. The acquired biological information may be read data of the sensor 12, or may be data obtained by extracting features of the biological body obtained by analyzing the read data of the sensor 12.

  The finger identification unit 120 refers to the finger recognition information in the finger recognition information storage unit 170 and identifies a finger corresponding to the biological information acquired by the biological information acquisition unit 110. More specifically, the finger specifying unit 120 performs matching between the biological information acquired by the biological information acquisition unit 110 and the biological information registered in the finger recognition information in the finger recognition information storage unit 170. The finger specifying unit 120 acquires finger information corresponding to the biometric information determined to be matched by matching from the finger recognition information in the finger recognition information storage unit 170, and corresponds to the biometric information acquired by the biometric information acquisition unit 110. Specify as finger information.

  Corresponding to the acquisition of biometric information by the biometric information acquisition unit 110, the character specifying unit 130 specifies an unconfirmed character that is a character whose input has not been determined. The unconfirmed character specified here is, for example, an initial unconfirmed character that is first displayed on the screen in an unconfirmed state in character input according to the present embodiment.

  For example, the character identification unit 130 refers to the character correspondence information in the character correspondence information storage unit 180 and sets the character corresponding to the finger identified by the finger identification unit 120 as the initial unconfirmed character. More specifically, the character identification unit 130 acquires the character corresponding to the finger information identified by the finger identification unit 120 from the character correspondence information in the character correspondence information storage unit 180 and identifies it as the initial undefined character. To do. If there are a plurality of characters corresponding to the information of one finger, the character specifying unit 130 specifies one of the plurality of characters as an initial undetermined character.

  The operation recognizing unit 140 recognizes an operation performed on the sensor 12 by the user from the change in the biometric information acquired by the biometric information acquiring unit 110. For example, the operation recognition unit 140 recognizes a slide operation on the sensor 12 by the user from the change in the biological information acquired by the biological information acquisition unit 110. For example, for a plurality of pieces of biological information acquired by the biological information acquisition unit 110, it is possible to specify the direction in which the user slides his / her finger with respect to the sensor 12 by tracking temporal changes in the positions of feature points. is there. For example, the operation recognition unit 140 recognizes that the user has performed an operation of releasing the finger from the sensor 12 when the biometric information is not acquired by the biometric information acquisition unit 110.

  In response to the operation recognized by the operation recognition unit 140, the operation handling unit 150 performs processing related to character input such as changing an unconfirmed character, confirming an unconfirmed character, or erasing a character. For example, the operation handling unit 150 changes the undetermined character according to the slide operation recognized by the operation recognition unit 140. In addition, for example, the operation handling unit 150 determines an undetermined character in response to an operation of releasing the finger from the sensor 12 recognized by the operation recognition unit 140.

  The output unit 160 displays the unconfirmed characters on the screen of the terminal 10. For example, the output unit 160 displays the undetermined character specified by the character specifying unit 130 in the undetermined state in the character input field on the screen of the touch panel 11.

  FIG. 3 is a diagram illustrating a hardware configuration example of a computer that realizes a terminal including a character input unit according to the present embodiment.

  A computer 1 that realizes a terminal 10 having a character input unit 100 shown in FIG. 2 includes, for example, a CPU (Central Processing Unit) 2, a memory 3 as a main memory 3, a storage device 4, a communication device 5, an input device 6, and an output device. 7 etc. The storage device 4 is an external storage device such as an HDD (Hard Disk Drive) or an auxiliary storage device such as a nonvolatile memory. The input device 6 is, for example, an input device such as a keyboard / mouse or a sensor. The output device 7 is a display device such as a display, for example. For example, the touch panel 11 included in the terminal 10 illustrated in FIG. 1 serves as both the input device 6 and the output device 7.

  The character input unit 100 and each function unit included in the character input unit 100 illustrated in FIG. 2 can be realized by hardware such as the CPU 2 and the memory 3 included in the computer 1 that implements the terminal 10 and a software program. . A program that can be executed by the computer 1 is stored in the storage device 4, read into the memory 3 at the time of execution, and executed by the CPU 2.

  The computer 1 can also read a program directly from a portable recording medium and execute processing according to the program. The computer 1 can also sequentially execute processing according to the received program every time the program is transferred from the server computer. Further, this program can be recorded on a recording medium readable by the computer 1.

  Hereinafter, the character input technique according to the present embodiment will be described using a more specific example. Hereinafter, an example in which fingerprint data is mainly used as an example of biometric information will be described. When the biological information is fingerprint data, the sensor 12 of the terminal 10 is a fingerprint sensor.

  FIG. 4 is a diagram illustrating an example of finger recognition data according to the present embodiment.

  The finger recognition data 175 illustrated in FIG. 4 illustrates an example of finger recognition information stored in the finger recognition information storage unit 170. The finger recognition data 175 shown in FIG. 4 has finger ID and fingerprint data information. The finger ID is identification information for identifying each finger of the user. The fingerprint data is fingerprint data of each finger of a user registered in advance.

  Here, in the finger recognition data 175 shown in FIG. 4, each finger ID “f01” to “f05” is associated with the fingerprint data of the index finger, middle finger, ring finger, pinky finger, and thumb of the right hand of the user, respectively. To do. A user who uses the character input function according to the present embodiment performs an operation of previously registering the finger fingerprint used for character input in the finger recognition data 175.

  FIG. 5 is a diagram showing an example of character correspondence data according to the present embodiment.

  The character correspondence data 185 shown in FIG. 5 shows an example of character correspondence information stored in the character correspondence information storage unit 180. In the character correspondence data 185 shown in FIG. 5, a character group is assigned to each finger ID, and a character can be specified from a combination of the finger ID and the character number.

  In the character correspondence data 185 shown in FIG. 5, hiragana characters “A line” and “Ka line” are assigned to the finger ID “f01”. Similarly, the finger ID “f02” includes hiragana characters “sa line” and “ta line”, the finger ID “f03” includes hiragana characters “na line” and “ha line”, and the finger ID “f04”. Are assigned hiragana characters “ma line” and “ya line”, and the finger ID “f05” is assigned hiragana characters “ra line”, “wa line”, and “n”.

  As shown in the character correspondence data 185 in FIG. 5, in the example of the present embodiment, it is assumed that the user inputs characters using a plurality of fingers. By performing character input using a plurality of fingers, it is possible to reduce the slide operation from when the user places the finger on the sensor 12 until the character is confirmed, and to prevent erroneous input due to a mistake in the slide operation. .

  For example, a user who wants to use the character input function according to the present embodiment in a state where the cursor is in the character input area displayed on the screen of the touch panel 11 applies a finger corresponding to the character to be input to the sensor 12 and performs fingerprint authentication. I do. At this time, the biometric information acquisition unit 110 of the character input unit 100 starts acquiring user fingerprint data obtained by the sensor 12.

  The fingerprint information can be read by the fingerprint sensor by reading the user's fingerprint information without moving the finger applied to the fingerprint sensor, or by sliding the finger applied to the fingerprint sensor by the user. There is a method to read fingerprint information. Fingerprint authentication according to the present embodiment may be performed by any of these methods.

  The finger specifying unit 120 specifies the finger ID of the finger applied to the sensor 12 by the user by matching the fingerprint data acquired by the biometric information acquisition unit 110 with the fingerprint data registered in the finger recognition data 175. Here, the finger identification unit 120 matches the fingerprint data acquired by the biometric information acquisition unit 110 and the finger ID corresponding to the fingerprint data registered in the finger recognition data 175 indicates the finger ID applied to the sensor 12 by the user. The finger ID is determined.

  The character specifying unit 130 refers to the character correspondence data 185 with the finger ID specified by the finger specifying unit 120, and specifies an initial unconfirmed character. In the example of the present embodiment, the character corresponding to the character number “5” in the character group corresponding to the finger ID in the character corresponding data 185 is set as the initial undetermined character. For example, when the finger ID specified by the finger specifying unit 120 is “f01”, the character “A” corresponding to the character number “5” is determined as the initial undefined character from the character correspondence data 185 shown in FIG. Identified. The output unit 160 displays the identified initial unconfirmed characters in an unconfirmed state in the character input area of the screen of the touch panel 11.

  When the user wants to change the unconfirmed character displayed on the screen, the user performs an operation of sliding the finger applied to the sensor 12. The direction of the slide operation for changing the unconfirmed character can be arbitrarily designed, for example, up and down, left and right, and diagonal. In the example of the present embodiment, it is assumed that the user changes an undetermined character by a vertical sliding operation.

  The operation recognizing unit 140 recognizes a slide operation in which the user slides his / her finger on the sensor 12 from the change in the fingerprint data acquired by the biometric information acquiring unit 110. At this time, the direction in which the user slides the finger is also recognized. The operation handling unit 150 refers to the character correspondence data 185 and changes the undetermined character according to the recognized slide direction.

  In the example of the present embodiment, in the character correspondence data 185 shown in FIG. 5, when the slide direction is upward, the undetermined character is changed to the one with the smaller character number, and the slide direction is downward. In such a case, it is assumed that the unconfirmed character is changed to the one with the larger character number. For example, when the finger ID of the finger to be operated is “f01”, if the slide direction is up, the undetermined characters are changed in the order of “A → I → U → E → O”, and if the slide direction is down. Undetermined characters are changed in the order of “A → ka → ki → ku → ke → ko”. In addition, when the user wants to input too many characters, the user can return the undetermined characters such as “A → I → U → E → U” by sliding the finger in the opposite direction. Note that if the unconfirmed character is “O” with the character number “1” and a further upward sliding operation is performed, the unconfirmed character is changed to “ko” with the character number “10”. You may design it.

  The operation recognition unit 140 determines that the user has performed an operation of releasing the finger from the sensor 12 when fingerprint data is no longer acquired by the biometric information acquisition unit 110. In the example of the present embodiment, when the operation recognizing unit 140 determines that the user has performed an operation of releasing the finger from the sensor 12, the operation handling unit 150 sets the unconfirmed character at that time as a confirmed character. The output unit 160 changes the character displayed in the unconfirmed state in the character input area on the screen of the touch panel 11 to the confirmed state.

  It is also possible to design such that the unconfirmed character is confirmed when the left / right sliding operation by the user is recognized. Further, a design other than changing the unconfirmed character or confirming a function other than the confirmation of the unconfirmed character, such as deleting one character when the left slide operation by the user is recognized, may be performed.

  FIG. 6 is a diagram for explaining an example (1) of changing an undetermined character according to this embodiment.

  For example, when the user performs fingerprint authentication by placing the index finger of the right hand on the sensor 12, the initial unconfirmed character “A” is identified from the finger recognition data 175 shown in FIG. 4 and the character correspondence data 185 shown in FIG. The At this time, “A” is displayed in an unconfirmed state in the character input area 200 of the screen of the touch panel 11 ((1) in FIG. 6). In FIG. 6, the character with an underscore indicates that it is an undetermined character.

  When the user slides the index finger of the right hand on the sensor 12 upward, the unconfirmed character in the character input area 200 is changed to “Yes” ((2) in FIG. 6). Further, when the user slides the index finger of the right hand applied to the sensor 12 upward, the unconfirmed character in the character input area 200 is changed to “U” ((3) in FIG. 6). In this state, when the user removes his / her finger from the sensor 12, the character “U” in the unconfirmed state is changed to the confirmed state ((4) in FIG. 6).

  FIG. 7 is a diagram for explaining an example (2) of changing an undetermined character according to the present embodiment.

  The example shown in FIG. 7 is an example in which a character selection menu 201 is further displayed on the screen of the touch panel 11. In this example, the user can perform a slide operation as if scrolling the character selection menu 201 displayed on the screen. For example, when the user slides the index finger of the right hand on the sensor 12 upward, the character selection menu 201 is scrolled upward, and the unconfirmed character is changed to “A → I → U → ...”. . For example, when the user slides the index finger of the right hand applied to the sensor 12 downward, the character selection menu 201 is scrolled downward, and the unconfirmed character is changed to “A → KA → KI → ...”. Is done.

  FIG. 8 is a flowchart of a character input process performed by the character input unit according to this embodiment.

  The character input unit 100 determines whether the cursor is in the character input area 200 displayed on the screen of the touch panel 11 (step S10). If there is a cursor in the character input area 200 (YES in step S10), the biometric information acquisition unit 110 starts acquiring user fingerprint data obtained by the sensor 12 (step S11).

  The finger identifying unit 120 determines whether fingerprint data has been acquired (step S12). If fingerprint data is acquired (YES in step S12), the finger specifying unit 120 refers to the finger recognition data 175 and specifies a finger corresponding to the fingerprint data acquired by the biometric information acquisition unit 110 (step S13). . Here, the finger ID corresponding to the fingerprint data acquired by the biometric information acquisition unit 110 is acquired from the finger recognition data 175. Although omitted in the flowchart of FIG. 8, if there is no fingerprint data registered in the finger recognition data 175 that matches the fingerprint data acquired by the biometric information acquisition unit 110, it is assumed that the fingerprint authentication has failed. Judgment is made and the finger is not specified.

  The character identification unit 130 initializes the value of the counter k indicating the character number to 5 (step S14). The character identifying unit 130 refers to the character correspondence data 185, and identifies the character with the character number k (= 5) corresponding to the finger identified by the finger identifying unit 120 as the initial unconfirmed character (step S15). . The output unit 160 displays the identified initial unconfirmed character in the character input area 200 in an unconfirmed state (step S16).

  The operation recognition unit 140 determines whether the slide operation by the user has been recognized from the change in the fingerprint data acquired by the biometric information acquisition unit 110 (step S17). If the slide operation is not recognized (NO in step S17), the operation recognition unit 140 proceeds to the process in step S23.

  If the slide operation is recognized (YES in step S17), the operation recognition unit 140 determines the slide direction (step S18). When the sliding direction is upward (upper step S18), the operation corresponding unit 150 decrements the value of the counter k indicating the character number (step S19). When the sliding direction is downward (below step S18), the operation handling unit 150 increments the value of the counter k indicating the character number (step S20). The operation handling unit 150 changes the unconfirmed character to the character having the character number k (step S21). The output unit 160 updates the undetermined character displayed in the character input area 200 with the changed undetermined character (step S22).

  The operation recognition unit 140 determines whether an operation of releasing a finger from the sensor 12 by the user is recognized (step S23). If the operation of releasing the finger is not recognized (NO in step S23), the operation recognizing unit 140 proceeds to the process of step S17.

  If the operation of releasing the finger is recognized (YES in step S23), the operation handling unit 150 determines the unconfirmed character (step S24). The output unit 160 changes the unconfirmed character displayed in the character input area 200 to a confirmed state (step S25).

  As described above, the character input technique according to the present embodiment enables the user to input characters with an easy operation. For example, since it is not necessary to display a software keyboard on the screen of the touch panel 11 in a small smart terminal, a large amount of information can be provided to a user who inputs characters, and the possibility of erroneous input of characters can be reduced. .

  Although the present embodiment has been described above, the present invention can naturally be modified in various ways within the scope of the gist thereof.

  For example, in this embodiment, an example of inputting hiragana has been described, but the character input technique according to this embodiment can also be applied to input of other character types such as katakana, numbers, alphabets, and symbols. is there. For example, it is possible to allow the user to select a character type by a left and right sliding operation and to select a character by a vertical sliding operation.

  Further, for example, in the present embodiment, an example in which a character group is assigned to each of a plurality of fingers and characters are input has been described. However, a design in which characters are input by an operation with one finger is also possible. For example, when inputting hiragana, the user selects a line such as “A” or “K” from the left / right slide operation, and selects a row such as “A” or “I” from the vertical slide. It is also possible to make it select.

DESCRIPTION OF SYMBOLS 10 Terminal 11 Touch panel 12 Sensor 100 Character input part 110 Biometric information acquisition part 120 Finger specific part 130 Character specific part 140 Operation recognition part 150 Operation corresponding part 160 Output part 170 Finger recognition information storage part 180 Character corresponding information storage part

Claims (4)

Computer
Obtain the user's biological information obtained from the sensor,
Corresponding to the acquisition of the biometric information, an unconfirmed character that is an unconfirmed input character is identified,
Recognizing the slide operation on the sensor by the user from the change of the acquired biological information,
A character input program for executing processing for changing the unconfirmed character in response to the slide operation. In addition to the computer,
Referring to the correspondence between the finger and the biometric information stored in the storage unit, and executing the process of specifying the finger corresponding to the acquired biometric information,
2. The character according to claim 1, wherein in the process of specifying the unconfirmed character, the character corresponding to the specified finger is specified with reference to a correspondence between the finger and the character stored in the storage unit. Input program. A biometric information acquisition unit that acquires biometric information of the user obtained from the sensor;
Corresponding to the acquisition of the biometric information, a character identifying unit that identifies an unconfirmed character that is a character whose input has not been confirmed;
An operation recognition unit for recognizing a slide operation on the sensor by the user from the change of the acquired biological information;
A character input device comprising: an operation corresponding unit that changes the unconfirmed character in response to the slide operation. Computer
Obtain the user's biological information obtained from the sensor,
Corresponding to the acquisition of the biometric information, an unconfirmed character that is an unconfirmed input character is identified,
Recognizing the slide operation on the sensor by the user from the change of the acquired biological information,
The character input method characterized by performing the process which changes the said undetermined character according to the said slide operation.

Images