JP2012113547A - Information processing terminal and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To allow even a person who is difficult to write characters to communicate in writing.SOLUTION: An information processing terminal includes instruction means, creation means, and display control means. The instruction means instructs characters to be displayed on a display unit. The creation means, by using data on reference characters corresponding to characters instructed by the instruction means and characteristic data showing characteristics of handwriting characters read from a predetermined storage unit, creates data on characters representing the characteristics. The display control means, by using data on characters created by the creation means, performs control so that characters representing the characteristics are displayed on the display unit.

Description

  Embodiments described herein relate generally to an information processing terminal and a program.

  2. Description of the Related Art Conventionally, there is known an information processing terminal that recognizes handwritten characters drawn on a touch panel with a finger or a touch pen, and displays handwritten characters or fixed characters (fonts) corresponding to the handwritten characters on a display.

  However, conventional information processing terminals have problems such as poor usability for those who have difficulty in writing characters.

  The information processing terminal of this embodiment includes an instruction unit, a creation unit, and a display control unit. The instruction means instructs a character to be displayed on the display unit. The creation means creates character data representing the characteristics using the reference character data corresponding to the character instructed by the instruction means and the characteristic data indicating the characteristics of the handwritten character read from the predetermined storage unit. To do. The display control means performs control to display the character representing the characteristic on the display unit using the character data created by the creating means.

FIG. 1 is a perspective view illustrating a schematic external configuration of the information processing terminal according to the present embodiment. FIG. 2 is a diagram illustrating a schematic hardware configuration of the information processing terminal. FIG. 3 is a block diagram illustrating a functional configuration of the information processing terminal. FIG. 4 is a diagram illustrating a state where a handwritten character is photographed by the camera. FIG. 5 is a diagram illustrating a configuration example of a registration table for registering characteristic information. FIG. 6 is a flowchart showing a processing procedure in the case where characteristic data of handwritten characters is stored in a nonvolatile memory. FIG. 7 is a flowchart showing a processing procedure at the time of writing.

  Hereinafter, embodiments will be described with reference to the accompanying drawings.

  Note that the information processing terminal of the present embodiment is generally a writing terminal for a patient who is difficult to speak due to illness or a patient who is difficult to write characters due to illness. This is a writing terminal that enables a user to write using a character (similar character) that reflects a habit of a handwritten character handwritten by hand when the patient is healthy.

  FIG. 1 is a perspective view for explaining a schematic external configuration of the information processing terminal 1 according to the present embodiment.

  As shown in FIG. 1, the information processing terminal 1 is a portable terminal and has a thin plate-shaped main body housing 100. On the front side of the main body housing 100, a keyboard 2 including a display 2 for displaying a similar character A used in writing and various function keys for inputting various instructions such as instructing a character to be displayed on the display 2 is provided. On the back side of the main body housing 100, a medium C such as a letter on which a handwritten character (hereinafter simply referred to as “self-written character”) B handwritten by a user in the past (when in a healthy state) B is shown. A camera 4 (see FIG. 4) for photographing is provided, and a power button 5 for turning on / off the apparatus is provided on one side surface (upper surface) of the main body housing 100.

  In the example of FIG. 1, the display 2 displays a word (character group) of “good morning” composed of similar characters A.

  FIG. 2 is a diagram for explaining a schematic hardware configuration of the information processing terminal 1 shown in FIG. 1.

  As shown in FIG. 2, the information processing terminal 1 includes, for example, a CPU (Central Processing Unit) 10, a ROM (Read Only Memory) 11, a RAM (Random Access Memory) connected to the CPU 10 via a bus line BL. ) 12, a storage unit 13, a display unit 14, an input unit 15 and a handwritten character input unit 16, and a power supply unit 17 for supplying power to each of the load units.

  Here, the CPU 10 controls the entire computer, that is, various operations and various processes for each component unit.

  The ROM 11 stores various programs such as a processing program P for executing processing procedures in a flowchart described later, and files such as various data used in the various programs.

  The RAM 12 temporarily stores work data such as input data and display data, a program read from the ROM 11 when the computer is started up, and the like.

  The storage unit 13 stores characteristic information of handwritten characters described later, information on reference characters, and the like.

  The display unit 14 includes the display 2 and a display controller (not shown) that controls display of various types of information on the display 2. As the display 2, for example, an LCD (Liquid Crystal Display) is adopted.

  The input unit 15 includes the keyboard 3 and an input controller (not shown) that controls input of operation signals from the keyboard 3.

  The handwritten character input unit 16 includes the camera 4 and a camera controller (not shown) that controls photographing with the camera 4. As the camera 4, for example, a digital camera such as a CCD (Charge-Coupled Device) is employed.

  The power supply unit 17 is a power supply unit for supplying necessary power to each load unit described above. For example, a storage battery (battery) 17a that can be attached to and detached from a battery storage port (not shown), and the storage battery 17a. And a power controller (not shown) for controlling the power supply.

  In the above-described embodiment, the case of the information processing terminal 1 in a form in which power is supplied from the storage battery 17a has been described. However, the present invention is not limited to this, and power is supplied from an external commercial power supply via an AC adapter or the like. It is also possible to use the information processing terminal 1 that can be used.

  FIG. 3 is a block diagram for explaining a functional configuration (software configuration) of the information processing terminal 1 realized by the CPU 10 developing and executing the processing program P stored in the ROM 11 on the RAM 12. is there.

  As shown in FIG. 3, the information processing terminal 1 includes a handwritten character input unit 100 a, a handwriting analysis unit 100 b, a characteristic data holding unit 100 c, a display character instruction unit 100 d, a similar character creation unit 100 e, and a display control unit as functional configurations. 100f or the like.

  Here, the handwritten character input unit 100a performs a process of inputting data related to the handwritten character B shown on the medium C or the like.

  More specifically, as shown in FIG. 4, the handwritten character input unit 100a is directed to the medium C on which the photographing window of the camera 4 is shown by the handwritten character B by an operator such as a user or a nurse who performs a conversation. When the mode switch key (see FIG. 1) for switching between the writing mode and the shooting mode included in the keyboard 3 is selected, the shooting key (also included in the keyboard 3 by the operator) is changed. 1 is selected, the medium 4 is photographed by the camera 4 and the image data including the handwritten character B (eg, “o”) is input.

  In addition, the handwritten character input unit 100a recognizes a character (for example, “o”) from image data acquired by photographing by the camera 4 using a known character recognition algorithm such as OCR (Optical Character Reader).

  The handwriting analysis unit 100b inputs image data and character data indicating the recognized character type from the handwritten character input unit 100a, and uses a predetermined handwriting analysis algorithm to determine the characteristics of the handwritten character (ie, “character処理 ”) is analyzed.

  More specifically, the handwriting analysis unit 100b reads the reference character pattern (coordinate information or image data) corresponding to the recognized character type (eg, “o”) from the storage unit 13, and the read reference Compare the pattern of the character with the pattern (coordinate information or image data) of the handwritten character B (e.g., “o”) included in the input image data, and extract the difference amount between the two predetermined determination points. Characteristic information (see FIG. 5) defined by the extracted difference amount is created.

  In order to increase the accuracy of the analysis of the handwriting analysis unit 100b, it is preferable to compare both patterns after matching the size of the reference character pattern (image data) and the size of the handwritten character pattern (image data).

  The “reference character” here is a type (font) that is displayed on a general computer display or used for printing with a printer, and the handwriting analysis unit 100b uses the reference character pattern as It has multiple types of patterns (fonts).

  The reference character can be customized according to the character language of the country in which the information processing terminal 1 is used. However, in the information processing terminal 1 according to the present embodiment, “kana character” in the Japanese character language is used. ”Is assumed, and as a pattern of plural types (fonts) as“ reference characters ”, there is only a“ hiragana ”pattern of 50 sounds, but it is not limited to this. For example, a 50-sound “Katakana” pattern, a “number” pattern from 0 to 9, a “symbol” pattern such as X or ○, a predetermined number of “Kanji” patterns, or “English characters” ”And other patterns such as a“ Greek character ”pattern.

  The “judgment point” here is a point where it is assumed that the wrinkle of the character appears prominently, and each part of the first, first and last strokes of an image in one character in Japanese character language ( "Horizontal image", "Vertical image", "Fold", "Turn", "Tome", "Harai", "Point", "Splash", "Sleigh", "Musubi", "Omari" etc.) It is a predetermined point such as the overall shape such as the roundness of one character or the average density of one character.

  The characteristic data holding unit 100c performs processing for causing the storage unit 13 to hold a table T (see FIG. 5) for registering the characteristic information input from the handwriting analysis unit 100b.

  FIG. 5 is a diagram for explaining a configuration example of a registration table T for registering characteristic information.

  As shown in FIG. 5, the registration table T registers characteristic information, and as characteristic information, the type of determination point and the characteristic value of each determination point are registered.

  In the example of FIG. 5, “6”, which is smaller than the reference value “10” of the reference character “Tome”, is registered as a characteristic value in association with the determination point “Tome”. Indicates that the handwritten character “Tome” is a relatively streamed character compared to the reference character “Tome”.

  Further, in association with the determination point “roundness (roundness)”, “12”, which is larger than the reference character “roundness reference value“ 10 ”, is registered as a characteristic value. This indicates that the “roundness” of the handwritten character is larger than the “roundness” of the reference character.

  Also, in association with the determination point “density”, “13”, which is larger than the reference value “10” of the reference character “density”, is registered as a characteristic value. This indicates that the “density” of the handwritten character is higher than the “density”.

  Returning to FIG. 3, the display character instruction unit 100 d is selected by the user when the information processing terminal 1 is in the writing mode when the terminal is turned on or when the mode switching key is selected. The reference character data assigned to the assigned character key is read from the storage unit 13 and output to the similar character creation unit 100e.

  When the reference character data is input from the display character instruction unit 100d, the similar character creation unit 100e acquires characteristic data from the registration table T (see FIG. 5) held in the storage unit 13, and the characteristic of the handwritten character ( A similar character A representing i) is created, and data of the similar character A is output to the display control unit 100f.

  More specifically, the similar character creation unit 100e includes the pattern of the reference character (for example, “O”) input from the display character instruction unit 100d in the characteristic data acquired from the registration table T (see FIG. 5). Characteristic values (for example, “12”, “13”, etc.) of characteristic points (for example, “roundness”, “density”, etc.) applicable to the reference character (“O”) among a plurality of determination points The similar character A having the characteristic values (that is, the character reflecting the characteristic (癖) of the user's own handwritten character) is created.

  The display control unit 100f performs processing for displaying the similar character A on the display 2 using the data of the similar character A input from the similar character creation unit 100e.

  Next, various processing operations in the information processing terminal 1 configured as described above will be described with reference to FIGS. 6 and 7.

  FIG. 6 is a flowchart for explaining the processing procedure of the information processing terminal 1 when the characteristic data of handwritten characters is stored in the storage unit 13.

  In step S1 of FIG. 6, the power button 5 is operated by an operator such as a user or a nurse to turn on the information processing terminal 1, and the switching key included in the keyboard 3 is also selected by the operator. The handwritten character input unit 100a is shown on the medium C by using the camera 4 when the operator selects and operates the shooting key included in the keyboard 3 while the information processing terminal 1 is in the shooting mode. The handwritten character B is photographed, and the character is recognized from the image data acquired by photographing.

  Subsequently, in step S2, the handwriting analysis unit 100b analyzes the characteristics of the handwritten character B from the character data indicating the character type recognized in the process of step S1 and the acquired image data by the method described above.

  Subsequently, in step S3, the characteristic data holding unit 100c holds the characteristic data obtained in the process of step S2 in the storage unit 13.

  If the information processing terminal 1 has successfully created / stored the characteristic data of the handwritten character in the processing of step S1 to step S3, the character information notifying the display 2 that the character recognition has been normally performed. On the other hand, when the characteristic data of the handwritten character B cannot be normally created / stored, the character information for notifying the character that the character recognition cannot be normally performed and prompting the photographing again is displayed on the display 2. .

  FIG. 7 is a flowchart for explaining the processing procedure of the information processing terminal 1 when the user is writing.

  In step S11 of FIG. 7, when the power button 5 is operated by an operator such as a user to turn on the information processing terminal 1, and the user selects and operates a character key included in the keyboard 3, information processing is performed. In the terminal 1, the display character instruction unit 100d reads the data of the reference character (“u”) corresponding to the selected character key (eg, “u”) from the storage unit 13 and outputs it to the similar character creation unit 100e. To do.

  Subsequently, in step S12, the similar character creating unit 100e performs a process of creating the similar character A representing the characteristic (癖) of the handwritten character B by the above-described method.

  Subsequently, in step S13, the display control unit 100f displays the similar character A created in step S12 on the display 2 of the display unit 14. Thereafter, the process of steps S11 to S13 is repeatedly executed until the user operates the power button 5 to turn off the power of the information processing terminal 1 and the writing is ended (step S14: Yes).

  That is, according to the embodiment described above, when a user designates a character (standard character, etc.) to be displayed using a keyboard, a line-of-sight reader, or the like, the character reflecting the user's handwritten character is displayed on the display. Can be displayed.

  More specifically, according to this embodiment, a patient who is difficult to speak due to illness or a patient who is difficult to write letters due to illness is relatively beautiful that he wrote himself when he was healthy. Since handwriting can be performed using characters that reflect the habits of simple handwritten characters (handwritten characters), it is possible to perform handwriting with a warm handwriting, unlike mechanical writing using standard characters.

  As mentioned above, although demonstrated based on exemplary embodiment, this embodiment is not limited by above-described embodiment.

  For example, in the above-described embodiment, information of a form including the storage unit 13 for holding the characteristic data of the handwritten character and the handwritten character input unit (camera 4 or camera controller) 16 for inputting the data of the handwritten character. The case of the processing terminal 1 has been described, but besides this, the storage unit 13 and the handwritten character input unit 16 are not provided, but instead an external device (an external storage device, an information processing terminal having a storage unit, or the like). An information processing terminal having a communication I / F unit for data communication with a user and acquiring characteristic data of handwritten characters from an external device via the communication I / F unit when a user makes a conversation It is also possible. In this case, the general-purpose portable communication terminal described above can be used.

  In the above-described embodiment, the case of the operation input unit 15 having the keyboard 3 as the input means for instructing characters to be displayed on the display 2 has been described. However, the present invention is not limited to this, and other forms of input means may be used. For example, it is also possible to use a line-of-sight reader that reads the line of sight of the user. In this case, a keyboard including keys to which each character is assigned is displayed on the display 2, and the display is based on a detection signal of a user's line of sight that looks at each key of the keyboard displayed on the display 2. 2 is configured to indicate a character to be displayed.

  In the above-described embodiment, a case has been described in which one kana character is assigned to each key of the keyboard 3. However, in addition to this, for example, a plurality of keys are assigned to one key as in a keyboard of a mobile phone. A kana character may be assigned, and a desired kana character may be selected from a plurality of kana characters assigned according to the number of times the same key is pressed (selected).

  In addition to the above, for example, a word consisting of a plurality of characters (for example, “Good morning”, “Thank you”, “Otsukasema”, etc.) is assigned to one key, and the key is selected in the writing mode. In this case, a plurality of similar characters representing characteristics are created using the data of each reference character constituting the assigned word and the characteristic data, and the word composed of the similar characters is displayed on the display 2. You may make it display.

  Further, in the above-described embodiment, the form in which the character to be displayed on the display 2 is instructed using the keyboard 3 has been described. However, for example, a touch panel stacked on the display 2 is used instead of the input unit 15. It is also possible to use a form in which a character to be displayed on the display 2 is designated by selecting a function key icon of the function keyboard displayed on the display 2 using the touch panel.

  In the above-described embodiment, the description has been given of the mode in which the handwritten character input unit 16 including the camera 4 and the camera controller is provided as means for inputting the data of the handwritten character. It is also possible to have a form including a handwritten character input unit.

  In the above-described embodiment, the case of the information processing terminal 1 as a dedicated writing terminal used in a specific place such as a hospital has been described. However, the present invention is not limited to this. For example, a mobile phone or a PDA (Personal Data Assistant) is used. It is also possible to apply to general-purpose portable terminals such as). Further, in the above-described embodiment, the case of the portable information processing terminal 1 lent to a patient in a hospital has been described. However, other than this, for example, stationary information installed near a user's bed It can also be applied to a processing terminal.

  Further, in the above-described embodiment, the case where only one user's characteristic data is stored in the storage unit 13 has been described assuming that there is only one user who uses the information processing terminal 1. In addition, for example, when it is assumed that one information processing terminal 1 is shared and used by a plurality of persons, identification information that can identify a user (individual) (biological information such as fingerprints, passwords, etc.) The characteristic data of the handwritten character is stored in the storage unit 13 in association with the ID information of the user, and the user's handwritten character specified based on the identification information input by a predetermined information input means at the time of writing. It is also possible to create a similar character A using the characteristic data and display it on the display 2.

  Further, the processing program P executed by the information processing terminal 1 described above can be read by a computer in a file in an installable format or an executable format, in addition to being provided so as to be incorporated in a storage unit such as the ROM 11 in advance. It is also possible to provide it by recording it in a storage medium, or to provide or distribute it via a network such as the Internet.

  In addition, the hardware configuration of the information processing terminal 1 in the above-described embodiment, the software configuration, the type of characteristic data of handwritten characters, the type of determination point, the processing procedure, etc. are described as examples only, This embodiment is not limited by these.

1 Information processing terminal 2 Display (display unit)
3 Keyboard (instruction means)
4 Camera (input means)
100a Handwritten character input part (input means)
100b Handwriting analysis unit (analysis means)
100c Characteristic data holding unit 100d Display character instruction unit 100e Similar character creation unit (creation means)
100f Display control unit (control means)

JP-A-4-153725

Claims (6)

Instruction means for instructing characters to be displayed on the display unit;
Creating means for creating character data representing the characteristics by using reference character data corresponding to the character designated by the instruction means and characteristic data indicating characteristics of the handwritten character read from a predetermined storage unit; ,
Control means for performing control to display the character representing the characteristic on the display unit, using the character data created by the creating means;
An information processing terminal having Input means for inputting an image of the handwritten character via a medium on which the handwritten character is shown;
Analyzing means for analyzing the characteristics of the handwritten character from the image input by the input means;
Holding means for holding the characteristic data indicating the characteristic analyzed by the analyzing means in the storage unit;
The information processing terminal according to claim 1, further comprising:   3. The information processing terminal according to claim 1, wherein the characteristic data is data indicating a habit of a character extracted from the handwritten character, and the character representing the characteristic is a character reflecting the habit.   The information processing terminal according to claim 1, wherein the instruction unit is a keyboard or a line-of-sight reader. A specific means of identifying the user,
Further comprising
The said creation means creates the data of the character showing the said characteristic using the characteristic data which shows the characteristic of the user's handwritten character specified by the said specification means. Information processing terminal. Computer
Instruction means for instructing characters to be displayed on the display unit;
Creating means for creating character data representing the characteristics by using reference character data corresponding to the character designated by the instruction means and characteristic data indicating characteristics of the handwritten character read from a predetermined storage unit; ,
Control means for performing control to display the character representing the characteristic on the display unit, using the character data created by the creating means;
Program to make it work.

Images