JPWO2017042981A1 - INPUT PROCESSING METHOD, INPUT PROCESSING DEVICE, INPUT PROCESSING PROGRAM, AND INPUT PROCESSING SYSTEM - Google Patents

Abstract

The first text information recognized based on the first handwritten input input by handwriting is transmitted to the second terminal, and the first text information displayed on the second terminal corresponds to the first text information. In response to reception of handwriting information related to the second handwritten input for the second text information and display position information related to the second text information from the second terminal, the handwriting information and the display position information And a process of correcting the first text information.

Description

  The present invention relates to an input processing method, an input processing device, an input processing program, and an input processing system.

  A tool is known that accepts handwritten input by a user and processes a recognized character obtained by performing character recognition on the accepted handwritten input as an input character (see, for example, Patent Document 1).

  In addition, sharing of data input on a screen is performed in a plurality of terminals such as tablets.

JP-A-2005-235116

  When the data input on the screen is shared by multiple terminals, it is compatible with handwriting input, and it is also compatible with correction by handwriting input, it is said that handwritten input was accepted for the character displayed on the terminal There are cases where corrections are made by handwriting input from different terminals. For example, it is assumed that the customer performs handwriting input at the first terminal and the store clerk corrects the description content by handwriting input at the second terminal.

  In this case, if the handwritten input handwritten information (stroke information) about the displayed characters can be reused in another terminal for correction, the handwritten information must be shared among a plurality of terminals. . In general, handwriting information is a series of two-dimensional coordinates, so that the amount of data is large (for example, several kilobytes), and a large amount of data that is not necessarily used for correction is shared between multiple terminals. Become.

  In addition, terminals that share data do not necessarily have all the processing capabilities (CPU, battery, presence / absence of recognition software, etc.), and even if handwriting information is shared by a plurality of terminals. The correction process may not be performed smoothly. For example, the memory usage of a terminal required for handwritten character recognition is about 2.5 MB for RAM (Random Access Memory) and about 1.5 MB for ROM (Read Only Memory), and processing cannot be performed smoothly on terminals with limited resources. In some cases, the effect on normal processing cannot be ignored.

  Therefore, in one aspect, when sharing the result of handwriting input by a plurality of terminals, it is an object to be able to correct a text recognized by handwriting input while suppressing communication amount and / or processing resources. .

  In one form, the process which transmits the 1st text information recognized based on the 1st handwritten input input by handwriting to a 2nd terminal, The said 1st displayed on the said 2nd terminal In response to reception of handwriting information related to second handwritten input with respect to second text information corresponding to text information, and display position information related to the second text information from the second terminal, the handwriting information, and And a process of correcting the first text information based on the display position information.

  In one aspect, when the result of handwriting input is shared by a plurality of terminals, it is possible to perform correction on the text recognized by handwriting input while suppressing the communication amount and / or processing resources.

It is a figure which shows the structural example of the system concerning one Embodiment. It is a figure which shows the hardware structural example of a terminal. 3 is a diagram illustrating an example of a functional configuration of a terminal 1. FIG. It is a figure which shows the structural example of character / stroke information and segment information. It is a figure which shows the structural example of area information. FIG. 5 is a diagram (part 1) illustrating an example of data sharing between terminals; It is FIG. (2) which shows the example of sharing of data between terminals. It is a figure which shows the example of transmission data. It is a flowchart (the 1) which shows the process example of embodiment. It is a flowchart (the 2) which shows the process example of embodiment. It is a figure which shows the example of correction | amendment of stroke information. It is a figure which shows the problem at the time of correct | amending simply from the size of a screen or area position information.

  Hereinafter, preferred embodiments of the present invention will be described.

<Configuration>
FIG. 1 is a diagram illustrating a configuration example of a system according to an embodiment. In FIG. 1, a plurality of terminals (terminal devices) 1A, 1B,... Are connected to a communication device 6 via a network 5 such as a wireless local area network (LAN), and the terminals 1A, 1B,. Data sharing is now available. When the communication device 6 receives the data specifying the destination from any one of the terminals 1A, 1B,..., The communication device 6 transmits the data to the corresponding destination terminal. When data is directly transmitted / received between the terminals 1A, 1B,..., The network 5 and the communication device 6 can be omitted.

  Each terminal 1 (1A, 1B,...) Recognizes a text display application 10 (10A, 10B,...) And a correction target character identification program 20 (20A, 20B,...) As main programs. A program 30 (30A, 30B,...) And a shared program 70 (70A, 70B,...) Are arranged.

  The text display application 10 is a program that displays an input character group (text) such as a slip creation application or an email creation application. The text displayed by the text display application 10 is also referred to as “display text”.

  The correction target character specifying program 20 specifies the range and position of the display text to be replaced / inserted / deleted from the input stroke and recognizes it when a correction input by handwriting is performed on the display text. Specify the combined range or split position of the display text that is subject to unit correction. The handwriting input and the handwriting correction input are not limited to the case where the stroke is input by a finger, and the stroke may be input using, for example, a stylus.

  The recognition program 30 recognizes a character from a stroke input by handwriting input and handwriting correction input, and acquires a character corresponding to the input stroke as a recognition result.

  The sharing program 70 performs data transmission / reception processing for data sharing between terminals.

  Although it is assumed that the text display application 10, the correction target character identification program 20, and the sharing program 70 are provided in each terminal 1, there are some terminals where the recognition program 30 is not provided from the viewpoint of resources.

  FIG. 2 is a diagram illustrating a hardware configuration example of the terminal 1 (1A, 1B,...). In FIG. 2, the terminal 1 includes a display operation device 101, a drive device 102, an auxiliary storage device 103, a memory device 104, an arithmetic processing device 105, and an interface device 106 that are mutually connected by a bus B.

  The display operation device 101 is, for example, a touch panel or the like, and is used for inputting various signals and displaying (outputting) various signals. The interface device 106 includes a modem, a LAN card, and the like, and is used for connecting to a network.

  The text display application 10, the correction target character identification program 20, the recognition program 30, and the sharing program 70 are at least a part of various programs that control the terminal 1. These programs are provided by, for example, distribution using the recording medium 107 or downloading from a network. The recording medium 107 on which the text display application 10, the correction target character identification program 20, the recognition program 30 and the shared program 70 are recorded is information such as a CD-ROM, a flexible disk, a magneto-optical disk, etc. Various types of recording media such as a recording medium for recording information, a semiconductor memory for electrically recording information, such as a ROM and a flash memory, can be used.

  When the recording medium 107 on which the text display application 10, the correction target character identification program 20, the recognition program 30 and the shared program 70 are recorded is set in the drive device 102, each program is transferred from the recording medium 107 via the drive device 102. Installed in the auxiliary storage device 103. Each program downloaded from the network is installed in the auxiliary storage device 103 via the interface device 106.

  The auxiliary storage device 103 stores the installed text display application 10, the correction target character specifying program 20, the recognition program 30, and the shared program 70, and also stores an OS (Operating System) that is basic software, necessary files, data, and the like. Store. The memory device 104 reads and stores each program in the auxiliary storage device 103 when each program is started. The arithmetic processing unit 105 implements various processes as described later according to each program stored in the memory device 104.

  FIG. 3 is a diagram illustrating an example of a functional configuration of the terminal 1 (1A, 1B,...). In FIG. 3, the terminal 1 includes a text display application execution unit 11, a correction target character identification unit 21, a character recognition unit 31, and a sharing control unit 71, and references / updates various information in the storage unit 41 during processing. . The text display application execution unit 11 corresponds to the text display application 10 (FIG. 1). The correction target character specifying unit 21 corresponds to the correction target character specifying program 20 (FIG. 1). The character recognition unit 31 corresponds to the recognition program 30 (FIG. 1). The sharing control unit 71 corresponds to the sharing program 70 (FIG. 1).

  The correction target character specifying unit 21 includes a stroke information acquiring unit 22, a region specifying unit 23, a replacement / insertion / deletion position range specifying unit 24, a combined range / division position specifying unit 25, and a stroke information correcting unit 26.

  The stroke information acquisition unit 22 has a function of acquiring handwritten stroke information (input stroke information) by the user. This stroke information corresponds to the input stroke information 44. The area specifying unit 23 has a function of specifying a stroke area (for example, a rectangular area circumscribing the stroke) of the input stroke information.

  The replacement / insertion / deletion position range specifying unit 24 performs replacement / insertion / deletion when the handwritten input indicated by the input stroke information is character or character string replacement, character or character string insertion, or character or character string deletion. It has a function to specify the position or range to be performed. The combination range / division position specifying unit 25 has a function of specifying the range of characters or segments to be combined or the positions of segments in characters to be divided when the handwritten input indicated by the input stroke information is a recognition unit correction input. Have. A segment is a part constituting a character.

  The stroke information correction unit 26 uses the stroke information sent as handwritten input handwriting information from another terminal as the stroke on the coordinates of the terminal based on the position information regarding the character or character string that is the target of the handwriting input. It has a function of correcting (coordinate conversion) information.

  FIG. 4 is a diagram showing a structure example of the character / stroke information 42 and the segment information 43. The character / stroke information 42 includes a table in which an input area ID and a recognition ID (character recognition is identified) are associated, a table in which a recognition ID and character ID are associated, a character ID, a character, a stroke information ID, and a character area. It includes a table associated with each other, and a table associated with stroke information ID and coordinate information. The information in each table is related to each other as indicated by a broken line. Note that the character area includes the coordinate value (L˜) of the left side of the quadrangular region circumscribing the character, the coordinate value (T˜) of the center of the upper side, the coordinate value (R˜) of the center of the right side, And the coordinate value (B˜) of the center of the base.

  The segment information 43 includes a table in which character IDs are associated with segment IDs, and a table in which segment IDs are associated with segment areas. The information in each table is related to each other as indicated by a broken line. In addition, the segment area includes the coordinate value (l˜) of the left side of the quadrangular area circumscribing the segment, the coordinate value (t˜) of the center of the upper side, the coordinate value (r˜) of the center of the right side, And the center coordinate value (b˜) of the base.

  The character / stroke information 42 and the segment information 43 are managed in units of the text display application 10, and are deleted at a predetermined timing. For example, after all input data has been input, it can be deleted at the time of confirmation, transmission, application termination, timeout, and the like. In addition, it is possible to adjust the timing of erasing according to the parameters, not 0 or 1 indicating whether or not to erase. For example, it is possible to control the password input area by deleting it without saving it at the time of input.

  FIG. 5 is a diagram illustrating a structure example of the area information 45. The area information 45 is used for determining whether correction is performed on the own terminal or on another terminal when a correction instruction by handwriting input is performed. In the area information 45, an input area ID and a correctable device ID (terminal ID) are associated with each other. Whether or not correction is possible is determined based on authority from the viewpoint of operation, and may be determined from the viewpoint of processing capability (such as the presence or absence of a CPU, a battery, and recognition software).

<Overview of operation>
6 and 7 are diagrams illustrating examples of data sharing between terminals. In both cases, the handwritten input operation on the terminal 1A and the shared text are corrected by handwriting on the terminal 1B, and the correction is performed on the terminal 1A. FIG. Reference numeral 7 denotes the case of a recognition unit correction operation.

  In FIG. 6, when a handwritten input “A” is performed in the uppermost input area of the terminal 1 </ b> A as shown in a, the character recognition result “A” is input by hand as shown in b. Displayed in the input area. Further, as shown in c, for the terminal 1A to the terminal 1B (including other terminals that share data), the input text and the input area ID (display attributes) are shared by the sharing function. Information) is transmitted, and “1” is displayed in the corresponding input area at the terminal 1B, as shown at d. FIG. 8A shows an example of transmission data at that time, and an input device ID indicating a transmission source is also added, but the data amount is about several bytes in total.

  Returning to FIG. 6, as shown in e, handwritten input to replace “i” of “Any” with “e” on the terminal 1B, that is, the character “e” is inputted on the display character “i” by handwriting. Suppose that it is determined that the terminal 1 </ b> B does not perform correction on its own terminal, but causes the terminal 1 </ b> A to perform correction. In this case, as shown in f, the handwriting information of “e”, the text position information (display position information) of “that” to be handwritten input, and the like are transmitted from the terminal 1B to the terminal 1A. FIG. 8b shows an example of transmission data at that time, and the size of the handwriting information part is large and the data amount is about several kilobytes, but it is transmitted only to the terminal 1A. Therefore, it hardly affects the communication volume of the entire system.

  Returning to FIG. 6, as shown in g, in the terminal 1A, the character or character string to be corrected is specified and recognized based on the handwriting information and text information transmitted from the terminal 1B, and is shown in h. In this way, “Yes” in “Any” is replaced with “E” and displayed. Also, as shown in i, the input text and the input area ID are transmitted from the terminal 1A to the terminal 1B (including other terminals that share data if any) by the sharing function. In 1B, as shown in j, “gae” is displayed in the corresponding input area. FIG. 8c shows an example of transmission data at that time, and an input device ID is also added, but the total data amount is about several bytes.

  Next, in FIG. 7, as shown in a, handwriting input “Eguchi” is performed in the uppermost input area of the terminal 1A, and the recognition unit (a set of segments recognized as one character) is accurately set. It is assumed that the character recognition result “cielo” is displayed in the input area where the handwriting is input, as shown in b, assuming that the character is not recognized. It is assumed that the part of “E” is recognized as “Shi”, the remaining part of “E” is recognized as “E” (Katakana), and the “mouth” is recognized as “B” (Katakana). In addition, since the context correction is performed in character recognition, katakana is given priority over the characters following katakana.

  Further, as shown in c, the input text and the input area ID are transmitted from the terminal 1A to the terminal 1B (including other terminals that share data if any) by the sharing function. In 1B, as shown in d, “cielo” is displayed in the corresponding input area.

  Next, as shown in e, the terminal 1B performs a handwriting input operation for correcting the recognition unit, for example, by encircling a circle so as to recognize the “sie” part of “ciero” as one character, Assume that it is determined that the terminal 1 </ b> A is to make corrections without making corrections at the terminal itself. In this case, as shown in f, handwriting information for recognition unit correction and text position information of “Ciel” to be corrected are transmitted from the terminal 1B to the terminal 1A.

  Next, as shown in g, in the terminal 1A, the range to be combined as a recognition unit is specified based on the handwriting information and text information transmitted from the terminal 1B, and the character is based on the accumulated stroke information. Recognition is performed, and “cielo” is corrected to “Eguchi” and displayed as shown in h. As the “sie” part is corrected to the Chinese character “E”, the subsequent katakana “Ro” (ro) is corrected to the Chinese character “mouth”.

  Also, as shown in i, the input text and the input area ID are transmitted from the terminal 1A to the terminal 1B (including other terminals that share data if any) by the sharing function. In 1B, as shown in j, “Eguchi” is displayed in the corresponding input area.

<Detailed operation>
FIG. 9 and FIG. 10 are flowcharts showing a processing example of the above-described embodiment. FIG. 9 shows that correction of handwriting information (stroke information) is performed before character recognition in the terminal 1A requested to be corrected by the terminal 1B. FIG. 10 shows a case where correction is performed after character recognition. When correction is performed first, it is possible to display handwriting in real time, and there is a merit that the subsequent processing can be performed in the same way as when correction operation is performed on the terminal itself. In the case of reduction, there is a demerit that recognition accuracy is lowered. As a decrease in recognition accuracy, for example, even if the user intends to input “1” by hand, if the resolution is reduced and the width is compressed to 1 pixel, the character may be recognized as an alphabetic el. When correction is performed later, the above advantages and disadvantages are reversed.

  In FIG. 9, when the correction handwriting input is started at the terminal 1B, the terminal 1B acquires stroke information for one fraction (from pen down to pen up) (step S101), and does not determine that the input is completed (step S102). NO) repeats the acquisition of stroke information (step S101). Note that the end of input can be determined based on whether or not handwriting input is performed for a predetermined time.

  If it is determined that the input has been completed (YES in step S102), the terminal 1B specifies a stroke area (input area) indicated by the stroke information (step S103).

  Next, the terminal 1B refers to the area information 45 to confirm other terminals that can perform processing, and determines whether or not processing is to be performed by the own terminal in consideration of the resource status of the own terminal and the other terminal as necessary. (Step S104). In addition, when not performing a process in the own terminal, the other terminal which performs a process is specified.

  If it is determined that the terminal does not perform processing (NO in step S104), data (handwriting information, text position information) is transmitted to the terminal 1A here (step S105).

  When the terminal 1A receives the data (step S106), the terminal 1A corrects the handwriting information (stroke information) (step S107). The corrected stroke information is stored as character / stroke information 42.

  FIG. 11 is a diagram illustrating an example of correction of stroke information. As illustrated, it is assumed that the screen size of the terminal 1A is 2560 × 1600 and the screen size of the terminal 1B is 1920 × 1080. Here, when the stroke information handwritten in the terminal 1B is simply corrected on the terminal 1A side from the screen size and area position information, the position and size of the handwriting information (stroke information) is relative to the terminal 1A. It will be shifted to. FIG. 12A shows an example when correction is performed from the screen size, and b shows an example when correction is performed from area position information. In both cases, it is assumed that “e” is handwritten over “i” in the character string “Ayu”, but the correction does not overlap “i”.

  Returning to FIG. 11, after handwritten input of a on the terminal 1A, text display of b, and text display of c on the terminal 1B, as shown at d on the terminal 1B, the character string “A” is superimposed on “I”. Suppose that "e" is handwritten. In this case, the terminal 1A performs correction (coordinate conversion) based on the text position information and handwriting information of the character string “A”, so that the terminal 1A accurately overlaps “I” on the terminal 1A as shown in e. Can recognize handwritten input of “e”.

  Returning to FIG. 9, after data correction (step S107), the terminal 1A specifies a character or a character string to be corrected (step S108). That is, in the case of replacement of a character or character string, insertion of a character or character string, or deletion of a character or character string, the position or range to be replaced, inserted, or deleted is specified. In the case of a recognition unit correction input, the range of the character or segment to be combined or the position of the segment within the character to be divided is specified.

  Next, in the case of replacement or insertion of characters or character strings, the terminal 1A performs character recognition from the handwriting information (step S109). In the case of the recognition unit correction input, the recognition unit segment is fixed from the accumulated stroke information and character recognition is performed again. In the case of deleting a character or character string that has been character-recognized, or the character or character string to be deleted, the character or character string to be deleted is passed to the text display application execution unit 11 to correct the text to be displayed. Then, the terminal 1A performs text display with the corrected text (step S110), and transmits the same content to the terminal 1B (step S111).

  When the terminal 1B receives the data (step S112), the terminal 1B performs text display according to the received data (step S113), and ends the process.

  On the other hand, when it is determined that the terminal 1B performs processing on its own terminal (YES in step S104), the terminal 1B identifies the character or character string to be corrected by itself (step S114), and character recognition is performed as necessary. (Step S115), text display is performed (step S116), and data is transmitted to the terminal 1A (step S117). When the terminal 1A receives the data (step S118), the terminal 1A performs text display according to the received data (step S119), and ends the process.

  In FIG. 10, when the handwriting input for correction is started at the terminal 1B, the terminal 1B acquires stroke information of one fraction (from pen down to pen up) (step S201), and does not determine that the input is finished (in step S202). NO) repeats the acquisition of stroke information (step S201). Note that the end of input is determined by whether or not handwriting input is performed for a predetermined time.

  If it is determined that the input has been completed (YES in step S202), the terminal 1B specifies a stroke area (input area) of the stroke information (step S203).

  Next, the terminal 1B refers to the area information 45 to confirm other terminals that can perform processing, and determines whether or not processing is to be performed by the own terminal in consideration of the resource status of the own terminal and the other terminal as necessary. (Step S204). In addition, when not performing a process in the own terminal, the other terminal which performs a process is specified.

  When it is determined that the terminal does not perform processing (NO in step S204), data (handwriting information, text position information) is transmitted to the terminal 1A here (step S205).

  Upon receiving the data (step S206), the terminal 1A performs character recognition from the handwriting information when the character or character string is replaced or inserted (step S207).

  Next, the terminal 1A corrects handwriting information (stroke information) (step S208). The corrected stroke information is stored as character / stroke information 42.

  Next, the terminal 1A specifies a character or a character string to be corrected (step S209). That is, in the case of replacement of a character or character string, insertion of a character or character string, or deletion of a character or character string, the position or range to be replaced, inserted, or deleted is specified. In the case of a recognition unit correction input, the range of the character or segment to be combined or the position of the segment within the character to be divided is specified. If the input is a recognition unit correction input, the recognition unit segment is fixed from the accumulated stroke information and character recognition is performed again.

  The character or character string recognized, the character or character string to be deleted if the character or character string is deleted, or the character string obtained by re-character recognition is passed to the text display application execution unit 11 for display. The target text is modified. Then, the terminal 1A performs text display using the corrected text (step S210), and transmits the same content to the terminal 1B (step S211).

  When the terminal 1B receives the data (step S212), the terminal 1B performs text display according to the received data (step S213), and ends the process.

  On the other hand, when it is determined that the terminal 1B performs processing on its own terminal (YES in step S204), the terminal 1B identifies the character or character string to be corrected by itself (step S214), and character recognition is performed as necessary. (Step S215), text display is performed (step S216), and data is transmitted to the terminal 1A (step S217). When the terminal 1A receives the data (step S218), the terminal 1A performs text display according to the received data (step S219), and ends the process.

<Summary>
As described above, according to the present embodiment, when the result of handwriting input is shared by a plurality of terminals, the text recognized by handwriting input can be corrected while reducing the communication amount and / or processing resources. Can be.

  The present invention has been described above by the preferred embodiments of the present invention. While the invention has been described with reference to specific embodiments, various modifications and changes may be made to the embodiments without departing from the broad spirit and scope of the invention as defined in the claims. Obviously you can. In other words, the present invention should not be construed as being limited by the details of the specific examples and the accompanying drawings.

1, 1A, 1B terminal 10, 10A, 10B Text display application 20, 20A, 20B Modification target character identification program 30, 30A, 30B Recognition program 70, 70A, 70B Shared program 11 Text display application execution unit 21 Modification target character identification unit DESCRIPTION OF SYMBOLS 22 Stroke information acquisition part 23 Area | region specific | specification part 24 Replacement / insertion / deletion position range specific | specification part 25 Combined range / division | segmentation position specific | specification part 26 Stroke information correction | amendment part 31 Character recognition part 41 Memory | storage part 42 Character / stroke information 43 Segment information 44 Input stroke Information 45 Area information 5 Network 6 Communication device 71 Shared control unit

Claims (13)

A process of transmitting the first text information recognized based on the first handwritten input input to the second terminal;
Handwriting information related to second handwriting input for the second text information corresponding to the first text information displayed on the second terminal, and the second of the display position information related to the second text information. Processing to correct the first text information based on the handwriting information and the display position information in response to reception from the terminal,
The input processing method characterized by performing. The transmitting process transmits the first text information and attribute information related to the first text information to the second terminal,
The correction process receives information including the attribute information from the second terminal.
The input processing method according to claim 1. The correction of the first text information is a correction of a character string.
The input processing method according to claim 1 or 2, characterized in that The correction of the first text information is a correction based on a recognition result obtained by correcting a recognition unit of the first handwriting input.
The input processing method according to claim 1 or 2, characterized in that The second handwriting input is a correction input for characters included in the second text information.
The input processing method according to claim 1 or 2, characterized in that The second handwriting input is a recognition unit instruction input for the second text information.
The input processing method according to claim 1 or 2, characterized in that The first terminal corrects the received handwriting information based on information on the screen of the second terminal.
The input processing method according to claim 1 or 2, characterized in that The first terminal transmits a correction result in the first terminal to the second terminal;
The input processing method according to claim 1 or 2, characterized in that The second terminal determines the first terminal from terminals capable of correcting the first text information.
The input processing method according to claim 1 or 2, characterized in that Means for transmitting the first text information recognized based on the first handwritten input input to the second terminal;
Handwriting information related to second handwriting input for the second text information corresponding to the first text information displayed on the second terminal, and the second of the display position information related to the second text information. Means for correcting the first text information based on the handwriting information and the display position information in response to reception from the terminal;
An input processing apparatus comprising: On the computer,
A process of transmitting the first text information recognized based on the first handwritten input input to the second terminal;
Handwriting information related to second handwriting input for the second text information corresponding to the first text information displayed on the second terminal, and the second of the display position information related to the second text information. Processing to correct the first text information based on the handwriting information and the display position information in response to reception from the terminal,
An input processing program that executes A first terminal and a second terminal;
The first terminal includes means for transmitting, to the second terminal, first text information recognized based on a first handwritten input input by handwriting on the first terminal,
When the second terminal receives a second handwriting input for the second text information corresponding to the first text information displayed on the second terminal, the second terminal relates to the second handwriting input. Means for transmitting handwriting information and display position information relating to the second text information to the first terminal;
The first terminal includes means for correcting the first text information based on the handwriting information and the display position information.
An input processing system characterized by that. A process in which the first terminal transmits the first text information recognized based on the first handwritten input input by handwriting on the first terminal to the second terminal;
When the second terminal receives a second handwriting input for the second text information corresponding to the first text information displayed on the second terminal, the second terminal relates to the second handwriting input. Processing for transmitting handwriting information and display position information related to the second text information to the first terminal;
A process in which the first terminal corrects the first text information based on the handwriting information and the display position information;
The input processing method characterized by performing.

Images