JPH09161089A - Handwritten data editing device and its method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To reduce the labor and time for rearranging handwritten data by changing the display position information of a prescribed handwriting group stored in accordance with an order insturction by a handwriting group rearranging-means. SOLUTION: A character recognition part 104 recognizes characters in handwriting data sorted by a group sorting part 102 and recognizes whether the handwriting data are order-instruction characters or order-characters, or not. A gesture recognition part 105 recognizes whether the handwriting data sorted by the sorting part 102 is a gesture indicating the change of the arrangement order of the handwriting group or not. An order-instruction control part 106 judges whether there is an input to a tablet device 101 or not. A rearranging processing part 108 executes rearranging processing for updating relative coordinates or absolute coordinates to be a coordinate value indicating a display position added to the handwriting data stored in a data storing part 103 based upon the order information under the control of the control part 106.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a handwriting data editing apparatus for editing handwriting data, which is a drawing trajectory handwritten using an input device such as a tablet device, in units of handwriting groups such as characters, lines, and blocks. Regarding the method.

[0002]

2. Description of the Related Art In recent years, as a technique for handling handwritten input handwriting data is widely used, a technique for directly editing the input handwriting data without converting the input handwriting data into a character code is becoming more important. For example, “Kamo, Sakurai, Sakurai, Shitanda, Sugita:“ Personal Pen Input Technology ”, Hu
man Interface News and Re
port, Vol. 10, pp. 59-64 (199
5) ”describes a technique capable of executing deletion, insertion, copying, moving, line feed and other editing operations of handwriting data grouped into characters and lines in units of characters and lines.

[0003]

However, in the conventional technique, when the groups are to be rearranged,
There was no other way than moving the groups to be sorted in order. For example, the row groups are A, B,
It is assumed that they are arranged in the order of C, D, and E. This is B, E,
If you try to rearrange in the order of D, C, A, first move B to the front of A, then move E to the front of A, move D to the front of A, and move C to the front of A. It was necessary to perform multiple operations of moving. Therefore, it took a lot of work to rearrange the groups.

The present invention has been made in view of the above circumstances, and an object of the present invention is to provide a handwriting data editing apparatus and method capable of reducing the time and effort required for rearranging handwritten data.

[0005]

According to a first aspect of the present invention, handwriting data classified in units of handwriting groups such as a character group, a line group, and a block group is made to correspond to display position information indicating a position for displaying them. And a data storage means that stores the stored order, an order instruction receiving means that receives an order instruction that rearranges a predetermined handwriting group among the classified handwriting groups in units of the handwriting group, and the data storage means according to the received order instruction. And a handwriting group rearranging means for changing the display position information of the predetermined handwriting group stored in.

According to a second aspect of the present invention, the order instruction receiving unit is a character data receiving unit that receives handwriting data, and a character that recognizes whether the received handwriting data is an order indicating character indicating a rearrangement order. And a recognition unit, wherein the handwriting group rearranging unit changes the display position information of the predetermined handwriting group stored in the data storage unit according to the order indicated by the order indicating character recognized by the character recognition unit. It is characterized by

According to a third aspect of the present invention, the order instruction receiving means further arranges a handwriting group to be rearranged and its order based on the position where the handwriting data of the recognized order instruction character is input to the handwriting data receiving means. The handwriting group rearranging means stores the handwriting group determined by the rearranging handwriting group determining means based on the handwriting group determined by the rearranging handwriting group determining means and the order thereof. The display position information of a predetermined handwriting group is changed.

According to a fourth aspect of the present invention, in the handwriting data editing apparatus, when the handwriting data accepted by the handwriting data accepting means is not recognized by the character recognizing means as an order designating character, the handwriting data is deleted. It is characterized by comprising handwriting data storage instruction means for storing data in the data storage means as handwritten characters. According to a fifth aspect of the present invention, the order instruction receiving means further includes a start / end instruction receiving means for receiving an instruction for starting the order instruction and an instruction for ending the order instruction, and the handwriting group rearranging means includes the start / end instruction. Of the predetermined handwriting group stored in the data storage unit based on the order designating character recognized by the character recognizing unit from the reception unit receiving the order start instruction to the order designation end instruction. It is characterized in that the display position information is changed.

According to a sixth aspect of the present invention, the order instruction accepting means receives the order instruction start instruction, the order instruction end instruction, and the handwriting group designation instruction, and the instruction accepting means starts the order instruction. And a sorting order determining means for determining the order of the handwriting group designation instructions received from the reception of the instruction of ending the order instruction to the order of sorting the handwriting groups, and the handwriting group sorting means. The display position information of the predetermined handwriting group stored in the data storage unit is changed based on the order of rearranging the handwriting group determined by the rearrangement order determining unit.

According to a seventh aspect of the present invention, the order instruction receiving unit receives the handwriting data, and whether the received handwriting data is a gesture having a unique shape indicating a rearrangement order. The handwriting group rearranging means changes the display position information of the predetermined handwriting group stored in the data storage means according to the order indicated by the gesture recognized by the gesture recognition means. It is characterized by doing.

According to an eighth aspect of the present invention, the handwriting group rearranging means is arranged in the horizontal direction when the handwriting data stored in the data storage means indicates vertical handwritten characters.
In the case of showing horizontally handwritten characters, a sorting direction determining unit that determines to sort the predetermined handwriting group in the vertical direction, and the predetermined writing group is sorted in the sorting direction determined by the sorting direction determining unit. Display position information changing means for changing the display position information of the predetermined handwriting group stored in the data storage means so as to be displayed.

According to a ninth aspect of the present invention, the handwriting group rearranging means further causes the data storage means to unify the starting points of display positions of the handwriting groups to be rearranged in a direction orthogonal to the rearranging direction. It is characterized by further comprising handwriting group starting point unifying means for changing the stored display position information of the predetermined handwriting group. According to a tenth aspect of the present invention, the handwriting group rearranging means further sets the handwriting data so as to unify the intervals of the handwriting groups in the rearranging direction of the handwriting groups based on the display position information of the handwriting groups to be rearranged. It is characterized by further comprising handwriting group interval unifying means for changing the display position information of the predetermined handwriting group stored in the storage means.

According to an eleventh aspect of the invention, an image is stored in which image data classified into image group units such as a character group, a line group and a block group is stored in association with display position information indicating a position for displaying them. A data storage unit, an image order instruction receiving unit that receives an order instruction for rearranging a predetermined image group of the classified image groups into image group units, and the image storage unit stores the image order instruction receiving unit in the data storage unit according to the received order instruction. Image group rearranging means for changing the display position information of the predetermined image group that is present.

According to the twelfth aspect of the invention, the code data stored in code group units such as character groups, line groups, block groups, etc. is stored in association with display position information indicating the position for displaying them. A data storage means, a code order instruction receiving means for receiving an order instruction for rearranging a predetermined code group among the classified code groups in the code group unit, and stored in the data storage means according to the received order instruction. And a code group rearranging means for changing the display position information of the predetermined code group.

According to a thirteenth aspect of the invention, an order instruction receiving step of receiving an order instruction for rearranging a predetermined handwriting group among the classified handwriting groups in units of the handwriting group, and the data storage means according to the received order instruction. A handwriting group rearrangement step of changing the display position information of the predetermined handwriting group stored in.

[0016]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of the present invention will be described below. FIG. 1 is a block diagram of a handwriting data editing apparatus of the present invention. The handwritten data editing device is composed of a tablet device 101, a group classification unit 102, and a data storage unit 1.
03, a character recognition unit 104, a gesture recognition unit 105, an order instruction control unit 106, a display device 107, and a rearrangement processing unit 108.

The tablet device 101 extracts handwriting data from the handwriting input by the operator via the pen,
It is passed to the group classification unit 102 and the data storage unit 103. The handwriting data includes a series of coordinate point sequences (hereinafter referred to as “strokes”) that represent the handwriting. This sequence of coordinate points is from pen down to pen up. The tablet device 101 also receives various operation instructions from the operator in addition to handwriting. The respective operation instructions are a setting change instruction, an order instruction start instruction, an order instruction end instruction, a rearrangement target change instruction, a coordinate adjustment change instruction, a direct instruction, and an order instruction. Here, the setting change instruction is an instruction for performing a setting change process that is a process of changing the setting of the rearrangement process of the handwriting data editing device. The order instruction start instruction is an instruction for starting acceptance of the order of rearranging the handwriting groups in the instruction mode processing. The instruction to end the order instruction is an instruction to start a rearrangement process that is a process of rearranging the handwriting groups. The instruction to change the rearrangement target, the instruction to change the coordinate adjustment, the direct instruction, and the order instruction will be described later.

The group classification unit 102 receives handwriting data from the tablet device 101, and classifies the handwriting data into handwriting groups such as character units, line units, and block units. Here, a set of character groups arranged in the same direction is a line group, and a block in which a plurality of line groups are gathered at a certain distance is a block group. For example, in FIG. 2A, the character groups 201, 20
A set of 2, 203 and 204 constitutes a row group 221. Similarly, the character group 205,
A set of 206 and 207 constitutes a row group 222. A group of row groups 221 and row groups 222 constitutes a block group 231. Similarly, in FIG. 2B showing handwriting data written vertically, a set of character groups 208, 209, 210, 211, 222 is a row group 223, and this row group 223 is also a block group 232. . The group classification unit 102 may be, for example, the Institute of Electronics, Information and Communication Engineers, Journal of '90 / 10 Vo.
l.J73-D-II No.10 “Cut out characters from stroke data”
, IEICE Transactions '90 / 7 Vol.J73-D-II No.7
Group classification is performed according to the method described in "Line segmentation from handwriting data". The direction of the line group or the block group is determined by referring to the writing direction of the stroke group.

Although not shown in FIG. 2, a plurality of figures can be classified as a block group. Based on the result of the group classification by the group classification unit 102, the data storage unit 103, as shown in FIG. 3, is a column 300 that is stroke group information, a column 310 that is character group information, and a column 340 that is line group information. The handwriting data is stored in the hierarchy of the column 370 which is the information of the block group. The data storage unit 103 stores not only handwriting data but also absolute coordinate information 381, ..., Relative coordinate information 351, ... 321, ..., Which indicates the display position of the handwriting data on the display device 107. The sequence information 391, ..., 361, ... 331, ... used for the processing is also stored. First, the column 300 stores a coordinate point sequence that is a stroke. For example, in line 301, FIG.
A stroke 1 forming the left side and a stroke 2 forming the right side of the character group 201 in (a) are stored. Similarly, in line 302, the stroke 3 forming the “ro” of the character group 202 in FIG. 2A is stored, and in line 303, “i” of the character group 203 is stored.
Are stored.

In the column 310, character header information 311, ...
. And relative coordinate information 321, ... And order information 331,
.. and are stored. Character header information 311, ...
Indicates the circumscribed rectangle information indicating the circumscribed rectangle of the character group 201, ..., Information indicating which stroke the character group 201, ... Is composed of, and the line group of the character group 201 ,. It is information such as information indicating whether it belongs. Relative coordinate information 321, ...
The information is provided corresponding to each character header information 311, ..., and the character group 201 indicated by the character header information 311, ... Is the position in the line group 221, ... to which the character group belongs. Information indicating the relative coordinates with respect to the row group 221 that indicates whether or not. Usually, information indicating the relative coordinates of the upper left corner of the circumscribed rectangle of the character group 201, ... Is used as the relative coordinate information. Next, the order information 331 is information provided corresponding to each character header information 311, ...
.. is information indicating the order of the rearranged character groups 201 ,. This order information is information written later by the order instruction control unit 106.

Similarly, column 340 contains row header information 34.
1, ... And relative coordinate information 351, ... And order information 3
61, ... Are stored. Row header information 341,
··· is the circumscribed rectangle information of the line group 221, ··· and the line group 221, ··· is which character group 2
01, ..., which character group 201, ..., which block group 231, ...
Information such as information indicating whether or not it belongs to. The relative coordinate information 351, ... Is information provided corresponding to each row header information 341 ,.
.. is information indicating relative coordinates with respect to the block group indicating the position in the circumscribed rectangle of the block group 231 to which the row group belongs ,. Usually line group 22
Information indicating the relative coordinates of the upper left corner of the circumscribed rectangle of 1, ... Is set as the relative coordinate information. Next, the order information 361 is information provided in correspondence with each row header information 341, ..., When the row group 221 ,. This is information indicating the order of the groups 221. This order information is information written later by the order instruction control unit 106.

In the column 370, the block header information 37
1, ... And absolute coordinate information 381, ... And order information 3
91, ... Are stored. Block header information 3
71, ... are information such as circumscribed rectangle information of the block group 231, ..., Information indicating which row group 221, ... Is the block group 231 ,. The absolute coordinate information 381, ... Is information provided corresponding to each block header information 371, ..., and the block group information 231 indicated by the block header information 371 ,. It is position information indicating which position is displayed above. Normally, information indicating the absolute coordinates of the upper left corner of the circumscribed rectangle of the block group 231, ... Is used as the absolute coordinate information.
Next, the order information 391 is the block header information 371,
.. is information corresponding to the block groups 231, ... If the block groups 231, ... Are rearranged, the information indicates the order of the block groups 231 ,. . This order information is information written later by the order instruction control unit 106.

The circumscribed rectangle information of each handwriting group can be calculated from the stroke information, but the result of the calculation may be stored in the data storage unit 103 in advance. The character recognition unit 104 performs character recognition on the handwriting data classified by the group classification unit 102, and recognizes whether the handwriting data is an order designation character, an order character, or the like. Here, the order designating character or the order character is a character for designating the order of rearranging the handwriting groups. For example, 4 in FIG.
As shown in FIG. 1, a combination of a circle and a number surrounded by a circle is an order designating character or a sequence character. Ordinal characters may not be circled. In addition, in the embodiment, the order indicating character or the order character that encloses a number in a circle has been described, but other shapes such as a parenthesis and an underline may be used without being limited to a circle, and what is enclosed is not limited to a number. English letters, Kana, Kanji numbers,
It may be a symbol or the like. The character recognizing unit 104 character-recognizes a circle or a number in the circle, and this character recognition is performed by using a method of performing segment matching by approximating a stroke to a broken line, for example.

The gesture recognition unit 105 recognizes whether or not the handwriting data classified by the group classification unit 102 is a gesture for instructing to change the order of arrangement of the handwriting groups. Here, the gesture is a peculiar shape that is written so as to surround two row groups to be rearranged, as shown in the gesture 51 of FIG. 5, for example. This gesture 51 is a gesture for performing a rearrangement process that interchanges two groups. This gesture recognition can also be realized by a method such as segment matching.

The order instruction control unit 106 controls each unit of the handwriting data editing apparatus. Specifically, control is performed according to the control flows shown in FIGS. 6, 7, 8, and 9. This figure will be described later. The display device 107 displays the handwriting data stored in the data storage unit 103 as handwriting. Further, a menu screen or the like is displayed under the control of the order instruction control unit 106. The display device 107 is usually placed under the tablet device 101 so as to be overlapped with each other, but it does not have to be an integral type.

The rearrangement processing unit 108 sets the relative coordinates and absolute coordinates, which are the coordinates indicating the display position added to the handwriting data stored in the data storage unit 103 under the control of the order instruction control unit 106, in order. A rearrangement process for updating based on the information is performed. Specifically, it is shown in the processing flow shown in FIG. This figure will be described later. Next, the operation of the handwriting data editing apparatus will be described with reference to FIG. 6, FIG. 7, FIG. 8, and FIG. 9 which are control flows of the order instruction control unit 106 and FIG. 10 which is a processing flow of the rearrangement processing unit 108. To do.

First, the order instruction control unit 106 determines whether or not there is an input on the tablet device 101 (step S101). If there is an input and the input is an instruction to change the setting, the setting is changed (step S102).
Specifically, the processing shown in FIG. 9 is performed. In FIG. 9, first, it is determined whether or not there is an instruction to change the group to be rearranged (step S301). If there is an instruction to change the rearrangement target group, the designation of the changed group is accepted from the operator (step S302). Specifically, the designation of whether the rearrangement target group is a block group, a line group, or a character group is accepted. Here, it is assumed that a row group is designated. Next, based on the designation of the row group, the group to be rearranged is set to the row group (step S303).
If it is not the instruction to change the rearrangement target group in step S301 but the instruction to change the coordinate adjustment (step S304), the setting of the coordinate adjustment is changed based on the instruction (step S305). Here, changing the setting of coordinate adjustment means changing the setting of whether or not coordinate adjustment is designated. The coordinate adjustment designation is a designation to make adjustment so that the coordinates of each group are aligned during sorting in the sorting process shown in FIG. The details will be described in the rearrangement process. This completes the setting change process and returns to the beginning of the control flow in FIG.

Next, in FIG. 6, when the instruction to start the order instruction is received (steps S101 to S10).
3) The order instruction screen is displayed (step S104).
Here, the instruction to start the order instruction is, for example, on the tablet device 101 as shown in FIG. 11, a button of the order instruction start 111 located at a corner of the input screen or outside the input screen is pressed with a pen. Order instruction screen 11 of FIG.
Reference numeral 2 is a screen for accepting inputs of direct instructions and writing instructions. Here, the direct instruction is an instruction to order the handwriting groups in the order in which the pen is touched (pressed) thereafter. On the other hand, the writing instruction is an instruction to pass the handwriting data of the order characters indicating the order written on or near the handwriting group to the character recognizing unit 104 and order the handwriting groups using the recognition result. is there. Next, the instruction mode process shown in FIG. 8 is started. First, on the screen shown in FIG. 11, the input of the order instruction end 113, the direct instruction 114, or the writing instruction 115 is accepted (steps S201, S202, S20).
8).

If a direct instruction is input (steps S201 and S202), the order instruction control unit 106 resets the internal order counter to 1 (step S203). Here, it is assumed that three row groups 401, 402, and 403 are displayed on the display screen shown in FIG. At that time, the line group is designated by touching the line group with the pen (step S205), and the contents of the sequence counter are written as sequence information of the designated line group (step S206). For example, when the row group 402 is designated, the content 1 of the sequence counter is 1
Is written in the data storage unit 103 as sequence information. After that, the sequence counter is incremented by 1 to be 2 (step S207). Next, when the row group 403 is touched with a pen, 2 is written as the order information of the row group 403 (steps S204 to S207). When the line group 401 is touched with a pen, 3 is written as the order information of the line group 401 (step S204).
-Step S207). As described above, if the ordering is to be ended, the button of the order instruction end 113 at the upper right of the screen is pressed (step S204). After that, the sorting process shown in FIG. 10 is performed, and the sorting process will be described later.

Next, in the instruction mode process of FIG. 8, when a writing instruction is input (steps S208 and S209), the input of the handwriting data is waited for by the operator, and the input handwriting data is recognized. The unit 104 is caused to perform character recognition (step S210). For example, assume that "" is first written near the right of the row group 401 on the display screen shown in FIG. Then, since the handwriting is an ordinal character, it is recognized as an ordinal character (step S2).
11). The order character written here is not limited to the right vicinity of the group, and may be written anywhere as long as it can be associated with the group, or may be written over the order character. Next, the order instruction control unit 106 determines the order based on the order character, and further determines the row group to be ordered based on the position of the order character (step S212). The line group to be ordered is determined by selecting the line group closest to the order character. If this ordering is performed normally (step S21
3), the data storage unit 103 corresponding to the row group 401
3 is written as the sequence information in (step S21
4). Similarly, it is assumed that “” is written near the right of the row group 402 as shown in FIG. The handwriting is an order character (steps S209 to S21).
1), 1 is written as the sequence information corresponding to the row group 402 (steps S212 to S214). Similarly, when “” is written near the right of the row group 403 as shown in FIG. 4, the handwriting is an order character (steps S209 to S211), and therefore, 2 is set as the order information corresponding to the row group 403. Is written (steps S212 to S214). Next, when the operator gives an instruction to end the order instruction (step S209),
Performs sorting of ordered row groups. The rearrangement process will be described later.

In this case, since it is clear that the input is a writing instruction, even if not only the circled order characters, but also characters such as "1" and "2" are input, the order instruction is required. It can be carried out. On the other hand, as shown in FIG. 6, when there is an input (step S101), the input is neither a setting change instruction (step S102) nor an order instruction start instruction (step S103). If it is not the end instruction (step S105),
The order instruction control unit 106 determines that the input is the handwriting input by the operator, and outputs the handwriting data to the tablet device 101.
To be extracted (step S106). Next, the extracted handwriting is stored in the data storage unit 103 (step S107), and the handwriting data is stored in the group classification unit 10
2 is grouped (step S108). Next, the character recognition unit 104 causes the handwriting data classified into groups to be recognized (step S109), and it is determined whether the handwriting data is an order designation character (step S110). Specifically, when there is handwriting in the shape of a circle and there is some handwriting inside the circle, the handwriting data is recognized as a sequence designating character. For example, as shown in FIG.
When the handwriting data of "" exists near the right of the line group 401, it is recognized as an order designating character. Next, the handwriting group to be ordered and the order thereof are determined based on the order indicated by the recognized order indicating character and the position where the order indicating character is present (step S111). Since the handwriting data forming the order designating character is not the handwriting that the user should input as handwritten characters, the handwriting data is discarded (step S112). If the handwriting groups are normally ordered in step S111 (step S113), the line group 401 that is the handwriting group to be ordered.
3 which is the determined order is written as the order information corresponding to (step S114). Similarly, when the handwriting “” is written near the right of the line group 402 shown in FIG. 4, the handwriting data is recognized as an order designating character (steps S101 to S110). The handwriting group to be ordered and its order are determined based on the order designating character (step S111), and the determined order 1 is written as the order information corresponding to the line group 402 which is the handwriting group to be ordered. (Steps S112 to S114).

For the row group 403 shown in FIG.
Row groups 403 are ordered based on “” written near the right (steps S101 to S111).
2 which is the determined order is written as the order information corresponding to (step S112 to step S114). After that, if there is an instruction to end the order instruction (steps S101 to S101).
(Step S105), rearrangement processing is performed. The rearrangement process will be described later.

In step S110 of the control flow of FIG. 6, if the handwriting data is not recognized as a sequential character, the gesture recognition unit 105 causes the handwriting data to be recognized as a gesture (step S115). For example, when the handwriting data indicating the gesture 51 of FIG. 5 is input, the handwriting data is recognized as a gesture having a specific shape that instructs rearrangement of the handwriting group (step S116). Next, the group to be rearranged and its order are determined based on the position and shape of the gesture, and then the handwriting data of the gesture is discarded (step S117,
Step S118). For example, in the case of the gesture 51 of FIG. 5, the group to rearrange is determined as follows. First, the region 501 and the region 502 including the opening end are determined based on the shape of the gesture. Next, the proportion of the circumscribed rectangles of each row group 401, ... The selected row group is the row group designated by the area 501. Similarly, the row group designated by the area 502 is obtained. Here, the row group 402 is designated by the area 501, and the area 5
The row group 403 is designated by 02. Here, the gesture 51 is a gesture for exchanging the group designated by the area 501 and the group designated by the area 502. Therefore, it can be understood that the gesture 51 is an instruction to exchange the row group 402 and the row group 403. Therefore, since the group to be rearranged and the order can be determined (step S119), 2 is written in the order information corresponding to the row group 402 and 1 is written in the order information corresponding to the row group 403 (step S12).
0). Then, rearrangement processing is performed. The rearrangement process will be described later.

On the other hand, when the gesture is not recognized in step S116. That is, if the input handwriting data is not recognized as the order designating character (steps S101 to S110) and is not recognized as the gesture shape (steps S115 and S116), the input handwriting data is operated. It is determined that the handwriting should be input by the person, and the handwriting data is not discarded.

Next, the rearrangement process shown in FIG. 10 will be described. First, the sorting processing unit 108 determines whether the sorting direction of the sorting target group stored in the data storage unit 103 is the vertical direction (step S40).
1). It is assumed that the rearrangement direction is designated in advance by the operator, for example. For example, FIG.
FIG. 6 is a diagram showing a state in which a rearrangement target row group 401 stored in the data storage unit 103 is displayed on the display device 107. However, in reality, only the handwritings “kaigi”, “soji”, and “paper” are displayed. Here, the row group 401 to be rearranged is ...
・ It is judged that is rearranged in the vertical direction.

When the rearrangement target is a row group or a block group, it is possible to easily determine whether the line group is vertical writing or horizontal writing depending on the arrangement direction of the handwriting groups forming the row group. Therefore, whether or not the rearrangement direction is the vertical direction may be determined based on the determined result. Specifically, when the line group and block group are written horizontally, it is determined that the groups are rearranged vertically. Similarly, when the line group and block group are written vertically, the horizontal group is written. Judge that the groups are sorted in the direction. In the case of a character group, for example, when the difference between the vertical position and the horizontal position is large, it may be determined that the character group is rearranged in the larger direction.

Next, it is determined whether or not coordinate adjustment is designated (step S402). Step S30 of FIG.
If the coordinate adjustment is not designated by changing the coordinate adjustment setting of 5, the coordinate information of each row group stored in the data storage unit 103 is listed in ascending order of the y-coordinate value (step S405). Here, for example, in FIG.
The order information and the relative coordinate information stored in the data storage unit 103 of each row group 401 shown in (a) are as follows: Group order information Relative coordinate information Row group 401 3 Relative coordinate information 1301 (x1 , Y1) Row group 402 1 Relative coordinate information 1302 (x2, y2) Row group 403 2 Relative coordinate information 1303 (x3, y3) x1 <x2 <x3, y1 <y2 <y3.

Then, the listed relative coordinate information becomes (x1, y1) (x2, y2) (x3, y3) in order. Next, the coordinate information of each row group is updated based on the order information of each row group and the listed relative coordinate information (step S406). Specifically, the relative coordinate information 1302 of the row group 402 of the order information “1” is set to
It is the first relative coordinate information listed (x
1, y1). Next, the relative coordinate information 1303 of the row group 403 of the order information “2” is updated with the second relative coordinate information (x2, y2) listed. Further, the relative coordinate information 1301 of the row group 401 of the order information “3” is updated with (x3, y3) which is the third relative coordinate information listed.

When the relative coordinate information is updated as described above, the relative coordinate information stored in the data storage unit 103 of each row group 401, ... Is as follows. Group Relative coordinate information Row group 401 Relative coordinate information 1301 (x3, y3) Row group 402 Relative coordinate information 1302 (x1, y1) Row group 403 Relative coordinate information 1303 (x2, y2) Then, the handwriting group is not a block group. Therefore (step S407), the order information stored in the data storage unit 103 is discarded.

Based on the relative coordinate information updated as described above, the handwriting data is displayed on the display device 107 as shown in FIG.
It is displayed as shown in FIG. On the other hand, step S40
If it is determined in step 2 that coordinate adjustment is specified,
That is, if the coordinate adjustment is designated by changing the coordinate adjustment setting in step S305 of FIG. 9, the coordinate is adjusted. Specifically, it is as follows. First, the x component of the coordinate information of each group is unified (step S403).

For example, it is assumed that the order information and relative coordinate information stored in the data storage unit 103 of each row group 401, ... Shown in FIG. Group order information Relative coordinate information Row group 401 3 Relative coordinate information 1301 (x1, y1) Row group 402 1 Relative coordinate information 1302 (x2, y2) Row group 403 2 Relative coordinate information 1303 (x3, y3) where x1 <x2 It is assumed that <x3 and y1 <y2 <y3.

It is assumed that all x components of the relative coordinate information of each row group are unified x components, for example, x0. Here, it is assumed that x0 is the average of x1, x2, and x3.
The average value is not limited to the average value, and may be unified to x1, for example. Next, the average interval between groups is calculated (step S40).
4). In this case, the average interval is {(y2-y1) + (y
3-y2)} / (3-1), which is referred to as a.

The y component of the coordinate information of each group is updated so that the average distance between the groups becomes the obtained average interval (step S405). Here, when updated, the relative coordinate information becomes as shown below. Group order information Relative coordinate information Row group 401 3 Relative coordinate information 1301 (x0, y1) Row group 402 1 Relative coordinate information 1302 (x0, y1 + a) Row group 403 2 Relative coordinate information 1303 (x0, y1 + 2a).

When the processing of steps S406 to S410 is performed based on the coordinate information thus adjusted, the relative coordinate information becomes as shown below. Group Relative coordinate information Row group 401 Relative coordinate information 1301 (x0, y1 + 2a) Row group 402 Relative coordinate information 1302 (x0, y1) Row group 403 Relative coordinate information 1303 (x0, y1 + a) Relative coordinate information updated as described above Based on the, the handwriting data is displayed on the display device 107 as shown in FIG.

If the handwriting group is a block group in step S408, the y component of the absolute coordinate information is updated based on the circumscribed rectangle information of each block group so that the intervals between the blocks are equal. (Step S409). This is because, if the rearrangement direction of each block group, that is, the length in the vertical direction is different, the intervals between the blocks to be written after the rearrangement become inconsistent, and the blocks may overlap each other. In order to prevent this and make the intervals between the blocks equal, specifically, first, the total of the intervals between all the block groups is calculated using the y component information of the circumscribed rectangle information of each block group. To do. Next, the interval between each block group is calculated based on the total of the intervals. The y component of the absolute coordinate information is updated based on the calculated interval and the y component of the circumscribing rectangle information of each block group to equalize the intervals between the block groups.

On the other hand, in step S401, if the rearrangement direction is not vertical, that is, the rearrangement direction is horizontal, the same processing is performed except that the vertical and horizontal directions are different in the processing of steps S402 to S410. Is performed (steps S411 to S418, step S410). This is a process when the rearrangement direction is horizontal, that is, when the character strings are vertically arranged.

As described above, according to the present embodiment, the operator issues an instruction for rearranging the handwriting groups in units of handwriting groups to the direct instruction or the writing instruction in FIG. 8 and the order instruction character in step S110 in FIG. , Step S1
Since the display position information (relative or absolute coordinate information) of the handwriting group stored in the data storage means is changed by the rearrangement processing shown in FIG. Since it is not necessary to repeat the instruction to move the handwriting group for each handwriting group in order to perform the rearrangement as in the technique of (1), it is possible to reduce the time and effort when rearranging the handwritten data.

It should be noted that the "instruction end instruction?" In FIG.
Determination step (step S201, step S20
4. Step S209) is not limited to an explicit instruction from the operator, and when the ordering is completed for all the handwriting groups existing up to that point, or when the ordering is completed and a certain time has elapsed, the order instruction is completed. May be considered to have been given.

Further, the ordering of groups performed by the order instruction control unit 106 does not necessarily have to be ordered for all groups, and the ordered order need not be continuous. However, when the same order is assigned to a plurality of groups, the order instruction control unit 106.
Presents the operator with the corresponding same-ordered groups and again requests ordering between them. Alternatively, the order instruction control unit 106 sets the order of the handwriting groups in the same order by a method of setting the order of the previously ordered ones as the first order.

The handwriting data extracted by the tablet device 101 may be added with time information such as sampling time for each coordinate point sequence. In that case, the data storage unit 103 stores the handwriting data to which the time information is added. In addition to the order designating character or the order designating method using the order character as in the embodiment, the order designating control unit 106 presents the handwriting groups to the operator one by one, and the corresponding order character is displayed. The order may be designated by accepting the above information from the operator. In that case, for handwriting groups that are not subject to ordering,
It is useful to have a symbol or button to indicate exclusion from ordering.

Further, in the order designation method using the order designating characters, a shape for identifying the order designating characters after writing characters such as numbers and symbols (circle circle in the embodiment).
Is written, or vice versa, a shape for identifying the order indicating character is written and then characters such as numbers are written, or which order may be used, if it is predetermined in the order indicating control unit 106. It doesn't matter.

Although the handwriting data editing apparatus has described the case of handling only handwriting data,
In addition to this, image data and code data may be handled. First, the case of handling image data will be described. The data storage unit 103 stores image data such as figures and images. The handwriting data editing device further includes an image group classification unit.

The image group classification unit is a method (for example, X,
It is stored in the data storage unit 103 by using the projection to the Y axis, connecting the connected components of the black pixels, expanding / contracting the image to obtain the connected components of the black pixels, and the like). Image data is classified into image groups such as block groups, line groups, and character groups to some extent. Based on the classified image groups, the order instruction control unit 106 orders the image groups, and the rearrangement processing unit 108 rearranges the ordered image data groups.

Next, the case of handling code data will be described. The data storage unit 103 stores code data including coded characters, symbols and figures. The handwriting data editing device further includes a code group classification unit. The code group classification part uses the blank code, line feed code, paragraph information, etc. of the code data to
The code data stored in the data storage unit 103 is classified into code groups such as a character group, a line group, and a block group. Based on the classified code groups, the order instruction control unit 106 orders the code groups, and the rearrangement processing unit 108 rearranges the code data.

Although the detailed description has been given by taking the handwriting data as an example, the handwriting data is not always necessary. That is, the rearrangement can be similarly performed in the case of only the image data, the code data only, or the image data and the code data. Further, for the sake of clarity, FIG. 4 and the like show the result of rearranging the groups of each data such as the handwriting group, but this display is not always necessary in this handwritten data editing device. That is, it is also possible to separately supply only the position coordinates of the rearranged groups of each data, and in some cases only the order, to other means or device.

In the present embodiment, the handwriting group,
The image group and the code group are automatically classified, but a user's modification may be added thereto. In that case, this function can be easily added by displaying the classification result of each group and receiving the user's correction instruction such as a gesture.

[0057]

As described above, according to the first aspect of the present invention, the operator only needs to instruct the order instruction receiving means to perform the order instruction for rearranging the handwriting groups in units of handwriting groups. Since the group rearrangement means changes the display position information of a predetermined handwriting group stored in the data storage means according to the order instruction, the handwriting group is moved for each handwriting group in order to perform rearrangement as in the conventional technique. It is not necessary to repeat the instruction of, and it is possible to reduce the trouble when rearranging the handwritten data.

According to the second aspect of the present invention, the handwriting data received by the handwriting data receiving means is recognized by the character recognizing means, and when the handwriting data is recognized as the order indicating character, the order indicating character indicates the order. Since it is possible to change the display position information of the predetermined handwriting group stored in the data storage means, it is possible to give an instruction for rearranging the handwriting group using the handwritten input characters, and to arrange the handwriting data more. It is possible to reduce the time and effort required for replacement.

According to the invention of claim 3, since the rearranged handwriting group determining means determines the handwriting group to be rearranged and the order thereof, there is an effect that the time and effort for inputting when rearranging the handwritten data is small. According to the invention of claim 4, when the handwriting data storage instructing means does not recognize the handwriting data accepted by the handwriting data accepting means as the order designating character by the character recognizing means, the handwriting data is handwritten. As it is stored in the data storage means, it is possible to input the order designating character while inputting the handwritten character, and conversely, the handwritten character is converted to the handwriting data while inputting the order designating character. You can enter.

According to the invention of claim 5, in the handwriting group rearranging means, the order recognized by the character recognizing means after the start / end instruction receiving means receives the order start instruction and before the order instruction end instruction is received. Since the display position information of the predetermined handwriting group stored in the data storage means is changed based on the instruction character, it is possible to reduce the time and effort required when rearranging the plurality of handwriting groups.

According to the sixth aspect of the present invention, the order of the handwriting group designation instructions received by the start / end acceptance means from the receipt of the order designation start instruction to the receipt of the order designation end instruction is rearranged. Since the order determination means and the sorting order instruction determining means do not have to repeat the instruction to move the handwriting group for each handwriting group in order to perform the sorting as in the conventional technique, the time and effort for sorting the handwritten data can be reduced. Can be reduced.

According to the invention of claim 7, the gesture recognition means recognizes whether or not the handwriting data received by the handwriting data receiving means is a gesture, and the handwriting group rearranging means stores data based on the gesture. Since the display position information of the predetermined handwriting group stored in the means is changed, it is not necessary to repeat the instruction to move the handwriting group for each handwriting group in order to rearrange as in the conventional technique, and handwriting data can be stored. It is possible to reduce the trouble of rearranging.

According to the invention of claim 8, since the rearrangement direction judging means judges the rearrangement direction, it is possible to reduce the trouble when rearranging the handwritten data. Claim 9
According to the invention, since the starting points of the display positions of the handwriting groups to be rearranged are unified, the display after rearranging becomes beautiful. According to the invention of claim 10, since the intervals of the handwriting groups in the handwriting group rearranging direction are unified,
The display after sorting will be beautiful.

According to the eleventh aspect of the present invention, since the image data storage means, the image order instruction receiving means and the image group rearranging means are provided, it is possible to reduce the time and labor for rearranging the image data. According to the twelfth aspect of the present invention, since the code data storage means, the code order instruction receiving means, and the code group rearranging means are provided, it is possible to reduce the labor for rearranging the code data.

According to the thirteenth invention, the same effect as that of the first invention is achieved.

[Brief description of the drawings]

FIG. 1 is a configuration diagram of a handwriting data editing apparatus of the present invention.

FIG. 2 is a diagram showing an example of a handwriting group of handwriting data stored in a data storage unit 103.

FIG. 3 is a diagram showing storage contents of a data storage unit 103.

FIG. 4 is a diagram showing rearrangement of a handwriting group using order indicating characters or order characters.

FIG. 5 is a diagram showing rearrangement of handwriting groups using gestures.

FIG. 6 is a diagram showing a control flow of the order instruction control unit 106.

FIG. 7 is a continuation of FIG. 6;

FIG. 8 is a flowchart of instruction mode processing.

FIG. 9 is a flowchart of setting change processing.

FIG. 10 is a processing flow chart of a rearrangement processing unit.

FIG. 11 is a diagram showing an order instruction screen.

FIG. 12 is a diagram for explaining rearrangement processing.

FIG. 13 is a diagram showing rearrangement of handwriting data when coordinate adjustment is not designated.

FIG. 14 is a diagram showing rearrangement of handwriting data when coordinate adjustment is designated.

[Explanation of symbols]

 101 tablet device 102 group classification unit 103 data storage unit 104 character recognition unit 105 gesture recognition unit 106 order instruction control unit 107 display device 107 display device 108 rearrangement processing unit

Front page continuation (72) Inventor Kazuhiko Yamashita 1006 Kadoma, Kadoma City, Osaka Prefecture Matsushita Electric Industrial Co., Ltd.

Claims (13)

[Claims] 1. A device for editing handwriting data of a character input by handwriting, wherein the handwriting data classified into handwriting group units such as a character group, a line group, and a block group is indicated by a position for displaying the handwriting data. Data storage means for storing the display position information, order instruction accepting means for accepting an order instruction for rearranging a predetermined handwriting group among the classified handwriting groups in units of the handwriting group, and the accepted order instruction According to the above, there is provided a handwriting group rearranging means for changing the display position information of the predetermined handwriting group stored in the data storage means. 2. The order instruction receiving means includes handwriting data receiving means for receiving handwriting data, and character recognition means for recognizing whether the received handwriting data is an order indicating character indicating a rearrangement order. The handwriting group rearranging unit changes the display position information of the predetermined handwriting group stored in the data storage unit according to the order indicated by the order indicating character recognized by the character recognizing unit. The handwritten data editing apparatus according to claim 1. 3. The order instruction receiving means further determines a handwriting group to be rearranged and a rearrangement order for determining the order based on the position where the handwriting data of the recognized order indicating characters is input to the handwriting data receiving means. A handwriting group determining means, wherein the handwriting group rearranging means is based on the handwriting group and the order thereof determined by the rearranging handwriting group determining means, of the predetermined handwriting groups stored in the data storing means. The handwriting data editing apparatus according to claim 2, wherein the display position information is changed. 4. The handwriting data editing apparatus, when the handwriting data accepted by the handwriting data accepting means is not recognized by the character recognizing means as an order designating character, the handwriting data is regarded as a handwriting character. 4. The handwriting data editing apparatus according to claim 2, further comprising handwriting data storage instruction means for storing the handwriting data in the data storage means. 5. The order instruction receiving means further comprises start / end instruction receiving means for receiving an instruction for starting the order instruction and an instruction for ending the order instruction, and the handwriting group rearranging means is for receiving the start / end instruction. The display position of the predetermined handwriting group stored in the data storage means based on the order indicating character recognized by the character recognizing means from the reception of the order start instruction to the reception of the order instruction end instruction. The handwriting data editing device according to claim 2, wherein the information is changed. 6. The order instruction receiving means receives an order instruction start instruction, an order instruction end instruction, and a handwriting group designation instruction, and the instruction accepting means receives an order instruction start instruction. From the order until the instruction to end the order instruction is received, the order of the instruction of the handwriting group designation received is determined as the order of sorting of the handwriting group, and the handwriting group sorting means includes the sorting order determining means. The display position information of the predetermined handwriting group stored in the data storage means is changed based on the rearrangement order of the handwriting group determined by the order determination means. 1. The handwritten data editing device according to 1. 7. The order instruction receiving means, a handwriting data receiving means for receiving handwriting data, and a gesture recognition means for recognizing whether the received handwriting data is a gesture having a peculiar shape indicating a rearrangement order. Wherein the handwriting group rearrangement unit changes the display position information of the predetermined handwriting group stored in the data storage unit according to the order indicated by the gesture recognized by the gesture recognition unit. The handwritten data editing device according to claim 1. 8. The handwriting group rearranging means is arranged in a horizontal direction when the handwriting data stored in the data storage means indicates a vertical handwritten character, and in a vertical direction when the handwriting data is indicated in a horizontal writing handwritten character. A rearrangement direction determining means for determining that the predetermined handwriting groups are rearranged, and the data storage so that the predetermined handwriting groups are rearranged and displayed in the rearrangement direction determined by the rearranging direction determining means. 8. A display position information changing means for changing the display position information of the predetermined handwriting group stored in the means.
Any one of the handwritten data editing devices. 9. The handwriting group rearranging means is further stored in the data storage means so as to unify the starting points of display positions of handwriting groups to be rearranged in a direction orthogonal to the rearranging direction. 9. The handwriting data editing apparatus according to claim 1, further comprising a handwriting group starting point unifying unit that changes display position information of a predetermined handwriting group. 10. The handwriting group rearranging means further sets the handwriting data storage means so as to unify the intervals of the handwriting groups in the rearranging direction of the handwriting groups based on the display position information of the handwriting groups to be rearranged. 10. The handwriting data editing apparatus according to claim 1, further comprising handwriting group interval unifying means for changing the display position information of the predetermined handwriting group stored in. 11. The handwriting data editing apparatus further stores image data classified into image group units such as a character group, a line group, and a block group in association with display position information indicating a position for displaying them. Image data storage means, an image order instruction receiving means for receiving an order instruction for rearranging a predetermined image group among the classified image groups into image group units, and the data storage means according to the received order instruction. And an image group rearranging means for changing the display position information of the predetermined image group stored in the handwriting data editing apparatus. 12. The handwriting data editing apparatus further stores code data classified into code group units such as a character group, a line group, and a block group in association with display position information indicating a position for displaying them. Code data storage means, a code order instruction receiving means for receiving an order instruction for rearranging a predetermined code group among the classified code groups into the code group units, and the data storage means according to the received order instruction. 2. The handwriting data editing apparatus according to claim 1, further comprising code group rearranging means for changing display position information of the predetermined code group stored in. 13. The handwriting data of characters input by handwriting is stored in a state of being classified into handwriting group units such as a character group, a line group, and a block group, and corresponding to display position information indicating a display position thereof. A handwriting data editing method in a handwriting data editing device having a data storage means, wherein an order instruction receiving step of receiving an order instruction for rearranging a predetermined handwriting group among the classified handwriting groups in units of the handwriting group, And a handwriting group rearrangement step of changing the display position information of the predetermined handwriting group stored in the data storage means according to the received order instruction.