JPH09190424A - Compound document processor - Google Patents

Abstract

PROBLEM TO BE SOLVED: To execute the input processing of data such a character, etc., of a required construction element in a compound document through the use of only a device for a hand-written input by a pen, etc. SOLUTION: When the hand-written input is executed, a handwriting coordinate information input means 22 gives handwriting coordinate information to a compound document control means 24. When an active construction element control means 29 adopts a specified element within the individual construction element in the compound document as the active construction element, handwriting coordinate information is processed as an input to the construction element. In the other cases, one construction element is selected from position relation with the areas of the respective construction elements controlled by a construction element area control means 28 and a processing is executed as the input to it. A container function processing 49 has a function for putting handwriting coordinate information inputted by the result of handwriting coordinate recognition in the compound document as the new construction element.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a compound document processing apparatus for processing a compound document in which a plurality of constituent elements such as characters and figures having different processing procedures such as image development are combined, and more specifically, The present invention relates to a compound document processing device adapted to edit these compound documents using handwriting coordinate information input by handwriting from a handwriting input means such as a pen.

[0002]

2. Description of the Related Art With the diversification of document creation, for example, not only characters but also information of different characters such as figures and tables are often mixed in one page documents. Such information having different characteristics is often created using independent application programs. For example, for character input, a dedicated application program is started, and when a figure is drawn, a dedicated figure application program is started. In this specification, information such as characters input for each such application program is referred to as a constituent element. A compound document is a document created by combining a plurality of constituent elements, for example, in which a character area or a graphic area exists in one page of a document.

FIG. 11 shows an example of a compound document. On the compound document 11, there is a container component 12 for accommodating various components.
In this example, the container component 12 contains text information 1
First and second text component area 14 ₁ and 14 ₂ for accommodating 3 ₁ and 13 ₂ and graphic component area 16 for accommodating graphic information 15 are arranged. In the compound document 11 of this example, the constituent element regions 14 ₁ , 14 ₂ and 15 in which the constituent elements are arranged are displayed in an overlapping manner.

Conventionally, when editing such a compound document, a keyboard and a pointing
Often uses a mouse as the device. The user uses the mouse to move the cursor 18 to the first text component when performing editing work such as adding the first text information 13 ₁ or deleting part of the contents of the area 14 _1. It is moved to the area 14 ₁ . Then, by clicking the button at a predetermined position or pressing an execution key (not shown) on the keyboard, the input position is confirmed, and if additional characters are to be input, the character can be input from the keyboard. input. This input work is performed by executing an application program prepared for the compound document processing apparatus for inputting characters.

If the graphic 15 in the graphic component area 16 is to be edited, the cursor 18 is used by using the mouse.
Is moved to the graphic component area 16 and necessary input work is performed. This input work is performed by executing an application program prepared for the complex document processing apparatus for inputting graphics.

On the other hand, in addition to the method of inputting information using a mouse or keyboard, there is also a method of inputting handwriting by using a writing instrument such as a pen. In the compound document processing apparatus using the latter method, the input position of which area to input is specified by handwriting input by the user. Also, various information such as editing characters and figures is input using the same writing instrument. The method of performing handwriting input in this way is essentially the information input method using a combination of a position specifying means such as a mouse and a tracking ball and a data input means such as a keyboard (hereinafter simply referred to as mouse and keyboard). Are different from each other.

[0007]

The compound document processing apparatus shown in FIG. 11 has conventionally been premised on using a mouse or a keyboard as an input device. This is because the following problems occur when handwriting input is performed with a writing tool such as a pen.

That is, in the case of handwriting input, it is impossible to distinguish between the information on the constituent elements themselves such as characters and figures and the information for designating the area in which the constituent elements are represented. Therefore, it is not possible to know which constituent element has been specified, and since these cannot be distinguished, it is impossible to accurately recognize the information input by handwriting.

However, there is an increasing need for processing compound documents even in information processing apparatuses that perform handwriting input. In addition, the contents of a document created by a compound document processing device that uses a mouse or keyboard are gradually copied to a device that performs handwriting input and processed. It is very inconvenient for people. For example, Japanese Unexamined Patent Publication No. 1-161438 discloses a document editing device that performs handwriting input, but there is no disclosure regarding processing of a compound document, and this problem has not been solved until now.

Therefore, an object of the present invention is to provide a compound document processing apparatus capable of inputting data such as characters to a compound document using only a device such as a pen for handwriting input. Especially.

[0011]

According to a first aspect of the present invention, (a) handwriting coordinate information input means for inputting handwriting coordinate information representing handwriting input by handwriting in coordinates, and (b) document are different from each other. Compound document management means for managing a compound document in which constituent elements classified as those to be processed by the processing procedure are combined in different areas.
(C) To which of the constituent elements managed by the compound document management means the handwriting coordinate information input from the handwriting coordinate information input means belongs to the input position of this handwriting coordinate information and each constituent element. And (d) handwriting coordinate information for distributing the handwriting coordinate information input from the handwriting coordinate information inputting means to the area where the component selected by this component selecting means exists. Distributing means and (e) information converting means for converting the handwriting coordinate information distributed by the handwriting coordinate information distributing means into information of the same information system as the already input information system of its constituent elements in a compound document processing device. Prepare.

That is, according to the first aspect of the present invention, when handwriting input is performed by the handwriting coordinate information input means, which of the constituent elements managed by the composite document management means is associated with this handwriting coordinate information. The selection is made in relation to the input position and the area to which each component belongs. Then, the handwriting input handwriting coordinate information is distributed to the selected component, and the distributed handwriting coordinate information is a character or figure such as already input code information of the component,
The information system will be converted to the same information system that represents the table. As a result, even if the user does not specify the attribution destination for the input handwriting coordinate information, it is possible to select the attribution destination according to the positional relationship with the existing component and convert it into information of the information system according to it. it can.

According to the second aspect of the present invention, (a) handwriting coordinate information input means for inputting handwriting coordinate information that represents handwriting input by handwriting in coordinates, and (b) the document is processed by different processing procedures. One of a compound document management means for managing a compound document in which constituent elements classified as objects are compounded in different areas, and (c) a constituent element managed by the compound document management means. And (d) when the active component designating unit designates an active component, the active component designating unit that designates as the active component that preferentially corresponds to the handwriting coordinate information input from the handwriting coordinate information input unit. Handwriting coordinate information distribution means for distributing the handwriting coordinate information input from the handwriting coordinate information input means to a region where the active component exists, E) is provided and information conversion means for converting the handwriting coordinate information distributed by the handwriting coordinate information distribution means to the information of the same information system and information systems already input the active components in the composite document processing apparatus.

That is, the invention according to claim 2 deals with the case where the belonging destination of the input handwriting coordinate information is designated as the active component. When an active component is designated, the input handwriting coordinate information belongs to the active component managed by the compound document management means, and is converted into information of the information system corresponding to it. Become.

According to the third aspect of the present invention, (a) handwriting coordinate information input means for inputting handwriting coordinate information that represents handwriting input by handwriting in coordinates, and (b) the document is processed by different processing procedures. One of a compound document management means for managing a compound document in which constituent elements classified as objects are compounded in different areas, and (c) a constituent element managed by the compound document management means. And (d) when the active component designating unit designates an active component, the active component designating unit that designates as the active component that preferentially corresponds to the handwriting coordinate information input from the handwriting coordinate information input unit. While the handwriting coordinate information input from the handwriting coordinate information input means is distributed to the area where the active component exists, If the handwriting coordinate information input from the handwriting coordinate information inputting means does not specify the active constituent element, the handwriting coordinates indicating which one of the constituent elements managed by the compound document managing means is related to the handwriting coordinates. Handwriting coordinate information distribution means for selecting and distributing the handwriting coordinate information in relation to the input position of information and the area to which each component belongs, and (e) the handwriting coordinate information distributed by this handwriting coordinate information distribution means is active. The compound document processing apparatus is provided with an information conversion means for converting information of the already input information system of the constituent elements into information of the same information system.

That is, the invention of claim 3 is the same as claim 1
The invention has a configuration in which an active component designating means is added, and when the active component is designated, the input handwriting coordinate information belongs to the active component, and in this case, claim 2 The processing is the same as the described invention. When the active component is not designated, the same processing as in the first aspect of the invention is performed.

According to a fourth aspect of the present invention, the constituent element selecting means according to the first aspect is the constituent element managed by the input position of the handwriting coordinate information input from the handwriting coordinate information input means and the composite document managing means. It is characterized in that the degree of overlap with the area in which each is present is compared with each other and the component having the maximum value is selected. As such a selection form, for example, a form of selecting a component having an area that intersects with the start point of the handwriting coordinates among the components, or an area that intersects the line segment formed of the handwriting coordinates for the longest among the components. There is a mode of selecting a constituent element to have or a mode of selecting a constituent element having a region which most widely intersects the smallest rectangular region surrounding the handwriting coordinates among the constituent elements.

In the invention according to claim 5, the handwriting coordinate information distributing means according to claim 2 or 3 creates a new component element according to the recognition result when the handwriting coordinate information is distributed, and creates this component document. It is characterized in that it is provided with a new component creating means to be embedded above.

[0019]

BEST MODE FOR CARRYING OUT THE INVENTION

[0020]

DESCRIPTION OF THE PREFERRED EMBODIMENTS The present invention will be described in detail below with reference to embodiments.

FIG. 1 shows a functional configuration of a compound document processing apparatus according to an embodiment of the present invention. The compound document processing apparatus includes an input / display integrated device 21. The input / display integrated device 21 is a handwriting coordinate input means 22 for detecting handwriting coordinates in handwriting input with a pen or the like.
And the display means 23 for visually displaying the predetermined contents of the input compound document. The handwriting coordinate input means 22 of the input / display integrated device 21 is a transparent sheet-like element arranged on the display means 23, and is a so-called touch panel. The user can perform handwriting input at a desired position while viewing the content displayed on the display unit 23. The display means 23 is composed of, for example, an LCD (liquid crystal display).

The input / display integrated device 21 is adapted to input / output data to / from the compound document management means 24. The compound document management means 24 is an input / display integrated device 21.
In addition to the constituent element function processing means 25, the handwriting coordinate information recognizing means 26, each block of the composite document 27, the constituent area managing means 28, the active constituent managing means 29, the constituent selecting means 30, and the handwriting coordinate information distributing means. It is connected to each means 31 and data is transmitted and received between these means. This compound document management means 24 is used for compound document 2
7 performs the processing for realizing the function of each component included in 7. Here, the constituent elements are the information such as input characters, figures, etc., which are classified (classified) for each application program.

The component function processing means 25 uses the composite document 2
Processing for realizing the functions of the components included in 7 is performed. The compound document 27 of this embodiment includes a container component 41.
Three types of components, that is, a text component 42, a graphic component 43, and a table component 44 are embedded in the. The constituent element function processing means 25 realizes the operation and display of each constituent element according to the handwriting coordinate information sent from the compound document managing means 24 by the distribution work of the handwriting coordinate information distributing means 31. In this embodiment, there are four types of function processing means 46 to 49.

Of these, the text editing function processing means 46
Is for performing functional processing of the text component 42, and realizes an editing function such as addition or deletion of text according to handwriting coordinate information and display of text. The graphic editing function processing means 47 includes a graphic component 43.
Is performed to realize the function of adding, deleting, or transforming a figure in accordance with the handwriting coordinate information and displaying the figure.

The table editing function processing means 48 is used for the table constituent element 4
The function processing of No. 4 is performed, and the function of adding or deleting columns or rows of the table or editing the content of the table element according to the handwriting coordinate information and the display of the table are realized. The container function processing means 49 performs the function processing of the container constituent element 41, and embeds the constituent elements 42 according to the handwriting coordinate information and the embedding function of the other constituent elements 42 to 44.
The functions of moving or transforming ~ 44 or embedding a new component and displaying a container are realized.

The compound document 27 is composed of the constituent elements 41 to 44 described above, and these constituent elements 41 to 44 each function of the constituent element function processing means 25 via the compound document management means 24. It is connected to the processing means 46 to 49. The container constituent element 41 holds information in the compound document 27 according to the type of each constituent element such as text information, graphic information or table information. The text component 42 holds text information and is coupled to the text editing function processing means 46. The graphic component 43 holds graphic information and is connected to the graphic editing function processing means 47. The table constituent element 44 holds table information and is connected to the table edit function processing means 48.

Here, the container component 41 is a component having a function of embedding the other components 42 to 44 in its own area on the compound document. As will be described later, there can be a plurality of constituent elements whose functions are realized by the same constituent element function processing means 25. Therefore, another container component (not shown) can be embedded in the area of the container component 41. Container component 4
Reference numeral 1 holds information about the embedded components and is connected to the container function processing means 49.

There can be a plurality of coupling elements coupled to a certain component function processing means 25. For example, there may be a text component holding the text "Iroha" in one area on the compound document and a text component holding the text "ABC" in another area. In the case of this example, each text component holds its own text information. Therefore, the same text editing function processing means 46
Realizes the functions of these text components.

The component area management unit 28 manages the regions of the components 41 to 44 in the compound document 27 in cooperation with the component function processing unit 25.

The active component management means 29 manages which component in the compound document 27 is currently active. Here, the active component refers to a component in the compound document 27 that receives handwriting coordinate information in preference to other components. Which component is the active component is determined by the instruction of the user. It is assumed that the number of active components is one at most on the compound document 27.

The constituent element selecting means 30 determines which constituent element the handwriting coordinate information obtained by the handwriting coordinate input means 22 corresponds to and makes a selection. The handwriting coordinate information distribution means 31 is for passing the handwriting coordinate information obtained by the handwriting coordinate input means 22 to the constituent element selected by the constituent element selecting means 30.

The handwriting coordinate information recognizing means 26 is for recognizing the handwriting coordinate information input to the constituent element function processing means 25, and outputs the recognition result of characters, figures and the like. Of these, the text recognition means 51 recognizes the handwriting coordinate information composed of text and outputs the recognition result. The figure recognizing means 52 recognizes the handwriting coordinate information composed of figures and outputs the recognition result. The table recognizing means 53 recognizes the handwriting coordinate information composed of a table and outputs the recognition result. Of these, the table recognizing unit 53 can recognize the table as a table even if the line segments that form the table are not formed by strict straight lines. For example, if there are a plurality of line segments that can be regarded as parallel in the vertical and horizontal directions within the error due to handwriting input, it is possible to recognize a combination of these as a table.

The handwriting coordinate information recognizing means 26 and the constituent element function processing means 25 do not necessarily have to correspond to each other. For example, the table editing function processing means 48 does not use the table recognizing means 53 but the text recognizing means 5 when the value of each element of the table is realized as only text.
Sometimes only one is used.

The container function processing means 49 uses the input handwriting coordinate information to recognize the text recognition means 51 and the graphic recognition means 5.
2 and the table recognition means 53, and any one of the text constituent element, the graphic constituent element, or the table constituent element corresponding to the recognition result is newly embedded.

FIG. 2 shows an outline of the circuit configuration of the compound document processing apparatus which realizes the above functions.
The compound document processing device includes a CPU (central processing unit) 61 which is the center of various controls. The CPU 61 is connected to each unit in the device through a bus 62 such as a data bus. Of these, the work memory 63 is a random access memory used as a work area for executing various programs of the compound document processing apparatus. The disk control device 64 is a device for controlling the input / output of the hard disk 65. The hard disk 65 stores various programs for executing processes such as creation of a compound document, among which necessary ones are transferred to a predetermined area of the work memory 63. To the bus 62, the handwriting coordinate input means 22 and the display means 23 constituting the input / display integrated device 21 are also connected. FIG.
The other means shown in (4) are realized by executing the program stored in the hard disk 65.

Now, it is assumed that the compound document processing apparatus of this embodiment has created the compound document 11 as shown in FIG. As shown in this figure, each component area 14 ₁ , 1 managed by the component area management means 28 of FIG.
4 _2, 16 has a minus region of the component that overlaps the original these areas in front geometrically. For example, the first text component area 14 ₁ is
The second text component area 14 placed in front of this
_It has a shape obtained by geometrically subtracting ₂ . As a result, it is guaranteed that there is only one constituent element corresponding to the area including any point on the compound document 11.

FIG. 3 shows an outline of the processing flow of the compound document processing apparatus of this embodiment. The compound document processing apparatus is the display means 23 shown in FIG. 1 or 2.
The handwriting input is awaited while the composite document 27 is displayed on the screen (step S101). When handwriting is input using a writing instrument such as a pen (Y), the component selection unit 3
0 inquires of the active component management means 29 whether there is an active component (step S10).
2). When the active component is designated, the component receives the handwriting coordinate information in priority over the other components in the compound document 27. Then, the designated one component is selected (step S103).

On the other hand, when the active component is not designated (step S102;
N), the input handwriting coordinate information and each component area managed by the component area management unit 28 (in the example shown in FIG. 11, the first and second text component areas 14 ₁ ,
14 ₂ and the graphic component area 16) to determine which component the handwriting coordinate information corresponds to and select the component (step S104).

Various methods can be adopted for the selection of the constituent elements performed in step S104. For example, a method that selects a component that has an area that includes the starting point of handwriting coordinates, a method that selects a component that has an area that intersects the line segment that is composed of handwriting coordinates for the longest, or the minimum that surrounds the handwriting coordinates. There is a method of selecting a component having a region that most widely intersects the rectangular region of. It is free to select one component most suitable for the handwriting coordinate information input from each component by a method other than this.

Step S103 or step S10
When the component is selected by the method of 4, the handwriting coordinate information currently input is distributed to the selected component (step S105). When the handwriting coordinate information is distributed, the function selected by the component function processing means 25 executes the corresponding function processing (step S10).
6). That is, for example, an operation of adding text information to already displayed text information or adding new graphic information to graphic information is performed.

FIG. 4 concretely shows a flow for executing the corresponding functional processing. C shown in FIG.
The PU 61 executes step S103 or step S10.
4, it is checked whether or not the text component is selected (step S201), and if so (Y), the handwriting coordinate information is processed using the text editing function processing means 46 shown in FIG. 1 (step S201). S202). When it is determined that the text component is not selected (N), it is checked whether the graphic component is selected (step S203). If it is determined that the graphic component is selected (Y), the handwriting coordinate information is processed using the graphic editing function processing means 47 shown in FIG. 1 (step S204).

If neither a text component nor a graphic component has been selected (step S203; N), it is checked whether a table component has been selected (step S205). If it is determined that the table constituent element is selected (Y), the table editing function processing means 48 shown in FIG.
Is used to process handwriting coordinate information (step S2).
06). If the table editing function processing means 48 is not selected either (step S205; N), it means that the container component is selected. Therefore, in this case, the handwriting coordinate information is processed using the container function processing means 49 (step S207).

As described above, the component function processing means 2
When the process of 5 is performed, the process proceeds to step S107 of FIG. 3, and the processed component area is updated.

FIGS. 5 to 7 show a first example of the editing operation of the composite document by the above handwriting input. Of these, FIG. 5 shows a compound document before editing. The composite document 71 has a container component 72, in which a text component 73, a table component 74 and a graphic component 75 are embedded. In this first example,
No active component is specified.

FIG. 6 shows a state in which handwriting input is performed in a predetermined area by using the handwriting coordinate input means 22 shown in FIG. 1 or 2. Here, the hiragana "Ai" is input by handwriting. Since the active component is not designated, the end of input is detected and at the same time, the component is selected in step S104 (FIG. 3). That is, the component selection means 30 compares the handwriting coordinate information 77 input by handwriting with the respective regions of the existing text component 73, table component 74, and graphic component 75. Then, in this case, the component of the region that intersects the line segment constituted by the handwriting coordinates for the longest time is examined, and it is determined that the input is handwriting input to the text component 73, and is selected as the component.

FIG. 7 shows handwriting coordinate information 7 by handwriting input.
7 represents the state passed to the text component 73. In this case, step S20 in FIG.
Process 2 is performed. That is, text recognition is performed on the handwriting coordinate information using the text editing function processing means 46 shown in FIG. 1, and the handwritten character is recognized as “a”, and this is displayed as the text information 79 on the text component 73. Has been entered in the area.

FIG. 8 shows the processing contents of the compound document when the container component is the active component. When the container component is the active component, the handwriting coordinate information 77 by handwriting input shown in FIG. 6 is passed to the container component 72 in step S103 of FIG. The container component 72 performs text recognition, graphic recognition, and table recognition on the handwriting coordinate information 77. Then, when it is determined that the result of the text recognition has the highest accuracy as a result, a text component 81 is newly created as shown in FIG. And
This is the initial text information for the text component 81, and this is the handwriting coordinate information 7 by handwriting input in FIG.
Embed at the position where 7 was performed.

FIG. 9 shows a state in which new handwriting input is performed from the state shown in FIG. The handwriting coordinate information 82 is isolated from any of the text component 73, the table component 74, and the graphic component 75. Therefore, the handwriting coordinate information 82 is passed to the container function processing means 49 shown in FIG. Container function processing means 49
As described in FIG. 8, the handwriting coordinate information 82 is subjected to text recognition, figure recognition and table recognition. Then, as a result, it is assumed that the result of table recognition is determined to have the highest accuracy.

FIG. 10 shows the result of processing in this case in which it is determined that the result of table recognition is the most accurate. The container function processing means 49 uses the table component 8
3 is newly created. Then, this is embedded at the position where the handwriting coordinate information 82 by handwriting input in FIG. 9 is performed.

In the compound document processing apparatus according to the above-described embodiment, an example in which the handwriting coordinate information is classified into a text constituent element, a table constituent element, and a graphic constituent element is shown. However, it is processed by different processing procedures. Of course, other components classified as may be used.

[0051]

As described above, according to the invention described in claim 1, in the invention described in claim 1, when the handwriting input is performed by the handwriting coordinate information input means, it is managed by the compound document management means. It is designed to select which one of the constituent elements is to be input in relation to the input position of the handwriting coordinate information and the area to which each constituent element belongs, and the handwriting coordinates input by handwriting to the selected constituent element. Information is distributed, and the distributed handwriting coordinate information is converted into information having the same information system as the information system representing characters, figures, tables, etc. of the already input code information of the constituent elements.
As a result, even if the user does not specify the attribution destination of the input handwriting coordinate information, it is possible to select the attribution destination according to the positional relationship with the existing component and convert it into information of the corresponding information system. it can.

According to the second aspect of the invention, since the active component designating means is arranged, the input destination of the handwriting coordinate information can be determined according to the intention of the user. Therefore, there is an advantage that the input operation can be performed without paying much attention to the input position of the handwriting coordinate information by the handwriting input, or even with respect to the handwriting coordinate information whose input position cannot be specified.

Further, according to the invention of claim 3, the handwriting coordinate information input from the handwriting coordinate information inputting means is managed by the compound document managing means in a state where the active component specifying means does not specify. The user selects the component to which the handwriting coordinate information is input according to the relationship between the input position of the handwriting coordinate information and the area to which each component belongs, and the handwriting coordinate information is distributed. There is an advantage that the designated mode of distribution destination can be switched, which is convenient for actual operation.

According to the invention described in claim 5, when the handwriting coordinate information is distributed when the active constituent element is designated, a new constituent element is created according to the recognition result, and this is embedded in the compound document. Therefore, a new component can be embedded in the compound document regardless of the current arrangement of the components.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a functional configuration of a compound document processing device according to an embodiment of the present invention.

FIG. 2 is a block diagram showing an outline of a circuit configuration of a compound document processing device.

FIG. 3 is a flowchart showing an outline of a processing flow of the compound document processing apparatus of the present embodiment.

FIG. 4 is a flowchart specifically showing step S106 of FIG.

FIG. 5 is a plan view showing an example of a compound document before being edited in this embodiment.

FIG. 6 is a plan view of a compound document showing a state in which handwriting input is performed in a predetermined area using the handwriting coordinate input means in this embodiment.

7 is a plan view showing a state in which the handwriting coordinate information of the handwriting input shown in FIG. 6 is passed to a predetermined component and converted.

FIG. 8 is a plan view showing processing contents of a compound document when a container component is an active component.

9 is a plan view of a compound document showing a state in which new handwriting input is performed from the state shown in FIG.

FIG. 10 is a plan view of a compound document showing the result of processing in this case in which it is determined that the result of table recognition is the most accurate for the input of FIG.

FIG. 11 is a plan view showing an example of a compound document.

[Explanation of symbols]

 21 Input / Display Integrated Device 22 Handwriting Coordinate Input Means 23 Display Means 24 Composite Document Management Means 26 Handwriting Coordinate Information Recognition Means 27, 71 Composite Documents 28 Component Area Management Means 29 Active Component Management Means 30 Component Selection Means 31 Handwriting Coordinates Information distribution means 41, 72 Container constituent elements 42, 73 Text constituent elements 43, 75 Graphic constituent elements 44, 74 Table constituent elements 51 Text recognition means 52 Graphic recognition means 53 Table recognition means 61 CPU 63 Working memory 65 Hard disk

Claims (5)

[Claims] 1. A handwriting coordinate information input means for inputting handwriting coordinate information in which handwriting input by handwriting is expressed by coordinates, and a component classified as a document to be processed by different processing steps from each area. A compound document management unit that manages a compound document that is differently compounded, and the handwriting coordinate information input from the handwriting coordinate information input unit is for any of the components managed by the compound document management unit. A constituent element selecting means for selecting whether or not there is a relationship between the input position of the handwriting coordinate information and the area to which each of the constituent elements belongs, and the handwriting coordinate information in the area where the constituent element selected by the constituent element selecting means exists. Handwriting coordinate information distributing means for distributing the handwriting coordinate information input from the input means, and handwriting distributed by the handwriting coordinate information distributing means Compound document processing apparatus characterized by comprising information conversion means for converting the target information to the information of the information system the same information system and the already input of the component. 2. A handwriting coordinate information input means for inputting handwriting coordinate information in which handwriting input by handwriting is expressed in coordinates, and a component classified as a document to be processed by different processing procedures from each area. A compound document management unit that manages a compound document that is differently compounded, and one of the components managed by the compound document management unit is used as handwriting coordinate information input from the handwriting coordinate information input unit. Active constituent element designating means for preferentially designating as the corresponding active constituent element, and when the active constituent element designating means designates the active constituent element, the handwriting coordinate information input means inputs the area where the active constituent element exists. Handwriting coordinate information distributing means for distributing handwriting coordinate information, and distribution by the handwriting coordinate information distributing means Compound document processing apparatus characterized by comprising information conversion means for converting the information of the information system the same information system and the already input the active components of the handwriting coordinate information. 3. A handwriting coordinate information input means for inputting handwriting coordinate information in which handwriting input by handwriting is expressed in coordinates, and a constituent element classified as a document to be processed by different processing steps from each area. A compound document management unit that manages a compound document that is differently compounded, and one of the components managed by the compound document management unit is used as handwriting coordinate information input from the handwriting coordinate information input unit. Active constituent element designating means for preferentially designating as the corresponding active constituent element, and when the active constituent element designating means designates the active constituent element, the handwriting coordinate information input means inputs the area where the active constituent element exists. While handwriting coordinate information is distributed, this active component designation means designates the active component If not, it is determined whether the handwriting coordinate information input from the handwriting coordinate information input means corresponds to each of the constituent elements managed by the compound document management means and the input position of the handwriting coordinate information and each of the configurations. Handwriting coordinate information distribution means for selecting and distributing the handwriting coordinate information in relation to the area to which the element belongs, and the handwriting coordinate information distributed by this handwriting coordinate information distribution means is the same as the already input information system of the active component. And an information conversion means for converting the information of the information system of FIG. 4. The constituent element selecting means overlaps an input position of the handwriting coordinate information input from the handwriting coordinate information input means and an area where each constituent element managed by the compound document managing means exists. 2. The compound document processing apparatus according to claim 1, wherein the components are compared with each other and the component having the maximum value is selected. 5. The handwriting coordinate information distributing means comprises a new constituent element creating means for creating a new constituent element according to the recognition result when the handwriting coordinate information is distributed and embedding the constituent element in the compound document. The compound document processing device according to claim 2 or 3.