JP2008243077A - Structured document management device, method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a structured document management device, a method for it, and a system for it for managing a structured document for efficiently transmitting/receiving a structured document between structured document management devices performing distributed management of a plurality of structured documents. <P>SOLUTION: Based on a structure index, in which a unique structure ID is allocated to for each of tag structures of respective elements constituting the structured document, and a vocabulary index, in which a unique vocabulary ID is allocated to each of vocabularies constituting a character string of each of elements of the structured document, the structured document is transformed into an array of the structure ID and the vocabulary ID and transmitted as coded data to another structured document management device. When receiving the coded data from another structured document management device, the coded data are restored to a structured document based on the structure index and the vocabulary index. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a structured document management apparatus, method, and system for managing a plurality of structured documents in a distributed manner.

  In query processing in a distributed database, intermediate data may have to be transferred between nodes in order to perform a join operation, and the time required for data transfer is a factor in processing delay. In the case of a distributed relational database (RDB), the key (foreign key) used in the join operation is determined in advance, and the field size is determined at the time of table creation even if it is not a key value, so it is transferred between nodes. The amount of data is small compared to a distributed database, and the time required for data transfer processing is also short.

  On the other hand, in the distributed XML database, the value corresponding to the foreign key in RDB such as which element value is used for the join operation is not defined, and the maximum length of the character string held for each element is also defined. Absent. Therefore, when a large character string is transferred between nodes in large quantities for the joining process, there is a problem that a long time is required for the data transfer process. In addition, a structured document generally includes a large number of character strings of indefinite length, so that the transfer process takes a relatively long time, and shortening the transfer process time is an issue.

  Incidentally, in the field of distributed databases, it is common practice to reduce the amount of data to be transferred and reduce the time required for transfer processing by compressing the data to be transferred between nodes. Also in the field of XML databases, a technique has been proposed in which the structured document to be transferred or a part thereof is compressed to reduce the amount of transferred data, thereby solving the problems related to the transfer process. For example, in Patent Document 1, a tag is separated from a character string stream composed of a document including a tag, a tag code is arranged for identification at the position of the character string stream from which the tag is separated, and then the character string A technique for encoding and outputting a stream is disclosed.

JP 2000-101442 A

  However, since the technique of Patent Document 1 supports all vocabularies, it is necessary to store a dictionary in which approximately 130,000 words are registered in advance regardless of the vocabulary included in the structured document to be transferred. There is a problem that the amount of data related to the digitization process increases. In addition, when data is compressed by a lexicographic encoding method as in the technique of Patent Document 1, the amount of data to be transferred can be reduced, so that the time required for transfer can be shortened, but a corresponding word is searched from the dictionary. Since processing takes time, as a result, time is required for compression / decompression. Therefore, if the network that performs the transmission is relatively fast, the processing time when combining compression, transfer, and decompression may be equivalent to the processing time when transferring without compression, The transfer time may not improve.

  The present invention has been made in view of the above, and is a structured document capable of efficiently transmitting and receiving structured documents between structured document management apparatuses that manage a plurality of structured documents in a distributed manner. An object is to provide a management apparatus, method, and system.

  In order to solve the above-described problems and achieve the object, the present invention distributes and stores a plurality of structured documents together with other structured document management apparatuses connected on the network, and the other structured documents. A unique structure ID for each type of tag structure of each element constituting the structured document shared with the management apparatus, and a unique vocabulary for each vocabulary included in each element constituting the structured document In a structured document management apparatus for managing the plurality of structured documents based on an ID, structured document storage means for storing the structured document, and structured documents stored in the structured document storage means A structure index storage means for storing a structure index in which a tag structure of each constituent element and a structure ID unique to each tag structure type are associated; and a structure stored in the structured document storage means Contained in each element of the document Vocabulary index storage means for storing a vocabulary index in which each vocabulary constituting a character string portion and the vocabulary ID unique to each vocabulary type are associated, and the structure index based on the structure index and the vocabulary index. Encoding means for generating encoded data obtained by converting the structured document stored in the structured document storage means into an array of the structure ID and the vocabulary ID, and transmitting the encoded data to the other structured document management apparatus; and the other structure When receiving encoded data from the structured document management apparatus, a restoration unit restores the coded data into a structured document based on the structure index and the vocabulary index.

  In addition, the present invention provides a structure in which a plurality of structured documents are distributed and stored together with other structured document management apparatuses connected on a network, and is shared with the other structured document management apparatuses. The plurality of structured documents based on a unique structure ID for each tag structure type of each element constituting the structured document and a unique vocabulary ID for each vocabulary included in each element constituting the structured document Structured document management method of a structured document management device for managing the tag structure of each element constituting the structured document stored in its own structured document management device, and specific to each tag structure type A structure index that stores a structure index that associates the structure IDs with each other, and each vocabulary that constitutes a character string portion included in each element of the structured document stored in its own structured document management device; Vocabulary unique to each vocabulary type Based on the vocabulary index that associates D with D, the encoded data obtained by converting the structured document stored in its own structured document management device into the structure ID and the vocabulary ID array is generated, and the other structure is generated. An encoding process to be transmitted to the structured document management apparatus, and when the encoded data is received from the other structured document management apparatus, the encoded data is restored to the structured document based on the structure index and the vocabulary index. And a restoring step.

  According to the present invention, the structured document is distributed between a plurality of structured document management apparatuses connected on a network and stored in a shared manner, and the structured document is shared among the plurality of structured document management apparatuses. The plurality of structured documents are managed based on a unique structure ID for each type of tag structure of each element constituting the vocabulary and a unique vocabulary ID for each vocabulary included in each element constituting the structured document. In the structured document management system, the structured document management device includes a structured document storage unit that stores the structured document, and a tag of each element constituting the structured document stored in the structured document storage unit Included in each element of the structured document stored in the structured index storage means for storing the structure index that associates the structure and the structure ID unique to each type of the tag structure, and the structured document storage means String part Vocabulary index storage means for storing a vocabulary index that associates each vocabulary constituting each vocabulary and the vocabulary ID unique to each vocabulary type, and the structured document storage based on the structure index and the vocabulary index. Encoding means for generating encoded data obtained by converting the structured document stored in the means into an array of the structure ID and vocabulary ID, and transmitting the encoded data to another structured document management apparatus; and the other structured document management apparatus And a restoring means for restoring the coded data into a structured document based on the structure index and the vocabulary index when the coded data is received from.

  According to the present invention, a structured document is encoded using a structure ID and a vocabulary ID corresponding to a tag structure and a vocabulary actually included in the structured document, and this encoded data is transferred to another structured document management apparatus. Therefore, compared with the case where the original structured document is transferred as it is, the amount of transfer data can be reduced and the time required for transfer can be shortened. In addition, since it is possible to reduce the amount of data required for the encoding process compared to the case of storing a dictionary in which various words are registered in advance, the time required for encoding and restoring a structured document can be reduced. It is possible to efficiently send and receive structured documents.

  Exemplary embodiments of a structured document management apparatus, method, and system will be described below in detail with reference to the accompanying drawings.

[First Embodiment]
FIG. 1 is a block diagram showing the configuration of the structured document management system 10 of this embodiment. As shown in FIG. 1, the structured document management system 10 includes a plurality of structured document management apparatuses 11 to 14 and a client apparatus 40, and each apparatus is connected to be communicable with each other via a network N. Yes. Note that the number of structured document management devices and client devices 40 connected to the network N is not limited to the illustrated example.

  Each of the structured document management apparatuses 11 to 14 has a structured document DB 31 (see FIG. 2) for storing and managing a structured document described in a markup language such as XML (eXtensible Markup Language). The structured document management apparatuses 11 to 14 realize the function as the structured document management system 10 for managing structured documents in a distributed manner. Hereinafter, each of the structured document management apparatuses 11 to 14 constituting the structured document management system 10 is also simply referred to as a node.

  In response to a search request input from the client device 40 through the network N, the structured document management system 10 searches for a corresponding structured document from the structured document DB 31 provided in the structured document management system 10, and as a search result. The structured document is provided to the client device 40. In addition, the structured document management system 10 responds to a structured document registration request input from the client device 40 through the network N, and the structured document to be registered in the structured document DB 31 included in the structured document management system 10. Register.

  The client device 40 is a terminal device such as a PC (Personal Computer) operated by a user. The user makes a search request for requesting a search for a structured document including a specific character string or a registration request for requesting a new registration of a structured document to the structured document management system 10 via the client device 40. It is possible to send. Here, it is assumed that the search request transmitted from the client device 40 includes a predetermined search expression related to the search such as XQuery. In addition, it is assumed that the registration request includes a structured document to be registered.

  Here, it is assumed that the search request or registration request transmitted from the client device 40 is received by any one of the four nodes constituting the structured document management system 10. Note that one node that receives a request from a client may be limited to a specific node, or each node may receive it sequentially in a round robin manner. Further, in consideration of the load of each node, the node with the smallest load may receive the request from the client device 40.

  In this embodiment, each node can receive a request from the client device 40. However, the present invention is not limited to this, and a request receiving device specialized for receiving a request from the client device 40 (not shown). ) May be provided separately.

  Hereinafter, the configuration of the structured document management apparatus 11 will be described. In the present embodiment, for simplicity of explanation, each of the structured document management apparatuses 11 to 14 has the same configuration, and the description of the configuration of the structured document management apparatuses 12 to 14 is omitted.

  FIG. 2 is a block diagram showing a hardware configuration of the structured document management apparatus 11. As shown in FIG. 2, the structured document management apparatus 11 includes a CPU (Central Processing Unit) 101, an operation unit 102, a display unit 103, a ROM (Read Only Memory) 104, a RAM (Random Access Memory) 105, and a communication unit. 106, a storage unit 107, and the like, and each unit is connected by a bus 108.

  The CPU 101 uses the predetermined area of the RAM 105 as a work area, executes various processes in cooperation with various control programs stored in advance in the ROM 104 or the storage unit 107, and controls the operation of each unit constituting the structured document management apparatus 11. Control.

  In addition, the CPU 101 cooperates with a predetermined program stored in advance in the ROM 104 or the storage unit 107, a request reception unit 20, a communication processing unit 21, a search plan generation unit 22, a search plan processing unit 23, and a structuring described later. The functional units of the document conversion unit 24, the structured document acquisition unit 26, the storage processing unit 27, the structure index unit 28, the vocabulary index unit 29, and the structured document DB management unit 30 (see FIG. 4) are realized. Details of each functional unit will be described later.

  The operation unit 102 includes various input keys, receives information input from the user as an instruction signal, and outputs the instruction signal to the CPU 101.

  The display unit 103 includes a display unit such as an LCD (Liquid Crystal Display), and displays various types of information based on a display signal from the CPU 101. The display unit 103 may be configured to form a touch panel integrally with the operation unit 102.

  The ROM 104 stores a program for controlling the structured document management apparatus 11 and various setting information in a non-rewritable manner.

  The RAM 105 is a volatile storage unit such as an SDRAM, functions as a work area for the CPU 101, and functions as a buffer.

  The communication unit 106 is an interface that communicates with other nodes and the client device 40 through the network N. The communication unit 106 outputs various types of information transmitted from other nodes and client devices 40 to the CPU 101, and transmits various types of information output from the CPU 101 to other nodes and client devices 40.

  The storage unit 107 includes a storage medium that can be magnetically or optically recorded, and stores a program, various setting information, and the like related to the control of the structured document management apparatus 11 in a rewritable manner. The storage unit 107 has a storage area for storing a structured document DB 31 as a database for storing structured documents, structure-structure ID correspondence data 32, and vocabulary-vocabulary ID correspondence data 33 described later. Yes. In the present embodiment, the structured document DB 31, the structure-structure ID correspondence data 32, and the vocabulary-vocabulary ID correspondence data 33 are held by one storage unit. However, the present invention is not limited to this. It is good also as an aspect hold | maintained in a respectively different memory | storage means. In this case, the position where the storage unit is provided may be inside or outside the structured document management apparatus 11.

  Here, the description format of the structured document handled in this embodiment will be described. FIG. 3 is a diagram showing an example of a structured document described in XML. In the figure, an example of a structured document in which information related to a patent is described in an XML format is shown. In XML, tags are used to represent the structure of a document. A tag has a start tag and an end tag. By enclosing the components of a structured document with a start tag and an end tag, the delimiter of the character string in the document and the character string can be assigned to any component in the structure. It is possible to clearly describe whether it belongs.

  Here, the start tag is described in a format in which the element name is closed with symbols “<” and “>”, and the end tag is described in a format in which the element name is closed with symbols “</” and “>”. . In XML, data defined by a series of start tags and end tags means one element. For example, it includes a <patent> tag and a </ patent> tag, and is surrounded by both tags. Data constitutes one element.

  FIG. 4 is a block diagram showing a functional configuration of the structured document management apparatus 11. As shown in FIG. 3, the structured document management apparatus 11 includes a request receiving unit 20, a communication processing unit 21, a search plan generation unit 22, a search plan processing unit 23, a structured document conversion unit 24, a dictionary 25, and a structuring. A document acquisition unit 26, a storage processing unit 27, a structure index unit 28, a vocabulary index unit 29, and a structured document DB management unit 30 are provided.

  The request reception unit 20 is a functional unit that receives various requests from other nodes and the client device 40 received via the communication unit 106. The request received by the request receiving unit 20 includes a search request and a registration request transmitted from the client device 40, an execution request transmitted from another node, and the like.

  The communication processing unit 21 transmits a search result for the search request, a processing result described later, and the like to other nodes and the client device 40 via the communication unit 106.

  The search plan generation unit 22 parses the search expression included in the search request received by the request reception unit 20 and generates a plan (search process execution plan) that minimizes the processing cost.

  The search plan processing unit 23 executes the execution plan according to the plan generated by the search plan generation unit 22 and uses the structured document finally acquired from the structured document DB 31 via the structured document acquisition unit 26 as a search result. And transmitted to the client device 40 via the communication processing unit 21.

  The structured document conversion unit 24 encodes the structured document based on the structure index 321 registered in the structure-structure ID correspondence data 32 and the vocabulary index 331 registered in the vocabulary-vocabulary ID correspondence data 33 described later. Reconstruct the encoded structured document.

  Further, the structured document conversion unit 24 reduces the data amount of the encoded data by performing compression processing on the encoded data in a predetermined compression format, and performs compression processing on the encoded data input from another node. If it is determined that it has been applied, this compression is decompressed. The compression format is not particularly limited. For example, a ZIP format, an LZH format, or the like can be used.

  In the dictionary 25, predetermined rules for determining a storage destination node in which a structured document is registered are defined in advance. When a new structured document is registered in the structured document management system 10, this rule is stored. Based on the rules defined in the dictionary 25, the storage processing unit 27 determines the storage destination node. The determined storage destination node is associated with the structured document to be registered by the storage processing unit 27 and registered in the dictionary 25 as storage destination information. Further, when reading the already registered structured document, the node storing the structured document is specified based on the storage location information.

  It is assumed that the rules defined in the dictionary 25 are stored in advance in the ROM 104 or the storage unit 107. The storage location information registered in the dictionary 25 is assumed to be stored in a predetermined storage area of the storage unit 107.

  The structured document acquisition unit 26 acquires the structured document instructed by the search plan processing unit 23 from the structured document DB 31 via the structured document DB management unit 30.

  The storage processing unit 27 determines the storage destination node of the structured document included in the registration request input from the client device 40 via the request reception unit 20 based on the rules defined in the dictionary 25, and this storage destination The structured document DB management unit 30 of the node registers the structured document to be registered.

  The storage processing unit 27 includes a document analysis unit 271, a structure analysis unit 272, and a vocabulary analysis unit 273 as illustrated in FIG. The document analysis unit 271 is an XML parser or the like, and analyzes the structure of the input structured document. Specifically, when the input structured document is an XML document as shown in FIG. 3, the document analysis unit 271 determines that the structured document is an XML document such as a correspondence between a start tag and an end tag. Check if the notation is followed. In this analysis process, after confirming that the structured document conforms to the notation, the structured document is output to the structure analyzing unit 272 and the vocabulary analyzing unit 273.

  The structure analysis unit 272 analyzes the tag structure indicating the structure position of the tag included in the structured document input from the document analysis unit 271 for each element, assigns a unique structure ID for each type of tag structure, and Information associating the structure with the structure ID is generated as the structure index 321. Here, the element means a start tag, an end tag, and a character string portion surrounded by the two tags. Moreover, it is preferable that the structure ID to be assigned has a format suitable for compression such as numerical values.

  In addition, the structure analysis unit 272 refers to the existing structure index registered in the structure-structure ID correspondence data 32 at the time of generating the structure index 321 described above, and performs control so that structure IDs are not assigned to overlapping items. .

  In addition, the structure analysis unit 272 outputs the generated structure index 321 to the structure index unit 28 so that the structure analysis unit 272 registers the structure index 321 in its own structure-structure ID correspondence data 32 and transmits it to other nodes via the communication processing unit 21. The generated structure index 321 is made common in the structured document management system 10 by registering it in the structure-structure ID correspondence data 32 of other nodes. In addition, when the structure analysis unit 272 receives the structure index 321 from another node via the request reception unit 20, the structure analysis unit 272 outputs the structure index 321 to the structure index unit 28, whereby the structure-structure ID correspondence data 32 is output. To register.

  5A and 5B are diagrams for explaining the operation of the structure analysis unit 272. First, as a result of analyzing the structured document by the structure analysis unit 272, it is assumed that the tag structure for each element is in the state shown in FIG. In this case, as shown in FIG. 5B, the structure analysis unit 272 generates a structure index 321 to which a unique structure ID is assigned for each type of tag structure. In the figure, “text ()” indicates the position of the character string portion of this element.

  Returning to FIG. 4, the vocabulary analysis unit 273 analyzes the character string portion included in the structured document input from the document analysis unit 271 for each element, and divides each character string portion into vocabulary units having a predetermined number of characters. A unique vocabulary ID is assigned to each divided vocabulary, and information that associates the vocabulary with the vocabulary ID is generated as the vocabulary index 331. Here, the character string portion means a character string portion surrounded by a start tag and an end tag. The assigned vocabulary ID is preferably in a format suitable for compression such as numerical values.

  In addition, the vocabulary analysis unit 273 refers to the existing vocabulary index registered in the vocabulary-vocabulary ID correspondence data 33 when generating the vocabulary index 331, and performs control so that lexical IDs are not assigned to overlapping items. .

  Further, the vocabulary analysis unit 273 outputs the generated vocabulary index 331 to the vocabulary index unit 29 to register it in its own vocabulary-vocabulary ID correspondence data 33 and transmits it to other nodes via the communication processing unit 21. The registered vocabulary index 331 is made common in the structured document management system 10 by registering it in the vocabulary-vocabulary ID correspondence data 33 of other nodes. In addition, when the vocabulary analysis unit 273 receives the vocabulary index 331 from another node via the request reception unit 20, the vocabulary index 331 is output to the vocabulary index unit 29 to output the vocabulary-vocabulary ID correspondence data 33. To register.

  FIG. 6 is a diagram for explaining the operation of the vocabulary analysis unit 273. First, as a result of the analysis of the structured document by the vocabulary analysis unit 273, as shown in the left diagram of FIG. 6, a single character string “parallel search device” included in the structured document is extracted as a character string portion. Shall. In this case, the vocabulary analyzing unit 273 divides the character string “parallel search device” into vocabulary units composed of two characters, as shown in FIG. Since the character string divided last is a “place” for one character, the vocabulary index unit 29 adds “#” to the end. Next, the vocabulary analysis unit 273 assigns a unique vocabulary ID to each divided vocabulary, and generates information that associates the vocabulary with the vocabulary ID as the vocabulary index 331 as illustrated in the right diagram of FIG.

  The structure index unit 28 registers the structure index 321 input from the structure analysis unit 272 in the structure-structure ID correspondence data 32. The vocabulary index unit 29 registers the vocabulary index 331 input from the vocabulary analysis unit 273 in the vocabulary-vocabulary ID correspondence data 33.

  The structured document DB management unit 30 is a functional unit that manages the structured document DB 31. In response to an instruction from the structured document acquisition unit 26, the structured document DB 31 is read from the structured document DB 31 and stored. In response to an instruction from the unit 27, the structured document is registered in the structured document DB 31.

  Hereinafter, an operation when a registration request for requesting registration of a structured document is transmitted from the client device 40 to the structured document management system 10 will be described with reference to FIGS.

  FIG. 7 is a flowchart showing a procedure of a process (structured document registration process) related to registration of a structured document at a node (master node) that has received a registration request.

  First, when receiving a structured document instructed as a registration request from the client device 40, the request receiving unit 20 outputs the structured document to the storage processing unit 27 (step S11). Subsequently, the document analysis unit 271 of the storage processing unit 27 analyzes the input structured document (step S12), and outputs the analysis result to the structure analysis unit 272 and the vocabulary analysis unit 273, so that the process of step S13 is performed. The structure-structure ID data update process and the vocabulary-vocabulary ID data update process in step S14 are sequentially executed.

  Hereinafter, the structure-structure ID data update process in step S13 will be described with reference to FIG. FIG. 8 is a flowchart showing the procedure of the structure-structure ID data update process.

  First, the structure analysis unit 272 acquires, for each element, a tag structure indicating a tag structure position based on the structured document input from the document analysis unit 271 (step S131).

  Next, the structure analysis unit 272 refers to the structure-structure ID correspondence data 32 and determines whether the same tag structure as the tag structure acquired in step S131 is already registered in the structure-structure ID correspondence data 32. (Step S132). Here, if it is determined that all the acquired tag structures are already registered in the structure-structure ID correspondence data 32 (step S132; Yes), this process is terminated and the process immediately proceeds to step S14 in FIG. To do.

  On the other hand, if it is determined in step S132 that there is a tag structure not registered in the structure-structure ID correspondence data 32 (step S132; No), the structure analysis unit 272 determines that the tag structure is not registered. A unique structure ID is assigned (step S133), and a structure index 321 in which the tag structure is associated with the structure ID is generated (step S134).

  Subsequently, the structure analysis unit 272 outputs the generated structure index 321 to the structure index unit 28 so as to be registered in its own structure-structure ID correspondence data 32 (step S135), and via the communication processing unit 21. By transmitting to another node (slave node), the structure-structure ID correspondence data 32 of the other node is registered (step S136), and the process proceeds to step S14 in FIG.

  Next, the vocabulary-vocabulary ID data update processing in step S14 will be described with reference to FIG. FIG. 9 is a flowchart showing a vocabulary-vocabulary ID data update process.

  First, the vocabulary analysis unit 273 extracts a character string portion included in the structured document input from the document analysis unit 271 for each element (step S141), and divides each extracted character string for each predetermined number of characters. Vocabulary is acquired (step S142).

  Next, the vocabulary analysis unit 273 refers to the vocabulary-vocabulary ID correspondence data 33 and determines whether or not the vocabulary similar to each vocabulary acquired in step S142 is already registered in the vocabulary-vocabulary ID correspondence data 33. (Step S143). Here, if the vocabulary index unit 29 determines that all the acquired vocabularies are already registered in the vocabulary-vocabulary ID correspondence data 33 (step S143; Yes), the process ends and the step of FIG. Immediately move to S15.

  On the other hand, if it is determined in step S143 that there is a vocabulary that is not registered in the vocabulary-vocabulary ID correspondence data 33 (step S143; No), the vocabulary index unit 29 determines that the vocabulary determined not to be registered. A unique vocabulary ID is assigned (step S144), and a vocabulary index 331 that associates the vocabulary with the vocabulary ID is generated (step S145).

  Subsequently, the vocabulary index unit 29 outputs the generated structure index 321 to the vocabulary index unit 29 so as to be registered in its own vocabulary-vocabulary ID correspondence data 33 (step S146) and through the communication processing unit 21. By transmitting to another node (slave node), it is registered in the vocabulary-vocabulary ID correspondence data 33 of the other node (step S147), and the process proceeds to step S15 in FIG.

  Returning to FIG. 7, the storage processing unit 27 refers to the dictionary 25, determines the storage destination node of the structured document to be registered (step S <b> 15), and determines whether or not this storage destination node is its own node. (Step S16).

  If it is determined in step S16 that the storage destination node is its own node (step S16; Yes), the structured document to be registered is registered in the structured document DB 31 of its own node (step S17). The process proceeds to step S19.

  On the other hand, when it is determined in step S16 that the storage destination node is another node (step S16; No), the storage processing unit 27 stores the structured document to be registered via the communication processing unit 21. By transmitting (transferring) to the destination node, it is registered in the structured document DB 31 of the storage destination node (step S18), and the process proceeds to step S19.

  In subsequent step S19, the storage processing unit 27 registers storage destination information in which the structured document to be registered and the storage destination node of the structured document are associated with each other in the dictionary 25 (step S19). This storage location information is transmitted to another node (slave node) via the communication processing unit 21 to be registered in the dictionary 25 of the other node (step S20), and this process is terminated.

  FIG. 10 is a flowchart showing a procedure of processing (registration processing on the other node side) related to registration of various information on the node side (slave node) that receives various information transmitted from the master node. It is assumed that this process is always performed or according to an instruction signal transmitted from the master node.

  First, the storage processing unit 27 (structure analysis unit 272) determines whether or not the structure index 321 has been received from the master node via the request reception unit 20 (step S21). Here, when the storage processing unit 27 determines that the structure index 321 has not been received (step S21; No), the storage processing unit 27 immediately proceeds to the process of step S23.

  On the other hand, when it is determined in step S21 that the structure index 321 has been received from the master node (step S21; Yes), the structure analysis unit 272 outputs the structure index 321 to the structure index unit 28, so -After being registered in the structure ID correspondence data 32 (step S22), the process proceeds to step S23.

  In subsequent step S23, the storage processing unit 27 (vocabulary analyzing unit 273) determines whether or not the vocabulary index 331 has been received from the master node via the request receiving unit 20 (step S23). If the storage processing unit 27 determines that the vocabulary index 331 has not been received (step S23; No), the storage processing unit 27 immediately proceeds to the process of step S25.

  On the other hand, when it is determined in step S23 that the vocabulary index 331 has been received from the master node (step S23; Yes), the vocabulary analysis unit 273 outputs the vocabulary index 331 to the vocabulary index unit 29, so that its own vocabulary is obtained. -After being registered in the vocabulary ID correspondence data 33 (step S24), the process proceeds to step S25.

  In subsequent step S25, the storage processing unit 27 determines whether or not a structured document to be registered has been transferred from the master node via the request receiving unit 20 (step S25). If the storage processing unit 27 determines that the structured document has not been received (step S25; No), the storage processing unit 27 immediately proceeds to the process of step S27.

  On the other hand, when it is determined in step S25 that the structured document to be registered is received from the master node (step S25; Yes), the storage processing unit 27 outputs the structured document to the structured document DB management unit 30. As a result, after being registered in the structured document DB 31 (step S26), the process proceeds to step S27.

  In subsequent step S27, the storage processing unit 27 determines whether or not the storage destination information is received from the master node via the request receiving unit 20 (step S27). Here, if the storage processing unit 27 determines that the storage location information has not been received (step S27; No), the process immediately ends.

  On the other hand, if it is determined in step S27 that the storage location information has been received from the master node (step S27; Yes), the storage processing unit 27 registers this storage location information in the dictionary 25 (step S28). This process ends.

  In this way, the tag structure and vocabulary included in the newly registered structured document can be used as common information among the nodes constituting the structured document management system 10, and the structure assigned to the tag structure The vocabulary ID assigned to the ID and vocabulary can be common information among the nodes constituting the structured document management system 10.

  In this embodiment, the structure index 321 and the vocabulary index 331 received from the master node are unconditionally registered in the structure-structure ID correspondence data 32 and the vocabulary-vocabulary ID correspondence data 33, respectively. It is not limited to this, and it is checked whether there is an overlapping index before registration, such as the structure-structure ID data update process (see FIG. 8) and the vocabulary-vocabulary ID data update process (see FIG. 9). It is good also as an aspect.

  In this embodiment, the structured document itself that is the registration target is transmitted to the storage node. However, the present invention is not limited to this, and the tag structure (structure ID) and vocabulary (vocabulary) included in the structured document are not limited thereto. After sharing the ID) between the nodes, it may be transmitted in the state of encoded data subjected to a structured document encoding process (see FIG. 12) described later. In this case, the original structured document can be restored by a structured document restoration process (see FIG. 14), which will be described later, and the transfer data amount is reduced as compared with the case of transferring the original structured document as it is, The time required for transfer can be reduced.

  Next, with reference to FIGS. 11 to 16, an operation when a search request for requesting a search for a structured document is input from the client device 40 will be described.

  FIG. 11 is a flowchart illustrating a procedure of a process (structured document search process) related to a search for a structured document at a node (master node) that has received a search request. First, when receiving a search request from the client device 40, the request receiving unit 20 outputs the search request to the search plan generating unit 22 (step S31). Subsequently, the search plan generation unit 22 generates a plan (search process execution plan) based on the search expression included in the input search request, and outputs the plan to the search plan processing unit 23 (step S32).

  Next, the search plan processing unit 23 refers to the dictionary 25 and determines whether or not the input plan includes a process related to the structured document DB 31 of another node (step S33). Here, when the search plan processing unit 23 determines that each execution plan included in the plan can be executed only with the structured document registered in the structured document DB 31 of its own node (step S33; No). Then, the execution plans instructed by the plan are sequentially executed (step S34), and the process proceeds to step S40.

  On the other hand, if it is determined in step S33 that a structured document stored in the structured document DB 31 of another node is necessary (step S33; Yes), the search plan processing unit 23 executes the execution plan indicated in the plan. Among them, after executing up to an execution plan relating to another node (step S35), the process proceeds to the structured document encoding process of step S36. Hereinafter, the structured document encoding process in step S36 will be described with reference to FIG.

  FIG. 12 is a flowchart showing the procedure of the structured document encoding process. First, the structured document conversion unit 24 sets one element included in the intermediate data (structured document) acquired in the process of step S35 as a processing target (step S361).

  Next, the structured document conversion unit 24 converts the tag structure of the processing target element into a structure ID based on the structure index registered in the structure-structure ID correspondence data 32 (step S362).

  Subsequently, the structured document conversion unit 24 converts the vocabulary constituting the character string included in the processing target element into the vocabulary ID based on the structure index registered in the vocabulary-vocabulary ID correspondence data 33, and An offset indicating the appearance position of the corresponding vocabulary is assigned to each vocabulary ID (step S363).

  Next, the structured document conversion unit 24 determines whether or not the processing in steps S362 and S363 has been performed on all elements included in the intermediate data, and determines that there are unprocessed elements. (Step S364; No), the process returns to Step S361 again, and unprocessed elements are processed, and then the processes of Steps S362 and S362 are performed.

  On the other hand, if it is determined in step S364 that all the elements have been processed in steps S362 and S363 (step S364; Yes), the converted data acquired for each element is combined and encoded data (Step S365).

  Next, the structured document conversion unit 24 determines whether or not to compress the encoded data (step S366). Here, it is assumed that the setting as to whether or not to perform compression processing is stored in advance in the storage unit 107 as setting information, and the structured document conversion unit 24 performs the determination in step S366 based on this setting information. Shall.

  If it is determined in step S366 that compression processing is not performed (step S366; No), the process immediately proceeds to step S37 in FIG. If it is determined in step S366 that compression processing is to be performed (step S366; Yes), the structured document conversion unit 24 performs compression processing on the encoded data in a predetermined compression format to obtain data. After the amount is decreased (step S367), the process proceeds to step S37 in FIG.

  Returning to FIG. 11, the search plan processing unit 23 executes an execution request including the encoded data acquired in step S <b> 36 and the plan generated in step S <b> 32 via the communication processing unit 21. To other nodes (slave nodes) necessary for the transmission (step S37).

  Hereinafter, with reference to FIG. 13, an operation related to the retrieval of the structured document in the node (slave node) that receives the execution request transmitted from the master node will be described. FIG. 13 is a flowchart showing a procedure of a process related to structured document search (another node side structured search process) executed in the slave node.

  On the slave node side, when the request reception unit 20 receives the execution request, the execution request is output to its own search plan processing unit 23 (step S51). Subsequently, the search plan processing unit 23 outputs the encoded data included in the execution request to the structured document conversion unit 24 (step S52), and shifts to the structured document restoration processing in step S53. Hereinafter, with reference to FIG. 14, the structured memorandum restoration process in step S53 will be described.

  FIG. 14 is a flowchart showing the procedure of the structured document restoration process. First, the search plan processing unit 23 determines whether or not compression processing has been performed on the encoded data based on the extension of the input encoded data and the data structure (step S531). If it is determined that the compression process has not been performed (step S531; No), the process immediately proceeds to step S533.

  If it is determined in step S531 that compression processing has been performed (step S531; Yes), the search plan processing unit 23 performs decompression processing on the encoded data (step S532), and then step The process shifts to S533.

  In subsequent step S533, the search plan processing unit 23 sets one element included in the encoded data as a processing target (step S533). Here, the element means one encoded tag structure (structure ID) and a character string portion (vocabulary group) of the tag structure.

  In step S533, the search plan processing unit 23 converts the structure ID included in the processing target element into a tag structure based on the structure index registered in the structure-structure ID correspondence data 32 (step S534).

  Subsequently, the search plan processing unit 23 converts each vocabulary ID included in the processing target element into a vocabulary based on the vocabulary index registered in the vocabulary-vocabulary ID correspondence data 33 and designates each vocabulary with an offset. The character string portion is restored based on the appearing position (step S535).

  Next, the structured document conversion unit 24 determines whether or not the processing of Step S534 and Step S535 has been performed on all elements included in the encoded data (Step S536). Here, when it is determined that there is an unprocessed element (step S536; No), the process returns to step S533 again, and after processing the unprocessed element, the processes of steps S534 and S535 are performed.

  If it is determined in step S536 that all the elements have been processed in steps S534 and S535 (step S536; Yes), the structured document conversion unit 24 performs steps S534 and S534 for all the elements. The original structured document is reconstructed from the processing result of step S535 (step S537), and the process proceeds to step S54 of FIG.

  Returning to FIG. 13, the search plan processing unit 23 uses the intermediate data (structured document) restored in the process of step S <b> 53, and the execution plan that can be processed in its own node among the execution plans instructed by the plan. The plan is executed (step S54), and the structured document obtained as a result is output to the search plan processing unit 23, thereby executing the structured document encoding process (step S55). Note that the structured document encoding process in step S55 is the same as the structured document encoding process in step S37 described above, and a description thereof will be omitted.

  Subsequently, the search plan processing unit 23 transmits the encoded data acquired in step S55 as a processing result to the master node that is the transmission source of the execution request via the communication processing unit 21 (step S56). Terminates processing on the node side.

  Returning to FIG. 11, on the master node side, when the request reception unit 20 receives the processing result from the slave node, the processing result is output to the structured document conversion unit 24 via the search plan processing unit 23 (step S38). .

  The structured document conversion unit 24 executes structured document restoration processing for restoring the encoded data input as the processing result, and restores intermediate data (structured document) from the encoded data (step S39). Here, the structured document composition processing in step S40 is the same as the structured document composition processing in step S53 described above, and a description thereof will be omitted.

  Subsequently, the search plan processing unit 23 executes the execution plan specified in the plan using the intermediate data restored in step S39 (step S40). This is not the case when the structured document received as the processing result is the final result of the execution plan instructed by the plan. When further processing is required in another node, the structured document received as the processing result or the structured document acquired based on the structured document is encoded by the structured document conversion unit 24 as intermediate data. After that, it transmits to the slave node.

  Next, the search plan processing unit 23 transmits the structured document obtained as the plan execution result as a search result to the client device 40 via the communication processing unit 21 (step S41), and ends this process.

  In this embodiment, the search result is transmitted in the state of the structured document. However, the present invention is not limited to this, and a mode in which the structured document is converted into encoded data may be used.

  FIGS. 15A, 15B, and 15C are diagrams for explaining the operation of the structured document conversion unit 24 when the structured document is searched. In the figure, a downward arrow indicates a flow of processing related to encoding of a structured document, and an upward arrow indicates a flow of processing related to restoration of the encoded structured document.

  First, the operation at the time of encoding a structured document will be described. It is assumed that the element “<name of invention> parallel search method and device </ name of invention>” of the structured document shown in the upper part of FIG. In this case, as shown in FIG. 15B, the structured document conversion unit 24 converts the tag structure “<name of invention>” of the processing target element into the structure index registered in the structure-structure ID correspondence data 32. Based on 321 (see FIG. 16A), the structure ID is converted to a structure ID “0007” corresponding to the tag structure.

  In addition, the structured document conversion unit 24 decomposes the character string “parallel search method and apparatus” included in the processing target element into a plurality of vocabularies as shown in the middle part of FIG. Based on the vocabulary index 331 (see FIG. 16-2) registered in the vocabulary ID correspondence data 33, each vocabulary is converted into a corresponding vocabulary ID, and an offset indicating the appearance position of each vocabulary is added to each vocabulary ID. To do.

  For example, as shown in FIG. 15C, the vocabulary “method” is assigned to the vocabulary ID “0101” corresponding to the vocabulary “method” based on the vocabulary index 331 registered in the vocabulary-vocabulary ID correspondence data 33. After the conversion, an offset “0” is added to the head part of this vocabulary ID. Here, the offset “0” means the distance between the end of the preceding vocabulary “search” and the own vocabulary “method”, and means that the vocabulary is continuously arranged without a space between characters. is doing.

  Next, as shown in the middle part of FIG. 15A, the structured document conversion unit 24 generates encoded data obtained by combining the converted structure ID and each vocabulary ID + offset, and performs compression processing according to the setting content. Apply.

  Next, the operation at the time of restoring the structured document will be described. Assume that the encoded data shown in the middle part of FIG. 15A is set as an element to be processed in step S533 described above. In this case, as shown in FIG. 15B, the structured document conversion unit 24 performs this processing mode element based on the structure index 321 (see FIG. 16A) registered in the structure-structure ID correspondence data 32. The structure ID included in is converted into a tag structure (inverse conversion).

  Further, as shown in FIG. 15C, the structured document conversion unit 24 is included in the processing target element based on the vocabulary index 331 (FIG. 16-2) registered in the vocabulary-vocabulary ID correspondence data 33. Each vocabulary ID is converted (reversely converted) into a corresponding vocabulary, and the vocabulary is arranged based on an offset added to each vocabulary ID, thereby reconstructing the original character string. When compressed encoded data is received, the tag structure and the character string are restored after performing this decompression process.

  Next, as shown in the upper part of FIG. 15A, the structured document conversion unit 24 combines the restored tag structure and the character string to restore the original structured document.

  As described above, according to the present embodiment, the structured document is encoded using the structure ID and the vocabulary ID corresponding to the tag structure and the vocabulary actually included in the structured document, and the encoded data is converted into other encoded data. Since it is used for transmission / reception with the structured document management apparatus, the amount of transfer data can be reduced and the time required for transfer can be shortened as compared with the case where the original structured document is transferred as it is. In addition, since it is possible to reduce the amount of data required for the encoding process compared to the case of storing a dictionary in which various words are registered in advance, the time required for encoding and restoring a structured document can be reduced. It is possible to efficiently send and receive structured documents.

  In addition, since the tag structure and the vocabulary are converted into the structure ID and the vocabulary ID suitable for the compression format, and can be transferred after being compressed, the structured document can be compressed more efficiently. The time required for transfer can be further reduced.

  In the present embodiment, the structure index 321 and the vocabulary index 331 are provided as indexes for the structured document DB 31. However, the present invention is not limited to this example. For example, the index may be provided as another index such as date information. Good.

[Second Embodiment]
Next, the structured document management system 10 according to the second embodiment will be described. In addition, about the structure similar to 1st Embodiment mentioned above, the same code | symbol is provided and the description is abbreviate | omitted.

  FIG. 17 is a block diagram showing a functional configuration of the structured document management apparatus 11 in the second embodiment. As shown in FIG. 17, the structured document management apparatus 11 of this embodiment newly includes a structure analysis unit 274 and a vocabulary analysis unit 275 in the storage processing unit 27.

  In addition to the functions of the structure analysis unit 272 described above, the structure analysis unit 274 counts the number of tag structures included in each input structured document for each type, and stores it in a predetermined area of the storage unit 107 as structure history information. accumulate. Further, the structure analysis unit 274 calculates the appearance frequency for each type of tag structure based on the structure history information, and reassigns the structure ID registered in the structure-structure ID correspondence data 32 according to the appearance frequency.

  Specifically, the structure analysis unit 274 reassigns the structure ID of the tag structure having a higher appearance frequency to a numerical value that increases the compression efficiency. For example, as the same numerical value such as “0001” or “1111” continuously appears, the compression efficiency tends to increase. Therefore, the structure analysis unit 274 reassigns the numerical value as a structure ID. Shall.

  In addition, the structure analysis unit 274 generates, as a structure ID reassignment request, information associating the numerical value reassigned to the structure ID and the tag structure corresponding to the structure ID when the structure ID is reassigned. By transmitting to another node via the unit 21, the structure ID registered in the structure-structure ID correspondence data 32 of the other node is reassigned.

  In addition, when the structure analysis unit 274 receives a structure ID reassignment request from another node via the request reception unit 20, the structure analysis unit 274 has a structure included in its own node based on the instruction content of the structure ID reassignment request. -Reassign the structure ID of the structure ID correspondence data 32.

  In addition to the function of the vocabulary analysis unit 273 described above, the vocabulary analysis unit 275 counts the number of vocabularies obtained by dividing the character string portion for each type, and stores the vocabulary history information in a predetermined area of the storage unit 107. Further, the vocabulary analysis unit 275 calculates the appearance frequency for each vocabulary type based on the vocabulary history information, and the numerical value of the vocabulary ID registered in the vocabulary-vocabulary ID correspondence data 33 is calculated according to the appearance frequency. Reassignment in the same manner as the structure analysis unit 274.

  Further, the vocabulary analysis unit 275 uses the communication processing unit 21 as a vocabulary ID reassignment request with information associating the numerical value reassigned to the vocabulary ID and the vocabulary corresponding to the vocabulary ID when the vocabulary ID is reallocated. The vocabulary ID registered in the vocabulary-vocabulary ID correspondence data 33 of the other node is reassigned.

  When the vocabulary analyzing unit 275 receives a vocabulary ID reassignment request from another node via the request accepting unit 20, the vocabulary included in its own node is based on the instruction content of the vocabulary ID reassignment request. -Reassign the vocabulary ID of the vocabulary ID correspondence data 33.

  Hereinafter, with reference to FIGS. 18 and 19, the operation of the structure analysis unit 274 of the present embodiment will be described. FIG. 18 is a flowchart showing a procedure of structure ID reassignment processing (structure ID reassignment processing) executed by a node (master node) that generates a structure ID reassignment request to be described later. Note that the timing at which the structure ID reassignment process is executed in the master node is not particularly limited. For example, the structure ID may be executed every predetermined time or every time the structure index 321 is registered.

  First, the structure analysis unit 274 calculates the appearance frequency for each tag structure based on the structure history information accumulated in the predetermined area of the storage unit 107 (step S61). Subsequently, the structure analysis unit 274 reassigns the structure ID of the tag structure registered in the structure-structure ID correspondence data 32 according to the calculated appearance frequency for each tag structure (step S62).

  Next, the structure analysis unit 274 generates, as a structure ID reassignment request, information associating the structure ID reassigned in step S62 with the tag structure corresponding to the structure ID (step S63). After transmitting the structure ID reassignment request to another node (slave node) via the communication processing unit 21 (step S64), this process is terminated.

  FIG. 19 is a flowchart showing the procedure of the process related to the structure ID reassignment (another node side structure ID reassignment process) executed by the node (slave node) that has received the structure ID reassignment request.

  On the slave node side, when the request reception unit 20 receives the ID reassignment request, the structure ID reassignment request is output to the structure analysis unit 274 (step S71).

  Subsequently, the structure analysis unit 274, based on the information in which the structure ID input as the structure ID reassignment request and the tag structure corresponding to the structure ID are associated with each other, in the structure-structure ID correspondence data 32 The structure ID of the tag structure to be changed is changed to the instructed value (step S72), and this process ends.

  Note that the operation of the vocabulary analysis unit 275 is the same as that of the structure analysis unit 274 described above, and is only performed on the vocabulary ID (vocabulary-vocabulary ID correspondence data 33).

  As described above, according to this embodiment, a numerical value with higher compression efficiency can be assigned to a structure ID and / or vocabulary vocabulary ID of a tag structure having a high appearance frequency. The amount of data can be further reduced, and the time required for data transfer between nodes can be shortened.

  In the present embodiment, the structure ID and the vocabulary ID are individually reassigned. However, the present invention is not limited to this, and it is possible to reassign both IDs at the same timing. It is good also as an aspect which reassigns only.

[Third Embodiment]
Next, the structured document management system 10 according to the third embodiment will be described. In addition, about the structure similar to 1st Embodiment mentioned above, the same code | symbol is provided and the description is abbreviate | omitted.

  FIG. 17 is a block diagram showing a functional configuration of the client device 40 in the present embodiment. As shown in the figure, the client device 40 includes a communication processing unit 41, a structure index unit 42, a vocabulary index unit 43, a structure-structure ID correspondence data 44, a vocabulary-vocabulary ID correspondence data 45, and a structured document restoration unit 46. It has. The communication processing unit 41, the structure index unit 42, the vocabulary index unit 43, and the structured document restoration unit 46 are a combination of a CPU (not shown) provided in the client device 40 and a predetermined program stored in advance in the ROM or storage unit. It is a functional part realized by operation.

  The structure-structure ID correspondence data 44 and the vocabulary-vocabulary ID correspondence data 45 are stored in a predetermined area of a storage unit (not shown) included in the client device 40, and the structure-structure ID correspondence data 32, vocabulary-vocabulary, and the like described above. Similar to the ID correspondence data 33, the structure index 321 and the vocabulary index 331 are held.

  When the communication processing unit 41 receives the structure index 321 transmitted from each node constituting the structured document management system 10 via the network N, the communication processing unit 41 outputs the structure index 321 to the structure index unit 42, thereby The structure index unit 42 registers the structure-structure ID correspondence data 44.

  In addition, when the communication processing unit 41 receives the vocabulary index 331 transmitted from the structured document management system 10 via the network N, the communication processing unit 41 outputs the vocabulary index 331 to the vocabulary index unit 43, thereby 43, the vocabulary-vocabulary ID correspondence data 45 is registered.

  In this embodiment, the structure index 321 and the vocabulary index 331 transmitted from each node are transmitted by broadcast. However, the structure index 321 and the vocabulary index 331 are not limited to this, and are transmitted by unicast including the client device 40, for example. It is good also as a mode which is transmitted, and it is good also as a mode transmitted by multicast.

  Further, when the communication processing unit 41 receives a search result for the search request from the structured document management system 10, the communication processing unit 41 outputs the search result to the structured document restoration unit 46. In the present embodiment, the search result transmitted from the structured document management system 10 is transmitted in the state of the encoded data described above.

  The structure index unit 42 registers the structure index 321 input from the communication processing unit 41 in the structure-structure ID correspondence data 44. The vocabulary index unit 43 registers the vocabulary index 331 input from the communication processing unit 41 in the vocabulary-vocabulary ID correspondence data 45.

  The structured document restoration unit 46 performs a search input from the communication processing unit 41 based on the structure index 321 registered in the structure-structure ID correspondence data 44 and the vocabulary index 331 registered in the vocabulary-vocabulary ID correspondence data 45. The resulting encoded data is restored to a structured document. If the structured document restoration unit 46 determines that the encoded data has been subjected to compression processing, the structured document restoration unit 46 decompresses the encoded data and then restores the structured document. The operation related to the reconstruction of the structured document is the same as the operation related to the restoration of the structured document in the structured document conversion unit 24 described above, and the description thereof will be omitted.

  In the above configuration, when the client device 40 acquires the inspection result (structured document) for the search request from the structured document management system 10 in the state of the encoded data, the structured document restoration unit 46 displays the structure-structure ID. Based on the structure index 321 registered in the correspondence data 44 and the vocabulary index 331 registered in the vocabulary-vocabulary ID correspondence data 45, the original structured document is restored.

  As described above, according to the present embodiment, the structured document to be transferred can be converted into a format suitable for compression, and compressed and transferred between the node and the client device constituting the structured document management system 10. Therefore, compared to the case where the original structured document is transferred as it is, the amount of transfer data can be reduced and the time required for transfer can be shortened.

  In the present embodiment, the client device 40 includes the structure index unit 42 and the vocabulary index unit 43. However, the present invention is not limited thereto, and the client device 40 does not include one or both of the structure index unit 42 and the vocabulary index unit 43. It is good also as an aspect.

  Although the embodiments of the invention have been described above, the present invention is not limited to these embodiments, and various modifications, substitutions, additions, and the like can be made without departing from the spirit of the present invention.

It is the figure which showed the structure of the structured document management system. It is the figure which showed the hardware constitutions of the structured document management apparatus. It is the figure which showed an example of the structured document. It is the figure which showed an example of the function structure of the structured document management apparatus. It is a figure for demonstrating operation | movement of a structure index part. It is a figure for demonstrating operation | movement of a structure index part. It is a figure for demonstrating operation | movement of a vocabulary index part. It is the flowchart which showed the procedure of the structured document registration process. It is the flowchart which showed the procedure of the structure-structure ID data update process. It is the flowchart which showed the procedure of the vocabulary-vocabulary ID data update process. It is the flowchart which showed the procedure of the other node side registration process. It is the flowchart which showed the procedure of the structured document search process. It is the flowchart which showed the procedure of the structured document encoding process. It is the flowchart which showed the procedure of the other node side structured document search process. It is the flowchart which showed the procedure of the structured document restoration process. It is a figure for demonstrating operation | movement of a structured document conversion part. It is a figure for demonstrating operation | movement of a structured document conversion part. It is a figure for demonstrating operation | movement of a structured document conversion part. It is the figure which showed an example of the structure index. It is the figure which showed an example of the vocabulary index. It is the block diagram which showed an example of the function structure of the structured document management apparatus. It is the flowchart which showed the procedure of structure ID reallocation processing. It is the flowchart which showed the procedure of the other node side structure ID reassignment process. It is the block diagram which showed the function structure of the client apparatus.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 Structured document management system 11 Structured document management apparatus 12 Structured document management apparatus 13 Structured document management apparatus 14 Structured document management apparatus 20 Request reception part 21 Communication processing part 22 Search plan generation part 23 Search plan processing part 24 Structure Document conversion unit 25 Dictionary 26 Structured document acquisition unit 27 Storage processing unit 271 Document analysis unit 272 Structure analysis unit 273 Vocabulary analysis unit 274 Structure analysis unit 275 Vocabulary analysis unit 28 Structure index unit 29 Vocabulary index unit 30 Structured document DB management Part 31 Structured document DB
32 Structure-Structure ID Corresponding Data 321 Structure Index 33 Vocabulary-Vocabulary ID Corresponding Data 331 Vocabulary Index 40 Client Device 41 Communication Processing Unit 42 Structure Index Unit 43 Vocabulary Index Unit 44 Structure-Structure ID Corresponding Data 45 Vocabulary-Vocabulary ID Corresponding Data 46 Structured document restoration unit 101 CPU
102 Operation unit 103 Display unit 104 ROM
105 RAM
106 Communication unit 107 Storage unit 108 Bus

Claims (13)

A plurality of structured documents are distributed and stored together with other structured document management apparatuses connected to the network, and each of the structured documents shared with the other structured document management apparatuses is configured. A structured document that manages the plurality of structured documents based on a unique structure ID for each type of tag structure of an element and a unique vocabulary ID for each vocabulary included in each element constituting the structured document In the management device,
Structured document storage means for storing the structured document;
Structure index storage means for storing a structure index in which the tag structure of each element constituting the structured document stored in the structured document storage means is associated with the structure ID unique to each type of the tag structure When,
A vocabulary index that associates each vocabulary constituting a character string portion included in each element of the structured document stored in the structured document storage means with the vocabulary ID unique to each vocabulary type. Vocabulary index storage means for storing;
Based on the structure index and the vocabulary index, the encoded data obtained by converting the structured document stored in the structured document storage means into an array of the structure ID and the vocabulary ID is generated, and the other structured document management apparatus Encoding means for transmitting to
A restoring means for restoring the encoded data to the structured document based on the structure index and the lexical index when the encoded data is received from the other structured document management device;
A structured document management apparatus comprising: The encoding means transmits encoded data obtained by compressing the encoded data in a predetermined compression format to the other structured document management apparatus,
2. The structured document management apparatus according to claim 1, wherein the restoration unit decompresses the encoded data compressed in the predetermined compression format, and then restores the structured data to a structured document. When the structured document is newly stored in the structured document storage unit, a new structure ID that is different from the structure ID is assigned to each tag structure type of each element constituting the structured document. A structure index generating means for generating a simple structure index;
Registering the new structure index in the structure index storage means, transmitting to the other structured document management apparatus, and making the other structured document management apparatus share the structure index registration means,
The structured document management apparatus according to claim 1, further comprising:   The structure index generation means determines whether or not the tag structure is already registered in the structure index storage means, and assigns the new structure ID to the tag structure when it is determined that the tag structure is not registered. The structured document management apparatus according to claim 3.   5. The structured document management apparatus according to claim 3, wherein the structure index generation unit determines the value of the new structure ID according to the appearance frequency of the tag structure.   4. The structure index registration unit, when a new structure index is received from the other structured document registration unit, registers the new structure index in the structure index storage unit. Structured document management device. When the structured document is newly stored in the structured document storage unit, a new word different from the vocabulary ID is created for each type of vocabulary constituting a character string part included in each element of the structured document. Vocabulary index generating means for generating a new vocabulary index to which a vocabulary ID is assigned;
Registering the new vocabulary index in the vocabulary index storage means, transmitting to the other structured document management apparatus, and sharing the lexical index with the other structured document management apparatus;
The structured document management apparatus according to claim 1, further comprising:   The vocabulary index generating means determines whether or not the vocabulary is already registered in the vocabulary index storage means, and assigns the new vocabulary ID to the vocabulary when it is determined that the vocabulary is not registered. Item 8. The structured document management apparatus according to Item 7.   9. The structured document management apparatus according to claim 7, wherein the vocabulary index generation unit determines the value of the new vocabulary ID according to the appearance frequency of the vocabulary.   8. The vocabulary index registration means, when receiving a new vocabulary index from the other structured document registration means, registers the new vocabulary index in the vocabulary index storage means. Structured document management device. A plurality of structured documents are distributed and stored together with other structured document management apparatuses connected to the network, and each of the structured documents shared with the other structured document management apparatuses is configured. A structured document that manages the plurality of structured documents based on a unique structure ID for each type of tag structure of an element and a unique vocabulary ID for each vocabulary included in each element constituting the structured document A structured document management method for a management device, comprising:
A structure index for storing a structure index in which a tag structure of each element constituting a structured document stored in its own structured document management apparatus is associated with the structure ID unique to each type of the tag structure; In addition, each vocabulary constituting the character string portion included in each element of the structured document stored in the structured document management apparatus of the self is associated with the vocabulary ID unique to each vocabulary type. Based on the vocabulary index, encoded data obtained by converting the structured document stored in its own structured document management apparatus into the structure ID and the vocabulary ID array is generated and transmitted to the other structured document management apparatus. Encoding process;
A restoration step of restoring the encoded data into a structured document based on the structure index and the vocabulary index when the encoded data is received from the other structured document management device;
A structured document management method comprising: A plurality of structured documents are distributed and stored by a plurality of structured document management apparatuses connected on a network, and each element constituting the structured document shared by the plurality of structured document management apparatuses is stored. A structured document management system that manages the plurality of structured documents based on a unique structure ID for each type of tag structure and a unique vocabulary ID for each vocabulary included in each element constituting the structured document In
The structured document management apparatus includes:
Structured document storage means for storing the structured document;
Structure index storage means for storing a structure index in which the tag structure of each element constituting the structured document stored in the structured document storage means is associated with the structure ID unique to each type of the tag structure When,
A vocabulary index that associates each vocabulary constituting a character string portion included in each element of the structured document stored in the structured document storage means with the vocabulary ID unique to each vocabulary type. Vocabulary index storage means for storing;
Based on the structure index and the vocabulary index, it generates encoded data obtained by converting the structured document stored in the structured document storage means into an array of the structure ID and the vocabulary ID. Encoding means for transmitting;
A restoring means for restoring the encoded data to the structured document based on the structure index and the lexical index when the encoded data is received from the other structured document management device;
A structured document management system characterized by comprising: A client device capable of communicating with the plurality of structured document management devices;
The client device is
The structure index storage means;
The lexical index storage means;
Structured document restoration means for restoring the coded data to a structured document based on the structure index and the lexical index when the coded data is received from the structured document management device;
The structured document management system according to claim 12, comprising:

Images