JP2007114972A - Data processing method of structured document, data processing program and data processor - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To perform the processing of fetching a CSV compressed document to an associative array and canceling CSV on the associative array and the management of a memory region size regarding a method for handling a CSV compressed XML document similarly to the a non-compressed document while saving resources. <P>SOLUTION: For the large volume XML document of a record form, a plurality of elements not to be processed are connected and gathered by a CSV format. A kind of a CSV-formatted element is read from a header when processing data, access is performed by canceling the CSV format for the CSV-formatted element when called from application software, and by managing the records for which the CSV format is canceled and the number of them, a memory is saved and loads are reduced without being conscious of CSV formatting. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention mainly targets a data type XML (eXtensible Markup Language) document expressed in a table format and handled like a database as a structured document, and simplifies an API (Application Programming Interface) specialized for this. It relates to technology.

  In recent years, various types of systems such as individuals, companies, and local governments are connected through the Internet, and Web (World Wide Web) service, EDI (Electronic Data Interchange), and EC (Electronic Commerce) are being performed in cooperation with each other. In order to realize these systems, a wide range of information exchange is required. In the data exchange and data processing, XML that has flexible expression ability by structuring data is suitable for computer processing. It is attracting attention as a common platform format.

  In order to make it easy to use SGML (Standard Generalized Markup Language) standardized by the International Organization for Standardization (ISO) in 1986 on the Internet, XML has its basic specification XML 1.0 changed to W3C (World Wide Web) in February 1998. Consortium). HTML (HyperText Markup Language), a Web page creation language, has a fixed tag and is specialized for display, and there is a problem that cannot meet the requirement to process information on a computer based on the tag information. . XML is a language structure that allows a user to freely define tags and give meaning to character strings in a document, and enables information processing by a computer.

  When performing an operation such as search, update, or deletion on an XML document, the XML document is expanded into a DOM (Document Object Model) tree structure using standard API software. However, expansion to the DOM tree requires a huge amount of operation memory 5 to 10 times that of the original data, and items that are not used are also expanded together, which takes time. In view of this, the present invention provides a technique for reducing resources required for data processing of an XML document and making the user aware of the device.

  In addition, depending on the characteristics of the XML document, there are two types: a document type XML document having a long element content such as a magazine, a manual, a dictionary, and a data type XML document having a large number of tags and a short element content such as a slip and a schedule. Although classified, the present invention mainly targets data type XML documents. In particular, the present invention aims to simplify the API by specializing in XML documents that are represented in a table form and handled like a database. Is.

In the following, the XML technology, the current state of the API, and the prior application technology will be described in order to clear the problems of the conventional XML document.
(1) About XML Here, the terminology of technical terms is defined based on the XML standard. A string surrounded by a pair of "<" and ">" is a tag, "<string>" is a start tag, "</ string>" is an end tag, and the entire string from the start tag to the end tag A character string sandwiched between an element and a start tag and an end tag is called element content, the name of the element described in the tag is called an element name (or tag name), and additional information for the element is called an attribute.

A structured document describes a data structure in a form in which tags are embedded in the document itself. By adopting a configuration in which a data structure is embedded in a document as a tag, it is possible to provide flexibility and expandability with respect to addition, deletion, and change of data items. In addition, it is possible to give the data visibility by giving a meaningful name to the tag name.
(2) Standard API for handling XML documents
In XML documents, which are typical structured documents, there are two standard interface (API) standards called DOM (Document Object Model) and SAX (Simple API for XML) to handle XML documents from application software. It has been established. Since SAX reads an XML document in a stream format, it consumes less memory and is generally faster. Therefore, it is suitable for simple processing that is simply referred to by time-series output.

On the other hand, DOM generally has a drawback that it is low speed and consumes a large amount of memory. However, since the elements of a document are expanded in a hierarchical tree shape, it has a feature that a program can be easily assembled even with complicated processing contents. The DOM is mainly used for updating.
(3) Prior application technology for resource saving (see Fig. 17)
The standard API (DOM) consumes a large amount of operation memory and the processing speed is slow because all elements including elements not used for data processing are expanded on the memory. The processing speed and the memory amount are proportional to the number of elements of the XML document. In order to solve these inconveniences, the applicant of the present application has previously filed a method called “XML CSV compression” (Patent Documents 1, 2, and 3). In this method, elements in an XML document are divided into two groups: elements that require random access and elements that can be collectively accessed, and multiple elements that are collectively accessed are combined into one element in CSV (Comma Separated Values) format. By performing the conversion to be summarized, the substantial number of elements is reduced, the memory usage of the standard API is reduced, and the speed is increased.
JP 2003-203667 A Japanese Patent Application No. 2004-082589 Japanese Patent Application No. 2005-506707

  As described above, XML is a flexible data expression format, but has the disadvantages that it consumes a large amount of memory and makes the CPU load heavy when it is manipulated by expanding it into a tree structure with standard API software (DOM). . The applicant of the present application has previously proposed “XML CSV compression” in the XML application software, which reduces the load on the CPU and saves memory by converting the non-processable element of the XML document into the CSV format.

  However, according to the technology of the prior application, when processing an XML document compressed in CSV format in application software, an element that is not converted to CSV (raw element) is distinguished from an element that is converted to CSV (CSV element). There was a need to do. Elements that have not been converted to CSV can be used as they are, but elements that have been converted to CSV are used after being converted to CSV. For this reason, although the resource is reduced, there is a problem that the user needs to distinguish and consciously handle the two types of elements and handle them separately, and the programming of the application software is complicated and time-consuming.

  Therefore, in the present invention, for a large-capacity XML document in record format, a plurality of non-processable elements are connected together in CSV format, and the type of CSV conversion element is read from the header during data processing, and is called from application software. When an element is converted to a CSV, the element is converted to a CSV and accessed, and the records and the number of records that are converted to a CSV are managed to save memory and reduce the load without being aware of the conversion to CSV. Provide technology to achieve this.

  1st invention is the data processing method of the structured document comprised by the record format, Comprising: The several element in the record in the said structured document is accessed collectively with the 1st element which should be accessed individually An element dividing step for grouping into a second element to be combined, and the elements in the target record as the second element are connected by a delimiter code and compressed and converted into one element to represent the type of the element A compression conversion step for storing a header in a memory, and when accessing a plurality of elements in the record by application software, the header information is first read, and the element is compressed and converted in the compression conversion step. An element determining step for determining from the header information whether the element corresponds to the second element, and an element in the record does not correspond to the second element. If the element content is accessed as it is, and the element in the record corresponds to the second element, the element content represented by the delimiter is decomposed into individual element contents. The present invention relates to a structured document data processing method, characterized by causing a computer to execute an element access step that is accessed after being expanded into a document.

  That is, according to the first invention, the element classification means has a plurality of elements in each record of the structured document, the first element to be accessed individually, and the second element to be accessed collectively. The compression conversion means compresses and converts the second element classified as a collective access target by a delimiter code for each record as one element, and a header indicating the type of the element. And when the element determination means accesses the plurality of elements in the record by the application software, the header information is first read and the element is compressed and converted. Is determined from the header information, if the element access means does not correspond to the second element, the element content is accessed as it is, In addition, when the element corresponds to the second element, the content of the element expressed by the delimiter is decomposed into individual element contents, and expanded on the memory, and then accessed, and then used memory is used. The capacity is reduced and the load on the CPU is reduced, and access to the target element is realized without being conscious of the application software.

  According to a second aspect of the invention, when the structured document is expanded in a memory, the structured document file is read as stream data, and each element of the structured document is assigned to an array and stored. The present invention relates to a structured document data processing method described in one invention.

  That is, according to the second invention, the structured document file is sequentially read as stream data, and each element of the structured document is allocated and stored in an array on the memory, so that the file is accessed many times. There is no need to read repeatedly, the memory can be reduced, and the memory can be efficiently deployed at high speed.

  According to a third aspect of the present invention, in the expansion of the structured document into the memory, a first array that assigns the first element and the second element collectively represented by the delimiter for each record, and the second The structured document data processing method according to the first or second aspect of the present invention, further comprising: a second array in which the element contents of the elements are collectively divided into individual element contents.

  That is, according to the third invention, when the structured document is expanded in the memory, the first element to be accessed and the second element compressed with a delimiter code are allocated for each record. Since the first array and the second array obtained by disassembling the grouped second element contents into individual element contents are held in the memory, when the same record is accessed, the compressed element has already been stored. The result of the expanded and disassembled element contents can be passed as it is.

  The invention described above produces the following effects.

  Up to now, compression of elements in structured documents has the effect of reducing the amount of main memory consumption in proportion to the ratio of elements that are reduced by grouping the elements in the record by delimiters. Therefore, it was necessary to make a program by distinguishing the raw elements and the batch elements in the record. According to the present invention, since programming can be performed without being conscious of this, it is possible to achieve both the performance improvement effect by the batch compression element and the ease of programming.

  In addition, by reading the structured document file sequentially as stream data and assigning each element of the structured document to an array on the memory, it is not necessary to read the file repeatedly and repeatedly. This makes it possible to efficiently expand the memory at high speed.

  In addition, when the structured document is expanded in the memory, for each record, the first array in which the first element to be accessed and the second element compressed into one with a delimiter code are allotted, and Since the second array obtained by decomposing the second element content into individual element contents is held in the memory, the compressed element is already expanded when the same record is accessed. It is possible to pass the result of the element content as it is.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the embodiment, since the structured document is an XML document of a data type expressed in a table format and handled like a database, it is expressed as an XML document below, and the elements in the record of the XML document are delimited. As for the compression format collectively using codes, various character strings can be applied as well as commas. Here, for convenience, it is expressed as CSV compression.

  FIG. 1 shows a basic configuration of a data processing system for a structured document according to an embodiment of the present invention. The data processing system includes a PC terminal of the end user 40, various application software 30 developed by the application developer 50, and CSV compressed XML documents A and A ′ stored in a device such as a server connected via a network. (Structured document compressed in CSV), data processing program 10, and API software 20 (XML parser) that transfers data to application software 30.

  Further, the data processing program 10 includes an element classification unit 11 for grouping a plurality of elements in the record in the structured document into a first element to be individually accessed and a second element to be collectively accessed. Compression / decompression conversion means 12 that connects the elements in the target record as the second element in CSV format, compresses and converts them into one element, attaches a header indicating the type of the element, and stores it in the memory, application software When accessing a plurality of elements in the record by 30 (application software), the header information for CSV compression information is first read, and whether or not the element corresponds to the second element that has been compression-converted is determined. If the element determination unit 13 determines from the header information, and the element in the record does not correspond to the second element, the content of the element is used as it is. If the element in the record corresponds to the second element, the element access of the batch-compressed CSV-compressed element is decomposed into individual element contents and expanded on the memory. It is comprised by the means 14.

  In this data processing system, the end user 40 uses various application software 30 on the screen of the own terminal with respect to the CSV compressed XML documents A and A ′ to be accessed stored in a device such as a server connected to the network. To instruct search / update.

  In an apparatus such as a server in which the CSV compressed XML documents A and A ′ are stored, the data operation is performed via the API software 20, the original XML document A is processed by the data processing program 10, and the processing result is The XML document A ′ is expanded on the memory, returned to the application software 30 via the API software 20, and the XML document A ′ is converted from XML to HTML in the PC terminal of the end user 40, and is displayed on the screen by the browser. Display output.

  FIG. 2 shows a hardware configuration example of a computer that realizes a structured document data processing system according to an embodiment of the present invention.

  A computer 100 shown in the figure includes a CPU (Central Processing Unit) 101, a memory 102, an input device 103, an output device 104, an auxiliary storage device 105, a medium drive device 106, a portable recording medium 107, and a network connected to each other by a bus 109. The connection device 108 is provided. However, the configuration shown in the figure is an example, and the present invention is not limited to this.

  The CPU 101 is a central processing unit that controls the entire computer 100, and the memory 102 is stored in the auxiliary storage device 105 (or the portable recording medium 107) when executing a program or updating data. A memory such as a RAM (Random Access Memory) that temporarily stores programs or data. In addition, the CPU 101 realizes the functions of the element sorting unit 11, the compression / decompression conversion unit 12, the element determination unit 13, and the element access unit 14 of FIG. 1 described above using the program and data read to the memory 102.

  The auxiliary storage device 105 is a storage device in which a magnetic disk, an optical disk, a magneto-optical disk or the like is mounted, and stores a program and data for realizing each function of the present invention. As data, an original XML document A input from the outside, an XML document A ′ as a processing result, and the like are temporarily stored. The medium driving device 106 reads programs and data stored in a portable recording medium 107 such as an FD (Fleible Disk), a CD-ROM (Compact Disk Read Only Memory), and a magneto-optical disk.

  The network connection device 108 is connected to a network and enables transmission and reception of programs, data, and the like with an external information processing device.

  In the following embodiment, FIG. 3 shows a basic API for handling a CSV compressed XML document of the present invention, and FIGS. 4, 5 and 6 show management, storage, and access of the XML document at this time. The image of is shown. 7 and 8 show examples of application software using Javascript using this API. Further, FIGS. 9 to 14 show a flowchart of each method of the API of FIG.

FIG. 3 shows a format setting example of an application programming interface (API) according to the embodiment of the present invention. A specific setting example using Javascript is shown below for this API.
(0) Creation of CSV compressed document operation object: This is an object constructor, and creates an object in which data handled as Object = new CSVCDocument is initialized.
(1) Load CSV-compressed document: The file reading process is Object.openCSVCFile (input CSV compressed file name, record element name), and the return value is “error status”. The file stored in the auxiliary storage device 105 is loaded into the memory 101, the data of the CSV compressed file name and the record element name is acquired, the header of the CSV compressed document file is read, and the data is associative array for data and management Store.
(2) Close CSV-compressed document: The file close process is Object.closeCSVCDocument (), and the return value is “error status”.
(3) Record number of XML document: Record number acquisition processing is Object.recordLength (), and return value is “record number of record specified at opening”.
(4) Record element read: The record element read process is Content = Object.getElement (record number, element name), and the return value is “element content or error status”.
(5) Record element write: Record element write processing is Object.putElement (record number, element name, element content), and the return value is "error status".

  FIG. 4 shows a data configuration example of the compressed object (management associative array) of the structured document according to the embodiment of the present invention. In the open process of FIG. 3A, the CSV compressed document file is read and the data is stored in the management associative array. The header of the XML document is read, and the relationship between the elements in the record and the CSV elements is stored as an associative array for data management.

  The associative array name has the object name “Doc”, for example, “DocArray”. The record element is a one-dimensional array, and each element of the record is an associative array. In this associative array, the element contents of the stored contents are read and written with the element name as a subscript.

  For example, in the item 2001, the file name: fname is “employee list-csv.xml”, in the item 2002, the record name: recname is “employee”, and in the item 2003, the record number: recnum is “1000”. In item 2004, current record number: cur_recno is “1”, in item 2005 is associative array name for data: arrayname “Doc Array”, and in item 2006 is associative array name for CSV data: csv_arrayname “Doc CSVArray”, item 2007 contains “information” as CSV element name: csvelem, item 2008 uses putElement method: “1 or 0” as putElementFlag, and item 2009 shows FIG. (b) “Doc AccessRecord”, “Doc ElementDisc”, etc. are stored as the management array name in (c).

  FIG. 5 shows an example of an array for data storing record elements of a compressed structured document according to an embodiment of the present invention (part 1—an example of an associative array). In the data array of FIG. 5, each record of the CSV compressed document is stored in the associative array of the first one-dimensional array as it is. Among these, when accessed, the CSV element is further expanded into an associative array of the second one-dimensional array for data. For this associative array name, for example, “DocCSVArray” is added by the same naming method as above. In the second associative array, element contents stored with the element name converted to CSV as a subscript are accessed based on the information read from the CSV compressed header described above.

  For example, the first data array Doc Array [2] is expanded in memory as an associative array, and the element contents in each item with the element names “@id”, “name”, “affiliation”, and “information” as subscripts Are stored as “0002”, “Jiro Tanaka”, “Sales”, and “General, 2333,456, tanaka @ yyyyy”, respectively. In the second data array Doc CSVArray [1], the CSVed elements to be accessed are expanded in an associative array, and the element names of “title”, “extension”, “Fax”, and “Email” are subscripted. The element contents of each item are stored as “general”, “2333”, “456”, and “tanaka @ yyyy”, respectively.

  FIG. 6 shows an example of an array for data storing record elements of a compressed structured document according to an embodiment of the present invention (part 2—an example of a normal array). Here, in the first array and the second array in FIG. 5A, element numbers (1 to 4 in the first array and 5 to 8 in the second array) are used as subscripts instead of the element names. An example is shown in which element contents are stored corresponding to each item. The associative array shown in FIG. 5 can use the memory effectively even if there is an element that does not appear. However, if there is an element that appears in the record, it is a normal array, so the entire memory area is allocated. However, when a set of elements in a record always appears, this configuration is more suitable and higher speed processing is possible.

  FIG. 7 shows management information when the CSV conversion element for each record according to the embodiment of the present invention is expanded on the memory.

  (A) has shown the arrangement | sequence which matches the associative arrangement | sequence which expand | deployed the record CSV conversion element at the time of CSV format expansion | deployment. Use the array element “Doc AccessRecord” for the number of records in the one-dimensional array, and store the subscript of the one-dimensional array for each associative array element in the DocCSVArray for each accessed record It is something to manage. For example, indexes 1 and 2 are stored as the CSVArray usage positions of the second and third records.

  (B) shows an array for associating a record with a CSVed element expansion associative array when writing back to the CSV format. For example, as the first and second records of CSV_RecordArray, use records 2 and 3 at each csvArray position are stored.

  (C) shows an associative array for determining a CSV element name. The one-dimensional associative array “DocDisc” identifies whether the element in the record is stored in the first associative array DocArray or the second associative array DocCSVArray. This array is created when the CSV compressed header is read when it is initialized. For example, whether or not CSV is used for element names of “name”, “affiliation”, “title”,. Is determined by the flags “0”, “0”, “1”.

  (D) shows an array for storing the order of CSV element names and CSV element names. The one-dimensional array “DocOrder” is also created when the CSV compressed header is read. This array is used to give the order in which the elements are arranged when the elements of the second data associative array are combined and written back into the original CSV format. In some programming languages, associative arrays do not preserve the storage order, so the order is preserved. The CSV element name is stored at the position of subscript 0.

  Note that the second associative array DocCSVArray that expands CSV elements consumes a large amount of main memory, and therefore manages the storage location so that the number of expansions is kept constant by managing the storage location at the time of access.

  In the management method, when the storage location becomes full due to the logic of (1) LRU (Least Recently Used) and (2) LFU (Least Frequently Used), which are well-known technologies, one location is left free. There is a method for storing newly developed CSV elements. LRU is a method of vacating a place that was used most recently, and LFU is a method of vacating a place that is least frequently used.

  In order to realize the LRU logic, the counter may count the number of places used so far. Then, when the count value exceeds the number of elements of the associative array and becomes full, the oldest place is opened next and a new CSV element is stored. For example, if the number of elements of the associative array is 256, the counter starts with zero, assigns the location of the number of the count value, and when the number exceeds 256, the value obtained by taking the modulo at 256 (the count value is 256 It is only necessary to make a new allocation by allocating the remainder of the division.

  In order to realize the logic of the LRU, the usage frequency of the CSV elements to which the elements of the associative array are assigned is counted, and a space is allocated from the one with the smallest counted value and newly assigned. By adopting any of the above management methods, the number of deployed CSV elements can be kept constant.

  FIG. 8 shows management information (modified example of FIG. 7 (c)) when the CSV conversion element for each record according to the embodiment of the present invention is expanded on the memory. The following shows the management information of FIG. 8 as an example. The number of each element is obtained with reference to the associative array of (c ′), and the number of raw elements (three in the figure) is held in the memory. This is a mechanism for expanding to two memories.

  A major difference from the configuration of FIG. 7C in this configuration is that the data arrays DocArray and DocCSVArray are changed from an associative array to a normal array. By using the normal array, the access speed becomes faster than the associative array. This configuration is more appropriate when a set of elements in a record always appears.

  FIG. 9 shows an example of a program using the API according to the embodiment of the present invention (part 1—modification of specific elements). FIG. 18 shows an example of application software of the API of the present invention, which is a program for sequentially accessing “employee list-csv.xml” in FIG. 17 using this API.

  After creating a CSV compressed document object, load “employee list-csv.xml” using the openCSVCFile method. Next, all records are scanned using the for statement, the element content of the “name” element is extracted using the getElement method, and the record of “Jiro Tanaka” is searched. If a record of “Jiro Tanaka” is found, the content of the “Email” element is rewritten to “j.tanaka@yyy”. From this point on, all records are scanned again using the for part, and the element name and element content of each record are output.

  FIG. 10 shows a program example (part 2-XML document update) using the API according to the embodiment of the present invention. This is a program example when the original file “Employee list-csv.xml” is rewritten with “Employee list-csv-change.xml” describing the changed part and the original file is updated.

  First, the original file and the changed part file are loaded with openCSVCFike to create CSV compressed document objects Doc1 and Doc2. Next, the changed part is taken out one record at a time, and all the records of the original are scanned to search for a record with a matching id attribute. When a record with the same id attribute is found, all elements of that record are rewritten. In this example, since the original is scanned many times, in the case of stream processing, it is necessary to read the data from the disk many times, whereas the data is expanded in the memory so that it can be processed at high speed. Can do. In addition, in the present invention, since elements other than the attribute, name, and affiliation are collected in the CSV format, the memory consumption can be greatly suppressed, and the API of the present invention is used to collect the elements in the CSV format. It becomes possible to handle without being conscious of the elements that are.

  Hereinafter, the flow of each method of the API object of the present invention will be described with reference to FIGS.

  FIG. 11 shows a creation flow of an API object of a structured document according to the embodiment of the present invention. The embodiment shows a flow of creating the CSV compressed document object (management associative array) shown in FIG. 4 in the object CSVCDocument.

  In step S11, a CSV compressed document object (management associative array) for managing various items is created. In step S12, the process returns to the caller.

  FIG. 12 shows a flow of open processing of a CSV-compressed structured document file according to the embodiment of the present invention. In the open process openCSVCFile, the CSV compressed document file given by the first argument is read using SAX that reads the XML document in the stream format, and the elements in the record given by the second argument are the first data shown in FIG. The flow to expand to the associative array “DocArray” is shown.

  First, in step S21, an XML file name and a record element name are received as arguments and stored in an object (management associative array).

  Next, in step S22, the CSV element and the CSV storage element name are read from the CSV compression header of the target XML document, and the one-dimensional associative array “DocCSVDisc” has the element content as the first data associative array “DocArray”. The second data associative array “DocCSVArray” or information for distinguishing in which associative array is stored is created. Also, various arrays for CSV element development management are created.

  Further, in step S21, using SAX, in-record elements and CSV elements are expanded on the first associative array for data for each record, and the number of records is counted at the time of expansion. In step S21, the counted number of records is stored in the object. In step S21, the process returns to the caller.

  FIG. 13 shows the flow of a CSV-processed structured document file closing process according to the embodiment of the present invention. Close processing of compressed structured document file closeCSVCDocument is as follows.

  In step S31, it is determined by reading from the CSV compressed document object whether the putElement method has been used before. If not used, the CSV compressed document file is only referred to in step S34, and is closed as it is. If it has been used, since the CSV reduced document file has been written in step S32, it is determined whether there is a record to be output next. If all the target records are set, the process closes in step S34.

  Furthermore, if there is a record that has not yet been processed, the next unprocessed record is set in step S33. In step S35, it is determined whether the CSV element of the record has already been expanded in the second associative array.

  If the CSV element of the record has been expanded into the second associative array, in step S36, the contents of the second associative array “DocCSVCArray” of the record are converted into the CSV format using the join function, and the first data While replacing the contents of the CSV element with the associative array “DocArray”, in step S37, the contents of the “DocArray” in the form of an XML document are written out from the associative array by using SAX. . Then, the processes from step S32 to step S37 are repeated until all the target records are completed.

  If the CSV element of the record is not expanded into the second associative array in step S35, the process jumps to step S37 to perform the XML document writing process using SAX.

  Here, with regard to the split function and the join function described later, in the script language, a function that separates and joins CSV format character strings is supported as a standard.

  For example, in Javascript, a format character string and an array for storing separated CSV elements can be designated as follows.

・ Separated array = split (delimiter, CSV format string);
-Join CSV format string = join (delimiter, array);
FIG. 14 shows a flow of the record number reading process of the compressed structured document file according to the embodiment of the present invention. The record number reading process recordLength is shown below.

  In step S41, the number of records stored in the CSV compressed document object is read, and in step S42, the process returns to the caller.

  FIG. 15 shows a flow of a reading process of element contents of a structured document according to the embodiment of the present invention. Element content read processing getElement is as follows.

  In step S51, the record number is received as the first argument and the element name in the record is received as the second argument. In step S52, it is determined by the associative array “DocCSVDisc” whether the received element name is a CSV element. If it is not a CSV element, in step S53, the element content is read by subtracting the element name from the first data associative array “_DocArray”. If it is a CSV element, in step S54, it is checked by a one-dimensional array “DocAccessRecord” whether the CSV element of this record is expanded on the memory.

  If not expanded, in step S55, the number of the empty array element of the second data associative array “DocCSVArray” is written to the one-dimensional array “DocAccessRecord”, and the CSV element is stored on the “DocCSVArray” using the split function. Expand to. In step S56, the storage position and the element name are designated, and the element contents are read from the second associative array.

  If the CSV element of this record has been expanded in the memory, in step S56, the expanded position on "DocCSVArray" is read from "DocAccessRecord", and the element content is extracted from "DocCSVArray" with the element name. Read. The element content read out as described above is returned as a return value in step S57.

  FIG. 16 shows a flow of processing for writing element contents of a structured document according to the embodiment of the present invention. Element content write processing putElement is as follows.

  First, in step S61, a record number, an element name in the record, and an element content to be written are received as arguments. In step S62, it is determined by the associative array “DocCSVDisc” whether the received element name is a CSV element. Next, if it is not a CSV element, in step S63, the element content is written by subtracting the element name from the first data associative array “DocArray”. If it is a CSV element, in step S64, it is checked by the one-dimensional array “DocAccessRecord” whether or not the CSV element of this record is expanded on the memory.

  If the CSV element is not expanded in step S64, the number of the empty array element of the second data associative array “DocCSVArray” is written in the one-dimensional array “DocAccessRecord” in step S65, and the CSV element is changed to the split function. Use it to expand on “DocCSVArray”. In step S65, the storage location and the element name are designated, and the element contents are written into the second associative array.

  In step S64, if the CSV element of this record has been expanded on the memory, the expanded location on "DocCSVArray" is read from "DocAccessRecord", and the element content is extracted from "DocCSVArray" with the element name. Write, return to caller in step S67.

  In the above example, the case where one CSV element is included in the record has been described. Of course, even when there are a plurality of CSV elements, they are stored in the plurality of CSV elements in the header of the CSV compressed document. The element names can be described, read in the same manner as described above, and managed on the API using two data associative arrays.

  In the above example, the case where an API that can be programmed without being aware of CSV compression has an element content update function has been described, but this also applies to the case where an insertion / deletion function is added to the API. it can. An object of the present invention is to use the CSV compression without being aware of it, and since the insertion / deletion function is not essential, the description is omitted.

  As described above, in the present invention, since the entire structured document is configured as an API stored in an array, various data operations over the entire structured document can be easily performed only by an intuitive array operation. Become. Also, by giving a record element name, an array structure in which the record element is reflected is obtained, and the inside and outside of the record are distinguished from each other, and it can be handled as an object in units of records. Furthermore, this API format makes it possible to easily access the element contents with another element name, and to perform operations such as changing the hierarchy in the record, the element name, and inserting / deleting the record.

The embodiments of the present invention described above are as shown in the following supplementary notes.
(Supplementary note 1) A data processing method for a structured document configured in a record format,
An element partitioning step for grouping a plurality of elements in the record in the structured document into a first element to be individually accessed and a second element to be collectively accessed;
A compression conversion step of compressing and converting the elements in the target record as the second element into a single element by connecting them with a delimiter, and storing in a memory with a header indicating the type of the element;
When accessing a plurality of elements in the record by application software, the header information is first read, and whether or not the element corresponds to the second element compressed and converted in the compression conversion step is determined. An element determination step for determining from header information;
When the element in the record does not correspond to the second element, the content of the element is accessed as it is, and when the element in the record corresponds to the second element, it is expressed by the delimiter An element access step for accessing the element contents after being decomposed into individual element contents and expanded on the memory;
A structured document data processing method characterized by causing a computer to execute the above.
(Supplementary note 2) The supplementary note 1, wherein when the structured document is expanded in a memory, the structured document file is read as stream data, and each element of the structured document is assigned to an array and stored. Data processing method for structured documents.
(Additional remark 3) In expansion | deployment to the memory of the said structured document, the 1st arrangement | sequence which allocates the 2nd element collectively represented by said 1st element and the said delimiter for every record, and said 2nd element The structured document data processing method according to appendix 1 or 2, further comprising: a second array in which each element content is decomposed and assigned to each element content.
(Supplementary Note 4) In the second element, when the element contents collected by the delimiter code are decomposed into individual element contents and expanded into the second array and then accessed, the second array is predetermined. If the capacity exceeds the capacity, array elements previously expanded in the second array are written together by the delimiter and written back to the first array, and then the individual element contents are expanded to the written back array elements. The structured document data processing method according to any one of appendices 1 to 3, wherein the data is processed as described above.
(Supplementary Note 5) The structured document expanded on the memory is rewritten, and for each record, the contents of the first array for the first element are output as a structured document, and the second element is: If not expanded to the second array, the contents of the first array are output, or if expanded to the second array element, the contents of the individual elements are output collectively by a delimiter The structured document data processing method according to any one of appendices 1 to 4, wherein:
(Supplementary Note 6) The second array that expands the elements grouped by the delimiter code counts the number of places used so far by the counter at the time of access, and uses the oldest place or the most frequently used place. The structured document data processing method according to any one of appendices 1 to 5, wherein the number of expansions is suppressed to a fixed number by making a space with a small amount of space.
(Supplementary note 7) A structured document data processing program configured in a record format,
On the computer,
An element partitioning step for grouping a plurality of elements in the record in the structured document into a first element to be individually accessed and a second element to be collectively accessed;
A compression conversion step of compressing and converting the elements in the target record as the second element into a single element by connecting them with a delimiter, and storing in a memory with a header indicating the type of the element;
When accessing a plurality of elements in the record by application software, the header information is first read, and whether or not the element corresponds to the second element compressed and converted in the compression conversion step is determined. An element determination step for determining from header information;
When the element in the record does not correspond to the second element, the content of the element is accessed as it is, and when the element in the record corresponds to the second element, it is expressed by the delimiter An element access step for accessing the element contents after being decomposed into individual element contents and expanded on the memory;
Data processing program for structured documents that executes
(Supplementary Note 8) A structured document data processing apparatus configured in a record format,
Element classification means for grouping a plurality of elements in the record in the structured document into a first element to be individually accessed and a second element to be collectively accessed;
Compression conversion means for compressing and converting the elements in the target record as the second element into a single element by connecting them with a delimiter, and storing in a memory with a header indicating the type of the element;
When accessing a plurality of elements in the record by application software, the header information is first read, and whether or not the element corresponds to the second element compressed and converted in the compression conversion step is determined. Element judging means judging from header information;
When the element in the record does not correspond to the second element, the content of the element is accessed as it is, and when the element in the record corresponds to the second element, it is expressed by the delimiter Element access means for accessing the element contents after being decomposed into individual element contents and expanded on a memory;
A structured document data processing apparatus characterized by comprising:

It is a figure which shows the basic composition of the data processing system in the structured document which becomes embodiment of this invention. It is a figure which shows the hardware structural example of the computer which implement | achieves the data processing system of the structured document which becomes embodiment of this invention. It is a figure which shows the example of a format setting of the application programming interface (API) which becomes embodiment of this invention. It is a figure which shows the example of a data structure of the compression object (management associative array) of the structured document which becomes embodiment of this invention. It is a figure which shows the example of an arrangement | sequence for the data which stored the record element of the compressed structured document which becomes embodiment of this invention (the example of the 1-associative arrangement | sequence). It is a figure which shows the example of an arrangement | sequence for the data which stored the record element of the compressed structured document which becomes embodiment of this invention (the example of the 2-normal arrangement | sequence). It is a figure which shows the management information at the time of expand | deploying the CSV conversion element for every record which becomes embodiment of this invention on a memory. It is a figure which shows the management information at the time of expand | deploying the CSV conversion element for every record which becomes embodiment of this invention on a memory (modified example of FIG.7 (c)). It is a figure which shows the example of a program (the 1-specific element correction) using API which becomes embodiment of this invention. It is a figure which shows the example of a program (the update of the 2-XML document) using API which becomes embodiment of this invention. It is a figure which shows the creation flow of the API object of the structured document which becomes embodiment of this invention. It is a figure which shows the flow of the open process of the CSV compression structured document file which becomes embodiment of this invention. It is a figure which shows the flow of the close process of the CSV compressed structured document file which becomes embodiment of this invention. It is a figure which shows the flow of the record number read-out process of the compressed structured document file which becomes embodiment of this invention. It is a figure which shows the flow of the read-out process of the element content of the structured document which becomes embodiment of this invention. It is a figure which shows the flow of the write-in process of the element content of the structured document which becomes embodiment of this invention. It is a figure which shows the structure of the structured document at the time of compressing the non-access object element in prior invention. It is a figure which shows the basic composition (Example 2) of the fraud prevention system which becomes embodiment of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 Data processing program 11 Element division means 12 Compression / decompression conversion means 13 Element judgment means 14 Element access means 20 API software (XML parser)
30 Application software 40 End user 50 Application developer 100 Computer 101 CPU
102 Memory 103 Input Device 104 Output Device 105 Auxiliary Storage Device 106 Medium Drive Device 107 Portable Recording Medium 108 Network Connection Device 109 Bus

Claims (5)

A data processing method for structured documents configured in record format,
An element partitioning step for grouping a plurality of elements in the record in the structured document into a first element to be individually accessed and a second element to be collectively accessed;
A compression conversion step of compressing and converting the elements in the target record as the second element into a single element by connecting them with a delimiter, and storing in a memory with a header indicating the type of the element;
When accessing a plurality of elements in the record by application software, the header information is first read, and whether or not the element corresponds to the second element compressed and converted in the compression conversion step is determined. An element determination step for determining from header information;
When the element in the record does not correspond to the second element, the content of the element is accessed as it is, and when the element in the record corresponds to the second element, it is expressed by the delimiter An element access step for accessing the element contents after being decomposed into individual element contents and expanded on the memory;
A structured document data processing method characterized by causing a computer to execute the above.   2. The structured document according to claim 1, wherein when the structured document is expanded in a memory, the structured document file is read as stream data, and each element of the structured document is assigned to an array and stored. Document data processing method.   In the expansion of the structured document into the memory, a first array in which the first elements and the second elements collectively represented by the delimiters are assigned to each record, and the second elements are collectively The structured document data processing method according to claim 1, further comprising: a second array in which element contents are divided into individual element contents and assigned. A structured document data processing program configured in record format,
On the computer,
An element partitioning step for grouping a plurality of elements in the record in the structured document into a first element to be individually accessed and a second element to be collectively accessed;
A compression conversion step of compressing and converting the elements in the target record as the second element into a single element by connecting them with a delimiter, and storing in a memory with a header indicating the type of the element;
When accessing a plurality of elements in the record by application software, the header information is first read, and whether or not the element corresponds to the second element compressed and converted in the compression conversion step is determined. An element determination step for determining from header information;
When the element in the record does not correspond to the second element, the content of the element is accessed as it is, and when the element in the record corresponds to the second element, it is expressed by the delimiter An element access step for accessing the element contents after being decomposed into individual element contents and expanded on the memory;
Data processing program for structured documents that executes A structured document data processing device configured in a record format,
Element classification means for grouping a plurality of elements in the record in the structured document into a first element to be individually accessed and a second element to be collectively accessed;
Compression conversion means for compressing and converting the elements in the target record as the second element into a single element by connecting them with a delimiter, and storing in a memory with a header indicating the type of the element;
When accessing a plurality of elements in the record by application software, the header information is first read, and whether or not the element corresponds to the second element compressed and converted in the compression conversion step is determined. Element judging means judging from header information;
When the element in the record does not correspond to the second element, the content of the element is accessed as it is, and when the element in the record corresponds to the second element, it is expressed by the delimiter Element access means for accessing the element contents after being decomposed into individual element contents and expanded on a memory;
A structured document data processing apparatus characterized by comprising:

Images