JP2020047212A - Data registration device and data registration method - Google Patents

Abstract

To perform data registration capable of effectively utilizing data by dealing with diverse data structure and presenting data structure truly useful to a user.SOLUTION: A data registration device for registering data structure of data to be utilized holds a data structure table, a tentative data structure table, and a data structure utilization history, registers the data structure of data to be utilized in the tentative data structure table as tentative data structure when the data structure of data to be utilized is not fitted to data structure registered in the data structure table, refers to a usage situation of the data structure of the data structure utilization history, and finally registers the tentative data structure registered in the tentative data structure table in the data structure table.SELECTED DRAWING: Figure 9

Description

  The present invention relates to a data registration device and a data registration method, and more particularly to a data registration device and a data registration method suitable for effectively utilizing data based on the data structure by providing a type for registration of the data structure.

  Studies are underway on a data sharing and utilization platform that uses data provided by various organizations, such as open data, across fields regardless of the field.

  In general, open data is "data that is published in a data format suitable for machine interpretation and that can be used with secondary usage rules". What to do ". The promotion of the use of public data, that is, the promotion of “open data”, will promote the transparency and reliability of the government, promote public participation and public-private collaboration, and revitalize the economy and improve the efficiency of the government. Is expected.

  However, there is a problem that various formats and data structures are present in the current open data because data is individually provided from various organizations. For this purpose, a DMD (Data Model Description: Data Model Description Package) for describing a data structure is provided on a common vocabulary base for handling data in common. DMD is a package for describing a data model designed for the purpose of sharing a data model between parties performing data exchange, between data creators, and between a data creator and a data user. By describing the structure definition and the data model that specifies input restrictions and usable character sets for each item of data, it becomes useful information when a computer processes data, and humans can correctly understand the contents of data. The specifications are understandable.

  Also, in order to systematically describe a model of an object, for example, in Patent Document 1, a concept called “ontology” is presented, and the ontology is described in metadata to solve problems such as compatibility. , And discloses a technique for managing data.

JP 2001-92727 A

  In the use of data based on the DMD, it is possible to use the DMD as a guide for the structure of data to be created, but the problem is that not all data already provided by the package provided by the DMD is compatible. There is. For this reason, data registration occurs every time the data structure is different, and it is difficult for the user to select a new valid data structure, which makes it difficult to use a new data structure design. Further, the DMD does not consider the concept of the number of uses of the data structure.

  Patent Document 1 does not consider a viewpoint of teaching what data structure is useful for a user. Further, according to the data management described in Patent Literature 1, when selecting metadata to be used in the use of metadata, the feedback of the user is determined below, but at first there is no feedback from the user. If the user has not reported a problem, there is a problem that the evaluation index is not accumulated.

  SUMMARY OF THE INVENTION An object of the present invention is to provide a data registration that can present a truly useful data structure to a user while coping with various data structures even when the feedback situation of a user is not clear, so that data can be effectively used. An apparatus and a method thereof are provided.

  The configuration of the data registration device of the present invention is preferably a data registration device for registering a data structure of data to be used, the data registration device holding a data structure table, a temporary data structure table, and a data structure use history, and When the data structure of the data to be used does not conform to the data structure registered in the data structure table, the data structure of the data to be used is registered as a temporary data structure in the temporary data structure table, and the data structure of the data structure use history is stored. The temporary data structure registered in the temporary data structure table is permanently registered in the data structure table by referring to the usage status of the temporary data structure table.

  ADVANTAGE OF THE INVENTION According to this invention, even when the feedback situation of a user is not clear, it is possible to present a truly useful data structure to a user while coping with various data structures, and to enable data to be used effectively. An apparatus can be provided.

1 is an overall configuration diagram of a data registration system. FIG. 2 is a functional configuration diagram of the data registration device. FIG. 3 is a hardware / software configuration diagram of the data registration device. FIG. 4 is a diagram illustrating an example of a data structure table. It is a figure showing an example of a temporary data structure table. It is a figure showing an example of a data structure use history. It is the figure which represented typically the image of the data structure description. It is a flowchart which shows the outline | summary of the data registration process of a data registration system. It is a flowchart which shows the process which registers a temporary data structure as this structure. It is an image figure of a data structure description when a temporary data structure is integrated and a new data structure is created.

  An embodiment according to the present invention will be described below with reference to FIGS.

First, the configuration of the data registration system will be described with reference to FIGS.
As shown in FIG. 1, the data registration system has a form in which a data registration device 100, a database server 400, a data registration terminal 710, and a data use terminal 720 are connected via a network 5. The network 5 may be a global network such as the Internet, or a local LAN (Local Network).

  The data registration device 100 is a device that registers a data structure in response to a request from a user and allows the user to use the data. The database server 400 is a server that manages input / output and processing of the external data structure DB (DataBase) 500 and the external data 600. The data registration terminal 710 is a client terminal into which a user inputs necessary data and commands to register the external data 600. The data use terminal 720 is a client terminal for inputting necessary data and commands in order for the user to use the registered external data 600.

  The external data structure DB 500 is a public database that stores data structures handled by the data registration system. The external data 600 is public data that can be registered and used by a user. In the present embodiment, the database server 400 is described to manage the external data structure DB 500 and the external data 600. However, this function may be performed by the data registration device 100.

Next, a functional configuration of the data registration device will be described with reference to FIG.
As shown in FIG. 2, the data registration device 100 includes functional units such as a data search unit 110, a data provision unit 120, a data registration unit 130, a data structure management unit 140, and a storage unit 200.

  The data search unit 110 is a functional unit for a data user to search data registered in the data registration system from the data use terminal 720. The data providing unit 120 is a functional unit that provides the data of the external data 600 to the data user via the data using terminal 720. The data registration unit 130 is a functional unit for the data registrant to register the external data 600 in the data registration system using the data registration terminal 710. The data structure management unit 140 is a functional unit that manages acquisition, creation, registration, and the like of a data structure that stores the registered external data 600. The storage unit 200 is a functional unit that stores data handled by the data registration device 100.

  Further, the data structure management unit 140 includes a data structure acquisition unit 141, a data structure selection 142, a temporary data structure processing unit 143, a temporary data structure registration unit 144, a data structure use recording unit 145, and a data structure main registration unit 146. It has a functional unit.

  The data structure acquisition unit 141 is a functional unit that acquires a data structure from the external data structure DB 500, the data structure table 220, and the temporary data structure table 230. The data structure selection unit 142 is a functional unit that selects a data structure to be associated with the external data 600 to be registered from the data structures acquired by the data structure acquisition unit 141. There are cases where the data registrant specifies and cases where the system selects automatically. The temporary data structure processing unit 143 is a functional unit that creates or deletes a new data structure as a temporary data structure by extending data elements and the like from a base data structure. The temporary data structure registration unit 144 is a functional unit that registers the temporary data structure created by the temporary data structure processing unit 143 in the temporary data structure table 230. The data structure use recording unit 145 is a functional unit that records, as a history, the correspondence of the data structure when the data registrant 102 registers the external data 600. The data structure main registration unit 146 is a functional unit that periodically starts and integrates the frequently used temporary data structure table 230 and registers it in the data structure table 220 or the external data structure DB 500.

  The data stored in the storage unit 200 includes registered data information 210, a data structure table 220, a temporary data structure table 230, and a data structure use history 240. The registration data information 210 records information on the external data 600 registered by the data registrant. The registered contents include a data name, a data acquisition method (e.g., a URI (Uniform Resource Identifier) link), additional information for searching data, and a structure of the external data 600 such as a data structure table 220 and a temporary data structure table. There is a mapping file for storing as a structure defined in 230. The data structure table 220 records a data structure indicating the structure of external data registered by the user, and may be considered to internally store the same data as the external data structure DB 500. Depending on the implementation form of the system, only the external data structure DB 500 does not have the data structure table 220 in the storage unit 200 of the data registration device 100. Conversely, only the internal data structure table 220 is used and the external data structure DB 500 is used. There are cases where the data is not used, and cases where the data complement each other. The temporary data structure table 230 is created when the data registration unit 130 registers the external data 600 and the data structure registered in the external data structure DB 500 or the data structure table 220 is insufficient for use. Is recorded as a temporary data structure. The temporary data structure may be re-registered in the data structure table 220 or the external data structure DB 500 when certain conditions are satisfied (details will be described later). The data structure usage history 240 records a history associated with the data structure table 220 and the temporary data structure table 230 when the external data 600 is registered in the data registration device 100.

Next, the hardware and software configuration of the data registration device will be described with reference to FIG.
The hardware configuration of the data registration device 100 is realized by, for example, an information processing device such as a general personal computer as shown in FIG.

  The data registration device 100 has a form in which a CPU (Central Processing Unit) 802, a main storage device 804, a network I / F 806, a display I / F 808, an input / output I / F 810, and an auxiliary storage I / F 812 are connected by a bus. ing.

  The CPU 802 controls each unit of the data registration device 100, loads necessary programs into the main storage device 804, and executes the programs.

  The main storage device 804 is generally formed of a volatile memory such as a RAM, and stores a program executed by the CPU 802 and data to be referred to.

The network I / F 806 is an interface for connecting to the network 5.
The display I / F 802 is an interface for connecting a display device 820 such as an LCD (Liquid Crystal Display).
The input / output I / F 810 is an interface for connecting an input / output device. In the example of FIG. 3, a keyboard 830 and a mouse 832 as a pointing device are connected.
The auxiliary storage I / F 818 is an interface for connecting an auxiliary storage device such as a hard disk drive (HDD) 850 or a solid state drive (SSD).

  The HDD 850 has a large storage capacity, and stores a program for executing the present embodiment. In the data registration device 100, a data search program 850, a data provision program 852, a data registration program 853, and a data structure management program 854 are installed.

The data search program 850, the data provision program 852, the data registration program 853, and the data structure management program 854 function to realize the functions of the data search unit 110, the data provision unit 120, the data registration unit 130, and the data structure management unit 140, respectively. Department.
The HDD 850 stores registration data information 210, a data structure table 220, a temporary data structure table 230, and a data structure use history 240.

Next, a data structure used in the data registration system will be described with reference to FIGS.
The data structure table 220 is a table for registering a data structure. As shown in FIG. 4, the data structure table 220 has fields of a data structure ID 501, a registration date 502, and a data structure description 503. The data structure ID 501 is a field for storing an identifier that uniquely identifies a data structure. The registration date 502 stores the date when the data structure represented by the record was registered. The data structure description 503 is a field that specifically describes the data structure represented by the record. The data structure is described in a language such as XML (Extensible Markup Language), for example.

  The temporary data structure table 230 is a table for registering a temporary data structure, and as shown in FIG. 5, has fields of a temporary data structure ID 601, an original data structure ID 602, a registration date 502, and a data structure description 503.

  In the present embodiment, the concept of a data structure of two categories is adopted, and a temporary data structure is a data structure (hereinafter, also referred to as “the present data structure” when used in comparison with the temporary data structure). This is a data structure registered as a temporary one before the main registration.

  The temporary data structure ID 601 is a field for storing an identifier for uniquely identifying a data structure. The original data structure ID 602 is a field for storing an identifier for uniquely identifying the original data structure associated with the temporary data structure. When the temporary data structure is registered, the ID of the standard data structure is stored in the data structure table 220 when the corresponding original data structure does not exist in the data structure table 220. The registration date 603 stores the date when the temporary data structure represented by the record was registered. The data structure description 503 is a field that specifically describes a temporary data structure represented by the record.

  The data structure use history 240 is a table for storing a history using a data structure and a temporary data structure. As shown in FIG. 6, each of a data ID 701, a data structure use history ID 702, a data structure ID 703, and a use date 702 is used. Has fields.

  The data ID 701 is a field for storing an identifier for uniquely identifying data created using a data structure. The data structure use history ID 702 is a field for storing an identifier that uniquely identifies a use history of the data structure. The data structure ID 703 is a field for storing an identifier for uniquely identifying the data structure (the present data structure) or the temporary data structure (that is, the ID stored in the data structure ID 501 in FIG. 4 and the temporary data structure ID 601 in FIG. 5). It is. The use date and time 702 is a field for storing the date and time when the data structure (the present data structure) or the temporary data structure of the record is used.

  FIG. 7 illustrates an image of the data structure description. The data structure description in this example includes items of a name, an address, and a description, and the item of the address further includes items of the whole, a prefecture, a city, a municipal office, and the following addresses. A description of such a data structure is stored in the field of the data structure description 503 of the data structure table 220 and the field of the data structure description 604 of the temporary data structure table 230.

Next, the processing of the data registration system will be described with reference to FIGS.
Here, an example will be described in which the user checks whether there is a usable data structure when using data, and registers a new data structure when there is no usable data structure.

  First, the data structure acquisition unit 141 of the data structure management unit 140 acquires a data structure (this data structure) or a temporary data structure from the external data structure DB 500, the data structure table 220, and the temporary data structure table 230 (S301). Next, the data structure selection unit 142 of the data structure management unit 140 selects the data structure (this data structure) or the temporary data structure to be associated with the external data 600 to be registered from the acquired data structures. (S302). Next, the data structure management unit 140 determines whether or not the selected data structure (the present data structure) or the provisional data structure can be used as it is (S303). If the data structure is used as it is (S303: YES), the process proceeds to S306. move on. Otherwise (S303: NO), the temporary data structure processing unit 143 creates a temporary data structure based on the selected data structure (S304), and the temporary data structure registration unit 144 deletes the created temporary data structure. It is registered in the temporary data structure table 230 (S305). Next, the data structure use recording unit 145 registers the use of the data structure as a history in the data structure use history 240 (S306).

Next, a process of registering a temporary data structure as a main structure will be described with reference to FIG.
The process of registering this temporary data structure as the main structure is periodically started and operated by a timer or the like.

  First, the data structure acquisition unit 141 of the data structure management unit 140 extracts the data structure ID 501 of the data structure table 220 shown in FIG. 4, and sets it as X (S401).

  Next, the data structure selection unit 142 of the data structure management unit 140 selects a temporary data structure (entry of the temporary data structure table 230) whose original data structure ID 602 of the temporary data structure table 230 is X (S402). ).

  Next, the data structure management unit 140 uses the data structure use history 240 to total the number of times of use of each temporary data structure and the original data structure selected in S402 (S403).

  If the total number of uses of the temporary data structure and the original data structure within the predetermined time T is equal to or more than the predetermined M times (S404: YES), the process proceeds to S405, otherwise (S404: NO), Proceed to S408.

  Next, the data structure acquisition unit 141 extracts a temporary data structure in which the number of uses within the predetermined time T is equal to or more than the predetermined N times (S405).

  Next, the data structure main registration unit 146 creates a new data structure by integrating the data structures extracted in S405, and registers the new data structure in the data structure table 220 or the external data structure DB 500 (S406). A specific example of creating a data structure will be described later in detail.

  Lastly, the temporary data structure processing unit 143 deletes, from the remaining temporary data structures not extracted in step 406, those included in the created new data structure and those inconsistent with the new data structure (S407). Here, the inconsistency with the new data structure means, for example, that the tree structure representing the inclusion of the item does not match. As described above, by deleting the temporary data structure that is no longer needed due to the created new data structure, the required data capacity can be reduced.

  Next, it is determined whether there is an unprocessed main data structure (entry of the data structure table 220) (S408). If there is an unprocessed main data structure (S408: YES), the process proceeds to S401. If there is no unprocessed data structure (S408: NO), the process ends.

Next, a specific example of a process for creating a new data structure by integrating temporary data structures will be described with reference to FIG.
It is assumed that there is an original DMD 800, from which a temporary DMD1 (810), a temporary DMD2 (811), and a temporary DMD3 (812) are generated as a temporary data structure.

  The original DMD 800 has items of a name 800a and an address 800b. The temporary DMD1 (810) has the whole, the prefecture, the municipalities, and the subsequent addresses as subordinate items of the item of the address 810b. The temporary DMD 2 (811) has a formal name and a nickname as subordinate items of the item of the name 811a. The temporary DMD 3 (812) has a prefecture and a street name as lower items of the address 812b. Further, the temporary DMD 2 (811) and the temporary DMD 3 (812) have a description 810c and a description 812c that did not exist in the original DMD 800, respectively.

  At this time, the data structure main registration unit 146 of the data registration apparatus 100 uses the temporary DMD 1 (810), the temporary DMD 2 (811), and the temporary DMD 3 (812) generated from the original DMD 800 to output the common items of name, address, The description is taken out, and DMD1 (820) is generated as a new data structure.

Next, the data structure main registration unit 146 takes in the item of the name 811a of the temporary DMD2 (811), and generates the DMD2 (821) including the official name and the nickname in the lower items of the name 821a.
Next, the data structure main registration unit 146 takes in the item of the address 810b of the temporary DMD1 (810) and the item of the address 812b of the temporary DMD3 (812), and stores the whole, the prefecture, the municipalities in the lower items of the address 822b. , DMD3 (822) including the subsequent address and street name.

  As described above, according to the data registration system of the present embodiment, first, the data structure used by the user is registered as a temporary data structure, and the temporary data structure is used as a temporary data structure within a predetermined period. When there are many, it is registered as this data structure.

  Therefore, it can be said that the present data structure is a structure that is recommended to the user and should be widely spread as a structure that is frequently used and popular. Further, when a data structure is standardized to create a de facto standard in the industry, the fact that the data structure is registered is an index.

5 Network 100 Data registration device 400 Database server 500 External data structure DB
600 external data 710 data registration terminal 720 data usage terminal 210 registration data information 220 data structure table 230 temporary data structure table 240 data structure usage history

Claims (8)

A data registration device for registering a data structure of data to be used,
A data structure table,
A temporary data structure table,
Data structure usage history and
When the data structure of the data to be used does not conform to the data structure registered in the data structure table, register the data structure of the data to be used as a temporary data structure in the temporary data structure table,
A data registration device, wherein a temporary data structure registered in the temporary data structure table is permanently registered in the data structure table with reference to a use state of a data structure of the data structure use history. According to the data structure use history, the number of times the temporary data structure is used within a predetermined time is extracted as a temporary data structure whose number is equal to or more than a predetermined number,
2. The data registration apparatus according to claim 1, wherein the extracted temporary data structure is permanently registered in the data structure table. A new data structure is created by integrating the extracted temporary data structures,
2. The data registration apparatus according to claim 1, wherein the new data structure is permanently registered in the data structure table.   4. The data registration apparatus according to claim 3, wherein a temporary data structure included in the created new data structure and a temporary data structure inconsistent with the created new data structure are deleted. A data registration device method in which a data registration device registers a data structure of data to be used,
Wherein the data registration device holds a data structure table, a temporary data structure table, and a data structure use history;
When the data structure of the data to be used is not adapted to the data structure registered in the data structure table, the data registration device registers the data structure of the data to be used as a temporary data structure in the temporary data structure table. Steps to
The data registration device refers to the use status of the data structure of the data structure use history, and permanently registers the temporary data structure registered in the temporary data structure table in the data structure table. Characteristic data registration method. In the step of the data registration device, referring to the use status of the data structure of the data structure use history, and temporarily registering the temporary data structure registered in the temporary data structure table in the data structure table,
Further, the data structure use history is used to extract a temporary data structure in which the number of times the temporary data structure is used within a predetermined time is equal to or more than a predetermined number,
6. The data registration method according to claim 5, wherein the extracted temporary data structure is permanently registered in the data structure table. In the step of the data registration device, referring to the use status of the data structure of the data structure use history, and temporarily registering the temporary data structure registered in the temporary data structure table in the data structure table,
A new data structure is created by integrating the extracted temporary data structures,
6. The data registration method according to claim 5, wherein the new data structure is permanently registered in the data structure table. In the step of the data registration device, referring to the use status of the data structure of the data structure use history, and temporarily registering the temporary data structure registered in the temporary data structure table in the data structure table,
8. The data registration method according to claim 7, wherein a temporary data structure included in the created new data structure and a temporary data structure inconsistent with the created new data structure are deleted.

Images