JPWO2015049769A1 - Data analysis system and method - Google Patents

Abstract

The data analysis system extracts and extracts metadata from the non-structured data acquired by the non-structured data acquisition unit that acquires non-structured data corresponding to the structural data specified in the input analysis input information. The metadata extraction unit that creates the hierarchy management metadata indicating the hierarchical structure between the selected metadata, the target axis specified in the input analysis input information, and the hierarchy management metadata as the analysis result corresponding to the target analysis accuracy The analysis data is created step by step, and based on the created analysis data, an important column list is created that includes metadata that contributes to the improvement of analysis accuracy when the analysis accuracy exceeds the target analysis accuracy. And an analysis accuracy evaluation unit that obtains the analysis accuracy with reference to the analysis data created by the data analysis unit.

Description

  The present invention relates to a data analysis system and method, and more particularly, to a data analysis system and method for combining unstructured data with structural data.

  Patent Document 1 discloses a technique for performing data analysis using unstructured data related to structural data. Patent Document 1 describes that important keywords are extracted from text data that is unstructured data, and at least one hierarchical structure is selected as an aggregation key based on the important keywords from the hierarchical structure generated from the structural data. Aggregates text data based on the co-occurrence table created from the calculated aggregation key and keyword, aggregates the structural data based on the aggregation key, and integrates the aggregated structural data with the aggregated text data This is a technology for creating an integrated database.

JP 2010-205077 A

  Conventionally, various data are managed as electronic data, and it is useful that such electronic data is collected and used for analysis. Electronic data includes structural data having structural information and unstructured data whose format is not fixed.

  The technique of Patent Document 1 associates structural data and non-structural data (text file) using a co-occurrence relationship, but has not yet analyzed the meaning of the associated result.

  In data analysis, what is the purpose and what level of accuracy is required is important. Otherwise, it will be unclear what the analysis results mean. Moreover, in order to clarify the meaning of the analysis result, it is necessary to obtain a simpler (clear) analysis result.

  The disclosed data analysis system extracts metadata from the non-structured data acquired by the non-structured data acquisition unit that acquires non-structured data corresponding to the structural data specified in the input analysis input information. A metadata extraction unit for creating a hierarchical management metadata indicating a hierarchical structure between the extracted metadata, a hierarchical management metadata as an analysis result corresponding to the target axis and target analysis accuracy specified in the input analysis input information Analytical data is created step by step, and based on the created analytical data, an important column list that includes metadata that contributes to improving analytical accuracy when the analytical accuracy exceeds the target analytical accuracy And a data analysis unit that creates an analysis accuracy by referring to the data for analysis created by the data analysis unit.

  According to the present invention, the data analysis system can output a simpler (clear) analysis result.

It is a figure which shows the structural example of an analysis system. It is an example of the analysis input information input into an analysis system. It is an example of structure data. It is a process flowchart of an unstructured data acquisition part. It is an example of a summary dictionary. It is an example of a positive reference dictionary. It is an example of an analysis and reliability calculation rule. It is a process flowchart of a metadata extraction part. It is an example of extraction of 1st hierarchy metadata. It is a reliability calculation table. It is an example of hierarchy management metadata. This is an example of hierarchical management metadata illustrated in a tree shape. It is a processing flowchart of a data analysis part. It is an example of a change of the data for analysis. It is an example of an accuracy improvement rate management table. It is an example of an important column list. It is a processing flowchart of an analysis accuracy evaluation part. It is an example of a screen displayed on an input / output device.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 shows a configuration example of a data analysis system (hereinafter, analysis system). The analysis system includes a non-structured data acquisition unit 11 that acquires non-structure data corresponding to the structure data 16 specified in the input analysis input information 10, various dictionaries from the non-structure data acquired by the non-structure data acquisition unit 11 Extract metadata using, create a hierarchical structure between the extracted metadata, input metadata extraction unit 12, structure data 16 and hierarchy management metadata 17 to create hierarchy management metadata 17, and hierarchy management While referring to the metadata 17 and creating the analysis data 18 step by step, the accuracy improvement rate management table 19 and the important column list as analysis results corresponding to the target axis and analysis accuracy specified in the input analysis input information 10 A data analysis unit 13 that creates 20 and an analysis accuracy evaluation unit 15 that evaluates the analysis accuracy with reference to the analysis data 18 created by the data analysis unit 13 are provided.

  The analysis system includes a CPU that executes processing units such as an unstructured data acquisition unit 11, a metadata extraction unit 12, a data analysis unit 13, and an analysis accuracy evaluation unit 15, and analysis input information 10, structural data 16, hierarchical management meta data. It has a memory to store data 17, analysis data 18, accuracy improvement rate management table 19, important column list 20, etc., and operates by a computer connected to an input / output device that inputs analysis input information 10 and outputs analysis results .

  In FIG. 1, a work area, various dictionaries, files, and the like used by each processing unit, which are not shown, are stored in a memory or a storage device connected to the outside.

  FIG. 2 shows an example of analysis input information 10 input from an input / output device (not shown) to the analysis system. The analysis input information 10 includes a structure data table ID 101 for uniquely identifying the analysis target structural data, an analysis target accuracy 102 indicating the strength of the relationship between the analysis target structural data and metadata described later, and an analysis target accuracy 102. , The recognition level limit value 103 that specifies the upper limit of the number of times to follow the metadata hierarchy when the analysis is repeated, and the target axis column 104 that indicates the column of the structural data to be analyzed. The recognition level is a hierarchical level of metadata having a hierarchical structure, which will be specifically described later.

  FIG. 3 shows an example of the structure data. The structure data shown in FIG. 3 is an example of the structure data Table-1 (16) specified by the table ID 101 of the analysis input information 10. The structural data 16 here includes a patient name 161, a treatment cost 162, a disease name 163, and an age 164. Based on this structural data, the analysis system performs an analysis on the treatment cost 162 indicated by the target axis column 104 of the analysis input information 10.

  FIG. 4 shows a process flowchart of the unstructured data acquisition unit 11. The unstructured data acquisition unit 11 inputs the analysis input information 10 from the input device (S110). The structure data 16 corresponding to the table ID 101 of the analysis input information 10 is acquired and stored (S111). The structural data to be acquired is structural data 16 as shown in FIG. 3 and may be stored in advance in a storage device in the analysis system or stored in another system (here, a hospital accounting system). May be.

  The unstructured data acquisition unit 11 searches for and associates unstructured data corresponding to each record of the structure data 16 (S112). The unstructured data searched by the unstructured data acquisition unit 11 is data (hereinafter referred to as a file) that is generally managed as a file by the file management system, such as a text file, an audio file, and a video file. The file to be searched may be stored in advance in a storage device in the analysis system, or may be stored in another system (in this example, a hospital chart management system). The key for searching is the contents of the column of each record of the structure data 16. In the example of the structure data 16 shown in FIG. 3, the patient name 161, the disease name 163, or the age 164 (OR search of the contents of each column), and in the first (# 1) record, the patient name 161 is A, the disease name 163 is influenza and age 164 is 30 years old. The treatment cost 162 may be used as a search key, but the treatment cost 162 may be excluded because it is a column to be analyzed, and is excluded here. An ID (# in FIG. 3) for identifying the record of the structure data 16 may be included as a key for searching. This is because an ID (#) for identifying structure data may be included in the search target file.

  The association between each record of the structure data 16 and the searched file will be described. As an easy-to-understand method, the searched file is read into the analysis system, and the structure data 16 record including the search key is linked to the searched file using a correspondence table or the like. Simply, a correspondence table between each record of the structure data 16 and a path name including a file name that can identify the searched file may be created. There are various other association methods, but they may be selected depending on the ease of system construction and operation.

  The unstructured data acquisition unit 11 activates the metadata extraction unit 12 to extract metadata from the searched file corresponding to each record of the structure data 16 (S113). A parameter when starting the metadata extraction unit 12 is a correspondence table between each record of the structure data 16 and the searched file.

  Before describing the processing of the metadata extraction unit 12, data and rules used by the metadata extraction unit 12 will be described. The metadata extracted by the metadata extraction unit 12 has a hierarchical structure. The metadata of the lowest hierarchy is called first hierarchy metadata, and the metadata of the hierarchy above is sequentially called second hierarchy metadata, third hierarchy metadata,. A recognition level, which will be described later, corresponds to a metadata hierarchy. For example, recognition level 1 corresponds to first hierarchy metadata.

  The first hierarchy metadata is a so-called keyword. Although not shown, the analysis system has a keyword dictionary. The keyword dictionary is created in advance based on a term dictionary in a field such as medicine. The term dictionary is not limited to medical fields, but includes nouns such as disease names as terms in the field, but few adjectives and adverbs that are frequently used in the field. Therefore, a keyword dictionary including terms sufficient for analysis by the analysis system is prepared in advance.

  FIG. 5 shows an example of the summary dictionary 500. The summary dictionary 500 is used for acquiring metadata of a higher hierarchy from metadata of a certain hierarchy. Here, the description will be made assuming that the second hierarchy metadata 502 is used to acquire from the first hierarchy metadata 501. The first hierarchy metadata 501 is a term included in the keyword dictionary as described above. The second hierarchy metadata 502 may be a term included in the keyword dictionary, but is included in the keyword dictionary such as an abstract concept and a concept including a term included in the keyword dictionary rather than a term included in the keyword dictionary. It is a term that represents the general concept of the term. From another viewpoint, the second hierarchy metadata 502 may be a term having a summary or combined meaning of the first hierarchy metadata 501. Here, in the summary dictionary 500 of FIG. 5, the superordinate concept of “pyretic fever”, “early”, “effective”, “doctor”, and “treatment” is “effect”. Similarly, the superordinate concept of “nausea” and “headache” is “side effect”.

  FIG. 6 shows an example of the positive reference dictionary 600. The positive reference dictionary 600 is a correspondence table of the term 601 and the positive score 602. The positive score 602 indicates the positive meaning of the term 601 as a positive number and the negative meaning as a negative number. The strength is represented by the value. How to use the positive reference dictionary will be described later. The positive score for terms not listed in the positive reference dictionary is zero. Note that the positive degree reference dictionary is stored in advance in the analysis system and reflects the learning result as the analysis system is operated. Reflecting the learning results includes changing the positive score and adding / deleting terms.

  FIG. 7 shows an example of the analysis / reliability calculation rule. Rule A shown in FIG. 7A is an example of a rule for analyzing the second hierarchy metadata, and rule B shown in FIG. 7B is an example of a rule for analyzing the third hierarchy metadata. is there. Rule A uses a hierarchical metadata name and the number of occurrences in the file from which the metadata was extracted as input, and applies calculation rule A-1 to find the upper hierarchical metadata and upper hierarchical metadata values for that hierarchy. In other words, the calculation rule A-2 is applied to calculate the reliability of the upper layer metadata.

  Rule B shown in FIG. 7 (B) receives the second hierarchy metadata value as input, applies calculation rule B-1 to obtain the third hierarchy metadata and the third hierarchy metadata value, and calculates rule B- It is an example of a rule that applies 2 and calculates the reliability of the third hierarchy metadata value. The application of the analysis / reliability calculation rule will be described in the process of the metadata extraction unit 12.

  FIG. 8 shows a processing flowchart of the metadata extraction unit 12. The metadata extraction unit 12 repeatedly executes S120 to S122, but the illustration of the repetition is omitted for easy understanding. The repetition is to repeat the file (unstructured data) associated in S112 with respect to each record (# 1 to # 4) of the structure data 16. For example, if a plurality of files are associated with the record # 1 of the structure data 16, the process is repeated for each of the files, and the repetition for the files is repeated for each record (# 1 to # 4). S120 to S122 of FIG. 8 indicate processing related to a certain file associated with a certain record of the structure data 16.

  The metadata extraction unit 12 extracts the first hierarchy metadata from the associated file using the content of each column of the processing target record of the structure data 16 and the keyword dictionary, and extracts each first hierarchy metadata Is the first hierarchical metadata value (S120). In extracting the first hierarchy metadata, a keyword with an appearance number exceeding a predetermined value (threshold) or a predetermined number of keywords from the top of the appearance number is selected. The contents of each column of the processing target record of the structure data 16 are handled in the same manner as each keyword in the keyword dictionary. In this case, when the treatment cost 162 indicated by the target axis column 104 is included as a keyword, the relationship between the contents of the target axis column 104 and other keywords (first hierarchical metadata) becomes clear.

  FIG. 9 shows an example of extracting the first hierarchy metadata. FIG. 9A shows the chart of the patient name A associated with the record # 1 of the structure data 16 as the file # 1, and FIG. 9B shows the record # 2 of the structure data 16 The chart of patient name B associated with is shown as file # 2. The keywords indicated by the underline in the figure are extracted from the file # 1 and the file # 2 using natural language processing. At this stage, meaningful terms such as nouns, verbs, adjectives, and adverbs that can be keywords are extracted by morphological analysis. Particles and auxiliary verbs that have no meaning are not subject to extraction. In the example of FIG. 9, since the file # 1 and the file # 2 are charts that are text files, natural language processing is used. Or by converting the video into corresponding text (representing the content of the video), the same processing as in the case of the text file is performed.

  9A is a keyword related to the fever and X medicine of patient A from file # 1 (patient A's chart), and FIG. 9B is the progress information of patient B from file # 2 (patient B's chart). Keywords related to are extracted. The first hierarchy metadata is extracted from these extracted keywords with reference to the contents of each column of the processing target record of the structure data 16 and the keyword dictionary. An example of the extraction result is shown in the lower part of FIG.

  The first hierarchy metadata value will be described. FIG. 10 shows a reliability calculation table 1000. The reliability calculation table 1000 is created in the work area of the analysis system memory. The reliability calculation table 1000 includes a correspondence table 1001 between the first hierarchy metadata and the first hierarchy metadata value, the second hierarchy metadata, the second hierarchy metadata value, and its reliability 1002. The second hierarchy metadata, the second hierarchy metadata value and its reliability 1002 will be described later. The first hierarchy metadata value is the number of appearances of the first hierarchy metadata. In FIG. 10, as the correspondence table 1001, the first hierarchy metadata and the first hierarchy metadata values extracted from the file # 1 (patient name A medical record) are shown corresponding to FIG. 9A. For example, the first hierarchy metadata “Fever” shows that it has appeared 20 times in file # 1.

  The metadata extraction unit 12 calculates the second hierarchy metadata, its value, and its reliability 1002 based on the correspondence table 1001 of the first hierarchy metadata and the first hierarchy metadata value of the reliability calculation table 1000, Stored in the reliability calculation table 1000 (S121). Based on the analysis / reliability calculation rule shown in FIG. 7 (A), the metadata extraction unit 12 uses the summary dictionary 500, and from the correspondence table 1001 of the first hierarchy metadata and the first hierarchy metadata value, Second hierarchy metadata / value 1002 included in the upper hierarchy metadata 502 of the summary dictionary 500 is calculated.

  A specific example will be described. The rule A of the analysis / reliability calculation rule shown in FIG. 7A is applied to the contents of the correspondence table 1001 between the first hierarchy metadata and the first hierarchy metadata value. In the calculation rule A-1, the first hierarchy metadata having the maximum number of appearances in the input first hierarchy metadata is set as the second hierarchy metadata to which the first hierarchy metadata belongs, and the first hierarchy metadata. The rule which calculates | requires a 2nd hierarchy metadata value from is shown. The first hierarchy metadata with the maximum number of appearances, which is the first hierarchy metadata value of the correspondence table 1001, is “early”. Referring to the summary dictionary 500, the first hierarchy metadata “early” belongs to the second hierarchy metadata “effect”, so that the output second hierarchy metadata is “effect”. Further, “early” of the first hierarchy metadata having the maximum number of appearances is set as the second hierarchy metadata value (the metadata value here is not a numerical value but a character string).

  In order to calculate the reliability of the second hierarchy metadata value “early”, the calculation rule A-2 of the analysis / reliability calculation rule shown in FIG. 7A is used. The calculation rule A-2 is the number of appearances of the first hierarchy metadata specified in the second hierarchy metadata value obtained by the calculation rule A-1 as the number of appearances of the first hierarchy metadata belonging to the second hierarchy metadata. The value divided by the sum represents the reliability. Referring to the correspondence table 1001 of the first hierarchy metadata and the first hierarchy metadata value, the total number of appearances of the first hierarchy metadata belonging to the second hierarchy metadata “effect” (total of the first hierarchy metadata values) Is 111. Therefore, the reliability of the second hierarchy metadata value “early” is 80 / 111≈0.7.

  The reliability of the second hierarchy metadata, the second hierarchy metadata value, and the second hierarchy metadata value obtained as described above is stored in the second hierarchy metadata / value 1002 of the reliability calculation table 1000.

  Based on the analysis / reliability calculation rule shown in FIG. 7 (A), from the extracted keyword, which is the first hierarchy metadata name, and the first hierarchy metadata value, which is the number of appearances, using the summary dictionary 500, It has been described that the second hierarchy metadata and the second hierarchy metadata value of the metadata at the recognition level 2 are determined and the reliability is calculated. The calculation result is applied to a hierarchy management metadata model to be described later to create hierarchy management metadata. Here, as described above, the second hierarchy metadata is a term having a summary or combined meaning of the first hierarchy metadata immediately below the hierarchy, and the value (in the above example, “early”) is the second hierarchy. A metadata value. The reliability is a numerical value indicating the probability that each hierarchical metadata has the metadata value. In the above example, in the second layer metadata “effect”, the reliability represents the probability of the second layer metadata value “early”.

  Next, the metadata extraction unit 12 determines the third hierarchy metadata, the third hierarchy of the metadata at the recognition level 3 in the same manner as the second hierarchy metadata, the second hierarchy metadata value, and the reliability are derived. A metadata value and reliability are derived (S122). Apply the derivation result to the metadata management hierarchy model and retain the data as hierarchy management metadata.

  Similarly to the second hierarchy metadata, the third hierarchy metadata is a term having a meaning that summarizes the second hierarchy metadata, and the value thereof is the third hierarchy metadata value. Since the abstraction level of metadata differs depending on the hierarchy, a summary dictionary 500 is prepared for each hierarchy. By preparing the summary dictionary 500 in this way, the recognition level and metadata hierarchy can be made multi-tiered. The number of hierarchies is determined depending on the field to which the analysis system is applied. In addition, by preparing the contents of the keyword dictionary and summary dictionary 500 according to the characteristics of the field to which the analysis system is applied, the characteristics of the terminology as metadata of each hierarchy are adapted to the field to which the analysis system is applied. You can make it. As an example adapted to the field to which the analysis system is applied, the third hierarchy metadata value will be described.

  Similarly to the second hierarchy metadata value, the third hierarchy metadata value may be the second hierarchy metadata belonging to the third hierarchy metadata. However, here, the third hierarchy metadata value is changed from a viewpoint. , “Positive” and “Negative” indicating good or bad meaning. The reliability indicates the likelihood of the third hierarchy metadata value, similarly to the second hierarchy metadata value. Changing the viewpoint is because there is a desirable viewpoint depending on the field to which the analysis system is applied.

  Described below is derivation of the third hierarchy metadata, the third hierarchy metadata value, and the reliability to which the analysis / reliability calculation rule shown in FIG. 7B is applied. The calculation rule B-1 shown in FIG. 7 (B) refers to the positive reference dictionary shown in FIG. 6 and acquires the positive score 602 corresponding to the second hierarchy metadata value (term 601 in FIG. 6). If the sum of the positive score of all the second hierarchy metadata values is a positive number, positive is set as the third hierarchy metadata value. The third hierarchy metadata may be set using the summary dictionary 500, but may be set arbitrarily. Here, the third hierarchy metadata is called a summary, and is the highest hierarchy.

  In the calculation rule B-2 shown in FIG. 7B, if the third hierarchy metadata value is positive, the ratio of the second hierarchy metadata in which the positive score in all the second hierarchy metadata is positive, negative Then, it represents that the ratio of the 2nd hierarchy metadata in which the positive score in all the 2nd hierarchy metadata is negative is made into reliability. The calculation rule B-2 may be set so that the absolute value or the average value of the sum of the positive score is set as the reliability. Although description of specific numerical examples is omitted, the description will be continued assuming that the numerical values shown in the hierarchy management metadata 17 of FIG.

  Next, the metadata extraction unit 12 generates hierarchy management metadata 17 in which the metadata of the first hierarchy, the second hierarchy, and the third hierarchy and their reliability are input (S123). FIG. 11 shows an example of the hierarchy management metadata 17. The hierarchy management metadata 17 includes the first hierarchy 171 and the first hierarchy 171 extracted or calculated by the processes of S120 to S122 corresponding to the files (170) F1, F2, F3, and F4 associated with the records of the structure data 16. The metadata of the 2nd hierarchy 172 and the 3rd hierarchy 173 and those reliability are shown. In FIG. 11, the first hierarchy metadata 171 is combined with the second hierarchy metadata 172 (for example, patient name) so that the correspondence relationship between the first hierarchy metadata 171 and the second hierarchy metadata 172 can be understood. It is.

  FIG. 12 is an example in which the hierarchy management metadata 17 is illustrated in a tree shape. The diagram shown as # 3 in FIG. 12 is an example in which the third hierarchy metadata value corresponding to the file (170) F3 in FIG. 11 is negative. The diagram shown as # 4 in FIG. 12 is an example in which the third hierarchy metadata value corresponding to the file (170) F4 in FIG. 11 is positive. A description of the numerical values in FIGS. 11 and 12 is omitted.

  In addition, the example which derived | led-out the 2nd hierarchy metadata from the 1st hierarchy metadata and the 1st hierarchy metadata value which is the appearance frequency so far, and the 3rd hierarchy metadata from the 2nd hierarchy metadata was shown so far. In general, the number of hierarchies in the metadata management hierarchy model is arbitrary. Hierarchical management metadata that has a hierarchical structure between metadata groups by repeating generation of other metadata groups (higher metadata groups) from any metadata group based on any metadata group 17 can be generated. The number of hierarchies is determined according to the field to be analyzed by the analysis system and the desired analysis accuracy.

  As described above, the hierarchy extraction metadata 17 is output, and the metadata extraction unit 12 ends the process.

  Returning to the description of the unstructured data acquisition unit 11 in FIG. The unstructured data acquisition unit 11 outputs the input analysis information 10, the structure data 16, and the hierarchy management metadata 17 generated by the metadata extraction unit 12 to the data analysis unit 13 (S114), and activates the data analysis unit 13. To finish the process.

  FIG. 13 shows a processing flowchart of the data analysis unit 13. In response to the activation from the unstructured data acquisition unit 11, the data analysis unit 13 inputs analysis input information 10, structure data 16, and hierarchy management metadata 17. The structure data 16 is stored as analysis data 18. The analysis data 18 will be described later.

  The data analysis unit 13 sets the maximum value of the recognition level to the variable n of the recognition level (S130). The recognition levels 1, 2,... Correspond to the first hierarchy metadata, the second hierarchy metadata,... Of the hierarchy management metadata 17 shown in FIG. Since the present embodiment is an example up to the third hierarchy metadata as shown in FIG.

  The data analysis unit 13 acquires the metadata name corresponding to the recognition level n from the hierarchy management metadata 17 and creates a metadata name list (S131). The data analysis unit 13 acquires a value corresponding to the created metadata name list from the hierarchy management metadata 17, and adds the value to the analysis data 18 as a new column (S132).

  FIG. 14 shows a change example of the analysis data 18. In FIG. 14, reference numerals are omitted to avoid the figure from being difficult to see. In FIG. 14A, the contents of the structure data 16 input with the activation of the data analysis unit 13 are stored as analysis data 18. When the recognition level n = 3, the value added as a new column to the analysis data 18 is the value of the third hierarchy metadata, and the result added to the rightmost column of the analysis data 18 is shown in FIG. ).

  The data analysis unit 13 executes the analysis accuracy evaluation unit 15 using the analysis data 18 as a parameter (S133). The analysis accuracy evaluation unit 15 outputs the analysis accuracy of the analysis data 18. The processing of the analysis accuracy evaluation unit 15 will be described later.

  The data analysis unit 13 calculates an accuracy improvement rate from the previous analysis accuracy (of the previous loop in the loop of S131 to S140) (S134). When the recognition level n is the maximum recognition level, there is no previous analysis accuracy, so the accuracy improvement rate is calculated by setting the previous analysis accuracy to zero. The data analysis unit 13 stores the calculated accuracy improvement rate in the accuracy improvement rate management table (S135). The analysis accuracy evaluation unit 15 described later outputs the analysis accuracy as 50% when FIG. 14B is used as a parameter as the analysis data 18.

  FIG. 15 shows an example of the accuracy improvement rate management table 19. The accuracy improvement rate management table 19 is a correspondence table of the recognition level 1501, additional metadata 1502, analysis accuracy 1503, and accuracy improvement rate 1504. The data analysis unit 13 displays the accuracy level output at the time along with the analysis accuracy output by the analysis accuracy evaluation unit 15 and the added accuracy to the analysis data 18 in the corresponding column of the accuracy rate management table 19. Store.

  The data analysis unit 13 compares the analysis accuracy output from the analysis accuracy evaluation unit 15 with the analysis target accuracy 102 of the analysis input information 10 (S136). If the analysis target accuracy 102 is lower than the analysis accuracy output by the analysis accuracy evaluation unit 15 (if the analysis accuracy has achieved the analysis target accuracy 102), the process proceeds to S142. If the analysis target accuracy 102 is lower than the analysis accuracy, the process proceeds to S137.

  If the recognition level n is greater than or equal to the recognition level limit value 103 of the analysis input information 10, the data analysis unit 13 proceeds to S138. If the recognition level n is lower than the recognition level limit value 103, the analysis is not possible (141) and the process is terminated. For example, when the recognition level n is 3 and the recognition level limit value is 1, the process proceeds to S138.

  The data analysis unit 13 determines the metadata having the lowest reliability among the metadata added to the analysis data 18 (S138). When the analysis data 18 is shown in FIG. 14B, the added metadata is one of the third hierarchy metadata (summary). Therefore, the third hierarchy metadata (summary) is the metadata with the lowest reliability. Data. The reliability is a value to which the analysis and reliability calculation rules shown in FIG. 7 are applied. In FIG. 14B, the value in parentheses of the added third-layer metadata (summary) is 0.9 (in the figure, 0.9). is there.

  The data analysis unit 13 determines whether there is metadata at the recognition level immediately below the metadata determined in S138 (S139), and if there is, sets n-1 to the recognition level variable n (S140), Return to S131. If not, the process is terminated as an analysis impossible (S141). To determine whether there is a metadata having a recognition level immediately below the determined metadata, the hierarchy management metadata 17 may be referred to. However, since the minimum value of the recognition level (integer) is 1, n is 2 or more. It may be determined whether (greater than 1).

  The loop (repetition) from S131 of the data analysis unit 13 will be described. When n = 2 in S140, the data analysis unit 13 refers to the second hierarchy metadata of the hierarchy management metadata 17 in S131, and creates a new metadata name list {drug name, patient name, effect, side effect }. Corresponding to the new metadata name list {drug name, patient name, effect, side effect}, in S132, when the recognition level is n = 2, the value of the second layer metadata is added to the analysis data 18 as a new column. The results obtained are shown in FIG. As shown in FIG. 14 (C), the patient name is included in the metadata name list, but the patient name is included in the analysis data 18 as one of the structural data 16, so it is not added to avoid duplication. .

  The analysis accuracy evaluation unit 15 to be described later sets the analysis accuracy to 50% for the “drug name”, 75% for the “effect”, and 50% for the “side effect” when FIG. Output. Therefore, each analysis accuracy output by the analysis accuracy evaluation unit 15 is stored in the analysis accuracy 1503 of the accuracy improvement rate management table 19 in FIG. 15 and each of the analysis accuracy from 50% when the recognition level n = 1 is set. The accuracy improvement rate is stored in the accuracy improvement rate 1504.

  The data analysis unit 13 has a maximum analysis accuracy of 75% when the recognition level n = 2, and the analysis accuracy 75% output by the analysis accuracy evaluation unit 15 in S136 is the analysis target accuracy 102 of the analysis input information 10. In S138, the metadata name list {medicine name, patient name, effect, side effect} has the lowest reliability (the numerical example is omitted). It is determined. The data analysis unit 13 creates {Fever, Fast, Effective, Doctor, Treatment} as a first-tier metadata name list immediately below “Effect” by loop processing in S131, and creates the created metadata in the analysis data 18 A value corresponding to the name list is acquired from the hierarchy management metadata 17, and the value is added as a new column. FIG. 14D shows an example in which the first hierarchy metadata is added. However, an example in which some first-layer metadata “antipyretic” is added is illustrated.

  As a result of the comparison between the analysis accuracy output from the analysis accuracy evaluation unit 15 and the analysis target accuracy 102 of the analysis input information 10, the data analysis unit 13 determines that the accuracy improvement rate management table 19 Referring to, a column with a high accuracy improvement rate is input to the important column list (S142). FIG. 16 shows an example of the important column list. The important column list 20 is a table that stores the additional metadata 1502 and the accuracy improvement rate 1504 of the accuracy improvement rate table 19 when the analysis accuracy has reached the analysis target accuracy 102 in the important metadata 1601 and the accuracy improvement rate 1602. There is a table for preparing an analysis result output as an analysis system to be described later. The important metadata 1601 is metadata that contributes to the improvement of analysis accuracy. The analysis target accuracy 102 of the analysis input information 10 is 80%, and the analysis accuracy related to the first hierarchy metadata “antipyretic” is 100%. Therefore, the analysis accuracy evaluation result at this time is reflected in the important column list 20.

  The data analysis unit 13 outputs the important column list 20 and the analysis data 18 via the output device (S143), and ends the process. In the example described, the analysis data 18 to be output is as shown in FIG. 14 (D). However, when the analysis accuracy has achieved the analysis target accuracy 102 at the recognition level 2, it becomes as shown in FIG. 14 (C). Similarly, when it is achieved at the recognition level 3, FIG. 14B is obtained.

  FIG. 17 shows a process flowchart of the analysis accuracy evaluation unit 15. The analysis accuracy evaluation unit 15 is started by the data analysis unit 13, receives the analysis input information 10 and the analysis data 18, calculates the purity, and outputs the calculation result as the analysis accuracy.

  The analysis accuracy evaluation unit 15 sets the content of the target axis column 104 of the analysis input information 10 as correct answer data (S150). Since the content of the target axis column 104 of the analysis input information 10 shown in FIG. 2 is “treatment cost”, this “treatment cost” is set as correct answer data.

  The analysis accuracy evaluation unit 15 performs clustering to classify the correct answer data into N groups for the input analysis data 18, and stores the result as a correct pattern (S151). A specific example will be described assuming that the input analysis data 18 is in the state of FIG. 14C (the state in which the data analysis unit 13 has added the second hierarchy metadata to the analysis data 18). Since “treatment cost” is correct answer data, it is classified into two groups of patient names A and B of $ 10 and patient names C and D of $ 1000. The threshold value as the classification criterion may be (maximum value + minimum value) / 2 in the case of two groups, or may be input via an input / output device. In general, when the data is classified into N groups, it is input via an input / output device.

  The analysis accuracy evaluation unit 15 performs clustering on each of the metadata of the analysis data 18 that is the analysis accuracy evaluation target data, and stores each as a classification pattern (S152). For example, clustering is performed on the metadata “effect” and classified into two groups of patient names A, B and D in the “early” group and patient name C in the “treatment” group.

  The analysis accuracy evaluation unit 15 calculates the coincidence rate between the correct pattern for the correct data and the metadata classification pattern, sets the calculation result as the analysis accuracy (S153), and returns the processing to the data analysis unit 13. The coincidence rate is a ratio of the number of data belonging to one group in the correct pattern and the number of data in one group in the classification pattern. Purity is used to determine this ratio. In the above-described example, the correct answer patterns using “treatment cost” as correct answer data are group 1 of patient names A and B and group 2 of patient names C and D. The classification patterns in which the analysis accuracy evaluation target data is metadata “effect” are group 3 of “early” patient names A, B, and D and group 4 of “treatment” patient name C. Patient names A and B belong to group 1 of the correct pattern and group 3 of the classification pattern. If group 1, the relationship of group 3 is established with a probability of 100%. On the other hand, the patient name C belonging to the group 2 belongs to the group 3, the patient name D belongs to the group 4, and the group 2 has a relationship of belonging to the group 3 or the group 4 with a probability of 50%. On the premise of this correct answer pattern, the combinations that maximize the probability of belonging to the group into which the “effect” that is the analysis accuracy evaluation target data is classified can be obtained as groups 1 and 3 and groups 2 and 4. At this time, the respective occurrence probabilities of 100% and 50% are added, and 75% which is a value obtained by dividing the added number of groups by 2 is calculated as the purity. The purity determined in this way is used as the analysis accuracy.

  FIG. 18 shows an example of a screen displayed on an input / output device (not shown) for using the analysis system. The screen includes an input screen “input” for the user to input each item of the analysis input information 10, an “execute” button 1805 for executing an analysis by the analysis system, and an output screen “2. output” for displaying the analysis result. "including.

  The input screen “input” includes the structure data 1801 for inputting the table ID 101 of the structure data, the analysis target accuracy 1802 for inputting the analysis target accuracy 102, the recognition level limit value 1803 for inputting the recognition level limit value 103, and the target axis column 104. Each column of the target axis designation 1804 is entered. The structure data 1801 is a field for designating and inputting “reference” and selecting and inputting the structure data to be displayed. The analysis target accuracy 1802 and the recognition level limit value 1803 are fields for numerical input as shown in the figure. The target axis designation 1804 selects and inputs a structure data column to be displayed in response to the structure data selection input in the structure data 1801 column.

  In response to input of each item of the analysis input information 10 by the user and pressing of the “execute” button 1805, the analysis system starts execution. When the execution ends, the output screen “2. output” is displayed on the input / output device. indicate. The analysis system includes analysis data 1806 and important column list 1807 on the output screen. The analysis data 1806 is the contents of the analysis data 18 at the stage where the analysis accuracy by the analysis system exceeds the analysis target accuracy 102 shown in FIG. In FIG. 18, the contents of the analysis data 18 of FIG. 14 (D) are displayed. The important column list 1807 is the contents of the important column list 20 shown in FIG.

  According to this embodiment, the analysis system can output a simpler (clear) analysis result. Since metadata that is highly likely to be related to structural data is preferentially analyzed, the time required for data analysis can be reduced.

  10: Analysis input information, 11: Unstructured data acquisition unit, 12: Metadata extraction unit, 13: Data analysis unit, 15: Analysis accuracy evaluation unit, 16: Structural data, 17: Hierarchy management metadata, 18: For analysis Data, 19: Accuracy improvement rate management table, 20 important column list.

Claims (12)

An unstructured data acquisition unit that acquires unstructured data corresponding to the structured data specified in the input analysis input information,
A metadata extraction unit that extracts metadata from the non-structured data acquired by the non-structured data acquisition unit and creates hierarchical management metadata indicating a hierarchical structure between the extracted metadata.
As analysis results corresponding to the target axis and target analysis accuracy specified in the input analysis input information, analysis data is created step by step with reference to the hierarchy management metadata, and based on the generated analysis data A data analysis unit that creates an important column list including the metadata that has contributed to the improvement of the analysis accuracy when the analysis accuracy exceeds the target analysis accuracy, and the data for analysis created by the data analysis unit And a data analysis system comprising an analysis accuracy evaluation unit for obtaining the analysis accuracy. The analysis input information includes the structure data, the target analysis accuracy, a recognition level limit value indicating a limit of a stage in which the data analysis unit creates the analysis data, and the object indicating the analysis target item of the structure data The data analysis system according to claim 1, further comprising an axis. The metadata extraction unit extracts the metadata as first hierarchy metadata from the unstructured data using a keyword dictionary in a field to be analyzed, and includes the first hierarchy metadata and the first hierarchy metadata. Using a dictionary indicating a correspondence relationship with terms representing upper concepts, terms included in the dictionary corresponding to the extracted first hierarchy metadata are extracted as second hierarchy metadata, and further, the second hierarchy metadata The terms contained in the other dictionary corresponding to the extracted second hierarchy metadata are extracted from the third hierarchy using the other dictionary indicating the correspondence relationship between the data and the terms representing the higher-level concept of the second hierarchy metadata. Extracting the first hierarchy metadata, the second hierarchy metadata, and the third hierarchy metadata as the metadata, and creating the hierarchy management metadata indicating the hierarchy structure between the extracted first hierarchy metadata, the second hierarchy metadata, and the third hierarchy metadata Data analysis system of claim 2 wherein. The metadata extraction unit is one of a keyword with an appearance count exceeding a predetermined value and a predetermined number of keywords from the top of the appearance count from the unstructured data, and the metadata included in the keyword dictionary The data analysis system according to claim 3, wherein the data is extracted as the first hierarchy metadata. The data analysis unit creates the analysis data step by step from the highest level metadata included in the hierarchy management metadata, and the analysis accuracy is the target analysis accuracy based on the generated analysis data. The data analysis system according to claim 4, wherein it is determined whether or not the value has been exceeded. 6. The data analysis system according to claim 5, wherein the data analysis unit cannot analyze the stepwise creation of the analysis data when the recognition level limit value is reached. A data analysis method in a data analysis system, the data analysis system comprising:
Get unstructured data corresponding to the structural data specified in the input analysis input information,
Extract metadata from the acquired unstructured data,
Create hierarchical management metadata indicating the hierarchical structure between the extracted metadata,
As the analysis result corresponding to the target axis and target analysis accuracy specified in the input analysis input information, the analysis data is created step by step with reference to the hierarchy management metadata.
Referring to the created analysis data, the analysis accuracy is obtained,
A data analysis method comprising: creating an important column list including the metadata that contributes to the improvement of the analysis accuracy at a stage where the analysis accuracy exceeds the target analysis accuracy based on the generated analysis data . The data analysis system includes:
The analysis input information includes the structure data, the target analysis accuracy, a recognition level limit value indicating a limit of a stage of creating the analysis data, and the target axis indicating an analysis target item of the structure data. 8. A data analysis method according to claim 7, wherein The data analysis system includes:
From the unstructured data, extract the metadata as the first hierarchy metadata using a keyword dictionary of the field to be analyzed,
Using a dictionary indicating a correspondence relationship between the first hierarchy metadata and a term representing a superordinate concept of the first hierarchy metadata, the terms included in the dictionary corresponding to the extracted first hierarchy metadata are Extracted as two-level metadata,
Further, using another dictionary indicating the correspondence relationship between the second hierarchy metadata and terms representing the higher-level concept of the second hierarchy metadata, included in the other dictionary corresponding to the extracted second hierarchy metadata Extracted terms as third-level metadata,
9. The data analysis according to claim 8, wherein the hierarchy management metadata indicating the hierarchy structure between the extracted first hierarchy metadata, the second hierarchy metadata, and the third hierarchy metadata is created. Method. The data analysis system includes:
From the unstructured data, any one of keywords having an appearance number exceeding a predetermined value and a predetermined number of keywords from the top of the appearance number, and the metadata included in the keyword dictionary is the first hierarchy metadata The data analysis method according to claim 9, wherein the data analysis method is extracted as: The data analysis system includes:
The analysis data is created step by step from the top-level metadata included in the hierarchy management metadata, and it is determined whether the analysis accuracy exceeds the target analysis accuracy based on the generated analysis data The data analysis method according to claim 10. The data analysis system includes:
12. The data analysis method according to claim 11, wherein the stepwise creation of the analysis data cannot be analyzed when the recognition level limit value is reached.

Images