WO2023124191A1 - 基于深度图匹配的医疗数据元自动化分类方法及系统 - Google Patents
基于深度图匹配的医疗数据元自动化分类方法及系统 Download PDFInfo
- Publication number
- WO2023124191A1 WO2023124191A1 PCT/CN2022/116971 CN2022116971W WO2023124191A1 WO 2023124191 A1 WO2023124191 A1 WO 2023124191A1 CN 2022116971 W CN2022116971 W CN 2022116971W WO 2023124191 A1 WO2023124191 A1 WO 2023124191A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- column
- data
- vertex
- medical data
- data element
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/906—Clustering; Classification
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/901—Indexing; Data structures therefor; Storage structures
- G06F16/9024—Graphs; Linked lists
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/93—Document management systems
Definitions
- the invention belongs to the field of regional medical big data centers and data production platforms, and in particular relates to an automatic classification method and system for medical data elements based on depth map matching.
- the data discovery, classification and data association mapping tasks in the development process of the medical big data center can be abstracted as the screening and classification tasks of medical data elements and the association mapping tasks of classified medical data elements.
- the platform development plan designers define the standard data element classification system and the corresponding data interface specifications based on the standard data model.
- developers filter and determine the data elements that match the data interface specification through rule search and manual search. This process is called data discovery.
- the data discovery process determines which data elements in the medical institution's data lake should be included Collection: Developers develop data interfaces based on the results of data discovery, and complete the data collection work.
- developers classify the multi-source and heterogeneous data elements in the data lake of medical institutions according to the standard data element classification system, integrate and map them to the standard data element classification system.
- Medical data includes diagnosis and treatment data generated during patient diagnosis and treatment and observation data during the operation of medical institutions, with various sources and complex relationships.
- diagnosis and treatment data generated during patient diagnosis and treatment and observation data during the operation of medical institutions, with various sources and complex relationships.
- historical data sleeps in the data lake of the medical institution without effective management, forming a local data swamp.
- the construction of a medical big data center requires the integration of these historical data to complete the transformation from a data swamp to a data lake. Due to the frequent turnover of relevant personnel in the information department of medical institutions and information system providers, the loss of historical system documents occurs from time to time.
- the present invention utilizes the deep graph matching algorithm based on the graph neural network to improve the data element classification method based on manual processing, minimize the dependence on the data files of the information system, and obtain only a few metadata information in the data lake of the medical institution.
- realize the rapid screening of effective data elements based on the text semantics of medical data realize the automatic data discovery of data in the data lake of medical institutions, realize the rapid classification of medical data elements based on the depth map matching algorithm, and realize the conversion of data elements in the data lake of medical institutions to standard data
- the automatic classification and association mapping of the meta-classification system greatly improves the efficiency of data interface development in the development process of the medical big data center.
- the data element classification method provided by the present invention has good scalability, and can be applied to the processing of various data swamp to data lake transformation problems.
- One aspect of the present invention discloses a method for automatic classification of medical data elements based on depth map matching, the method includes the following steps:
- (1) Define a medical data element map data model based on the minimum metadata information; the multi-source heterogeneous data elements stored in the data lake in the medical institution form a set of medical data elements to be screened, and add to the medical data element map data model Automated mapping, the mapping results are stored as metagraph data of medical data to be screened;
- the medical data element graph data model is modeled using a directed attribute graph, and the graph is composed of two graph elements: vertices and edges;
- the vertex is composed of a label and an attribute group corresponding to the label.
- the label represents the type of the vertex, and the attribute group represents one or more attributes owned by the label;
- the ontology information of the vertex includes the vertex type and the attributes corresponding to each type of vertex information
- the vertex type includes database vertex, table vertex and column vertex
- the attribute information corresponding to the database vertex includes database vertex index and database type information
- the attribute information corresponding to the table vertex includes table vertex index
- the column vertex The corresponding attribute information includes column vertex index, column data type information and column vector representation;
- the edge is composed of an edge type and an edge attribute, and each edge is a directed edge; the ontology information of the edge includes the edge type and attribute information corresponding to each type of edge, and the edge type includes the starting point being a database vertex, The parent-child association whose end point is a table vertex, the parent-child association whose starting point is a table vertex and the end point is a column vertex, and the foreign key whose starting point and end point are both column vertices.
- the attribute information corresponding to the three edge types is the edge index.
- mapping of the multi-source heterogeneous data elements to the medical data element graph data model includes:
- the collected metadata and the generated column vector representation are mapped to the medical data element graph data model to obtain the medical data element graph data to be screened.
- the column vector generator uses a single column in the data table as a data element unit, uses the column vector representation model to convert the data stored in each column, and calculates the vector representation of each column;
- the training of the column vector representation model includes: the training data of the column vector representation model is stored in the standard database to manually complete the medical data element classification, and the data structure conforms to the column data of the standard data model, which is recorded as a standard classification column; the standard classification medical treatment There is a one-to-one correspondence between the column vertices in the data element graph data and the corresponding standard classification columns;
- a vector is expressed as According to the calculation of the self-attention mechanism, the correlation of each row of data under the column vertex C k in the standard classified medical data element graph data is obtained, and the column vector
- v(C k ) is the vector representation of column vertex C k
- d k is the dimension of v(C k )
- softmax is the softmax function
- the prediction of the column vector representation model includes: the prediction data of the column vector representation model is a set of medical data elements to be screened composed of each table and column in each database in the data lake, and the set of medical data elements to be screened is performed using the column as a traversal unit. Traversing; using the column vector representation model to calculate the column vector representation of each random sampling of the column vertices; calculating the average of the predicted multiple random sampling column vector representation results, as the final column vector representation of the column vertices.
- the calculation of the importance of each column vertex stored in the medical data element graph data to be screened in the medical data element graph data model includes:
- Importance_score is an importance function.
- the medical data element screening model judges whether the column in the medical data element set to be screened corresponding to the column vertex C k is a valid data element by calculating the threshold L', and the calculation formula of the threshold L' is:
- the medical data element graph data to be classified is formed by association of the filtered effective column vertex sets, and the corresponding filtered column sets form the medical data element set to be classified.
- the determination of the seed vertex set of the standard classified medical data meta graph data from the medical data meta graph data to be classified includes:
- subgraph cutting of the metagraph data of medical data to be classified based on the set of seed vertices includes:
- N(D i ) denote the set of column vertices associated with the same parent vertex as D i in the standard classification medical data element graph data
- the goal of the depth graph matching model is to obtain Search the subgraph in , so that the column vertices in the searched subgraph match the column vertices in N(D i ) one by one, and realize The classification of the medical data elements corresponding to the vertices of the middle column.
- the use of the depth map matching model to complete the classification of column vertices in the medical data element graph data to be classified includes:
- the vector representation V(D i ) of column vertices D i in the standard classification medical data element graph data is calculated as:
- the classification of the column corresponding to the column vertex C′ in the medical data element graph data to be classified is The corresponding category in the standard data element taxonomy.
- Another aspect of the present invention discloses a medical data element automatic classification system based on depth map matching, the system includes:
- Standardized acquisition and mapping module of multi-source heterogeneous data elements define the medical data element graph data model based on the minimum metadata information; combine multi-source heterogeneous data elements stored in the data lake in the medical institution to form a set of medical data elements to be screened , automatically mapping to the medical data element map data model, and storing the mapping result as medical data element map data to be screened;
- Effective medical data element screening module Calculate the importance of each column vertex stored in the medical data element graph data to be screened in the medical data element graph data model; build a medical data element screening model, and calculate each column based on the importance of each column vertex The possibility that the column corresponding to the vertex is mapped to the standard data model, and the valid column vertex is screened out.
- the corresponding column is a valid medical data element, and the medical data element graph data to be classified is composed of the valid column vertex set, and the column set corresponding to the valid column vertex Form a collection of medical data elements to be classified;
- Medical data element classification module based on depth graph matching model: determine the seed vertex set of standard classified medical data element graph data from the medical data element graph data to be classified; perform subgraph cutting of the medical data element graph data to be classified based on the seed vertex set ; Use the deep graph matching model to complete the classification of the column vertices in the medical data element graph data to be classified, so as to obtain the classification of the medical data elements corresponding to the column vertices.
- the present invention only utilizes the minimal metadata information stored in the data lake of the medical institution, and uses the medical data element diagram data model to realize the standardized collection of medical data elements in the medical institution and the relationship information between medical data elements to be screened and classified full use of.
- the method of the present invention reduces the dependence of the data discovery, classification and association mapping process on the historical documents of the information system of the medical institution, and the absence and error of the historical documents have little influence on the classification results of the medical data elements.
- the method of the present invention greatly reduces the manual intervention in the process of data discovery, classification and association mapping, and classifies the medical data elements to be classified through the artificial intelligence algorithm, which meets the needs of real-time update, dynamic aggregation and deep utilization of medical big data center data Provides a heuristic solution to the difficult problem of automatic classification of medical data elements in .
- Fig. 1 is the overall flowchart of the method of the present invention
- Fig. 2 is the flowchart of traditional medical data element classification method
- FIG. 3 is a schematic diagram of the implementation process of the automatic classification method for medical data elements based on depth map matching provided by the present invention
- Fig. 4 is an example of medical data element diagram data model
- Fig. 5 is a schematic diagram of the mapping of multi-source heterogeneous data elements to the medical data element graph data model.
- Metadata Data that describes other data. Metadata is data about data. Sometimes it does not specifically refer to a single data. It can be understood as a set of information groups/data groups used to describe data. All data and information in this information group/data group , all describe/reflect a certain aspect of a certain data, then this information group/data group can be called a metadata. Metadata can describe data about its elements or properties (name, size, data type, etc.), its structure (length, fields, data columns), or its related data (where it is located, how it is contacted, who owns it). In everyday life, metadata is ubiquitous. As long as there is a class of things, a set of metadata can be defined.
- Data element can be understood as the basic unit of data.
- the basic data elements of health information standardize and define the unique Chinese names and codes of all relevant information in the field of medicine and health, and the codes are expressed in letters, Chinese characters, and digital strings.
- a data element enumerates and defines an information resource in a specific semantic environment.
- Complete data element name object class term + feature class term + representation class term + (qualified class term).
- Metadata cannot possibly cover all the information necessary to understand the data that a data element is intended to represent.
- Information about data elements is an integral part of any (organizational) metadata.
- Each element of metadata is a data element, and metadata attributes and description methods conforming to data element standards are used to describe metadata.
- Storing and codifying metadata in a repository requires modeling, which requires obtaining metadata from a registry of data elements or from a repository.
- Metadata which is a data element expressed in a consistent and standard way.
- Both metadata and data element dictionary formats are composed of attributes such as line number, Chinese name, English name, identifier (phrase), definition, constraint/condition, maximum number of occurrences, data type, and data value range. The difference is that there are other attributes such as context and synonym name in the data element dictionary format.
- a data lake is a method of storing data in a natural format in a system or repository, which facilitates the configuration of data in various schema and structural forms, usually object blocks or files.
- the main idea of a data lake is the unified storage of all data in an enterprise, from raw data (an exact copy of source system data) to target data for various tasks such as reporting, visualization, analysis, and machine learning.
- the entire HDFS is generally called a data warehouse (in a broad sense), that is, the place where all data is stored, while in foreign countries it is generally called a data lake.
- data lakes When data lakes are left unmanaged, data swamps form. It is easy to build a data lake, but it is difficult to make the data lake play a role.
- the data lake just pours data into it all the time, and there are very few application scenarios, with no output or very little output, forming a one-way lake.
- Most enterprises that use data lakes often fail to use the data because the quality of the data in the data lake is too poor when the data really needs to be used.
- Graph Neural Networks In the past few years, the rise and application of neural networks has successfully promoted the research of pattern recognition and data mining. Many machine learning tasks (such as object detection, machine translation, and speech recognition) that once relied heavily on manually extracted features have been revolutionized by various end-to-end deep learning paradigms. Although traditional deep learning methods have been applied to extract features of Euclidean space data with great success, the data in many practical application scenarios are generated from non-Euclidean spaces, and traditional deep learning methods are not effective in processing non-Euclidean space data. Performance is still unsatisfactory. Each data sample (node) in the graph will have edges related to other real data samples in the graph, and this information can be used to capture the interdependencies between instances.
- Graph neural network is a neural network applied to graph-structured data (non-Euclidean space).
- Deep graph matching is a classic problem in artificial intelligence and has important applications in several fields, such as matching 2D/3D shapes in computer vision, matching protein networks in bioinformatics, and matching different networks in social networks. user etc. Deep graph matching is a method based on graph neural network to solve the graph matching problem.
- the present invention provides a kind of automatic classification method of medical data element based on depth map matching, and this method comprises the following steps:
- Standardized collection and mapping of multi-source heterogeneous data elements including:
- Fig. 2 is a flowchart of traditional medical data element classification method. The implementation process of each part of the method of the present invention will be described in detail below with reference to FIG. 3 .
- the data of medical institutions are aggregated to form a data lake.
- the data of the data lake has the characteristics of multi-source heterogeneity, including the observation data of the diagnosis and treatment process and the operation process of medical institutions in the medical process.
- the purpose and design of the observation database are different.
- the electronic medical records formed during the diagnosis and treatment process are designed to support clinical practice, while the operating data of medical institutions are constructed for in-hospital management and medical insurance reimbursement processes. Each is collected for a different purpose, resulting in data having a different logical organization and physical format.
- the data model is a tool used to abstract the real world in database design. By establishing a standard and unified data model and defining data structure, data operation, and data constraints, it can effectively ensure the quality of collected data and the controllability of data representation standards, as shown in Fig.
- the data model is a data model developed based on the graph database.
- the present invention Based on the minimum metadata information of the database in the data lake, the present invention defines a medical data metadata graph data model based on the minimum metadata information, which is a medical big data center Automated classification of medical data elements during establishment provides a heuristic solution.
- the graph data model is modeled by a directed attribute graph, which consists of two graph elements: vertex Vertex and edge Edge.
- the vertex is composed of a label and an attribute group corresponding to the label.
- the label represents the type of the vertex, and the attribute group represents one or more attributes owned by the label.
- Vertex ontology information includes vertex types and attribute information corresponding to each type of vertex.
- the ontology information of the vertex of the medical data element graph data model defined by the present invention is shown in the following table:
- Table 1 The ontology information table of the vertices of the medical data element graph data model
- vid is the unique index id of each vertex in the graph, which can be hash coded uniformly.
- vector_embeddings is a column vector representing the result of the model prediction.
- an edge is composed of an edge type and an edge attribute, and each edge is a directed edge, and a directed edge indicates an association relationship between one vertex (start point src) and another vertex (end point dst).
- Edge ontology information includes edge types and attribute information corresponding to each type of edge.
- the ontology information of the edge of the medical data element graph data model defined by the present invention is shown in the following table:
- Table 2 The ontology information table of the edge of the medical data element graph data model
- Figure 4 is an example of a medical data element graph data model.
- the data collection and association mapping process of the present invention collects heterogeneous medical data from multiple sources from the data lake to form a set of medical data elements to be screened.
- Use the metadata collection tool to capture the metadata stored in the data lake.
- Use the column vector generator to traverse the data stored in each column of each table in the medical data element set to be screened, and use the column vector representation model to predict and obtain the column vector representation of each column of each table.
- graph data association mapping the collected metadata and the generated column vector representation are associated and mapped to the medical data element graph data model to obtain the medical data element graph data to be screened.
- the collection information is configured to only collect table column information, blood relationship information and foreign key information of each column in the metadata; for primary keys, constraints, and indexes Common metadata such as , permissions, and triggers are not within the scope of collection.
- Metadata capture perform metadata capture operations on each database in the data lake according to the parsing configuration.
- the column vector generator uses a single column in the data table as a data element unit, uses the column vector representation model to convert the data stored in each column, and calculates the vector representation of each column;
- the column vector indicates that the training data of the model is the column data stored in the standard database that manually completes the classification of medical data and whose data structure conforms to the standard data model, referred to as the standard classification column.
- the method of obtaining the column vertex vector representation in the medical data element graph data is to convert the data stored in the column in the corresponding medical data element set into text data, and add [CLS] and [SEP] to the head and tail of each column of text data to represent The beginning and end of the data.
- the initial vector representation h(w t ) of the character w t is obtained by calculating the text representation model h.
- the text representation model h can adopt a deep bidirectional language representation model (BERT model) based on the Transformer model.
- v(C k ) is the vector representation of column vertex C k
- d k is the dimension of v(C k )
- softmax is the softmax function
- the standard classification column data can be used for further transfer learning of the column vector representation model. Take the column as a unit, randomly cover 15% of the characters in the corresponding column data, and use the [MASK] label to replace the covered characters. Use the column vector representation model to predict the covered characters to further train and update the model, so that the obtained column vector representation model is more suitable for the task of screening valid data elements.
- the column vector indicates that the prediction data of the model is a set of medical data elements to be screened composed of each table and column in each database in the data lake, and the set of medical data elements to be screened is traversed with the column as the traversal unit.
- random sampling can be used (such as random sampling of 1000 data in a single column , sampled 100 times), use the column vector representation model to calculate the column vector representation H s (C k ) for the sth sampling of the column vertex C k .
- the calculated column vector representation of each column in the medical data element set to be screened, as well as the metadata collection results, are respectively associated and mapped into objects corresponding to vertices and edges in the medical data element graph data model, and stored in the medical data element graph
- the corresponding mapping relationship is shown in the following table in the medical data element graph data whose data model is the data standard to be screened.
- serial number map object object properties metadata information 1 Database vertex Name (number) of the database in the medical institution 2 table vertex Data table name (number) in the database 3 Column vertex Column name (number) in the data table 4 Database-Table side Dependencies of databases and data tables 5 Table-Column side The inclusion relationship between the data table and the columns in the table 6 Column-Column side Database column foreign key, blood relationship between columns
- the present invention proposes a method for quickly and automatically screening effective medical data elements, including the following two steps: (1) calculating the importance of each column vertex stored in the medical data element graph data to be screened in the medical data element graph data model. (2) Construct a medical data element screening model, calculate the possibility of mapping the column corresponding to each column vertex to the standard data model based on the importance of each column vertex, and filter out the effective medical data elements to form a set of medical data elements to be classified.
- Importance_score is an importance function.
- the importance function is updated through the Adam algorithm, and the medical data element screening model is updated.
- the medical data element screening model judges whether the column in the set of medical data elements to be screened corresponding to the column vertex C k is a valid data element by calculating the threshold L'.
- the formula for calculating the threshold L' is:
- the filtered effective column vertex set is associated to form the medical data element graph data to be classified, and the corresponding filtered column set forms the medical data element set to be classified.
- the medical data element classification process can be abstracted as finding the column vertex D i with the highest matching degree with the column vertex C k ⁇ C in D, so as to determine the classification of the column corresponding to the column vertex C k as E i , and the medical big data center develops
- the data classification and association mapping process in the process can be abstracted as finding the C k with the highest matching degree for all the classifications E i of the standard data element classification system.
- the data format or content of some columns in the standard database with the standard data model as the data standard will be relatively uniform, and the format or content of the columns of the standard classified medical data element set that has an associated mapping relationship with it will also be relatively uniform. If the vertices corresponding to these columns are firstly located to the corresponding vertices (called seed vertices) in the medical data element graph data to be classified, the search space of the depth map matching model can be reduced, thereby improving its efficiency.
- N(D i ) denote the set of column vertices associated with the same parent vertex as D i in the standard classification medical data element graph data
- the goal of the depth graph matching model is to obtain Search for a suitable subgraph in , so that the column vertices in the searched subgraph match the column vertices in N(D i ) one by one, so that The classification of the medical data elements corresponding to the vertices of the middle column.
- the medical data metadata classification process includes the following steps:
- w(D′, D i ) represents the weight function of a certain column vertex D′ in N(D i ) for the column vertex D i , and the specific calculation method for:
- W 1 is the matrix parameter obtained from training.
- W 2 is a matrix parameter obtained from training.
- the matching degree match_2(D', C') of the column vertex D' of the standard classified medical data element graph data and the column vertex C' of the medical data element graph data to be classified is:
- the embodiment of the present invention also provides a medical data element automatic classification system based on depth map matching, the system includes:
- Standardized acquisition and mapping module of multi-source heterogeneous data elements define the medical data element graph data model based on the minimum metadata information; combine multi-source heterogeneous data elements stored in the data lake in the medical institution to form a set of medical data elements to be screened , automatic mapping to the medical data element graph data model, and the mapping result is stored as medical data element graph data to be screened; the implementation of this module can refer to the above step 1.
- Effective medical data element screening module Calculate the importance of each column vertex stored in the medical data element graph data to be screened in the medical data element graph data model; build a medical data element screening model, and calculate each column based on the importance of each column vertex The possibility that the column corresponding to the vertex is mapped to the standard data model, and the valid column vertex is screened out.
- the corresponding column is a valid medical data element, and the medical data element graph data to be classified is composed of the valid column vertex set, and the column set corresponding to the valid column vertex Form a set of medical data elements to be classified; the realization of this module can refer to the above step 2.
- Medical data element classification module based on depth graph matching model: determine the seed vertex set of standard classified medical data element graph data from the medical data element graph data to be classified; perform subgraph cutting of the medical data element graph data to be classified based on the seed vertex set ; Use the depth map matching model to complete the classification of the column vertices in the medical data element graph data to be classified, so as to obtain the classification of the medical data elements corresponding to the column vertices; the implementation of this module can refer to the above step three.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Software Systems (AREA)
- Business, Economics & Management (AREA)
- General Business, Economics & Management (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Medical Treatment And Welfare Office Work (AREA)
- Image Analysis (AREA)
Abstract
Description
| 起点标签 | 终点标签 | 边类型 | 属性 | 属性说明 |
| Database | Table | 父子关联 | eid | 边索引 |
| Table | Column | 父子关联 | eid | 边索引 |
| Column | Column | 外键 | eid | 边索引 |
| 序号 | 映射对象 | 对象属性 | 元数据信息 |
| 1 | Database | 顶点 | 医疗机构内数据库名称(编号) |
| 2 | Table | 顶点 | 数据库内数据表名称(编号) |
| 3 | Column | 顶点 | 数据表内列名称(编号) |
| 4 | Database-Table | 边 | 数据库和数据表的从属关系 |
| 5 | Table-Column | 边 | 数据表和表内列的包含关系 |
| 6 | Column-Column | 边 | 数据库列外键,列间血缘关系 |
Claims (9)
- 一种基于深度图匹配的医疗数据元自动化分类方法,其特征在于,包括:(1)定义基于最小元数据信息的医疗数据元图数据模型;将医疗机构内数据湖中存储的多源异构的数据元组成待筛选医疗数据元集合,向所述医疗数据元图数据模型自动化映射,映射结果存储为待筛选医疗数据元图数据;所述医疗数据元图数据模型采用有向属性图建模,图由顶点和边两种图元素构成;所述顶点是由标签和对应标签的属性组构成的,标签代表顶点的类型,属性组代表标签拥有的一种或多种属性;所述顶点的本体信息包含顶点类型及每类顶点对应的属性信息,所述顶点类型包括数据库顶点、表顶点和列顶点,所述数据库顶点对应的属性信息包括数据库顶点索引和数据库类型信息,所述表顶点对应的属性信息包括表顶点索引,所述列顶点对应的属性信息包括列顶点索引、列数据类型信息和列向量表示;所述边是由边类型和边属性构成的,每一条边均为有向边;所述边的本体信息包含边类型及每类边对应的属性信息,所述边类型包括起点为数据库顶点、终点为表顶点的父子关联,起点为表顶点、终点为列顶点的父子关联,以及起点和终点均为列顶点的外键,三种边类型对应的属性信息均为边索引;(2)计算待筛选医疗数据元图数据中存储的各列顶点在医疗数据元图数据模型中的重要度;构建医疗数据元筛选模型,基于各列顶点的重要度计算各列顶点对应的列映射到标准数据模型的可能性,筛选出有效列顶点,由有效列顶点集合关联组成待分类医疗数据元图数据,有效列顶点对应的列集合组成待分类医疗数据元集合;(3)从待分类医疗数据元图数据中确定标准分类医疗数据元图数据的种子顶点集合;基于种子顶点集合进行待分类医疗数据元图数据的子图切割;利用深度图匹配模型完成对待分类医疗数据元图数据中列顶点的分类,从而得到列顶点对应的医疗数据元的分类。
- 根据权利要求1所述的方法,其特征在于,所述多源异构的数据元向医疗数据元图数据模型的映射,包括:将来自多源异构的医疗数据从数据湖中采集,组成待筛选医疗数据元集合;使用元数据采集工具对数据湖中存储的元数据进行抓取;使用列向量生成器,对待筛选医疗数据元集合中各表各列中存储的数据进行遍历,利用列向量表示模型预测得到各表各列的列向量表示;通过图数据关联映射,将采集的元数据和产生的列向量表示向医疗数据元图数据模型关联映射,得到待筛选医疗数据元图数据。
- 根据权利要求2所述的方法,其特征在于,所述列向量生成器以数据表中的单列作为一个数据元单位,使用列向量表示模型转化各列存储的数据,计算各列的向量表示;所述列向量表示模型的训练包括:列向量表示模型的训练数据为存储在标准数据库中的人工完成医疗数据元分类、数据结构符合标准数据模型的列数据,记为标准分类列;标准分类医疗数据元图数据中的列顶点与对应标准分类列存在一一对应关系;设标准分类医疗数据元图数据中列顶点集合为C={c k,j},其中c k,j表示列顶点集合对应的标准分类列中第k列,第j行的数据,c k,j={w t} t=1,2,...,m,m为第j行字符总数,w t为构成数据c k,j的字符;通过文本表示模型h计算得到字符w t的初始向量表示h(w t);在标准分类医疗数据元图数据的列顶点C k下随机抽取n行数据{c k,j} j=1,2,...,n,第j行数据的向量表示为 根据自注意力机制计算得到标准分类医疗数据元图数据中列顶点C k下各行数据的相关性,得到列顶点C k的列向量表示H(C k),计算公式为:其中v(C k)为列顶点C k的向量表示,d k为v(C k)的维度,softmax为softmax函数;所述列向量表示模型的预测包括:列向量表示模型的预测数据为数据湖中各数据库中各表各列所组成的待筛选医疗数据元集合,以列为遍历单元对待筛选医疗数据元集合进行遍历;使用列向量表示模型计算对列顶点每次随机抽样的列向量表示;对预测的多次随机抽样的列向量表示结果求平均值,作为所述列顶点最终的列向量表示。
- 根据权利要求1所述的方法,其特征在于,所述医疗数据元筛选模型的训练与预测具体为:将根据标准数据元分类体系,人工分类和关联映射构建的标准分类医疗数据元集合转换为标准分类医疗数据元图数据,设标准分类医疗数据元图数据中存储的列顶点集合为S={s k},设构建标准分类医疗数据元集合过程中被人工筛选排除的列对应的列顶点集合为S′={s′ k};训练时从集合S中随机抽取q个列顶点作为正样本集合{s t} t=1,2,...,q,从集合S′中随机抽取q个列顶点作为负样本集合{s′ t} t=1,2,...,q;设样本(s i,y i)的重要度分 数为Im(s i),s i表示第i个列顶点,y i∈{0,1}表示样本真实类别,则基于重要度分数计算医疗数据元筛选模型的损失函数Loss:所述医疗数据元筛选模型在预测时,通过计算阈值L′判断列顶点C k对应的待筛选医疗数据元集合中的列是否为有效数据元,阈值L′计算公式:若L′≥0.5,则说明列顶点C k为有效列顶点,对应的列为有效数据元;由筛选后的有效列顶点集合关联组成待分类医疗数据元图数据,对应的筛选后的列集合组成待分类医疗数据元集合。
- 根据权利要求1所述的方法,其特征在于,所述从待分类医疗数据元图数据中确定标准分类医疗数据元图数据的种子顶点集合,包括:设由标准数据模型定义的标准数据元分类体系中所有标准分类集合为E,标准分类医疗数据元图数据中的列顶点集合为D,D i∈D在标准数据元分类体系中的分类为E i∈E;设待分类医疗数据元图数据中存储的列顶点集合为C;医疗数据元分类过程抽象为在D中找到与列顶点C k∈C匹配度最高的列顶点D i,从而确定列顶点C k对应的列的分类为E i;
- 根据权利要求7所述的方法,其特征在于,所述利用深度图匹配模型完成对待分类医疗数据元图数据中列顶点的分类,包括:根据图注意力机制,计算标准分类医疗数据元图数据中列顶点D i的向量表示V(D i)为:
- 一种基于深度图匹配的医疗数据元自动化分类系统,其特征在于,包括:多源异构数据元的规范化采集与映射模块:定义基于最小元数据信息的医疗数据元图数据模型;将医疗机构内数据湖中存储的多源异构的数据元组成待筛选医疗数据元集合,向所述医疗数据元图数据模型自动化映射,映射结果存储为待筛选医疗数据元图数据;所述医疗数据元图数据模型采用有向属性图建模,图由顶点和边两种图元素构成;所述顶点是由标签和对应标签的属性组构成的,标签代表顶点的类型,属性组代表标签拥有的一种或多种属性;所述顶点的本体信息包含顶点类型及每类顶点对应的属性信息,所述顶点类型包括数据库顶点、表顶点和列顶点,所述数据库顶点对应的属性信息包括数据库顶点索引和数据库类型信息,所述表顶点对应的属性信息包括表顶点索引,所述列顶点对应的属性信息包括列顶点索引、列数据类型信息和列向量表示;所述边是由边类型和边属性构成的,每一条边均为有向边;所述边的本体信息包含边类型及每类边对应的属性信息,所述边类型包括起点为数据库顶点、终点为表顶点的父子关联,起点为表顶点、终点为列顶点的父子关联,以及起点和终点均为列顶点的外键,三种边类型对应的属性信息均为边索引;有效医疗数据元筛选模块:计算待筛选医疗数据元图数据中存储的各列顶点在医疗数据元图数据模型中的重要度;构建医疗数据元筛选模型,基于各列顶点的重要度计算各列顶点对应的列映射到标准数据模型的可能性,筛选出有效列顶点,对应的列为有效医疗数据元,由有效列顶点集合关联组成待分类医疗数据元图数据,有效列顶点对应的列集合组成待分类医疗数据元集合;基于深度图匹配模型的医疗数据元分类模块:从待分类医疗数据元图数据中确定标准分类医疗数据元图数据的种子顶点集合;基于种子顶点集合进行待分类医疗数据元图数据的子图切割;利用深度图匹配模型完成对待分类医疗数据元图数据中列顶点的分类,从而得到列顶点对应的医疗数据元的分类。
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2023536557A JP7432801B2 (ja) | 2021-12-30 | 2022-09-05 | デプスマップマッチングに基づく医療データエレメント自動化分類方法及びシステム |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111649231.1 | 2021-12-30 | ||
| CN202111649231.1A CN114003791B (zh) | 2021-12-30 | 2021-12-30 | 基于深度图匹配的医疗数据元自动化分类方法及系统 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2023124191A1 true WO2023124191A1 (zh) | 2023-07-06 |
Family
ID=79932292
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2022/116971 Ceased WO2023124191A1 (zh) | 2021-12-30 | 2022-09-05 | 基于深度图匹配的医疗数据元自动化分类方法及系统 |
Country Status (3)
| Country | Link |
|---|---|
| JP (1) | JP7432801B2 (zh) |
| CN (1) | CN114003791B (zh) |
| WO (1) | WO2023124191A1 (zh) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117312435A (zh) * | 2023-11-23 | 2023-12-29 | 首都信息发展股份有限公司 | 数据采集方法、装置及电子设备 |
| CN117763129A (zh) * | 2024-02-22 | 2024-03-26 | 神州医疗科技股份有限公司 | 基于生成式预训练模型的病历检索系统 |
| CN118331993A (zh) * | 2024-06-12 | 2024-07-12 | 北京云成金融信息服务有限公司 | 一种基于大数据平台的数据筛选方法 |
| CN120833878A (zh) * | 2025-09-19 | 2025-10-24 | 北京惠每云科技有限公司 | 医疗元组生成方法与装置、电子设备及存储介质 |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114003791B (zh) * | 2021-12-30 | 2022-04-08 | 之江实验室 | 基于深度图匹配的医疗数据元自动化分类方法及系统 |
| CN116166698B (zh) * | 2023-01-12 | 2023-09-01 | 之江实验室 | 一种基于通用医疗术语的快速构建队列方法及系统 |
| CN116226281B (zh) * | 2023-02-14 | 2026-05-05 | 清华大学 | 基于深度图压缩算法的自动数据库分区方法及系统 |
| CN117349401B (zh) * | 2023-12-06 | 2024-03-15 | 之江实验室 | 一种非结构化数据的元数据存储方法、装置、介质及设备 |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2017152802A1 (zh) * | 2016-03-07 | 2017-09-14 | 陈宽 | 将文本类医疗报告转换为结构化数据的智能系统及方法 |
| CN109471945A (zh) * | 2018-11-12 | 2019-03-15 | 中山大学 | 基于深度学习的医疗文本分类方法、装置及存储介质 |
| CN109948680A (zh) * | 2019-03-11 | 2019-06-28 | 合肥工业大学 | 病历数据的分类方法及系统 |
| CN110021439A (zh) * | 2019-03-07 | 2019-07-16 | 平安科技(深圳)有限公司 | 基于机器学习的医疗数据分类方法、装置和计算机设备 |
| CN110349639A (zh) * | 2019-07-12 | 2019-10-18 | 之江实验室 | 一种基于通用医疗术语库的多中心医疗术语标准化系统 |
| US20210089880A1 (en) * | 2019-09-25 | 2021-03-25 | International Business Machines Corporation | Systems and methods for training a model using a few-shot classification process |
| CN113656604A (zh) * | 2021-10-19 | 2021-11-16 | 之江实验室 | 基于异构图神经网络的医疗术语规范化系统及方法 |
| CN114003791A (zh) * | 2021-12-30 | 2022-02-01 | 之江实验室 | 基于深度图匹配的医疗数据元自动化分类方法及系统 |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8280886B2 (en) | 2008-02-13 | 2012-10-02 | Fujitsu Limited | Determining candidate terms related to terms of a query |
| CN105354266A (zh) * | 2015-10-23 | 2016-02-24 | 北京航空航天大学 | 一种基于富图模型RichGraph的图数据管理方法 |
| CN106250382A (zh) * | 2016-01-28 | 2016-12-21 | 新博卓畅技术(北京)有限公司 | 一种元数据管理引擎系统及实现方法 |
| US11625620B2 (en) | 2018-08-16 | 2023-04-11 | Oracle International Corporation | Techniques for building a knowledge graph in limited knowledge domains |
| US11921697B2 (en) * | 2019-11-22 | 2024-03-05 | Fraud.net, Inc. | Methods and systems for detecting spurious data patterns |
| CN111523003A (zh) * | 2020-04-27 | 2020-08-11 | 北京图特摩斯科技有限公司 | 一种以时序动态图谱为核心的数据应用方法及平台 |
| CN112185515A (zh) * | 2020-10-12 | 2021-01-05 | 安徽动感智能科技有限公司 | 一种基于动作识别的病患辅助系统 |
-
2021
- 2021-12-30 CN CN202111649231.1A patent/CN114003791B/zh active Active
-
2022
- 2022-09-05 JP JP2023536557A patent/JP7432801B2/ja active Active
- 2022-09-05 WO PCT/CN2022/116971 patent/WO2023124191A1/zh not_active Ceased
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2017152802A1 (zh) * | 2016-03-07 | 2017-09-14 | 陈宽 | 将文本类医疗报告转换为结构化数据的智能系统及方法 |
| CN109471945A (zh) * | 2018-11-12 | 2019-03-15 | 中山大学 | 基于深度学习的医疗文本分类方法、装置及存储介质 |
| CN110021439A (zh) * | 2019-03-07 | 2019-07-16 | 平安科技(深圳)有限公司 | 基于机器学习的医疗数据分类方法、装置和计算机设备 |
| CN109948680A (zh) * | 2019-03-11 | 2019-06-28 | 合肥工业大学 | 病历数据的分类方法及系统 |
| CN110349639A (zh) * | 2019-07-12 | 2019-10-18 | 之江实验室 | 一种基于通用医疗术语库的多中心医疗术语标准化系统 |
| US20210089880A1 (en) * | 2019-09-25 | 2021-03-25 | International Business Machines Corporation | Systems and methods for training a model using a few-shot classification process |
| CN113656604A (zh) * | 2021-10-19 | 2021-11-16 | 之江实验室 | 基于异构图神经网络的医疗术语规范化系统及方法 |
| CN114003791A (zh) * | 2021-12-30 | 2022-02-01 | 之江实验室 | 基于深度图匹配的医疗数据元自动化分类方法及系统 |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117312435A (zh) * | 2023-11-23 | 2023-12-29 | 首都信息发展股份有限公司 | 数据采集方法、装置及电子设备 |
| CN117763129A (zh) * | 2024-02-22 | 2024-03-26 | 神州医疗科技股份有限公司 | 基于生成式预训练模型的病历检索系统 |
| CN117763129B (zh) * | 2024-02-22 | 2024-05-28 | 神州医疗科技股份有限公司 | 基于生成式预训练模型的病历检索方法及系统 |
| CN118331993A (zh) * | 2024-06-12 | 2024-07-12 | 北京云成金融信息服务有限公司 | 一种基于大数据平台的数据筛选方法 |
| CN120833878A (zh) * | 2025-09-19 | 2025-10-24 | 北京惠每云科技有限公司 | 医疗元组生成方法与装置、电子设备及存储介质 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114003791A (zh) | 2022-02-01 |
| CN114003791B (zh) | 2022-04-08 |
| JP7432801B2 (ja) | 2024-02-16 |
| JP2024502730A (ja) | 2024-01-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN114003791B (zh) | 基于深度图匹配的医疗数据元自动化分类方法及系统 | |
| CN111428053B (zh) | 一种面向税务领域知识图谱的构建方法 | |
| CN111967761B (zh) | 一种基于知识图谱的监控预警方法、装置及电子设备 | |
| WO2021103492A1 (zh) | 一种企业经营风险预测方法和系统 | |
| CN104346438B (zh) | 基于大数据数据管理服务系统 | |
| CN120493159A (zh) | 一种基于政务服务数据的多源异构语料融合方法及系统 | |
| CN118657213A (zh) | 基于多源异构知识图谱决策方案获取方法及系统 | |
| CN117151659A (zh) | 一种基于大语言模型的生态修复工程全生命周期追溯方法 | |
| CN116821376B (zh) | 煤矿安全生产领域的知识图谱构建方法及系统 | |
| CN110544035A (zh) | 一种内控检测方法、系统和计算机可读存储介质 | |
| WO2025166928A1 (zh) | 一种基于情报共享及图计算的涉诈团伙事件识别系统、方法以及相关设备 | |
| CN118227599A (zh) | 基于自动化流程的数据标准治理方法、系统、设备和介质 | |
| CN120930739A (zh) | 能源政策知识图谱的多级构建与智能召回策略实现方法、系统、设备及介质 | |
| CN120387504A (zh) | 基于低代码开发平台的知识图谱构建方法 | |
| CN117056528A (zh) | 一种基于实时大数据的知识图谱系统的构建方法 | |
| CN118568189A (zh) | 基于距离的城市功能同位分析方法及系统 | |
| CN120893547B (zh) | 一种历史文献版本知识本体动态协同构建方法及系统 | |
| CN118093604A (zh) | 知识图谱更新方法、装置、电子设备及存储介质 | |
| CN121599068A (zh) | 一种基于大模型的多层材料知识图谱构建方法及系统 | |
| CN121051165A (zh) | 一种多源异构调度行为数据集成方法及系统 | |
| CN107180024A (zh) | 一种中心连通子图的多源异构数据实体识别方法及系统 | |
| CN115934969B (zh) | 一种不可移动文物风险评估知识图谱构建方法 | |
| Su et al. | [Retracted] Design and Application of Intelligent Management Platform Based on Big Data | |
| CN120996012B (zh) | 一种连接大模型与多源数据的高效交互方法、系统 | |
| CN118797385B (zh) | 一种基于大数据的职位名称聚类方法及装置 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| WWE | Wipo information: entry into national phase |
Ref document number: 2023536557 Country of ref document: JP |
|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 22913470 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 22913470 Country of ref document: EP Kind code of ref document: A1 |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 22913470 Country of ref document: EP Kind code of ref document: A1 |
|
| 32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 17.01.2025) |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 22913470 Country of ref document: EP Kind code of ref document: A1 |
































