CN108595571A - A kind of Data Integration management method, device, system and user terminal - Google Patents
A kind of Data Integration management method, device, system and user terminal Download PDFInfo
- Publication number
- CN108595571A CN108595571A CN201810338365.3A CN201810338365A CN108595571A CN 108595571 A CN108595571 A CN 108595571A CN 201810338365 A CN201810338365 A CN 201810338365A CN 108595571 A CN108595571 A CN 108595571A
- Authority
- CN
- China
- Prior art keywords
- data
- standardized
- master index
- engine
- integration management
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Abstract
The present invention provides a kind of Data Integration management method, device, system and user terminals, wherein the method includes：Obtain the integrated information of the target data in data source；Arrangement is standardized to integrated information, obtains standardized data；Master index corresponding with target data is obtained by master index engine, and master index and standardized data are bound；It is inducted into the standardized data bound with master index according to main rope, and standardized data is sent to server-side.Method provided by the present invention carries out Data Matching by using visualization implement engine, to collect the basic data of comprehensive " effective, useful, available " by data source, and it carries out effective cleaning according to default unified standard and integrates, to meet the demand of the resource-sharing for data source, method configuration is simple, it is compatible strong, it avoids in traditional technology, it needs to write sql scripts by implementation personnel, increase configuration difficulty, is easy because of the defect that personal error causes target data set incompatible.
Description
Technical field
The present invention relates to technical field of network information, more specifically to a kind of Data Integration management method, device,
System and user terminal.
Background technology
Data integration is that the data of separate sources, format, feature property logically or are physically organically concentrated, from
And provide comprehensive data sharing for enterprise.In enterprise data integration field, there is the frame of many maturations that can utilize.
At present generally use federal style, integrated system is constructed based on the methods of Middleware Model and data warehouse, these technologies exist
Different emphasis point and the upper solution data sharing of application and provide decision support for enterprise.
It (is mainly the abbreviation of English Extract-Transform-Load, for retouching with ETL that medical data is integrated at present
State data from source terminal by extracting (extract), conversion (transform), loading (load) to the process of destination) work
Tool extracts required data from data source, by data cleansing, finally according to the data warehouse model pre-defined, will count
According to being loaded into data warehouse, but traditional mode needs to write sql scripts by implementation personnel, increases configuration difficulty, holds
Easily because personal error causes target data set incompatible.
Invention content
In view of this, a kind of Data Integration management method of present invention offer, device, system and user terminal are existing to solve
The deficiency of technology.
To solve the above problems, the present invention provides a kind of Data Integration management method, including：
Obtain the integrated information of the target data in data source；
Arrangement is standardized to the integrated information, obtains standardized data；
Corresponding with target data master index is obtained by master index engine, and by the master index and the standard
Change data binding；
It is inducted into the standardized data bound with the master index according to the main rope, and by the standardized data
It is sent to server-side.
Preferably, described " integrated information for obtaining the target data in data source " includes：
Based on data query mode or data-interface mode, judge whether the corresponding data of the target data are to be resolved
Data；
If so, carrying out structuring to the data to be resolved by analytics engine, integrated information is generated.
If it is not, then obtain the increment delta data of the target data in data source, and using the increment delta data as
Integrated information.
Preferably, described " being standardized arrangement to the integrated information, obtain standardized data " includes：
Remove the invalid information in the integrated information；
Coded data in the integrated information after removing invalid information is converted according to default unified standard, is obtained
To the standardized data.
Preferably, described " corresponding with target data master index to be obtained by master index engine, and by the main rope
Draw and bound with the standardized data " before, further include：
By the standardized data encrypted transmission to task scheduling center, in order to which the task scheduling is centrally through main rope
Binding of the engine to the master index and the standardized data.
Preferably, described " to be inducted into the standardized data bound with the master index according to the main rope, and by institute
State standardized data and be sent to server-side ", including：
Based on the master index, the standardized data bound with the master index is subjected to batch data importing；
If when batch data imports, there is the standardized data that can not be imported, then by the standardization that can not be imported
The advanced row buffering of data, then the standardized data batch that can not be imported described in after buffering is submitted；
The standardized data that batch is submitted is sent to server-side.
Preferably, described " standardized data that batch is submitted is sent to server-side " includes：
The standardized data that batch is submitted is put in storage；
If the standardized data has the data that can not be put in storage, the standardized data that will be unable to storage carries out list
Item is inserted into, and carries out automatic adaptation to the standardized data that single is inserted by script；
The standardized data being voluntarily adapted to is entered into library storage to server-side.
In addition, to solve the above problems, the present invention also provides a kind of Data Integration managing devices, including：It is acquisition module, whole
Manage module, binding module and import modul；
The acquisition module, the integrated information for obtaining the target data in data source；
The sorting module obtains standardized data for being standardized arrangement to the integrated information；
The binding module, for obtaining corresponding with target data master index by master index engine, and by institute
Master index is stated to bind with the standardized data；
The import modul, for being inducted into the standardized data bound with the master index according to the main rope,
And the standardized data is sent to server-side.
In addition, to solve the above problems, the present invention also provides a kind of Data Integrations to manage system, including it is data source, preposition
Acquisition engine, central dispatching engine, master index engine, regional data center and data publication service；
The data source, the front-collection engine and the central dispatching engine are sequentially connected；
The master index engine and the regional data center are connect with the central dispatching engine；
The data publication service is connect with the regional data center.
In addition, to solve the above problems, the present invention also provides a kind of user terminal, including memory and processor, institute
Memory integration management program for storing data is stated, the processor runs the Data Integration management program so that the use
Family terminal executes Data Integration management method as described above.
In addition, to solve the above problems, the present invention also provides a kind of computer readable storage medium, it is described computer-readable
It is stored with Data Integration management program on storage medium, is realized as above-mentioned when the Data Integration management program is executed by processor
The Data Integration management method.
A kind of Data Integration management method, device, system and user terminal provided by the invention.Wherein, the present invention is carried
The method of confession includes：Obtain the integrated information of the target data in data source；Arrangement is standardized to the integrated information, is obtained
To standardized data；Corresponding with target data master index is obtained by master index engine, and by the master index and institute
State standardized data binding；The standardized data bound with the master index is inducted into according to the main rope, and will be described
Standardized data is sent to server-side.Method provided by the present invention carries out Data Matching by using visualization Run-time engine,
To collect the basic data of comprehensive " effective, useful, available " by data source, and carried out effectively according to default unified standard
Cleaning integrate, to meet the demand of the resource-sharing for data source, method configuration is simple, and compatibility is strong, avoids tradition
It in technology, needs to write sql scripts by implementation personnel, increases configuration difficulty, be easy because personal error leads to target data
Collect incompatible defect.
Description of the drawings
Fig. 1 is the structural schematic diagram for the hardware running environment that Data Integration management method example scheme of the present invention is related to；
Fig. 2 is the flow diagram of Data Integration management method first embodiment of the present invention；
Fig. 3 is the flow diagram of Data Integration management method second embodiment of the present invention；
Fig. 4 is the flow diagram of Data Integration management method 3rd embodiment of the present invention；
Fig. 5 is the flow diagram of Data Integration management method fourth embodiment of the present invention；
Fig. 6 is the flow diagram of the 5th embodiment of Data Integration management method of the present invention；
Fig. 7 is the refinement flow diagram of step S430 in the 5th embodiment of Data Integration management method of the present invention；
Fig. 8 is the high-level schematic functional block diagram of Data Integration managing device of the present invention.
The embodiments will be further described with reference to the accompanying drawings for the realization, the function and the advantages of the object of the present invention.
Specific implementation mode
The embodiment of the present invention is described below in detail, in which the same or similar labels are throughly indicated same or like
Element or element with the same or similar functions.
In addition, term " first ", " second " are used for description purposes only, it is not understood to indicate or imply relative importance
Or implicitly indicate the quantity of indicated technical characteristic.Define " first " as a result, the feature of " second " can be expressed or
Implicitly include one or more this feature.In the description of the present invention, the meaning of " plurality " is two or more,
Unless otherwise specifically defined.
In the present invention unless specifically defined or limited otherwise, term " installation ", " connected ", " connection ", " fixation " etc.
Term shall be understood in a broad sense, for example, it may be being fixedly connected, may be a detachable connection, or integral；Can be that machinery connects
It connects, can also be electrical connection；It can be directly connected, can also can be indirectly connected through an intermediary in two elements
The interaction relationship of the connection in portion or two elements.It for the ordinary skill in the art, can be according to specific feelings
Condition understands the concrete meaning of above-mentioned term in the present invention.
It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, it is not intended to limit the present invention.
As shown in Figure 1, the structural schematic diagram of the hardware running environment for the terminal that Fig. 1, which is the embodiment of the present invention, to be related to.
Terminal of the embodiment of the present invention can be PC, can also be that smart mobile phone, tablet computer, E-book reader, MP3 are broadcast
Putting device, MP4 players, pocket computer etc. has the packaged type terminal device of display function.
As shown in Figure 1, the terminal may include：Processor 1001, such as CPU, network interface 1004, user interface
1003, memory 1005, communication bus 1002.Wherein, communication bus 1002 is for realizing the connection communication between these components.
User interface 1003 may include display screen, input unit such as keyboard, remote controler, and optional user interface 1003 can also include
Standard wireline interface and wireless interface.Network interface 1004 may include optionally standard wireline interface and wireless interface (such as
WI-FI interfaces).Memory 1005 can be high-speed RAM memory, can also be stable memory, such as magnetic disk storage.
Memory 1005 optionally can also be the storage device independently of aforementioned processor 1001.
Optionally, terminal can also include camera, RF (Radio Frequency, radio frequency) circuit, sensor, audio
Circuit, WiFi module etc..In addition, mobile terminal can also configure gyroscope, barometer, hygrometer, thermometer, infrared ray sensing
The other sensors such as device, details are not described herein.
It will be understood by those skilled in the art that the restriction of the not structure paired terminal of terminal shown in Fig. 1, may include ratio
More or fewer components are illustrated, certain components or different components arrangement are either combined.
As shown in Figure 1, as may include operating system, number in a kind of memory 1005 of computer readable storage medium
According to interface control program, network attachment procedure and Data Integration management program.
A kind of Data Integration management method, device, system and user terminal provided by the invention.Wherein, the method is real
Data Matching is now carried out by using visualization Run-time engine, to be collected comprehensive " effective, useful, available " by data source
Basic data, and carry out effective cleaning according to default unified standard and integrate, to meet the resource-sharing for data source
Demand, method configuration is simple, and compatibility is strong.
Embodiment 1：
With reference to Fig. 2, first embodiment of the invention provides a kind of Data Integration management method, including：
Step S100 obtains the integrated information of the target data in data source；
A kind of Data Integration management method, the aggregation platform that base provides in this present embodiment are provided in the present embodiment.It needs
Illustrate, aggregation platform mainly uses advanced ESB, and (full name is Enterprise Service Bus, i.e. enterprises service
Bus)+SOA (Enterprise SOA is a component model) architecture design, use visualization implement engine carry out data
Matching, and platform software system does not influence the development of vocational work when safeguarding and update upgrading.Simultaneously because the framework of SOA is set
Meter according to the needs of service application, can support interface exploitation and the hot plug of corresponding data application, can be other application and pipe
Reason system provides data or data acquisition functions.
It is above-mentioned, it is directed to the integration with data information in the present embodiment and shares, passes through aggregation platform for example, can be directed to
To the acquisition and integration for medical data in each health organ.Wherein, the data source can be medical data source.Institute
It states medical data source medical data source and mostlys come from medical institutions' information system, such as HIS systems (Hospital
Information System, hospital information system), LIS systems (Laboratory Information Management
System, Laboratory Information Management System), PACS system (Picture Archiving and Communication
Systems, medical image information system), emr system (Electronic Medical Record, computerized medical record system)
And health information system, it is desirable to provide the encryption connection mode or interface mode in hospital's relevant information library and hygienic resident library.
Above-mentioned, target data can be the data of target patient in medical data source.
It is above-mentioned, by using having visual implement engine, implements personnel and pull source field to aiming field i.e. completion
Mapping configures and exports configuration, and configuration difficulty is greatly reduced, artificial origin is avoided to lead to target data differentiation.
Step S200 is standardized arrangement to the integrated information, obtains standardized data；
For the integrated information extracted, it can be standardized arrangement, to make by each data source of each mechanism
Integrated information in accessed different data format, different data source is arranged, and is unified for identical standard, in turn
Obtain standardized data.
Step S300 obtains corresponding with target data master index by master index engine, and by the master index
It is bound with the standardized data；
After data are standardized, master index engine need to further be called to carry out resident's master index calculating, a main rope
Drawing can be used for indicating this independent personal other demographic information or socioeconomic information.For example this resident exists
When different medical mechanism goes to a doctor, multiple medical serial numbers or identity card/medical insurance card number of generation etc..In these information
Per portion, all bound with corresponding unique master index.
Step S400 is inducted into the standardized data bound with the master index according to the main rope, and will be described
Standardized data is sent to server-side.
Above-mentioned, server-side can be regional medical data center.
After above-mentioned standard data loading, the transmission to server-side can be carried out.In addition, when all kinds of medical applications need
When using consolidated storage data, unified data acquisition source, data hair can be provided for each application system by data publication service
The data sharing document format that cloth service provides is to meet HL7V3 (7 health information exchange standards of Health Level v3.0 editions)
Standard and CDA (Clinical Document Architecture clinical documents framework) standard criterion, are that one kind meeting state
XML (Extensible Markup Language extensible markup languages) format file of the shared standard of family.CDA documents are supported
Clinical document interacts, and even between possessing the user of technical sophistication degree of different stage, can also realize document exchange；Together
When also support a series of subsequent exchange processing system, can be consistent with document creation systems.The support of CDA documents can make number
Become an independent switching layer according to switching layer, is exchanged with bottom or memory mechanism is unrelated.CDA documents can well adapt to various
Medical environment readily satisfies the information requirement of user, and can flexibly be extended.
Method provided by the present invention carries out Data Matching by using visualization Run-time engine, to be adopted by data source
Collect the basic data of comprehensive " effective, useful, available ", and carry out effective cleaning according to default unified standard and integrate, with full
Foot is for the demand of the resource-sharing of data source, and method configuration is simple, and compatibility is strong, avoids in traditional technology, needs to rely on
Implementation personnel write sql scripts, increase configuration difficulty, are easy because of the defect that personal error causes target data set incompatible.
Embodiment 2：
With reference to Fig. 3, second embodiment of the invention provides a kind of Data Integration management method, based on above-mentioned shown in Fig. 2 the
One embodiment, the step S100 " integrated information for obtaining the target data in data source " include：
Step S110 is based on data query mode or data-interface mode, judges that the corresponding data of the target data are
No is data to be resolved；
Step S120 generates integrated information if so, carrying out structuring to the data to be resolved by analytics engine.
Step S130 if it is not, then obtaining the increment delta data of the target data in data source, and the increment is changed
Data are as integrated information.
It is above-mentioned, the data of clinical business application system are extracted by data query or data-interface mode, platform
Extraction process use increment technique, ensure that gatherer process does not influence the normal operation of original system.What it is when acquisition is to need to parse
Electronic health record data, data as to be resolved, platform then calls electronic health record analytics engine to tie electronic health record data
Structure.
Embodiment 3：
With reference to Fig. 4, third embodiment of the invention provides a kind of Data Integration management method, based on above-mentioned shown in Fig. 2 the
One embodiment, the step S200 " being standardized arrangement to the integrated information, obtain standardized data " include：
Step S210 removes the invalid information in the integrated information；
Step S220, to remove the coded data in the integrated information after invalid information according to it is default seek unity of standard into
Row conversion, obtains the standardized data.
It is above-mentioned, to extract or the integrated information of structuring, such as at patient's diagnosis and treatment data and image data
Reason, cleans up invalid information therein, may include invalid ID card No., invalid contact method etc. ensures to enter
The data of consolidated storage are authentic and valid data.
According to national standards or international standard is converted to some coded datas, ensure that the data that each hospital is provided are retouched
It states and is consistent, such as be converted to national gender code, ICD-10 codings.
Embodiment 4：
With reference to Fig. 5, fourth embodiment of the invention provides a kind of Data Integration management method, based on above-mentioned shown in Fig. 2 the
One embodiment, the step S300 " obtain master index corresponding with the target data, and by the master by master index engine
Index is bound with the standardized data " before, further include：
Step S500, by the standardized data encrypted transmission to task scheduling center, in order in the task scheduling
Binding of the heart by master index engine to the master index and the standardized data.
It is above-mentioned, it will as pass through standardized Data Encryption Transmission and dispatch (abbreviation center) to central task, center is called
Master index computing engines.
Above-mentioned, the encryption technology in encrypted transmission may include two elements：Algorithm and key.Algorithm is will be common
The combination of text (or be appreciated that information) and string number (key), the step of generating impenetrable ciphertext, key
It is a kind of algorithm for being coded and decoded to data.In safe and secret, can by Key Encryption Technology appropriate and
Administrative mechanism is safe to ensure the information communication of network.The cipher system of Key Encryption Technology is divided into standard-key cryptography and non-right
Claim two kinds of key cryptosystem.Correspondingly, two classes are divided into the encrypted technology of data, i.e. symmetric cryptography (private key cryptographic) and non-right
Claim encryption (public key encryption).Symmetric cryptography is with data encryption standards (DES, Data Encryption Standard) algorithm
For Typical Representative, asymmetric encryption is usually using RSA (Rivest Shamir Adleman) algorithm as representative.Symmetric cryptography adds
Key is identical with decruption key, and the encryption key of asymmetric encryption and decruption key are different, encryption key can disclose and
Decruption key need for confidentiality.
It should be noted that the encrypted transmission of data, may be used different cipher modes and transmission is encrypted, for example,
RSA technologies, as rivest, shamir, adelman may be used, key pair is instantiated by recipient first, then by the public key of oneself
Announcement is gone out, this just discloses public key to sender, and if prompt want transmission data, please use the public key to adding in plain text
It is close, it after recipient receives with plaintext after public key encryption, needs to be decrypted using mating private key, and because the private key
Only recipient oneself just has, even if so data are intercepted by hacker during transmission, it is also not possible to go out deciphering data
Come.
Embodiment 5：
Referring to figure 6 and figure 7, fifth embodiment of the invention provides a kind of Data Integration management method, based on shown in above-mentioned Fig. 2
First embodiment, the step S400 " standardized data bound with the master index is inducted into according to the main rope,
And the standardized data is sent to server-side ", including：
Step S410 is based on the master index, and the standardized data bound with the master index is carried out lot number
According to importing；
If there is the standardized data that can not be imported in step S420, then can not be imported by described in when batch data imports
The advanced row buffering of standardized data, then the standardized data batch that can not be imported described in after buffering is submitted；
The standardized data that batch is submitted is sent to server-side by step S430.
The step S430 " standardized data that batch is submitted is sent to server-side " includes：
The standardized data that batch is submitted is put in storage by step S431；
Step S432 will be unable to the standardization of storage if the standardized data has the data that can not be put in storage
Data carry out single insertion, and carry out automatic adaptation to the standardized data that single is inserted by script；
The standardized data being voluntarily adapted to is entered library storage to server-side by step S433.
After Data Encryption Transmission to center, master index engine is called to carry out resident's master index calculating, a master index can
For indicating this independent personal other demographic information or socioeconomic information.For example this resident is in different doctors
When treatment mechanism is medical, multiple medical serial numbers or identity card/medical insurance card number of generation etc..It is every a in these information,
All bound with corresponding unique master index.
Data that are after standardization and being bound in master index are subjected to data loading, data, which load, preferentially uses bulkload
Technology batch imports, and storage performance is substantially improved；The data that can not be imported are submitted into row buffering, then batch, and data are greatly decreased
It asks in library；Automatically single insertion is carried out when can not be put in storage with upper type, programming automatic generation script can automatic adaptation target data
The change of structure.And then standardized data is entered into library storage to regional medical data center again
In addition, with reference to Fig. 8, the present invention also provides a kind of Data Integration managing devices, including：Acquisition module 10 arranges mould
Block 20, binding module 30 and import modul 40；
The acquisition module 10, the integrated information for obtaining the target data in data source；
The sorting module 20 obtains standardized data for being standardized arrangement to the integrated information；
The binding module 30, for obtaining master index corresponding with the target data by master index engine, and will
The master index is bound with the standardized data；
The import modul 40, for being inducted into the normalized number bound with the master index according to the main rope
According to, and the standardized data is sent to server-side.
In addition, the present invention also provides a kind of Data Integrations to manage system, which is characterized in that including data source, front-collection
Engine, central dispatching engine, master index engine, regional data center and data publication service；
The data source, the front-collection engine and the central dispatching engine are sequentially connected；
The master index engine and the regional data center are connect with the central dispatching engine；
The data publication service is connect with the regional data center.
Mainly comprising hospital data source, front-collection engine, central dispatching engine, master index engine, area medical data
Center, data publication service.
Hospital data source, the business datum for mainly thering is hospital's sorts of systems to generate and patient clinical data.Front-collection draws
It holds up, it is main to be extracted using the part that increment technique changes data source, the extraction, conversion, transmission of duplicate data are reduced, greatly
Width reduces resource consumption, and in the case where not influencing operation system operation, setting high frequency acquires, and can solve asynchronous extraction data
Be delayed longer problem.
Central dispatching engine provides and configures entire process by flow definition tool come visual to access system
Journey, flow after definition configure its method of operation by workflow management module, for example, automatically, timing, craft or business triggering
Formula operation etc..
Master index engine positions and manages relevant complex task, including correlation with data for handling in aggregation platform
Patient's index information.Indexed links to the service point for generating different storage services, these service points produce it is specific it is personal,
Health care personnel or medical and health organization and real-time business datum.Index service is responsible for analysis and comes from external resource
Information and repository in, oppositely retrieval, convergence and the returned data of response external medical and health services point.
Regional medical data center, regional medical data center are a clinical datas for integrating multiple sources, provide with
The real time data center of unified view centered on resident, structure hospital and the closely coupled information platform of resident.Clinical user
It can be inquired from multiple angles, browsing and analysis data, diagnosis and treatment data therein include resident's essential information, all previous just diagnose a disease
History.
Data publication service provides volume of data and shares exchange regulation, data communication standards, data sharing format standard
Data sharing service, interface and data communication service can be provided between other hygienic platforms.The standardized electricity of service support
Sub- case history shared document structure output also supports customized REST (English：Representational State
Transfer, abbreviation REST describe the network system of a framework pattern, such as weblication.)Api
(Application Programming Interface, application programming interface) exports.
In addition, the present invention also provides a kind of user terminal, including memory and processor, including memory and processing
Device, memory integration management program for storing data, the processor run the Data Integration management program so that
The user terminal executes Data Integration management method as described above.
In addition, the present invention also provides a kind of computer readable storage medium, stored on the computer readable storage medium
There are Data Integration management program, the Data Integration management program to realize Data Integration pipe as described above when being executed by processor
Reason method.
In addition, in order to better illustrate a kind of Data Integration management method provided by the present invention, the present invention is carried
The flow of the method for confession carries out as described below：
1, medical data source mostlys come from medical institutions' information system, such as HIS systems (Hospital Information
System, hospital information system), LIS systems (Laboratory Information Management System, laboratory
Information management system), PACS system (Picture Archiving and Communication Systems, medical image letter
Breath system), emr system (Electronic Medical Record, computerized medical record system) and health information system, need
The encryption connection mode or interface mode in hospital's relevant information library and hygienic resident library are provided.
2, by using having visual implement engine, implement personnel and pull source field to the i.e. completion mapping of aiming field
Configuration is configured and exported, configuration difficulty is greatly reduced, artificial origin is avoided to lead to target data differentiation.
3, the data of clinical business application system are extracted by data query or data-interface mode, the pumping of platform
It takes process to use increment technique, ensures that gatherer process does not influence the normal operation of original system.
4, when extraction it is to need the electronic health record data that parse, platform then calls electronic health record analytics engine by electronics disease
It counts one by one according to progress structuring.
5, the patient's diagnosis and treatment data and image data that have carried out extraction or structuring are handled, cleans up invalid body
Part card number, invalid contact method etc. ensure the data that the data for entering consolidated storage are authentic and valid.
6, according to national standards or international standard is converted to some coded datas, ensure the data that each hospital is provided
Description is consistent, such as is converted to national gender code, ICD-10 codings.
7, standardized Data Encryption Transmission will be passed through and dispatches (abbreviation center) to central task, master index meter is called at center
Calculate engine.
8, after data to center, master index engine is called to carry out resident's master index calculating, a master index can be used for marking
Show this independent personal other demographic information or socioeconomic information.For example this resident is in different medical mechanism
When medical, multiple medical serial numbers or identity card/medical insurance card number of generation etc..In these information per a, all with it is right
The unique master index binding answered.
9, data that are after standardization and being bound in master index are subjected to data loading, data load preferential use
Bulkload technology batches import, and storage performance is substantially improved；The data that can not be imported are submitted into row buffering, then batch, substantially
Reduce database request；Automatically single insertion is carried out when can not be put in storage with upper type, programming automatic generation script can automatic adaptation
The change of target data structure.
10, standardized data enters library storage to regional medical data center (abbreviation consolidated storage).
11, can be each answer by data publication service when all kinds of medical applications are needed using consolidated storage data
Unified data acquisition source is provided with system, the data sharing document format that data publication service provides is to meet HL7V3
(7 health information exchange standards of Health Level v3.0 editions) standard and CDA (Clinical Document
Architecture clinical documents framework) standard criterion is a kind of XML (Extensible meeting the shared standard of country
Markup Language extensible markup languages) format file.CDA documents support clinical document interaction, are even possessing not
Between the user of the technical sophistication degree of same level, document exchange can also be realized；It also supports at a series of subsequent exchange simultaneously
Reason system can be consistent with document creation systems.The support of CDA documents can make data exchange layer become an independent exchange
Layer exchanges with bottom or memory mechanism is unrelated.CDA documents can well adapt to various medical environments, readily satisfy user's
Information requirement, and can flexibly be extended.
It should be noted that aggregation platform provided by the present invention includes mainly hospital's acquisition front end processor, fire wall, center
Server, regional medical data center server, data distribution server, all kinds of medical profession application services.
Hospital acquires front end processor, is mainly used for data pick-up, data normalization and Data Encryption Transmission, front end processor is using anti-
Wall with flues carries out packet filtering.Front end processor is deployed in after hospital's outer net fire wall, and is limited and can only be interacted with Platform Server.
Fire wall, it is mainly and close with IP (agreement interconnected between network is that the foreign language of Internet Protocol is abridged)
Key is verified, and is only allowed the data packet of the platform IP address authorized by fire wall, is transferred to end server, blocks other IP
The data packet request of address.
Central server is mainly used for receiving encryption standard data packet, and valid data is loaded in batch deposit library.
Regional medical data center server is mainly used for storage region medical data.
Data publication service server provides data sharing on the basis of fire wall and carries out data friendship with other platforms
The service of changing, data transmission uses SSL (Secure Sockets Layer Secure Socket Layer) agreement when request data shared service
Data transmission is encrypted.Being carried out data transmission by ssl protocol, it is ensured that data are sent to correct client-server,
Data between transmission are encrypted to prevent data midway to be stolen, and safeguard the integrality of data, it is ensured that data in transmission process not
It is changed.Recipient, sender are specified in data exchange, specify the sender and recipient of intranet and extranet, data exchange is just
The data exchange service that point-to-point can only be provided facilitates the audit of data exchange, has been also convenient for positioning problems to source, has avoided
The generation for the attacks such as three pretends to be, acquisition of information is reset.
All kinds of medical profession application services, all kinds of medical applications services, as each information system of hospital, health information platform,
When medical social security etc. needs to obtain regional medical data center data, initiate to obtain request of data to data publication service.
Aggregation platform of the present invention mainly optimizes existing ETL technologies and network communication technology, is subject to fused data technology of sharing
All nodes of stream compression (cleaning, conversion, be packaged, upload, parsing) can all be used Stream Processing technology, reduce volume compared with
Big data packet results in blockage in each node, improves data-handling efficiency, and avoids and create imperial palace for big data packet
The case where depositing object is reduced the system performance that Memory recycle is brought and is declined, also reduce the risk of memory overflow, platform support module
Hot plug technology, above-mentioned function have covered most of complex scene, and encountering certain above-mentioned functions of special situation cannot meet
When, particular demands can also be rapidly adapted to by customized development plug-in unit flexible expansion.
In conclusion aggregation platform of the present invention collects comprehensive " effective, useful, available " from each medical and health organization
Basic data, and carry out effective cleaning by national regulation and integrate, to meet hospital's health medical treatment resource-sharing demand, to doctor
It treats innovation service construction propulsion and plays vital supporting role.
It should be noted that herein, the terms "include", "comprise" or its any other variant are intended to non-row
His property includes, so that process, method, article or system including a series of elements include not only those elements, and
And further include other elements that are not explicitly listed, or further include for this process, method, article or system institute it is intrinsic
Element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that including this
There is also other identical elements in the process of element, method, article or system.
The embodiments of the present invention are for illustration only, can not represent the quality of embodiment.
Through the above description of the embodiments, those skilled in the art can be understood that above-described embodiment side
Method can add the mode of required general hardware platform to realize by software, naturally it is also possible to by hardware, but in many cases
The former is more preferably embodiment.Based on this understanding, technical scheme of the present invention substantially in other words does the prior art
Going out the part of contribution can be expressed in the form of software products, which is stored in one as described above
In storage medium (such as ROM/RAM, magnetic disc, CD), including some instructions use so that a station terminal equipment (can be mobile phone,
Computer, server or network equipment etc.) execute method described in each embodiment of the present invention.
It these are only the preferred embodiment of the present invention, be not intended to limit the scope of the invention, it is every to utilize this hair
Equivalent structure or equivalent flow shift made by bright specification and accompanying drawing content is applied directly or indirectly in other relevant skills
Art field, is included within the scope of the present invention.
Claims (10)
1. a kind of Data Integration management method, which is characterized in that including：
Obtain the integrated information of the target data in data source；
Arrangement is standardized to the integrated information, obtains standardized data；
Corresponding with target data master index is obtained by master index engine, and by the master index and the normalized number
According to binding；
It is inducted into the standardized data bound with the master index according to the main rope, and the standardized data is sent
To server-side.
2. Data Integration management method as described in claim 1, which is characterized in that described " to obtain the target data in data source
Integrated information " include：
Based on data query mode or data-interface mode, judge whether the corresponding data of the target data are number to be resolved
According to；
If so, carrying out structuring to the data to be resolved by analytics engine, integrated information is generated.
If it is not, the increment delta data of the target data in data source is then obtained, and using the increment delta data as synthesis
Information.
3. Data Integration management method as described in claim 1, which is characterized in that described " to carry out standard to the integrated information
Change and arrange, obtain standardized data " include：
Remove the invalid information in the integrated information；
Coded data in the integrated information after removing invalid information is converted according to default unified standard, obtains institute
State standardized data.
4. Data Integration management method as described in claim 1, which is characterized in that described " to be obtained by master index engine and institute
The corresponding master index of target data is stated, and the master index and the standardized data are bound " before, further include：
By the standardized data encrypted transmission to task scheduling center, in order to which the task scheduling is drawn centrally through master index
Hold up the binding to the master index and the standardized data.
5. Data Integration management method as described in claim 1, which is characterized in that described " to be inducted into according to the main rope and institute
The standardized data of master index binding is stated, and the standardized data is sent to server-side ", including：
Based on the master index, the standardized data bound with the master index is subjected to batch data importing；
If when batch data imports, there is the standardized data that can not be imported, then by the standardized data that can not be imported
Advanced row buffering, then the standardized data batch that can not be imported described in after buffering is submitted；
The standardized data that batch is submitted is sent to server-side.
6. Data Integration management method as claimed in claim 5, which is characterized in that " the standardization for submitting batch
Data are sent to server-side " include：
The standardized data that batch is submitted is put in storage；
If the standardized data has the data that can not be put in storage, the standardized data progress single that will be unable to storage is inserted
Enter, and automatic adaptation is carried out to the standardized data that single is inserted by script；
The standardized data being voluntarily adapted to is entered into library storage to server-side.
7. a kind of Data Integration managing device, which is characterized in that including：Acquisition module, sorting module, binding module and importing mould
Block；
The acquisition module, the integrated information for obtaining the target data in data source；
The sorting module obtains standardized data for being standardized arrangement to the integrated information；
The binding module, for obtaining corresponding with target data master index by master index engine, and by the master
Index is bound with the standardized data；
The import modul, for being inducted into the standardized data bound with the master index according to the main rope, and will
The standardized data is sent to server-side.
8. a kind of Data Integration manages system, which is characterized in that including data source, front-collection engine, central dispatching engine, master
Index engine, regional data center and data publication service；
The data source, the front-collection engine and the central dispatching engine are sequentially connected；
The master index engine and the regional data center are connect with the central dispatching engine；
The data publication service is connect with the regional data center.
9. a kind of user terminal, which is characterized in that including memory and processor, the memory is integrated for storing data
Management program, the processor runs the Data Integration management program so that the user terminal executes such as claim 1-6
Any one of the Data Integration management method.
10. a kind of computer readable storage medium, which is characterized in that it is whole to be stored with data on the computer readable storage medium
Management program is closed, the number as described in any one of claim 1-6 is realized when the Data Integration management program is executed by processor
According to integration management method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810338365.3A CN108595571A (en) | 2018-04-16 | 2018-04-16 | A kind of Data Integration management method, device, system and user terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810338365.3A CN108595571A (en) | 2018-04-16 | 2018-04-16 | A kind of Data Integration management method, device, system and user terminal |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108595571A true CN108595571A (en) | 2018-09-28 |
Family
ID=63622672
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810338365.3A Pending CN108595571A (en) | 2018-04-16 | 2018-04-16 | A kind of Data Integration management method, device, system and user terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108595571A (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109542967A (en) * | 2018-11-19 | 2019-03-29 | 四川长虹电器股份有限公司 | Smart city data-sharing systems and method based on XBRL standard |
| CN109542966A (en) * | 2018-11-09 | 2019-03-29 | 金色熊猫有限公司 | Data fusion method, device, electronic equipment and computer-readable medium |
| CN111145843A (en) * | 2019-11-27 | 2020-05-12 | 陕西医链区块链集团有限公司 | Multi-center integration platform and method based on medical big data |
| CN112035468A (en) * | 2020-08-24 | 2020-12-04 | 杭州览众数据科技有限公司 | Multi-data-source ETL tool based on memory calculation and web visual configuration |
| CN113468379A (en) * | 2020-03-31 | 2021-10-01 | 上海依图网络科技有限公司 | Data source processing method and device and intelligent analysis platform |
| CN115394392A (en) * | 2022-08-31 | 2022-11-25 | 西安交通大学 | Medical data sharing system and method |
| CN115543929A (en) * | 2022-11-27 | 2022-12-30 | 成都成电金盘健康数据技术有限公司 | Verification method and system based on regional medical health information interaction service |
| CN117216040A (en) * | 2023-11-08 | 2023-12-12 | 中电数据服务有限公司 | Data layered treatment design method and system based on medical data operation mode |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120173576A1 (en) * | 2010-12-30 | 2012-07-05 | Microsoft Corporation | Patient identification |
| CN104104738A (en) * | 2014-08-06 | 2014-10-15 | 江苏瑞中数据股份有限公司 | FTP-based (file transfer protocol-based) data exchange system |
| CN105701176A (en) * | 2016-01-04 | 2016-06-22 | 浪潮软件股份有限公司 | Data integration method and apparatus |
| CN105844566A (en) * | 2016-03-25 | 2016-08-10 | 东华软件股份公司 | Electronic medical record filing management system and electronic medical record filing management method |
| CN107767948A (en) * | 2017-10-30 | 2018-03-06 | 深圳市宏数科技有限公司 | It is classified diagnosis and treatment cloud platform |
| CN107833595A (en) * | 2017-10-12 | 2018-03-23 | 山东大学 | Medical big data multicenter integration platform and method |
-
2018
- 2018-04-16 CN CN201810338365.3A patent/CN108595571A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120173576A1 (en) * | 2010-12-30 | 2012-07-05 | Microsoft Corporation | Patient identification |
| CN104104738A (en) * | 2014-08-06 | 2014-10-15 | 江苏瑞中数据股份有限公司 | FTP-based (file transfer protocol-based) data exchange system |
| CN105701176A (en) * | 2016-01-04 | 2016-06-22 | 浪潮软件股份有限公司 | Data integration method and apparatus |
| CN105844566A (en) * | 2016-03-25 | 2016-08-10 | 东华软件股份公司 | Electronic medical record filing management system and electronic medical record filing management method |
| CN107833595A (en) * | 2017-10-12 | 2018-03-23 | 山东大学 | Medical big data multicenter integration platform and method |
| CN107767948A (en) * | 2017-10-30 | 2018-03-06 | 深圳市宏数科技有限公司 | It is classified diagnosis and treatment cloud platform |
Non-Patent Citations (3)
| Title |
|---|
| 王世伟等: "《医学信息系统教程》", 30 September 2009 * |
| 秦银河等: "《研究型医院管理学》", 30 November 2014 * |
| 谢用辉等: "《保险IT系统建设》", 31 July 2016 * |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109542966A (en) * | 2018-11-09 | 2019-03-29 | 金色熊猫有限公司 | Data fusion method, device, electronic equipment and computer-readable medium |
| CN109542966B (en) * | 2018-11-09 | 2020-09-18 | 金色熊猫有限公司 | Data fusion method and device, electronic equipment and computer readable medium |
| CN109542967A (en) * | 2018-11-19 | 2019-03-29 | 四川长虹电器股份有限公司 | Smart city data-sharing systems and method based on XBRL standard |
| CN109542967B (en) * | 2018-11-19 | 2022-03-08 | 四川长虹电器股份有限公司 | Smart city data sharing system and method based on XBRL standard |
| CN111145843A (en) * | 2019-11-27 | 2020-05-12 | 陕西医链区块链集团有限公司 | Multi-center integration platform and method based on medical big data |
| CN113468379A (en) * | 2020-03-31 | 2021-10-01 | 上海依图网络科技有限公司 | Data source processing method and device and intelligent analysis platform |
| CN112035468A (en) * | 2020-08-24 | 2020-12-04 | 杭州览众数据科技有限公司 | Multi-data-source ETL tool based on memory calculation and web visual configuration |
| CN115394392A (en) * | 2022-08-31 | 2022-11-25 | 西安交通大学 | Medical data sharing system and method |
| CN115543929A (en) * | 2022-11-27 | 2022-12-30 | 成都成电金盘健康数据技术有限公司 | Verification method and system based on regional medical health information interaction service |
| CN117216040A (en) * | 2023-11-08 | 2023-12-12 | 中电数据服务有限公司 | Data layered treatment design method and system based on medical data operation mode |
| CN117216040B (en) * | 2023-11-08 | 2024-04-09 | 中电数据服务有限公司 | Data layered treatment design method and system based on medical data operation mode |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108595571A (en) | A kind of Data Integration management method, device, system and user terminal | |
| US11087878B2 (en) | Methods and systems for improving connections within a healthcare ecosystem | |
| US8990834B2 (en) | Managing healthcare information in a distributed system | |
| He et al. | Toward ubiquitous healthcare services with a novel efficient cloud platform | |
| US11586581B2 (en) | Data capturing and structuring method and system | |
| CN101803293A (en) | Healthcare semantic interoperability platform | |
| Wang et al. | Design and implementation of a web-service-based public-oriented personalized health care platform | |
| CN106407680B (en) | A kind of remote diagnosis system | |
| CN110311973A (en) | A kind of image cloud service system and method towards multi-tenant | |
| CN105678057A (en) | Medical information sharing system | |
| CN102238162A (en) | Inter-hospital unstructured information archiving method | |
| WO2013016324A2 (en) | System and method for sharing electronic information | |
| CN110321283A (en) | Interface testing case generation method, device, computer installation and storage medium | |
| CN107506494B (en) | Document handling method, mobile terminal and computer readable storage medium | |
| Gupta et al. | Security of IoT-based e-healthcare applications using blockchain | |
| CN107111846A (en) | Message processing device, information processing method and program | |
| CN113360941A (en) | Medical data processing method and device based on digital twins and computer equipment | |
| WO2019141696A1 (en) | Detecting recurrence of a medical condition | |
| Meridou et al. | The health avatar: privacy-aware monitoring and management | |
| Pacheco | Self-service kiosk-based anamnesis system for emergency departments | |
| Meridou et al. | An event-driven health service bus | |
| CN114582519B (en) | Hospital follow-up method and device based on multi-source data and terminal equipment | |
| Fu et al. | Sensor application of mobile nursing integrated workstation measurement system based on SOA architecture model in nursing information management | |
| Biswas | EHR-Interoperability study of HL7 amid the COVID-19 epidemic | |
| US20220198576A1 (en) | Systems and method to treat complex revenue cycle management transactions with machine learning in a standards-based electronic data interchange |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180928 |