CN103440302A - Real-time data exchange method and system - Google Patents
Real-time data exchange method and system Download PDFInfo
- Publication number
- CN103440302A CN103440302A CN2013103685523A CN201310368552A CN103440302A CN 103440302 A CN103440302 A CN 103440302A CN 2013103685523 A CN2013103685523 A CN 2013103685523A CN 201310368552 A CN201310368552 A CN 201310368552A CN 103440302 A CN103440302 A CN 103440302A
- Authority
- CN
- China
- Prior art keywords
- time data
- real time
- buffer memory
- storehouse
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a real-time data exchange method and system. A real-time data cache library for caching real-time data in at least one real-time data source is established in advance to cache the real-time data in the at least one real-time data source, afterwards, query information on a client terminal is analyzed and received, at last, real-time data information which is matched with the query information is found out in the real-time data cache library and is further fed back to the client terminal, the rapid data exchange service between heterogeneous systems can be provided, wrong information feedback can also be conducted on wrong query information, the high-speed concurrence query function of the real-time data can be achieved, and therefore the efficient and open real-time data service is achieved.
Description
Technical field
The present invention relates to the Data Control field, particularly relate to a kind of method and system of real time data exchange.
Background technology
Requirement of real-time in fields such as electric power, Industry Control to image data is very high, is generally even Millisecond of second level, and how this part data being released in time with general form is that the major issue solved is badly in need of in this field.
There is at present multiple implementation, but mostly the mode based on privately owned interface is carried out data acquisition and can't be fully open, Data Integration in a plurality of real time datas source can not be carried out to integrated use together, directly by network, realize the exchanges data in each real time data source, when a plurality of clients are carried out data access, often to network, cause overweight resource burden, can not process flexibly the Data Integration problem between each system of enterprise.
Summary of the invention
Based on this, be necessary can not carry out flexibly the problem of exchanges data for real time data in a plurality of clients and a plurality of real time datas source, a kind of method and system of real time data exchange is provided.
A kind of method of real time data exchange comprises step:
Receive client query information;
Described client query information and the real time data in the real time data buffer memory storehouse of setting up are in advance mated, and described real time data buffer memory storehouse is real time data in real time data source of buffer memory at least;
If coupling obtains the real time data corresponding with described client query information, described real time data is fed back to client, if mate described client query information, mistake appears, feedback error information is to client.
A kind of system of real time data exchange, comprise access interface unit, Query Information matching unit, real time data buffer memory storehouse and information feedback processing unit;
Described access interface unit is for receiving client query information;
Described Query Information matching unit is for described client query information and the real time data in the real time data buffer memory storehouse of setting up are in advance mated, and described real time data buffer memory storehouse is real time data in real time data source of buffer memory at least;
If described information feedback processing unit obtains the real time data corresponding with described client query information for coupling, described real time data is fed back to client, if mate described client query information, mistake appears, feedback error information is to client.
The method and system of above-mentioned real time data exchange, by receiving client query information, by client query information with real time data source of at least buffer memory of setting up in advance in the real time data buffer memory storehouse of real time data real time data mated; If coupling obtains the real time data corresponding with described client query information, described real time data is fed back to client, if mate described client query information, mistake appears, feedback error information is to client.Real time data buffer memory storehouse by real time data in real time data source of at least buffer memory of setting up in advance is cached the real time data at least one real time data source, receive again the Query Information of client by analysis, the last real time data information feedback be complementary with described Query Information that finds in described real time data buffer memory storehouse is to client, the service of fast data exchange between heterogeneous system can be provided, can also carry out the error message feedback to wrong Query Information, the high speed of real time data is provided, concurrent query function, realized efficient, open Real-time Data Service.
The accompanying drawing explanation
The method flow diagram of one of them embodiment of method that Fig. 1 is the real time data exchange;
The module connection layout of one of them embodiment of system that Fig. 2 is the real time data exchange.
Embodiment
As shown in Figure 1, a kind of method of real time data exchange comprises step:
Step S110, receive client query information; In the present embodiment, system can receive the Query Information that the client of each system sends over, the Query Information that can send over each system client by unified access interface is integrated, and inquires about corresponding real time data information according to the Query Information of each client.
Step S120, mated described client query information and the real time data in the real time data buffer memory storehouse of setting up in advance, and described real time data buffer memory storehouse is real time data in real time data source of buffer memory at least; In the present embodiment, can set up in advance a real time data buffer memory storehouse, described real time data buffer memory storehouse can the real time data source of at least one system of buffer memory in real time data, system receives client query information and Query Information is analyzed, and selects the real time data information corresponding with described Query Information.
Step S130, if coupling obtains the real time data corresponding with described client query information, feed back to client by described real time data, if mate described client query information, mistake occurs, and feedback error information is to client.In the present embodiment, system will feed back to the client that sends out described Query Information with the real time data information that described client query information is complementary, and the different Query Informations that can simultaneously send for a plurality of clients feed back corresponding real time data information.The Query Information that system can also send in described client occur wrong in, the immediate feedback error message is to client, and mistake appears in the reminding user Query Information, in order to input correct Query Information, effectively avoid time waste unnecessary in query script, improve search efficiency.
In the present embodiment, can be according to cached configuration information creating real time data buffer memory storehouse, described cached configuration information comprises to be treated cache table, cache attribute, records number etc.Further the real time data of system focus is cached to real time data buffer memory storehouse, can comprises in the information of buffer memory that the main coding of object is as data cached index.The user can insert inquiry noun, one or more main coding or querying condition etc. by client and form Query Information, by the Web service backstage, connects described real time data buffer memory library inquiry data, and in returning results.Service interface in the present embodiment be for can be set as GetData, and the inquiry noun can pre-define, and consistent with the buffer memory table name in high-speed cache or have one-to-one relationship, is convenient to the user, by client, required real time data carried out to fast query.In the middle of the formula of a specific embodiment is described, in this programme, service interface is described in detail as follows:
Service interface definition:
The input data definition:
The inquiry nominal definition
The user profile definition
The query object definition
The querying attributes definition
The conditional definition inquiry
The output parameter definition
The definition of query note number
The object data definition
In the output parameter definition, query name is identical with input with user profile.
The abnormal information definition
| ReplyCode | Non-conformance description |
| 201 | " verb " is wrong |
| 202 | " noun " is wrong |
| 203 | " main coding " is wrong |
| 204 | " condition " is wrong |
| 205 | " attribute " is wrong |
| 206 | " object data " quantity is too much |
| 207 | The server internal abnormality |
| 208 | " user profile " is wrong |
The complete example of Web-based services:
Request data format:
Response data format:
The method of above-mentioned real time data exchange, by receiving client query information, by client query information with real time data source of at least buffer memory of setting up in advance in the real time data buffer memory storehouse of real time data real time data mated; If coupling obtains the real time data corresponding with described client query information, described real time data is fed back to client, if mate described client query information, mistake appears, feedback error information is to client.Real time data buffer memory storehouse by real time data in real time data source of at least buffer memory of setting up in advance is cached the real time data at least one real time data source, receive again the Query Information of client by analysis, the last real time data information feedback be complementary with described Query Information that finds in described real time data buffer memory storehouse is to client, the service of fast data exchange between heterogeneous system can be provided, can also carry out the error message feedback to wrong Query Information, the high speed of real time data is provided, concurrent query function, realized efficient, open Real-time Data Service.
Therein in embodiment, the method for described real time data exchange, the described real time data buffer memory storehouse of setting up in advance real time data in real time data source of buffer memory at least specifically comprises step:
Set up the shared drive storehouse according to predetermined cached configuration table and buffer memory attribute configuration table, to the main coding field establishment index of described predetermined cached configuration table and described cache attribute allocation list; In the present embodiment, described cached configuration table and described cache attribute allocation list can be determined and revise data wherein by system, user's needs as the case may be pre-determine cached configuration table and buffer memory attribute configuration table, further create the shared drive storehouse, and the main coding field of described predetermined cached configuration table and described cache attribute allocation list is created to index, the system of being convenient to is carried out data query.
The real time data of at least one real time data source issue is buffered into to described shared drive storehouse and obtain real time data buffer memory storehouse.In the present embodiment, the real time data buffer memory that at least one real time data source will be able to be issued to described shared drive storehouse obtains real time data buffer memory storehouse.
For the ease of understanding, now describe in conjunction with specific embodiments.Described cached configuration table can comprise following field:
| Title | Record number |
| Plant stand | 100000 |
| Transformer | 1000000 |
Described cache attribute allocation list can comprise following field:
The table be buffered must configuration main coding field in the cache attribute table.High-speed cache is according to the content creating shared drive storehouse of these two table configurations, and reading out data deposits in wherein from data source, and cache maintenance program is subsequently carried out the real-time change Data Update.High-speed cache creates index to the main coding field of every cache table, accelerates inquiry velocity.
In embodiment, the method for described real time data exchange also comprises step therein: by subscribe in real time delta data to the real time data source, described real time data buffer memory storehouse is upgraded.In the present embodiment, can to described real time data buffer memory storehouse, be upgraded by subscribe in real time delta data to the real time data source, when the data in the real time data source change, can be upgraded real time data buffer memory storehouse timely, valid data are provided immediately.
Therein in embodiment, the method for described real time data exchange, described by subscribe in real time the step that delta data is upgraded described real time data buffer memory storehouse to the real time data source, specifically comprise step:
In the real time data source, object occur to increase or while deleting, and correspondingly increases or deletes the object in described cached configuration table and buffer memory attribute configuration table;
Upgrade described real time data buffer memory storehouse according to described cached configuration table and buffer memory attribute configuration table.
In the present embodiment, after increase or deletion occur object in data source, by maintenance program, carry out cache maintenance.By the variation of contrast main coding, after the object that described cached configuration table and buffer memory attribute configuration table are newly increased is appended to cache table, deleted object is deleted in cache table.By definition " maintenance release number " in buffer memory, after the each maintenance of buffer memory, " maintenance release number " of buffer memory can carry out corresponding modify.
High-speed cache provides the interface of the data query based on main coding to Web service.In order further to accelerate inquiry, the quick real time data query interface according to the main coding Position Number with version number also is provided, provide traversal for regularly inquiring about the fixedly client of main coding.When the version of buffer memory changes, return to the inconsistent mistake of user side version information, allow its re invocation interface inquiry main coding number, or by the inquiry of the interface based on main coding.
Therein in embodiment, the method for described real time data exchange, described Query Information comprises query name word information, querying attributes information, querying condition information and main coding information.In the present embodiment, in actual query script, the noun input of mistake can cause system to return to mistake.The user is in query script, can specify main coding and condition to need wherein one or two to carry out, and described main coding and condition are arranged, as all objects that mean inquiry appointment noun are not set, if there are mistake in main coding or the condition of request return mistake.If do not set a property, return to all available attributes.
As shown in Figure 2, in embodiment, a kind of system of real time data exchange, comprise access interface unit 110, Query Information matching unit 120, real time data buffer memory storehouse 130 and information feedback processing unit 140 therein;
Described access interface unit 110 is for receiving client query information;
Described Query Information matching unit 120 is for described client query information and the real time data in the real time data buffer memory storehouse of setting up are in advance mated, and described real time data buffer memory storehouse 130 is real time data in real time data source of buffer memory at least;
If described information feedback processing unit 140 obtains the real time data corresponding with described client query information for coupling, described real time data is fed back to client, if mate described client query information, mistake appears, feedback error information is to client.
The system of above-mentioned real time data exchange, by receiving client query information, by client query information with real time data source of at least buffer memory of setting up in advance in the real time data buffer memory storehouse of real time data real time data mated; If coupling obtains the real time data corresponding with described client query information, described real time data is fed back to client, if mate described client query information, mistake appears, feedback error information is to client.Real time data buffer memory storehouse by real time data in real time data source of at least buffer memory of setting up in advance is cached the real time data at least one real time data source, receive again the Query Information of client by analysis, the last real time data information feedback be complementary with described Query Information that finds in described real time data buffer memory storehouse is to client, the service of fast data exchange between heterogeneous system can be provided, can also carry out the error message feedback to wrong Query Information, the high speed of real time data is provided, concurrent query function, realized efficient, open Real-time Data Service.
Therein in embodiment, the system of described real time data exchange, also comprise that memory bank processing unit and data lead deposit receipt unit;
Described memory bank processing unit is for according to predetermined cached configuration table and buffer memory attribute configuration table, setting up the shared drive storehouse, to the main coding field establishment index of described predetermined cached configuration table and described cache attribute allocation list;
Described data are led deposit receipt unit and are buffered into described shared drive storehouse for the real time data by the issue of at least one real time data source and obtain real time data buffer memory storehouse.
In embodiment, the system of described real time data exchange, also comprise real time data buffer memory storehouse updating block therein;
Described real time data buffer memory storehouse updating block is for being upgraded described real time data buffer memory storehouse by subscribe in real time delta data to the real time data source.
Therein in embodiment, the system of described real time data exchange, described real time data buffer memory storehouse updating block comprises the data objects processing unit and sets up updating block;
Described data objects processing unit is for occur increasing when real time data source object or while deleting, corresponding increase or delete the object in described cached configuration table and buffer memory attribute configuration table;
The described updating block of setting up is for upgrading described real time data buffer memory storehouse according to described cached configuration table and buffer memory attribute configuration table.
Therein in embodiment, the system of described real time data exchange, described access interface unit comprises query name word information access interface, querying attributes message reference interface, querying condition message reference interface and main coding message reference interface.
Because other part technical characterictics of system of described real time data exchange are identical with said method, do not repeat them here.
The above embodiment has only expressed several embodiment of the present invention, and it describes comparatively concrete and detailed, but can not therefore be interpreted as the restriction to the scope of the claims of the present invention.It should be pointed out that for the person of ordinary skill of the art, without departing from the inventive concept of the premise, can also make some distortion and improvement, these all belong to protection scope of the present invention.Therefore, the protection domain of patent of the present invention should be as the criterion with claims.
Claims (10)
1. the method for a real time data exchange, is characterized in that, comprises step:
Receive client query information;
Described client query information and the real time data in the real time data buffer memory storehouse of setting up are in advance mated, and described real time data buffer memory storehouse is real time data in real time data source of buffer memory at least;
If coupling obtains the real time data corresponding with described client query information, described real time data is fed back to client, if mate described client query information, mistake appears, feedback error information is to client.
2. the method for real time data according to claim 1 exchange, is characterized in that, the described real time data buffer memory storehouse of setting up in advance real time data in real time data source of buffer memory at least specifically comprises step:
Set up the shared drive storehouse according to predetermined cached configuration table and buffer memory attribute configuration table, to the main coding field establishment index of described predetermined cached configuration table and described cache attribute allocation list;
The real time data of at least one real time data source issue is buffered into to described shared drive storehouse and obtain real time data buffer memory storehouse.
3. the method for real time data exchange according to claim 1 and 2, is characterized in that, also comprises step: by subscribe in real time delta data to the real time data source, described real time data buffer memory storehouse is upgraded.
4. the method for real time data exchange according to claim 3, is characterized in that, described by subscribe in real time the step that delta data is upgraded described real time data buffer memory storehouse to the real time data source, specifically comprises step:
In the real time data source, object occur to increase or while deleting, and correspondingly increases or deletes the object in described cached configuration table and buffer memory attribute configuration table;
Upgrade described real time data buffer memory storehouse according to described cached configuration table and buffer memory attribute configuration table.
5. the method for real time data exchange according to claim 1 and 2, is characterized in that, described Query Information comprises query name word information, querying attributes information, querying condition information and main coding information.
6. the system of a real time data exchange, is characterized in that, comprises access interface unit, Query Information matching unit, real time data buffer memory storehouse and information feedback processing unit;
Described access interface unit is for receiving client query information;
Described Query Information matching unit is for described client query information and the real time data in the real time data buffer memory storehouse of setting up are in advance mated, and described real time data buffer memory storehouse is real time data in real time data source of buffer memory at least;
If described information feedback processing unit obtains the real time data corresponding with described client query information for described Query Information matching unit coupling, described real time data is fed back to client, if described Query Information matching unit mates described client query information and mistake occurs, feedback error information is to client.
7. the system of real time data according to claim 6 exchange, is characterized in that, also comprises that memory bank processing unit and data lead deposit receipt unit;
Described memory bank processing unit is for according to predetermined cached configuration table and buffer memory attribute configuration table, setting up the shared drive storehouse, to the main coding field establishment index of described predetermined cached configuration table and described cache attribute allocation list;
Described data are led deposit receipt unit and are buffered into described shared drive storehouse for the real time data by the issue of at least one real time data source and obtain real time data buffer memory storehouse.
8. according to the system of the described real time data exchange of claim 6 or 7, it is characterized in that, also comprise real time data buffer memory storehouse updating block;
Described real time data buffer memory storehouse updating block is for being upgraded described real time data buffer memory storehouse by subscribe in real time delta data to the real time data source.
9. the system of real time data exchange according to claim 8, is characterized in that, described real time data buffer memory storehouse updating block comprises the data objects processing unit and sets up updating block;
Described data objects processing unit is for occur increasing when real time data source object or while deleting, corresponding increase or delete the object in described cached configuration table and buffer memory attribute configuration table;
The described updating block of setting up is for upgrading described real time data buffer memory storehouse according to described cached configuration table and buffer memory attribute configuration table.
10. the system exchanged according to the described real time data of claim 6 or 7, it is characterized in that, described access interface unit comprises query name word information access interface, querying attributes message reference interface, querying condition message reference interface and main coding message reference interface.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310368552.3A CN103440302B (en) | 2013-08-21 | 2013-08-21 | The method and system of Real Data Exchangs |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310368552.3A CN103440302B (en) | 2013-08-21 | 2013-08-21 | The method and system of Real Data Exchangs |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103440302A true CN103440302A (en) | 2013-12-11 |
| CN103440302B CN103440302B (en) | 2016-06-08 |
Family
ID=49693994
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310368552.3A Active CN103440302B (en) | 2013-08-21 | 2013-08-21 | The method and system of Real Data Exchangs |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103440302B (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105868203A (en) * | 2015-01-21 | 2016-08-17 | 上海可鲁系统软件有限公司 | Industrial internet-of-things distributed data access method and database system |
| CN106446279A (en) * | 2016-10-31 | 2017-02-22 | 南京南瑞继保电气有限公司 | Concurrent data analysis method based on analysis service pool and dynamic virtual data set |
| CN107016025A (en) * | 2016-11-17 | 2017-08-04 | 阿里巴巴集团控股有限公司 | A kind of method for building up and device of non-relational database index |
| CN108681588A (en) * | 2018-05-14 | 2018-10-19 | 北京明朝万达科技股份有限公司 | A kind of interface accesses real-time statistical method and system |
| CN112313587A (en) * | 2018-07-09 | 2021-02-02 | 大族激光科技产业集团股份有限公司 | Data processing method of numerical control system, computer equipment and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7287021B2 (en) * | 2000-08-07 | 2007-10-23 | Francis De Smet | Method for searching information on internet |
| CN101989939A (en) * | 2009-07-31 | 2011-03-23 | 同方威视技术股份有限公司 | Real-time data providing method, server and network |
| CN102436510A (en) * | 2011-12-30 | 2012-05-02 | 浙江乐得网络科技有限公司 | Method and system for improving on-line real-time search quality by off-line query |
| CN102523309A (en) * | 2009-07-31 | 2012-06-27 | 同方威视技术股份有限公司 | Method and equipment for responding request of client side and acquiring and returning real-time data |
-
2013
- 2013-08-21 CN CN201310368552.3A patent/CN103440302B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7287021B2 (en) * | 2000-08-07 | 2007-10-23 | Francis De Smet | Method for searching information on internet |
| CN101989939A (en) * | 2009-07-31 | 2011-03-23 | 同方威视技术股份有限公司 | Real-time data providing method, server and network |
| CN102523309A (en) * | 2009-07-31 | 2012-06-27 | 同方威视技术股份有限公司 | Method and equipment for responding request of client side and acquiring and returning real-time data |
| CN102436510A (en) * | 2011-12-30 | 2012-05-02 | 浙江乐得网络科技有限公司 | Method and system for improving on-line real-time search quality by off-line query |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105868203A (en) * | 2015-01-21 | 2016-08-17 | 上海可鲁系统软件有限公司 | Industrial internet-of-things distributed data access method and database system |
| CN106446279A (en) * | 2016-10-31 | 2017-02-22 | 南京南瑞继保电气有限公司 | Concurrent data analysis method based on analysis service pool and dynamic virtual data set |
| CN106446279B (en) * | 2016-10-31 | 2019-09-27 | 南京南瑞继保电气有限公司 | Concurrent data analysis method based on Analysis Service pond and dynamic virtual data set |
| CN107016025A (en) * | 2016-11-17 | 2017-08-04 | 阿里巴巴集团控股有限公司 | A kind of method for building up and device of non-relational database index |
| CN108681588A (en) * | 2018-05-14 | 2018-10-19 | 北京明朝万达科技股份有限公司 | A kind of interface accesses real-time statistical method and system |
| CN112313587A (en) * | 2018-07-09 | 2021-02-02 | 大族激光科技产业集团股份有限公司 | Data processing method of numerical control system, computer equipment and storage medium |
| US11513493B2 (en) | 2018-07-09 | 2022-11-29 | Han's Laser Technology Industry Group Co., Ltd. | Control system driven by real time and non-real time data |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103440302B (en) | 2016-06-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108536778B (en) | Data application sharing platform and method | |
| CN103559217B (en) | A kind of massive multicast data towards isomeric data storehouse warehouse-in implementation method | |
| CN102637214B (en) | Method and system for synchronizing general data among database services | |
| CN103440302A (en) | Real-time data exchange method and system | |
| CN101957865A (en) | Data exchange and sharing technology among heterogeneous systems | |
| CN102546751A (en) | Hierarchical metadata cache control method of distributed file system | |
| CN103516591A (en) | Method and device for achieving enterprise address list in instant communication platform | |
| CN104102652A (en) | Unstructured data storage system and method | |
| CN104778175A (en) | Method and system for realizing data synchronization of heterogeneous database | |
| CN103984726A (en) | Local revision method for database execution plan | |
| CN101521606B (en) | Log information processing method, log server and communication system | |
| CN104794190A (en) | Method and device for effectively storing big data | |
| CN110096521A (en) | Log information processing method and device | |
| CN103678676A (en) | IP library processing method and system | |
| CN103856353A (en) | Service log data access and statistic analysis method and device | |
| CN101021916A (en) | Business process analysis method | |
| CN105320676A (en) | Customer data query service method and device | |
| CN114205641A (en) | Video data processing method and device | |
| CN115481110A (en) | Resource sharing exchange design method based on metadata | |
| CN103593345A (en) | Webpage flow chart editing method and system | |
| CN105023184A (en) | Financial market information query method based on WeChat terminal | |
| CN103365987A (en) | Clustered database system and data processing method based on shared-disk framework | |
| WO2010016941A1 (en) | System, method, and computer program product for accessing and manipulating remote datasets | |
| CN112612802B (en) | Real-time data middle station processing method, device and platform | |
| CN112800066A (en) | Index management method, related device and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |