CN102609769A - Data acquisition tool and data acquisition method - Google Patents
Data acquisition tool and data acquisition method Download PDFInfo
- Publication number
- CN102609769A CN102609769A CN2011100214581A CN201110021458A CN102609769A CN 102609769 A CN102609769 A CN 102609769A CN 2011100214581 A CN2011100214581 A CN 2011100214581A CN 201110021458 A CN201110021458 A CN 201110021458A CN 102609769 A CN102609769 A CN 102609769A
- Authority
- CN
- China
- Prior art keywords
- data
- layer
- data source
- instrument
- source
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a data acquisition tool which is used for acquiring data from a plurality of heterogeneous data sources. The data acquisition tool comprises a presentation layer tool, a logic layer tool and a data layer tool. The presentation layer tool is connected to a page presentation layer of each data source and is used for carrying out data acquisition on the page presentation layer of each data source; the presentation layer tool only accesses the page presentation layers of the data sources; the logic layer tool is connected to a logic layer of each data source; data interfaces are provided by the logic layers of the data sources for the logic layer tool to carry out data exchange; and the data layer tool is connected to a data layer of each data source and is used for generating transfer file packages at the data sources or establishing data structure matching association with the data sources and acquiring the data by the transfer file packages or the data structure matching association. The invention also discloses a data acquisition method. According to the data acquisition tool and the data acquisition method, the purpose of acquiring the data from various heterogeneous data sources is achieved by the presentation layers, the logic layers and the data layers and the combined application of various acquisition modes.
Description
Technical field
The present invention relates to data acquisition technology, relate in particular to a kind of metadata acquisition tool and collecting method.
Background technology
Receive open archive information system reference model (the Reference Model for an Open Archival Information System of extensive concern at the international information resources domain; Be called for short OAIS) be one based on numerical information long preservation and the international standard of obtaining (ISO14721:2003), this also is the important reference that current domestic and international Digital Archives is built.Outside the OAIS system, three with separate, the interactional entity of OAIS system formed external environment condition, they are respectively: information generation person, external management, user.This wherein, information generation person is meant and utilizes the OAIS reference model that to individual, mechanism or third party system that information is taken care of for a long time, information generation person will need the information of long preservation and associated metadata to transfer archives to.Digital Archives construction project for present stage; Information generation person is meant that mainly machine-operated archive office and subordinate's files department, particularly these units are existing, regularly produce operation system, office automation (OA) system, archive office's management system of file data.The OAIS model only defines the turnover agreement between information generation person and the archives, but does not provide the concrete mode of data acquisition and transfer, and this problem of the most often running in the Digital Archives project construction exactly.
In conjunction with the situation of actual Digital Archives, the model of corresponding real Digital Archives can abstractly be following three phases:
Receive: the collection of collection archival digitalization and various e-files.The channel of collecting comprises variety of ways such as electronic government documents filing, digitizing processing (comprising papery archives scanning processing and acoustic image archives analog to digital conversion), e-file center are filed, onlinely reported, off line reports.
Pipe (depositing): preservations such as bookkeeping such as archive arrangement, archival description, archives evaluations, data management and data backup memory, CD off-line storage, miniature processing, data migtation are operated.According to the file Life Circle, electronic record is carried out the management of life cycle.
Use: the information issue of archives resource also provides retrieval utilization.Towards different user various archive information services are provided through each net territory, comprise site information issue, utilize service platform, multi-medium file utilization, file retrieval, file borrowing or the like on the net.
This collection reception problem that wherein how to solve e-file is the key issue in the present stage Digital Archives project construction, but does not still have a kind of common software instrument that can adapt to data acquisition in most cases to occur up to now.
Summary of the invention
The present invention is intended to propose a kind of instrument and the method that can gather receipt from heterogeneous data source.
According to an aspect of the present invention, propose a kind of metadata acquisition tool, from several heterogeneous data source image data, this metadata acquisition tool comprises: presentation layer instrument, logical layer instrument and data Layer instrument.The presentation layer instrument is connected to the webpage representation layer of each data source, carries out data acquisition at the webpage representation layer of each data source, and the presentation layer instrument is the webpage representation layer of access data sources only.The logical layer instrument is connected to the logical layer of each data source, and the logical layer of data source provides data-interface to supply the logical layer instrument to carry out exchanges data.The data Layer instrument is connected to the data Layer of each data source, produce to transfer literature kit or to set up the data structure coupling related with data source in data source, matees association and obtains data through transferring literature kit or data structure.
In one embodiment, the presentation layer instrument comprises the data gripping tool, the source code of the page that the webpage representation layer in data gripping tool resolution data source is showed or from the webpage representation layer extracting metadata of data source.The webpage representation layer is that the page of showing is a html page.
In one embodiment, the logical layer instrument comprises application programming interfaces instrument and service bus instrument.The application programming interfaces instrument provides the routine call interface in data source, and the application programming interfaces instrument encapsulates and calls to obtain data said routine call interface, and said routine call interface comprises WebPart, DLL, OCX, JavaBean.The service bus instrument is set up data bus between metadata acquisition tool and data source; With Web Service mode the access standard is provided, data source realizes the exchanges data between data source and the metadata acquisition tool according to the Web Service interface that provides that inserts standard.In one embodiment, the service bus instrument comprises the exchanges data engine, and the exchanges data engine provides transparent data communication and transparent data search and adopts the unified data security mechanism.
In one embodiment, the data Layer instrument comprises data importing instrument and data pipe instrument.The data importing instrument produces to transfer literature kit and will transfer literature kit in data source and imports metadata acquisition tool, and the data importing instrument imports the transfer literature kit based on XML, Excel, DBF, TXT form.The data pipe instrument is set up data structure with data source and is mated related; Fields match through data source and metadata acquisition tool imports metadata acquisition tool with data from data source, and the data pipe instrument is set up data structure with Oracle, MSSQL Server, DB2, Sybase, Access, Foxpro database and mated related.
According to a further aspect in the invention, propose a kind of collecting method, from several heterogeneous data source image data, this collecting method comprises:
The presentation layer acquisition step is carried out data acquisition from the webpage representation layer of each data source, and the presentation layer acquisition step is the webpage representation layer of access data sources only;
The logical layer acquisition step provides data-interface at the logical layer of data source, and carries out exchanges data through data-interface;
The data Layer acquisition step produce to be transferred literature kit or to set up the data structure coupling related with data source in data source, matees association and obtains data through transferring literature kit or data structure.
In one embodiment, the presentation layer acquisition step comprises the source code of the page that the webpage representation layer in resolution data source is showed or from the webpage representation layer extracting metadata of data source.
In one embodiment; The logical layer acquisition step is included in data source the routine call interface is provided; The routine call interface is encapsulated and calls to obtain data; The routine call interface comprises WebPart, DLL, OCX, JavaBean; The logical layer acquisition step also is included between metadata acquisition tool and the data source and sets up data bus, with Web Service mode the access standard is provided, and data source realizes the exchanges data between data source and the metadata acquisition tool according to the Web Service interface that provides that inserts standard.
In one embodiment; The data Layer acquisition step is included in data source and produces the transfer literature kit and will transfer literature kit importing metadata acquisition tool; The data importing instrument imports the transfer literature kit based on XML, Excel, DBF, TXT form; The data Layer acquisition step comprises that also setting up data structure with data source matees related; Fields match through data source and metadata acquisition tool imports metadata acquisition tool with data from data source, and the data pipe instrument is set up data structure with Oracle, MS SQL Server, DB2, Sybase, Access, Foxpro database and mated related.
Metadata acquisition tool of the present invention and collecting method are through presentation layer, logical layer, three aspects of data Layer, and the purpose that reaches image data from various heterogeneous data sources is used in the combination of multiple acquisition mode.
Description of drawings
Fig. 1 has disclosed the structural drawing according to the metadata acquisition tool of one embodiment of the invention.
Fig. 2 has disclosed the process flow diagram according to the collecting method of one embodiment of the invention.
Embodiment
With reference to shown in Figure 1, the present invention has disclosed a kind of metadata acquisition tool, and this metadata acquisition tool is from several heterogeneous data source 50 image data, and this metadata acquisition tool comprises presentation layer instrument 10, logical layer instrument 20 and data Layer instrument 30.
In one embodiment, presentation layer instrument 10 possesses following function with data gripping tool 11:
Can resolve webpage, the extraction of specified URL and transfer metadata;
● support increment extraction, the scope of extraction can be set, can be set to increment extraction yet, the data that extracted can not repeat to extract;
● the support condition extracts, and condition can be set, and only extracts qualified data;
● support multiple deployment way, both can be deployed in data source this locality and carry out single-point acquiring, also can be deployed in and carry out the concurrent collection of multiple spot on the archives remote server;
● support the Mission Monitor function, adopt polling mechanism, one finds that new generation of data source wait to transfer data and promptly carry out active and grasp and realize that data capture operates;
● support format conversion and encapsulation function, can carry out the file layout conversion and make transfer data encapsulation bag according to standard for the electronic record metadata that obtains after extracting.
For crawlers, the configuration feature of support includes but not limited to:
● reference address (the query page address need obtain automatically) that can the disposition data source login page;
● login username/password that can disposition data source;
● querying condition that can the disposition data source query interface;
● can disposition data source query interface information point and the goal systems Database field between corresponding relation;
● can gather the electronic transcript data that entry data and link are pointed to simultaneously;
● support the automatic page turning of Query Result.
Logical layer instrument 20 is connected to the logical layer of each data source, and the logical layer of data source 50 provides data-interface to supply the logical layer instrument to carry out exchanges data.In one embodiment, logical layer instrument 20 comprises application programming interfaces instrument 21 and service bus instrument 22.
Application programming interfaces instrument 21 provides the routine call interface in data source, and 21 pairs of routine call interfaces of application programming interfaces instrument encapsulate and call to obtain data, and the routine call interface comprises WebPart, DLL, OCX, JavaBean.The routine call interface does not have visual operation interface; And need to carry out secondary development to the physical interface situation that data source provides; But application programming interfaces instrument 21 can be reserved the integrated approach that calls of common interface (Web Part, DLL, OCX, JavaBean etc.); Modal method is that it is carried out the interface encapsulation, perhaps is directed against the Web Service encapsulation of Web Part etc. such as the JNI encapsulation to DLL.
Service bus instrument 22 is set up data bus between metadata acquisition tool and data source; With the WebService mode access standard is provided, data source realizes the exchanges data between data source and the metadata acquisition tool according to the Web Service interface that provides that inserts standard.In one embodiment, service bus instrument 22 comprises exchanges data engine 23, and exchanges data engine 23 provides transparent data communication and transparent data search and adopts the unified data security mechanism.
It is close that data in 23 pairs of transmission of exchanges data engine have been carried out content conversion, format conversion, compression and plus-minus, is used for guaranteeing consistance, integrality and the security of data in transmission course.The exchanges data engine comprises support technology, data processing and data, services three parts:
Support technology comprises the basic support technologies of exchanges data such as queuing mechanism, synchronization mechanism, asynchronous mechanism, and supports common data transfer modes such as FTP, HTTP, File Stream, Socket, supports breakpoint transmission.Data processing comprises data pattern management, data route and data processing functions such as conversion, data encryption and storage.Data, services comprises data exchange service, data check service, data access service and Data Update service.
Data processing section and data, services partial function briefly introduce as follows:
● data pattern management: when each application system is carried out data exchange operation through the exchanges data engine, all indicated the data pattern parameter, to show what the data that will ask and operate are.Another function of data pattern management can be carried out format conversion exactly: can be new message with the data recombination in a certain message, so it just can be used for the Another application program.Can the data pattern management service be envisioned as a general dictionary, be appreciated that " language " of application program, and know application information which partly be useful.The data pattern management has powerful analysis and method for mode matching, and this is the reason place that it can understand message format.These methods combine, and almost can describe the structure of all message formats.Message format is made up of each parts, and each parts has all been described the corresponding field in the message.When coming describing message, just can each territory be reconfigured, constitute new message with the pattern of parts.
● data route and conversion: under fairly simple situation, a certain message possibly have only one to receive application program.And the situation of more complicated is, the reception application program of two (or more) is arranged.For supporting all these situation, need to send a message to the reception application program of arbitrary number.Note that each receives application program and all requires to use different message formats.In order to realize really solution flexibly, need and dynamically to formulate format conversion and routing decision according to the real data in every message.
● data encryption and storage: in exchanges data and dump procedure, some confidentiality data need be encrypted before storing target database into.Even also direct reading machine ciphertext data from target database of data base administrator like this.Whole data encryption stores service is made up of three parts: data encryption uses AES that data are encrypted, and the confidentiality data need to encrypt before advancing database.Data decryption uses decipherment algorithm that data are deciphered, and confidential data needs deciphering when database takes out.It is to encrypt that which information of which table is specified in the confidential data configuration.
● data exchange service: the api routine calling interface of exchanges data is provided, adopts Web Service mode to encapsulate, be convenient to the related application system integration.After integrated, not only exchanges data can be carried out between origin system and the goal systems, exchanges data can be carried out in twos between any system of access exchanges data engine.
● data access service: to the application system data access service of query source database and target database is provided, adopts Web Service mode to encapsulate, be convenient to the related application system call.
● Data Update service: to source database the Data Update poll services is provided, changes, upgrade target database automatically, adopt Web Service mode to encapsulate, be convenient to the related application system integration in case find the source database data.
● the data check service: the consistance conflict may take place in the data of separate sources when being dumped to target database.Inconsistent situation generation when data needs corresponding processing rule and triggers, and removes the corresponding record of verification.The data check service adopts Web Service mode to encapsulate, and is convenient to the related application system integration.
Data Layer instrument 30 is connected to the data Layer of each data source 50, produce to transfer literature kit or to set up the data structure coupling related with data source in data source, matees association and obtains data through transferring literature kit or data structure.In one embodiment, data Layer instrument 30 comprises data importing instrument 31 and data pipe instrument 32.Data importing instrument 31 produces to transfer literature kit and will transfer literature kit in data source and imports metadata acquisition tool, and the data importing instrument imports the transfer literature kit based on XML, Excel, DBF, TXT form.
Support but be not limited to following three types data source (comprising source database and target database): large-scale relevant database: Oracle, SQL Server, DB2, Sybase etc.Standalone version relevant database: MySQL, Foxpro, Access etc.Text: XML, TXT and EXCEL etc.
The function that data pipe instrument 32 is supported comprises:
● visual connection Various types of data source (comprising source database and target database).
● data pipe function: data sync between the database and exchange, visual selection correspondence table and corresponding field.
● import and export function: the data in the database are exported to the text of certain format, the text of certain format is imported database.
● condition setting function: the querying condition (comprising various comparison operators and logical operator) that allows to be provided with the source data table.
● multiple update mode: create table (create), rebuild table (replace), empty renewal (refresh), update all (update), incremental update multiple update modes such as (append) to the target database support.
● log recording function: write down relevant informations such as error situation, record number, progress at derivative in according to process, and on the interface, show.
● the version hold function: user definition can the result of definition be preserved after data pipeline and be convenient to reuse next time.
● test function: can carry out database (comprising source database and target database) and be connected test and the test before of derivative certificate.
● multilist correlation function:, can also carry out multilist operation associated (can adopt the method for data base view to solve) except singly showing derivative one to one according to the operation.
With reference to shown in Figure 2, the present invention has also disclosed a kind of collecting method, and this method is from several heterogeneous data source image data, and this collecting method comprises:
S40. presentation layer acquisition step is carried out data acquisition from the webpage representation layer of each data source, and the presentation layer acquisition step is the webpage representation layer of access data sources only.In one embodiment, presentation layer acquisition step S40 comprises the source code of the page that the webpage representation layer in resolution data source is showed or from the webpage representation layer extracting metadata of data source.
S41. logical layer acquisition step provides data-interface at the logical layer of data source, and carries out exchanges data through data-interface.In one embodiment; Logical layer acquisition step S41 is included in data source the routine call interface is provided; The routine call interface is encapsulated and calls to obtain data; The routine call interface comprises Web Part, DLL, OCX, JavaBean; Logical layer acquisition step S41 also is included between metadata acquisition tool and the data source and sets up data bus, with Web Service mode the access standard is provided, and data source realizes the exchanges data between data source and the metadata acquisition tool according to the Web Service interface that provides that inserts standard.
S42. data Layer acquisition step produces in data source and to transfer literature kit or to set up the data structure coupling related with data source, matees association and obtains data through transferring literature kit or data structure.In one embodiment; Data Layer acquisition step S42 is included in data source and produces the transfer literature kit and will transfer literature kit importing metadata acquisition tool; The data importing instrument imports the transfer literature kit based on XML, Excel, DBF, TXT form; Data Layer acquisition step S42 comprises that also setting up data structure with data source matees related; Fields match through data source and metadata acquisition tool imports metadata acquisition tool with data from data source, and the data pipe instrument is set up data structure with Oracle, MS SQL Server, DB2, Sybase, Access, Foxpro database and mated related.
The details step of collecting method shown in Figure 2 is corresponding with metadata acquisition tool shown in Figure 1, no longer is repeated in this description here.
Metadata acquisition tool of the present invention and collecting method are through presentation layer, logical layer, three aspects of data Layer, and the purpose that reaches image data from various heterogeneous data sources is used in the combination of multiple acquisition mode.
Claims (10)
1. a metadata acquisition tool is characterized in that, from several heterogeneous data source image data, this metadata acquisition tool comprises:
The presentation layer instrument is connected to the webpage representation layer of each data source, carries out data acquisition at the webpage representation layer of each data source, and the presentation layer instrument is the webpage representation layer of access data sources only;
The logical layer instrument is connected to the logical layer of each data source, and the logical layer of data source provides data-interface to supply the logical layer instrument to carry out exchanges data;
The data Layer instrument is connected to the data Layer of each data source, produces in data source and transfers literature kit or to set up the data structure coupling related with data source, matees association and obtains data through transferring literature kit or data structure.
2. metadata acquisition tool as claimed in claim 1 is characterized in that,
Said presentation layer instrument comprises the data gripping tool, the source code of the page that the webpage representation layer in data gripping tool resolution data source is showed or from the webpage representation layer extracting metadata of data source.
3. metadata acquisition tool as claimed in claim 2 is characterized in that,
Said webpage representation layer is that the page of showing is the HTM L page.
4. metadata acquisition tool as claimed in claim 1 is characterized in that,
Said logical layer instrument comprises application programming interfaces instrument and service bus instrument;
Said application programming interfaces instrument provides the routine call interface in data source, and the application programming interfaces instrument encapsulates and calls to obtain data said routine call interface, and said routine call interface comprises Web Part, DLL, OCX, JavaBean;
Said service bus instrument is set up data bus between metadata acquisition tool and data source; With Web Service mode the access standard is provided, said data source realizes the exchanges data between data source and the metadata acquisition tool according to the WebService interface that provides that inserts standard.
5. metadata acquisition tool as claimed in claim 4 is characterized in that,
Said service bus instrument comprises the exchanges data engine, and the exchanges data engine provides transparent data communication and transparent data search and adopts the unified data security mechanism.
6. metadata acquisition tool as claimed in claim 1 is characterized in that,
Said data Layer instrument comprises data importing instrument and data pipe instrument;
Said data importing instrument produces to transfer literature kit and will transfer literature kit in data source and imports said metadata acquisition tool, and said data importing instrument imports the transfer literature kit based on XML, Excel, DBF, TXT form;
Said data pipe instrument is set up data structure with data source and is mated related; Fields match through data source and metadata acquisition tool imports metadata acquisition tool with data from data source, and said data pipe instrument is set up data structure with Oracle, MS SQL Server, DB2, Sybase, Access, Foxpro database and mated related.
7. a collecting method is characterized in that, from several heterogeneous data source image data, this collecting method comprises:
The presentation layer acquisition step is carried out data acquisition from the webpage representation layer of each data source, and the presentation layer acquisition step is the webpage representation layer of access data sources only;
The logical layer acquisition step provides data-interface at the logical layer of data source, and carries out exchanges data through data-interface;
The data Layer acquisition step produce to be transferred literature kit or to set up the data structure coupling related with data source in data source, matees association and obtains data through transferring literature kit or data structure.
8. collecting method as claimed in claim 7 is characterized in that,
Said presentation layer acquisition step comprises the source code of the page that the webpage representation layer in resolution data source is showed or from the webpage representation layer extracting metadata of data source.
9. collecting method as claimed in claim 7 is characterized in that,
Said logical layer acquisition step is included in data source the routine call interface is provided; The routine call interface is encapsulated and calls to obtain data; Said routine call interface comprises Web Part, DLL, OCX, JavaBean; Said logical layer acquisition step also is included between metadata acquisition tool and the data source sets up data bus; With Web Service mode the access standard is provided, said data source realizes the exchanges data between data source and the metadata acquisition tool according to the Web Service interface that provides that inserts standard.
10. collecting method as claimed in claim 7 is characterized in that,
Said data Layer acquisition step is included in data source and produces the transfer literature kit and will transfer literature kit importing metadata acquisition tool; The data importing instrument imports the transfer literature kit based on XML, Excel, DBF, TXT form; Said data Layer acquisition step comprises that also setting up data structure with data source matees related; Fields match through data source and metadata acquisition tool imports metadata acquisition tool with data from data source, and said data pipe instrument is set up data structure with Oracle, MS SQL Server, DB2, Sybase, Access, Foxpro database and mated related.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011100214581A CN102609769A (en) | 2011-01-19 | 2011-01-19 | Data acquisition tool and data acquisition method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011100214581A CN102609769A (en) | 2011-01-19 | 2011-01-19 | Data acquisition tool and data acquisition method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN102609769A true CN102609769A (en) | 2012-07-25 |
Family
ID=46527124
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2011100214581A Pending CN102609769A (en) | 2011-01-19 | 2011-01-19 | Data acquisition tool and data acquisition method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102609769A (en) |
Cited By (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103412933A (en) * | 2013-08-20 | 2013-11-27 | 南京物联网应用研究院有限公司 | Cloud search platform |
| CN103473378A (en) * | 2013-09-30 | 2013-12-25 | 国家电网公司 | Conventional data collecting system capable of collecting various structural data sources and collecting method |
| CN103488955A (en) * | 2013-10-17 | 2014-01-01 | 上海中信信息发展股份有限公司 | Electronic document handover all-in-one machine |
| CN103970794A (en) * | 2013-02-01 | 2014-08-06 | 联想(北京)有限公司 | Method and device for accessing data |
| CN104426900A (en) * | 2013-09-11 | 2015-03-18 | 腾讯科技（深圳）有限公司 | Multimedia data acquiring method and system |
| CN104899325A (en) * | 2015-06-19 | 2015-09-09 | 上海卓悠网络科技有限公司 | APP (application) acquired data collection method, terminal, server and system |
| CN105760532A (en) * | 2016-03-03 | 2016-07-13 | 江苏物联网研究发展中心 | Resource sharing system based on Web Service and resource sharing method based on Web Service |
| CN106156356A (en) * | 2016-07-27 | 2016-11-23 | 北京电子科技学院 | OAIS Information encapsulation method and system based on XML |
| CN107274098A (en) * | 2017-06-20 | 2017-10-20 | 国网江苏省电力公司无锡供电公司 | A kind of method of the grid equipment information intelligent storage based on dispatching of power netwoks technology |
| CN107733893A (en) * | 2017-10-18 | 2018-02-23 | 陕西云基华海信息技术有限公司 | A kind of data collecting system and acquisition method |
| CN107818820A (en) * | 2017-09-14 | 2018-03-20 | 金华禾宜信息技术有限公司 | A kind of heterogeneous medical device data acquisition platform |
| CN108197207A (en) * | 2017-12-28 | 2018-06-22 | 南京涵韬信息科技有限公司 | Batch data matches introduction method |
| CN108228667A (en) * | 2016-12-22 | 2018-06-29 | 钢钢网电子商务（上海）股份有限公司 | A kind of integration method and system of iron and steel resource data information |
| CN109446387A (en) * | 2018-10-09 | 2019-03-08 | 众蚁(上海)信息技术有限公司 | A kind of Owners Committee's intelligent Answer System based on artificial intelligence |
| CN109460912A (en) * | 2018-10-31 | 2019-03-12 | 泰康保险集团股份有限公司 | Data processing method, device, storage medium and electronic equipment |
| CN109614532A (en) * | 2018-11-26 | 2019-04-12 | 上海阿米特数据系统有限公司 | A kind of retail website data auto acquisition system |
| CN109977154A (en) * | 2019-02-22 | 2019-07-05 | 青岛农业大学 | A kind of more API sets at big data terminal system method for building up |
| CN110019501A (en) * | 2017-08-24 | 2019-07-16 | 深圳市金证科技股份有限公司 | A kind of collecting method, device and terminal device |
| CN110377563A (en) * | 2019-07-23 | 2019-10-25 | 中国工商银行股份有限公司 | Document handling method and device and electronic equipment and readable storage medium storing program for executing |
| CN110866005A (en) * | 2019-09-26 | 2020-03-06 | 上海东方富联科技有限公司 | Internet of things data acquisition management method and system, storage medium and terminal |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1786965A (en) * | 2005-12-21 | 2006-06-14 | 北大方正集团有限公司 | Method for acquiring news web page text information |
| CN101206648A (en) * | 2006-12-20 | 2008-06-25 | 鸿富锦精密工业（深圳）有限公司 | Network service generating system and method |
| CN101452450A (en) * | 2007-11-30 | 2009-06-10 | 上海市电力公司 | Multiple source data conversion service method and apparatus thereof |
| CN101604319A (en) * | 2009-05-31 | 2009-12-16 | 上海文广新闻传媒集团 | Xinhua Finance Media's business datum centring system |
| CN101930464A (en) * | 2010-08-25 | 2010-12-29 | 华南理工大学 | RFID logistics application-orientated loose heterogeneous data exchange system and method |
-
2011
- 2011-01-19 CN CN2011100214581A patent/CN102609769A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1786965A (en) * | 2005-12-21 | 2006-06-14 | 北大方正集团有限公司 | Method for acquiring news web page text information |
| CN101206648A (en) * | 2006-12-20 | 2008-06-25 | 鸿富锦精密工业（深圳）有限公司 | Network service generating system and method |
| CN101452450A (en) * | 2007-11-30 | 2009-06-10 | 上海市电力公司 | Multiple source data conversion service method and apparatus thereof |
| CN101604319A (en) * | 2009-05-31 | 2009-12-16 | 上海文广新闻传媒集团 | Xinhua Finance Media's business datum centring system |
| CN101930464A (en) * | 2010-08-25 | 2010-12-29 | 华南理工大学 | RFID logistics application-orientated loose heterogeneous data exchange system and method |
Non-Patent Citations (4)
| Title |
|---|
| 《数字技术与应用》 20101130 赖松兆 "基于Web Service 的异构数据库的集成" 第117-119页 , 第11期 * |
| 《计算机时代》 20070131 张爱平; 赖欣 "在JSP中调用JavaBean实现Web数据库访问" 第62-64页 , 第01期 * |
| 张爱平; 赖欣: ""在JSP中调用JavaBean实现Web数据库访问"", 《计算机时代》, no. 01, 31 January 2007 (2007-01-31), pages 62 - 64 * |
| 赖松兆: ""基于Web Service 的异构数据库的集成"", 《数字技术与应用》, no. 11, 30 November 2010 (2010-11-30), pages 117 - 119 * |
Cited By (24)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103970794B (en) * | 2013-02-01 | 2017-11-28 | 联想(北京)有限公司 | Data access method and data access device |
| CN103970794A (en) * | 2013-02-01 | 2014-08-06 | 联想(北京)有限公司 | Method and device for accessing data |
| CN103412933A (en) * | 2013-08-20 | 2013-11-27 | 南京物联网应用研究院有限公司 | Cloud search platform |
| CN104426900A (en) * | 2013-09-11 | 2015-03-18 | 腾讯科技（深圳）有限公司 | Multimedia data acquiring method and system |
| CN104426900B (en) * | 2013-09-11 | 2019-12-06 | 腾讯科技（深圳）有限公司 | multimedia data acquisition method and system |
| CN103473378A (en) * | 2013-09-30 | 2013-12-25 | 国家电网公司 | Conventional data collecting system capable of collecting various structural data sources and collecting method |
| CN103488955A (en) * | 2013-10-17 | 2014-01-01 | 上海中信信息发展股份有限公司 | Electronic document handover all-in-one machine |
| CN103488955B (en) * | 2013-10-17 | 2017-02-08 | 上海中信信息发展股份有限公司 | Electronic document handover all-in-one machine |
| CN104899325A (en) * | 2015-06-19 | 2015-09-09 | 上海卓悠网络科技有限公司 | APP (application) acquired data collection method, terminal, server and system |
| CN105760532A (en) * | 2016-03-03 | 2016-07-13 | 江苏物联网研究发展中心 | Resource sharing system based on Web Service and resource sharing method based on Web Service |
| CN105760532B (en) * | 2016-03-03 | 2020-02-14 | 江苏物联网研究发展中心 | Resource sharing system and method based on Web Service |
| CN106156356A (en) * | 2016-07-27 | 2016-11-23 | 北京电子科技学院 | OAIS Information encapsulation method and system based on XML |
| CN108228667A (en) * | 2016-12-22 | 2018-06-29 | 钢钢网电子商务（上海）股份有限公司 | A kind of integration method and system of iron and steel resource data information |
| CN107274098A (en) * | 2017-06-20 | 2017-10-20 | 国网江苏省电力公司无锡供电公司 | A kind of method of the grid equipment information intelligent storage based on dispatching of power netwoks technology |
| CN110019501A (en) * | 2017-08-24 | 2019-07-16 | 深圳市金证科技股份有限公司 | A kind of collecting method, device and terminal device |
| CN107818820A (en) * | 2017-09-14 | 2018-03-20 | 金华禾宜信息技术有限公司 | A kind of heterogeneous medical device data acquisition platform |
| CN107733893A (en) * | 2017-10-18 | 2018-02-23 | 陕西云基华海信息技术有限公司 | A kind of data collecting system and acquisition method |
| CN108197207A (en) * | 2017-12-28 | 2018-06-22 | 南京涵韬信息科技有限公司 | Batch data matches introduction method |
| CN109446387A (en) * | 2018-10-09 | 2019-03-08 | 众蚁(上海)信息技术有限公司 | A kind of Owners Committee's intelligent Answer System based on artificial intelligence |
| CN109460912A (en) * | 2018-10-31 | 2019-03-12 | 泰康保险集团股份有限公司 | Data processing method, device, storage medium and electronic equipment |
| CN109614532A (en) * | 2018-11-26 | 2019-04-12 | 上海阿米特数据系统有限公司 | A kind of retail website data auto acquisition system |
| CN109977154A (en) * | 2019-02-22 | 2019-07-05 | 青岛农业大学 | A kind of more API sets at big data terminal system method for building up |
| CN110377563A (en) * | 2019-07-23 | 2019-10-25 | 中国工商银行股份有限公司 | Document handling method and device and electronic equipment and readable storage medium storing program for executing |
| CN110866005A (en) * | 2019-09-26 | 2020-03-06 | 上海东方富联科技有限公司 | Internet of things data acquisition management method and system, storage medium and terminal |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102609769A (en) | Data acquisition tool and data acquisition method | |
| CN106874461B (en) | A kind of workflow engine supports multi-data source configuration security access system and method | |
| US20220019559A1 (en) | Blockchain Services | |
| WO2022001418A1 (en) | Data processing method and apparatus, and computer program and storage medium | |
| CN103107889B (en) | A kind of cloud computing environment data encryption storage system and method that can search for | |
| JP5591232B2 (en) | Information transmission using virtual input layout | |
| CN105450636B (en) | A kind of cloud computing management system | |
| CN101853287B (en) | Data compression quick retrieval file system and method thereof | |
| CN110009201B (en) | Electric power data link system and method based on block chain technology | |
| CN103731489B (en) | A kind of date storage method, system and equipment | |
| CN107665233A (en) | Database data processing method, device, computer equipment and storage medium | |
| CN103595730A (en) | Ciphertext cloud storage method and system | |
| CN102800015A (en) | Financial IC (Integrated Circuit) card long-distance individualized method and system | |
| CN104660617B (en) | A kind of data transmission system and method | |
| CN112883015A (en) | Block chain data management method, device and storage medium | |
| CN103490886A (en) | Permission data validation method, device and system | |
| CN109522328A (en) | A kind of data processing method and its device, medium, terminal | |
| CN103179193A (en) | Data transmission system and data transmission method used for distributed application system | |
| CN102065136A (en) | P2P (Peer-to-Peer) network safety data transmission method and system | |
| CN115208665A (en) | Block chain-based germplasm resource data secure sharing method and system | |
| CN105447146A (en) | Massive data collecting and exchanging system and method | |
| CN115085902A (en) | Power grid dispatching log management method and system | |
| JP2017016430A (en) | Communication system and program | |
| CN104753870A (en) | Data transmission method and system | |
| CN109660568B (en) | Method, equipment and system for realizing network talkback security mechanism based on SRTP |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20120725 |