CN101093483A - Method for collecting and refreshing data of knowledge base - Google Patents
Method for collecting and refreshing data of knowledge base Download PDFInfo
- Publication number
- CN101093483A CN101093483A CN 200610028055 CN200610028055A CN101093483A CN 101093483 A CN101093483 A CN 101093483A CN 200610028055 CN200610028055 CN 200610028055 CN 200610028055 A CN200610028055 A CN 200610028055A CN 101093483 A CN101093483 A CN 101093483A
- Authority
- CN
- China
- Prior art keywords
- data
- mode
- knowledge base
- collecting
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
A method for collecting and updating data of knowledge base includes collecting data from data source by utilizing file transmission mode of FTP protocol according to data type and applying direct update mode to carry out update on data.
Description
Technical field
The present invention relates to the dynamic adjustment of knowledge base data, particularly relate to a kind of method of collecting and refreshing data of knowledge base.
Background technology
The inside simultaneous techniques of large database is a difficult problem of database technology aspect always.When data volume is very huge, just require system very outstanding aspect on the simultaneous techniques of the inside of large database, satisfy and reach very high standard for database security, completeness and real-time aspect.
Summary of the invention
Purpose of the present invention is exactly the method that a kind of collecting and refreshing data of knowledge base is provided for the defective that overcomes above-mentioned prior art existence.
Purpose of the present invention can be achieved through the following technical solutions: a kind of method of collecting and refreshing data of knowledge base, it is characterized in that, this method adopts the document transfer mode of File Transfer Protocol or WEBService mode from the data source image data according to the type of data, and adopts and directly refresh mode or pretreatment mode refreshes data.
This method adopts the document transfer mode of File Transfer Protocol that the basic data that provides with incremental mode is gathered.
When this method proposed up-to-date business datum and user data requests at any time when the client of using knowledge base, knowledge base was passed through the WEBService mode immediately directly to the data source image data.
Method adopts for basic data and directly refreshes mode and carry out Refresh Data.
This method produces the intermediate result data of a large amount of variations for the gene basis data, adopt pretreatment mode, promptly by understanding knowledge base user's custom, the data that predictive user is wished, also can customized demand be proposed by the user, upgrade back calculation process in advance in basic data, when the user needs data, withdraw from immediately; On storage organization, adopt the mode of multistage Materialized View.
Compared with prior art, the present invention has improved the integrality and the real-time of data.
Description of drawings
Fig. 1 is a theory diagram of the present invention;
Embodiment
The invention will be further described below in conjunction with accompanying drawing.
As shown in Figure 1, a kind of method of collecting and refreshing data of knowledge base, this method adopts the document transfer mode of File Transfer Protocol or WEBService mode from the data source image data according to the type of data, and adopts and directly refresh mode or pretreatment mode refreshes data.
This method adopts the document transfer mode of File Transfer Protocol that the basic data that provides with incremental mode is gathered.
When this method proposed up-to-date business datum and user data requests at any time when the client of using knowledge base, knowledge base was passed through the WEBService mode immediately directly to the data source image data.
This method adopts for basic data and directly refreshes mode and carry out Refresh Data.
This method produces the intermediate result data of a large amount of variations for the gene basis data, adopt pretreatment mode, promptly by understanding knowledge base user's custom, the data that predictive user is wished, also can customized demand be proposed by the user, upgrade back calculation process in advance in basic data, when the user needs data, withdraw from immediately; On storage organization, adopt the mode of multistage Materialized View.
The data source collection has two kinds of schemes:
As Fig. 1:
Transmit based on the file of File Transfer Protocol, the increment that transmits data in the set time data source changes file, and this scheme has the time and fixes, time length, batch data, only contains characteristics such as incremental portion, scale are big.
Based on WEBService, when the client of using knowledge base proposed up-to-date business datum and user data requests at any time, knowledge base was passed through more new data of the direct request msg of WEBService mode source immediately.This scheme has in real time, fast, characteristics such as individual data items, small scale.
The complex structure of knowledge base, internal relations is numerous, can produce the computing of a large amount of intermediate results during Data Update, the description of customers like this model etc.As deal with improperly, will directly influence the response performance of system.Therefore, Refresh Data is divided into directly refreshing with pre-service and refreshes two kinds of schemes:
Adopt the method that directly refreshes for basic data, small because new data provides with incremental mode, can very fast realization upgrade.
Produce the intermediate result data of a large amount of variations for the gene basis data, adopt pretreatment mode, promptly by understanding knowledge base user's custom, the data that predictive user is wished, also can customized demand be proposed by the user, upgrade back calculation process in advance in basic data, when the user needs data, release immediately.On storage organization, adopt the mode of multistage Materialized View, to make full use of the facility that database provides.
Claims (5)
1. the method for a collecting and refreshing data of knowledge base, it is characterized in that, this method adopts the document transfer mode of File Transfer Protocol or WEBService mode from the data source image data according to the type of data, and adopts and directly refresh mode or pretreatment mode refreshes data.
2. the method for a kind of collecting and refreshing data of knowledge base according to claim 1 is characterized in that, this method adopts the document transfer mode of File Transfer Protocol that the basic data that provides with incremental mode is gathered.
3. the method for a kind of collecting and refreshing data of knowledge base according to claim 1, it is characterized in that, when this method proposed up-to-date business datum and user data requests at any time when the client of using knowledge base, knowledge base was passed through the WEBService mode immediately directly to the data source image data.
4. the method for a kind of collecting and refreshing data of knowledge base according to claim 1 is characterized in that, this method adopts for basic data and directly refreshes mode and carry out Refresh Data.
5. the method for a kind of collecting and refreshing data of knowledge base according to claim 1, it is characterized in that, this method produces the intermediate result data of a large amount of variations for the gene basis data, adopt pretreatment mode, promptly by understanding knowledge base user's custom, the data that predictive user is wished also can propose customized demand by the user, upgrade back calculation process in advance in basic data, when the user needs data, withdraw from immediately; On storage organization, adopt the mode of multistage Materialized View.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 200610028055 CN101093483A (en) | 2006-06-22 | 2006-06-22 | Method for collecting and refreshing data of knowledge base |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 200610028055 CN101093483A (en) | 2006-06-22 | 2006-06-22 | Method for collecting and refreshing data of knowledge base |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN101093483A true CN101093483A (en) | 2007-12-26 |
Family
ID=38991752
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 200610028055 Pending CN101093483A (en) | 2006-06-22 | 2006-06-22 | Method for collecting and refreshing data of knowledge base |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101093483A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102096857A (en) * | 2010-12-27 | 2011-06-15 | 大唐软件技术股份有限公司 | Collaboration method and device for data processing process |
| CN101557316B (en) * | 2009-05-14 | 2011-07-27 | 阿里巴巴集团控股有限公司 | Method and system for updating statistical data |
| CN102521716A (en) * | 2011-12-31 | 2012-06-27 | 成都信息工程学院 | Integrative specialized weather service integrated system |
-
2006
- 2006-06-22 CN CN 200610028055 patent/CN101093483A/en active Pending
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101557316B (en) * | 2009-05-14 | 2011-07-27 | 阿里巴巴集团控股有限公司 | Method and system for updating statistical data |
| CN102096857A (en) * | 2010-12-27 | 2011-06-15 | 大唐软件技术股份有限公司 | Collaboration method and device for data processing process |
| CN102096857B (en) * | 2010-12-27 | 2013-05-29 | 大唐软件技术股份有限公司 | Collaboration method and device for data processing process |
| CN102521716A (en) * | 2011-12-31 | 2012-06-27 | 成都信息工程学院 | Integrative specialized weather service integrated system |
| CN102521716B (en) * | 2011-12-31 | 2016-01-06 | 成都信息工程学院 | Integrative specialized weather service integrated system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103488760B (en) | Provision method of geographic information tile services and device for implementing provision method | |
| CN105930446B (en) | A kind of telecom client label generating method based on Hadoop distributed computing technology | |
| CN103078958B (en) | Real-time monitoring supervising method for WEB mode of power SCADA (Supervisory Control And Data Acquisition) on basis of combining SVG (Scalable Vector Graphics) with RIA (Rich Internet Application) | |
| CN104573065A (en) | Report display engine based on metadata | |
| CN102567330A (en) | Heterogeneous database integration system | |
| CN102882974A (en) | Method for saving website access resource by website identification version number | |
| CN108228743A (en) | A kind of real-time big data search engine system | |
| CN103823846A (en) | Method for storing and querying big data on basis of graph theories | |
| CN106897386B (en) | A kind of big data multidimensional analysis method and system | |
| CN103164510A (en) | Method and system of generating dynamic data table | |
| CN107563955A (en) | A kind of parallel map dicing method and system based on GPU | |
| CN108351760A (en) | Feed service-Engine | |
| CN103246963A (en) | Staff training system based on Internet of Things | |
| CN101093483A (en) | Method for collecting and refreshing data of knowledge base | |
| CN103198126B (en) | Internet of Things Temporal-spatial data management method | |
| CN102420862B (en) | A kind of Internet of things middleware message form conversion method | |
| Swaroop et al. | Mobile distributed real time database systems: A research challenges | |
| CN102663097A (en) | Agricultural timing sequence data organization method based on Hadoop+Hbase | |
| CN104809210A (en) | Top-k query method based on massive data weighing under distributed computing framework | |
| CN102521360B (en) | Raster data transmission method and system | |
| CN101382959B (en) | Multimedia resource acquisition method, apparatus and system | |
| CN102799649B (en) | Intelligent input prompting device and intelligent input prompting method | |
| CN101964807A (en) | Use technology of network disk and method thereof | |
| CN108170718A (en) | A kind for the treatment of method and apparatus of achievement data | |
| CN106294876A (en) | A kind of three dimensions geographic information data method of servicing of opening |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Open date: 20071226 |