CN108228667A - A kind of integration method and system of iron and steel resource data information - Google Patents
A kind of integration method and system of iron and steel resource data information Download PDFInfo
- Publication number
- CN108228667A CN108228667A CN201611198229.6A CN201611198229A CN108228667A CN 108228667 A CN108228667 A CN 108228667A CN 201611198229 A CN201611198229 A CN 201611198229A CN 108228667 A CN108228667 A CN 108228667A
- Authority
- CN
- China
- Prior art keywords
- resource data
- iron
- steel
- steel resource
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- XEEYBQQBJWHFJM-UHFFFAOYSA-N Iron Chemical compound [Fe] XEEYBQQBJWHFJM-UHFFFAOYSA-N 0.000 title claims abstract description 305
- 229910000831 Steel Inorganic materials 0.000 title claims abstract description 182
- 239000010959 steel Substances 0.000 title claims abstract description 182
- 229910052742 iron Inorganic materials 0.000 title claims abstract description 153
- 238000000034 method Methods 0.000 title claims abstract description 31
- 230000010354 integration Effects 0.000 title claims abstract description 20
- 238000012216 screening Methods 0.000 claims abstract description 47
- 238000001914 filtration Methods 0.000 claims abstract description 22
- 238000005516 engineering process Methods 0.000 claims abstract description 20
- 238000013500 data storage Methods 0.000 claims abstract description 12
- 238000004891 communication Methods 0.000 claims abstract description 6
- 230000014509 gene expression Effects 0.000 claims description 8
- 238000003032 molecular docking Methods 0.000 claims description 5
- 150000002505 iron Chemical class 0.000 claims 1
- 238000007726 management method Methods 0.000 abstract description 10
- 238000010586 diagram Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/215—Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/951—Indexing; Web crawling techniques
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/04—Manufacturing
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/30—Computing systems specially adapted for manufacturing
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Business, Economics & Management (AREA)
- General Health & Medical Sciences (AREA)
- Strategic Management (AREA)
- Tourism & Hospitality (AREA)
- Primary Health Care (AREA)
- General Business, Economics & Management (AREA)
- Marketing (AREA)
- Human Resources & Organizations (AREA)
- Economics (AREA)
- Health & Medical Sciences (AREA)
- Manufacturing & Machinery (AREA)
- Quality & Reliability (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a kind of integration method and system of iron and steel resource data information, method includes following process：S1, iron and steel resource data platform is docked by way of Webservice network technologies and data-interface；S2, the original iron and steel resource data for obtaining iron and steel resource data platform；S3, the original iron and steel resource data of acquisition are stored in local MySQL database；S4, original iron and steel resource data in MySQL database are called, local timing performs the filtering screening application program of prepackage, which is filtered screening according to steel industry rule and specification to the original iron and steel resource data of calling；S5, the original iron and steel resource data after screening are stored in local SQL database.System includes data communication module, data acquisition module, the first data storage module, filtering screening module and the second data storage module.The present invention can timely and effectively obtain complete, high-quality, cost-effective iron and steel resource data, it is easy to accomplish the complex optimum management to resource, order.
Description
Technical field
The invention belongs to data platform technical field more particularly to a kind of iron and steel resource data information integration method and be
System.
Background technology
Have multiple steel e-commerce websites at present, have respective steel trade quotient, stock quotient per home Web site.According to region
There is oneself unique steel resources per home Web site, to look at this stage entirely, steel of making uniform need to each website to look for, and reduce in this way
Working efficiency, increases cost, is not easy to realize the optimum management to resource, order.
Invention content
Based on this, in view of the above-mentioned problems, the present invention provides a kind of integration method and system of iron and steel resource data information, profit
Each iron and steel resource data platform is docked with the mode of Webservice network technologies and data-interface, is received using spiders software
Collection, parsing raw resource data, are later filtered raw resource data screening and obtain high-quality iron and steel resource data and preserve,
Data cover is wide, and information update is timely and effective, it is easy to accomplish the complex optimum management to resource, order.
The technical scheme is that：A kind of integration method of iron and steel resource data information, including following process：
S1, each iron and steel resource data platform in network is docked by way of Webservice network technologies and data-interface；
S2, using spiders software is pre-installed, obtain the original iron and steel resource data of each iron and steel resource data platform in network；
S3, the original iron and steel resource data of acquisition are stored in local MySQL database；
Original iron and steel resource data in S4, calling MySQL database, local timing perform the filtering screening application journey of prepackage
Sequence, the application program are filtered screening according to steel industry rule and specification to the original iron and steel resource data of calling；
S5, the original iron and steel resource data after screening are stored in local SQL database.
As a further improvement on the present invention, in step S2 each steel in network is obtained using spiders software is pre-installed
The original iron and steel resource data of iron resource data platform refer specifically to：According to the website structure of each iron and steel resource data platform, make
Original iron and steel resource data are decomposed with html analytic technique combination regular expressions, and according to steel characteristics.
As a further improvement on the present invention, the prepackage spiders software in step S2 is by way of multithreading, portion
Multiple servers are affixed one's name to, obtained using distributed way, parse original iron and steel resource data.
To solve technical problem, the present invention also provides a kind of integration system of iron and steel resource data information, including：
Data communication module, for docking each steel in network by way of Webservice network technologies and data-interface
Resource data platform；
Data acquisition module, for using spiders software is pre-installed, obtaining the original of each iron and steel resource data platform in network
Beginning iron and steel resource data；
First data storage module, for the original iron and steel resource data obtained to be stored in local MySQL database；
Filtering screening module, for calling the original iron and steel resource data in MySQL database, and local timing performs prepackage
Filtering screening application program, the application program according to steel industry rule and specification, to the original iron and steel resource data of calling into
Row filtering screening；
Original iron and steel resource data after screening are stored in local SQL database by the second data storage module.
As a further improvement on the present invention, data acquisition module is obtained each in network using spiders software is pre-installed
The original iron and steel resource data of a iron and steel resource data platform refer specifically to：It is tied according to the website of each iron and steel resource data platform
Structure decomposes original iron and steel resource data using html analytic technique combination regular expressions, and according to steel characteristics.
As a further improvement on the present invention, the side that the spiders software pre-installed in data acquisition module passes through multithreading
Formula is deployed to multiple servers, is obtained using distributed way, parses original iron and steel resource data.
The beneficial effects of the invention are as follows：The integration method and system of a kind of iron and steel resource data information provided by the invention,
Each iron and steel resource data platform is docked using the mode of Webservice network technologies and data-interface, utilizes spiders software
It collects, parsing raw resource data, is filtered screening to raw resource data later and obtains high-quality iron and steel resource data and protect
It deposits, data cover is wide, and information update is timely and effective, timely and effectively obtains complete, high-quality, cost-effective iron and steel resource number
According to, it is easy to accomplish the complex optimum management to resource, order.
Description of the drawings
Fig. 1 is the flow diagram of the present invention；
Fig. 2 is the system block diagram of the present invention.
Specific embodiment
The present invention is described in detail below.
Embodiment 1
As shown in Figure 1, a kind of integration method of iron and steel resource data information, including following process：
S1, each iron and steel resource data platform in network is docked by way of Webservice network technologies and data-interface；
S2, using spiders software is pre-installed, obtain the original iron and steel resource data of each iron and steel resource data platform in network；
S3, the original iron and steel resource data of acquisition are stored in local MySQL database；
Original iron and steel resource data in S4, calling MySQL database, local timing perform the filtering screening application journey of prepackage
Sequence, the application program are filtered screening according to steel industry rule and specification to the original iron and steel resource data of calling；
S5, the original iron and steel resource data after screening are stored in local SQL database.
In the above process, dock each iron and steel resource data using the mode of Webservice network technologies and data-interface and put down
Platform, using spiders software collect, parsing raw resource data, raw resource data is filtered later screening obtain it is excellent
Matter iron and steel resource data simultaneously preserve, and data cover is wide, and information update is timely and effective, timely and effectively obtains complete, high-quality, property
Valency is than high iron and steel resource data, it is easy to accomplish the complex optimum management to resource, order.
Embodiment 2
As shown in Figure 1, a kind of integration method of iron and steel resource data information, including following process：
S1, each iron and steel resource data platform in network is docked by way of Webservice network technologies and data-interface；
S2, using spiders software is pre-installed, obtain the original iron and steel resource data of each iron and steel resource data platform in network；
S3, the original iron and steel resource data of acquisition are stored in local MySQL database；
Original iron and steel resource data in S4, calling MySQL database, local timing perform the filtering screening application journey of prepackage
Sequence, the application program are filtered screening according to steel industry rule and specification to the original iron and steel resource data of calling；
S5, the original iron and steel resource data after screening are stored in local SQL database.
In the above process, dock each iron and steel resource data using the mode of Webservice network technologies and data-interface and put down
Platform, using spiders software collect, parsing raw resource data, raw resource data is filtered later screening obtain it is excellent
Matter iron and steel resource data simultaneously preserve, and data cover is wide, and information update is timely and effective, timely and effectively obtains complete, high-quality, property
Valency is than high iron and steel resource data, it is easy to accomplish the complex optimum management to resource, order.
Wherein, in step S2 the original of each iron and steel resource data platform in network is obtained using spiders software is pre-installed
Beginning iron and steel resource data refer specifically to：According to the website structure of each iron and steel resource data platform, combined using html analytic techniques
Regular expression, and decompose original iron and steel resource data according to steel characteristics.
Embodiment 3
As shown in Figure 1, a kind of integration method of iron and steel resource data information, including following process：
S1, each iron and steel resource data platform in network is docked by way of Webservice network technologies and data-interface；
S2, using spiders software is pre-installed, obtain the original iron and steel resource data of each iron and steel resource data platform in network；
S3, the original iron and steel resource data of acquisition are stored in local MySQL database；
Original iron and steel resource data in S4, calling MySQL database, local timing perform the filtering screening application journey of prepackage
Sequence, the application program are filtered screening according to steel industry rule and specification to the original iron and steel resource data of calling；
S5, the original iron and steel resource data after screening are stored in local SQL database.
In the above process, dock each iron and steel resource data using the mode of Webservice network technologies and data-interface and put down
Platform, using spiders software collect, parsing raw resource data, raw resource data is filtered later screening obtain it is excellent
Matter iron and steel resource data simultaneously preserve, and data cover is wide, and information update is timely and effective, timely and effectively obtains complete, high-quality, property
Valency is than high iron and steel resource data, it is easy to accomplish the complex optimum management to resource, order.
Wherein, in step S2 the original of each iron and steel resource data platform in network is obtained using spiders software is pre-installed
Beginning iron and steel resource data refer specifically to：According to the website structure of each iron and steel resource data platform, combined using html analytic techniques
Regular expression, and decompose original iron and steel resource data according to steel characteristics.
Wherein, the prepackage spiders software in step S2 is deployed to multiple servers by way of multithreading, uses
Distributed way obtains, parses original iron and steel resource data, to improve performance.
Embodiment 4
As shown in Fig. 2, a kind of integration system of iron and steel resource data information, including：
Data communication module, for docking each steel in network by way of Webservice network technologies and data-interface
Resource data platform；
Data acquisition module, for using spiders software is pre-installed, obtaining the original of each iron and steel resource data platform in network
Beginning iron and steel resource data；
First data storage module, for the original iron and steel resource data obtained to be stored in local MySQL database；
Filtering screening module, for calling the original iron and steel resource data in MySQL database, and local timing performs prepackage
Filtering screening application program, the application program according to steel industry rule and specification, to the original iron and steel resource data of calling into
Row filtering screening；
Original iron and steel resource data after screening are stored in local SQL database by the second data storage module.
In above system, dock each iron and steel resource data using the mode of Webservice network technologies and data-interface and put down
Platform, using spiders software collect, parsing raw resource data, raw resource data is filtered later screening obtain it is excellent
Matter iron and steel resource data simultaneously preserve, and data cover is wide, and information update is timely and effective, timely and effectively obtains complete, high-quality, property
Valency is than high iron and steel resource data, it is easy to accomplish the complex optimum management to resource, order.
Embodiment 5
As shown in Fig. 2, a kind of integration system of iron and steel resource data information, including：
Data communication module, for docking each steel in network by way of Webservice network technologies and data-interface
Resource data platform；
Data acquisition module, for using spiders software is pre-installed, obtaining the original of each iron and steel resource data platform in network
Beginning iron and steel resource data；
First data storage module, for the original iron and steel resource data obtained to be stored in local MySQL database；
Filtering screening module, for calling the original iron and steel resource data in MySQL database, and local timing performs prepackage
Filtering screening application program, the application program according to steel industry rule and specification, to the original iron and steel resource data of calling into
Row filtering screening；
Original iron and steel resource data after screening are stored in local SQL database by the second data storage module.
In above system, dock each iron and steel resource data using the mode of Webservice network technologies and data-interface and put down
Platform, using spiders software collect, parsing raw resource data, raw resource data is filtered later screening obtain it is excellent
Matter iron and steel resource data simultaneously preserve, and data cover is wide, and information update is timely and effective, timely and effectively obtains complete, high-quality, property
Valency is than high iron and steel resource data, it is easy to accomplish the complex optimum management to resource, order.
Wherein, data acquisition module obtains each iron and steel resource data platform in network using spiders software is pre-installed
Original iron and steel resource data refer specifically to：According to the website structure of each iron and steel resource data platform, html analytic techniques are used
Original iron and steel resource data are decomposed with reference to regular expression, and according to steel characteristics.
Embodiment 6
As shown in Fig. 2, a kind of integration system of iron and steel resource data information, including：
Data communication module, for docking each steel in network by way of Webservice network technologies and data-interface
Resource data platform；
Data acquisition module, for using spiders software is pre-installed, obtaining the original of each iron and steel resource data platform in network
Beginning iron and steel resource data；
First data storage module, for the original iron and steel resource data obtained to be stored in local MySQL database；
Filtering screening module, for calling the original iron and steel resource data in MySQL database, and local timing performs prepackage
Filtering screening application program, the application program according to steel industry rule and specification, to the original iron and steel resource data of calling into
Row filtering screening；
Original iron and steel resource data after screening are stored in local SQL database by the second data storage module.
In above system, dock each iron and steel resource data using the mode of Webservice network technologies and data-interface and put down
Platform, using spiders software collect, parsing raw resource data, raw resource data is filtered later screening obtain it is excellent
Matter iron and steel resource data simultaneously preserve, and data cover is wide, and information update is timely and effective, timely and effectively obtains complete, high-quality, property
Valency is than high iron and steel resource data, it is easy to accomplish the complex optimum management to resource, order.
Wherein, data acquisition module obtains each iron and steel resource data platform in network using spiders software is pre-installed
Original iron and steel resource data refer specifically to：According to the website structure of each iron and steel resource data platform, html analytic techniques are used
Original iron and steel resource data are decomposed with reference to regular expression, and according to steel characteristics.
Wherein, the spiders software pre-installed in data acquisition module is deployed to more services by way of multithreading
Device is obtained using distributed way, parses original iron and steel resource data.
Embodiment described above only expresses the specific embodiment of the present invention, and description is more specific and detailed, but simultaneously
Cannot the limitation to the scope of the claims of the present invention therefore be interpreted as.It should be pointed out that for those of ordinary skill in the art
For, without departing from the inventive concept of the premise, various modifications and improvements can be made, these belong to the guarantor of the present invention
Protect range.
Claims (6)
1. a kind of integration method of iron and steel resource data information, which is characterized in that including following process：
S1, each iron and steel resource data platform in network is docked by way of Webservice network technologies and data-interface；
S2, using spiders software is pre-installed, obtain the original iron and steel resource data of each iron and steel resource data platform in network；
S3, the original iron and steel resource data of acquisition are stored in local MySQL database；
Original iron and steel resource data in S4, calling MySQL database, local timing perform the filtering screening application journey of prepackage
Sequence, the application program are filtered screening according to steel industry rule and specification to the original iron and steel resource data of calling；
S5, the original iron and steel resource data after screening are stored in local SQL database.
2. the integration method of iron and steel resource data information according to claim 1, which is characterized in that using pre- in step S2
Spiders software is filled, the original iron and steel resource data for obtaining each iron and steel resource data platform in network refer specifically to：According to each
The website structure of a iron and steel resource data platform, using html analytic technique combination regular expressions, and according to steel characteristics point
Solve original iron and steel resource data.
3. the integration method of iron and steel resource data information according to claim 1, which is characterized in that the prepackage in step S2
Spiders software is deployed to multiple servers by way of multithreading, is obtained using distributed way, parses original steel
Resource data.
4. a kind of integration system of iron and steel resource data information, which is characterized in that including：
Data communication module, for docking each steel in network by way of Webservice network technologies and data-interface
Resource data platform；
Data acquisition module, for using spiders software is pre-installed, obtaining the original of each iron and steel resource data platform in network
Beginning iron and steel resource data；
First data storage module, for the original iron and steel resource data obtained to be stored in local MySQL database；
Filtering screening module, for calling the original iron and steel resource data in MySQL database, and local timing performs prepackage
Filtering screening application program, the application program according to steel industry rule and specification, to the original iron and steel resource data of calling into
Row filtering screening；
Original iron and steel resource data after screening are stored in local SQL database by the second data storage module.
5. the integration system of iron and steel resource data information according to claim 4, which is characterized in that data acquisition module profit
With prepackage spiders software, the original iron and steel resource data for obtaining each iron and steel resource data platform in network refer specifically to：Root
According to the website structure of each iron and steel resource data platform, using html analytic technique combination regular expressions, and according to steel spy
Property decompose original iron and steel resource data.
6. the integration system of iron and steel resource data information according to claim 4, which is characterized in that in data acquisition module
The spiders software of prepackage is deployed to multiple servers by way of multithreading, is obtained using distributed way, parses original
Beginning iron and steel resource data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611198229.6A CN108228667A (en) | 2016-12-22 | 2016-12-22 | A kind of integration method and system of iron and steel resource data information |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611198229.6A CN108228667A (en) | 2016-12-22 | 2016-12-22 | A kind of integration method and system of iron and steel resource data information |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108228667A true CN108228667A (en) | 2018-06-29 |
Family
ID=62656932
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611198229.6A Pending CN108228667A (en) | 2016-12-22 | 2016-12-22 | A kind of integration method and system of iron and steel resource data information |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108228667A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112749312A (en) * | 2019-10-31 | 2021-05-04 | 北京国双科技有限公司 | Data query method and related device |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102609769A (en) * | 2011-01-19 | 2012-07-25 | 上海中信信息发展股份有限公司 | Data acquisition tool and data acquisition method |
| CN103902732A (en) * | 2014-04-18 | 2014-07-02 | 北京大学 | Construction and network resource collection method of self-adaption network resource collection system |
| CN104281680A (en) * | 2014-09-30 | 2015-01-14 | 百度在线网络技术（北京）有限公司 | Data processing system, method and device for acquiring website resources |
| CN106055618A (en) * | 2016-05-26 | 2016-10-26 | 优品财富管理有限公司 | Data processing method based on web crawlers and structural storage |
-
2016
- 2016-12-22 CN CN201611198229.6A patent/CN108228667A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102609769A (en) * | 2011-01-19 | 2012-07-25 | 上海中信信息发展股份有限公司 | Data acquisition tool and data acquisition method |
| CN103902732A (en) * | 2014-04-18 | 2014-07-02 | 北京大学 | Construction and network resource collection method of self-adaption network resource collection system |
| CN104281680A (en) * | 2014-09-30 | 2015-01-14 | 百度在线网络技术（北京）有限公司 | Data processing system, method and device for acquiring website resources |
| CN106055618A (en) * | 2016-05-26 | 2016-10-26 | 优品财富管理有限公司 | Data processing method based on web crawlers and structural storage |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112749312A (en) * | 2019-10-31 | 2021-05-04 | 北京国双科技有限公司 | Data query method and related device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104077402B (en) | Data processing method and data handling system | |
| Piffer et al. | Turnover rates of regenerated forests challenge restoration efforts in the Brazilian Atlantic forest | |
| CN107590188A (en) | A kind of reptile crawling method and its management system for automating vertical subdivision field | |
| CN103401849B (en) | Abnormal session analyzing method for website logs | |
| CN101997714A (en) | Time processing method, device and system | |
| CN105868327A (en) | Distributed web crawler capturing method based on different updating strategies | |
| CN104182846A (en) | Client management system | |
| CN107045507A (en) | Web page crawl method and device | |
| CN104699757A (en) | Distributed network information acquisition method in cloud environment | |
| CN104967698B (en) | A kind of method and apparatus crawling network data | |
| CN106599015A (en) | Data service management system and method | |
| CN109241380A (en) | A kind of acquisition method of the microblog data combined based on web crawlers and Sina API | |
| CN108228667A (en) | A kind of integration method and system of iron and steel resource data information | |
| Laursen et al. | Parent-child relationship | |
| CN105069135B (en) | The data crawling method and system of the website OTA | |
| CN102130916A (en) | Authority control method and device for page content level | |
| CN107204892A (en) | Power telecom network service data processing method and processing device | |
| CN104809016B (en) | A kind of upgrade method and system of Website page | |
| CN108629475A (en) | A kind of exchange method of the operation information analysis system based on macroeconomic data | |
| CN106815720A (en) | The global adaptation system and method for automatic scheduling | |
| CN106960353A (en) | A kind of user behavior analysis method and system based on e-commerce platform | |
| ATE384300T1 (en) | SYSTEM AND METHOD FOR DEVELOPING ASSIGNMENTS BETWEEN DIFFERENT MESSAGE STRUCTURES | |
| CN106034110B (en) | Access link generation method and device | |
| CN109361564A (en) | Internet data acquisition method and device based on the passive data fusion of master | |
| CN107861994A (en) | Daily record method for sorting and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180629 |
|
| RJ01 | Rejection of invention patent application after publication |