CN1249610C - Automatic document down-load system and method - Google Patents
Automatic document down-load system and method Download PDFInfo
- Publication number
- CN1249610C CN1249610C CN 02115085 CN02115085A CN1249610C CN 1249610 C CN1249610 C CN 1249610C CN 02115085 CN02115085 CN 02115085 CN 02115085 A CN02115085 A CN 02115085A CN 1249610 C CN1249610 C CN 1249610C
- Authority
- CN
- China
- Prior art keywords
- data
- download
- automatic
- title
- data base
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Landscapes
- Information Transfer Between Computers (AREA)
Abstract
The present invention relates to an automatic data downloading system and a method, which can automatically download data which is in conformity with conditions through a network according to downloading conditions set by users. Before data is downloaded, the automatic data downloading system automatically inspects a local database so as to avoid repeatedly downloading the existing data. The automatic data downloading system comprises an automatic search module, an automatic downloading module and an automatic recording module, wherein the automatic search module can automatically search the local database before downloading, the automatic downloading module can automatically download the data which is in conformity with the conditions according to the downloading conditions and repeatedly download data which is not successfully downloaded, and the automatic recording module is used for automatically recording a list for data which is not downloaded or is not successfully downloaded. All the required data can be downloaded through the network by users through the automatic data downloading system, and data which is already stored in the local database is not repeatedly downloaded; consequently, the present invention has the advantages of data downloading time saving and reduction of network resource occupation.
Description
[invention field]
The present invention relates to automatic download system of a kind of data and method, refer to that especially a kind of energy downloads in the local data base the not system and method for the data of storage automatically by network.
[background of invention]
Along with the development of network transmission technology, most of Internet service provider all is give information inquiry and a download function of user, and the user can transmit data mutually by network on the network, also can directly download data from some network information service merchant's the server by network.
When users from networks is sought required information, many information sites query function of giving information.The user can enumerate the message that all need by setting querying condition, clicks the title of a certain Query Result or intersecting chain then and fetches and check or download its content.The general information website can only allow the user once to download one piece of content when download function is provided, and can not download the data content that all satisfy condition automatically according to the querying condition that the user sets.User such as need are downloaded all data that satisfy condition, and can only download piece by piece artificially.Especially (as some data is to preserve with image file when the data quantity of required download is very big, and once can only download one page), this will expend the user and finish this download work a large amount of time, in case situations such as temporary transient network is obstructed occur, download the work meeting and will quite bother and expend time in.
When carrying out the network data download, some user of collective can share a server and visit external website, and the data of download can be stored in the server by an internal network, also can directly be stored in user's terminating machine separately.The user of these collectives can be certain department of a company or a company, and its internal user may need often to use some identical data.Yet when carrying out the data download by network, these users download own required information separately, and the data that can not effectively utilize other user to download causes the repeated downloads of great mass of data, and cause user time and waste of network resources.
In the data downloading process, the user runs into network congestion or blockage through regular meeting, and user's download work is once success often.In this case, the user need repeat download work artificially, and this also can cause the waste of time and resource.
The U.S. is in the 6th, 339, No. 785 patents (application on November 24th, 1999 bulletin on January 15th, 1) disclose a kind of system (Multi-Server FileDownload) that carries out the data download by network from a plurality of servers, this system can accelerate the speed of download of data by network simultaneously from the same piece of writing of a plurality of downloaded data.As shown in Figure 7, a client computer 30 can be downloaded data from a plurality of far- end servers 51,52,53 by a network system 40.This data downloading system can be simultaneously downloaded same piece of writing archives from a plurality of far-end servers, downloads the different piece of these archives, these archives of combination in client computer 30 at last from each far-end server.
Yet this U.S. data downloading system that the 6th, 339, No. 785 patent disclosed can not just be checked its local data base before data is downloaded, and to avoid the repeated downloads of data, can not carry out automatic repeated downloads to the data content of not success download.
In sum, need the automatic download tool of a kind of data, the download condition that can set by the user is automatically from the network download required information, can carry out automatic repeated downloads to downloading unsuccessful data, and can make collective's internal user share the data of having downloaded, avoid the repeated downloads of data, with the time of minimizing data download and taking of Internet resources.
[summary of the invention]
Fundamental purpose of the present invention is to provide automatic download system of a kind of data and method, can check local data base by elder generation before the network download data, and only download the data of not storing in the local data base.
Another object of the present invention is to provide automatic download system of a kind of data and method, can download data automatically by network according to the download condition, and after download is finished the automatic data successfully do not downloaded of record and automatic repeated downloads.
The present invention discloses the automatic download system of a kind of data, and the download condition that this system can set according to the user is automatically from the network download related data, and checks local data base before download earlier, to avoid the repeated downloads of data.The automatic download system of this data comprises: a local data base; Whether one automatic search module can be stored in this local data base with the data of confirming required download according to this local data base of download conditional search of user's setting; One automatic download module, can meet this download condition by a network download according to the download condition that the user sets and the data in this local data base of not being stored in to this local data base; One automatic recording module is used for writing down and meets this download condition and do not download or download successful tabulation of date as yet.
The present invention discloses a kind of data automatic downloading method, and the download condition that this method can be set according to the user is automatically from the network download related data, and checks local data base before download earlier, to avoid the repeated downloads of data.This data automatic downloading method comprises following key step: the download condition of setting according to user header list to the logout file of downloading data automatically; Check header list and this local data base of this logout file; Download the content that is not stored in this logout file in the local data base to this local data base.
Behind the header list of checking this logout file and this local data base, the automatic download system of this data can be deleted the title that has been stored in the local data base from the header list of incident log file.Comprise following concrete steps by the content that is not stored in the local data base in this logout file of network download: from the header list of incident log file, read a title; The particular content of downloading this title is to this local data base; The particular content of this title is downloaded successfully back this title of deletion in the logout file; Repeat above three steps, all titles are read out in the header list of this logout file.
By the automatic download system of this data, the user can pass through all data that need of the disposable download of network, and can not carry out repeated downloads to the data that is stored in the local data base, thereby has saved the time that data is downloaded, and has reduced taking of Internet resources.To downloading unsuccessful data, the automatic repeated downloads of this system's meeting reaches the number of times that the user sets until all data download successes or download time.
[description of drawings]
Fig. 1 is the running environment synoptic diagram of the automatic download system of data of the present invention.
Fig. 2 is the system architecture diagram of the automatic download system of data of the present invention.
Fig. 3 is the system architecture diagram of another embodiment of the automatic download system of data of the present invention.
Fig. 4 is the overall flow figure of the automatic download system of data of the present invention.
Fig. 5 downloads the detail flowchart of the search home server of flow process automatically for data.
Fig. 6 is that data of the present invention is downloaded detail flowchart.
Fig. 7 is existing data downloading system synoptic diagram.
[embodiment]
Consult Fig. 1, be the running environment synoptic diagram of the automatic download system of data of the present invention.In preferred embodiment of the present invention, the automatic download system of this data is installed in the master-slave architecture (Server/Client).As shown in the figure, this master-slave architecture comprises a home server 2 and a plurality of client computer 1, and these a plurality of client computer are connected with this home server 2 by an Intranet 6.This home server 2 can be visited a far-end server 3 by an external network 8, and by the data of these external network 8 downloaded stored in this far-end server.This external network 8 can be a world-wide web or other is based on transmission control protocol/IP Internet Protocol (Transport Control Protocol/Internet Protocol, TCP/IP) network, can be used to carry out super literal host-host protocol (Hypertext Transfer Protocol, HTTP) and File Transfer Protocol (File Transfer Protocol, FTP).
Consult Fig. 2, be the system architecture diagram of the automatic download system of data of the present invention.This client computer 1 comprises a master controller 10, is used for carrying out the automatic download system of data of the present invention.This master controller 10 comprises an automatic search module 11, one automatic download module 12, one automatic recording module 13.Client computer 1 is connected with home server 2 by internal network 6.This home server 2 comprises a local data base 20, is used for storing the data of being downloaded.This home server 2 can be by external network 8 visits one far-end server 3, and this far-end server 3 can be any one can be by the server of these external network 8 visits, and having in it can be for the data of downloading.By home server 2, also addressable this far-end server 3 of client computer 1.When this client computer 1 when far-end server 3 is downloaded data, the automatic search module 11 of this master controller 10 is searched for the local data base 20 of home server 2 at first automatically, confirms whether this data that need download has been stored in this local data base 20.If this local data base does not comprise the data that all need be downloaded, then this automatic download module 12 can be downloaded the data of not storing in the local data base 20 according to the download condition that the user sets.In to home server 2 search and data downloading process, this automatic recording module 13 can be carried out record to the data of not downloading, and this automatic download module 12 carries out repeated downloads according to the record situation to the data of not success download.
Consult Fig. 3, be the system architecture diagram of another embodiment of the automatic download system of data of the present invention.In another embodiment of the present invention, this local data base 20 also can directly be installed in this client computer 1, and client computer 1 can be directly by these external network 8 these far-end servers 3 of visit.As mentioned above, the automatic search module 11 of this master controller 10 is searched for local data base 20 at first automatically, confirms whether this data that need download has been stored in this local data base 20.If this local data base does not comprise the data that all need be downloaded, then this automatic download module 12 can be downloaded the data of not storing in the local data base 20 according to the download condition that the user sets.In to local data base 20 search and data downloading process, this automatic recording module 13 can be carried out record to the data of not downloading, and this automatic download module 12 carries out repeated downloads according to the record situation to data.
Consult shown in Figure 4ly, be the overall flow figure of the automatic download system of data of the present invention.At first, the user sets download conditions (step 300) by automatic download module 12, and the download condition comprises contents such as the data address, data crux word, time span of required download.Then, automatic search module 11 confirms wherein whether there has been the data (step 302) that needs download according to the local data base 20 of downloading conditional search home server 2.If do not comprise the data that all need download in the local data base 20, this automatic download module 12 is visited the data address that needs download by home server 2, and the content that does not have in the local data base 20 is downloaded in this local data base 20 (step 304) automatically.In the data downloading process, whether full content is downloaded successfully in automatic recording module 12 meeting self-verifyings, and successful data (step 306) downloaded in record automatically.If full content is downloaded successfully the then whole end that downloads.If still there is data successfully not download, this automatic download system can check whether download time has surpassed predetermined number of times (step 308).If download time has surpassed predetermined number of times, this end that downloads.If download time does not surpass predetermined number of times as yet, then 12 pairs of not successful downloaded contents of this automatic download module are downloaded (step 310) again.After this download can repeating step 306-310, all download the number of times that success or download time surpass appointment until all the elements.
Consult shown in Figure 5ly, be the detail flowchart of search home server in the automatic download system operational scheme of data of the present invention.After the user sets the download condition (step 300), this home server 2 is according to downloading the far-end server 3 that conditional access has downloaded data, and at first download the content title tabulation (step 400) that meets the download condition from far-end server, as or other reason obstructed owing to network, make downloaded title tabulation unsuccessful (step 402), then download and finish automatically.As successful downloaded title tabulation, then this header list is deposited in a logout file (step 404).After the header list download finishes, the automatic download system of this data can be searched for the local data base 20 (step 406) of home server 2 automatically according to the content of this header list, if there be the title content identical with this header list in the local data base 20, this identical title can be deleted (step 408) from this logout file.Through above step, this logout file only keeps the content title that does not exist in the local data base 20.
Consult shown in Figure 6ly, be that data of the present invention downloads detail flowchart.This automatic download system is at first checked the header list (step 500) of logout file, confirms whether there is the title (step 502) that needs download in this logout file, is empty as this logout file, then downloads and finishes automatically.As this logout file non-NULL, whether this automatic download system self-verifying has surpassed predetermined number of times (step 504) to the download content number of times in this logout file, has surpassed predetermined number of times as downloading number of times, and then this downloads and finishes automatically.As download number of times as yet above predetermined number of times, this automatic download system is read a title (step 506) from the header list of incident log file.By external network 8, this home server 2 is downloaded the particular content (step 508) of this title from the far-end server 3 of appointment.After 2 pairs of these far-end servers 3 of home server send downloading request, can confirm automatically whether the content of this title is successfully downloaded (step 510), successfully downloaded as this content, then this title is deleted (step 512) automatically in the logout file, in the back (no matter success or not) that downloads of finishing to a title, this automatic download system can check that this title whether is the last item title in the header list of logout file, if this title is not the last item title in the header list, then this downloads and gets back to step 506 automatically, from the incident log file, read another title, after this repeating step 506-514, the last item title is read out in header list.If the title of reading is the last item title in the header list, then download and to get back to step 500 automatically, reexamine whether the not successful title of download is arranged in the logout file, if being sky or download time, the logout file surpasses predetermined number of times, then whole downloading finished automatically, if logout file non-NULL then downloads and repeats institute automatically in steps.
The automatic download system of data of the present invention, can be automatically from the data of the bigger database download user appointment of some capacity.For example, the automatic download system of data of the present invention can be used to carry out from various countries' patent database the automatic download of Patent data.By the automatic download system of this data, the user only need set the download condition, as the patent No., patent name, patentee, patented claim or bulletin time, key word etc., this system can download qualified patent automatically, downloads the Patent data of finishing and can be stored in local data base.Owing to may retrieve some identical patent with different download conditions, when the user downloads according to its download condition, the automatic download system of this data is the search local data base automatically, can not carry out repeated downloads to the patent that has existed, thereby improves the Patent data downloading efficiency.
Claims (6)
1. a data automatic downloading method can be downloaded data to a local data base from a far-end server by network, it is characterized in that may further comprise the steps:
(a) the download condition of setting according to the user is automatically from this far-end server downloaded data header list to logout file;
(b) check the data of storing in the header list of this logout file and this local data base;
(c) from the header list of incident log file, delete the title that has been stored in the local data base;
(d) download be not stored in the title representative in this local data base in this logout file particular content to this local data base;
(e) not successful downloaded contents in this logout file of repeated downloads.
2. data automatic downloading method as claimed in claim 1 is characterized in that step (d) is further comprising the steps of:
(d1) from the header list of incident log file, read a title;
(d2) download the particular content of this title to this local data base;
(d3) in the logout file, delete this title after the particular content of this title is downloaded and finished.
3. data automatic downloading method as claimed in claim 1 is characterized in that the data of downloading is the Patent data that is stored in various countries' patent database.
4. a data automatic downloading method is checked a local data base earlier before can downloading data from a far-end server by network, it is characterized in that may further comprise the steps:
(a) the download condition of setting according to user header list to the logout file of downloading data automatically;
(b) check the data of storing in the header list of this logout file and this local data base;
(c) from the header list of incident log file, delete the title that has been stored in the local data base;
(d) from the header list of incident log file, read a title;
(e) download particular content under this title to this local data base;
(f) in the logout file, delete this title after the particular content of this title is downloaded and finished;
(g) repeating step (d)-(f), all titles are read in this header list;
(h) do not finish the title content of download in this logout file of repeated downloads.
5. the system that data is downloaded automatically can download data to a local data base from a far-end server by network, it is characterized in that comprising:
Whether one automatic search module can be stored in this local data base with the data of confirming required download according to this local data base of download conditional search of setting;
One automatic download module can meet aforementioned download condition and not be present in data in this local data base to this local data base by a network download;
One automatic recording module is used for writing down and meets this download condition and download and download successful data as yet.
6. the automatic download system of data as claimed in claim 5 is characterized in that this automatic search module and automatic download module can visit this local data base by an Intranet.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 02115085 CN1249610C (en) | 2002-04-13 | 2002-04-13 | Automatic document down-load system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 02115085 CN1249610C (en) | 2002-04-13 | 2002-04-13 | Automatic document down-load system and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN1452095A CN1452095A (en) | 2003-10-29 |
| CN1249610C true CN1249610C (en) | 2006-04-05 |
Family
ID=29220942
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 02115085 Expired - Fee Related CN1249610C (en) | 2002-04-13 | 2002-04-13 | Automatic document down-load system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN1249610C (en) |
Families Citing this family (22)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4423550B2 (en) * | 2004-05-19 | 2010-03-03 | ソニー株式会社 | Information processing apparatus, content title display method, and content title display program |
| CN100425019C (en) * | 2004-11-26 | 2008-10-08 | 英业达股份有限公司 | Entertainment apparatus and method for downoloading multi-media data from target website |
| US7930367B2 (en) | 2006-01-04 | 2011-04-19 | Sony Ericsson Mobile Communications Ab | Low storage portable media player |
| CN101315629B (en) * | 2007-06-01 | 2010-11-17 | 潘晓梅 | Downloading method and system for web page dynamic contents |
| CN101364979B (en) * | 2007-08-10 | 2011-12-21 | 鸿富锦精密工业（深圳）有限公司 | Downloaded material parsing and processing system and method |
| CN101488138B (en) * | 2008-01-18 | 2011-06-22 | 鹏智科技(深圳)有限公司 | Network file downloading server and method |
| KR20100127162A (en) * | 2009-05-25 | 2010-12-03 | 엘지전자 주식회사 | Method and apparatus for searching and downloading related contents in broadcast service at terminal |
| CN102238204A (en) * | 2010-04-23 | 2011-11-09 | 腾讯科技（深圳）有限公司 | Network data acquisition method and system |
| CN101840432B (en) * | 2010-05-11 | 2012-07-25 | 同方知网(北京)技术有限公司 | Data mining device based on Deep Web deep dynamic data and method thereof |
| CN102006363A (en) * | 2010-11-15 | 2011-04-06 | 东莞宇龙通信科技有限公司 | Method and system of resource management in mobile terminal and mobile terminal |
| CN102571921B (en) * | 2011-12-09 | 2015-07-08 | 广东威创视讯科技股份有限公司 | Network access method and device for mobile equipment |
| CN103176991A (en) * | 2011-12-21 | 2013-06-26 | 苏州威世博知识产权服务有限公司 | Method and system for downloading patent |
| CN103916422A (en) * | 2012-12-31 | 2014-07-09 | 上海证大喜马拉雅网络科技有限公司 | Wireless network based automatic synchronous audio downloading system and method |
| CN103412900A (en) * | 2013-07-29 | 2013-11-27 | 宇龙计算机通信科技(深圳)有限公司 | File downloading treatment method and terminal |
| CN105227598B (en) * | 2014-06-11 | 2020-11-27 | 腾讯科技（深圳）有限公司 | Resource sharing method, device and system based on cloud storage |
| CN106657195B (en) * | 2015-11-02 | 2019-12-24 | 北大方正集团有限公司 | Task processing method and relay device |
| CN106911758A (en) * | 2015-12-23 | 2017-06-30 | 北京奇虎科技有限公司 | File acquisition system |
| CN106982254B (en) * | 2017-03-30 | 2019-09-10 | 中国联合网络通信集团有限公司 | The method and apparatus of file download |
| CN107623747A (en) * | 2017-10-27 | 2018-01-23 | 中国银行股份有限公司 | A kind of data transmission method, equipment and system |
| CN108495147A (en) * | 2018-03-09 | 2018-09-04 | 网宿科技股份有限公司 | A kind of method and system that video resource is provided |
| CN112925840A (en) * | 2021-03-09 | 2021-06-08 | 上海华客信息科技有限公司 | Data export method, system, device and storage medium |
| CN114666319B (en) * | 2022-03-02 | 2024-03-22 | 北京百度网讯科技有限公司 | Data downloading method, device, electronic equipment and readable storage medium |
-
2002
- 2002-04-13 CN CN 02115085 patent/CN1249610C/en not_active Expired - Fee Related
Also Published As
| Publication number | Publication date |
|---|---|
| CN1452095A (en) | 2003-10-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN1249610C (en) | Automatic document down-load system and method | |
| CN1253813C (en) | Contents-index search system and its method | |
| US7185088B1 (en) | Systems and methods for removing duplicate search engine results | |
| US6061686A (en) | Updating a copy of a remote document stored in a local computer system | |
| US5991760A (en) | Method and apparatus for modifying copies of remotely stored documents using a web browser | |
| US6658476B1 (en) | Client-server protocol support list for standard request-response protocols | |
| US7308643B1 (en) | Anchor tag indexing in a web crawler system | |
| US6105028A (en) | Method and apparatus for accessing copies of documents using a web browser request interceptor | |
| US6601061B1 (en) | Scalable information search and retrieval including use of special purpose searching resources | |
| US7542965B2 (en) | Method, apparatus, and computer-readable medium for searching and navigating a document database | |
| US7523173B2 (en) | System and method for web page acquisition | |
| JP4437918B2 (en) | Apparatus and method for selectively retrieving information and subsequently displaying the information | |
| TW573257B (en) | Automatic data download system and method | |
| US20160360003A1 (en) | Processing incoming messages | |
| US6658402B1 (en) | Web client controlled system, method, and program to get a proximate page when a bookmarked page disappears | |
| US8266134B1 (en) | Distributed crawling of hyperlinked documents | |
| JP2006107446A (en) | Batch indexing system and method for network document | |
| CN102577237B (en) | Method for scheduling web hosting service, method for processing application access, apparatus and system thereof | |
| US6473756B1 (en) | Method for selecting among equivalent files on a global computer network | |
| WO2001033384A1 (en) | System and method for efficient representation of data set addresses in a web crawler | |
| US6883020B1 (en) | Apparatus and method for filtering downloaded network sites | |
| CN1701587A (en) | Method and apparatus for local ip address translation | |
| CN101046806A (en) | Search engine system and method | |
| CN1622083A (en) | Patent download system and method | |
| US7100106B1 (en) | Mirroring operations performed on linked files and folders |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20060405 Termination date: 20150413 |
|
| EXPY | Termination of patent right or utility model |