CN107181830B - A kind of method and device obtaining targeted website data information - Google Patents

A kind of method and device obtaining targeted website data information Download PDF

Info

Publication number
CN107181830B
CN107181830B CN201710210057.8A CN201710210057A CN107181830B CN 107181830 B CN107181830 B CN 107181830B CN 201710210057 A CN201710210057 A CN 201710210057A CN 107181830 B CN107181830 B CN 107181830B
Authority
CN
China
Prior art keywords
address
period
target
targeted website
section
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201710210057.8A
Other languages
Chinese (zh)
Other versions
CN107181830A (en
Inventor
帅伟良
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing QIYI Century Science and Technology Co Ltd
Original Assignee
Beijing QIYI Century Science and Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing QIYI Century Science and Technology Co Ltd filed Critical Beijing QIYI Century Science and Technology Co Ltd
Priority to CN201710210057.8A priority Critical patent/CN107181830B/en
Publication of CN107181830A publication Critical patent/CN107181830A/en
Application granted granted Critical
Publication of CN107181830B publication Critical patent/CN107181830B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L61/00Network arrangements, protocols or services for addressing or naming
    • H04L61/09Mapping addresses
    • H04L61/25Mapping addresses of the same type
    • H04L61/2503Translation of Internet protocol [IP] addresses
    • H04L61/255Maintenance or indexing of mapping tables
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing data switching networks
    • H04L43/04Processing captured monitoring data, e.g. for logfile generation

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Data Mining & Analysis (AREA)
  • Information Transfer Between Computers (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)

Abstract

The embodiment of the invention provides a kind of method and device for obtaining targeted website data information, this method is applied to server, comprising: obtains the target ip address of current time access target website;According to the corresponding relationship of each period, IP address section and each station address that pre-save, judge whether IP address section where the target ip address corresponds to the address of place period at current time and the targeted website;If not, according to the corresponding relationship of the period, IP address section and each station address that pre-save, target ip address section corresponding to period where obtaining the targeted website and current time, and select any IP address to access the targeted website in the target ip address section, obtain the data information of the targeted website.In the present solution, can be shielded to avoid the IP address of access target website.

Description

A kind of method and device obtaining targeted website data information
Technical field
The present invention relates to Internet technical fields, more particularly to a kind of method and dress for obtaining targeted website data information It sets.
Background technique
With the rapid development of network technology, network operator can automatically grab other networks fortune by web crawlers The data information of quotient website is sought, and by corresponding these data informations of index technology tissue, is supplied to search user and looks into It askes.Wherein, web crawlers is a kind of technology of batch acquisition targeted website data information.Data information may include: picture, sound Frequently, video etc..Targeted website can crawl the website of data information for network operator.
Currently, the method that targeted website data information is obtained using web crawlers mode, mainly are as follows: use Target IP (Internet Protocol, Internet protocol) address accesses targeted website, and obtains the data information of targeted website.When adopting When obtaining the data information of targeted website in aforementioned manners, target website server can count the target for accessing the targeted website IP address determines the target ip address when being greater than predetermined period there are the time cycle of target ip address access target website Corresponding user is used web crawlers and obtains targeted website data information, and shields to the target ip address.Cause This, the target ip address that the existing method for obtaining targeted website data information may cause access target website is shielded.
Summary of the invention
The embodiment of the present invention is designed to provide a kind of method and device for obtaining targeted website data information, to solve The shielded technical problem of target ip address in the prior art.Specific technical solution is as follows:
On the one hand, the embodiment of the invention discloses a kind of method for obtaining targeted website data information, it is applied to server, The described method includes:
Obtain the target ip address of current time access target website;
According to the corresponding relationship of each period, IP address section and each station address that pre-save, the Target IP is judged The address of period and the targeted website where whether IP address section where address corresponds to current time;
If it is not, obtaining the target according to the corresponding relationship of the period, IP address section and each station address that pre-save Target ip address section corresponding to period where website and current time, and select in the target ip address section any IP address accesses the targeted website, obtains the data information of the targeted website.
Optionally, the corresponding relationship of the basis pre-saves each period, IP address section and each station address, judgement The step of the address of period and the targeted website where whether IP address section where the target ip address corresponds to current time Suddenly include:
In the corresponding relationship, the time where IP address section, the current time where searching the target ip address Section;
Judge target ip address place IP address section, period where the current time and the targeted website Whether address corresponds to.
Optionally, it selects any IP address to access the targeted website in the target ip address section, obtains the mesh After the data information for marking website, the method also includes:
It detects whether to have triggered and the targeted website is accessed by any IP address, obtain the number of the targeted website It is believed that breath;
If it is not, triggering accesses the targeted website by any IP address, the data letter of the targeted website is obtained Breath, and record the trigger action.
Optionally, the method also includes:
Store the corresponding relationship of each period, IP address section and each station address.
Optionally, the step of corresponding relationship of the storage each period, IP address section and each station address includes:
Obtain IP address section corresponding to each period and each station address;
It is corresponding to store IP address section and each station address corresponding to each period.
Optionally, the method also includes:
When detecting that user changes the corresponding relationship of the period, IP address section and each station address, storage change The corresponding relationship of rear period, IP address section and each station address.
On the other hand, the embodiment of the invention also discloses a kind of device for obtaining targeted website data information, it is applied to clothes Business device, described device include:
Acquiring unit, for obtaining the target ip address of current time access target website;
Judging unit is sentenced for the corresponding relationship according to each period, IP address section and each station address pre-saved The address of period and the targeted website where whether IP address section where the target ip address of breaking corresponds to current time;
Selecting unit, for when the judging unit judging result is no, according to pre-save each period, IP The corresponding relationship of location section and each station address obtains target corresponding to the targeted website and place period at current time IP address section, and select any IP address to access the targeted website in the target ip address section, obtain the target network The data information stood.
Optionally, the judging unit includes:
Search subelement, in the corresponding relationship, IP address section where searching the Target IP, it is described current when Period where carving;
Judgment sub-unit, for the period where IP address section, the current time where judging the target ip address And whether the address of the targeted website corresponds to.
Optionally, described device further include:
Detection unit accesses the targeted website by any IP address for detecting whether having triggered, obtains institute State the data information of targeted website;
Trigger unit, for when the detection unit testing result is no, triggering to be accessed by any IP address The targeted website, obtains the data information of the targeted website, and records the trigger action.
Optionally, described device further include:
Storage unit, for storing the corresponding relationship of each period, IP address section and each station address.
Optionally, the storage unit includes:
Subelement is obtained, for obtaining IP address section corresponding to each period and each station address;
Storing sub-units store IP address section and each station address corresponding to each period for corresponding.
Optionally, described device further include:
Updating unit detects that user changes the corresponding of the period, IP address section and each station address and closes for working as When being, the corresponding relationship of period, IP address section and each station address after storage change.
A kind of method and device obtaining targeted website data information provided in an embodiment of the present invention, server are available The target ip address of current time access target website, according to each period, IP address section and each station address pre-saved Corresponding relationship, judge period where whether IP address section where the target ip address corresponds to current time and targeted website Address, when the judgment result is No, target ip address section and current time institute corresponding to the period where obtaining current time The address of targeted website corresponding to the period, and in destination address section select any IP address come access targeted website, Obtain the data information of the targeted website.
In the present solution, server can be right using period institute where current time for the period where current time Any IP address in IP address section answered selects different to obtain the data information of targeted website for the different periods IP address access targeted website, and obtain the data information of targeted website.In this way, an IP address will not the long period One targeted website of access, so as to avoid the IP address of access target website from being shielded, improve obtain targeted website number It is believed that the efficiency of breath.Certainly, implement any of the products of the present invention or method it is not absolutely required at the same reach above-described institute There is advantage.
Detailed description of the invention
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this Some embodiments of invention for those of ordinary skill in the art without creative efforts, can be with It obtains other drawings based on these drawings.
Fig. 1 is a kind of flow chart of the method provided in an embodiment of the present invention for obtaining targeted website data information;
Fig. 2 is another flow chart of the method provided in an embodiment of the present invention for obtaining targeted website data information;
Fig. 3 is another flow chart of the method provided in an embodiment of the present invention for obtaining targeted website data information;
Fig. 4 is a kind of structural schematic diagram of the device provided in an embodiment of the present invention for obtaining targeted website data information;
Fig. 5 is another structural schematic diagram of the device provided in an embodiment of the present invention for obtaining targeted website data information.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete Site preparation description, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.It is based on Embodiment in the present invention, it is obtained by those of ordinary skill in the art without making creative efforts every other Embodiment shall fall within the protection scope of the present invention.
It should be noted that in the absence of conflict, the feature in embodiment and embodiment in the present invention can phase Mutually combination.The present invention will be described in detail below with reference to the accompanying drawings and embodiments.
A kind of method for being provided for the embodiments of the invention acquisition targeted website data information first below is introduced.
It should be noted that the executing subject of the method for the acquisition targeted website data information in the embodiment of the present invention can be with For the application program in server or the server, this is all reasonable.
In order to solve the shielded technical problem of target ip address in the prior art, the embodiment of the invention provides one kind to obtain The method for taking targeted website data information is applied to server, as shown in Figure 1, this method may comprise steps of:
S101 obtains the target ip address of current time access target website.
In practical applications, the data information of the available each website of server.In the embodiment of the present invention, obtained with server For the data information for taking a website (targeted website), illustrate acquisition targeted website provided in an embodiment of the present invention data information Method.
In embodiments of the present invention, server can be periodically detected its targeted website accessed, and obtain The target ip address of access target website.That is, server can determine mesh used in its present access destination website Mark IP address.Wherein, server obtains the process of the target ip address of current time access target website, can use existing Any method, the embodiment of the present invention is to this process without repeating.
In embodiments of the present invention, server can detecte the targeted website that current time accessed, and when obtaining current Carve the target ip address just in access target website.For example, server detects its current time, (e.g., current time can be 16 When 15 divide 30 seconds) just at access target website (e.g., http://www.youku.com/), and obtain and accessing the target The target ip address (e.g., 10.221.82.130) of website.
S102 judges the mesh according to the corresponding relationship of each period, IP address section and each station address that pre-save The address of period and the targeted website where whether IP address section where mark IP address corresponds to current time;If not, holding Row step S103.
In the embodiment of the present invention, the corresponding relationship of each period, IP address section and each station address can be stored in advance In the server.As shown in table 1, table 1 shows the exemplary corresponding relationship of each period, IP address section and each station address.
Each station address IP address section Period Annotation
http://www.youku.com/ 10.221.* 00:00:00-08:59:59 Shanghai computer room
http://www.youku.com/ 10.10.* 09:00:00-16:59:59 Beijing computer room
http://www.youku.com/ 10.188.* 17:00:00-23:59:59 Chongqing computer room
Wherein, " 10.221.* " indicates IP address section where all IP address started with 10.221. in table 1. " 10.10.* " indicates IP address section where all IP address started with 10.10.." 10.188.* " expression is started with 10.188. All IP address where IP address section.
Shanghai computer room can be with IP address section, period (00:00:00- where all IP address for being started with 10.221. 08:59:59) and http://www.youku.com/ is corresponding;Beijing computer room can be with all IP address institutes for being started with 10.10. It is corresponding in IP address section, period (09:00:00-16:59:59) and http://www.youku.com/;Chongqing computer room can be with With all IP address place IP address section, period (17:00:00-23:59:59) and the http started with 10.188.: // Www.youku.com/ is corresponding.
After server obtains the target ip address of current time access target website, the Target IP may further determine that Period and targeted website where IP address section, current time where address, and judge IP address where the target ip address The corresponding relationship of section, period where current time and targeted website whether with pre-stored each period, IP address section and Each station address corresponding relationship is consistent.
Specifically, server after the target ip address for obtaining current time access target website, can be protected according to preparatory The corresponding relationship of each period, IP address section and each station address deposited searches the target ip address in stored corresponding pass Which of which IP address section and current time in system in stored corresponding relationship period.Also, judge Target IP Whether the address of period and targeted website where IP address section, current time where address corresponds to.
For example, the target ip address of current time access target website (http://www.youku.com/) is 10.221.30.130 current time 07:59:59.According to table 1, server can determine IP where the target ip address Address field is 10.221.*, and the period where current time is 00:00:00-08:59:59, and determines target ip address place Period where IP address section, current time and target website address (http://www.youku.com/) are corresponding.
In another example the target ip address of current time access target website http://www.youku.com/ is 10.221.30.130 current time 10:59:59.According to table 1, server can determine IP where the target ip address Address field is 10.221.*, and the period where current time is 09:00:00-16:59:59, and determines target ip address place Period and target website address (http://www.youku.com/) do not correspond to where IP address section, current time.
S103, according to the corresponding relationship of each period, IP address section and each station address that pre-save, when obtaining current The ground of targeted website corresponding to period where target ip address section corresponding to period where carving and current time Location, and select any IP address to access the targeted website in the target ip address section, obtain the number of the targeted website It is believed that breath.
The corresponding relationship of the address of period and targeted website where IP address section, current time where target ip address When inconsistent with stored corresponding relationship, server can be in stored each period, IP address section and each station address Corresponding relationship in, obtain target ip address section corresponding to targeted website and period where current time.Further, In the IP address section where acquired target ip address, an optional IP address is determined as current time access target website Target ip address.
For example, IP address section where target ip address is 10.221.*, the period where current time is (09:00:00- 16:59:59), target website address is http://www.youku.com/, it is seen then that IP address section where target ip address, when Period (09:00:00-16:59:59), IP in the corresponding relationship and table 1 of the address of period and targeted website where the preceding moment The corresponding relationship of address field (10.10.*) and station address (http://www.youku.com/) is inconsistent.Then server can be with Period where obtaining targeted website (http://www.youku.com/) and current time in table 1 (09:00:00-16: Target ip address section (10.10.*) corresponding to 59:59), and any IP address is selected in target ip address section (10.10.*) (for example, selected any IP address can be 10.10.30.140) access target website (http: // Www.youku.com/), and the data information of targeted website (http://www.youku.com/) is obtained.
In the embodiment of the present invention, server can use the time where current time for the period where current time Any IP address in IP address section corresponding to section selects to obtain the data information of targeted website for the different periods Different IP address is selected to access targeted website, and obtains the data information of targeted website.In this way, IP address will not be compared with It improves so as to avoid the IP address of access target website from being shielded and obtains target in one targeted website of access for a long time The efficiency of website data information.
Further, as shown in Fig. 2, after step s 103, the method can also include:
S104 detects whether to have triggered accessing the targeted website by any IP address, obtains the target network The data information stood, if it is not, executing step S105.
Server selects any IP address in target ip address section come after accessing targeted website, can also be in default week Detect whether to have used any IP address access target website in target ip address section in phase, to obtain the number of targeted website It is believed that breath.
For example, server selects any IP address (10.10.80.130) access target website in destination address section After (http://www.youku.com/), in predetermined period 1 second, it can detecte and whether passed through any IP address (10.10.80.130) access target website (http://www.youku.com/).
S105, triggering access the targeted website by any IP address, obtain the data letter of the targeted website Breath, and record the trigger action.
It, can if server detects that any IP address starts access target website not yet in the embodiment of the present invention Start access target website to trigger any IP address, and obtain the data information of targeted website by the IP address, together When, record the operation of triggered any IP address access target website.
In the embodiment of the present invention, after server selects any IP address access target website in target ip address section, It further detects whether selected IP address has begun access target website, if server detects access target website IP address be not its selection IP address, then trigger selected IP address further to access targeted website.Meanwhile it recording Trigger action does not detect whether selected IP address has begun visit so that server is recorded according to the trigger action again Ask targeted website.As it can be seen that the embodiment of the present invention, it can be ensured that server is used in the period where current time selected by it IP address access targeted website.
Optionally, the server of the embodiment of the present invention be with can also being stored in advance each period, IP address section and each website The corresponding relationship of location.
In the embodiment of the present invention, user can divide the period in advance, and each time corresponds to respective IP address section and website Address.For example, one day 24 hour can be divided into 3 periods or 4 periods, 6 periods etc..It needs to infuse Meaning, it can be to differ that each period after division, which can be each period after isometric period, or division, The long period.It is as shown in table 1 the exemplary of each period provided in an embodiment of the present invention, IP address section and each station address Corresponding relationship.
Specifically, the corresponding relationship process that server stores each period, IP address section and each station address can be with are as follows: clothes Business device obtains IP address section corresponding to each period and each station address, and corresponds to storing IP corresponding to each period Location section and each station address.
Server, can be for each period with distributing corresponding IP address section and each website after obtaining each period Location.Here, each period can correspond to different IP address sections, can correspond to different station addresses.When server will be each Between section, corresponding IP address section of each period and the corresponding storage of corresponding station address of each time to pre-set storage sky Between.
In the embodiment of the present invention, user can be by relevant operation to pair of period, IP address section and each station address It should be related to and be modified.When server detects that user changes the corresponding relationship of each period, IP address section and each station address When, the corresponding relationship of stored each period, IP address section and each station address is updated to each time after user's change The corresponding relationship of section, IP address section and each station address, and store-updated each period, IP address section and each website The corresponding relationship of location.
For example, as shown in figure 3, the structural schematic diagram of server provided in an embodiment of the present invention, wherein server 300 may include: configuration files database 310, timesharing crawl trigger 320, agency of trademark registration server 330, change trigger 340, proxy updating service device 350 and access server 360.
It is closed specifically, storing the corresponding of each period, IP address section and each station address in configuration files database 310 System.For example, can store each period, IP address section and each station address as shown in Table 1 in configuration files database 310 Corresponding relationship.
Timesharing grabs the target ip address of 320 available current time access target website of trigger, is protected according to preparatory There are the corresponding relationships of each period, IP address section and each station address in configuration files database 310, judge target ip address The address of period and the targeted website where whether place IP address section corresponds to current time, if it is not, according to pre-saving Period, IP address section and each station address corresponding relationship, Target IP corresponding to the period where obtaining current time The address of targeted website corresponding to period where address field and current time.
Agency of trademark registration server 330 selects any IP address in target ip address section.Later, change trigger 340 will The target ip address of access target website is changed to any IP address in destination address section.Meanwhile proxy updating service device 350 The target ip address of access target website is updated to any IP address in destination address section, and notifies access server 360, so as to access server according to updated any IP address access target website, and obtain the data letter of targeted website Breath.
Relative to above method embodiment, the embodiment of the invention also provides a kind of dresses for obtaining targeted website data information 400 are set, is applied to server, as shown in figure 4, described device 400 includes:
Acquiring unit 410, for obtaining the target ip address of current time access target website;
Judging unit 420, for being closed according to the corresponding of each period, IP address section and each station address pre-saved System, judges whether IP address section where the target ip address corresponds to the ground of place period at current time and the targeted website Location;
Selecting unit 430, for when the judging unit judging result be it is no when, according to each period pre-saved, The corresponding relationship of IP address section and each station address obtains corresponding to the targeted website and place period at current time Target ip address section, and select any IP address to access the targeted website in the target ip address section, obtain the mesh Mark the data information of website.
In the embodiment of the present invention, server can use the time where current time for the period where current time Any IP address in IP address section corresponding to section selects to obtain the data information of targeted website for the different periods Different IP address is selected to access targeted website, and obtains the data information of targeted website.In this way, IP address will not be compared with It improves so as to avoid the IP address of access target website from being shielded and obtains target in one targeted website of access for a long time The efficiency of website data information.
Optionally, the judging unit 420 includes:
Subelement (not shown) is searched, for IP address where in the corresponding relationship, searching the Target IP Period where section, the current time;
Judgment sub-unit (not shown), for IP address section where judging the target ip address, it is described current when Whether the address of period and the targeted website where carving corresponds to.
Optionally, as shown in figure 5, described device 400 further include:
Detection unit 440 accesses the targeted website by any IP address for detecting whether having triggered, obtains The data information of the targeted website;
Trigger unit 450, for when the detection unit testing result is no, triggering to be visited by any IP address It asks the targeted website, obtains the data information of the targeted website, and record the trigger action.
Optionally, described device further include:
Storage unit (not shown), for storing the corresponding relationship of each period, IP address section and each station address.
Optionally, the storage unit includes:
Subelement (not shown) is obtained, for obtaining IP address section corresponding to each period and each station address;
Storing sub-units (not shown), for IP address section corresponding to corresponding storage each period and each website Location.
Optionally, described device further include:
Updating unit (not shown) detects that user changes the period, IP address section and each website for working as When the corresponding relationship of address, the corresponding relationship of period, IP address section and each station address after storage change.
For device embodiment, since it is substantially similar to the method embodiment, related so being described relatively simple Place illustrates referring to the part of embodiment of the method.
It should be noted that, in this document, relational terms such as first and second and the like are used merely to a reality Body or operation are distinguished with another entity or operation, are deposited without necessarily requiring or implying between these entities or operation In any actual relationship or order or sequence.Moreover, the terms "include", "comprise" or its any other variant are intended to Non-exclusive inclusion, so that the process, method, article or equipment including a series of elements is not only wanted including those Element, but also including other elements that are not explicitly listed, or further include for this process, method, article or equipment Intrinsic element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that There is also other identical elements in process, method, article or equipment including the element.
Each embodiment in this specification is all made of relevant mode and describes, same and similar portion between each embodiment Dividing may refer to each other, and each embodiment focuses on the differences from other embodiments.Especially for system reality For applying example, since it is substantially similar to the method embodiment, so being described relatively simple, related place is referring to embodiment of the method Part explanation.
The foregoing is merely illustrative of the preferred embodiments of the present invention, is not intended to limit the scope of the present invention.It is all Any modification, equivalent replacement, improvement and so within the spirit and principles in the present invention, are all contained in protection scope of the present invention It is interior.

Claims (12)

1. a kind of method for obtaining targeted website data information, which is characterized in that be applied to server, which comprises
Obtain the target ip address of current time access target website;
According to the corresponding relationship of each period, IP address section and each station address that pre-save, the target ip address is judged The address of period and the targeted website where whether place IP address section corresponds to current time;
If it is not, obtaining the targeted website according to the corresponding relationship of the period, IP address section and each station address that pre-save And target ip address section corresponding to the period where current time, and in the target ip address section with selecting any IP Location accesses the targeted website, obtains the data information of the targeted website.
2. the method according to claim 1, wherein the basis pre-save each period, IP address section And the corresponding relationship of each station address, judge whether IP address section where the target ip address corresponds to the time where current time Section and the targeted website address the step of include:
In the corresponding relationship, the period where IP address section, the current time where searching the target ip address;
The address of period and the targeted website where IP address section, the current time where judging the target ip address Whether correspond to.
3. the method according to claim 1, wherein selecting any IP address to visit in the target ip address section Ask the targeted website, after the data information for obtaining the targeted website, the method also includes:
It detects whether to have triggered and the targeted website is accessed by any IP address, obtain the data letter of the targeted website Breath;
If it is not, triggering accesses the targeted website by any IP address, the data information of the targeted website is obtained, and Record the trigger action.
4. the method according to claim 1, wherein the method also includes:
Store the corresponding relationship of each period, IP address section and each station address.
5. according to the method described in claim 4, it is characterized in that, the storage each period, IP address section and each website The step of corresponding relationship of location includes:
Obtain IP address section corresponding to each period and each station address;
It is corresponding to store IP address section and each station address corresponding to each period.
6. according to the method described in claim 4, it is characterized in that, the method also includes:
When detecting that user changes the corresponding relationship of the period, IP address section and each station address, after storage change The corresponding relationship of period, IP address section and each station address.
7. a kind of device for obtaining targeted website data information, which is characterized in that be applied to server, described device includes:
Acquiring unit, for obtaining the target ip address of current time access target website;
Judging unit judges institute for the corresponding relationship according to each period, IP address section and each station address pre-saved The address of period and the targeted website where whether IP address section where stating target ip address corresponds to current time;
Selecting unit, for when the judging unit judging result be it is no when, according to pre-save each period, IP address section And the corresponding relationship of each station address, with obtaining Target IP corresponding to the targeted website and place period at current time Location section, and select any IP address to access the targeted website in the target ip address section, obtain the targeted website Data information.
8. device according to claim 7, which is characterized in that the judging unit includes:
Subelement is searched, for IP address section, current time institute where in the corresponding relationship, searching the Target IP In the period;
Judgment sub-unit, for period and institute where IP address section, the current time where judging the target ip address Whether the address for stating targeted website corresponds to.
9. device according to claim 7, which is characterized in that described device further include:
Detection unit accesses the targeted website by any IP address for detecting whether having triggered, obtains the mesh Mark the data information of website;
Trigger unit, for when the detection unit testing result is no, triggering to pass through described in any IP address access Targeted website, obtains the data information of the targeted website, and records the trigger action.
10. device according to claim 7, which is characterized in that described device further include:
Storage unit, for storing the corresponding relationship of each period, IP address section and each station address.
11. device according to claim 10, which is characterized in that the storage unit includes:
Subelement is obtained, for obtaining IP address section corresponding to each period and each station address;
Storing sub-units store IP address section and each station address corresponding to each period for corresponding.
12. device according to claim 10, which is characterized in that described device further include:
Updating unit, for when detecting that user changes the corresponding relationship of the period, IP address section and each station address, The corresponding relationship of period, IP address section and each station address after storage change.
CN201710210057.8A 2017-03-31 2017-03-31 A kind of method and device obtaining targeted website data information Active CN107181830B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710210057.8A CN107181830B (en) 2017-03-31 2017-03-31 A kind of method and device obtaining targeted website data information

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710210057.8A CN107181830B (en) 2017-03-31 2017-03-31 A kind of method and device obtaining targeted website data information

Publications (2)

Publication Number Publication Date
CN107181830A CN107181830A (en) 2017-09-19
CN107181830B true CN107181830B (en) 2019-07-12

Family

ID=59830543

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710210057.8A Active CN107181830B (en) 2017-03-31 2017-03-31 A kind of method and device obtaining targeted website data information

Country Status (1)

Country Link
CN (1) CN107181830B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114499921A (en) * 2021-11-26 2022-05-13 中国南方电网有限责任公司 Data packet file playback method, data packet file acquisition method and device
US20230222613A1 (en) * 2022-01-10 2023-07-13 Capital One Services, Llc Predicting customer change of address based on web browsing activity and transactions

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1437361A (en) * 2002-02-07 2003-08-20 华为技术有限公司 Network access control method based on network address
CN102025793A (en) * 2010-01-22 2011-04-20 中国移动通信集团北京有限公司 Domain name resolution method and system and DNS in IP network
CN103916493A (en) * 2014-04-15 2014-07-09 大唐移动通信设备有限公司 IP address field distribution method and device
CN104320446A (en) * 2014-10-14 2015-01-28 上海交通大学 Distributed multi-Agent website monitoring method and system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1437361A (en) * 2002-02-07 2003-08-20 华为技术有限公司 Network access control method based on network address
CN102025793A (en) * 2010-01-22 2011-04-20 中国移动通信集团北京有限公司 Domain name resolution method and system and DNS in IP network
CN103916493A (en) * 2014-04-15 2014-07-09 大唐移动通信设备有限公司 IP address field distribution method and device
CN104320446A (en) * 2014-10-14 2015-01-28 上海交通大学 Distributed multi-Agent website monitoring method and system

Also Published As

Publication number Publication date
CN107181830A (en) 2017-09-19

Similar Documents

Publication Publication Date Title
US8572100B2 (en) Method and system for recording search trails across one or more search engines in a communications network
US8548991B1 (en) Personalized browsing activity displays
CN103186666B (en) Method, device and equipment for searching based on favorites
CN104424244B (en) A kind of method, apparatus and equipment obtaining search result
CN107181830B (en) A kind of method and device obtaining targeted website data information
CN109274584A (en) Cut-in method, device, client device and the storage medium of access server
CN106294848A (en) A kind of web analysis, acquisition methods and device
CN110535974A (en) Method for pushing, driving means, equipment and the storage medium of resource to be put
CN101551813A (en) Network connection apparatus, search equipment and method for collecting search engine data source
CN109474698A (en) Access request labeling method, device, equipment and storage medium
CN106301928A (en) A kind of web analysis, acquisition methods and device
CN109086158A (en) A kind of Analysis on Abnormal method, apparatus and server
CN113660359B (en) Domain name resolution record management method and device, storage medium and electronic equipment
CN107798100A (en) A kind of collocation method using recommendation information
CN105635821B (en) A kind of video filtering method and device
CN104021203B (en) It is a kind of for accessing the method and device of webpage
CN106897297B (en) Method and device for determining access path between website columns
CN106469166B (en) A kind of information processing method and device
CN107968812A (en) The method and device of synchronous local resource and Internet resources
CN107871021B (en) Method and device for obtaining identification features of webpage search keywords
CN110399557A (en) A kind of recognition methods of visitor information, identification device and readable storage medium storing program for executing
CN109783728A (en) Page crawler rule update method and system
CN106713588B (en) A kind of method and device that communication address book stored is synchronous
JP4233386B2 (en) Information resource server and information resource providing method
CN111198818B (en) Information acquisition method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant