CN107181830B - A kind of method and device obtaining targeted website data information - Google Patents
A kind of method and device obtaining targeted website data information Download PDFInfo
- Publication number
- CN107181830B CN107181830B CN201710210057.8A CN201710210057A CN107181830B CN 107181830 B CN107181830 B CN 107181830B CN 201710210057 A CN201710210057 A CN 201710210057A CN 107181830 B CN107181830 B CN 107181830B
- Authority
- CN
- China
- Prior art keywords
- address
- period
- target
- targeted website
- section
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L61/00—Network arrangements, protocols or services for addressing or naming
- H04L61/09—Mapping addresses
- H04L61/25—Mapping addresses of the same type
- H04L61/2503—Translation of Internet protocol [IP] addresses
- H04L61/255—Maintenance or indexing of mapping tables
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/04—Processing captured monitoring data, e.g. for logfile generation
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Data Mining & Analysis (AREA)
- Information Transfer Between Computers (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The embodiment of the invention provides a kind of method and device for obtaining targeted website data information, this method is applied to server, comprising: obtains the target ip address of current time access target website;According to the corresponding relationship of each period, IP address section and each station address that pre-save, judge whether IP address section where the target ip address corresponds to the address of place period at current time and the targeted website;If not, according to the corresponding relationship of the period, IP address section and each station address that pre-save, target ip address section corresponding to period where obtaining the targeted website and current time, and select any IP address to access the targeted website in the target ip address section, obtain the data information of the targeted website.In the present solution, can be shielded to avoid the IP address of access target website.
Description
Technical field
The present invention relates to Internet technical fields, more particularly to a kind of method and dress for obtaining targeted website data information
It sets.
Background technique
With the rapid development of network technology, network operator can automatically grab other networks fortune by web crawlers
The data information of quotient website is sought, and by corresponding these data informations of index technology tissue, is supplied to search user and looks into
It askes.Wherein, web crawlers is a kind of technology of batch acquisition targeted website data information.Data information may include: picture, sound
Frequently, video etc..Targeted website can crawl the website of data information for network operator.
Currently, the method that targeted website data information is obtained using web crawlers mode, mainly are as follows: use Target IP
(Internet Protocol, Internet protocol) address accesses targeted website, and obtains the data information of targeted website.When adopting
When obtaining the data information of targeted website in aforementioned manners, target website server can count the target for accessing the targeted website
IP address determines the target ip address when being greater than predetermined period there are the time cycle of target ip address access target website
Corresponding user is used web crawlers and obtains targeted website data information, and shields to the target ip address.Cause
This, the target ip address that the existing method for obtaining targeted website data information may cause access target website is shielded.
Summary of the invention
The embodiment of the present invention is designed to provide a kind of method and device for obtaining targeted website data information, to solve
The shielded technical problem of target ip address in the prior art.Specific technical solution is as follows:
On the one hand, the embodiment of the invention discloses a kind of method for obtaining targeted website data information, it is applied to server,
The described method includes:
Obtain the target ip address of current time access target website;
According to the corresponding relationship of each period, IP address section and each station address that pre-save, the Target IP is judged
The address of period and the targeted website where whether IP address section where address corresponds to current time;
If it is not, obtaining the target according to the corresponding relationship of the period, IP address section and each station address that pre-save
Target ip address section corresponding to period where website and current time, and select in the target ip address section any
IP address accesses the targeted website, obtains the data information of the targeted website.
Optionally, the corresponding relationship of the basis pre-saves each period, IP address section and each station address, judgement
The step of the address of period and the targeted website where whether IP address section where the target ip address corresponds to current time
Suddenly include:
In the corresponding relationship, the time where IP address section, the current time where searching the target ip address
Section;
Judge target ip address place IP address section, period where the current time and the targeted website
Whether address corresponds to.
Optionally, it selects any IP address to access the targeted website in the target ip address section, obtains the mesh
After the data information for marking website, the method also includes:
It detects whether to have triggered and the targeted website is accessed by any IP address, obtain the number of the targeted website
It is believed that breath;
If it is not, triggering accesses the targeted website by any IP address, the data letter of the targeted website is obtained
Breath, and record the trigger action.
Optionally, the method also includes:
Store the corresponding relationship of each period, IP address section and each station address.
Optionally, the step of corresponding relationship of the storage each period, IP address section and each station address includes:
Obtain IP address section corresponding to each period and each station address;
It is corresponding to store IP address section and each station address corresponding to each period.
Optionally, the method also includes:
When detecting that user changes the corresponding relationship of the period, IP address section and each station address, storage change
The corresponding relationship of rear period, IP address section and each station address.
On the other hand, the embodiment of the invention also discloses a kind of device for obtaining targeted website data information, it is applied to clothes
Business device, described device include:
Acquiring unit, for obtaining the target ip address of current time access target website;
Judging unit is sentenced for the corresponding relationship according to each period, IP address section and each station address pre-saved
The address of period and the targeted website where whether IP address section where the target ip address of breaking corresponds to current time;
Selecting unit, for when the judging unit judging result is no, according to pre-save each period, IP
The corresponding relationship of location section and each station address obtains target corresponding to the targeted website and place period at current time
IP address section, and select any IP address to access the targeted website in the target ip address section, obtain the target network
The data information stood.
Optionally, the judging unit includes:
Search subelement, in the corresponding relationship, IP address section where searching the Target IP, it is described current when
Period where carving;
Judgment sub-unit, for the period where IP address section, the current time where judging the target ip address
And whether the address of the targeted website corresponds to.
Optionally, described device further include:
Detection unit accesses the targeted website by any IP address for detecting whether having triggered, obtains institute
State the data information of targeted website;
Trigger unit, for when the detection unit testing result is no, triggering to be accessed by any IP address
The targeted website, obtains the data information of the targeted website, and records the trigger action.
Optionally, described device further include:
Storage unit, for storing the corresponding relationship of each period, IP address section and each station address.
Optionally, the storage unit includes:
Subelement is obtained, for obtaining IP address section corresponding to each period and each station address;
Storing sub-units store IP address section and each station address corresponding to each period for corresponding.
Optionally, described device further include:
Updating unit detects that user changes the corresponding of the period, IP address section and each station address and closes for working as
When being, the corresponding relationship of period, IP address section and each station address after storage change.
A kind of method and device obtaining targeted website data information provided in an embodiment of the present invention, server are available
The target ip address of current time access target website, according to each period, IP address section and each station address pre-saved
Corresponding relationship, judge period where whether IP address section where the target ip address corresponds to current time and targeted website
Address, when the judgment result is No, target ip address section and current time institute corresponding to the period where obtaining current time
The address of targeted website corresponding to the period, and in destination address section select any IP address come access targeted website,
Obtain the data information of the targeted website.
In the present solution, server can be right using period institute where current time for the period where current time
Any IP address in IP address section answered selects different to obtain the data information of targeted website for the different periods
IP address access targeted website, and obtain the data information of targeted website.In this way, an IP address will not the long period
One targeted website of access, so as to avoid the IP address of access target website from being shielded, improve obtain targeted website number
It is believed that the efficiency of breath.Certainly, implement any of the products of the present invention or method it is not absolutely required at the same reach above-described institute
There is advantage.
Detailed description of the invention
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
Some embodiments of invention for those of ordinary skill in the art without creative efforts, can be with
It obtains other drawings based on these drawings.
Fig. 1 is a kind of flow chart of the method provided in an embodiment of the present invention for obtaining targeted website data information;
Fig. 2 is another flow chart of the method provided in an embodiment of the present invention for obtaining targeted website data information;
Fig. 3 is another flow chart of the method provided in an embodiment of the present invention for obtaining targeted website data information;
Fig. 4 is a kind of structural schematic diagram of the device provided in an embodiment of the present invention for obtaining targeted website data information;
Fig. 5 is another structural schematic diagram of the device provided in an embodiment of the present invention for obtaining targeted website data information.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete
Site preparation description, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.It is based on
Embodiment in the present invention, it is obtained by those of ordinary skill in the art without making creative efforts every other
Embodiment shall fall within the protection scope of the present invention.
It should be noted that in the absence of conflict, the feature in embodiment and embodiment in the present invention can phase
Mutually combination.The present invention will be described in detail below with reference to the accompanying drawings and embodiments.
A kind of method for being provided for the embodiments of the invention acquisition targeted website data information first below is introduced.
It should be noted that the executing subject of the method for the acquisition targeted website data information in the embodiment of the present invention can be with
For the application program in server or the server, this is all reasonable.
In order to solve the shielded technical problem of target ip address in the prior art, the embodiment of the invention provides one kind to obtain
The method for taking targeted website data information is applied to server, as shown in Figure 1, this method may comprise steps of:
S101 obtains the target ip address of current time access target website.
In practical applications, the data information of the available each website of server.In the embodiment of the present invention, obtained with server
For the data information for taking a website (targeted website), illustrate acquisition targeted website provided in an embodiment of the present invention data information
Method.
In embodiments of the present invention, server can be periodically detected its targeted website accessed, and obtain
The target ip address of access target website.That is, server can determine mesh used in its present access destination website
Mark IP address.Wherein, server obtains the process of the target ip address of current time access target website, can use existing
Any method, the embodiment of the present invention is to this process without repeating.
In embodiments of the present invention, server can detecte the targeted website that current time accessed, and when obtaining current
Carve the target ip address just in access target website.For example, server detects its current time, (e.g., current time can be 16
When 15 divide 30 seconds) just at access target website (e.g., http://www.youku.com/), and obtain and accessing the target
The target ip address (e.g., 10.221.82.130) of website.
S102 judges the mesh according to the corresponding relationship of each period, IP address section and each station address that pre-save
The address of period and the targeted website where whether IP address section where mark IP address corresponds to current time;If not, holding
Row step S103.
In the embodiment of the present invention, the corresponding relationship of each period, IP address section and each station address can be stored in advance
In the server.As shown in table 1, table 1 shows the exemplary corresponding relationship of each period, IP address section and each station address.
Each station address | IP address section | Period | Annotation |
http://www.youku.com/ | 10.221.* | 00:00:00-08:59:59 | Shanghai computer room |
http://www.youku.com/ | 10.10.* | 09:00:00-16:59:59 | Beijing computer room |
http://www.youku.com/ | 10.188.* | 17:00:00-23:59:59 | Chongqing computer room |
Wherein, " 10.221.* " indicates IP address section where all IP address started with 10.221. in table 1.
" 10.10.* " indicates IP address section where all IP address started with 10.10.." 10.188.* " expression is started with 10.188.
All IP address where IP address section.
Shanghai computer room can be with IP address section, period (00:00:00- where all IP address for being started with 10.221.
08:59:59) and http://www.youku.com/ is corresponding;Beijing computer room can be with all IP address institutes for being started with 10.10.
It is corresponding in IP address section, period (09:00:00-16:59:59) and http://www.youku.com/;Chongqing computer room can be with
With all IP address place IP address section, period (17:00:00-23:59:59) and the http started with 10.188.: //
Www.youku.com/ is corresponding.
After server obtains the target ip address of current time access target website, the Target IP may further determine that
Period and targeted website where IP address section, current time where address, and judge IP address where the target ip address
The corresponding relationship of section, period where current time and targeted website whether with pre-stored each period, IP address section and
Each station address corresponding relationship is consistent.
Specifically, server after the target ip address for obtaining current time access target website, can be protected according to preparatory
The corresponding relationship of each period, IP address section and each station address deposited searches the target ip address in stored corresponding pass
Which of which IP address section and current time in system in stored corresponding relationship period.Also, judge Target IP
Whether the address of period and targeted website where IP address section, current time where address corresponds to.
For example, the target ip address of current time access target website (http://www.youku.com/) is
10.221.30.130 current time 07:59:59.According to table 1, server can determine IP where the target ip address
Address field is 10.221.*, and the period where current time is 00:00:00-08:59:59, and determines target ip address place
Period where IP address section, current time and target website address (http://www.youku.com/) are corresponding.
In another example the target ip address of current time access target website http://www.youku.com/ is
10.221.30.130 current time 10:59:59.According to table 1, server can determine IP where the target ip address
Address field is 10.221.*, and the period where current time is 09:00:00-16:59:59, and determines target ip address place
Period and target website address (http://www.youku.com/) do not correspond to where IP address section, current time.
S103, according to the corresponding relationship of each period, IP address section and each station address that pre-save, when obtaining current
The ground of targeted website corresponding to period where target ip address section corresponding to period where carving and current time
Location, and select any IP address to access the targeted website in the target ip address section, obtain the number of the targeted website
It is believed that breath.
The corresponding relationship of the address of period and targeted website where IP address section, current time where target ip address
When inconsistent with stored corresponding relationship, server can be in stored each period, IP address section and each station address
Corresponding relationship in, obtain target ip address section corresponding to targeted website and period where current time.Further,
In the IP address section where acquired target ip address, an optional IP address is determined as current time access target website
Target ip address.
For example, IP address section where target ip address is 10.221.*, the period where current time is (09:00:00-
16:59:59), target website address is http://www.youku.com/, it is seen then that IP address section where target ip address, when
Period (09:00:00-16:59:59), IP in the corresponding relationship and table 1 of the address of period and targeted website where the preceding moment
The corresponding relationship of address field (10.10.*) and station address (http://www.youku.com/) is inconsistent.Then server can be with
Period where obtaining targeted website (http://www.youku.com/) and current time in table 1 (09:00:00-16:
Target ip address section (10.10.*) corresponding to 59:59), and any IP address is selected in target ip address section (10.10.*)
(for example, selected any IP address can be 10.10.30.140) access target website (http: //
Www.youku.com/), and the data information of targeted website (http://www.youku.com/) is obtained.
In the embodiment of the present invention, server can use the time where current time for the period where current time
Any IP address in IP address section corresponding to section selects to obtain the data information of targeted website for the different periods
Different IP address is selected to access targeted website, and obtains the data information of targeted website.In this way, IP address will not be compared with
It improves so as to avoid the IP address of access target website from being shielded and obtains target in one targeted website of access for a long time
The efficiency of website data information.
Further, as shown in Fig. 2, after step s 103, the method can also include:
S104 detects whether to have triggered accessing the targeted website by any IP address, obtains the target network
The data information stood, if it is not, executing step S105.
Server selects any IP address in target ip address section come after accessing targeted website, can also be in default week
Detect whether to have used any IP address access target website in target ip address section in phase, to obtain the number of targeted website
It is believed that breath.
For example, server selects any IP address (10.10.80.130) access target website in destination address section
After (http://www.youku.com/), in predetermined period 1 second, it can detecte and whether passed through any IP address
(10.10.80.130) access target website (http://www.youku.com/).
S105, triggering access the targeted website by any IP address, obtain the data letter of the targeted website
Breath, and record the trigger action.
It, can if server detects that any IP address starts access target website not yet in the embodiment of the present invention
Start access target website to trigger any IP address, and obtain the data information of targeted website by the IP address, together
When, record the operation of triggered any IP address access target website.
In the embodiment of the present invention, after server selects any IP address access target website in target ip address section,
It further detects whether selected IP address has begun access target website, if server detects access target website
IP address be not its selection IP address, then trigger selected IP address further to access targeted website.Meanwhile it recording
Trigger action does not detect whether selected IP address has begun visit so that server is recorded according to the trigger action again
Ask targeted website.As it can be seen that the embodiment of the present invention, it can be ensured that server is used in the period where current time selected by it
IP address access targeted website.
Optionally, the server of the embodiment of the present invention be with can also being stored in advance each period, IP address section and each website
The corresponding relationship of location.
In the embodiment of the present invention, user can divide the period in advance, and each time corresponds to respective IP address section and website
Address.For example, one day 24 hour can be divided into 3 periods or 4 periods, 6 periods etc..It needs to infuse
Meaning, it can be to differ that each period after division, which can be each period after isometric period, or division,
The long period.It is as shown in table 1 the exemplary of each period provided in an embodiment of the present invention, IP address section and each station address
Corresponding relationship.
Specifically, the corresponding relationship process that server stores each period, IP address section and each station address can be with are as follows: clothes
Business device obtains IP address section corresponding to each period and each station address, and corresponds to storing IP corresponding to each period
Location section and each station address.
Server, can be for each period with distributing corresponding IP address section and each website after obtaining each period
Location.Here, each period can correspond to different IP address sections, can correspond to different station addresses.When server will be each
Between section, corresponding IP address section of each period and the corresponding storage of corresponding station address of each time to pre-set storage sky
Between.
In the embodiment of the present invention, user can be by relevant operation to pair of period, IP address section and each station address
It should be related to and be modified.When server detects that user changes the corresponding relationship of each period, IP address section and each station address
When, the corresponding relationship of stored each period, IP address section and each station address is updated to each time after user's change
The corresponding relationship of section, IP address section and each station address, and store-updated each period, IP address section and each website
The corresponding relationship of location.
For example, as shown in figure 3, the structural schematic diagram of server provided in an embodiment of the present invention, wherein server
300 may include: configuration files database 310, timesharing crawl trigger 320, agency of trademark registration server 330, change trigger
340, proxy updating service device 350 and access server 360.
It is closed specifically, storing the corresponding of each period, IP address section and each station address in configuration files database 310
System.For example, can store each period, IP address section and each station address as shown in Table 1 in configuration files database 310
Corresponding relationship.
Timesharing grabs the target ip address of 320 available current time access target website of trigger, is protected according to preparatory
There are the corresponding relationships of each period, IP address section and each station address in configuration files database 310, judge target ip address
The address of period and the targeted website where whether place IP address section corresponds to current time, if it is not, according to pre-saving
Period, IP address section and each station address corresponding relationship, Target IP corresponding to the period where obtaining current time
The address of targeted website corresponding to period where address field and current time.
Agency of trademark registration server 330 selects any IP address in target ip address section.Later, change trigger 340 will
The target ip address of access target website is changed to any IP address in destination address section.Meanwhile proxy updating service device 350
The target ip address of access target website is updated to any IP address in destination address section, and notifies access server
360, so as to access server according to updated any IP address access target website, and obtain the data letter of targeted website
Breath.
Relative to above method embodiment, the embodiment of the invention also provides a kind of dresses for obtaining targeted website data information
400 are set, is applied to server, as shown in figure 4, described device 400 includes:
Acquiring unit 410, for obtaining the target ip address of current time access target website;
Judging unit 420, for being closed according to the corresponding of each period, IP address section and each station address pre-saved
System, judges whether IP address section where the target ip address corresponds to the ground of place period at current time and the targeted website
Location;
Selecting unit 430, for when the judging unit judging result be it is no when, according to each period pre-saved,
The corresponding relationship of IP address section and each station address obtains corresponding to the targeted website and place period at current time
Target ip address section, and select any IP address to access the targeted website in the target ip address section, obtain the mesh
Mark the data information of website.
In the embodiment of the present invention, server can use the time where current time for the period where current time
Any IP address in IP address section corresponding to section selects to obtain the data information of targeted website for the different periods
Different IP address is selected to access targeted website, and obtains the data information of targeted website.In this way, IP address will not be compared with
It improves so as to avoid the IP address of access target website from being shielded and obtains target in one targeted website of access for a long time
The efficiency of website data information.
Optionally, the judging unit 420 includes:
Subelement (not shown) is searched, for IP address where in the corresponding relationship, searching the Target IP
Period where section, the current time;
Judgment sub-unit (not shown), for IP address section where judging the target ip address, it is described current when
Whether the address of period and the targeted website where carving corresponds to.
Optionally, as shown in figure 5, described device 400 further include:
Detection unit 440 accesses the targeted website by any IP address for detecting whether having triggered, obtains
The data information of the targeted website;
Trigger unit 450, for when the detection unit testing result is no, triggering to be visited by any IP address
It asks the targeted website, obtains the data information of the targeted website, and record the trigger action.
Optionally, described device further include:
Storage unit (not shown), for storing the corresponding relationship of each period, IP address section and each station address.
Optionally, the storage unit includes:
Subelement (not shown) is obtained, for obtaining IP address section corresponding to each period and each station address;
Storing sub-units (not shown), for IP address section corresponding to corresponding storage each period and each website
Location.
Optionally, described device further include:
Updating unit (not shown) detects that user changes the period, IP address section and each website for working as
When the corresponding relationship of address, the corresponding relationship of period, IP address section and each station address after storage change.
For device embodiment, since it is substantially similar to the method embodiment, related so being described relatively simple
Place illustrates referring to the part of embodiment of the method.
It should be noted that, in this document, relational terms such as first and second and the like are used merely to a reality
Body or operation are distinguished with another entity or operation, are deposited without necessarily requiring or implying between these entities or operation
In any actual relationship or order or sequence.Moreover, the terms "include", "comprise" or its any other variant are intended to
Non-exclusive inclusion, so that the process, method, article or equipment including a series of elements is not only wanted including those
Element, but also including other elements that are not explicitly listed, or further include for this process, method, article or equipment
Intrinsic element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that
There is also other identical elements in process, method, article or equipment including the element.
Each embodiment in this specification is all made of relevant mode and describes, same and similar portion between each embodiment
Dividing may refer to each other, and each embodiment focuses on the differences from other embodiments.Especially for system reality
For applying example, since it is substantially similar to the method embodiment, so being described relatively simple, related place is referring to embodiment of the method
Part explanation.
The foregoing is merely illustrative of the preferred embodiments of the present invention, is not intended to limit the scope of the present invention.It is all
Any modification, equivalent replacement, improvement and so within the spirit and principles in the present invention, are all contained in protection scope of the present invention
It is interior.
Claims (12)
1. a kind of method for obtaining targeted website data information, which is characterized in that be applied to server, which comprises
Obtain the target ip address of current time access target website;
According to the corresponding relationship of each period, IP address section and each station address that pre-save, the target ip address is judged
The address of period and the targeted website where whether place IP address section corresponds to current time;
If it is not, obtaining the targeted website according to the corresponding relationship of the period, IP address section and each station address that pre-save
And target ip address section corresponding to the period where current time, and in the target ip address section with selecting any IP
Location accesses the targeted website, obtains the data information of the targeted website.
2. the method according to claim 1, wherein the basis pre-save each period, IP address section
And the corresponding relationship of each station address, judge whether IP address section where the target ip address corresponds to the time where current time
Section and the targeted website address the step of include:
In the corresponding relationship, the period where IP address section, the current time where searching the target ip address;
The address of period and the targeted website where IP address section, the current time where judging the target ip address
Whether correspond to.
3. the method according to claim 1, wherein selecting any IP address to visit in the target ip address section
Ask the targeted website, after the data information for obtaining the targeted website, the method also includes:
It detects whether to have triggered and the targeted website is accessed by any IP address, obtain the data letter of the targeted website
Breath;
If it is not, triggering accesses the targeted website by any IP address, the data information of the targeted website is obtained, and
Record the trigger action.
4. the method according to claim 1, wherein the method also includes:
Store the corresponding relationship of each period, IP address section and each station address.
5. according to the method described in claim 4, it is characterized in that, the storage each period, IP address section and each website
The step of corresponding relationship of location includes:
Obtain IP address section corresponding to each period and each station address;
It is corresponding to store IP address section and each station address corresponding to each period.
6. according to the method described in claim 4, it is characterized in that, the method also includes:
When detecting that user changes the corresponding relationship of the period, IP address section and each station address, after storage change
The corresponding relationship of period, IP address section and each station address.
7. a kind of device for obtaining targeted website data information, which is characterized in that be applied to server, described device includes:
Acquiring unit, for obtaining the target ip address of current time access target website;
Judging unit judges institute for the corresponding relationship according to each period, IP address section and each station address pre-saved
The address of period and the targeted website where whether IP address section where stating target ip address corresponds to current time;
Selecting unit, for when the judging unit judging result be it is no when, according to pre-save each period, IP address section
And the corresponding relationship of each station address, with obtaining Target IP corresponding to the targeted website and place period at current time
Location section, and select any IP address to access the targeted website in the target ip address section, obtain the targeted website
Data information.
8. device according to claim 7, which is characterized in that the judging unit includes:
Subelement is searched, for IP address section, current time institute where in the corresponding relationship, searching the Target IP
In the period;
Judgment sub-unit, for period and institute where IP address section, the current time where judging the target ip address
Whether the address for stating targeted website corresponds to.
9. device according to claim 7, which is characterized in that described device further include:
Detection unit accesses the targeted website by any IP address for detecting whether having triggered, obtains the mesh
Mark the data information of website;
Trigger unit, for when the detection unit testing result is no, triggering to pass through described in any IP address access
Targeted website, obtains the data information of the targeted website, and records the trigger action.
10. device according to claim 7, which is characterized in that described device further include:
Storage unit, for storing the corresponding relationship of each period, IP address section and each station address.
11. device according to claim 10, which is characterized in that the storage unit includes:
Subelement is obtained, for obtaining IP address section corresponding to each period and each station address;
Storing sub-units store IP address section and each station address corresponding to each period for corresponding.
12. device according to claim 10, which is characterized in that described device further include:
Updating unit, for when detecting that user changes the corresponding relationship of the period, IP address section and each station address,
The corresponding relationship of period, IP address section and each station address after storage change.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710210057.8A CN107181830B (en) | 2017-03-31 | 2017-03-31 | A kind of method and device obtaining targeted website data information |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710210057.8A CN107181830B (en) | 2017-03-31 | 2017-03-31 | A kind of method and device obtaining targeted website data information |
Publications (2)
Publication Number | Publication Date |
---|---|
CN107181830A CN107181830A (en) | 2017-09-19 |
CN107181830B true CN107181830B (en) | 2019-07-12 |
Family
ID=59830543
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201710210057.8A Active CN107181830B (en) | 2017-03-31 | 2017-03-31 | A kind of method and device obtaining targeted website data information |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN107181830B (en) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN114499921A (en) * | 2021-11-26 | 2022-05-13 | 中国南方电网有限责任公司 | Data packet file playback method, data packet file acquisition method and device |
US20230222613A1 (en) * | 2022-01-10 | 2023-07-13 | Capital One Services, Llc | Predicting customer change of address based on web browsing activity and transactions |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1437361A (en) * | 2002-02-07 | 2003-08-20 | 华为技术有限公司 | Network access control method based on network address |
CN102025793A (en) * | 2010-01-22 | 2011-04-20 | 中国移动通信集团北京有限公司 | Domain name resolution method and system and DNS in IP network |
CN103916493A (en) * | 2014-04-15 | 2014-07-09 | 大唐移动通信设备有限公司 | IP address field distribution method and device |
CN104320446A (en) * | 2014-10-14 | 2015-01-28 | 上海交通大学 | Distributed multi-Agent website monitoring method and system |
-
2017
- 2017-03-31 CN CN201710210057.8A patent/CN107181830B/en active Active
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1437361A (en) * | 2002-02-07 | 2003-08-20 | 华为技术有限公司 | Network access control method based on network address |
CN102025793A (en) * | 2010-01-22 | 2011-04-20 | 中国移动通信集团北京有限公司 | Domain name resolution method and system and DNS in IP network |
CN103916493A (en) * | 2014-04-15 | 2014-07-09 | 大唐移动通信设备有限公司 | IP address field distribution method and device |
CN104320446A (en) * | 2014-10-14 | 2015-01-28 | 上海交通大学 | Distributed multi-Agent website monitoring method and system |
Also Published As
Publication number | Publication date |
---|---|
CN107181830A (en) | 2017-09-19 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US8572100B2 (en) | Method and system for recording search trails across one or more search engines in a communications network | |
US8548991B1 (en) | Personalized browsing activity displays | |
CN103186666B (en) | Method, device and equipment for searching based on favorites | |
CN104424244B (en) | A kind of method, apparatus and equipment obtaining search result | |
CN107181830B (en) | A kind of method and device obtaining targeted website data information | |
CN109274584A (en) | Cut-in method, device, client device and the storage medium of access server | |
CN106294848A (en) | A kind of web analysis, acquisition methods and device | |
CN110535974A (en) | Method for pushing, driving means, equipment and the storage medium of resource to be put | |
CN101551813A (en) | Network connection apparatus, search equipment and method for collecting search engine data source | |
CN109474698A (en) | Access request labeling method, device, equipment and storage medium | |
CN106301928A (en) | A kind of web analysis, acquisition methods and device | |
CN109086158A (en) | A kind of Analysis on Abnormal method, apparatus and server | |
CN113660359B (en) | Domain name resolution record management method and device, storage medium and electronic equipment | |
CN107798100A (en) | A kind of collocation method using recommendation information | |
CN105635821B (en) | A kind of video filtering method and device | |
CN104021203B (en) | It is a kind of for accessing the method and device of webpage | |
CN106897297B (en) | Method and device for determining access path between website columns | |
CN106469166B (en) | A kind of information processing method and device | |
CN107968812A (en) | The method and device of synchronous local resource and Internet resources | |
CN107871021B (en) | Method and device for obtaining identification features of webpage search keywords | |
CN110399557A (en) | A kind of recognition methods of visitor information, identification device and readable storage medium storing program for executing | |
CN109783728A (en) | Page crawler rule update method and system | |
CN106713588B (en) | A kind of method and device that communication address book stored is synchronous | |
JP4233386B2 (en) | Information resource server and information resource providing method | |
CN111198818B (en) | Information acquisition method and device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |