CN106681992A - Method and device for managing website login information - Google Patents

Method and device for managing website login information Download PDF

Info

Publication number
CN106681992A
CN106681992A CN201510745533.7A CN201510745533A CN106681992A CN 106681992 A CN106681992 A CN 106681992A CN 201510745533 A CN201510745533 A CN 201510745533A CN 106681992 A CN106681992 A CN 106681992A
Authority
CN
China
Prior art keywords
message
log
preset time
failure
time threshold
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201510745533.7A
Other languages
Chinese (zh)
Other versions
CN106681992B (en
Inventor
崔志伸
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Gridsum Technology Co Ltd
Original Assignee
Beijing Gridsum Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Gridsum Technology Co Ltd filed Critical Beijing Gridsum Technology Co Ltd
Priority to CN201510745533.7A priority Critical patent/CN106681992B/en
Publication of CN106681992A publication Critical patent/CN106681992A/en
Application granted granted Critical
Publication of CN106681992B publication Critical patent/CN106681992B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/951Indexing; Web crawling techniques
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/958Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking

Landscapes

  • Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Debugging And Monitoring (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

The invention discloses a method and device for managing website login information and relates to the technical field of Internet. The invention is aimed at solving the problem of low efficiency in managing website login information caused by the situation where a crawler program determines that certain login information is invalid and discards the login information and later the discarded login information requires manual processing. The method of the invention comprises following steps: obtaining invalid login information stored locally; determining whether the invalid duration of the login information is larger than a preset time threshold corresponding to the login information; if the invalid duration is larger than the preset time threshold, recovering the login information to valid login information. The invention is mainly suitable in the scenario where crawler programs crawl web pages through login vouchers.

Description

The method and apparatus of managing web log-on message
Technical field
The present invention relates to Internet technical field, more particularly to a kind of method of managing web log-on message And device.
Background technology
Web crawlers is a kind of according to certain rule, and the program of web message is captured automatically.In reality In the application of border, crawlers can run into when various websites are crawled, usually needs logging on authentication just to have the right Crawl the website of web page contents.In this case, before crawlers crawl website, can first to Website server sends log-on message (including login account and password);Website server receives login After information, the log-on message can be verified by proof rule;If being verified, climb to this Worm program feeds back logging on authentication, so that crawlers are crawled in the webpage on the website by logging on authentication Hold.It follows that log-on message is the essential condition that crawlers obtain logging on authentication.
However, in actual applications, but it occur frequently that because of the log-on message failure for being used, so as to nothing Method obtains the phenomenon of logging on authentication.Wherein, log-on message failure is broadly divided into three kinds of situations:(1) forever Failure long;(2) fail in certain period of time, after the time period, the log-on message can be recovered Normally use;(3) due to network or other reasonses, request obtains logging on authentication failure, and by reptile Program is mistakenly considered log-on message failure.When crawlers know certain log-on message failure, can be somebody's turn to do Log-on message is abandoned, and then judges whether the log-on message for abandoning can reuse by manually, if can Reuse, then reusable log-on message is added in crawlers.It follows that The whole process that the log-on message for failing is managed, complex operation, and need at artificial participation Reason, so as to cause the less efficient of managing web log-on message.
The content of the invention
In view of above-mentioned technical problem, a kind of method and dress for proposing managing web log-on message of the invention Put, can solve the problem that in prior art when crawlers determine certain log-on message fails when, abandoned, The log-on message manually to abandoning is needed to process afterwards, so as to cause managing web log-on message efficiency Low problem.
On the one hand, the invention provides a kind of method of managing web log-on message, methods described includes:
Obtain the log-on message of locally stored failure;
Judge the failure duration of the log-on message whether more than the corresponding Preset Time of the log-on message Threshold value;
If the failure duration is more than the preset time threshold, the log-on message is reverted to The log-on message of effect.
On the other hand, the invention provides a kind of device of managing web log-on message, described device bag Include:
Acquiring unit, for obtaining the log-on message of locally stored failure;
Judging unit, for judging that the failure duration of the log-on message that the acquiring unit is obtained is It is no more than the corresponding preset time threshold of the log-on message;
Recovery unit, the judged result for working as the judging unit is the failure duration more than described During preset time threshold, the log-on message is reverted to into effective log-on message.
The method and apparatus of the managing web log-on message provided by above-mentioned technical proposal, the present invention, Can save it in locally after crawlers determine certain log-on message failure, and it is examined Survey, whether judge the failure duration of log-on message more than the corresponding preset time threshold of the log-on message, When the duration that fails is more than preset time threshold, the log-on message is reverted to into effective log-on message. During whole log-on message recovers effectiveness, the log-on message that crawlers fail without the need for discarding, Without the artificial log-on message for participating in processing failure, so as to improve the effect of managing web log-on message Rate.
Described above is only the general introduction of technical solution of the present invention, in order to better understand the present invention's Technological means, and being practiced according to the content of description, and in order to allow the above-mentioned of the present invention and Other objects, features and advantages can become apparent, below especially exemplified by the specific embodiment of the present invention.
Description of the drawings
By the detailed description for reading hereafter preferred implementation, various other advantage and benefit for Those of ordinary skill in the art will be clear from understanding.Accompanying drawing is only used for illustrating the mesh of preferred implementation , and it is not considered as limitation of the present invention.And in whole accompanying drawing, with identical with reference to symbol Number represent identical part.In the accompanying drawings:
Fig. 1 shows a kind of flow process of the method for managing web log-on message provided in an embodiment of the present invention Figure;
Fig. 2 shows a kind of composition of the device of managing web log-on message provided in an embodiment of the present invention Block diagram;
Fig. 3 shows the group of the device of another kind of managing web log-on message provided in an embodiment of the present invention Into block diagram.
Specific embodiment
The exemplary embodiment of the disclosure is more fully described below with reference to accompanying drawings.Although showing in accompanying drawing The exemplary embodiment of the disclosure is shown, it being understood, however, that may be realized in various forms the disclosure And should not be limited by embodiments set forth here.On the contrary, there is provided these embodiments are able to more Thoroughly understand the disclosure, and can be by the complete technology for conveying to this area of the scope of the present disclosure Personnel.
A kind of method of managing web log-on message is embodiments provided, as shown in figure 1, should Method includes:
101st, the log-on message of locally stored failure is obtained.
Specifically, when crawlers cannot obtain logging on authentication using certain log-on message, can determine whether this Log-on message fails, now, when crawlers can fail the log-on message of the failure and determination Time point (i.e. initiated failure time point) storage is to locally.Judging whether log-on message is failure During log-on message, directly whether there can be corresponding initiated failure time point to judge according to the log-on message Whether the log-on message is the log-on message for failing.
Additionally, the efficiency in order to improve the log-on message for obtaining failure, in crawlers certain login is determined Can also be its one invalid markers of addition, so as to according to failure when information is the log-on message of failure Labelling quickly determines whether the current log-on message for obtaining is the log-on message for failing.
It should be noted that generally, the log-on message that Website login is used is login account And the log-on message being related in password, therefore the embodiment of the present invention is mainly login account and password.
102nd, judge the failure duration of log-on message whether more than the corresponding Preset Time threshold of log-on message Value.
Wherein, preset time threshold is for judging whether the log-on message for failing can recover effectiveness The recovery cycle.In actual applications, effectiveness institute is recovered in each website for the log-on message of failure The time for needing is often different, so the preset time threshold being related in this step may be different.
Specifically, a recovery cycle correspondence table can be locally being stored, in the recovery cycle correspondence table extremely Few record has the corresponding relation of log-on message and preset time threshold, can also record the net of correspondence website The information such as location.When needing the log-on message of failure to obtaining to judge, can be from locally stored Recovery cycle correspondence table in find preset time threshold corresponding to the log-on message of the failure, so Judged according to preset time threshold afterwards.
Additionally, referring in above-mentioned steps 101, in the log-on message of record failure, can also record The initiated failure time point of the log-on message, therefore, this can be obtained according to the initiated failure time point and be stepped on The failure duration of record information, so as to failure duration preset time threshold corresponding with the log-on message be entered Row compares, to judge whether the log-on message can recover effectiveness.
It should be noted that in most cases, reptile developer is not aware that set by each website The actual recovery cycle, therefore the preset time threshold referred in this step possibly rule of thumb counts And come.
If the duration that the 103, fails is more than preset time threshold, log-on message is reverted to into effectively login Information.
When judged result is more than preset time threshold for the failure duration of the log-on message of current detection, In the recovered effectiveness of the log-on message in Website server side, illustrate now using login letter Breath can successfully be applied to logging on authentication.But, in crawlers side, the log-on message is still It is the log-on message of failure, therefore, in order to allow crawlers to determine that it is effective log-on message, need The log-on message is reverted to into effective log-on message, i.e., in crawlers side, the log-on message It is effective log-on message.Wherein, crawlers are allowed to determine that the log-on message is effective log-on message Method have various.For example, a significant notation is added to the log-on message, for identifying the login Information is effective.
Additionally, in actual applications can whether can be with the locally stored failure log-on message of real-time detection Recover effectiveness, it is also possible to regularly detect whether locally stored failure log-on message can recover effective Property, the embodiment of the present invention is not limited this.
The method of managing web log-on message provided in an embodiment of the present invention, can determine in crawlers After certain log-on message failure, save it in locally, and it is detected, judge log-on message Whether failure duration is more than the corresponding preset time threshold of the log-on message, when failure duration is more than default During time threshold, the log-on message is reverted to into effective log-on message.Recover in whole log-on message During effectiveness, the log-on message that crawlers fail without the need for discarding, at artificial participation The log-on message of reason failure, so as to improve the efficiency of managing web log-on message.
Further, refer in above-mentioned steps 101, when crawlers determine certain log-on message failure When, can be its one invalid markers of addition, subsequently quickly to determine that the log-on message is stepping on for failure Record information.Therefore, when the log-on message of failure carries invalid markers, step 101 can be refined as: The locally stored log-on message of traversal;Judge whether current log-on message carries invalid markers;If current Log-on message carries invalid markers, it is determined that current log-on message is the log-on message of failure;If current Log-on message does not carry invalid markers, it is determined that current log-on message is not the log-on message of failure. Wherein, it, when crawlers determine that log-on message fails, is the mark of log-on message addition that invalid markers are Note.
It should be noted that referring in the above-described embodiments, judging whether log-on message is failure During log-on message, directly whether there can be corresponding initiated failure time point to judge according to the log-on message Whether the log-on message is the log-on message for failing.But, in the log-on message that crawlers are failure Addition invalid markers in the case of, crawlers when judging whether certain log-on message fails, only with mistake Criterion is denoted as basis for estimation, it is not intended that whether containing corresponding initiated failure time point.
Further, when it is determined that the failure duration of log-on message is more than preset time threshold, can be true Surely logging on authentication can successfully be applied for using the log-on message, therefore, in order to avoid crawlers continuation The log-on message for failing is identified as, the log-on message is reverted to effective log-on message by needs. Specifically, the invalid markers that the log-on message is carried can be changed to significant notation, it is also possible to directly Invalid markers are deleted.
Further, in actual applications, when crawlers determine certain log-on message fails when, can be by The log-on message of the failure is saved in locally, and records corresponding initiated failure time point, so as to follow-up The failure duration of the log-on message is judged according to initiated failure time point.It follows that for judgement is stepped on Whether the failure duration of record information is more than the specific implementation of the corresponding preset time threshold of log-on message Can be:The corresponding initiated failure time point of log-on message is obtained from local;According to the initiated failure time Point, calculates the failure duration of log-on message;The corresponding preset time threshold of log-on message is searched from local; Judge to fail duration whether more than preset time threshold.
Exemplary, if the corresponding initiated failure time point of log-on message is 1 day 18 October in 2015 Point 25 minutes and 4 seconds, current point in time is 4 seconds October 2 day 7 point 50 minute in 2015, then reptile journey Sequence according to initiated failure time point and current point in time, a length of 13 hours 25 points during the failure for calculating Clock, and the preset time threshold corresponding to log-on message is 10 hours.It follows that the log-on message Failure duration have been over preset time threshold, therefore crawlers can recover the log-on message Effectiveness.
Further, come because preset time threshold is possibly rule of thumb counted, with reality There is error in the recovery cycle, it is possible that occurring that preset time threshold is less than the actual recovery cycle Situation.For above-mentioned situation, it may occur that problems with:When crawlers determine certain log-on message Failure duration be more than preset time threshold when, the log-on message can be reverted to effective log-on message, But actually the log-on message does not also reach the actual recovery cycle, if now crawlers utilization should Log-on message application logging on authentication, can apply failing, so as to again crawlers determine the log-on message For failure log-on message, so as to reduce the efficiency that crawlers crawl webpage.To solve above-mentioned skill Art problem, the embodiment of the present invention proposes following scheme:
From log-on message reverts to effective log-on message, if in preset time period, log-on message The log-on message of failure is changed into from effective log-on message, then according to the first preset algorithm, letter will be logged in Cease corresponding preset time threshold to heighten.
Wherein, the particular content of the first preset algorithm can be:By current preset time threshold into multiplication Greatly, for example, current preset time threshold is multiplied by into 2;Can also be:Current preset time threshold is increased Plus a fixed value, for example, add 5 minutes on the basis of current preset time threshold.
Furthermore, it is also possible to there is the situation that preset time threshold is far longer than the actual recovery cycle, and Such case can reduce the utilization rate of log-on message.To solve the problem, the embodiment of the present invention is proposed Following scheme:
After log-on message to be reverted to effective log-on message, according to default regulation rule, to stepping on The corresponding preset time threshold of record information is adjusted, and obtains Best Times threshold value, wherein, when optimal Between threshold value when being that the log-on message for failing is recovered into effectiveness based on current preset time threshold, using stepping on Record information can successfully apply for logging on authentication, and if the second preset algorithm in default regulation rule Current preset time threshold is turned down, then the stepping on failure based on the preset time threshold after turning down During record Information recovering effectiveness, using log-on message logging on authentication cannot be successfully applied for.
Specifically, default regulation rule can be:(1) according to the second preset algorithm, by log-on message Corresponding preset time threshold is turned down;(2) if after being turned down processed at least one times, using turning down Preset time threshold afterwards recovers log-on message after effectiveness, occurs successfully applying arriving for the first time The phenomenon of logging on authentication, then stop turning down processs, and record appearance for the first time and cannot successfully apply to stepping on Corresponding preset time threshold (hereinafter referred to as very first time threshold value) during record voucher is then pre- according to first Imputation method, by the very first time threshold value process is heightened at least one times, until using default after heightening Time threshold recovers log-on message after effectiveness, can successfully apply to logging on authentication;(3) repeat Execution step (1)-(2), until there is situations below:If the preset time threshold after to heightening is carried out During turning down process at least one times, letter will be logged in using the preset time threshold after turning down each time Breath recovers after effectiveness, can successfully apply to logging on authentication, but working as will at least one times turn down process In last time turn down process after preset time threshold carry out turning down before processing, if find to last Once turning down the preset time threshold after processing carries out turning down process, and the preset time threshold after turning down will The maximum that can be less than or equal at least one very first time threshold value of record, even carries out turning down process, Recovered after the effectiveness of log-on message using the preset time threshold after turning down, it is impossible to successfully obtain login Voucher, then now crawlers determine that the last time that will not be turned down at least one times to this again in processing is adjusted Preset time threshold after reduction process carries out turning down process, and this is turned down at least one times in process most The preset time threshold after processing once is turned down afterwards and is defined as final preset time threshold, i.e., when optimal Between threshold value.
Due to preset time threshold significantly being turned down, it is likely that can be fast by original preset time threshold Speed is adjusted to the value less than the actual recovery cycle, therefore, the adjustment amplitude of the second preset algorithm is less. Conventional method is:Reduce by a fixed value on the basis of current preset time threshold, for example, working as Subtract 2 on the basis of front preset time threshold minute.
Exemplary, if preset time threshold is 8 hours, the second preset algorithm is in current preset Between reduce 0.5 hour on the basis of threshold value, then when the failure duration of the log-on message of failure is more than 8 hours When, the log-on message is reverted to effective log-on message by crawlers.Now, if crawlers make Can successfully obtain logging on authentication with the log-on message, then according to the second preset algorithm, by this it is default when Between threshold value turn down, that is, the preset time threshold after turning down be 8-0.5=7.5 hours.If at longer one section Between after (such as one month), the log-on message again for some reason from failure is effectively changed into, then this Secondary to judge whether the log-on message recover the effective time for 7.5 hours, that is, the duration that fails is more than After 7.5 hours, the log-on message is reverted to effective log-on message by crawlers.Now, if reptile Program still can successfully obtain logging on authentication using the log-on message, then again according to the second pre- imputation Method, the preset time threshold is turned down, that is, the preset time threshold after turning down is 7 hours.
If initial preset time threshold has been carried out into 6 times to turn down, and the Preset Time after turning down every time Threshold value all without too small, i.e., recovers the effective of log-on message using the preset time threshold after turning down every time After property, can successfully apply for logging on authentication.But after carrying out turning down for the 7th time, using pre- after turning down If time threshold recovers after the effectiveness of log-on message, but without successfully application to logging on authentication, i.e., in advance It is less than the actual recovery cycle if time threshold is changed into 4.5 hours.Accordingly, it would be desirable to the 7th time is turned down Preset time threshold afterwards, carries out heightening process according to the first preset algorithm.If the first preset algorithm is Current preset time threshold is multiplied by into 2, then the preset time threshold for carrying out heightening after processing is changed into 4.5*2=9 hour.
Can be after log-on message recover effectiveness as preset time threshold by the use of 9 hours, successful Shen Please arrive logging on authentication.Now, current preset time threshold need to be turned down according to the second preset algorithm Process.During were turned down within 9 hours to 5 hours, using the Preset Time after turning down each time Threshold value is recovered after the effectiveness of log-on message, can successfully apply to logging on authentication.Crawlers are intended to root When according to the second preset algorithm are turned down again within 5 hours, the preset time threshold after discovery is turned down can be changed into 4.5 hours, and determine before 4.5 hours and recover cycle is short than actual, therefore crawlers can be little by 5 When be set to final preset time threshold, without subsequently being adjusted again.
It follows that using the above-mentioned method heightened and turn down to preset time threshold, to default After time threshold is adjusted several times, the preset time threshold of acquisition can be closer to actual recovery week Phase.
Further, it is how much a length of when no matter failing for the log-on message of permanent failure, all Will not recover to effective log-on message in Website server side.Therefore, when from crawlers will log in Information recovering rises for effective log-on message, if continuous several times occur situations below:In preset time period Interior, log-on message believes that then crawlers determine that this is stepped on from the login that effective log-on message is changed into failing Record information is the log-on message of permanent failure, and is abandoned.
Further, according to said method embodiment, an alternative embodiment of the invention additionally provides one The device of managing web log-on message is planted, as shown in Fig. 2 the device includes:Acquiring unit 21, sentence Disconnected unit 22 and recovery unit 23.Wherein,
Acquiring unit 21, for obtaining the log-on message of locally stored failure;
Whether judging unit 22, the failure duration for judging the log-on message that acquiring unit 21 is obtained is big In the corresponding preset time threshold of log-on message;
Recovery unit 23, for being more than Preset Time for failure duration when the judged result of judging unit 22 During threshold value, log-on message is reverted to into effective log-on message.
The device of managing web log-on message provided in an embodiment of the present invention, can determine in crawlers After certain log-on message failure, save it in locally, and it is detected, judge log-on message Whether failure duration is more than the corresponding preset time threshold of the log-on message, when failure duration is more than default During time threshold, the log-on message is reverted to into effective log-on message.Recover in whole log-on message During effectiveness, the log-on message that crawlers fail without the need for discarding, at artificial participation The log-on message of reason failure, so as to improve the efficiency of managing web log-on message.
Further, as shown in figure 3, acquiring unit 21, including:
Spider module 211, for traveling through locally stored log-on message;
Judge module 212, for judging whether current log-on message carries invalid markers, invalid markers are It is the labelling of log-on message addition when crawlers determine that log-on message fails;
Determining module 213, for losing when the judged result of judge module 212 is carried for current log-on message Criterion clocks, it is determined that current log-on message is the log-on message of failure.
Further, recovery unit 23, the invalid markers for log-on message to be carried are changed to effectively Labelling.
Further, as shown in figure 3, judging unit 22, including:
Acquisition module 221, for obtaining the corresponding initiated failure time point of log-on message from local;
Computing module 222, for the initiated failure time point obtained according to acquisition module 221, calculating is stepped on The failure duration of record information;
Searching modul 223, for searching the corresponding preset time threshold of log-on message from local;
Judge module 224, for judging whether the failure duration that computing module 222 is obtained is more than lookup mould The preset time threshold that block 223 is searched.
Further, as shown in figure 3, the device also includes:
Adjustment unit 24, for reverting to effective log-on message from log-on message, if when default Between in section, log-on message is changed into the log-on message that fails from effective log-on message, then pre- according to first Imputation method, the corresponding preset time threshold of log-on message is heightened.
Further, adjustment unit 24, are additionally operable to according to default regulation rule, to log-on message correspondence Preset time threshold be adjusted, obtain Best Times threshold value;
Wherein, Best Times threshold value is to be recovered the log-on message for failing based on current preset time threshold During effectiveness, using log-on message logging on authentication can be successfully applied for, and if according to default regulation rule In the second preset algorithm current preset time threshold is turned down, then when based on default after turning down Between threshold value by fail log-on message recover effectiveness when, using log-on message cannot successfully apply log in Voucher.
The device embodiment is corresponding with preceding method embodiment, and for ease of reading, this device embodiment is not The detail content in preceding method embodiment is repeated one by one again, it should be understood that the present embodiment In device can correspond to the full content that realize in preceding method embodiment.
The device of the managing web log-on message includes processor and memorizer, above-mentioned acquiring unit, Judging unit and recovery unit etc. are stored in memory as program unit, are deposited by computing device Storage said procedure unit in memory is realizing corresponding function.
Kernel is included in processor, is gone in memorizer to transfer corresponding program unit by kernel.Kernel can To arrange one or more, by adjusting kernel parameter crawlers managing web log-on message is improved Efficiency.
Memorizer potentially includes the volatile memory in computer-readable medium, random access memory The form such as device (RAM) and/or Nonvolatile memory, such as read only memory (ROM) or flash memory (flash RAM), memorizer includes at least one storage chip.
Present invention also provides a kind of computer program, when performing in data handling equipment, It is adapted for carrying out initializing the program code of there are as below methods step:
Obtain the log-on message of locally stored failure;
Judge the failure duration of log-on message whether more than the corresponding preset time threshold of log-on message;
If failure duration is more than preset time threshold, log-on message is reverted to into effective log-on message.
Those skilled in the art it should be appreciated that embodiments herein can be provided as method, system, Or computer program.Therefore, the application can be implemented using complete hardware embodiment, complete software Example or with reference to the form of the embodiment in terms of software and hardware.And, the application can be adopted at one Or it is multiple wherein include computer usable program code computer-usable storage medium (including but not Be limited to disk memory, CD-ROM, optical memory etc.) on the computer program implemented Form.
The application is with reference to the method according to the embodiment of the present application, equipment (system) and computer program The flow chart and/or block diagram of product is describing.It should be understood that can be realized flowing by computer program instructions In each flow process and/or square frame and flow chart and/or block diagram in journey figure and/or block diagram Flow process and/or square frame combination.Can provide these computer program instructions to general purpose computer, specially With the processor of computer, Embedded Processor or other programmable data processing devices producing one Machine so that produced by the instruction of computer or the computing device of other programmable data processing devices It is raw to be used to realize in one flow process of flow chart or one square frame of multiple flow processs and/or block diagram or multiple sides The device of the function of specifying in frame.
These computer program instructions may be alternatively stored in can guide computer or other programmable datas to process In the computer-readable memory that equipment works in a specific way so that be stored in the computer-readable and deposit Instruction in reservoir is produced and includes the manufacture of command device, and command device realization is in flow chart one The function of specifying in flow process or one square frame of multiple flow processs and/or block diagram or multiple square frames.
These computer program instructions can also be loaded into computer or other programmable data processing devices On so that series of operation steps is performed on computer or other programmable devices to produce computer The process of realization, so as to the instruction performed on computer or other programmable devices is provided for realizing Specify in one flow process of flow chart or one square frame of multiple flow processs and/or block diagram or multiple square frames The step of function.
In a typical configuration, computing device include one or more processors (CPU), input/ Output interface, network interface and internal memory.
Memorizer potentially includes the volatile memory in computer-readable medium, random access memory The form such as device (RAM) and/or Nonvolatile memory, such as read only memory (ROM) or flash memory (flash RAM).Memorizer is the example of computer-readable medium.
Computer-readable medium includes that permanent and non-permanent, removable and non-removable media can be with Information Store is realized by any method or technique.Information can be computer-readable instruction, data knot Structure, the module of program or other data.The example of the storage medium of computer includes, but are not limited to phase Become internal memory (PRAM), static RAM (SRAM), dynamic random access memory (DRAM), other kinds of random access memory (RAM), read only memory (ROM), electricity can Erasable programmable read-only memory (EPROM) (EEPROM), fast flash memory bank or other memory techniques, read-only light Disk read only memory (CD-ROM), digital versatile disc (DVD) or other optical storages, magnetic Cassette tape, the storage of tape magnetic rigid disk or other magnetic storage apparatus or any other non-transmission medium, Can be used to store the information that can be accessed by a computing device.Define according to herein, computer-readable Medium does not include temporary computer readable media (transitory media), the such as data signal and load of modulation Ripple.
Embodiments herein is these are only, the application is not limited to.For this area skill For art personnel, the application can have various modifications and variations.It is all spirit herein and principle it Interior made any modification, equivalent substitution and improvements etc., should be included in claims hereof model Within enclosing.

Claims (10)

1. a kind of method of managing web log-on message, it is characterised in that methods described includes:
Obtain the log-on message of locally stored failure;
Judge the failure duration of the log-on message whether more than the corresponding Preset Time of the log-on message Threshold value;
If the failure duration is more than the preset time threshold, the log-on message is reverted to The log-on message of effect.
2. method according to claim 1, it is characterised in that the locally stored mistake of the acquisition The log-on message of effect, including:
The locally stored log-on message of traversal;
Judge whether current log-on message carries invalid markers, the invalid markers are true in crawlers It is the labelling of log-on message addition when determining log-on message failure;
If the current log-on message carries invalid markers, it is determined that the current log-on message is failure Log-on message.
3. method according to claim 2, it is characterised in that described that the log-on message is extensive It is again effective log-on message, including:
The invalid markers that the log-on message is carried are changed to into significant notation.
4. method according to claim 1, it is characterised in that the judgement log-on message Failure duration whether be more than the corresponding preset time threshold of the log-on message, including:
From locally obtaining the corresponding initiated failure time point of the log-on message;
According to the initiated failure time point, the failure duration of the log-on message is calculated;
From locally searching the corresponding preset time threshold of the log-on message;
Judge the failure duration whether more than the preset time threshold.
5. method according to claim 1, it is characterised in that methods described is further included:
From the log-on message reverts to effective log-on message, if in preset time period, it is described Log-on message is changed into the log-on message of failure from effective log-on message, then according to the first preset algorithm, The corresponding preset time threshold of the log-on message is heightened.
6. method according to claim 5, it is characterised in that described by the log-on message After reverting to effective log-on message, methods described is further included:
According to default regulation rule, the corresponding preset time threshold of the log-on message is adjusted, Obtain Best Times threshold value;
Wherein, the Best Times threshold value is the log-on message that will be failed based on current preset time threshold When recovering effectiveness, using log-on message logging on authentication can be successfully applied for, and if according to described default The second preset algorithm in regulation rule is turned down to current preset time threshold, then based on turning down after Preset time threshold by fail log-on message recover effectiveness when, cannot be successful using log-on message Application logging on authentication.
7. a kind of device of managing web log-on message, it is characterised in that described device includes:
Acquiring unit, for obtaining the log-on message of locally stored failure;
Judging unit, for judging that the failure duration of the log-on message that the acquiring unit is obtained is It is no more than the corresponding preset time threshold of the log-on message;
Recovery unit, the judged result for working as the judging unit is the failure duration more than described During preset time threshold, the log-on message is reverted to into effective log-on message.
8. device according to claim 7, it is characterised in that the acquiring unit, including:
Spider module, for traveling through locally stored log-on message;
Judge module, for judging whether current log-on message carries invalid markers, the invalid markers It, when crawlers determine that log-on message fails, is the labelling of log-on message addition to be;
Determining module, for carrying for the current log-on message when the judged result of the judge module During invalid markers, the log-on message that the current log-on message is failure is determined.
9. device according to claim 8, it is characterised in that the recovery unit, for will The invalid markers that the log-on message is carried are changed to significant notation.
10. device according to claim 7, it is characterised in that the judging unit, including:
Acquisition module, for from locally obtaining the corresponding initiated failure time point of the log-on message;
Computing module, for the initiated failure time point obtained according to the acquisition module, calculates The failure duration of the log-on message;
Searching modul, for from locally searching the corresponding preset time threshold of the log-on message;
Judge module, for judging the failure duration of the computing module acquisition whether more than described The preset time threshold that searching modul is searched.
CN201510745533.7A 2015-11-05 2015-11-05 Method and device for managing website login information Active CN106681992B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510745533.7A CN106681992B (en) 2015-11-05 2015-11-05 Method and device for managing website login information

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510745533.7A CN106681992B (en) 2015-11-05 2015-11-05 Method and device for managing website login information

Publications (2)

Publication Number Publication Date
CN106681992A true CN106681992A (en) 2017-05-17
CN106681992B CN106681992B (en) 2020-12-01

Family

ID=58857757

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510745533.7A Active CN106681992B (en) 2015-11-05 2015-11-05 Method and device for managing website login information

Country Status (1)

Country Link
CN (1) CN106681992B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110138719A (en) * 2019-03-05 2019-08-16 北京车和家信息技术有限公司 A kind of detection method of network security, device and electronic equipment
CN110968760A (en) * 2018-09-30 2020-04-07 北京国双科技有限公司 Webpage data crawling method and device, and webpage login method and device

Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101047504A (en) * 2006-03-29 2007-10-03 腾讯科技(深圳)有限公司 Network log-in authorization method and authorization system
CN102073678A (en) * 2010-12-03 2011-05-25 厦门市美亚柏科信息股份有限公司 System and method for analyzing information of websites
CN102214011A (en) * 2010-04-09 2011-10-12 北京搜狗科技发展有限公司 Method and device for initiating input method remote calculation request
CN103034632A (en) * 2011-09-29 2013-04-10 北京神州泰岳软件股份有限公司 Information transmitting method and a system
CN103179134A (en) * 2013-04-19 2013-06-26 中国建设银行股份有限公司 Single sign on method and system based on Cookie and application server thereof
CN203301755U (en) * 2013-04-18 2013-11-20 浙江金之路信息科技有限公司 Wireless network transmission and coverage apparatus based on multi-network integration technology
CN103457738A (en) * 2013-08-30 2013-12-18 优视科技有限公司 Method and system for login processing based on browser
CN103544193A (en) * 2012-07-17 2014-01-29 北京千橡网景科技发展有限公司 Method and apparatus for recognizing network robot
CN103744907A (en) * 2013-12-26 2014-04-23 三星电子(中国)研发中心 Information publishing method and device
CN103886248A (en) * 2014-04-08 2014-06-25 国家电网公司 Website weak password detecting method
CN103984719A (en) * 2014-05-12 2014-08-13 浪潮电子信息产业股份有限公司 Method for acquiring by using crawler to simulate login
CN104320309A (en) * 2014-11-17 2015-01-28 上海斐讯数据通信技术有限公司 Automatic testing system and method for automatic redial function
CN104811449A (en) * 2015-04-21 2015-07-29 深信服网络科技(深圳)有限公司 Base collision attack detecting method and system

Patent Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101047504A (en) * 2006-03-29 2007-10-03 腾讯科技(深圳)有限公司 Network log-in authorization method and authorization system
CN102214011A (en) * 2010-04-09 2011-10-12 北京搜狗科技发展有限公司 Method and device for initiating input method remote calculation request
CN102073678A (en) * 2010-12-03 2011-05-25 厦门市美亚柏科信息股份有限公司 System and method for analyzing information of websites
CN103034632A (en) * 2011-09-29 2013-04-10 北京神州泰岳软件股份有限公司 Information transmitting method and a system
CN103544193A (en) * 2012-07-17 2014-01-29 北京千橡网景科技发展有限公司 Method and apparatus for recognizing network robot
CN203301755U (en) * 2013-04-18 2013-11-20 浙江金之路信息科技有限公司 Wireless network transmission and coverage apparatus based on multi-network integration technology
CN103179134A (en) * 2013-04-19 2013-06-26 中国建设银行股份有限公司 Single sign on method and system based on Cookie and application server thereof
CN103457738A (en) * 2013-08-30 2013-12-18 优视科技有限公司 Method and system for login processing based on browser
CN103744907A (en) * 2013-12-26 2014-04-23 三星电子(中国)研发中心 Information publishing method and device
CN103886248A (en) * 2014-04-08 2014-06-25 国家电网公司 Website weak password detecting method
CN103984719A (en) * 2014-05-12 2014-08-13 浪潮电子信息产业股份有限公司 Method for acquiring by using crawler to simulate login
CN104320309A (en) * 2014-11-17 2015-01-28 上海斐讯数据通信技术有限公司 Automatic testing system and method for automatic redial function
CN104811449A (en) * 2015-04-21 2015-07-29 深信服网络科技(深圳)有限公司 Base collision attack detecting method and system

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110968760A (en) * 2018-09-30 2020-04-07 北京国双科技有限公司 Webpage data crawling method and device, and webpage login method and device
CN110138719A (en) * 2019-03-05 2019-08-16 北京车和家信息技术有限公司 A kind of detection method of network security, device and electronic equipment
CN110138719B (en) * 2019-03-05 2022-05-27 北京车和家信息技术有限公司 Network security detection method and device and electronic equipment

Also Published As

Publication number Publication date
CN106681992B (en) 2020-12-01

Similar Documents

Publication Publication Date Title
CN107241296B (en) Webshell detection method and device
CA2738290C (en) Exclusion of irrelevant data from a dom equivalence
CN104714878B (en) A kind of method and device of collector journal data
US20160092290A1 (en) Processing data errors for a data processing system
US10223287B2 (en) Method and system for cache management
WO2013020226A1 (en) Advanced statistical detection of emerging trends
CN107316176A (en) The control method and device of declaration form processing
JP2020113233A (en) Method and apparatus for detecting abnormal behavior of groupware user
CN109710224A (en) Page processing method, device, equipment and storage medium
CN106681992A (en) Method and device for managing website login information
CN106354587A (en) Mirror image server and method for exporting mirror image files of virtual machine
CN106648839A (en) Method and device for processing data
CN104166545B (en) The sniff method and device of a kind of web page resources
CN109446441B (en) General credible distributed acquisition and storage system for network community
US20100073374A1 (en) Calculating a webpage importance from a web browsing graph
CN107015986A (en) A kind of reptile crawls the method and device of webpage
CN108073703A (en) A kind of comment information acquisition methods, device, equipment and storage medium
CN103684823A (en) Weblog recording method, network access path determining method and related devices
CN107800683A (en) A kind of method and device for excavating malice IP
CN106611118B (en) Method and device for applying login credentials
CN115065558A (en) Attack flow tracing method and device for APT attack
CN106559278A (en) data processing state monitoring method and device
CN111125087A (en) Data storage method and device
CN112448855B (en) Method and system for updating block chain system parameters
CN113992378A (en) Safety monitoring method and device, electronic equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information

Address after: 100083 No. 401, 4th Floor, Haitai Building, 229 North Fourth Ring Road, Haidian District, Beijing

Applicant after: Beijing Guoshuang Technology Co.,Ltd.

Address before: 100086 Cuigong Hotel, 76 Zhichun Road, Shuangyushu District, Haidian District, Beijing

Applicant before: Beijing Guoshuang Technology Co.,Ltd.

CB02 Change of applicant information
GR01 Patent grant
GR01 Patent grant