CN107870861A - The concurrent testing method and application server of web page crawl - Google Patents
The concurrent testing method and application server of web page crawl Download PDFInfo
- Publication number
- CN107870861A CN107870861A CN201710933694.8A CN201710933694A CN107870861A CN 107870861 A CN107870861 A CN 107870861A CN 201710933694 A CN201710933694 A CN 201710933694A CN 107870861 A CN107870861 A CN 107870861A
- Authority
- CN
- China
- Prior art keywords
- abnormal information
- test
- web page
- user name
- identification code
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012360 testing method Methods 0.000 title claims abstract description 121
- 230000002159 abnormal effect Effects 0.000 claims abstract description 115
- 238000000034 method Methods 0.000 claims abstract description 70
- 230000008569 process Effects 0.000 claims abstract description 56
- 230000015654 memory Effects 0.000 claims description 21
- 238000012423 maintenance Methods 0.000 claims description 14
- 230000008439 repair process Effects 0.000 claims description 10
- 230000009193 crawling Effects 0.000 abstract description 8
- 230000010365 information processing Effects 0.000 abstract description 6
- 230000004807 localization Effects 0.000 abstract description 5
- 238000012545 processing Methods 0.000 description 10
- 238000004891 communication Methods 0.000 description 4
- 230000008859 change Effects 0.000 description 3
- 238000004590 computer program Methods 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000010354 integration Effects 0.000 description 2
- 238000010295 mobile communication Methods 0.000 description 2
- 230000006399 behavior Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000000151 deposition Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- PCHJSUWPFVWCPO-UHFFFAOYSA-N gold Chemical compound [Au] PCHJSUWPFVWCPO-UHFFFAOYSA-N 0.000 description 1
- 239000010931 gold Substances 0.000 description 1
- 229910052737 gold Inorganic materials 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000012549 training Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/362—Software debugging
- G06F11/3644—Software debugging by instrumenting at runtime
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/362—Software debugging
- G06F11/366—Software debugging using diagnostics
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3684—Test management for test design, e.g. generating new test cases
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention discloses a kind of concurrent testing method of web page crawl, methods described includes：Multiple test assignments are integrated into a test script；Run the test script and detect the abnormal information in test process；Intercepting process is carried out to the abnormal information；Obtain task ID corresponding to the abnormal information after intercepting process；And according to the task ID obtain corresponding to test assignment parameter.The present invention also provides a kind of application server.The concurrent testing method and application server of web page crawl provided by the invention, can be with quick search in the case where concurrently crawling task more, the system being likely to occur logs in mistake, and mistake can be quickly logged in the system and carries out localization process, and then cause financial system when crawled for multitask, information processing it is more perfect.
Description
Technical field
The present invention relates to communication technical field, more particularly to a kind of concurrent testing method of web page crawl and application service
Device.
Background technology
At present in financial system, it can go to crawl the various gold of user by crawlers in the case where user authorizes
Melt accounts information, such as the credit card information of the Credit Statement of mailbox, short message, common reserve fund information etc., and these information
Crawl, none need not carry out the input of user account and password.Once carry out in the case that multiple tasks crawl, may be due to
The difference of task is crawled, some input focus for crawling interface changes, and finally results in user name input error or leakage is defeated, enter
And cause to crawl mission failure, and the reason for can not effectively know the place and failure that appearance fails.
The content of the invention
In view of this, the present invention proposes a kind of concurrent testing method and application server of web page crawl, can check quickly soon
Ask the system being likely to occur in the case where concurrently crawling task more and log in mistake, and mistake quickly can be logged in the system
Carry out localization process by mistake, and then cause financial system when crawled for multitask, information processing it is more perfect.
First, to achieve the above object, the present invention proposes a kind of application server, and the application server includes storage
Device, processor, the concurrent test program for the web page crawl that can be run on the processor is stored with the memory, it is described
Following steps are realized when the concurrent test program of web page crawl is by the computing device：
Multiple test assignments are integrated into a test script；
Run the test script and detect the abnormal information in test process；
Intercepting process is carried out to the abnormal information；
Obtain task ID corresponding to the abnormal information after intercepting process；And
The parameter of test assignment according to corresponding to obtaining the task ID.
Alternatively, described the step of intercepting process is carried out to the abnormal information, specifically include：
The prompting message of abnormal information is intercepted, obtains the prompting message picture of abnormal information；And
Picture scanning is carried out to the picture of the prompting message of abnormal information, obtains the word in the picture of the prompting message
Content；And
The interface message for abnormal information occur is obtained by the prompting message picture of the abnormal information.
Alternatively, described the step of intercepting process is carried out to the abnormal information, specifically also include：
By being extracted to the word content, username and password is obtained；
Whether the user name for comparing acquisition is consistent with Standard User name；
When the user name of the acquisition is consistent with the Standard User name, then username good is judged；
When the user name and the inconsistent Standard User name of the acquisition, then user name mistake is judged；
To the password of acquisition by being multiplied by preset data group, identification code is obtained；
Judge whether the identification code is consistent with default identification code；
When the identification code is consistent with the default identification code, then judge that Password Input is correct；And
When the identification code and the inconsistent default identification code, then Password Input mistake is judged.
Alternatively, when the concurrent test program of the web page crawl is by the computing device, following steps are also realized：
The parameter of the test assignment is sent to system maintenance personnel, the system maintenance personnel appoint according to the test
The parameter of business and the interface message carry out repair process to system corresponding to the interface message.
In addition, to achieve the above object, the present invention also provides a kind of concurrent testing method of web page crawl, this method application
In application server, methods described includes：
Multiple test assignments are integrated into a test script；
Run the test script and detect the abnormal information in test process；
Intercepting process is carried out to the abnormal information；
Obtain task ID corresponding to the abnormal information after intercepting process；And
The parameter of test assignment according to corresponding to obtaining the task ID.
Alternatively, described the step of intercepting process is carried out to the abnormal information, specifically include：
The prompting message of abnormal information is intercepted, obtains the prompting message picture of abnormal information；And
Picture scanning is carried out to the picture of the prompting message of abnormal information, obtains the word in the picture of the prompting message
Content.
Alternatively, described the step of intercepting process is carried out to the abnormal information, specifically also include：
The interface message for abnormal information occur is obtained by the prompting message picture of the abnormal information.
Alternatively, described the step of intercepting process is carried out to the abnormal information, specifically also include：
By being extracted to the word content, username and password is obtained；
Whether the user name for comparing acquisition is consistent with Standard User name；
When the user name of the acquisition is consistent with the Standard User name, then username good is judged；
When the user name and the inconsistent Standard User name of the acquisition, then user name mistake is judged；
To the password of acquisition by being multiplied by preset data group, identification code is obtained；
Judge whether the identification code is consistent with default identification code；
When the identification code is consistent with the default identification code, then judge that Password Input is correct；And
When the identification code and the inconsistent default identification code, then Password Input mistake is judged.
Alternatively, the concurrent testing method of the web page crawl also includes：
The parameter of the test assignment is sent to system maintenance personnel, the system maintenance personnel appoint according to the test
The parameter of business and the interface message carry out repair process to system corresponding to the interface message.
Further, to achieve the above object, the present invention also provides a kind of computer-readable recording medium, the computer
Readable storage medium storing program for executing is stored with the concurrent test program of web page crawl, and the concurrent test program of the web page crawl can be by least one
Individual computing device, so that the step of concurrent testing method of at least one computing device web page crawl described above.
Compared to prior art, application server proposed by the invention, the concurrent testing method of web page crawl and calculating
Machine readable storage medium storing program for executing, first, multiple test assignments are integrated into a test script；Secondly, the test script is run simultaneously
Detect the abnormal information in test process；Again, intercepting process is carried out to the abnormal information；Then, after obtaining intercepting process
Abnormal information corresponding to task ID；Finally, according to the task ID obtain corresponding to test assignment parameter.So, can be with
The system that quick search is likely to occur in the case where concurrently crawling task more logs in mistake, and can be quickly to the system
Log in mistake and carry out localization process, and then cause financial system when crawled for multitask, information processing it is more perfect.
Brief description of the drawings
Fig. 1 is the schematic diagram of one optional hardware structure of application server；
Fig. 2 is the Program modual graph of the concurrent test program first embodiment of web page crawl of the present invention；
Fig. 3 is the Program modual graph of the concurrent test program second embodiment of web page crawl of the present invention；
Fig. 4 is the flow chart of the concurrent testing method first embodiment of web page crawl of the present invention；
Fig. 5 is the flow chart of the concurrent testing method second embodiment of web page crawl of the present invention；
Fig. 6 is the flow chart of the concurrent testing method 3rd embodiment of web page crawl of the present invention；
Fig. 7 is the flow chart of the concurrent testing method fourth embodiment of web page crawl of the present invention.
Reference：
The realization, functional characteristics and advantage of the object of the invention will be described further referring to the drawings in conjunction with the embodiments.
Embodiment
In order to make the purpose , technical scheme and advantage of the present invention be clearer, it is right below in conjunction with drawings and Examples
The present invention is further elaborated.It should be appreciated that specific embodiment described herein is only to explain the present invention, not
For limiting the present invention.Based on the embodiment in the present invention, those of ordinary skill in the art are not before creative work is made
The every other embodiment obtained is put, belongs to the scope of protection of the invention.
It should be noted that the description for being related to " first ", " second " etc. in the present invention is only used for describing purpose, and can not
It is interpreted as indicating or implies its relative importance or imply the quantity of the technical characteristic indicated by indicating.Thus, define " the
One ", at least one this feature can be expressed or be implicitly included to the feature of " second ".In addition, the skill between each embodiment
Art scheme can be combined with each other, but must can be implemented as basis with those of ordinary skill in the art, when technical scheme
With reference to occurring conflicting or will be understood that the combination of this technical scheme is not present when can not realize, also not in application claims
Protection domain within.
As shown in fig.1, it is the schematic diagram of 1 one optional hardware structure of application server.
The application server 1 can be rack-mount server, blade server, tower server or cabinet-type service
The computing devices such as device, the application server 1 can be the servers that independent server or multiple servers are formed
Cluster.
In the present embodiment, the application server 1 may include, but be not limited only to, and company can be in communication with each other by system bus
Connect memory 11, processor 12, network interface 13.
The application server 1 connects network by network interface 13, obtains information.The network can be enterprises
Net (Intranet), internet (Internet), global system for mobile communications (Global System of Mobile
Communication, GSM), WCDMA (Wideband Code Division Multiple Access,
WCDMA), the wirelessly or non-wirelessly network such as 4G networks, 5G networks, bluetooth (Bluetooth), Wi-Fi, speech path network.
It is pointed out that Fig. 1 illustrate only the application server 1 with component 11-13, it should be understood that simultaneously
All components shown realistic are not applied, the more or less component of the implementation that can be substituted.
Wherein, the memory 11 comprises at least a type of readable storage medium storing program for executing, and the readable storage medium storing program for executing includes
Flash memory, hard disk, multimedia card, card-type memory (for example, SD or DX memories etc.), random access storage device (RAM), it is static with
Machine access memory (SRAM), read-only storage (ROM), Electrically Erasable Read Only Memory (EEPROM), it is programmable only
Read memory (PROM), magnetic storage, disk, CD etc..In certain embodiments, the memory 11 can be described answers
With the hard disk or internal memory of the internal storage unit of server 1, such as the application server 1.In further embodiments, it is described to deposit
Reservoir 11 can also be the External memory equipment of the application server 1, such as the plug-in type that the application server 1 is equipped with is hard
Disk, intelligent memory card (Smart Media Card, SMC), secure digital (Secure Digital, SD) card, flash card
(Flash Card) etc..Certainly, the memory 11 can also both include the internal storage unit of the application server 1 or wrap
Include its External memory equipment.In the present embodiment, the memory 11 is generally used for the behaviour that storage is installed on the application server 1
Make system and types of applications software, such as program code of concurrent test program 200 of the web page crawl etc..It is in addition, described
Memory 11 can be also used for temporarily storing the Various types of data that has exported or will export.
The processor 12 can be in certain embodiments central processing unit (Central Processing Unit,
CPU), controller, microcontroller, microprocessor or other data processing chips.The processor 12 is generally used for should described in control
With the overall operation of server 1, such as execution data interaction or the control of communication correlation and processing etc..In the present embodiment, institute
State processor 12 to be used to run the program code stored in the memory 11 or processing data, such as run described webpage
Concurrent test program 200 crawled etc..
The network interface 13 may include radio network interface or wired network interface, and the network interface 13 is generally used for
Communication connection is established between the application server 1 and other electronic equipments.
In the present embodiment, installed in the application server 1 and run the concurrent test program 200 of web page crawl, when
When the concurrent test program 200 of the web page crawl is run, multiple test assignments are integrated into a survey by the application server 1
Training sheet；Run the test script and detect the abnormal information in test process；Intercepting process is carried out to the abnormal information；
Obtain task ID corresponding to the abnormal information after intercepting process；The parameter of test assignment according to corresponding to obtaining the task ID.
So, mistake can be logged in the system that quick search is likely to occur in the case where concurrently crawling task more, and can be quick
When mistake is logged in the system and carries out localization process, and then make it that financial system crawls for multitask, information processing
It is more perfect.
So far, oneself is through describing the hardware configuration and function of the relevant device of each embodiment of the present invention in detail.Below, will
Based on above-mentioned application environment and relevant device, each embodiment of the invention is proposed.
First, the present invention proposes a kind of concurrent test program 200 of web page crawl.
As shown in fig.2, it is the Program modual graph of the first embodiment of concurrent test program 200 of web page crawl of the present invention.
In the present embodiment, the concurrent test program 200 of described web page crawl is stored in memory 11 including a series of
On computer program instructions, when the computer program instructions are performed by processor 12, it is possible to achieve various embodiments of the present invention
Web page crawl concurrent test operation.In certain embodiments, the spy realized based on the computer program instructions each several part
Fixed operation, the concurrent test program 200 of web page crawl can be divided into one or more modules.For example, in fig. 2, institute
The concurrent test program 200 for the web page crawl stated can be divided into integration module 201, detecting module 202, interception module 203
And acquisition module 204.Wherein：
The integration module 201, for multiple test assignments to be integrated into a test script.
The detecting module 202, for running the test script and detecting the abnormal information in test process.
The interception module 203, the abnormal information for being detected to the detecting module 202 carry out intercepting process.This reality
Apply in example, the abnormal information is that financial system logs in failure information.In the present embodiment, the financial system, which logs in, unsuccessfully believes
Breath is probably failure information caused by user name input error, it is also possible to failure information caused by Password Input mistake, no matter
Which kind of failure information, finally result in the logon operation failure that some interface is accessed during test assignment.
Specifically, the interception module 203, is intercepted to the prompting message of abnormal information, obtains carrying for abnormal information
Show message frame.In the present embodiment, the interception module 203, obtained and occurred by the prompting message picture of the abnormal information
The interface message of abnormal information.So, the interface message for occurring abnormal information by obtaining may determine that and be crawled in multitask
During, occur abnormal information position where, and then repair process when facilitating the follow-up system to improve.
Further, the interception module 203, picture scanning also is carried out to the picture of the prompting message of abnormal information, obtained
Take the word content in the picture of the prompting message.
Further, in the present embodiment, the interception module 203, by being extracted to the word content, obtain and use
Name in an account book and password, whether then, it is consistent with Standard User name to compare the user name of acquisition, abnormal to judge whether to occur.Wherein,
It is as follows to the determination methods of user name：Standard User name is pre-set by administrative staff, for example, formed for 13 characters, or
Cell-phone number is formed, specific to set rule basis to be actually needed setting.User name and the Standard User name when the acquisition
Unanimously, then username good is judged；Conversely, when the user name of the acquisition and the Standard User name are inconsistent, then judgement is used
Name in an account book mistake.In addition, as follows to the determination methods of password：The interception module 203, to the password of acquisition by being multiplied by present count
According to group, identification code is obtained.Further, the interception module 203 judges whether the identification code is consistent with default identification code.If
The identification code is consistent with the default identification code, then judges that Password Input is correct.Conversely, when the identification code is preset with described
Identification code is inconsistent, then judges Password Input mistake.
The acquisition module 204, for obtaining task identification number corresponding to the abnormal information after intercepting process
(identifier, ID), and according to the task ID obtain corresponding to test assignment parameter.In the present embodiment, obtain each
The sign number of task, when system occur in the case of concurrently crawling task more and logging in mistake, can clearly it be gone out by sign number
Now abnormal test assignment, and the parameter of corresponding test assignment can be accurately obtained, the time is saved, improves efficiency.
By said procedure module 201-204, the concurrent test program 200 of web page crawl proposed by the invention, first,
Multiple test assignments are integrated into a test script；Secondly, run the test script and detect the exception in test process
Information；Again, intercepting process is carried out to the abnormal information；Then, task corresponding to the abnormal information after intercepting process is obtained
ID；Finally, according to the task ID obtain corresponding to test assignment parameter.So, can concurrently crawled more with quick search
The system being likely to occur in the case of task logs in mistake, and quickly can log in mistake to the system and carry out at positioning
Reason, and then cause financial system when crawled for multitask, information processing it is more perfect.
Further, the above-mentioned first embodiment of the concurrent test program 200 based on web page crawl of the present invention, proposes this hair
Bright second embodiment (as shown in Figure 3).In the present embodiment, the concurrent test program 200 of described web page crawl also includes depositing
Store up module 205 and sending module 206.
In the present embodiment, after task ID corresponding to the abnormal information after the acquisition module 204 obtains intercepting process, institute
Memory module 205 is stated to be used to corresponding task ID be stored the abnormal information in pairs.That is, established in database different
The mapping table of normal information and task ID, so, by the way that abnormal information and task ID are associated, you can passed through with realizing
Abnormal information directly obtains associated task.It is more efficient to obtain abnormal information, it is time saving.
The sending module 206, the parameter of the test assignment for the acquisition module 204 to be obtained are sent to system dimension
Shield personnel.The system maintenance personnel are according to the parameter and the interface message of the test assignment to the interface message pair
The system answered carries out repair process.Wherein, the parameter (or abnormal information) of the test assignment acquisition module 204 obtained
The form for being sent to system maintenance personnel can be the form of mail or the form of short message.For further at saving
Manage the time, the abnormal information that the sending module 206 is sent, which can include, occurs abnormal test assignment ID, and abnormal time is different
Normal reason.Classification setting can also be carried out to receiving abnormal system maintenance personnel in addition, to handle exception faster.It is described
Classification setting can be first order director (system is directly responsible for people), second level director (director upper-level leader), the 3rd
Level director (director's highest supervisor).For example, in 15 minutes ought occurred extremely, the system of being sent to is directly responsible for people.When different
It is also untreated after often occurring 1 hour, abnormal information is sent to second level director (director upper-level leader).When abnormal generation
It is also untreated after 2 hours, abnormal information is sent to third level director (director's highest supervisor).By the management of level,
So as to the quick processing of exception.
By said procedure module 201-206, the concurrent test program 200 of web page crawl proposed by the invention can lead to
The abnormal progress level processing that appearance is crawled to multitask is crossed, improves treatment effeciency.
In addition, the present invention also proposes a kind of concurrent testing method of web page crawl.
As shown in fig.4, it is the flow chart of the concurrent testing method first embodiment of web page crawl of the present invention.In this implementation
In example, according to different demands, the execution sequence of the step in flow chart shown in Fig. 4 can change, and some steps can save
Slightly.
Step S401, multiple test assignments are integrated into a test script.Under normal circumstances, multiple information crawlers are had
Test assignment performing, multiple test assignments are integrated under a test script, be advantageous to test focus on and supervise
Control.
Step S402, run the test script and detect the abnormal information in test process.It is described different in the present embodiment
Normal information is that financial system logs in failure information.
Step S403, intercepting process is carried out to the abnormal information.In the present embodiment, the financial system logs in failure
Information is probably failure information caused by user name input error, it is also possible to failure information caused by Password Input mistake, nothing
By which kind of failure information, the logon operation failure that some interface is accessed during test assignment is finally resulted in.Specifically, institute
The specific steps that intercepting process is carried out to the abnormal information are stated, by the 3rd embodiment of database update method of the present invention
(referring to Fig. 6) and fourth embodiment (referring to Fig. 7) are described in detail.
Step S404, obtain task identification number (identifier, ID) corresponding to the abnormal information after intercepting process.
Step S405, the parameter of test assignment according to corresponding to obtaining the task ID.In the present embodiment, each appoint is obtained
The sign number of business, when system occur in the case of concurrently crawling task more and logging in mistake, can clearly occur by sign number
Abnormal test assignment, and the parameter of corresponding test assignment can be accurately obtained, the time is saved, improves efficiency.
By above-mentioned steps S401-405, the concurrent testing method of web page crawl proposed by the invention first, will be multiple
Test assignment is integrated into a test script；Secondly, run the test script and detect the abnormal information in test process；Again
It is secondary, intercepting process is carried out to the abnormal information；Then, task ID corresponding to the abnormal information after intercepting process is obtained；Finally,
The parameter of test assignment according to corresponding to obtaining the task ID.This way it is possible to avoid the difference due to crawling task, some is climbed
Take the input focus of interface to change, finally result in user name input error or leakage is defeated, and then cause to crawl mission failure, and
And the drawbacks of the reason for can not effectively knowing the local and failure that appearance fails, task can concurrently crawled with quick search more
In the case of the system that is likely to occur log in mistake, and mistake can be quickly logged in the system and carries out localization process, entered
And cause financial system when crawled for multitask, information processing it is more perfect.
As shown in figure 5, it is the flow chart of the second embodiment of the concurrent testing method of web page crawl of the present invention.In this implementation
In example, according to different demands, the execution sequence of the step in flow chart shown in Fig. 5 can change, and some steps can save
Slightly.
Step S501, multiple test assignments are integrated into a test script.
Step S502, run the test script and detect the abnormal information in test process.
Step S503, intercepting process is carried out to the abnormal information.
In the present embodiment, the abnormal information is that financial system logs in failure information.In the present embodiment, the Faculty of Finance
It is probably failure information caused by user name input error that system, which logs in failure information, it is also possible to is lost caused by Password Input mistake
Lose information, no matter which kind of failure information, finally result in the logon operation failure that some interface is accessed during test assignment.
Step S504, obtain task ID corresponding to the abnormal information after intercepting process.
Step S505, the abnormal information is stored in pairs with corresponding task ID.
Step S506, the parameter of test assignment according to corresponding to obtaining the task ID.
Step S507, the parameter of the test assignment is sent to system maintenance personnel.The system maintenance personnel according to
The parameter of the test assignment and the interface message carry out repair process to system corresponding to the interface message.The system
System attendant is carried out according to the parameter of the test assignment and the interface message to system corresponding to the interface message
Repair process.Wherein, the parameter (or abnormal information) of the test assignment of acquisition is sent to system dimension by the application server 1
The form of shield personnel can be the form of mail or the form of short message.It is described to answer further to save processing time
The abnormal information sent with server 1, which can include, occurs abnormal test assignment ID, abnormal time, abnormal cause.It is right in addition
Classification setting can also be carried out by receiving abnormal system maintenance personnel, to handle exception faster.The classification setting can be with
It is first order director (system is directly responsible for people), second level director (director upper-level leader), third level director (is responsible for
People's highest is responsible for).For example, in 15 minutes ought occurred extremely, the system of being sent to is directly responsible for people.After when generation 1 is small extremely
It is also untreated, abnormal information is sent to second level director (director upper-level leader).Do not locate also after when generation 2 is small extremely
Reason, third level director (director's highest supervisor) is sent to by abnormal information.It is quick so as to exception by the management of level
Processing.
By above-mentioned steps S501-S507, the concurrent testing method of web page crawl proposed by the invention can be by right
Multitask crawls the abnormal of appearance and carries out level processing, improves treatment effeciency..
As shown in fig. 6, it is the flow chart of the 3rd embodiment of the concurrent testing method of web page crawl of the present invention.The present embodiment
In, described the step of intercepting process is carried out to the abnormal information, specifically include：
Step S601, the prompting message of abnormal information is intercepted, obtain the prompting message picture of abnormal information.
Step S602, picture scanning is carried out to the picture of the prompting message of abnormal information, obtains the picture of the prompting message
Word content in face.
Step S603, the interface message for abnormal information occur is obtained by the prompting message picture of the abnormal information.This
Sample, it may determine that during multitask crawls abnormal information occur by obtaining the interface message for abnormal information occur
Position where, and then repair process when facilitating the follow-up system to improve.
By above-mentioned steps S601-S603, the concurrent testing method of web page crawl proposed by the invention can be by obtaining
The interface message for taking out existing abnormal information may determine that during multitask crawls the position of abnormal information occur at which
In, and then repair process when facilitating the follow-up system to improve.
Further, the 3rd embodiment of the concurrent testing method based on web page crawl of the present invention, proposes webpage of the present invention
The fourth embodiment of the concurrent testing method crawled.
As shown in fig. 7, it is the flow chart of the fourth embodiment of the concurrent testing method of web page crawl of the present invention.The present embodiment
In, described the step of intercepting process is carried out to the abnormal information, specifically also include：
Step S701, by being extracted to the word content, obtain username and password.
Whether step S702, the user name for comparing acquisition are consistent with Standard User name.When the user name and standard of acquisition are used
When name in an account book is consistent, step S703 is performed, conversely, when the user name and inconsistent Standard User name of acquisition, performs step S704.
Step S703, judges username good.
Step S704, judge user name mistake；
Step S705, to the password of acquisition by being multiplied by preset data group, obtain identification code.
Step S706, judge whether the identification code is consistent with default identification code.When the identification code and the pre- bidding
It is consistent to know code, performs step S707, conversely, when the identification code and the inconsistent default identification code, performs step S708.
Step S707, judge that Password Input is correct.
Step S708, judge Password Input mistake.
In the present embodiment, the application server 1 obtains user name and close by being extracted to the word content
Code, whether then, it is consistent with Standard User name to compare the user name of acquisition, abnormal to judge whether to occur.Wherein, to user name
Determination methods it is as follows：Standard User name is pre-set by administrative staff, for example, formed for 13 characters, or cell-phone number structure
Into specific setting rule basis is actually needed setting.When the user name of the acquisition is consistent with the Standard User name, then sentence
Disconnected username good；Conversely, when the user name of the acquisition and the Standard User name are inconsistent, then user name mistake is judged.
In addition, as follows to the determination methods of password：The application server 1, to the password of acquisition by being multiplied by preset data group, obtain
Identification code.Further, the application server 1 judges whether the identification code is consistent with default identification code.If the mark
Code is consistent with the default identification code, then judges that Password Input is correct.Conversely, work as the identification code and the default identification code not
Unanimously, then Password Input mistake is judged.
By above-mentioned steps S701-S708, the concurrent testing method of web page crawl proposed by the invention can be to exception
Information carries out intercepting process, and whether quick judgement crawls abnormal.
The embodiments of the present invention are for illustration only, do not represent the quality of embodiment.
Through the above description of the embodiments, those skilled in the art can be understood that above-described embodiment side
Method can add the mode of required general hardware platform to realize by software, naturally it is also possible to by hardware, but in many cases
The former is more preferably embodiment.Based on such understanding, technical scheme is substantially done to prior art in other words
Going out the part of contribution can be embodied in the form of software product, and the computer software product is stored in a storage medium
In (such as ROM/RAM, magnetic disc, CD), including some instructions to cause a station terminal equipment (can be mobile phone, computer, clothes
Be engaged in device, air conditioner, or network equipment etc.) perform method described in each embodiment of the present invention.
The preferred embodiments of the present invention are these are only, are not intended to limit the scope of the invention, it is every to utilize this hair
The equivalent structure or equivalent flow conversion that bright specification and accompanying drawing content are made, or directly or indirectly it is used in other related skills
Art field, is included within the scope of the present invention.
Claims (10)
- A kind of 1. concurrent testing method of web page crawl, applied to application server, it is characterised in that methods described includes：Multiple test assignments are integrated into a test script；Run the test script and detect the abnormal information in test process；Intercepting process is carried out to the abnormal information；Obtain task ID corresponding to the abnormal information after intercepting process；AndThe parameter of test assignment according to corresponding to obtaining the task ID.
- 2. the concurrent testing method of web page crawl as claimed in claim 1, it is characterised in that described to enter to the abnormal information The step of row intercepting process, specifically include：The prompting message of abnormal information is intercepted, obtains the prompting message picture of abnormal information；AndPicture scanning is carried out to the picture of the prompting message of abnormal information, obtained in the word in the picture of the prompting message Hold.
- 3. the concurrent testing method of web page crawl as claimed in claim 2, it is characterised in that described to enter to the abnormal information The step of row intercepting process, specifically also include：The interface message for abnormal information occur is obtained by the prompting message picture of the abnormal information.
- 4. the concurrent testing method of web page crawl as claimed in claim 2, it is characterised in that described to enter to the abnormal information The step of row intercepting process, specifically also include：By being extracted to the word content, username and password is obtained；Whether the user name for comparing acquisition is consistent with Standard User name；When the user name of the acquisition is consistent with the Standard User name, then username good is judged；When the user name and the inconsistent Standard User name of the acquisition, then user name mistake is judged；To the password of acquisition by being multiplied by preset data group, identification code is obtained；Judge whether the identification code is consistent with default identification code；When the identification code is consistent with the default identification code, then judge that Password Input is correct；AndWhen the identification code and the inconsistent default identification code, then Password Input mistake is judged.
- 5. the concurrent testing method of web page crawl as claimed in claim 3, it is characterised in that methods described also includes：The parameter of the test assignment is sent to system maintenance personnel, the system maintenance personnel are according to the test assignment Parameter and the interface message carry out repair process to system corresponding to the interface message.
- 6. a kind of application server, it is characterised in that the application server includes memory, processor, on the memory It is stored with the concurrent test program for the web page crawl that can be run on the processor, the concurrent test program of the web page crawl Following steps are realized during by the computing device：Multiple test assignments are integrated into a test script；Run the test script and detect the abnormal information in test process；Intercepting process is carried out to the abnormal information；Obtain task ID corresponding to the abnormal information after intercepting process；AndThe parameter of test assignment according to corresponding to obtaining the task ID.
- 7. application server as claimed in claim 6, it is characterised in that described that intercepting process is carried out to the abnormal information Step, specifically include：The prompting message of abnormal information is intercepted, obtains the prompting message picture of abnormal information；AndPicture scanning is carried out to the picture of the prompting message of abnormal information, obtained in the word in the picture of the prompting message Hold；AndThe interface message for abnormal information occur is obtained by the prompting message picture of the abnormal information.
- 8. the concurrent testing method of web page crawl as claimed in claim 7, it is characterised in that described to enter to the abnormal information The step of row intercepting process, specifically also include：By being extracted to the word content, username and password is obtained；Whether the user name for comparing acquisition is consistent with Standard User name；When the user name of the acquisition is consistent with the Standard User name, then username good is judged；When the user name and the inconsistent Standard User name of the acquisition, then user name mistake is judged；To the password of acquisition by being multiplied by preset data group, identification code is obtained；Judge whether the identification code is consistent with default identification code；When the identification code is consistent with the default identification code, then judge that Password Input is correct；AndWhen the identification code and the inconsistent default identification code, then Password Input mistake is judged.
- 9. application server as claimed in claim 6, it is characterised in that the concurrent test program of the web page crawl is described During computing device, following steps are also realized：The parameter of the test assignment is sent to system maintenance personnel, the system maintenance personnel are according to the test assignment Parameter and the interface message carry out repair process to system corresponding to the interface message.
- 10. a kind of computer-readable recording medium, the computer-readable recording medium storage has the concurrent test of web page crawl Program, the concurrent test program of the web page crawl can be by least one computing device, so that at least one processor The step of performing the concurrent testing method of the web page crawl as any one of claim 1-5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710933694.8A CN107870861A (en) | 2017-10-10 | 2017-10-10 | The concurrent testing method and application server of web page crawl |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710933694.8A CN107870861A (en) | 2017-10-10 | 2017-10-10 | The concurrent testing method and application server of web page crawl |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107870861A true CN107870861A (en) | 2018-04-03 |
Family
ID=61752744
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710933694.8A Pending CN107870861A (en) | 2017-10-10 | 2017-10-10 | The concurrent testing method and application server of web page crawl |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107870861A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110659870A (en) * | 2019-08-14 | 2020-01-07 | 平安普惠企业管理有限公司 | Business audit test method, device, equipment and storage medium |
| CN110968755A (en) * | 2018-09-29 | 2020-04-07 | 北京国双科技有限公司 | Method and device for crawling data |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103605764A (en) * | 2013-11-26 | 2014-02-26 | Tcl集团股份有限公司 | Web crawler system and web crawler multitask executing and scheduling method |
| CN103942309A (en) * | 2014-04-18 | 2014-07-23 | 乐得科技有限公司 | Network data acquisition device and method and implementation method of acquisition process |
| US20150347270A1 (en) * | 2014-05-28 | 2015-12-03 | National Central University | Automatic test system and test method for computer, record medium, and program product |
| CN105243017A (en) * | 2015-10-20 | 2016-01-13 | 上海斐讯数据通信技术有限公司 | Test method and system capable of carrying out login authentication on the basis of SSH (Secure Shell) protocol |
| CN106126648A (en) * | 2016-06-23 | 2016-11-16 | 华南理工大学 | A kind of based on the distributed merchandise news reptile method redo log |
| CN106296429A (en) * | 2016-08-31 | 2017-01-04 | 哈尔滨工业大学（威海） | A kind of intelligent test method for social network sites |
| US20170060577A1 (en) * | 2014-06-25 | 2017-03-02 | Hewlett Packard Enterprise Development Lp | Documentation notification |
-
2017
- 2017-10-10 CN CN201710933694.8A patent/CN107870861A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103605764A (en) * | 2013-11-26 | 2014-02-26 | Tcl集团股份有限公司 | Web crawler system and web crawler multitask executing and scheduling method |
| CN103942309A (en) * | 2014-04-18 | 2014-07-23 | 乐得科技有限公司 | Network data acquisition device and method and implementation method of acquisition process |
| US20150347270A1 (en) * | 2014-05-28 | 2015-12-03 | National Central University | Automatic test system and test method for computer, record medium, and program product |
| US20170060577A1 (en) * | 2014-06-25 | 2017-03-02 | Hewlett Packard Enterprise Development Lp | Documentation notification |
| CN105243017A (en) * | 2015-10-20 | 2016-01-13 | 上海斐讯数据通信技术有限公司 | Test method and system capable of carrying out login authentication on the basis of SSH (Secure Shell) protocol |
| CN106126648A (en) * | 2016-06-23 | 2016-11-16 | 华南理工大学 | A kind of based on the distributed merchandise news reptile method redo log |
| CN106296429A (en) * | 2016-08-31 | 2017-01-04 | 哈尔滨工业大学（威海） | A kind of intelligent test method for social network sites |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110968755A (en) * | 2018-09-29 | 2020-04-07 | 北京国双科技有限公司 | Method and device for crawling data |
| CN110659870A (en) * | 2019-08-14 | 2020-01-07 | 平安普惠企业管理有限公司 | Business audit test method, device, equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110348239B (en) | Desensitization rule configuration method, data desensitization method, system and computer equipment | |
| ES2808954T3 (en) | Procedure and device for use in risk management of application information | |
| CN107871083A (en) | Desensitize regular collocation method, application server and computer-readable recording medium | |
| CN108805697A (en) | Loan transaction processing method and device, computer equipment and readable storage medium | |
| CN106599713A (en) | Database masking system and method based on big data | |
| CN108428099A (en) | Field personnel staff attendance management-control method, application server and computer readable storage medium | |
| CN108171069A (en) | Desensitization method, application server and computer readable storage medium | |
| CN107871086A (en) | Sensitive information screen method, application server and computer-readable recording medium | |
| CN105516133A (en) | User identity verification method, server and client | |
| CN105827577A (en) | Method and device for information verification | |
| CN107909486A (en) | Commission management method, application server and computer-readable recording medium | |
| CN108038655A (en) | Recommendation method, application server and the computer-readable recording medium of department's demand | |
| CN109447384A (en) | Verification method, device, equipment and the storage medium of air control system | |
| CN106470109A (en) | A kind of personal identification method and equipment | |
| CN104836777B (en) | Identity verification method and system | |
| CN107545637A (en) | The Activiation method and server of a kind of electronic lock | |
| CN107689941A (en) | A kind of apparatus and method for preventing same user's repeat logon | |
| CN108170551A (en) | Front and back end error handling method, server and storage medium based on crawler system | |
| CN107872440A (en) | Identification authentication methods, devices and systems | |
| CN108512664A (en) | Login method of attending a banquet, electronic device and storage medium based on Application on Voiceprint Recognition | |
| CN107870861A (en) | The concurrent testing method and application server of web page crawl | |
| CN108153663B (en) | Page data processing method and device | |
| CN106559386A (en) | A kind of authentication method and device | |
| CN112561690B (en) | Method, system, equipment and storage medium for testing credit card staged service interface | |
| US7962789B2 (en) | Method and apparatus for automated testing of a utility computing system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20180530 Address after: 518000 Room 201, building A, No. 1, Qian Wan Road, Qianhai Shenzhen Hong Kong cooperation zone, Shenzhen, Guangdong (Shenzhen Qianhai business secretary Co., Ltd.) Applicant after: ONECONNECT FINANCIAL TECHNOLOGY Co.,Ltd. (SHANGHAI) Address before: 200030 Xuhui District, Shanghai Kai Bin Road 166, 9, 10 level. Applicant before: ONECONNECT FINANCIAL TECHNOLOGY Co.,Ltd. (SHANGHAI) |
|
| TA01 | Transfer of patent application right | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| AD01 | Patent right deemed abandoned |
Effective date of abandoning: 20240130 |
|
| AD01 | Patent right deemed abandoned |