CN105095464B - A kind of detection method and device of searching system - Google Patents
A kind of detection method and device of searching system Download PDFInfo
- Publication number
- CN105095464B CN105095464B CN201510461502.9A CN201510461502A CN105095464B CN 105095464 B CN105095464 B CN 105095464B CN 201510461502 A CN201510461502 A CN 201510461502A CN 105095464 B CN105095464 B CN 105095464B
- Authority
- CN
- China
- Prior art keywords
- search result
- result
- searching system
- retrieval
- sequence
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2453—Query optimisation
Abstract
The invention discloses a kind of detection methods of searching system.The described method includes: obtaining and comparing the first search result and the second search result that retrieve respectively in the first searching system and the second searching system according to keyword sample；If first search result and second search result are inconsistent, second search result and the reference retrieval result preset for keyword sample are further compared；If second search result and the reference retrieval result are inconsistent, second searching system is corrected according to the second search result type of error.The accuracy of searching system detection can be promoted according to the present invention.
Description
Technical field
The present invention relates to communication technique fields, examine more particularly to a kind of searching system detection method and a kind of searching system
Survey device.
Background technique
With the development of communication technologies, people rely on retrieval service to search information, retrieval service provider more and more
In order to meet the increasing requirement to retrieval service of user, especially to the requirement in terms of the accuracy of search result, need
Upgrading update often is carried out to searching system, in order to which searching system can provide more accurate retrieval service.
To searching system upgrading update after, mode usually manually go detection upgrade after searching system relative to
Whether the search result that old searching system provides is more acurrate, and specific operation usually manually determines several popular terms
It converges or emphasis retrieval vocabulary is as keyword, be utilized respectively new version of the keyword after the searching system and upgrading of legacy version
Searching system is retrieved, the accuracy of the search result of artificial contrast's two systems.
However the method for existing searching system detection, the search result that new version searching system provides is examined than legacy version
Whether the search result that cable system provides is more acurrate, and dependent on artificial subjective judgement, judging result is not objective, therefore causes
The whether optimised problem of new version searching system after being unable to judge accurately upgrading.
Summary of the invention
In view of the above problems, it proposes on the present invention overcomes the above problem or at least be partially solved in order to provide one kind
State the searching system detection method and a kind of corresponding searching system detection device of problem.
According to one aspect of the present invention, a kind of searching system detection method is provided, comprising:
It obtains and compares first retrieved respectively in the first searching system and the second searching system according to keyword sample
Search result and the second search result；
If first search result and second search result are inconsistent, the second retrieval knot is further compared
Fruit and the reference retrieval result preset for keyword sample；
If second search result and the reference retrieval result are inconsistent, according to the second search result type of error
Correct second searching system.
Optionally, described to obtain and compare according to keyword sample respectively in the first searching system and the inspection of the second searching system
Rope to the first search result and the second search result the step of include:
Compare sequence of the target retrieval result in first search result and the row in second search result
Sequence.
Optionally, if first search result and second search result are inconsistent, institute is further compared
The second search result, which is stated, with for the step of reference retrieval result made by keyword sample includes:
If the target retrieval result sorting and in second search result in first search result
It sorts inconsistent, then further compares sequence of the target retrieval result in second search result and in the reference
Sequence in search result.
Optionally, if second search result and the reference retrieval result are inconsistent, according to the second retrieval
As a result type of error corrects the step of second searching system specifically:
If the target retrieval result sorting and in the reference retrieval result in second search result
It sorts inconsistent, then second searching system is corrected according to the second search result type of error.
Optionally, if second search result and the reference retrieval result are inconsistent, according to the second retrieval
As a result the step of type of error amendment second searching system includes:
Obtain the third search result retrieved according to the keyword sample in third searching system；
Using the third search result as the reference retrieval result.
Optionally, it if second search result and the reference retrieval result are inconsistent, is tied according to the second retrieval
Fruit type of error correct second searching system the step of include:
Judge the keyword sample respectively in first searching system and in the keyword of second searching system
Whether classification information is consistent, if inconsistent, the second search result type of error is identified as keyword classification mistake；
Update keyword categories information of the keyword sample in second searching system.
Optionally, it if second search result and the reference retrieval result are inconsistent, is tied according to the second retrieval
Fruit type of error correct second searching system the step of include:
If whether target retrieval result, which is present in first search result, may be not present in second search result,
The second search result type of error is identified as target retrieval result gaps and omissions mistake；
The corresponding relationship of the target retrieval result and the keyword sample is added to second searching system.
Optionally, it if second search result and the reference retrieval result are inconsistent, is tied according to the second retrieval
Fruit type of error correct second searching system the step of include:
According to sequence of the target retrieval result in second search result and the row in the reference retrieval result
Sequence is inconsistent, and the second search result type of error is identified as search result misordering；
Using sequence of the target retrieval result in the reference retrieval result as the target retrieval result in institute
State the sequence in the second search result.
Optionally, the method also includes:
The keyword categories information of the keyword sample is obtained by internet；
The keyword categories information that will acquire corresponds to the keyword sample and is added to second searching system.
Optionally, the method also includes:
It counts the retrieval frequency of the keyword sample and adds corresponding detection priority tag.
According to another aspect of the present invention, a kind of searching system detection device is provided, comprising:
First search result comparison module, for obtain and compare according to keyword sample respectively in the first searching system and
The first search result and the second search result that second searching system retrieves；
Reference retrieval result comparison module, if inconsistent for first search result and second search result,
Then further compare second search result and the reference retrieval result preset for keyword sample；
Correction module, if inconsistent for second search result and the reference retrieval result, according to the second inspection
Hitch fruit type of error corrects second searching system.
Optionally, the first search result comparison module includes:
The sequence of first search result compares submodule, for comparing target retrieval result in first search result
Sequence and the sequence in second search result.
Optionally, the reference retrieval result comparison module includes:
Reference retrieval sort result compares submodule, if the row for target retrieval result in first search result
Sequence and the sequence in second search result are inconsistent, then further compare the target retrieval result in second inspection
Sequence in hitch fruit and the sequence in the reference retrieval result.
Optionally, the correction module is specifically used for:
If the target retrieval result sorting and in the reference retrieval result in second search result
It sorts inconsistent, then second searching system is corrected according to the second search result type of error.
Optionally, the correction module includes:
Third search result acquisition submodule is retrieved according to the keyword sample in third searching system for obtaining
Third search result；
Reference retrieval result submodule, for using the third search result as the reference retrieval result.
Optionally, the correction module includes:
First judging submodule judges the keyword sample respectively in first searching system and in second inspection
Whether the keyword categories information of cable system is consistent, if inconsistent, the second search result type of error is identified as closing
Keyword classification error；
First amendment submodule, for updating keyword categories of the keyword sample in second searching system
Information.
Optionally, the correction module includes:
Second judgment submodule, if for target retrieval result whether be present in first search result may be not present in
The second search result type of error is then identified as target retrieval result gaps and omissions mistake by second search result；
Second amendment submodule, for the target retrieval result and the corresponding relationship of the keyword sample to be added to
Second searching system.
Optionally, the correction module includes:
Third judging submodule, according to sequence of the target retrieval result in second search result and in the reference
Sequence in search result is inconsistent, and the second search result type of error is identified as search result misordering；
Third corrects submodule, for using sequence of the target retrieval result in the reference retrieval result as institute
State sequence of the target retrieval result in second search result.
Optionally, described device further include:
Keyword categories data obtaining module, the keyword categories for obtaining the keyword sample by internet are believed
Breath；
Adding module, keyword categories information for will acquire correspond to the keyword sample and are added to described the
Two searching systems.
Optionally, described device further include:
Label adding module, for counting the retrieval frequency of the keyword sample and adding corresponding detection priority mark
Label.
Searching system detection method according to the present invention can be by obtaining and comparing according to keyword sample respectively
The first search result and the second search result that one searching system and the second searching system retrieve, if the first search result and the
Two search results are inconsistent, then further compare the second search result with for the preset reference retrieval of keyword sample as a result,
Whether the new version searching system that the method for thus solving the problems, such as artificial detection is unable to judge accurately after upgrading is optimised, takes
The whether optimised beneficial effect of accurate judgement new version searching system was obtained, the accuracy of searching system detection is improved.
Secondly, being repaired if the second search result and reference retrieval result are inconsistent according to the second search result type of error
Just described second searching system, so as to accurately identify the type that mistake occurs when new version searching system has mistake
With reason and correspondingly correct the searching system of new version.
Third, searching system detection method of the invention do not need manually to participate in, and save manpower and time.And it is opposite
In the artificial detection method randomly selecting a limited number of keyword samples and being detected, detection method of the invention can be directed to
A large amount of search key sample is detected, and the comprehensive of searching system detection is improved.
The above description is only an overview of the technical scheme of the present invention, in order to better understand the technical means of the present invention,
And it can be implemented in accordance with the contents of the specification, and in order to allow above and other objects of the present invention, feature and advantage can
It is clearer and more comprehensible, the followings are specific embodiments of the present invention.
Detailed description of the invention
By reading the following detailed description of the preferred embodiment, various other advantages and benefits are common for this field
Technical staff will become clear.The drawings are only for the purpose of illustrating a preferred embodiment, and is not considered as to the present invention
Limitation.And throughout the drawings, the same reference numbers will be used to refer to the same parts.In the accompanying drawings:
Fig. 1 shows a kind of step flow chart of searching system detection method embodiment 1 according to the present invention；
Fig. 2 shows a kind of step flow charts of searching system detection method embodiment 2 according to the present invention；
Fig. 3 shows a kind of step flow chart of searching system detection method embodiment 3 according to the present invention；
Fig. 4 shows a kind of structural block diagram of searching system detection device embodiment 1 according to the present invention；
Fig. 5 shows a kind of structural block diagram of searching system detection device embodiment 2 according to the present invention.
Specific embodiment
Exemplary embodiments of the present disclosure are described in more detail below with reference to accompanying drawings.Although showing the disclosure in attached drawing
Exemplary embodiment, it being understood, however, that may be realized in various forms the disclosure without should be by embodiments set forth here
It is limited.On the contrary, these embodiments are provided to facilitate a more thoroughly understanding of the present invention, and can be by the scope of the present disclosure
It is fully disclosed to those skilled in the art.
Referring to Fig.1, a kind of step flow chart of searching system detection method embodiment 1 according to the present invention is shown, specifically
It may include steps of:
Step 101, it obtains and compares and retrieved respectively in the first searching system and the second searching system according to keyword sample
The first search result and the second search result arrived.
Above-mentioned first searching system and the second searching system can be respectively the new edition after legacy version searching system and upgrading
This searching system detects the retrieval performance of updated new system through the embodiment of the present invention.
In concrete implementation, detection service device uses some keyword sample, respectively in the first searching system and second
Searching system is retrieved, and the first searching system and the second searching system correspondingly return to the first search result and the second retrieval knot
Fruit.Detection service device is to obtain the first search result and the second search result and processing is compared.
As the preferable example of the embodiment of the present invention, the retrieval frequency of the keyword sample can also be counted and according to inspection
Rope frequency adds corresponding detection priority tag to keyword sample.Detection service device can count in searching system for each
The retrieval frequency of a keyword, retrieval frequency can be user use within a preset period of time some keyword searching system into
The number of row retrieval.The detection service device detection priority tag advanced, intermediate, rudimentary accordingly according to retrieval frequency addition,
Keyword of the preferential test with advanced detection priority tag when detecting, and do not detect when it is pressed for time with rudimentary
Detection priority tag keyword, to improve detection efficiency while ensure that detection effect.
It should be noted that above-mentioned keyword sample can be multiple keyword samples being interrelated, for example, wherein
One keyword sample is " Peking University ", related keyword sample can be " Beijing University ", " Peking University, school district, Haidian ",
" Peking University goes in a big way school district " etc..Because user may use different keywords in actual user search scene
The same information is retrieved in retrieval, such as in the scene using some place of map retrieval system retrieval, and user may use and close
Keyword " Beijing University " is retrieved, it is also possible to and use " Peking University " to be retrieved, and it may be to look into that user, which really retrieves intention,
The location information for looking for Peking University, school district, Haidian is retrieved using above-mentioned multiple inter-related keyword samples, even if
User has only used " Beijing University " as keyword, can also retrieve the location information of Peking University, school district, Haidian.Therefore, originally
Inventive embodiments are detected using multiple related keyword samples when carrying out the detection of searching system, avoid something lost
The keyword that leakage certain user may use, so as to more fully detect searching system.
Step 102, if first search result and second search result are inconsistent, described is further compared
Two search results and the reference retrieval result preset for keyword sample.
Search result can wrap containing one or more preset target retrieval results.
Above-mentioned search result is inconsistent, may include a variety of inconsistent situations, such as can be some target retrieval
As a result it is present in the first search result, may be not present in the second search result；It is also likely to be the first search result and the second retrieval
As a result the target retrieval result for being included is identical, but inconsistent to the sequence of target retrieval result.It certainly, can be in practical operation
There is a situation where that other search results are inconsistent, the embodiment of the present invention to this with no restriction.
The above-mentioned reference retrieval preset for keyword sample is as a result, can be for some keyword sample according to each
Target retrieval result significance level sequence a preset reference retrieval as a result, for example, for " Beijing University " keyword into
The retrieval of row location information, above-mentioned reference retrieval result can be " Peking University ", " Peking University, school district, Haidian ", " Beijing is big
Daxing school district ", " hotel, Peking University ", " affiliated middle school, Peking University "；It is also possible to give birth to by the feedback for acquiring user
At reference retrieval as a result, for example, when collect multiple users get " Peking University ", " Peking University, school district, Haidian ",
" Peking University go in a big way school district ", " hotel, Peking University ", " affiliated middle school, Peking University " each location information reference retrieval result
Afterwards, the feedback of " Peking University, school district, Haidian " is clicked, above-mentioned reference retrieval result can be by the row of " Peking University, school district, Haidian "
Sequence up-regulation, be updated to " Peking University, school district, Haidian ", " Peking University ", " Peking University go in a big way school district ", " hotel, Peking University ",
" affiliated middle school, Peking University ".
In actual operation, the first search result and the second search result are inconsistent, i.e. legacy version searching system and upgrading
Search result provided by new version searching system afterwards is inconsistent, it may be possible to which new version searching system is optimised, it is also possible to
It is some function normal operation that escalation process influences searching system, new version searching system is caused to be deteriorated.By by
Two search results compare with preset reference retrieval result, it can be determined that the superiority and inferiority feelings of the new version searching system after upgrading out
Condition.
Step 103, if second search result and the reference retrieval result are inconsistent, according to the second search result
Type of error corrects second searching system.
If the second search result and reference retrieval result are inconsistent, it may be said that the searching system of bright new version there are mistake,
And it is different inconsistent it may be the case that caused by different type of errors, according to the second search result and the first search result,
The inconsistent situation of reference retrieval result, can correspondingly identify type of error, and correspondingly correct the second searching system.Example
Such as, when the first search result and reference retrieval result contain some target retrieval as a result, and the second search result not
Include the target retrieval as a result, there is the reason of such case target retrieval that may be the second searching system gaps and omissions as a result,
The target retrieval thus can not be retrieved as a result, therefore its type of error can be identified as target according to above-mentioned keyword sample
Search result gaps and omissions mistake, and the target retrieval is added as a result, to have modified the second searching system in the second searching system
Mistake.
As the preferable example of the embodiment of the present invention, the step 103 may include following sub-step:
Sub-step S11 obtains the third search result retrieved according to the keyword sample in third searching system.
Sub-step S12, using the third search result as the reference retrieval result.
In concrete implementation, when the first search result and the second search result are inconsistent, identical key can be used
Word is retrieved in the third searching system for being relatively independent of the first searching system and the second searching system, and obtains third inspection
The third search result that cable system returns.Because third searching system is independently of the first searching system and the second searching system,
The influence of system upgrade is not will receive, so using the search result of third searching system as reference retrieval as a result, can be more quasi-
Whether the searching system after really detecting upgrading is optimised.
Searching system detection method according to the present invention can be by obtaining and comparing according to keyword sample respectively
The first search result and the second search result that one searching system and the second searching system retrieve, if the first search result and the
Two search results are inconsistent, then further compare the second search result with for the preset reference retrieval of keyword sample as a result,
Whether the new version searching system that the method for thus solving the problems, such as artificial detection is unable to judge accurately after upgrading is optimised, takes
The whether optimised beneficial effect of accurate judgement new version searching system was obtained, the accuracy of searching system detection is improved.
Secondly, being repaired if the second search result and reference retrieval result are inconsistent according to the second search result type of error
Just described second searching system, so as to accurately identify the type that mistake occurs when new version searching system has mistake
With reason and correspondingly correct the searching system of new version.
Third, searching system detection method of the invention do not need manually to participate in, and save manpower and time.And it is opposite
In the artificial detection method randomly selecting a limited number of keyword samples and being detected, detection method of the invention can be directed to
A large amount of search key sample is detected, and the comprehensive of searching system detection is improved.
Referring to Fig. 2, a kind of step flow chart of searching system detection method embodiment 2 according to the present invention is shown, specifically
It may include steps of:
Step 201, sequence of the target retrieval result in first search result is compared to tie in second retrieval
Sequence in fruit.
Search result can wrap containing one or more target retrievals as a result, including multiple target retrieval knots in search result
In the case where fruit, searching system can also be to the processing that target retrieval result is ranked up.
In actual retrieval application scenarios, user after getting the search result comprising multiple target retrieval results,
Some target retrieval result can be further clicked on to obtain more detailed information, the target retrieval result of user demand will be met
It comes in the forefront of search result, user can be made more easily to obtain relevant information.Therefore, the mode of searching system sequence
It can be and be ranked up according to matching degree priority rule, is i.e. keyword and the matching degree of target retrieval result is higher, and sequence is more leaned on
Before, such as the matching degree in keyword " hotel, Beijing University " and " hotel, Peking University " is higher than the matching degree with " Peking University ", therefore
The sequence in " hotel, Peking University " is prior to " Peking University "；It is also possible to be ranked up according to significance level priority rule, i.e. mesh
It is higher to mark significance level of the search result in the target retrieval result of same type, sorts more forward, such as keyword " north
The significance level of capital tourist attractions ", 5A grades of tourist attractions " the Forbidden City " is higher than 4A grades of tourist attractions " Daxing District Safari Park ", because
The sequence of this Forbidden City " is prior to " Daxing District Safari Park ".
Searching system is ranked up using different priority rules, may cause target retrieval result in search result
There is different sequences.
As the preferable example of the embodiment of the present invention, the row in the first search result and the second search result can be only compared
As a result, because in actual retrieval scene, user usually can pay close attention to sequence and lean on for sequence first or first three the target retrieval of sorting
Several preceding target retrievals are as a result, targetedly the forward target retrieval of detection sequence is as a result, it is possible to increase searching system
The efficiency of detection.
Step 202, if sequence of the target retrieval result in first search result in second search result
In sequence it is inconsistent, then further compare sequence of the target retrieval result in second search result with described
Sequence in reference retrieval result.
Step 203, if sequence of the target retrieval result in second search result in the reference retrieval
As a result the sequence in is inconsistent, then corrects second searching system according to the second search result type of error.
Searching system detection method according to the present invention can compare row of the target retrieval result in the first search result
Sequence and the sequence in the second search result, further comparison target retrieval result is in the second search result if inconsistent
Sequence and the sequence in reference retrieval result, to more fully detect searching system.
Referring to Fig. 3, a kind of step flow chart of searching system detection method embodiment 3 according to the present invention is shown, specifically
It may include steps of:
Step 301, it obtains and compares and retrieved respectively in the first searching system and the second searching system according to keyword sample
The first search result and the second search result arrived.
Step 302, if first search result and second search result are inconsistent, described is further compared
Two search results and the reference retrieval result preset for keyword sample.
Step 303, if second search result and the reference retrieval result are inconsistent, according to the second search result
Type of error corrects second searching system.
As the preferable example one of the embodiment of the present invention, the step 303 may include following sub-step:
Sub-step S21 judges the keyword sample respectively in first searching system and in second retrieval system
Whether the keyword categories information of system is consistent, if inconsistent, the second search result type of error is identified as keyword
Classification error.
Sub-step S22 updates keyword categories information of the keyword sample in second searching system.
In concrete implementation, examined respectively in the first searching system and the second searching system obtaining according to keyword sample
While the first search result and the second search result that rope arrives, the classification information of available keyword sample.Usually retrieval
System can classify to keyword, for example, " Beijing University ", " Peking University " " Peking University, school district, Haidian ", " Peking University Daxing
School district " is classified as " university's class ", and " hotel, Peking University " is classified as " hotel's class ".User is passing through inspection using some keyword
When cable system is retrieved, searching system can carry out parsing and determining to keyword the classification of the keyword, according to keyword
Classification retrieve and belong to same category of target retrieval as a result, for example keyword is " Beijing University ", searching system explains the pass
The classification of keyword is " university's class ", may include " Peking University " " the Peking University Haidian for belonging to " university's class " in search result
The target retrievals result such as school district ", " Peking University goes in a big way school district ".
When the first search result and the second search result are inconsistent, and keyword sample is in the first searching system and
The keyword categories information of two searching systems is inconsistent, it may be said that bright second searching system exists for the processing of the keyword closes
Keyword classification error can control the second searching system and parsed simultaneously to the keyword again for keyword classification mistake
Redefine the classification of the keyword.For example, new version searching system is classified as " hotel to the parsing mistake of " Beijing University "
Class ", causes search result to contain " hotel, Peking University " for belonging to " hotel's class ", and detection system controls the second searching system weight
Newly keyword " Beijing University " is parsed, to have modified the search result that the second searching system is directed to keyword " Beijing University ".
Searching system detection method according to the present invention can be by judging in the first searching system and in the second retrieval system
The keyword categories information of system, and keyword categories information of the keyword sample in the second searching system is updated accordingly, it can
Accurately to identify and correct the keyword classification mistake of searching system, the accuracy of searching system detection is improved.
As the preferred embodiment of the embodiment of the present invention, the pass of the keyword sample can also be obtained by internet
Keyword classification information, the keyword categories information that will acquire correspond to the keyword sample and are added to second retrieval system
System.For example, the webpage of Baidupedia entry " Peking University " has the classification of " well-known university " " 985 " " 211 " of the entry etc.
Information, detection service device obtains the relevant classification information of the webpage, and the classification information got from the webpage is corresponded to
" Peking University " is added to the second searching system.
As the preferable example two of the embodiment of the present invention, the step 303 may include following sub-step:
Sub-step S31, if whether target retrieval result is present in first search result and may be not present in described second
The second search result type of error is then identified as target retrieval result gaps and omissions mistake by search result.
The corresponding relationship of the target retrieval result and the keyword sample is added to described second by sub-step S32
Searching system.
In concrete implementation, examined respectively in the first searching system and the second searching system obtaining according to keyword sample
After the first search result and the second search result that rope arrives, it can be determined that whether some or multiple target retrieval results are present in
First search result may be not present in the second search result, if then the inconsistent situation can be identified as target retrieval result
Gaps and omissions mistake, causing the reason of target retrieval result gaps and omissions mistake to can be in the second searching system, there is no the keyword samples
The corresponding relationship of this and the target retrieval result of gaps and omissions, therefore, by target retrieval result pass corresponding with the keyword sample
System is added to the second searching system.Such as keyword is " Beijing University ", the first search result includes " Peking University goes in a big way school district ", and
Second search result do not include " Peking University go in a big way school district ", the reason is that in the second searching system gaps and omissions " Beijing University " with
The corresponding relationship of " Peking University goes in a big way school district ", is added to the second searching system for the corresponding relationship, to have modified the second inspection
Cable system is directed to the search result of keyword " Beijing University ".
Searching system detection method according to the present invention can be by comparing whether target retrieval result is present in the first inspection
Hitch fruit may be not present in the second search result, and correspondingly add the corresponding relationship of target retrieval result and keyword sample
To second searching system, the target retrieval result gaps and omissions mistake of searching system can be accurately identified and be corrected, is improved
The accuracy of searching system detection.
As the preferable example three of the embodiment of the present invention, the step 303 may include following sub-step:
Sub-step S41, according to sequence of the target retrieval result in second search result and in the reference retrieval
As a result the sequence in is inconsistent, and the second search result type of error is identified as search result misordering.
Sub-step S42 examines sequence of the target retrieval result in the reference retrieval result as the target
Sequence of the hitch fruit in second search result.
After searching system is upgraded, it is possible that legacy version searching system and new version searching system are for same
Keyword sample searching provides the search result of different sequences, can be some target retrieval result in the first search result
Sequence it is inconsistent with the sequence in the second search result, be also possible to sequence of multiple target retrieval results in the two not
Unanimously.Further compare the second search result and reference retrieval at this time as a result, if the ranking results of the two are also inconsistent, it can be with
There are search result misorderings for new version searching system after identifying upgrading accordingly.It, can for search result misordering
Using by sequence of the target retrieval result in reference retrieval result as the target retrieval result in second search result
In sequence.
For example, sequence first is that " Beijing is big in the first search result in the detection for being keyword sample with " Beijing University "
Learn " this target retrieval as a result, and " Peking University " in the second search result by the second searching system sort the 5th, and
Target retrieval result " Peking University " is come first by reference retrieval result, it is possible thereby to illustrate the second searching system for key
The search result sequence of word " Beijing University " handles the sequence mistake that " Peking University " this target retrieval result is resulted in there are mistake
Accidentally, at this time can will " Peking University " as in the search result retrieved according to keyword sample " Beijing University " sort first mesh
Search result is marked, to have modified the search result that the second searching system is directed to keyword " Beijing University ".
Searching system detection method according to the present invention can be by comparing target retrieval result in the first search result
Sequence and sequence in the second search result and in reference retrieval result, identify the search result row of the second search result
Sequence mistake, and correspondingly the sequence using target retrieval result in reference retrieval result is retrieved as target retrieval result second
As a result the sequence in can be identified accurately in the mistake in terms of new version searching system has sequence and correct retrieval system
The misordering of system improves the accuracy of searching system detection.
For embodiment of the method, for simple description, therefore, it is stated as a series of action combinations, but this field
Technical staff should be aware of, and embodiment of that present invention are not limited by the describe sequence of actions, because implementing according to the present invention
Example, some steps may be performed in other sequences or simultaneously.Secondly, those skilled in the art should also know that, specification
Described in embodiment belong to preferred embodiment, the actions involved are not necessarily necessary for embodiments of the present invention.
Referring to Fig. 4, a kind of structural block diagram of searching system detection device embodiment 1 according to the present invention is shown, specifically may be used
To include following module:
First search result comparison module 401, for obtaining and comparing according to keyword sample respectively in the first retrieval system
The first search result and the second search result that system and the second searching system retrieve.
As the preferable example of the embodiment of the present invention, the first search result comparison module 401 may include following son
Module:
The sequence of one search result compares submodule, for comparing row of the target retrieval result in first search result
Sequence and the sequence in second search result.
Reference retrieval result comparison module 402, if different for first search result and second search result
It causes, then further compares second search result and the reference retrieval result preset for keyword sample.
As the preferable example of the embodiment of the present invention, the reference retrieval result comparison module 402 may include following son
Module:
Reference retrieval sort result compares submodule, if the row for target retrieval result in first search result
Sequence and the sequence in second search result are inconsistent, then further compare the target retrieval result in second inspection
Sequence in hitch fruit and the sequence in the reference retrieval result.
Correction module 403, if inconsistent for second search result and the reference retrieval result, according to second
Search result type of error corrects second searching system.
As the preferable example of the embodiment of the present invention, the correction module 403 can be specifically used for:
If the target retrieval result sorting and in the reference retrieval result in second search result
It sorts inconsistent, then second searching system is corrected according to the second search result type of error.
As the preferable example one of the embodiment of the present invention, the correction module 403 may include following submodule:
Third search result acquisition submodule is retrieved according to the keyword sample in third searching system for obtaining
Third search result；
Reference retrieval result submodule, for using the third search result as the reference retrieval result.
Searching system detection device according to the present invention can be by obtaining and comparing according to keyword sample respectively
The first search result and the second search result that one searching system and the second searching system retrieve, if the first search result and the
Two search results are inconsistent, then further compare the second search result with for the preset reference retrieval of keyword sample as a result,
Whether the new version searching system that the method for thus solving the problems, such as artificial detection is unable to judge accurately after upgrading is optimised, takes
The whether optimised beneficial effect of accurate judgement new version searching system was obtained, the accuracy of searching system detection is improved.
Secondly, being repaired if the second search result and reference retrieval result are inconsistent according to the second search result type of error
Just described second searching system, so as to accurately identify the type that mistake occurs when new version searching system has mistake
With reason and correspondingly correct the searching system of new version.
Third, searching system detection method of the invention do not need manually to participate in, and save manpower and time.And it is opposite
In the artificial detection method randomly selecting a limited number of keyword samples and being detected, detection method of the invention can be directed to
A large amount of search key sample is detected, and the comprehensive of searching system detection is improved
Referring to Fig. 5, a kind of structural block diagram of searching system detection device embodiment 2 according to the present invention is shown, specifically may be used
To include following module:
First search result comparison module 501, for obtaining and comparing according to keyword sample respectively in the first retrieval system
The first search result and the second search result that system and the second searching system retrieve.
Reference retrieval result comparison module 502, if different for first search result and second search result
It causes, then further compares second search result and the reference retrieval result preset for keyword sample.
Correction module 503, if inconsistent for second search result and the reference retrieval result, according to second
Search result type of error corrects second searching system.
As the preferable example one of the embodiment of the present invention, the correction module 503 may include following submodule:
First judging submodule judges the keyword sample respectively in first searching system and in second inspection
Whether the keyword categories information of cable system is consistent, if inconsistent, the second search result type of error is identified as closing
Keyword classification error.
First amendment submodule, for updating keyword categories of the keyword sample in second searching system
Information.
Searching system detection device according to the present invention can be by judging in the first searching system and in the second retrieval system
The keyword categories information of system, and keyword categories information of the keyword sample in the second searching system is updated accordingly, it can
Accurately to identify and correct the keyword classification mistake of searching system, the accuracy of searching system detection is improved.
As the preferable example two of the embodiment of the present invention, the correction module 503 may include following submodule:
Second judgment submodule, if for target retrieval result whether be present in first search result may be not present in
The second search result type of error is then identified as target retrieval result gaps and omissions mistake by second search result；
Second amendment submodule, for the target retrieval result and the corresponding relationship of the keyword sample to be added to
Second searching system.
Searching system detection device according to the present invention can be by comparing whether target retrieval result is present in the first inspection
Hitch fruit may be not present in the second search result, and correspondingly add the corresponding relationship of target retrieval result and keyword sample
To second searching system, the target retrieval result gaps and omissions mistake of searching system can be accurately identified and be corrected, is improved
The accuracy of searching system detection.
As the preferable example three of the embodiment of the present invention, the correction module 503 may include following submodule:
Third judging submodule, according to sequence of the target retrieval result in second search result and in the reference
Sequence in search result is inconsistent, and the second search result type of error is identified as search result misordering；
Third corrects submodule, for using sequence of the target retrieval result in the reference retrieval result as institute
State sequence of the target retrieval result in second search result
Searching system detection device according to the present invention can be by comparing target retrieval result in the first search result
Sequence and sequence in the second search result and in reference retrieval result, identify the search result row of the second search result
Sequence mistake, and correspondingly the sequence using target retrieval result in reference retrieval result is retrieved as target retrieval result second
As a result the sequence in can be identified accurately in the mistake in terms of new version searching system has sequence and correct retrieval system
The misordering of system improves the accuracy of searching system detection.
Keyword categories data obtaining module 504, for obtaining the crucial part of speech of the keyword sample by internet
Other information.
Adding module 505, the keyword categories information for will acquire correspond to the keyword sample and are added to institute
State the second searching system.
Label adding module 506, for counting the retrieval frequency of the keyword sample and adding corresponding detection preferentially
Grade label.
For device embodiment, since it is basically similar to the method embodiment, related so being described relatively simple
Place illustrates referring to the part of embodiment of the method.
Algorithm and display are not inherently related to any particular computer, virtual system, or other device provided herein.
Various general-purpose systems can also be used together with teachings based herein.As described above, it constructs required by this kind of system
Structure be obvious.In addition, the present invention is also not directed to any particular programming language.It should be understood that can use various
Programming language realizes summary of the invention described herein, and the description done above to language-specific is to disclose this hair
Bright preferred forms.
In the instructions provided here, numerous specific details are set forth.It is to be appreciated, however, that implementation of the invention
Example can be practiced without these specific details.In some instances, well known method, structure is not been shown in detail
And technology, so as not to obscure the understanding of this specification.
Similarly, it should be understood that in order to simplify the disclosure and help to understand one or more of the various inventive aspects,
Above in the description of exemplary embodiment of the present invention, each feature of the invention is grouped together into single implementation sometimes
In example, figure or descriptions thereof.However, the disclosed method should not be interpreted as reflecting the following intention: i.e. required to protect
Shield the present invention claims features more more than feature expressly recited in each claim.More precisely, as following
Claims reflect as, inventive aspect is all features less than single embodiment disclosed above.Therefore,
Thus the claims for following specific embodiment are expressly incorporated in the specific embodiment, wherein each claim itself
All as a separate embodiment of the present invention.
Those skilled in the art will understand that can be carried out adaptively to the module in the equipment in embodiment
Change and they are arranged in one or more devices different from this embodiment.It can be the module or list in embodiment
Member or component are combined into a module or unit or component, and furthermore they can be divided into multiple submodule or subelement or
Sub-component.Other than such feature and/or at least some of process or unit exclude each other, it can use any
Combination is to all features disclosed in this specification (including adjoint claim, abstract and attached drawing) and so disclosed
All process or units of what method or apparatus are combined.Unless expressly stated otherwise, this specification is (including adjoint power
Benefit require, abstract and attached drawing) disclosed in each feature can carry out generation with an alternative feature that provides the same, equivalent, or similar purpose
It replaces.
In addition, it will be appreciated by those of skill in the art that although some embodiments described herein include other embodiments
In included certain features rather than other feature, but the combination of the feature of different embodiments mean it is of the invention
Within the scope of and form different embodiments.For example, in the following claims, embodiment claimed is appointed
Meaning one of can in any combination mode come using.
Various component embodiments of the invention can be implemented in hardware, or to run on one or more processors
Software module realize, or be implemented in a combination thereof.It will be understood by those of skill in the art that can be used in practice
Microprocessor or digital signal processor (DSP) realize the detection method and dress of searching system according to an embodiment of the present invention
Install some or all functions of some or all components in standby.The present invention is also implemented as executing institute here
Some or all device or device programs of the method for description are (for example, computer program and computer program produce
Product).It is such to realize that program of the invention can store on a computer-readable medium, or can have one or more
The form of signal.Such signal can be downloaded from an internet website to obtain, and perhaps be provided on the carrier signal or to appoint
What other forms provides.
It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and ability
Field technique personnel can be designed alternative embodiment without departing from the scope of the appended claims.In the claims,
Any reference symbol between parentheses should not be configured to limitations on claims.Word "comprising" does not exclude the presence of not
Element or step listed in the claims.Word "a" or "an" located in front of the element does not exclude the presence of multiple such
Element.The present invention can be by means of including the hardware of several different elements and being come by means of properly programmed computer real
It is existing.In the unit claims listing several devices, several in these devices can be through the same hardware branch
To embody.The use of word first, second, and third does not indicate any sequence.These words can be explained and be run after fame
Claim.
The invention discloses A1, a kind of detection method of searching system, comprising:
It obtains and compares first retrieved respectively in the first searching system and the second searching system according to keyword sample
Search result and the second search result；
If first search result and second search result are inconsistent, the second retrieval knot is further compared
Fruit and the reference retrieval result preset for keyword sample；
If second search result and the reference retrieval result are inconsistent, according to the second search result type of error
Correct second searching system.
A2, the method as described in claim A1, the acquisition are simultaneously compared according to keyword sample respectively in the first retrieval
The step of the first search result and the second search result that system and the second searching system retrieve includes:
Compare sequence of the target retrieval result in first search result and the row in second search result
Sequence.
A3, the method as described in claim A2, if first search result and second search result are not
Unanimously, then the step of second search result is with for reference retrieval result made by keyword sample packet is further compared
It includes:
If the target retrieval result sorting and in second search result in first search result
It sorts inconsistent, then further compares sequence of the target retrieval result in second search result and in the reference
Sequence in search result.
A4, the method as described in claim A2, if second search result and the reference retrieval result are not
Unanimously, then according to the second search result type of error correct second searching system the step of specifically:
If the target retrieval result sorting and in the reference retrieval result in second search result
It sorts inconsistent, then second searching system is corrected according to the second search result type of error.
A5, the method as described in claim A1, if second search result and the reference retrieval result are not
Unanimously, then include: according to the step of the second search result type of error amendment second searching system
Obtain the third search result retrieved according to the keyword sample in third searching system；
Using the third search result as the reference retrieval result.
A6, the method as described in claim A1, if second search result and the reference retrieval result are not
Unanimously, include: according to the step of the second search result type of error amendment second searching system
Judge the keyword sample respectively in first searching system and in the keyword of second searching system
Whether classification information is consistent, if inconsistent, the second search result type of error is identified as keyword classification mistake；
Update keyword categories information of the keyword sample in second searching system.
A7, the method as described in claim A1, if second search result and the reference retrieval result are not
Unanimously, include: according to the step of the second search result type of error amendment second searching system
If whether target retrieval result, which is present in first search result, may be not present in second search result,
The second search result type of error is identified as target retrieval result gaps and omissions mistake；
The corresponding relationship of the target retrieval result and the keyword sample is added to second searching system.
A8, the method as described in claim A1, if second search result and the reference retrieval result are not
Unanimously, include: according to the step of the second search result type of error amendment second searching system
According to sequence of the target retrieval result in second search result and the row in the reference retrieval result
Sequence is inconsistent, and the second search result type of error is identified as search result misordering；
Using sequence of the target retrieval result in the reference retrieval result as the target retrieval result in institute
State the sequence in the second search result.
A9, the method as described in claim A6, the method also includes:
The keyword categories information of the keyword sample is obtained by internet；
The keyword categories information that will acquire corresponds to the keyword sample and is added to second searching system.
A10, the method as described in claim A1, the method also includes:
It counts the retrieval frequency of the keyword sample and adds corresponding detection priority tag.
The invention also discloses B11, a kind of detection device of searching system, comprising:
First search result comparison module, for obtain and compare according to keyword sample respectively in the first searching system and
The first search result and the second search result that second searching system retrieves；
Reference retrieval result comparison module, if inconsistent for first search result and second search result,
Then further compare second search result and the reference retrieval result preset for keyword sample；
Correction module, if inconsistent for second search result and the reference retrieval result, according to the second inspection
Hitch fruit type of error corrects second searching system.
B12, the device as described in claim B11, the first search result comparison module include:
The sequence of first search result compares submodule, for comparing target retrieval result in first search result
Sequence and the sequence in second search result.
B13, the device as described in claim B12, the reference retrieval result comparison module include:
Reference retrieval sort result compares submodule, if the row for target retrieval result in first search result
Sequence and the sequence in second search result are inconsistent, then further compare the target retrieval result in second inspection
Sequence in hitch fruit and the sequence in the reference retrieval result.
B14, the device as described in claim B12, the correction module are specifically used for:
If the target retrieval result sorting and in the reference retrieval result in second search result
It sorts inconsistent, then second searching system is corrected according to the second search result type of error.
B15, the device as described in claim B11, the correction module include:
Third search result acquisition submodule is retrieved according to the keyword sample in third searching system for obtaining
Third search result；
Reference retrieval result submodule, for using the third search result as the reference retrieval result.
B16, the device as described in claim B11, the correction module include:
First judging submodule judges the keyword sample respectively in first searching system and in second inspection
Whether the keyword categories information of cable system is consistent, if inconsistent, the second search result type of error is identified as closing
Keyword classification error；
First amendment submodule, for updating keyword categories of the keyword sample in second searching system
Information.
B17, the device as described in claim B11, the correction module include:
Second judgment submodule, if for target retrieval result whether be present in first search result may be not present in
The second search result type of error is then identified as target retrieval result gaps and omissions mistake by second search result；
Second amendment submodule, for the target retrieval result and the corresponding relationship of the keyword sample to be added to
Second searching system.
B18, the device as described in claim B11, the correction module include:
Third judging submodule, according to sequence of the target retrieval result in second search result and in the reference
Sequence in search result is inconsistent, and the second search result type of error is identified as search result misordering；
Third corrects submodule, for using sequence of the target retrieval result in the reference retrieval result as institute
State sequence of the target retrieval result in second search result.
B19, the device as described in claim B16, described device further include:
Keyword categories data obtaining module, the keyword categories for obtaining the keyword sample by internet are believed
Breath；
Adding module, keyword categories information for will acquire correspond to the keyword sample and are added to described the
Two searching systems.
B20, the device as described in claim B11, described device further include:
Label adding module, for counting the retrieval frequency of the keyword sample and adding corresponding detection priority mark
Label.
Claims (18)
1. a kind of detection method of searching system, comprising:
It obtains and compares the first retrieval retrieved respectively in the first searching system and the second searching system according to keyword sample
As a result with the second search result；
If first search result and second search result are inconsistent, further compare second search result with
For the preset reference retrieval result of keyword sample；
If second search result and the reference retrieval result are inconsistent, corrected according to the second search result type of error
Second searching system；
Wherein, if second search result and the reference retrieval result are inconsistent, according to the second search result mistake
Accidentally the step of type amendment second searching system includes:
Obtain the third search result retrieved according to the keyword sample in third searching system；
Using the third search result as the reference retrieval result.
2. the method for claim 1, wherein described obtain and compare according to keyword sample respectively in the first retrieval system
System and the second searching system retrieve the first search result and the second search result the step of include:
Compare sequence of the target retrieval result in first search result and the sequence in second search result.
3. method according to claim 2, wherein if first search result and second search result are different
It causes, then further comparing second search result with for the step of reference retrieval result made by keyword sample includes:
If sequence of the target retrieval result in first search result and the sequence in second search result
It is inconsistent, then further compare sequence of the target retrieval result in second search result and in the reference retrieval
As a result the sequence in.
4. method according to claim 2, wherein if second search result and the reference retrieval result are different
The step of causing, then second searching system being corrected according to the second search result type of error specifically:
If sequence of the target retrieval result in second search result and the sequence in the reference retrieval result
It is inconsistent, then second searching system is corrected according to the second search result type of error.
5. if the method for claim 1, wherein second search result and the reference retrieval result are different
It causes, then includes: according to the step of the second search result type of error amendment second searching system
Judge the keyword sample respectively in first searching system and in the keyword categories of second searching system
Whether information is consistent, if inconsistent, the second search result type of error is identified as keyword classification mistake；
Update keyword categories information of the keyword sample in second searching system.
6. if the method for claim 1, wherein second search result and the reference retrieval result are different
It causes, then includes: according to the step of the second search result type of error amendment second searching system
If whether target retrieval result, which is present in first search result, may be not present in second search result, by institute
It states the second search result type of error and is identified as target retrieval result gaps and omissions mistake；
The corresponding relationship of the target retrieval result and the keyword sample is added to second searching system.
7. if the method for claim 1, wherein second search result and the reference retrieval result are different
It causes, then includes: according to the step of the second search result type of error amendment second searching system
Not according to sequence of the target retrieval result in second search result and the sequence in the reference retrieval result
Unanimously, the second search result type of error is identified as search result misordering；
Using sequence of the target retrieval result in the reference retrieval result as the target retrieval result described
Sequence in two search results.
8. method as claimed in claim 6, wherein the method also includes:
The keyword categories information of the keyword sample is obtained by internet；
The keyword categories information that will acquire corresponds to the keyword sample and is added to second searching system.
9. the method for claim 1, wherein the method also includes:
It counts the retrieval frequency of the keyword sample and adds corresponding detection priority tag.
10. a kind of detection device of searching system, comprising:
First search result comparison module, for obtaining and comparing according to keyword sample respectively in the first searching system and second
The first search result and the second search result that searching system retrieves；
Reference retrieval result comparison module, if inconsistent for first search result and second search result, into
One step compares second search result and the reference retrieval result preset for keyword sample；
Correction module is tied if inconsistent for second search result and the reference retrieval result according to the second retrieval
Fruit type of error corrects second searching system；
The correction module includes:
Third search result acquisition submodule, for obtaining retrieve according to the keyword sample in third searching system
Three search results；
Reference retrieval result submodule, for using the third search result as the reference retrieval result.
11. device as claimed in claim 10, wherein the first search result comparison module includes:
The sequence of first search result compares submodule, for comparing sequence of the target retrieval result in first search result
With the sequence in second search result.
12. device as claimed in claim 11, wherein the reference retrieval result comparison module includes:
Reference retrieval sort result compare submodule, if for sequence of the target retrieval result in first search result with
Sequence in second search result is inconsistent, then further compares the target retrieval result in the second retrieval knot
Sequence in fruit and the sequence in the reference retrieval result.
13. device as claimed in claim 11, wherein the correction module is specifically used for:
If sequence of the target retrieval result in second search result and the sequence in the reference retrieval result
It is inconsistent, then second searching system is corrected according to the second search result type of error.
14. device as claimed in claim 10, wherein the correction module includes:
First judging submodule judges the keyword sample respectively in first searching system and in second retrieval system
Whether the keyword categories information of system is consistent, if inconsistent, the second search result type of error is identified as keyword
Classification error；
First amendment submodule, for updating keyword categories letter of the keyword sample in second searching system
Breath.
15. device as claimed in claim 10, wherein the correction module includes:
Second judgment submodule, if may be not present for whether target retrieval result to be present in first search result in described
The second search result type of error is then identified as target retrieval result gaps and omissions mistake by the second search result；
Second amendment submodule, it is described for the corresponding relationship of the target retrieval result and the keyword sample to be added to
Second searching system.
16. device as claimed in claim 10, wherein the correction module includes:
Third judging submodule, according to sequence of the target retrieval result in second search result and in the reference retrieval
As a result the sequence in is inconsistent, and the second search result type of error is identified as search result misordering；
Third corrects submodule, for using sequence of the target retrieval result in the reference retrieval result as the mesh
Mark sequence of the search result in second search result.
17. device as claimed in claim 14, wherein described device further include:
Keyword categories data obtaining module, for obtaining the keyword categories information of the keyword sample by internet；
Adding module, the keyword categories information for will acquire correspond to the keyword sample and are added to second inspection
Cable system.
18. device as claimed in claim 10, wherein described device further include:
Label adding module, for counting the retrieval frequency of the keyword sample and adding corresponding detection priority tag.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510461502.9A CN105095464B (en) | 2015-07-30 | 2015-07-30 | A kind of detection method and device of searching system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510461502.9A CN105095464B (en) | 2015-07-30 | 2015-07-30 | A kind of detection method and device of searching system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105095464A CN105095464A (en) | 2015-11-25 |
| CN105095464B true CN105095464B (en) | 2019-03-05 |
Family
ID=54575900
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510461502.9A Active CN105095464B (en) | 2015-07-30 | 2015-07-30 | A kind of detection method and device of searching system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105095464B (en) |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105808735B (en) * | 2016-03-10 | 2020-02-07 | 宁波金唐软件有限公司 | Data processing method and device |
| CN106202449B (en) * | 2016-07-14 | 2019-09-13 | 上海超橙科技有限公司 | Information retrieval and methods of exhibiting and system |
| CN108733707B (en) * | 2017-04-20 | 2022-10-04 | 腾讯科技（深圳）有限公司 | Method and device for determining stability of search function |
| CN107688595B (en) * | 2017-05-10 | 2019-03-15 | 平安科技（深圳）有限公司 | Information retrieval Accuracy Evaluation, device and computer readable storage medium |
| CN110929135B (en) * | 2019-11-15 | 2023-01-06 | 泰康保险集团股份有限公司 | Query processing method and device |
| CN113656315B (en) * | 2021-08-19 | 2023-01-24 | 北京百度网讯科技有限公司 | Data testing method and device, electronic equipment and storage medium |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1455902A (en) * | 2000-07-17 | 2003-11-12 | 西门子公司 | Method for comparing search profiles |
| CN102902722A (en) * | 2012-09-04 | 2013-01-30 | 北京奇虎科技有限公司 | Method and system for treating information safety |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101359331B (en) * | 2008-05-04 | 2014-03-19 | 索意互动（北京）信息技术有限公司 | Method and system for reordering search result |
-
2015
- 2015-07-30 CN CN201510461502.9A patent/CN105095464B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1455902A (en) * | 2000-07-17 | 2003-11-12 | 西门子公司 | Method for comparing search profiles |
| CN102902722A (en) * | 2012-09-04 | 2013-01-30 | 北京奇虎科技有限公司 | Method and system for treating information safety |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105095464A (en) | 2015-11-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105095464B (en) | A kind of detection method and device of searching system | |
| CN104185840B (en) | It is used for being prioritized the mthods, systems and devices of multiple tests in lasting deployment streamline | |
| CN103473506B (en) | For the method and apparatus identifying malice APK file | |
| US9600403B1 (en) | Method and system for creating functional model of test cases | |
| CN103914546B (en) | Data-updating method and its device | |
| US20150142718A1 (en) | Ontology-Aided Business Rule Extraction Using Machine Learning | |
| US11327874B1 (en) | System, method, and computer program for orchestrating automatic software testing | |
| CN106294743A (en) | The recommendation method and device of application function | |
| CN104932980B (en) | Software automatic testing method and device | |
| CN103559222B (en) | Method and device for displaying page loading time in browsers | |
| CN110059003B (en) | Automatic test method, device, electronic equipment and readable storage medium | |
| CN104462985A (en) | Detecting method and device of bat loopholes | |
| CN109753286A (en) | A method of the code method based on functional label counts its call number | |
| CN105183658A (en) | Software code testing method and device | |
| CN106843984A (en) | The update method and device of application database | |
| CN108959929A (en) | Program file processing method and processing device | |
| CN103365778B (en) | A kind of method and apparatus testing control | |
| CN106776348B (en) | Test case management method and device | |
| CN107909414A (en) | The anti-cheat method and device of application program | |
| CN107291619A (en) | EMS memory occupation analysis method and device | |
| US9489451B2 (en) | Visual data definition for identifying data items in loosely-structured data | |
| CN106411899A (en) | Security detection method and device for data files | |
| CN102831002B (en) | Patch discharging method and device | |
| US11138099B2 (en) | Method for testing software, and computing device and computer-readable storage medium thereof | |
| CN110110521A (en) | It is a kind of based on iOS application safety detection method, apparatus and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20220714 Address after: Room 801, 8th floor, No. 104, floors 1-19, building 2, yard 6, Jiuxianqiao Road, Chaoyang District, Beijing 100015 Patentee after: BEIJING QIHOO TECHNOLOGY Co.,Ltd. Address before: Room 112, block D, No. 28, Xinjiekou outer street, Xicheng District, Beijing 100088 (Desheng Park) Patentee before: BEIJING QIHOO TECHNOLOGY Co.,Ltd. Patentee before: Qizhi software (Beijing) Co.,Ltd. |