CN103186619B - A kind of method and apparatus of the evaluation search result based on non click operation information - Google Patents
A kind of method and apparatus of the evaluation search result based on non click operation information Download PDFInfo
- Publication number
- CN103186619B CN103186619B CN201110457424.7A CN201110457424A CN103186619B CN 103186619 B CN103186619 B CN 103186619B CN 201110457424 A CN201110457424 A CN 201110457424A CN 103186619 B CN103186619 B CN 103186619B
- Authority
- CN
- China
- Prior art keywords
- search result
- operation information
- user
- click operation
- evaluated
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Abstract
The method and apparatus for the evaluation search result that the object of the present invention is to provide a kind of based on non click operation information.First, non click operation information of one or more users to the search result to be evaluated based on same queries sequence is obtained；Then, according to the non click operation information, described search result is evaluated.Compared with prior art, the present invention is by obtaining non click operation information of the user to the search result to be evaluated based on same queries sequence, such as whether inputting new search sequence, drawing selection operation etc. to search result items, and the search result is evaluated based on predetermined evaluation rule, the situation that search need can be met when user executes without clicking operation search result includes into evaluation criterion, to provide more structurally sound foundation to improve the accuracy that search result is evaluated.
Description
Technical field
The present invention relates to computer realm more particularly to a kind of technologies for evaluating search result.
Background technology
In the prior art, click behavior of the user to search result is depended on to the evaluation of search result, and not
Consider that user is not required to that described search result progress clicking operation can be met the situation of its search need, example in search process
Such as, the search result abstract that user is only shown by result of page searching can meet query demand, without clicking each search
The link of result items with enter its corresponding to the page.Due to ignoring to evaluation of the user without clicking operation, so as to cause to searching
Rope evaluation of result it is not accurate enough.
Therefore, how search result is efficiently and accurately evaluated, becomes one of current urgent problem to be solved.
Invention content
The object of the present invention is to provide a kind of method and apparatus for evaluating search result.
According to an aspect of the invention, there is provided a kind of computer implemented method for evaluating search result, it should
Method includes the following steps：
A. one or more users are obtained to operate the click of the search result to be evaluated based on same queries sequence
Information；
B. according to the non click operation information, described search result is evaluated.
According to another aspect of the present invention, a kind of equipment for evaluating search result is additionally provided, which includes：
Operation information acquisition device, for obtaining one or more users to searching based on same queries sequence to be evaluated
The non click operation information of hitch fruit；
Evaluating apparatus, for according to the non click operation information, evaluating described search result.
Compared with prior art, the present invention is by obtaining user to the search result to be evaluated based on same queries sequence
Non click operation information, such as whether the new search sequence of input, drawing selection operation etc. to search result items, and be based on pre- accepted opinion
Valence rule evaluates the search result, can meet search need when user executes without clicking operation search result
Situation includes into evaluation criterion, to provide more structurally sound foundation to improve the accuracy that search result is evaluated.
Description of the drawings
By reading a detailed description of non-restrictive embodiments in the light of the attached drawings below, of the invention other
Feature, objects and advantages will become more apparent upon：
Fig. 1 shows the equipment schematic diagram for evaluating search result according to one aspect of the invention；
Fig. 2 shows the method flow diagrams for evaluating search result according to a further aspect of the present invention.
Same or analogous reference numeral represents same or analogous component in attached drawing.
Specific implementation mode
Present invention is further described in detail below in conjunction with the accompanying drawings.
Fig. 1 shows the equipment schematic diagram of the evaluation search result according to one aspect of the invention.Wherein, valuator device 1 wraps
Include operation information acquisition device 111 and evaluating apparatus 112.
Here, valuator device 1 can be a network equipment or the function module that is located therein, wherein network equipment packet
Include but be not limited to what computer, network host, single network server, multiple network server collection or multiple servers were constituted
Cloud, here, cloud is made of a large amount of computers or network server for being based on cloud computing (Cloud Computing), wherein cloud meter
It is one kind of Distributed Calculation, a super virtual computer being made of the computer collection of a group loose couplings；Evaluation is set
Standby 1 can also be user equipment comprising but be not limited to any type and can pass through keyboard, remote controler, touch tablet or sound with user
Control electronic product, such as computer, smart mobile phone, PDA, game machine or IPTV etc. that equipment carries out human-computer interaction.
It is described in detail referring to Fig. 1 to evaluate valuator device 1 process of search result：
Specifically, operation information acquisition device 111 obtains one or more users to be evaluated based on same queries sequence
The non click operation information of the search result of row.
Here, the non click operation information includes but not limited to any one of following：
1) user inputs the operation information of new search sequence；For example, after having obtained search result, user ties in search
Search input frame in the fruit page carries out input operation again, and the input operates corresponding new search sequence and previous inquiry sequence
Row are related, such as have partial query keyword identical in two search sequences, then can determine user its search need not
New search sequence is inputted in the case of being satisfied；
2) stroke selection operation information of the user to each search result items of search result；Wherein, described stroke of selection operation information
Including but not limited to user to each search result items of search result draw the number of selection operation；For example, according to mouse point
Under operation relevant information, such as the temporal information under putting lower position coordinates and putting, and mouse when being accordingly released mouse
The operation relevant information of release, such as position coordinates of release and the temporal information of release draw choosing to record such operation to be primary
Operation, meanwhile, according to the position coordinates of position coordinates and release under the point, determine that the corresponding search result of selection operation is drawn in this time
, and according to the temporal information of temporal information and relieving under the point, determine that the duration of selection operation is drawn in this time；
3) hovering operation information of the user to each search result items of search result；
Wherein, the user to the hovering operation information of each search result items of described search result include it is following at least
Any one：
A) hovering number of operations of the user in each search result items of search result；For example, obtaining mouse in real time
It moves into the time of some search result items region of search result and removes the time in the region, when immigration time and shifting
When going out the time interval of time and being more than predetermined time interval threshold value, it is recorded as operation of once hovering, and then counting user is searched at this
Total hovering number of operations in result of page searching where hitch fruit；
B) duration of each hovering operation of the user in each search result items of search result；For example, in real time
Ground obtains the time of some search result items region of mouse immigration search result and removes the time in the region, record
Move into the time interval of time and throughput time, i.e., the duration that hovering operates every time.
Those skilled in the art will be understood that above-mentioned hovering operation information is only for example, other are existing or may go out from now on
Existing hovering operation information is such as applicable to the present invention, should also be included within the scope of the present invention, and wrap by reference
Contained in this.
Those skilled in the art will be understood that above-mentioned non click operation information is only for example, other are existing or from now on may
The non click operation information of appearance is such as applicable to the present invention, should also be included within the scope of the present invention, and with reference side
Formula is incorporated herein.
Here, the mode for obtaining non click operation information includes but not limited to following any case：
1) operation information acquisition device 111 obtain a user by user equipment to be evaluated based on same queries sequence
The non click operation information that the search result of row executes；
2) operation information acquisition device 111 is answered event triggering in real time or is received periodically and sent from third party device
Multiple users to the non click operation information of the search result to be evaluated based on same queries sequence.
In one example, when valuator device 1 is the network equipment, first, user is by the interactive device of user equipment, packet
Keyboard, mouse, remote controler, touch tablet or handwriting equipment are included but are not limited to, it is soft with the browser software or client of user equipment
Part interacts.By taking mouse as an example, user carries out drawing selection operation in the result of page searching of the browser software of user equipment
When, which obtains stroke selection operation of the user to a certain search result items of search result, such as user equipment in real time
The operation relevant information under mouse point is obtained first, the temporal information under position coordinates and point under such as putting, then when release should
When mouse, the operation relevant information of mouse release, such as position coordinates of release and the temporal information of release are obtained, and recording should
Secondary operation is a stroke selection operation, meanwhile, according to the position coordinates of position coordinates and release under the point, determine that selection operation pair is drawn in this time
The search result items answered, and according to the temporal information of temporal information and release under the point, determine that the duration of selection operation is drawn in this time；
So that it is determined that drawing the corresponding non click operation information of selection operation with the user, the non click operation information is then passed through into agreement
Communication mode be sent to valuator device 1；Then, operation information acquisition device 111 receives the non click operation information in real time.
In another example, the Application Programming Interface that operation information acquisition device 111 is provided via third party device
(API), it is triggered ground by predetermined condition or event or regularly transmits and receives multiple users to be evaluated to the third party device
The request message for the non click operation information that search result based on same queries sequence executes, and receive third party device sound
The click that the search result to be evaluated based on same queries sequence should be executed in multiple users that the request message returns
Operation information.In another example, third party device actively pushes multiple users to be evaluated based on identical to valuator device 1
The non click operation information that the search result of search sequence executes, operation information acquisition device 111 receive multiple user and treat
The non click operation information that the search result based on same queries sequence of evaluation executes.
Those skilled in the art will be understood that the mode of above-mentioned acquisition non click operation information is only for example, other are existing
Or the mode for the acquisition non click operation information being likely to occur from now on is such as applicable to the present invention, should also be included in protection of the present invention
Within range, and it is incorporated herein by reference.
Then, the non click operation information that evaluating apparatus 112 is obtained according to operation information acquisition device 111 ties search
Fruit is evaluated.
Here, the situation that described search result is evaluated according to scheduled evaluation rule include but not limited to down toward
It is any one of few：
1) user inputs new search sequence after obtaining search result；
For example, if user re-enters new search sequence after obtaining search result in result of page searching, comment
Valence device 112 determines that the opinion rating of the search result is low；
2) user selects number to select frequency threshold value more than predetermined draw in the drawing for each search result items of search result；
For example, if user selects number to select frequency threshold value model more than predetermined draw in the drawing for each search result items of search result
Maximum value is enclosed, then evaluating apparatus 112 determines that the opinion rating of the search result is height；
3) user is more than predetermined hovering frequency threshold value in the hovering number of each search result items of search result；
For example, if user is more than predetermined hovering frequency threshold value model in the hovering number of each search result items of search result
Maximum value is enclosed, then evaluating apparatus 112 determines that the opinion rating of the search result is height；
4) user is more than predetermined hovering duration threshold value in the hovering duration of each search result items of search result；
For example, if user is more than predetermined hovering duration threshold value model in the hovering duration of each search result items of search result
Maximum value is enclosed, then evaluating apparatus 112 determines that the opinion rating of the search result is height.
Those skilled in the art will be understood that the above-mentioned scheduled evaluation rule of items can not only be individually used for evaluating apparatus
Search result is evaluated, wherein multinomial combination can also be evaluated search result for evaluating apparatus.
Here, the evaluation criterion evaluated described search result includes but not limited to following any form：
A) predetermined opinion rating, such as predetermined opinion rating are high, medium and low；For example, making a reservation for 80% or more in multiple users
User inputs new search sequence after obtaining the search result based on same queries sequence and not to each search result items
Have and draw the operations such as choosing, hovering, then opinion rating is rudimentary；For another example 80% or more user is obtaining in predetermined multiple users
After search result based on same queries sequence, number is selected to be drawn more than predetermined the drawing for a certain search result items of the search result
Frequency threshold value range maximum value is selected, then opinion rating is middle rank；In another example 80% or more user is obtaining in default multiple users
After the search result based on same queries sequence, meet the above-mentioned situation 2 evaluated search result), 3), 4) in two
Or two or more, and do not input new search sequence, then opinion rating is advanced；
B) predetermined evaluation criterion preferably/it is bad, for example, if in multiple users 80% or more user obtain be based on phase
The behaviour such as choosing, hovering are drawn with inputting new search sequence after the search result of search sequence and not having to each search result items
Make, then evaluation result is bad；In another example if 80% or more user is obtaining based on same queries sequence in multiple users
Search result after, meet the above-mentioned situation 2 evaluated search result), 3), 4) in two or two or more, and be
New search sequence is inputted, then evaluation result is preferably.
In one example, non click operation information shows in multiple users 85% user based on same search sequence
New search sequence is re-entered in the result of page searching of the search result of " sound of chopping wood Adventures of Pei ", and to each of the search result
A search result items do not draw the operations such as choosing, hovering, then the opinion rating that evaluating apparatus 112 evaluates the search result is
It is low.
Preferably, also weight, evaluating apparatus 112 can be assigned to above-mentioned predetermined evaluation rule according to scheduled Weighted Rule
According to the equal weight, weighting obtains the evaluation of estimate corresponding to non click operation information to determine opinion rating, to realize to search
As a result it is evaluated.
In one example, preset Weighted Rule is shown：
1) when the situation evaluated search result is：80% or more user is based on same queries in multiple users
Input new search sequence after the acquisition search result of sequence, then the corresponding evaluation of estimate of the situation be -10, and the evaluation of estimate with
Possessed weight is 0.5 in evaluation of estimate corresponding to the entire non click operation information of determination,
2) when the situation evaluated search result is：Stroke of multiple users in each search result items of search result
It is more than that predetermined draw selects frequency threshold value range maximum value 3 times to select number mean value, then the corresponding evaluation of estimate of the situation is 10, and the evaluation
Value for determining in the evaluation of estimate corresponding to entire non click operation information that possessed weight is 0.2,
3) multiple users are more than predetermined hovering number threshold in the hovering number mean value of each search result items of search result
It is worth range maximum value 5 times, then the corresponding evaluation of estimate of the situation is 10, and the evaluation of estimate is for determining entire click operation letter
Possessed weight is 0.2 in the corresponding evaluation of estimate of breath,
4) multiple users are more than predetermined hovering duration threshold in the hovering duration mean value of each search result items of search result
It is worth range maximum value 120 seconds, then the corresponding evaluation of estimate of the situation is 10, and the evaluation of estimate is for determining entire click operation
Possessed weight is 0.1 in evaluation of estimate corresponding to information；
Non click operation information shows multiple users in the search result based on same search sequence " Grand National Theatre "
It is 5 times to draw selection operation number mean value to each search result items in result of page searching, that is, is more than that predetermined draw selects frequency threshold value model
Enclose maximum value 3 times, such user is 6 times to the hovering number mean value of each search result items in the result of page searching, i.e.,
More than predetermined hovering frequency threshold value range maximum value 5 times, such user is in the result of page searching to each search result items
Hovering duration be more than predetermined hovering duration threshold range maximum value 120 seconds, and 90% user searches at this in such user
New search sequence is not inputted in rope results page, then evaluating apparatus 112 is to the evaluation corresponding to such non click operation information
It is 5 (=10 × 0.2+10 × 0.2+10 × 0.1) that value weighting, which is obtained to the evaluation of estimate of search result, is more than predetermined weights range most
Big value 3 determines that opinion rating is advanced.
Those skilled in the art will be understood that the above-mentioned mode evaluated search result is only for example, other are existing
Or the mode evaluated search result being likely to occur from now on is such as applicable to the present invention, should also be included in protection of the present invention
Within range, and it is incorporated herein by reference.
Preferably, it is continuously to work between operation information acquisition device 111 and evaluating apparatus 112.Specifically, it grasps
Make information acquisition device 111 and constantly obtains one or more users to the search result to be evaluated based on same queries sequence
Non click operation information；Then, evaluating apparatus 112 is also constantly according to the non click operation information, to described search knot
Fruit is evaluated.Here, it will be understood by those skilled in the art that " lasting ", which refers to each device, constantly carries out above-mentioned click operation letter
The acquisition of breath, the evaluation to search result, until meeting predetermined stoppage condition, such as acquisition request device 111 in the long period
Acquisition of the interior stopping to non click operation information.
Preferably (referring to Fig.1), evaluating apparatus 112 is sent out according to non click operation information and such non click operation information
Raw temporal information, evaluates search result.
The operation information of new search sequence is inputted here, the non click operation information includes user, to search result
Each search result items draw selection operation information, hovering operation information and it is such input, draw choosing, hovering operation occur when
Between information.
Here, user's can represent to it in rear operation in the negative of preceding operation, thus grasped in the click of rear generation
The evaluation weight of work is more than the evaluation weight in the click operation of preceding generation.
In one example, non click operation information shows that a certain user does not input new inquiry sequence after obtaining search result
Row, while it is 12 draw time for terminating of selection operation and this stroke of selection operation to the search result items A in search result:01PM,
And the user also carries out the search result items B in such search result drawing time for terminating of selection operation and this stroke of selection operation and is
12:03PM；Then evaluating apparatus 112 assigns the selection operation of drawing to search result items B in rear generation according to scheduled Weighted Rule
Give evaluation of estimate 20, and weight 0.8, to search result items A draw selection operation assign evaluation of estimate 10, and weight 0.2, then to this
Etc. Weight corresponding to non click operation informations to obtain weights be 9 (=(20 × 0.8+10 × 0.2)/2), be located at predetermined power
It is worth in range (6 to 11), determines that opinion rating is middle rank.
Those skilled in the art will be understood that the above-mentioned mode evaluated search result is only for example, other are existing
Or the mode evaluated search result being likely to occur from now on is such as applicable to the present invention, should also be included in protection of the present invention
Within range, and it is incorporated herein by reference.
More preferably (referring to Fig.1), evaluating apparatus 112 is according to non click operation information, and combines user to search result
Clicking operation information, which is evaluated.
Specifically, evaluating apparatus 112 can operate click and clicking operation assigns weight, according to predetermined Weighted Rule,
The evaluation of estimate after weighting is obtained, to determine the opinion rating to search result.
In one example, predetermined Weighted Rule is shown：The corresponding evaluation weight of clicking operation is 0.6, click operation
Evaluation weight is 0.4；User has clicking operation to each search result items, and the corresponding evaluation of estimate of the clicking operation is 8, simultaneously
Determine that its corresponding opinion rating is high, its weights value is 18 according to non click operation information, then evaluating apparatus 112 calculates
Weights 12 (=8 × 0.6+18 × 0.4) are obtained, 12 are more than predetermined opinion rating threshold range maximum value 11, it is determined that evaluation etc.
Grade is advanced.
Those skilled in the art will be understood that the above-mentioned mode evaluated search result is only for example, other are existing
Or the mode evaluated search result being likely to occur from now on is such as applicable to the present invention, should also be included in protection of the present invention
Within range, and it is incorporated herein by reference.
Here, one or more users operate the click of the search result to be evaluated based on same queries sequence
It is combined with clicking operation, user can be met search by clicking search result to meet search need and without clicking
The situation of demand includes to further increase the accuracy evaluated search result into evaluation criterion.
Fig. 2 shows the method flow diagrams for evaluating search result according to one aspect of the invention.
Here, valuator device 1 can be a network equipment or the function module that is located therein, wherein network equipment packet
Include but be not limited to what computer, network host, single network server, multiple network server collection or multiple servers were constituted
Cloud, here, cloud is made of a large amount of computers or network server for being based on cloud computing (Cloud Computing), wherein cloud meter
It is one kind of Distributed Calculation, a super virtual computer being made of the computer collection of a group loose couplings；Evaluation is set
Standby 1 can also be user equipment comprising but be not limited to any type and can pass through keyboard, remote controler, touch tablet or sound with user
Control electronic product, such as computer, smart mobile phone, PDA, game machine or IPTV etc. that equipment carries out human-computer interaction.
It is described in detail referring to Fig. 2 to evaluate valuator device 1 process of search result：
Specifically, in step sl, valuator device 1 obtains one or more users to be evaluated based on same queries sequence
The non click operation information of the search result of row.
Here, the non click operation information includes but not limited to any one of following：
1) user inputs the operation information of new search sequence；For example, after having obtained search result, user ties in search
Search input frame in the fruit page carries out input operation again, and the input operates corresponding new search sequence and previous inquiry sequence
Row are related, such as have partial query keyword identical in two search sequences, then can determine user its search need not
New search sequence is inputted in the case of being satisfied；
2) stroke selection operation information of the user to each search result items of search result；Wherein, described stroke of selection operation information
Including but not limited to user to each search result items of search result draw the number of selection operation；For example, according to mouse point
Under operation relevant information, such as the temporal information under putting lower position coordinates and putting, and mouse when being accordingly released mouse
The operation relevant information of release, such as position coordinates of release and the temporal information of release draw choosing to record such operation to be primary
Operation, meanwhile, according to the position coordinates of position coordinates and release under the point, determine that the corresponding search result of selection operation is drawn in this time
, and according to the temporal information of temporal information and relieving under the point, determine that the duration of selection operation is drawn in this time；
3) hovering operation information of the user to each search result items of search result；
Wherein, the user to the hovering operation information of each search result items of described search result include it is following at least
Any one：
A) hovering number of operations of the user in each search result items of search result；For example, obtaining mouse in real time
It moves into the time of some search result items region of search result and removes the time in the region, when immigration time and shifting
When going out the time interval of time and being more than predetermined time interval threshold value, it is recorded as operation of once hovering, and then counting user is searched at this
Total hovering number of operations in result of page searching where hitch fruit；
B) duration of each hovering operation of the user in each search result items of search result；For example, in real time
Ground obtains the time of some search result items region of mouse immigration search result and removes the time in the region, record
Move into the time interval of time and throughput time, i.e., the duration that hovering operates every time.
Those skilled in the art will be understood that above-mentioned hovering operation information is only for example, other are existing or may go out from now on
Existing hovering operation information is such as applicable to the present invention, should also be included within the scope of the present invention, and wrap by reference
Contained in this.
Those skilled in the art will be understood that above-mentioned non click operation information is only for example, other are existing or from now on may
The non click operation information of appearance is such as applicable to the present invention, should also be included within the scope of the present invention, and with reference side
Formula is incorporated herein.
Here, the mode for obtaining non click operation information includes but not limited to following any case：
1) in step sl, valuator device 1 obtain a user by user equipment to be evaluated based on same queries
The non click operation information that the search result of sequence executes；
2) in step sl, valuator device 1 is answered event triggering in real time or is received periodically and sent from third party device
Multiple users to the non click operation information of the search result to be evaluated based on same queries sequence.
In one example, when valuator device 1 is the network equipment, first, user by the interactive mode with user equipment,
Including but not limited to keyboard, mouse, remote controler, touch tablet or handwriting equipment, browser software or client with user equipment
Software interacts.By taking mouse as an example, user carries out drawing choosing behaviour in the result of page searching of the browser software of user equipment
When making, which obtains stroke selection operation of the user to a certain search result items of search result in real time, such as user sets
The standby operation relevant information obtained first under mouse point then works as release such as the temporal information under the position coordinates and point under putting
When the mouse, the operation relevant information of mouse release, such as position coordinates of release and the temporal information of release are obtained, and record
This time operation is a stroke selection operation, meanwhile, according to the position coordinates of position coordinates and release under the point, determine that selection operation is drawn in this time
Corresponding search result items, and according to the temporal information of temporal information and release under the point, determine this time draw selection operation when
It is long；So that it is determined that drawing the corresponding non click operation information of selection operation with the user, then the non click operation information is passed through
The communication mode of agreement is sent to valuator device 1；Then, in step sl, valuator device 1 receives click operation in real time
Information.
In another example, in step sl, the Application Programming Interface that valuator device 1 is provided via third party device
(API), it is triggered ground by predetermined condition or event or regularly transmits and receives multiple users to be evaluated to the third party device
The request message for the non click operation information that search result based on same queries sequence executes, and receive third party device sound
The click that the search result to be evaluated based on same queries sequence should be executed in multiple users that the request message returns
Operation information.In another example, third party device actively pushes multiple users to be evaluated based on identical to valuator device 1
The non click operation information that the search result of search sequence executes, in step sl, valuator device 1 receives multiple user and treats
The non click operation information that the search result based on same queries sequence of evaluation executes.
Those skilled in the art will be understood that the mode of above-mentioned acquisition non click operation information is only for example, other are existing
Or the mode for the acquisition non click operation information being likely to occur from now on is such as applicable to the present invention, should also be included in protection of the present invention
Within range, and it is incorporated herein by reference.
Then, in step s 2, the non click operation information that valuator device 1 obtains in step sl according to it, to search
As a result it is evaluated.
Here, the situation that described search result is evaluated according to scheduled evaluation rule include but not limited to down toward
It is any one of few：
1) user inputs new search sequence after obtaining search result；
For example, if user re-enters new search sequence after obtaining search result in result of page searching,
In step S2, valuator device 1 determines that the opinion rating of the search result is low；
2) user selects number to select frequency threshold value more than predetermined draw in the drawing for each search result items of search result；
For example, if user selects number to select frequency threshold value model more than predetermined draw in the drawing for each search result items of search result
Maximum value is enclosed, then in step s 2, valuator device 1 determines that the opinion rating of the search result is height；
3) user is more than predetermined hovering frequency threshold value in the hovering number of each search result items of search result；
For example, if user is more than predetermined hovering frequency threshold value model in the hovering number of each search result items of search result
Maximum value is enclosed, then in step s 2, valuator device 1 determines that the opinion rating of the search result is height；
4) user is more than predetermined hovering duration threshold value in the hovering duration of each search result items of search result；
For example, if user is more than predetermined hovering duration threshold value model in the hovering duration of each search result items of search result
Maximum value is enclosed, then in step s 2, valuator device 1 determines that the opinion rating of the search result is height.
Those skilled in the art will be understood that the above-mentioned scheduled evaluation rule of items can not only be individually used for valuator device
1 pair of search result is evaluated, and can also evaluate search result wherein multinomial combination for valuator device 1.
Here, the evaluation criterion evaluated described search result includes but not limited to following any form：
A) predetermined opinion rating, such as predetermined opinion rating are high, medium and low；For example, making a reservation for 80% or more in multiple users
User inputs new search sequence after obtaining the search result based on same queries sequence and not to each search result items
Have and draw the operations such as choosing, hovering, then opinion rating is rudimentary；For another example 80% or more user is obtaining in predetermined multiple users
After search result based on same queries sequence, number is selected to be drawn more than predetermined the drawing for a certain search result items of the search result
Frequency threshold value range maximum value is selected, then opinion rating is middle rank；In another example 80% or more user is obtaining in default multiple users
After the search result based on same queries sequence, meet the above-mentioned situation 2 evaluated search result), 3), 4) in two
Or two or more, and do not input new search sequence, then opinion rating is advanced；
B) predetermined evaluation criterion preferably/it is bad, for example, if in multiple users 80% or more user obtain be based on phase
The behaviour such as choosing, hovering are drawn with inputting new search sequence after the search result of search sequence and not having to each search result items
Make, then evaluation result is bad；In another example if 80% or more user is obtaining based on same queries sequence in multiple users
Search result after, meet the above-mentioned situation 2 evaluated search result), 3), 4) in two or two or more, and be
New search sequence is inputted, then evaluation result is preferably.
In one example, non click operation information shows in multiple users 85% user based on same search sequence
New search sequence is re-entered in the result of page searching of the search result of " sound of chopping wood Adventures of Pei ", and to each of the search result
A search result items do not draw the operations such as choosing, hovering, then in step s 2, valuator device 1 evaluates the search result
Opinion rating is low.
Preferably, also weight can be assigned to above-mentioned predetermined evaluation rule according to scheduled Weighted Rule to comment in step s 2
For valence equipment 1 according to the equal weight, weighting obtains the evaluation of estimate corresponding to non click operation information to determine opinion rating, to real
Now search result is evaluated.
In one example, preset Weighted Rule is shown：
1) when the situation evaluated search result is：80% or more user is based on same queries in multiple users
Input new search sequence after the acquisition search result of sequence, then the corresponding evaluation of estimate of the situation be -10, and the evaluation of estimate with
Possessed weight is 0.5 in evaluation of estimate corresponding to the entire non click operation information of determination,
2) when the situation evaluated search result is：Stroke of multiple users in each search result items of search result
It is more than that predetermined draw selects frequency threshold value range maximum value 3 times to select number mean value, then the corresponding evaluation of estimate of the situation is 10, and the evaluation
Value for determining in the evaluation of estimate corresponding to entire non click operation information that possessed weight is 0.2,
3) multiple users are more than predetermined hovering number threshold in the hovering number mean value of each search result items of search result
It is worth range maximum value 5 times, then the corresponding evaluation of estimate of the situation is 10, and the evaluation of estimate is for determining entire click operation letter
Possessed weight is 0.2 in the corresponding evaluation of estimate of breath,
4) multiple users are more than predetermined hovering duration threshold in the hovering duration mean value of each search result items of search result
It is worth range maximum value 120 seconds, then the corresponding evaluation of estimate of the situation is 10, and the evaluation of estimate is for determining entire click operation
Possessed weight is 0.1 in evaluation of estimate corresponding to information；
Non click operation information shows multiple users in the search result based on same search sequence " Grand National Theatre "
It is 5 times to draw selection operation number mean value to each search result items in result of page searching, that is, is more than that predetermined draw selects frequency threshold value model
Enclose maximum value 3 times, such user is 6 times to the hovering number mean value of each search result items in the result of page searching, i.e.,
More than predetermined hovering frequency threshold value range maximum value 5 times, such user is in the result of page searching to each search result items
Hovering duration be more than predetermined hovering duration threshold range maximum value 120 seconds, and 90% user searches at this in such user
New search sequence is not inputted in rope results page, then in step s 2, valuator device 1 is right to such non click operation information institute
It is 5 (=10 × 0.2+10 × 0.2+10 × 0.1) that the evaluation of estimate weighting answered, which is obtained to the evaluation of estimate of search result, is more than predetermined power
It is worth range maximum value 3, determines that opinion rating is advanced.
Those skilled in the art will be understood that the above-mentioned mode evaluated search result is only for example, other are existing
Or the mode evaluated search result being likely to occur from now on is such as applicable to the present invention, should also be included in protection of the present invention
Within range, and it is incorporated herein by reference.
Preferably, valuator device 1 is continuously to work in step S1 and step S2.Specifically, in step sl,
Valuator device 1 constantly obtains click of one or more users to the search result to be evaluated based on same queries sequence
Operation information；Then, in step s 2, valuator device 1 is also constantly according to the non click operation information, to described search knot
Fruit is evaluated.Here, it will be understood by those skilled in the art that " lasting " to refer to that valuator device 1 constantly carries out in each step above-mentioned
The acquisition of non click operation information, the evaluation to search result, until meet predetermined stoppage condition, such as valuator device 1 compared with
Stop the acquisition to non click operation information in for a long time.
Preferably (with reference to Fig. 2), in step s 2, valuator device 1 is according to non click operation information and such click
The temporal information that operation information occurs, evaluates search result.
The operation information of new search sequence is inputted here, the non click operation information includes user, to search result
Each search result items draw selection operation information, hovering operation information and it is such input, draw choosing, hovering operation occur when
Between information.
Here, user's can represent to it in rear operation in the negative of preceding operation, thus grasped in the click of rear generation
The evaluation weight of work is more than the evaluation weight in the click operation of preceding generation.
In one example, non click operation information shows that a certain user does not input new inquiry sequence after obtaining search result
Row, while it is 12 draw time for terminating of selection operation and this stroke of selection operation to the search result items A in search result:01PM,
And the user also carries out the search result items B in such search result drawing time for terminating of selection operation and this stroke of selection operation and is
12:03PM；Then in step s 2, valuator device 1 is according to scheduled Weighted Rule, in rear generation to search result items B's
Draw selection operation and assign evaluation of estimate 20, and weight 0.8 assigns evaluation of estimate 10 to the selection operation of drawing of search result items A, and weight
0.2, then to corresponding to such non click operation information Weight obtain weights be 9 (=(20 × 0.8+10 × 0.2)/
2), it is located in predetermined weights range (6 to 11), determines that opinion rating is middle rank.
Those skilled in the art will be understood that the above-mentioned mode evaluated search result is only for example, other are existing
Or the mode evaluated search result being likely to occur from now on is such as applicable to the present invention, should also be included in protection of the present invention
Within range, and it is incorporated herein by reference.
More preferably (with reference to Fig. 2), in step s 2, valuator device 1 combines user couple according to non click operation information
The clicking operation information of search result, evaluates the search result.
Specifically, in step s 2, valuator device 1 can operate click and clicking operation assigns weight, according to predetermined
Weighted Rule obtains the evaluation of estimate after weighting, to determine the opinion rating to search result.
In one example, predetermined Weighted Rule is shown：The corresponding evaluation weight of clicking operation is 0.6, click operation
Evaluation weight is 0.4；User has clicking operation to each search result items, and the corresponding evaluation of estimate of the clicking operation is 8, simultaneously
Determine that its corresponding opinion rating is high, its weights value is 18 according to non click operation information, then in step s 2, evaluation
Equipment 1, which calculates, obtains weights 12 (=8 × 0.6+18 × 0.4), and 12 are more than predetermined opinion rating threshold range maximum value 11, then really
It is advanced to determine opinion rating.
Those skilled in the art will be understood that the above-mentioned mode evaluated search result is only for example, other are existing
Or the mode evaluated search result being likely to occur from now on is such as applicable to the present invention, should also be included in protection of the present invention
Within range, and it is incorporated herein by reference.
Here, one or more users operate the click of the search result to be evaluated based on same queries sequence
It is combined with clicking operation, user can be met search by clicking search result to meet search need and without clicking
The situation of demand includes to further increase the accuracy evaluated search result into evaluation criterion.
It is obvious to a person skilled in the art that invention is not limited to the details of the above exemplary embodiments, Er Qie
In the case of without departing substantially from spirit or essential attributes of the invention, the present invention can be realized in other specific forms.Therefore, no matter
From the point of view of which point, the present embodiments are to be considered as illustrative and not restrictive, and the scope of the present invention is by appended power
Profit requires rather than above description limits, it is intended that all by what is fallen within the meaning and scope of the equivalent requirements of the claims
Variation includes within the present invention.Any reference signs in the claims should not be construed as limiting the involved claims.This
Outside, it is clear that one word of " comprising " is not excluded for other units or step, and odd number is not excluded for plural number.That is stated in device claim is multiple
Unit or device can also be realized by a unit or device by software or hardware.The first, the second equal words are used for table
Show title, and does not represent any particular order.
Claims (8)
1. a kind of computer implemented method for evaluating search result, this approach includes the following steps：
A. non click operation information of one or more users to the search result to be evaluated based on same queries sequence is obtained；
B. according to the non click operation information, described search result is evaluated；
Wherein, the step b includes：
According to the temporal information that the non click operation information and the non click operation information occur, to described search knot
Fruit is evaluated, wherein is more than the evaluation in the click operation of preceding generation in the evaluation weight that the click of rear generation operates
Weight；
Wherein, the step a includes the following steps：
Event triggering is answered to receive the multiple users sent from third party device in real time or periodically to be evaluated based on phase
With the non click operation information of the search result of search sequence.
2. according to the method described in claim 1, wherein, the non click operation information includes following at least any one：
The user inputs the operation information of new search sequence；
Stroke selection operation information of the user to each search result items of described search result；
Hovering operation information of the user to each search result items of described search result.
3. according to the method described in claim 2, wherein, the user is outstanding to each search result items of described search result
It includes following at least any one to stop operation information：
Hovering number of operations of the user in each search result items of described search result；
The duration of each hovering operation of the user in each search result items of described search result.
4. according to the method in any one of claims 1 to 3, wherein the step b includes：
According to the non click operation information, and in conjunction with the user to the clicking operation information of described search result, to described
Search result is evaluated.
5. a kind of equipment for evaluating search result, the equipment include：
Operation information acquisition device, for obtaining one or more users to the search knot to be evaluated based on same queries sequence
The non click operation information of fruit；
Evaluating apparatus, for according to the non click operation information, evaluating described search result；
Wherein, the evaluating apparatus be used for according to the non click operation information and the non click operation information occur when
Between information, described search result is evaluated, wherein rear generation click operate evaluation weight be more than in preceding generation
Click operation evaluation weight；
Wherein, the operation information acquisition device is used for：
Event triggering is answered to receive the multiple users sent from third party device in real time or periodically to be evaluated based on phase
With the non click operation information of the search result of search sequence.
6. equipment according to claim 5, wherein the non click operation information includes following at least any one：
The user inputs the operation information of new search sequence；
Stroke selection operation information of the user to each search result items of described search result；
Hovering operation information of the user to each search result items of described search result.
7. equipment according to claim 6, wherein the user is to the outstanding of each search result items of described search result
It includes following at least any one to stop operation information：
Hovering number of operations of the user in each search result items of described search result；
The duration of each hovering operation of the user in each search result items of described search result.
8. equipment according to any one of claims 5 to 7, wherein the evaluating apparatus is used for according to the click
Operation information, and the clicking operation information of described search result evaluates described search result in conjunction with the user.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110457424.7A CN103186619B (en) | 2011-12-30 | 2011-12-30 | A kind of method and apparatus of the evaluation search result based on non click operation information |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110457424.7A CN103186619B (en) | 2011-12-30 | 2011-12-30 | A kind of method and apparatus of the evaluation search result based on non click operation information |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103186619A CN103186619A (en) | 2013-07-03 |
| CN103186619B true CN103186619B (en) | 2018-08-07 |
Family
ID=48677788
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201110457424.7A Active CN103186619B (en) | 2011-12-30 | 2011-12-30 | A kind of method and apparatus of the evaluation search result based on non click operation information |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103186619B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| FR3006472B1 (en) * | 2013-05-31 | 2016-12-30 | Xilopix | METHOD OF SEARCHING IN A DATABASE |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6269361B1 (en) * | 1999-05-28 | 2001-07-31 | Goto.Com | System and method for influencing a position on a search result list generated by a computer network search engine |
| CN1818908A (en) * | 2006-03-16 | 2006-08-16 | 董崇军 | Feedbakc information use of searcher in search engine |
| CN101030210A (en) * | 2006-10-08 | 2007-09-05 | 胡继强 | Method for searching sort by user action |
| CN101454780A (en) * | 2006-03-30 | 2009-06-10 | 谷歌公司 | Method of generating a website profile bases on monitoring user activities |
| CN102298615A (en) * | 2011-07-29 | 2011-12-28 | 百度在线网络技术（北京）有限公司 | Method for displaying research result realized by computer and equipment |
-
2011
- 2011-12-30 CN CN201110457424.7A patent/CN103186619B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6269361B1 (en) * | 1999-05-28 | 2001-07-31 | Goto.Com | System and method for influencing a position on a search result list generated by a computer network search engine |
| CN1818908A (en) * | 2006-03-16 | 2006-08-16 | 董崇军 | Feedbakc information use of searcher in search engine |
| CN101454780A (en) * | 2006-03-30 | 2009-06-10 | 谷歌公司 | Method of generating a website profile bases on monitoring user activities |
| CN101030210A (en) * | 2006-10-08 | 2007-09-05 | 胡继强 | Method for searching sort by user action |
| CN102298615A (en) * | 2011-07-29 | 2011-12-28 | 百度在线网络技术（北京）有限公司 | Method for displaying research result realized by computer and equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103186619A (en) | 2013-07-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11727048B2 (en) | Methods, systems, and media for presenting recommended content based on social cues | |
| CN108040294B (en) | Method, system, and computer readable medium for recommending videos | |
| Abel et al. | Leveraging the semantics of tweets for adaptive faceted search on twitter | |
| US9064016B2 (en) | Ranking search results using result repetition | |
| CN102316130B (en) | A kind of behavior based on user judges the method and apparatus of the close and distant degree of itself and good friend | |
| CN103970754B (en) | The automatically selecting method and device of article | |
| US9015170B2 (en) | Entropy-based mixing and personalization | |
| US20140351179A1 (en) | Information push method and apparatus | |
| KR101764696B1 (en) | Method and System for determination of social network hot topic in consideration of user’s influence and time | |
| CN103577511B (en) | A kind of method for realizing media application, apparatus and system | |
| Shokouhi et al. | Fighting search engine amnesia: Reranking repeated results | |
| CN103744916B (en) | A kind of method and apparatus for sharing temperature information for being used to determine target video | |
| CN104657372A (en) | Page operation data processing method and device | |
| CN109299420A (en) | Social media account processing method, device, equipment and readable storage medium storing program for executing | |
| CN102955829B (en) | For the method being ranked up to resource items, device and equipment | |
| EP2946312A2 (en) | Systems and methods for displaying user-generated content | |
| Liu et al. | Research of personalized news recommendation system based on hybrid collaborative filtering algorithm | |
| CN107645667A (en) | Video recommendation method, system and server apparatus | |
| CN109688217B (en) | Message pushing method and device and electronic equipment | |
| US8825698B1 (en) | Showing prominent users for information retrieval requests | |
| CN103186619B (en) | A kind of method and apparatus of the evaluation search result based on non click operation information | |
| CN113111216B (en) | Advertisement recommendation method, device, equipment and storage medium | |
| CN108830636A (en) | A kind of inquiry amount method and apparatus of any active ues | |
| US8745074B1 (en) | Method and system for evaluating content via a computer network | |
| CN103530789A (en) | Method, device and apparatus for determining key index terms |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |