CN112541710A - Search product quality evaluation method and device, electronic equipment and storage medium - Google Patents

Search product quality evaluation method and device, electronic equipment and storage medium Download PDF

Info

Publication number
CN112541710A
CN112541710A CN202011561346.0A CN202011561346A CN112541710A CN 112541710 A CN112541710 A CN 112541710A CN 202011561346 A CN202011561346 A CN 202011561346A CN 112541710 A CN112541710 A CN 112541710A
Authority
CN
China
Prior art keywords
search
target
evaluation
product
evaluation card
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202011561346.0A
Other languages
Chinese (zh)
Other versions
CN112541710B (en
Inventor
林泽诚
高晖
李梦婷
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Baidu Netcom Science and Technology Co Ltd
Original Assignee
Beijing Baidu Netcom Science and Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Baidu Netcom Science and Technology Co Ltd filed Critical Beijing Baidu Netcom Science and Technology Co Ltd
Priority to CN202011561346.0A priority Critical patent/CN112541710B/en
Publication of CN112541710A publication Critical patent/CN112541710A/en
Application granted granted Critical
Publication of CN112541710B publication Critical patent/CN112541710B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/06Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
    • G06Q10/063Operations research, analysis or management
    • G06Q10/0639Performance analysis of employees; Performance analysis of enterprise or organisation operations
    • G06Q10/06393Score-carding, benchmarking or key performance indicator [KPI] analysis
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/06Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
    • G06Q10/063Operations research, analysis or management
    • G06Q10/0639Performance analysis of employees; Performance analysis of enterprise or organisation operations
    • G06Q10/06395Quality analysis or management

Landscapes

  • Business, Economics & Management (AREA)
  • Human Resources & Organizations (AREA)
  • Engineering & Computer Science (AREA)
  • Strategic Management (AREA)
  • Development Economics (AREA)
  • Economics (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Educational Administration (AREA)
  • Operations Research (AREA)
  • Marketing (AREA)
  • Game Theory and Decision Science (AREA)
  • Quality & Reliability (AREA)
  • Tourism & Hospitality (AREA)
  • Physics & Mathematics (AREA)
  • General Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The application discloses a method and a device for evaluating the quality of a search product, electronic equipment and a storage medium, and relates to the technical field of internet and the technical field of information search. The specific implementation scheme is as follows: acquiring a target evaluation card of a target vertical type search product; binding a target evaluation card with a search result of a target vertical search product, and outputting the search result bound with the target evaluation card; acquiring user feedback data returned aiming at the search result bound with the target evaluation card; and evaluating the searching quality of the target vertical type searching product based on the user feedback data of the target vertical type searching product. According to the technical scheme, the evaluation efficiency of the search quality of the vertical search products can be improved.

Description

Search product quality evaluation method and device, electronic equipment and storage medium
Technical Field
The application relates to the technical field of internet, in particular to the technical field of information search.
Background
The search system is a complex network system that aggregates and presents the premium resources of the entire network to the user. With the development of search technology, the complexity of searching products becomes high, and the feedback of a user on product experience is difficult to be positioned on a certain vertical type of search products, so that a great deal of difficulty is caused to search quality evaluation, and the evaluation efficiency is low.
Disclosure of Invention
The application provides a search product quality evaluation method, a search product quality evaluation device, an electronic device, a storage medium and a computer program product.
According to an aspect of the present application, there is provided a search product quality evaluation method including:
acquiring a target evaluation card of a target vertical type search product;
binding a target evaluation card with a search result of the target vertical search product, and outputting the search result bound with the target evaluation card;
acquiring user feedback data returned aiming at the search result bound with the target evaluation card;
and evaluating the searching quality of the target vertical type searching product based on the user feedback data of the target vertical type searching product.
According to another aspect of the present application, there is provided a search product quality evaluation apparatus including:
the recall unit is used for acquiring a target evaluation card of a target vertical search product;
the binding unit is used for binding the target evaluation card with the search result of the target vertical type search product and outputting the search result bound with the target evaluation card;
the acquisition unit is used for acquiring user feedback data returned aiming at the search result bound with the target evaluation card;
and the evaluation unit is used for evaluating the search quality of the target vertical type search product based on the user feedback data of the target vertical type search product.
According to another aspect of the present disclosure, there is provided an electronic device including:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein,
the memory stores instructions executable by the at least one processor to cause the at least one processor to perform the method of any of the embodiments of the present application.
According to another aspect of the present disclosure, there is provided a non-transitory computer readable storage medium having stored thereon computer instructions for causing a computer to perform a method in any of the embodiments of the present application.
According to another aspect of the present disclosure, a computer program product is provided, comprising a computer program which, when executed by a processor, implements the method word in any of the embodiments of the present application.
According to the technical scheme, the evaluation efficiency of the search quality of the vertical search products can be improved.
It should be understood that the statements in this section do not necessarily identify key or critical features of the embodiments of the present application, nor do they limit the scope of the present application. Other features of the present application will become apparent from the following description.
Drawings
The drawings are included to provide a better understanding of the present solution and are not intended to limit the present application. Wherein:
FIG. 1 is a first schematic diagram of a search product quality assessment method according to one embodiment of the present application;
FIG. 2 is a second schematic diagram of a search product quality assessment method according to one embodiment of the present application;
FIG. 3 is a third schematic diagram of a search product quality assessment method according to one embodiment of the present application;
FIG. 4 is a fourth schematic diagram of a search product quality assessment method according to one embodiment of the present application;
FIG. 5 is a fifth schematic diagram of a search product quality assessment method according to one embodiment of the present application;
FIG. 6 is a sixth schematic diagram of a search product quality assessment method according to one embodiment of the present application;
FIG. 7 is a schematic diagram of user feedback data for querying a target vertical category search product, according to one embodiment of the present application;
FIG. 8 is an architectural diagram illustrating an embodiment of the present application for evaluating search quality for vertical category search products;
FIG. 9 is a schematic diagram of a search product quality assessment apparatus according to one embodiment of the present application;
FIG. 10 is a schematic diagram of a search product quality assessment apparatus according to yet another embodiment of the present application;
fig. 11 is a block diagram of an electronic device for implementing the search product quality evaluation method according to the embodiment of the present application.
Detailed Description
The following description of the exemplary embodiments of the present application, taken in conjunction with the accompanying drawings, includes various details of the embodiments of the application for the understanding of the same, which are to be considered exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present application. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.
Fig. 1 shows a schematic diagram of a search product quality evaluation method according to an embodiment of the present application, which may be applied to an electronic device including, but not limited to, a fixed device and/or a mobile device, for example, the fixed device includes, but not limited to, a server, and the server may be a cloud server or a general server. For example, mobile devices include, but are not limited to: one or more of a cell phone or a tablet computer. As shown in fig. 1, the method includes:
step S11, acquiring a target evaluation card of a target vertical search product;
step S12, binding the target evaluation card with the search result of the target vertical search product, and outputting the search result bound with the target evaluation card;
step S13, obtaining the user feedback data returned for the search result binding the target evaluation card;
and step S14, evaluating the search quality of the target vertical type search product based on the user feedback data of the target vertical type search product.
Wherein the vertical type search products are search products with one or more obvious uniform characteristics. Each search product has a vertical line of search products that is based on the search. For example, search for "Benz Car", is divided into the vertical class of cars; search for "cold" and are classified into the medical vertical category.
Wherein different vertical search products correspond to different evaluation cards. Illustratively, the vertical type search product M1 is targeted, and its corresponding target evaluation card is n 1; the vertical class search product M2 is a target vertical class search product, and its corresponding target evaluation card is n 2.
Wherein the evaluation card comprises at least one or more of the following information:
evaluating the evaluation condition of the current search result, for example, evaluating in a scoring mode, wherein the satisfaction is 5 points, the comparison is satisfactory to 2 points, and the comparison is unsatisfactory to 1 point; for another example, the evaluation is performed in the form of a rating star, and the satisfaction is 5 stars, the comparison is satisfactory 2 stars, and is not satisfactory 1 star.
Opinions given to the current search result, such as writing satisfactory points; as another example, an unsatisfactory spot is written.
The binding positions are not limited, and the specific binding positions can be set or adjusted according to design requirements. Because the evaluation card is bound with the search result, the effectiveness of the user feedback data obtained based on the evaluation card is stronger. Illustratively, the evaluation card is bound behind the search results; or the evaluation card is bound in front of the search result; still alternatively, the evaluation card is bound in the middle of the search results. In practical application, the evaluation card can be bound behind the search result to improve the search experience of the user.
Wherein, the user feedback data is feedback information given by the user based on the target evaluation card.
Therefore, according to the scheme, the user feedback data are collected in the form of binding the target evaluation card of the target vertical type search product with the search result, so that the customized evaluation on the search quality of different vertical type search products can be realized, and the evaluation efficiency on the search quality of the vertical type search product can be improved.
In order to quickly obtain the evaluation card of the vertical search product, the corresponding evaluation card needs to be generated according to the input evaluation configuration information, so that the evaluation card can be obtained in real time in practical application. In the embodiment of the present application, on the basis of implementing any one of the methods described above, as shown in fig. 2, the method may further include the following steps:
and step S15, generating evaluation cards of different vertical search products according to the obtained evaluation configuration information of the different vertical search products.
Wherein the evaluation configuration information comprises an evaluation card identification.
Wherein, different evaluation cards correspond to different evaluation card identifications (ID, Identity).
Further, the evaluation configuration information further includes evaluation content. Wherein different vertical search products may correspond to different evaluation content.
In some embodiments, the electronic device receives evaluation configuration information sent by a terminal where a product manager is located through an external interface, and generates evaluation cards of different vertical search products according to the evaluation configuration information of the different vertical search products. The product manager can edit the evaluation content aiming at the interested function points of the search products, and then the edited evaluation content is bound to the corresponding search product function.
By the embodiment, the problem of flexibly configuring the evaluation content in the search process can be solved. Because the evaluation card can be generated for different vertical search products through the external interface, a product manager can realize automatic binding only by configuring the evaluation file and the corresponding product function according to own requirements, and the working efficiency of the product manager is improved.
On the basis of implementing any one of the above methods, as shown in fig. 3, the method may further include the following steps:
and step S16, determining the target evaluation card of the target vertical type search product according to the display probability of the target vertical type search product.
The presentation probability represents the probability of presenting the evaluation card in the search result, and can be specifically understood as the probability of binding the evaluation card on the search result. In practical application, the display probability can be set for different vertical search products according to the number of research users required by the different vertical search products, and the display probability corresponding to the number of the research users is set for the different vertical search products. The presentation probability can be adjusted according to actual requirements. For example, the current presentation probability is a%, a worker such as a product manager considers that the number of users returning product experience opinions based on the evaluation card is not enough to evaluate the search quality of the currently searched product, and the presentation probability can be adjusted to b%, where a is less than b, and a and b are positive integers.
Therefore, according to the scheme, the corresponding evaluation card is recalled according to the display probability of the target vertical search product, and the user feedback data is collected in a mode of binding the evaluation card with the search result, so that the customized evaluation on the search quality of different vertical search products can be realized, and the evaluation efficiency on the search quality of the vertical search product can be improved. And the evaluation card is output according to a certain display probability, so that the user feedback data required by the evaluation can be conveniently acquired, and the search experience of a normal user can be avoided being disturbed.
In the embodiment of the present application, on the basis of implementing any one of the methods described above, as shown in fig. 4, the method may further include the following steps:
and step S17, setting the display probability corresponding to the number of the research users for different vertical search products according to the number of the research users required by the different vertical search products.
The number of research users required by the vertical search product can be understood as the number of users who need to collect reply evaluation cards. The number of the research users can be set by workers such as a product manager according to requirements.
In some embodiments, the presentation probability is determined by a preset function that is variable by the number of research users. For example, the number of research users is input into a preset function, and the probability is displayed through the output of the preset function.
Through the embodiment, the customization of different vertical search products on the probability of displaying the evaluation card can be realized. The evaluation card is output according to a certain display probability, so that the user feedback data required by the evaluation can be conveniently acquired, and the search experience of a normal user can be avoided being disturbed.
In the embodiment of the present application, on the basis of implementing any one of the methods described above, as shown in fig. 5, the method may further include the following steps:
and step S18, establishing the corresponding relation between the resource identification and the evaluation card identification of different vertical search products.
Through the implementation mode, different evaluation contents can be displayed on different vertical search products, and customization of the different vertical search products on the evaluation contents is realized.
In the embodiment of the present application, on the basis of implementing any one of the methods described above, as shown in fig. 6, before step S11, the method further includes:
step S19, according to the corresponding relation between the resource identification and the evaluation card identification, determining the target evaluation card according to the evaluation card identification matched with the resource identification of the target vertical search product under the condition that the evaluation card identification matched with the resource identification of the target vertical search product exists.
That is, whether an evaluation card identifier matched with the resource identifier of the target vertical search product exists is determined according to the corresponding relation between the resource identifier and the evaluation card identifier; if the target evaluation card exists, the target evaluation card is determined according to the evaluation card identification matched with the resource identification of the target vertical type search product.
Through the embodiment, only when the evaluation card identification matched with the resource identification of the target vertical type search product is determined, the evaluation card corresponding to the evaluation card identification is recalled, so that the search experience of a normal user can be avoided to the greatest extent, and the customization of different vertical type search products on whether the evaluation card is recalled or not is realized.
In the embodiment of the present application, on the basis of implementing any one of the methods described above, step S13 includes: and inquiring to obtain the user feedback data of the target vertical type search product according to the evaluation card identifier of the target evaluation card bound by the target vertical type search product.
FIG. 7 is a diagram illustrating user feedback data for querying a target vertical search product, specifically, determining an evaluation card identifier matching a resource identifier of the target vertical search product according to a corresponding relationship between the resource identifier and the evaluation card identifier; and inquiring to obtain the user feedback data of the target vertical type search product according to the evaluation card identification matched with the resource identification of the target vertical type search product.
The user feedback data can be stored in a database, and the user feedback data of the evaluation cards of the vertical search products are stored in the database.
In the above embodiment, the corresponding evaluation card identifier is found according to the resource identifier, and then the corresponding user feedback data is found, so that the user feedback data can be quickly obtained, the evaluation customization of different vertical search products is realized, and the efficiency of evaluating the search quality of different vertical search products is improved.
Fig. 8 shows a schematic architecture diagram for evaluating the search quality of a vertical search product, and as can be seen from fig. 8, a product manager enters evaluation configuration information, such as an evaluation card identifier of an evaluation card to be edited and evaluation content included in the evaluation card, into a database through a platform to obtain a corresponding relationship between a resource identifier of the vertical search product and the evaluation card identifier, pushes the corresponding relationship into a search module, and after a search result is fed back, queries whether an evaluation card identifier matching the resource identifier of the vertical search product exists; and if so, determining whether to recall the evaluation card corresponding to the evaluation card identifier according to the display probability of the vertical type search product. The product manager only needs to search the evaluation card identification according to the resource identification of different vertical search products, inquire the user feedback data according to the evaluation card identification, and then evaluate the search quality of the target vertical search product according to the user feedback data. Therefore, the platform receives the configuration evaluation configuration information of the product manager for different vertical search products, determines whether to recall the evaluation card of the target vertical search product according to the display probability, and stores the user feedback data of each evaluation card, so that the customized evaluation of the different vertical search products is realized, and the high-efficiency evaluation and agility evaluation in each search stage can be realized.
It should be understood that the architecture shown in fig. 8 is an alternative specific implementation, and that various obvious changes and/or substitutions may be made by those skilled in the art based on the example of fig. 8, and still fall within the scope of the disclosure of the embodiments of the disclosure.
The search product quality evaluation method provided by the application can be used for items such as search engines or search recommendations. Illustratively, the execution subject of the method may be an electronic device, which may be a variety of search engine devices, such as a search engine server.
As an implementation of the above methods, the present application also provides a search product quality evaluation device. Fig. 9 shows a schematic diagram of the search product quality evaluation apparatus. As shown in fig. 9, the apparatus includes:
a recall unit 810, configured to obtain a target evaluation card of a target vertical search product;
a binding unit 820, configured to bind the target evaluation card with the search result of the target vertical search product, and output the search result bound with the target evaluation card;
an obtaining unit 830, configured to obtain user feedback data returned for the search result bound to the target evaluation card;
the evaluation unit 840 is configured to evaluate the search quality of the target vertical type search product based on the user feedback data of the target vertical type search product.
In some embodiments, as shown in fig. 10, the apparatus may further include:
the generating unit 850 is configured to generate evaluation cards of different vertical search products according to the acquired evaluation configuration information of the different vertical search products; wherein the evaluation configuration information includes an evaluation card identification.
In some embodiments, as shown in fig. 10, the apparatus may further comprise:
the first determining unit 860 is configured to determine a target evaluation card of a target vertical type search product according to the presentation probability of the target vertical type search product.
In some embodiments, as shown in fig. 10, the apparatus may further include:
the setting unit 870 is configured to set, according to the number of research users required for searching products of different vertical categories, the presentation probability corresponding to the number of research users for searching products of different vertical categories.
In some embodiments, as shown in fig. 10, the apparatus may further include:
an establishing unit 880, configured to establish a correspondence between the resource identifier and the evaluation card identifier of the different vertical search products.
In some embodiments, as shown in fig. 10, the apparatus may further include:
a second determining unit 890, configured to determine, according to the correspondence between the resource identifier and the evaluation card identifier, that there is an evaluation card identifier matching the resource identifier of the target vertical search product, and determine the target evaluation card according to the evaluation card identifier matching the resource identifier of the target vertical search product.
In some embodiments, the obtaining unit 830 is specifically configured to:
and inquiring to obtain the user feedback data of the target vertical type search product according to the evaluation card identification of the target evaluation card bound by the marked vertical type search product.
The search product quality evaluation device of the embodiment can realize customized evaluation on the search quality of different vertical search products and can improve the evaluation efficiency on the search quality of the vertical search products.
There is also provided, in accordance with an embodiment of the present application, an electronic device, a readable storage medium, and a computer program product.
As shown in fig. 11, it is a block diagram of an electronic device of a search product quality evaluation method according to an embodiment of the present application. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be examples only, and are not meant to limit implementations of the present application that are described and/or claimed herein.
As shown in fig. 11, the electronic apparatus includes: one or more processors 901, memory 902, and interfaces for connecting the various components, including a high-speed interface and a low-speed interface. The various components are interconnected using different buses and may be mounted on a common motherboard or in other manners as desired. The processor may process instructions for execution within the electronic device, including instructions stored in or on the memory to display Graphical information for a Graphical User Interface (GUI) on an external input/output device, such as a display device coupled to the Interface. In other embodiments, multiple processors and/or multiple buses may be used, along with multiple memories and multiple memories, as desired. Also, multiple electronic devices may be connected, with each device providing portions of the necessary operations (e.g., as a server array, a group of blade servers, or a multi-processor system). Fig. 11 illustrates an example of a processor 901.
Memory 902 is a non-transitory computer readable storage medium as provided herein. The memory stores instructions executable by the at least one processor to cause the at least one processor to perform the search product quality assessment method provided herein. The non-transitory computer-readable storage medium of the present application stores computer instructions for causing a computer to execute the search product quality assessment method provided by the present application.
The memory 902, which is a non-transitory computer-readable storage medium, may be used to store non-transitory software programs, non-transitory computer-executable programs, and modules, such as program instructions/modules corresponding to the search product quality assessment method in the embodiments of the present application (e.g., the recall unit 810, the binding unit 820, the obtaining unit 830, the assessment unit 840, the generation unit 850, the first determination unit 860, the setting unit 870, the establishment unit 880, and the second determination unit 890 shown in fig. 8). The processor 901 executes various functional applications of the server and data processing, i.e., implements the search product quality assessment method in the above-described method embodiments, by running non-transitory software programs, instructions, and modules stored in the memory 902.
The memory 902 may include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required for at least one function; the storage data area may store data created according to use of the electronic device searching for the product quality evaluation method, and the like. Further, the memory 902 may include high speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid state storage device. In some embodiments, the memory 902 may optionally include a memory remotely located from the processor 901, and such remote memory may be connected to the electronic device searching for the product quality assessment method via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The electronic device searching for the product quality evaluation method may further include: an input device 903 and an output device 904. The processor 901, the memory 902, the input device 903 and the output device 904 may be connected by a bus or other means, and fig. 11 illustrates the connection by a bus as an example.
The input device 903 may receive input numeric or character information and generate key signal inputs related to user settings and function control of the electronic apparatus searching for a product quality evaluation method, such as an input device of a touch screen, a keypad, a mouse, a track pad, a touch pad, a pointing stick, one or more mouse buttons, a track ball, a joystick, or the like. The output devices 904 may include a display device, auxiliary lighting devices (e.g., LEDs), tactile feedback devices (e.g., vibrating motors), and the like. The Display device may include, but is not limited to, a Liquid Crystal Display (LCD), a Light Emitting Diode (LED) Display, and a plasma Display. In some implementations, the display device can be a touch screen.
According to an embodiment of the present application, the present application also provides an electronic device. The apparatus may include:
one or more processors; and
and a storage device for storing one or more programs, which when executed by the one or more processors, cause the one or more processors to implement the search term recommendation method in the above method embodiments.
The functions and implementations of the processor and the storage device of the electronic device may refer to the descriptions about the processor and the memory in the above embodiments of the electronic device.
Various implementations of the systems and techniques described here can be realized in digital electronic circuitry, Integrated circuitry, Application Specific Integrated Circuits (ASICs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.
These computer programs (also known as programs, software applications, or code) include machine instructions for a programmable processor, and may be implemented using high-level procedural and/or object-oriented programming languages, and/or assembly/machine languages. As used herein, the terms "machine-readable medium" and "computer-readable medium" refer to any computer program product, apparatus, and/or device (e.g., magnetic discs, optical disks, memory, Programmable Logic Devices (PLDs)) used to provide machine instructions and/or data to a Programmable processor, including a machine-readable medium that receives machine instructions as a machine-readable signal. The term "machine-readable signal" refers to any signal used to provide machine instructions and/or data to a programmable processor.
To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a Cathode Ray Tube (CRT) or LCD monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic, speech, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), Wide Area Networks (WANs), and the internet.
The computer system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server may be a cloud server, which is also called a cloud computing server or a cloud host, and is a host product in a cloud computing service system, so as to solve the defects of high management difficulty and weak service expansibility in a conventional physical host and Virtual Private Server (VPS) service. The server may also be a server of a distributed system, or a server incorporating a blockchain.
According to the technical scheme of the embodiment of the application, the corresponding evaluation card is recalled according to the display probability of the target vertical search product, and the user feedback data is collected in the form of binding the evaluation card with the search result, so that the evaluation on the search quality of different vertical search products can be realized, and the evaluation efficiency on the search quality of the vertical search product can be improved.
It should be understood that various forms of the flows shown above may be used, with steps reordered, added, or deleted. For example, the steps described in the present application may be executed in parallel, sequentially, or in different orders, as long as the desired results of the technical solutions disclosed in the present application can be achieved, and the present invention is not limited herein.
The above-described embodiments should not be construed as limiting the scope of the present application. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made in accordance with design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present application shall be included in the protection scope of the present application.

Claims (17)

1. A search product quality assessment method, comprising:
acquiring a target evaluation card of a target vertical type search product;
binding the target evaluation card with the search result of the target vertical search product, and outputting the search result bound with the target evaluation card;
obtaining user feedback data returned aiming at the search result bound with the target evaluation card;
and evaluating the searching quality of the target vertical type searching product based on the user feedback data of the target vertical type searching product.
2. The method of claim 1, further comprising:
generating evaluation cards of different vertical search products according to the obtained evaluation configuration information of the different vertical search products; wherein the evaluation configuration information includes an evaluation card identification.
3. The method of claim 1, further comprising:
and determining a target evaluation card of the target vertical type search product according to the display probability of the target vertical type search product.
4. The method of claim 3, further comprising:
and setting the display probability corresponding to the number of the investigation users for different vertical search products according to the number of the investigation users required by the different vertical search products.
5. The method of claim 1, further comprising:
and establishing the corresponding relation between the resource identification and the evaluation card identification of different vertical search products.
6. The method of claim 5, wherein obtaining the target assessment card for the target vertical category search product comprises:
and determining a target evaluation card according to the evaluation card identifier matched with the resource identifier of the target vertical type search product under the condition that the evaluation card identifier matched with the resource identifier of the target vertical type search product exists according to the corresponding relation between the resource identifier and the evaluation card identifier.
7. The method of claim 5, further comprising:
and inquiring to obtain the user feedback data of the target vertical type search product according to the evaluation card identification of the target evaluation card bound by the target vertical type search product.
8. A search product quality evaluation apparatus comprising:
the recall unit is used for acquiring a target evaluation card of a target vertical search product;
the binding unit is used for binding the target evaluation card with the search result of the target vertical type search product and outputting the search result bound with the target evaluation card;
an acquisition unit, configured to acquire user feedback data returned for the search result to which the target evaluation card is bound;
and the evaluation unit is used for evaluating the search quality of the target vertical type search product based on the user feedback data of the target vertical type search product.
9. The apparatus of claim 8, further comprising:
the generating unit is used for generating evaluation cards of different vertical search products according to the obtained evaluation configuration information of the different vertical search products; wherein the evaluation configuration information includes an evaluation card identification.
10. The apparatus of claim 8, further comprising:
the first determining unit is used for determining a target evaluation card of the target vertical type search product according to the display probability of the target vertical type search product.
11. The apparatus of claim 10, further comprising:
and the setting unit is used for setting the display probability corresponding to the number of the investigation users for the different vertical search products according to the number of the investigation users required by the different vertical search products.
12. The apparatus of claim 8, further comprising:
and the establishing unit is used for establishing the corresponding relation between the resource identifiers and the evaluation card identifiers of different vertical search products.
13. The apparatus of claim 12, further comprising: and the second determining unit is used for determining a target evaluation card according to the evaluation card identifier matched with the resource identifier of the target vertical type search product under the condition that the evaluation card identifier matched with the resource identifier of the target vertical type search product exists according to the corresponding relation between the resource identifier and the evaluation card identifier.
14. The apparatus of claim 12, wherein the obtaining unit is further configured to obtain the user feedback data of the target vertical type search product according to an evaluation card identifier query of a target evaluation card bound to the target vertical type search product.
15. An electronic device, comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-7.
16. A non-transitory computer readable storage medium having stored thereon computer instructions for causing a computer to perform the method of any one of claims 1-7.
17. A computer program product comprising a computer program which, when executed by a processor, implements the method according to any one of claims 1-7.
CN202011561346.0A 2020-12-25 2020-12-25 Search product quality evaluation method and device, electronic equipment and storage medium Active CN112541710B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011561346.0A CN112541710B (en) 2020-12-25 2020-12-25 Search product quality evaluation method and device, electronic equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011561346.0A CN112541710B (en) 2020-12-25 2020-12-25 Search product quality evaluation method and device, electronic equipment and storage medium

Publications (2)

Publication Number Publication Date
CN112541710A true CN112541710A (en) 2021-03-23
CN112541710B CN112541710B (en) 2024-09-06

Family

ID=75017415

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011561346.0A Active CN112541710B (en) 2020-12-25 2020-12-25 Search product quality evaluation method and device, electronic equipment and storage medium

Country Status (1)

Country Link
CN (1) CN112541710B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113449212A (en) * 2021-06-25 2021-09-28 北京百度网讯科技有限公司 Quality evaluation and optimization method, device and equipment for search results

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160078131A1 (en) * 2014-09-15 2016-03-17 Google Inc. Evaluating semantic interpretations of a search query
US20170154113A1 (en) * 2015-11-30 2017-06-01 Wal-Mart Stores, Inc. System, method, and non-transitory computer-readable storage media for evaluating search results
CN108897685A (en) * 2018-06-28 2018-11-27 百度在线网络技术(北京)有限公司 Method for evaluating quality, device, server and the medium of search result
CN109961308A (en) * 2017-12-25 2019-07-02 北京京东尚科信息技术有限公司 The method and apparatus of assessment tag data
CN110738239A (en) * 2019-09-20 2020-01-31 浙江大学 search engine user satisfaction evaluation method based on mouse interaction sequence region behavior joint modeling
CN111310069A (en) * 2018-12-11 2020-06-19 阿里巴巴集团控股有限公司 Evaluation method and device for timeliness search
CN111666396A (en) * 2020-06-05 2020-09-15 北京百度网讯科技有限公司 User intention understanding satisfaction evaluation method, device, equipment and storage medium

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160078131A1 (en) * 2014-09-15 2016-03-17 Google Inc. Evaluating semantic interpretations of a search query
US20170154113A1 (en) * 2015-11-30 2017-06-01 Wal-Mart Stores, Inc. System, method, and non-transitory computer-readable storage media for evaluating search results
CN109961308A (en) * 2017-12-25 2019-07-02 北京京东尚科信息技术有限公司 The method and apparatus of assessment tag data
CN108897685A (en) * 2018-06-28 2018-11-27 百度在线网络技术(北京)有限公司 Method for evaluating quality, device, server and the medium of search result
CN111310069A (en) * 2018-12-11 2020-06-19 阿里巴巴集团控股有限公司 Evaluation method and device for timeliness search
CN110738239A (en) * 2019-09-20 2020-01-31 浙江大学 search engine user satisfaction evaluation method based on mouse interaction sequence region behavior joint modeling
CN111666396A (en) * 2020-06-05 2020-09-15 北京百度网讯科技有限公司 User intention understanding satisfaction evaluation method, device, equipment and storage medium

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
王若佳;李月琳;: "基于用户体验的健康类搜索引擎可用性评估", 图书情报工作, 31 May 2016 (2016-05-31) *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113449212A (en) * 2021-06-25 2021-09-28 北京百度网讯科技有限公司 Quality evaluation and optimization method, device and equipment for search results
CN113449212B (en) * 2021-06-25 2024-05-17 北京百度网讯科技有限公司 Quality evaluation and optimization method, device and equipment for search results

Also Published As

Publication number Publication date
CN112541710B (en) 2024-09-06

Similar Documents

Publication Publication Date Title
CN106919635B (en) Group chat record query method and device and electronic equipment
CN111460285A (en) Information processing method, device, electronic equipment and storage medium
CN106470110B (en) Method and device for sending messages to multiple users in user list in group mode
CN111639027B (en) Test method and device and electronic equipment
CN111800493A (en) Information content pushing method and device, electronic equipment and storage medium
CN104579909B (en) Method and equipment for classifying user information and acquiring user grouping information
CN110619002A (en) Data processing method, device and storage medium
CN111460292A (en) Model evaluation method, apparatus, device, and medium
CN110737634A (en) Log searching method, client, server and computer readable storage medium
CN111814067B (en) Friend recommendation method, device, equipment and storage medium
CN112328658A (en) User profile data processing method, device, equipment and storage medium
CN112084150A (en) Model training method, data retrieval method, device, equipment and storage medium
CN116048987A (en) Processing method, device, electronic equipment, system and storage medium for flow business
CN109213782B (en) Search interface configuration and display method and device and communication equipment
CN112307357A (en) Social method and device for strangers
CN112541710B (en) Search product quality evaluation method and device, electronic equipment and storage medium
CN111555894B (en) Data processing method, device, equipment and storage medium
CN113434432B (en) Performance test method, device, equipment and medium for recommendation platform
CN112699314A (en) Hot event determination method and device, electronic equipment and storage medium
CN112069137A (en) Method and device for generating information, electronic equipment and computer readable storage medium
CN116402472A (en) Workflow approval method and device
CN113114557B (en) Message sending method and device, electronic equipment and storage medium
CN111638982B (en) Flow guiding method, flow guiding device and electronic equipment
CN112446728B (en) Advertisement recall method, device, equipment and storage medium
CN112328892A (en) Information recommendation method, device, equipment and computer storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant