CN109522203B - Software product evaluation method and device - Google Patents
Software product evaluation method and device Download PDFInfo
- Publication number
- CN109522203B CN109522203B CN201710848458.6A CN201710848458A CN109522203B CN 109522203 B CN109522203 B CN 109522203B CN 201710848458 A CN201710848458 A CN 201710848458A CN 109522203 B CN109522203 B CN 109522203B
- Authority
- CN
- China
- Prior art keywords
- software product
- event
- tested
- semantic
- session set
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3604—Software analysis for verifying properties of programs
- G06F11/3608—Software analysis for verifying properties of programs using formal methods, e.g. model checking, abstract interpretation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3688—Test management for test execution, e.g. scheduling of test suites
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- Stored Programmes (AREA)
Abstract
The embodiment of the application discloses a method and a device for evaluating a software product, wherein the method is used for acquiring each session set of a user; determining semantic labels corresponding to the operation events contained in each session set based on the association relationship between the preset operation events and the semantic labels, and respectively obtaining an event label queue of each session set; acquiring each operation event set in the software product to be tested, and acquiring an event tree consisting of semantic labels corresponding to each operation event of the software product to be tested based on the incidence relation and the conversion relation among the operation events of the software product to be tested; and respectively matching the event label queue of each session set with the event tree of the software product to be tested, and determining the conversion rate among the semantic labels of the software product to be tested based on the obtained matching result to obtain an evaluation result. Therefore, the application dimension of the operation data is widened, the evaluation precision is improved, and the cost is reduced.
Description
Technical Field
The present application relates to the field of evaluation technologies, and in particular, to a method and an apparatus for evaluating a software product.
Background
With the development of internet technology, in order to improve user experience of users using software products (e.g., applications and websites), developers continuously update and upgrade the software products to optimize the software products.
When a software product is subjected to research, development and design or version updating, research and development personnel need to evaluate the software product to predict whether a user is satisfied with the designed software product or most effectively places advertisements in the visual area of the user, and determine the conversion path of each operation of the user when the user uses the software product so as to design the layout of the software product, thereby more effectively guiding the user to complete payment. The evaluation refers to obtaining user experience data of the software product or judging whether the software product reaches an expected target.
In the prior art, the following method is generally adopted when evaluating software products;
the first mode is as follows: and (4) investigating the user experience of the user using the specified software product, and obtaining an evaluation result according to investigation data.
However, in this way, since the number of samples is small, the accuracy of the obtained evaluation result is not high, and the time cost is high.
The second way is: and (3) adopting a gray release test or an A/B version test, namely updating the appointed software product used by a part of users to obtain user operation data of the part of users, and obtaining an evaluation result according to the user operation data.
However, this method consumes a lot of time and cost, and the evaluation period is long, which causes the software product to miss the best release opportunity.
The third mode is as follows: and (4) iterative updating, namely analyzing the user operation data of the current version used by the user, and correspondingly updating the next version according to the obtained evaluation result.
However, in this way, when the current version is designed, corresponding research and development decisions are lacked.
The fourth mode is as follows: and evaluating through a virtual user based on an artificial intelligence technology to obtain an evaluation result.
However, this method does not reflect the true idea of the user, and the obtained evaluation result is not accurate.
The fifth mode is as follows: and testing the software product through the script program to obtain a test result.
However, in this way, only the test result of the product quality of the software product can be obtained, and the evaluation result is not.
Disclosure of Invention
The embodiment of the application provides an evaluation method and device of a software product, which are used for reducing time cost and data analysis cost and improving the trueness and precision of evaluation when the software product is evaluated.
The embodiment of the application provides the following specific technical scheme:
in a first aspect, a method for evaluating a software product includes:
acquiring each session set of a user, wherein one session set comprises operation events of a plurality of operations executed by the user on one software product in one session;
determining semantic labels corresponding to the operation events contained in each session set based on the association relationship between preset operation events and the semantic labels, and respectively obtaining an event label queue of each session set, wherein the event label queue of one session set contains each semantic label corresponding to one session set;
acquiring each operation event set in a software product to be tested, and acquiring an event tree consisting of semantic labels corresponding to each operation event of the software product to be tested based on the incidence relation and the conversion relation among the operation events of the software product to be tested, wherein the event tree of the software product to be tested represents the conversion direction and the conversion path among the semantic labels of the software product to be tested;
and respectively matching the event label queue of each session set with an event tree of the software product to be tested, determining the conversion rate among the semantic labels of the software product to be tested based on the obtained matching result, and analyzing the obtained conversion rates to obtain an evaluation result.
Preferably, before acquiring each session set of the user, the method further includes:
acquiring description information of each operation event of a specified software product, wherein the description information of one operation event comprises a business target, a function, an attribute, a name and importance of an event generated after triggering one element of the software product;
setting corresponding semantic tags respectively based on the service targets, functions, attributes, names and importance contained in the description information of each operation event;
and establishing an incidence relation between the operation events and the semantic labels based on the operation events and the obtained semantic labels.
Preferably, the obtaining each session set of the user specifically includes:
acquiring a session set of operations performed on the software product to be tested by each user, or,
acquiring a session set of operations of each user on a specified software product similar to the software product to be tested; alternatively, the first and second electrodes may be,
and acquiring a session set of the specified user group operating the software product to be tested or the specified software product similar to the software product to be tested.
Preferably, the determining, based on the preset association relationship between the operation event and the semantic tag, the semantic tag corresponding to the operation event included in each session set, and obtaining the event tag queue of each session set respectively specifically includes:
respectively determining the semantic label of each operation event in each session set based on the association relationship;
for each set of sessions, performing the steps of: and sequencing semantic labels corresponding to the operation events in one session set according to the execution sequence of the operation events in the session set to obtain an event label queue containing the semantic labels of the session set.
Preferably, based on the obtained matching result, determining the conversion rate between each semantic tag of the software product to be tested, and analyzing each obtained conversion rate to obtain an evaluation result, specifically including:
grouping semantic labels of the software product to be tested in pairs;
respectively determining the number of event label queues which contain each group of semantic labels and are successfully matched by the representation of the matching result, and obtaining the conversion rate corresponding to each group of semantic labels by the ratio of the number of event label queues which are successfully matched by the representation of the matching result to the total number of event label queues;
and analyzing the conversion rate of each acquired group of semantic tags to obtain an evaluation result.
In a second aspect, an evaluation apparatus for a software product includes:
the software product management system comprises an acquisition unit, a processing unit and a processing unit, wherein the acquisition unit is used for acquiring each session set of a user, and one session set comprises operation events of a plurality of operations executed by one user on one software product in one session;
the obtaining unit is used for determining semantic labels corresponding to the operation events contained in each session set based on the association relationship between the preset operation events and the semantic labels, and respectively obtaining an event label queue of each session set, wherein the event label queue of one session set contains each semantic label corresponding to one session set;
the conversion unit is used for acquiring each operation event set in the software product to be tested, and acquiring an event tree consisting of semantic labels corresponding to each operation event of the software product to be tested based on the incidence relation and the conversion relation among the operation events of the software product to be tested, wherein the event tree of the software product to be tested represents the conversion direction and the conversion path among the semantic labels of the software product to be tested;
and the evaluation unit is used for respectively matching the event label queue of each session set with the event tree of the software product to be tested, determining the conversion rate among the semantic labels of the software product to be tested based on the obtained matching result, and analyzing the obtained conversion rates to obtain an evaluation result.
Preferably, before acquiring each session set of the user, the acquiring unit is further configured to:
acquiring description information of each operation event of a specified software product, wherein the description information of one operation event comprises a business target, a function, an attribute, a name and importance of an event generated after triggering one element of the software product;
setting corresponding semantic tags respectively based on the service targets, functions, attributes, names and importance contained in the description information of each operation event;
and establishing an incidence relation between the operation events and the semantic labels based on the operation events and the obtained semantic labels.
Preferably, when acquiring each session set of the user, the acquiring unit is specifically configured to:
acquiring a session set of operations performed on the software product to be tested by each user, or,
acquiring a session set of operations of each user on a specified software product similar to the software product to be tested; alternatively, the first and second electrodes may be,
and acquiring a session set of the specified user group operating the software product to be tested or the specified software product similar to the software product to be tested.
Preferably, when determining the semantic tags corresponding to the operation events included in each session set based on the preset association relationship between the operation events and the semantic tags, and respectively obtaining the event tag queue of each session set, the conversion unit is specifically configured to:
respectively determining the semantic label of each operation event in each session set based on the association relationship;
for each set of sessions, performing the steps of: and sequencing semantic labels corresponding to the operation events in one session set according to the execution sequence of the operation events in the session set to obtain an event label queue containing the semantic labels of the session set.
Preferably, when determining the conversion rate between each semantic tag of the software product to be tested based on the obtained matching result, and analyzing each obtained conversion rate to obtain an evaluation result, the evaluation unit is specifically configured to:
grouping semantic labels of the software product to be tested in pairs;
respectively determining the number of event label queues which contain each group of semantic labels and are successfully matched by the representation of the matching result, and obtaining the conversion rate corresponding to each group of semantic labels by the ratio of the number of event label queues which are successfully matched by the representation of the matching result to the total number of event label queues;
and analyzing the conversion rate of each acquired group of semantic tags to obtain an evaluation result.
In a third aspect, an electronic device includes: one or more processors; and
one or more computer-readable media having stored thereon an evaluation program for a software product, wherein the program, when executed by one or more processors, performs the steps of the method of any of the above first aspects.
In a fourth aspect, one or more computer readable media having stored thereon an evaluation program for a software product, wherein the program, when executed by one or more processors, causes a communication device to perform the method of any of the first aspect described above.
In the embodiment of the application, each session set comprising a plurality of operation events is obtained, semantic labels corresponding to each operation event are respectively determined according to the incidence relation between the preset operation events and the semantic labels, and an event label queue comprising each semantic label of each session set is respectively established; based on the incidence relation and the conversion relation among the operation events set in the software product to be tested, obtaining an event tree composed of semantic labels of the software product to be tested; and determining the conversion rate among the operation events according to the matching result of each event label queue and the event tree to obtain an evaluation result. Therefore, each operation event of the software product by the user is abstracted into a semantic label easy to understand, a series of operations of the user can be simply and clearly obtained through the semantic label, evaluation and analysis are convenient, the software product to be tested which is the same as or similar to the software product can be evaluated through each session set of the software product by each user, the software product can be predicted, time is saved, the application dimensionality of data is widened, the precision of the obtained evaluation result is high, and the analysis cost is low.
Drawings
FIG. 1a is a flow chart of a method for evaluating a software product according to an embodiment of the present application;
FIG. 1b is a schematic diagram of an event tree of a software product to be tested in the embodiment of the present application;
fig. 2 is a schematic structural diagram of an evaluation device of a software product in an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present application without any creative effort belong to the protection scope of the present application.
In order to reduce the time cost and the analysis cost and improve the trueness and the precision of the evaluation when the software product is evaluated, in the embodiment of the application, an evaluation method of the software product is designed, the method comprises obtaining session sets containing operation events of software products by users, determining semantic tags corresponding to each session set according to preset association relationship between the operation events and the semantic tags, obtaining corresponding event tag queues, and obtaining an event tree consisting of semantic tags corresponding to the operation events set in the software product to be tested based on the incidence relation and the conversion relation among the operation events set in the software product to be tested, and further obtaining the conversion rate among the semantic tags based on the matching result between each event tag queue and the event tree so as to obtain the evaluation result of the software product to be tested.
The preferred embodiments of the present application will be described below with reference to the accompanying drawings of the specification, it being understood that the preferred embodiments described herein are merely for illustrating and explaining the present invention and are not intended to limit the present invention, and that the embodiments and features of the embodiments in the present application may be combined with each other without conflict.
In the embodiment of the application, before evaluating the software product, the association relationship between the operation event and the semantic tag is established, and the specific steps are as follows:
first, the terminal acquires description information of each operation event of a specified software product.
The operation event refers to an event generated after a user triggers any element in a page of the software product, such as a button, a link, and the like.
The description information of an operation event includes information such as a service object, a function, an attribute, a name, and other importance of the operation event. The business goal of an operational event may be advertising, payment, completion or query, etc.
Then, the user sets a corresponding semantic tag for each operation event according to the service target, function, attribute, name and importance contained in the description information of each operation event. .
For example, if the business object included in the description information of the operation event a is login, the function is login, the attribute is a button, the name is login, and the importance is high, the user sets the semantic tag of the operation event a as login.
Further, the terminal establishes an association relation between the operation event and the semantic label based on each operation event and each acquired semantic label.
After the incidence relation between the operation event and the semantic tag is established, acquiring the operation event of the software product on each terminal by different users by implanting an acquisition program of user operation data in an application program of each terminal or implanting a corresponding JS code in a page of a website of each terminal, and acquiring each session set of each user.
When the terminal collects the operation events of the user, one session set of the user comprises the operation events from the beginning of the session to the ending of the session in one software product by taking the session of the user as a unit.
For example, a session set of user a includes the following operation events: login, view, collect, purchase, pay, and logout.
And when the terminal stores the session set of the user, storing according to the type of the software product, the identification of the user and the three-level structure of the session set.
Therefore, the terminal can evaluate the software product to be tested which is the same as or similar to the specified software product in the subsequent steps according to the incidence relation between the operation event and the semantic label and the collected session sets of different users, and obtain an evaluation result.
Referring to fig. 1a, which is a flowchart for evaluating a software product, in the embodiment of the present application, a specific process for evaluating a software product is as follows:
step 100: the terminal acquires a session set of each user.
Specifically, when the terminal obtains the session set of each user, the following modes may be adopted:
the first mode is as follows: the terminal directly obtains the session set of each user of the software product to be tested.
By adopting the method, the user operation data of each user on the software product to be tested can be directly obtained, and in the subsequent step, the software product to be tested is evaluated through the obtained user operation data, which is used for evaluating the current version of the released software product.
The second way is: the terminal acquires a session set of each user using a specified software product similar to the software product to be tested.
Optionally, the specified software product may be a software product in which the set operation event is more the same as the operation event set in the software product to be tested, or a software product in which the specified software product and the software product to be tested have different versions.
By adopting the method, when the software product to be tested is not released, the software product to be tested can be predicted through the session set of the software product similar to the software to be tested, and then research and development personnel can be guided to carry out research and development.
The third mode is as follows: the terminal obtains a session set of the appointed user group to the software product to be tested or the appointed software product similar to the software product to be tested.
By adopting the method, the appointed user group, such as a student or a teacher, can be selected, and the conversation set when the appointed software product or the software product to be tested is used is selected, so that the corresponding evaluation result can be obtained aiming at the specific user group in the subsequent steps.
Therefore, corresponding user data can be obtained according to different application scenes, and the software product to be tested is evaluated.
Step 101: the terminal respectively determines the semantic label corresponding to each operation event contained in each session set based on the association relationship between the preset operation event and the semantic label.
Therefore, each operation event of the user can be abstracted into a simple and clear semantic label according to the semantics, the target and the like of the operation event, and the semantic label which is popular and easy to understand is used for description, so that the subsequent analysis and evaluation are facilitated.
Step 102: and the terminal respectively establishes an event label queue of each session set based on the semantic labels of each session set.
Specifically, taking a session set as an example, the step of establishing an event tag queue of the session set by the terminal is as follows:
and sequencing semantic labels corresponding to the operation events of one session set according to the execution sequence of the operation events in the session set, and acquiring an event label queue of the session set based on the sequenced semantic labels.
For example, one event tag queue is: login, view, play, pause, and exit.
In the embodiment of the present application, only one session set is taken as an example to describe the event tag queue for establishing one session set, and other session sets may establish corresponding event tag queues according to the same principle, which is not described herein again.
In this way, each step of the operation of the software product by the user can be abstracted into the event tag queue of the corresponding operation.
Step 103: and the terminal acquires each operation event set in the software product to be tested, and determines the semantic label of each set operation event based on the incidence relation.
Specifically, when step 103 is executed, each element in each page of one software product corresponds to a corresponding operation event, and the terminal obtains each operation event in the configuration information of the software product to be tested.
Step 104: and the terminal obtains an event tree consisting of semantic labels corresponding to the operation events of the software product to be tested according to the conversion relation among the operation events of the software product to be tested.
Specifically, when step 104 is executed, the event tree represents the conversion direction and the conversion path between the operation events through the semantic tags.
Referring to fig. 1b, a schematic diagram of an event tree of a software product to be tested is shown, which includes all semantic tags of the software product to be tested, and a conversion direction and a conversion path between the semantic tags.
Step 105: and the terminal respectively matches the event label queue of each session set with the event tree of the software product to be tested.
For example, the event tree a of the software product to be tested is the event tree shown in fig. 1b, and the event tag queue a of session a is: starting, labeling 1, labeling 2 and a target B, and then matching the event tree A and the event label queue A by the terminal to obtain a matching result of successful matching.
Further, if only a part of semantic tags in the event tag queue are successfully matched with the event tree, selecting the successfully matched part of semantic tags to form a new event tag queue, and adopting the updated event tag queue for evaluation in the subsequent evaluation step.
Step 106: and the terminal determines the conversion rate among the operation events of the software product to be tested based on the obtained matching result to obtain an evaluation result.
Specifically, firstly, the terminal groups each semantic tag of the software product to be tested in pairs.
And then, the terminal respectively determines the number of event label queues which contain each group of semantic labels and are successfully matched by the representation of the matching result, and the ratio of the number of the event label queues successfully matched by the representation of the matching result to the total number of the event label queues successfully matched by the representation of the matching result, so as to obtain the conversion rate between the two semantic labels contained in each group of semantic labels.
And finally, the terminal analyzes the conversion rate of each group of acquired semantic tags to obtain an evaluation result.
For example, the event tree a of the software product to be tested refers to the event tree shown in fig. 1b, and the terminal acquires 5 event tag queues. Wherein, the event tag queue a is: start, tag 1, tag 2, and target 2. The event tag queue B is: start, tag 3 and target 3. Event tag queue C is startup, tag 4, tag 5, and object 2. Event tag queue D is start, tag 1 and object 3. Event tag queue E is start, tag 1, tag 6, and object 1.
The terminal matches the 5 event tag queues with the event tree a respectively, determines that the event tag queue E fails to be matched, determines that the total number of the event tag queues successfully matched is 4, determines that the event tag queues including the start and the target 2 are the event tag queue a and the event tag queue C, the number of the event tag queues is 2, and determines that the conversion rate between the start and the target 2 is 2/4-0.5.
Therefore, each conversion path and conversion rate of the semantic label when the user reaches the target can be obtained, and therefore the user habit when the user uses the software product and whether the target effect is achieved are determined.
For example, the page of the application program a includes 3 page links, that is, a link B, a link C, and a link D, and it is determined that, according to the obtained conversion rate of each semantic tag of the application program, the probability of clicking the link B is 0.8, the probability of clicking the link C is 0.15, and the probability of clicking the link D is 0.05 in the page a, it is determined that the page position of the link B is better, or the content of the link B is better.
In an embodiment of the present application, an electronic device includes: one or more processors; and
one or more computer-readable media having stored thereon a program for evaluation of a software product, wherein the program, when executed by one or more processors, performs the steps of the above-described embodiments.
In an embodiment of the application, one or more computer-readable media having stored thereon a program for evaluation of a software product, where the program, when executed by one or more processors, causes a communication device to perform the steps in the above-described embodiments.
Based on the above embodiment, referring to fig. 2, a schematic structural diagram of an evaluation device of a software product is shown, in the embodiment of the present application, the evaluation device of the software product specifically includes:
an obtaining unit 20, configured to obtain session sets of users, where one session set includes operation events of multiple operations executed by one user on one software product in one session;
an obtaining unit 21, configured to determine, based on a preset association relationship between an operation event and semantic tags, semantic tags corresponding to the operation event included in each session set, and obtain an event tag queue of each session set respectively, where an event tag queue of one session set includes each semantic tag corresponding to one session set;
the conversion unit 22 is configured to obtain each operation event set in the software product to be tested, and obtain an event tree composed of semantic tags corresponding to each operation event of the software product to be tested based on the association relationship and the conversion relationship between each operation event of the software product to be tested, where the event tree of the software product to be tested represents a conversion direction and a conversion path between each semantic tag of the software product to be tested;
the evaluating unit 23 is configured to match the event tag queue of each session set with an event tree of the software product to be tested, determine a conversion rate between each semantic tag of the software product to be tested based on an obtained matching result, and analyze each obtained conversion rate to obtain an evaluation result.
Preferably, before acquiring the respective session sets of the users, the acquiring unit 20 is further configured to:
acquiring description information of each operation event of a specified software product, wherein the description information of one operation event comprises a business target, a function, an attribute, a name and importance of an event generated after triggering one element of the software product;
setting corresponding semantic tags respectively based on the service targets, functions, attributes, names and importance contained in the description information of each operation event;
and establishing an incidence relation between the operation events and the semantic labels based on the operation events and the obtained semantic labels.
Preferably, when acquiring each session set of the user, the acquiring unit 20 is specifically configured to:
acquiring a session set of operations performed on the software product to be tested by each user, or,
acquiring a session set of operations of each user on a specified software product similar to the software product to be tested; alternatively, the first and second electrodes may be,
and acquiring a session set of the specified user group operating the software product to be tested or the specified software product similar to the software product to be tested.
Preferably, when determining semantic tags corresponding to the operation events included in each session set based on the preset association relationship between the operation events and the semantic tags, and obtaining an event tag queue of each session set, the conversion unit 20 is specifically configured to:
respectively determining the semantic label of each operation event in each session set based on the association relationship;
for each set of sessions, performing the steps of: and sequencing semantic labels corresponding to the operation events in one session set according to the execution sequence of the operation events in the session set to obtain an event label queue containing the semantic labels of the session set.
Preferably, when determining the conversion rate between each semantic tag of the software product to be tested based on the obtained matching result, and analyzing each obtained conversion rate to obtain an evaluation result, the evaluation unit 20 is specifically configured to:
grouping semantic labels of the software product to be tested in pairs;
respectively determining the number of event label queues which contain each group of semantic labels and are successfully matched by the representation of the matching result, and obtaining the conversion rate corresponding to each group of semantic labels by the ratio of the number of event label queues which are successfully matched by the representation of the matching result to the total number of event label queues;
and analyzing the conversion rate of each acquired group of semantic tags to obtain an evaluation result.
In the embodiment of the application, each session set comprising a plurality of operation events is obtained, semantic labels corresponding to each operation event are respectively determined according to the incidence relation between the preset operation events and the semantic labels, and an event label queue comprising each semantic label of each session set is respectively established; based on the incidence relation and the conversion relation among the operation events set in the software product to be tested, obtaining an event tree composed of semantic labels of the software product to be tested; and determining the conversion rate among the operation events according to the matching result of each event label queue and the event tree to obtain an evaluation result. Therefore, each operation event of the software product by the user is abstracted into a semantic label easy to understand, a series of operations of the user can be simply and clearly obtained through the semantic label, evaluation and analysis are convenient, the software product to be tested which is the same as or similar to the software product can be evaluated through each session set of the software product by each user, the software product can be predicted, time is saved, the application dimensionality of data is widened, the precision of the obtained evaluation result is high, and the analysis cost is low.
As will be appreciated by one of skill in the art, the embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, embodiments of the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
Embodiments of the present application are described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While preferred embodiments of the present application have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including the preferred embodiment and all changes and modifications that fall within the true scope of the embodiments of the present application.
It is apparent that those skilled in the art can make various changes and modifications to the embodiments of the present application without departing from the spirit and scope of the embodiments of the present application. Thus, if such modifications and variations of the embodiments of the present application fall within the scope of the claims of the embodiments of the present application and their equivalents, the embodiments of the present application are also intended to include such modifications and variations.
Claims (8)
1. A method for evaluating a software product, comprising:
acquiring each session set of a user, wherein one session set comprises operation events of a plurality of operations executed by the user on one software product in one session;
determining semantic labels corresponding to operation events contained in each session set based on an association relationship between preset operation events and the semantic labels, and respectively obtaining an event label queue of each session set, wherein the event label queue of one session set contains each semantic label corresponding to the one session set, the association relationship is obtained by obtaining description information of each operation event set in a software product, respectively setting corresponding semantic labels for each operation event according to a business target, a function, an attribute, a name and importance contained in the description information of each operation event, and respectively establishing an association relationship between the operation events and the semantic labels based on each operation event and each semantic label; the description information of the operation event is the service target, function, attribute, name and importance of the operation event;
acquiring each operation event set in a software product to be tested, and acquiring an event tree composed of semantic labels corresponding to each operation event of the software product to be tested based on the incidence relation and the conversion relation among the operation events of the software product to be tested, wherein the event tree of the software product to be tested represents the conversion direction and the conversion path among the semantic labels of the software product to be tested;
and respectively matching the event label queue of each session set with the event tree of the software product to be tested, determining the conversion rate among the semantic labels of the software product to be tested based on the obtained matching result, and analyzing the obtained conversion rates to obtain an evaluation result.
2. The method of claim 1, prior to obtaining respective sets of sessions for a user, further comprising:
acquiring description information of each operation event of a specified software product, wherein the description information of one operation event comprises a business target, a function, an attribute, a name and importance of an event generated after triggering one element of the software product;
setting corresponding semantic tags respectively based on the service targets, functions, attributes, names and importance contained in the description information of each operation event;
and establishing an incidence relation between the operation events and the semantic labels based on the operation events and the obtained semantic labels.
3. The method of claim 1, wherein obtaining each session set of the user specifically comprises:
acquiring a session set of operations of each user on the software product to be tested, or,
acquiring a session set of operations of each user on a specified software product similar to the software product to be tested; alternatively, the first and second electrodes may be,
and acquiring a session set of the specified user group for operating the software product to be tested or the specified software product similar to the software product to be tested.
4. The method according to claim 1, wherein determining semantic tags corresponding to the operation events included in each session set based on an association relationship between a preset operation event and the semantic tags, and respectively obtaining an event tag queue of each session set specifically comprises:
respectively determining the semantic label of each operation event in each session set based on the association relationship;
for each set of sessions, performing the steps of: and sequencing semantic labels corresponding to the operation events contained in one session set according to the execution sequence of the operation events contained in the session set to obtain an event label queue containing the semantic labels of the session set.
5. The method according to any one of claims 1 to 4, wherein determining conversion rates between semantic tags of the software product to be tested based on the obtained matching results, and analyzing the obtained conversion rates to obtain evaluation results, specifically comprises:
grouping every two semantic tags of the software product to be tested;
respectively determining the number of event label queues which contain each group of semantic labels and are successfully matched by the representation of the matching result, and obtaining the conversion rate corresponding to each group of semantic labels by the ratio of the number of event label queues which are successfully matched by the representation of the matching result to the total number of event label queues;
and analyzing the conversion rate of each acquired group of semantic tags to obtain an evaluation result.
6. An evaluation apparatus for a software product, comprising:
the software product management system comprises an acquisition unit, a processing unit and a processing unit, wherein the acquisition unit is used for acquiring each session set of a user, and one session set comprises operation events of a plurality of operations executed by one user on one software product in one session;
an obtaining unit, configured to determine semantic tags corresponding to operation events included in each session set based on an association relationship between preset operation events and semantic tags, and obtain an event tag queue of each session set, where an event tag queue of one session set includes each semantic tag corresponding to the one session set, and the association relationship is obtained by obtaining description information of each operation event set in a software product, setting a corresponding semantic tag for each operation event according to a service object, a function, an attribute, a name, and an importance included in the description information of each operation event, and establishing an association relationship between an operation event and a semantic tag based on each operation event and each semantic tag; the description information of the operation event is the service target, function, attribute, name and importance of the operation event;
the conversion unit is used for acquiring each operation event set in a software product to be tested, and acquiring an event tree consisting of semantic labels corresponding to each operation event of the software product to be tested based on the incidence relation and the conversion relation among the operation events of the software product to be tested, wherein the event tree of the software product to be tested represents the conversion direction and the conversion path among the semantic labels of the software product to be tested;
and the evaluation unit is used for respectively matching the event label queue of each session set with the event tree of the software product to be tested, determining the conversion rate among the semantic labels of the software product to be tested based on the obtained matching result, and analyzing the obtained conversion rates to obtain an evaluation result.
7. An electronic device, comprising: one or more processors; and
one or more computer-readable media having stored thereon an evaluation program for a software product, wherein the program, when executed by one or more processors, performs the steps of the method according to any one of claims 1 to 5.
8. One or more computer-readable media, characterized in that the readable media have stored thereon an evaluation program for a software product, wherein the program, when executed by one or more processors, causes a communication device to perform the method according to any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710848458.6A CN109522203B (en) | 2017-09-19 | 2017-09-19 | Software product evaluation method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710848458.6A CN109522203B (en) | 2017-09-19 | 2017-09-19 | Software product evaluation method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109522203A CN109522203A (en) | 2019-03-26 |
| CN109522203B true CN109522203B (en) | 2022-02-11 |
Family
ID=65769482
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710848458.6A Active CN109522203B (en) | 2017-09-19 | 2017-09-19 | Software product evaluation method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109522203B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112540919B (en) * | 2020-12-08 | 2024-02-23 | 上海哔哩哔哩科技有限公司 | Test equipment determining method and device |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101334783A (en) * | 2008-05-20 | 2008-12-31 | 上海大学 | Network user behaviors personalization expression method based on semantic matrix |
| CN103823883A (en) * | 2014-03-06 | 2014-05-28 | 焦点科技股份有限公司 | Analysis method and system for website user access path |
| CN104090888A (en) * | 2013-12-10 | 2014-10-08 | 深圳市腾讯计算机系统有限公司 | Method and device for analyzing user behavior data |
| CN105677857A (en) * | 2016-01-01 | 2016-06-15 | 广州筷子信息科技有限公司 | Keyword and marketing landing page accurate-matching method and device |
| CN107153681A (en) * | 2017-04-19 | 2017-09-12 | 畅捷通信息技术股份有限公司 | A kind of user's registration conversion method and system |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9372779B2 (en) * | 2014-05-02 | 2016-06-21 | International Business Machines Corporation | System, method, apparatus and computer program for automatic evaluation of user interfaces in software programs |
-
2017
- 2017-09-19 CN CN201710848458.6A patent/CN109522203B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101334783A (en) * | 2008-05-20 | 2008-12-31 | 上海大学 | Network user behaviors personalization expression method based on semantic matrix |
| CN104090888A (en) * | 2013-12-10 | 2014-10-08 | 深圳市腾讯计算机系统有限公司 | Method and device for analyzing user behavior data |
| CN103823883A (en) * | 2014-03-06 | 2014-05-28 | 焦点科技股份有限公司 | Analysis method and system for website user access path |
| CN105677857A (en) * | 2016-01-01 | 2016-06-15 | 广州筷子信息科技有限公司 | Keyword and marketing landing page accurate-matching method and device |
| CN107153681A (en) * | 2017-04-19 | 2017-09-12 | 畅捷通信息技术股份有限公司 | A kind of user's registration conversion method and system |
Non-Patent Citations (1)
| Title |
|---|
| 基于标签和评分的协作过滤推荐算法研究;郭亚琼;《中国优秀硕士学委论文全文数据库 信息科技辑》;20170315;I138-6041 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109522203A (en) | 2019-03-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109460513B (en) | Method and apparatus for generating click rate prediction model | |
| US10958748B2 (en) | Resource push method and apparatus | |
| CN109165249B (en) | Data processing model construction method and device, server and user side | |
| CN109976997B (en) | Test method and device | |
| CN109447156B (en) | Method and apparatus for generating a model | |
| CN109121022B (en) | Method and apparatus for marking video segments | |
| CN111090756B (en) | Artificial intelligence-based multi-target recommendation model training method and device | |
| CN110162359B (en) | Method, device and system for pushing novice guiding information | |
| CN111491202B (en) | Video publishing method, device, equipment and storage medium | |
| CN110472154A (en) | A kind of resource supplying method, apparatus, electronic equipment and readable storage medium storing program for executing | |
| CN110704750A (en) | Article pushing method, article pushing device, article pushing equipment and storage medium based on user tags | |
| CN112995690B (en) | Live content category identification method, device, electronic equipment and readable storage medium | |
| CN112070310A (en) | Loss user prediction method and device based on artificial intelligence and electronic equipment | |
| CN110609947A (en) | Learning content recommendation method, terminal and storage medium of intelligent learning system | |
| CN113626624B (en) | Resource identification method and related device | |
| CN111666771A (en) | Semantic label extraction device, electronic equipment and readable storage medium of document | |
| CN109522203B (en) | Software product evaluation method and device | |
| CN117611272A (en) | Commodity recommendation method and device and electronic equipment | |
| CN115408606A (en) | Insurance information pushing method and device, storage medium and computer equipment | |
| CN111078972B (en) | Questioning behavior data acquisition method, questioning behavior data acquisition device and server | |
| CN110807179B (en) | User identification method, device, server and storage medium | |
| CN111475722B (en) | Method and apparatus for transmitting information | |
| CN114265777A (en) | Application program testing method and device, electronic equipment and storage medium | |
| CN110473008B (en) | Data processing method, device, equipment and storage medium | |
| CN111767290B (en) | Method and apparatus for updating user portraits |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |