CN115738285A - Game quality evaluation feedback method and system - Google Patents
Game quality evaluation feedback method and system Download PDFInfo
- Publication number
- CN115738285A CN115738285A CN202310022819.7A CN202310022819A CN115738285A CN 115738285 A CN115738285 A CN 115738285A CN 202310022819 A CN202310022819 A CN 202310022819A CN 115738285 A CN115738285 A CN 115738285A
- Authority
- CN
- China
- Prior art keywords
- quality evaluation
- index
- game quality
- game
- evaluation
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
The present disclosure provides a game quality evaluation feedback method and system, relating to the technical field of game quality evaluation, wherein the method comprises the following steps: matching game quality evaluation indexes according to the basic information of the game to be evaluated; generating a game quality evaluation discrete index set and a game quality evaluation associated index set; generating a game quality evaluation index weight distribution result; obtaining an ideal score of the game quality evaluation; collecting an index characteristic value set; comprehensively evaluating according to the game quality evaluation index weight distribution result and the index characteristic value set to generate a game quality evaluation score; the method and the device can solve the technical problems that in the prior art, due to the fact that the evaluation of the game quality presents a multi-level and multi-thread complex evaluation process, the relation among the evaluation factors is difficult to draw up, and data are redundant, and achieve the technical effects of accurately determining the relation among the evaluation factors and reducing the data redundancy.
Description
Technical Field
The disclosure relates to the technical field of game quality evaluation, in particular to a game quality evaluation feedback method and system.
Background
In the internet era, games are more and more popular and are suitable for people of all ages. The variety of games is also varied for different populations and carriers. Before the game is played, the game developer can evaluate the quality of the game to improve the game. Currently, the quality evaluation methods for a certain scheme mainly include a statistical analysis evaluation method, a fuzzy evaluation method, a correlation diagram analysis method, an analytic hierarchy process and the like; in the quality evaluation, for the establishment of the weight of the evaluation index, an AHP analytic hierarchy process, a Delphi expert weighting method, a variation coefficient method and the like are mainly adopted; at present, in order to construct an evaluation matrix, a method of directly and subjectively assigning weights by experts is often used to establish the weights of evaluation indexes and coefficients related to the evaluation matrix. However, the main interface design of the mobile phone game has the characteristics of multiple dimensions, multiple attributes, high coupling and the like, which means that numerous and complex influencing factors need to be considered in the design quality evaluation process.
At present, the technical problems that the evaluation of game quality presents a multi-level and multi-thread complex evaluation process, so that the relation among evaluation factors is difficult to draw up, and data is redundant exist in the prior art exist.
Disclosure of Invention
The invention provides a game quality evaluation feedback method and system, which are used for solving the technical problems that in the prior art, due to the fact that the evaluation of game quality presents a multi-level and multi-thread complex evaluation process, the relation among evaluation factors is difficult to draw up, and data is redundant.
According to a first aspect of the present disclosure, there is provided a game quality evaluation feedback method including: matching game quality evaluation indexes according to the basic information of the game to be evaluated; traversing the game quality evaluation indexes to perform relevance analysis, and generating a game quality evaluation discrete index set and a game quality evaluation relevance index set; carrying out weight distribution on the game quality evaluation indexes to generate a game quality evaluation index weight distribution result; obtaining an ideal score of game quality evaluation; traversing the game quality evaluation discrete index set and the game quality evaluation associated index set, and collecting an index characteristic value set; performing comprehensive evaluation according to the game quality evaluation index weight distribution result and the index characteristic value set to generate a game quality evaluation score; and when the game quality evaluation score meets the game quality evaluation ideal score, generating a game design scheme qualified instruction.
According to a second aspect of the present disclosure, there is provided a game quality evaluation feedback system including: the quality evaluation index matching module is used for matching game quality evaluation indexes according to the basic information of the game to be evaluated; the relevance analysis module is used for traversing the game quality evaluation indexes to perform relevance analysis so as to generate a game quality evaluation discrete index set and a game quality evaluation relevance index set; the weight distribution module is used for carrying out weight distribution on the game quality evaluation indexes to generate a game quality evaluation index weight distribution result; an ideal score obtaining module, which is used for obtaining the ideal score of the game quality evaluation; the index characteristic value set acquisition module is used for traversing the game quality evaluation discrete index set and the game quality evaluation associated index set and acquiring an index characteristic value set; the comprehensive evaluation module is used for carrying out comprehensive evaluation according to the game quality evaluation index weight distribution result and the index characteristic value set to generate a game quality evaluation score; and the quality evaluation judging module is used for generating a game design scheme qualified instruction when the game quality evaluation score meets the game quality evaluation ideal score.
According to a third aspect of the present disclosure, there is provided an electronic device comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of the first aspect.
According to the game quality evaluation feedback method adopted by the disclosure, game quality evaluation indexes are matched according to basic information of a game to be evaluated; traversing the game quality evaluation indexes to perform relevance analysis, and generating a game quality evaluation discrete index set and a game quality evaluation relevance index set; carrying out weight distribution on the game quality evaluation indexes to generate a game quality evaluation index weight distribution result; obtaining an ideal score of the game quality evaluation; traversing the game quality evaluation discrete index set and the game quality evaluation associated index set, and collecting an index characteristic value set; performing comprehensive evaluation according to the game quality evaluation index weight distribution result and the index characteristic value set to generate a game quality evaluation score; and when the game quality evaluation score meets the game quality evaluation ideal score, generating a game design scheme qualified instruction. According to the method, multi-dimensional and multi-level evaluation indexes are obtained through basic information of the game to be evaluated, weight distribution is set according to factors such as the influence of correlation among the evaluation indexes, the competitive relation of a design scheme, player requirements and the like, then the game to be evaluated is comprehensively evaluated according to the weight distribution result of the quality evaluation indexes and the index characteristic value, the accurate relation among the evaluation indexes is achieved, the data redundancy is reduced, and the game quality is accurately evaluated.
It should be understood that the statements in this section do not necessarily identify key or critical features of the embodiments of the present disclosure, nor do they limit the scope of the present disclosure. Other features of the present disclosure will become apparent from the following description.
Drawings
In order to more clearly illustrate the technical solutions of the present disclosure or the prior art, the drawings used in the embodiments or the prior art descriptions will be briefly described below, it is obvious that the drawings in the following description are only exemplary, and other drawings can be obtained by those skilled in the art without inventive efforts based on the provided drawings.
Fig. 1 is a schematic flow chart of a game quality evaluation feedback method provided in an embodiment of the present disclosure;
FIG. 2 is a schematic flow chart illustrating the generation of a game quality evaluation discrete index set and a game quality evaluation associated index set according to an embodiment of the present disclosure;
FIG. 3 is a schematic flow chart illustrating the generation of a game quality assessment score according to an embodiment of the present disclosure;
FIG. 4 is a schematic structural diagram of a game quality evaluation feedback system according to an embodiment of the present disclosure;
fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure.
Description of reference numerals: the system comprises a quality evaluation index matching module 11, a relevance analysis module 12, a weight distribution module 13, an ideal score acquisition module 14, an index characteristic value set acquisition module 15, a comprehensive evaluation module 16, a quality evaluation judgment module 17, an electronic device 800, a processor 801, a memory 802 and a bus 803.
Detailed Description
Exemplary embodiments of the present disclosure are described below with reference to the accompanying drawings, in which various details of the embodiments of the disclosure are included to assist understanding, and which are to be considered as merely exemplary. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present disclosure. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.
In order to solve the technical problems that in the prior art, due to the fact that game quality evaluation presents a multi-level and multi-thread complex evaluation process, the relation among evaluation factors is difficult to draw up, and data is redundant, the inventor obtains the game quality evaluation feedback method and system through creative labor.
Example one
Fig. 1 is a diagram of a game quality evaluation feedback method provided in an embodiment of the present application, and as shown in fig. 1, the method includes:
step S100: matching game quality evaluation indexes according to the basic information of the game to be evaluated;
wherein, according to the basic information of the game to be evaluated, the game quality evaluation index is matched, and the step S100 of the embodiment of the application comprises:
step S110: the basic information of the game to be evaluated comprises game type information and a quality evaluation purpose;
step S120: acquiring a technical index set, a functional index set and an emotional index set;
step S130: and traversing the technical index set, the functional index set and the emotional index set according to the game type information and the quality evaluation purpose to screen and generate the game quality evaluation index.
Specifically, the game to be evaluated refers to any game for which quality evaluation is required, the game basic information to be evaluated includes information such as a screen effect, a music effect, an operation, a game mechanism, and the like of the game to be evaluated, the game quality evaluation index is an index for measuring the quality level of the game to be evaluated, different games have different basic information and different types of concerned game indexes, and the game quality evaluation index can be matched according to the game basic information to be evaluated.
Specifically, the basic information of the game to be evaluated includes game type information and a quality evaluation purpose, the game type information indicates a game type to which the game to be evaluated belongs, and includes shooting games, simulation operation games, tactical sports games and the like, the quality evaluation purpose is what game quality evaluation is to be performed, for example, playability, expandability and the like of the game to be evaluated are evaluated, and different game types, different evaluation purposes and concerned game quality indexes are also different. The method comprises the steps of obtaining a technical index set, a functional index set and an emotional index set, wherein quality evaluation indexes are divided into three levels of technical indexes, functional indexes and emotional indexes, the game evaluation system needs to be established by considering functional factors such as operability of a game and the like, and also needs to consider satisfaction degree of requirements of players and emotional experience brought to the players, the technical index set comprises indexes such as quantity, color types, visual balance, visibility and simplicity, the functional index set comprises indexes such as function quantity, operation accuracy, operation steps, convenience, feedback time, function guidance, consistency and interaction modes, and the emotional index set comprises indexes such as visual substitution feeling, auditory substitution feeling, joyful feeling, dysphoria feeling, progress feeling and frustration feeling. And screening according to all indexes contained in the technical index set, the functional index set and the emotional index set traversed by the game type information and the quality evaluation purpose, screening indexes meeting the game type information and the quality evaluation purpose of the game to be evaluated, wherein the screened indexes are game quality evaluation indexes. The technical effect of providing basic data for subsequent game quality evaluation is achieved by matching the game quality evaluation indexes according to the basic information of the game to be evaluated.
Step S200: traversing the game quality evaluation indexes to perform relevance analysis, and generating a game quality evaluation discrete index set and a game quality evaluation relevance index set;
wherein, traversing the game quality evaluation indexes to perform relevance analysis, and generating a game quality evaluation discrete index set and a game quality evaluation relevance index set, as shown in fig. 2, step S200 in the embodiment of the present application includes:
step S210: traversing the game quality evaluation indexes to perform regularization processing to generate a game quality evaluation index sequence;
step S220: acquiring a kth-1 game quality evaluation index and a kth game quality evaluation index according to the game quality evaluation index sequence;
step S230: performing relevance analysis on the kth-1 game quality evaluation index and the kth game quality evaluation index to generate a kth-1 relevance degree;
step S240: when the k-1 association degree is larger than an association degree threshold value, adding the k-1 game quality evaluation index and the k game quality evaluation index into the game quality evaluation association index set;
step S250: traversing the game quality evaluation index sequence, and adding the game quality evaluation indexes which are not added into the game quality evaluation associated index set into the game quality evaluation discrete index set.
Wherein, traversing the game quality evaluation indexes to perform regularization processing to generate a game quality evaluation index sequence, in step S210 in this embodiment of the present application, the method includes:
step S211: acquiring a qualitative index set and a quantitative index set according to the game quality evaluation index;
step S212: carrying out regularization processing on the game quality evaluation indexes according to a preset score scale rule to generate a qualitative evaluation index sequence;
step S213: classifying the quantitative index sets to generate a positive excitation quantitative index set and a negative excitation quantitative index set;
step S214: obtaining a quantitative index reduction formula:
wherein, the first and the second end of the pipe are connected with each other,X 1 is a set of forward-excited quantitative indicators,X 2 is a negative-direction excitation quantitative index set,xin order to quantify the characteristic value of the index,ris composed ofxRegularizing the processed result;
step S215: processing the positive excitation quantitative index set and the negative excitation quantitative index set according to the quantitative index reduced formula to generate a quantitative evaluation index sequence;
step S216: and combining the qualitative evaluation index sequence and the quantitative evaluation index sequence to generate the game quality evaluation index sequence.
Wherein, the step S230 of the embodiment of the present application includes performing relevance analysis on the kth game quality evaluation index and the kth game quality evaluation index to generate a kth-1 relevance degree:
step S231: collecting game quality evaluation record data according to the kth-1 game quality evaluation index and the kth game quality evaluation index;
step S232: obtaining a support calculation formula:
wherein the content of the first and second substances,
the result of the calculation of the degree of support is characterized,r k-1 the (k-1) th game quality evaluation index is represented,r k the k-th game quality evaluation index is represented,f(r k-1 ,r k ) Characterization ofr k-1 Andr k the frequency of the co-occurrence of the two,f(r k-1 ) Characterization ofr k-1 The frequency of the single occurrence of the frequency,f(r k ) Characterization ofr k Frequency of individual occurrence;
step S233: obtaining a relevancy calculation formula:
wherein the content of the first and second substances,
calculation of the degree of correlation of the characterization Δr k Characterization of any two sets of recorded datar k Delta, isr k-1 Mean sum Δr k In two corresponding sets of recorded datar k-1 The amount of change in the amount of change,nrepresenting the group number of the correlation calculation statistics;
step S234: traversing the game quality evaluation record data according to the support degree calculation formula, and calculating the kth-1 support degree;
step S235: and when the k-1 support degree is greater than or equal to a support degree threshold value, traversing the game quality evaluation record data according to the association degree calculation formula, and calculating the k-1 association degree.
Specifically, the game quality evaluation indexes are traversed for relevance analysis, and in brief, when one index changes and another index changes, the relevance between the two indexes is shown. The relevance between the indexes has positive correlation, for example, when the operation steps are increased, the dysphoria is likely to be increased; and further, according to the relevance among the game quality evaluation indexes, generating a game quality evaluation association index set and a game quality evaluation association index set, wherein the game quality evaluation association index set comprises indexes which are relevant to other indexes, and the game quality evaluation association index set comprises indexes which are not relevant to any other index.
Specifically, the game quality evaluation indexes comprise multi-dimensional and multi-level evaluation indexes, dimensions among different evaluation indexes are not uniform and cannot be directly used for comparison or calculation, so if comprehensive evaluation covering a plurality of indexes is to be performed, each evaluation index needs to be subjected to regularization processing, influences caused by different dimensions are eliminated, the game quality evaluation indexes need to be traversed for regularization processing, all indexes are subjected to regularization processing and then are arranged in a certain sequence, a game quality evaluation index sequence is generated, a k-1 game quality evaluation index and a k-th game quality evaluation index are obtained according to the game quality evaluation index sequence, wherein k is a positive integer larger than 1, correlation analysis is performed on the k-1 game quality evaluation index and the k-th game quality evaluation index, a k-1 correlation degree is generated, a correlation degree threshold value can be set according to actual conditions, when the k-1 correlation degree is larger than the correlation degree threshold value, the k-1 game quality evaluation index and the k-1 game quality evaluation index are added into the game quality evaluation correlation index set, a whole game quality evaluation index set is traversed, and the game quality evaluation indexes are not added into the game quality evaluation index set, namely, the game quality evaluation indexes are not subjected to discrete evaluation index set.
Specifically, a qualitative index set and a quantitative index set are obtained according to the game quality evaluation index, the qualitative index refers to the game quality evaluation index which cannot be directly quantified and needs to be quantified through other ways, such as simplicity, and the quantitative index refers to the game evaluation index which can be accurately defined in quantity and accurately measured, such as operation accuracy, function quantity and the like. Since dimensions among different evaluation indexes are not uniform and cannot be directly used for comparison or calculation, if comprehensive evaluation covering a plurality of indexes is to be performed, each evaluation index needs to be subjected to regularization processing, influences caused by different dimensions are eliminated, game quality evaluation indexes are subjected to regularization processing according to a preset score scaling rule, a qualitative evaluation index sequence is generated, exemplarily, for qualitative indexes such as convenience, substitution feeling and the like, 5-grade value scaling processing can be selected and divided into five grades of excellent, good, medium, inferior and inferior, scoring adopts a 0-10 grading principle, and an evaluation value related to a certain qualitative index can be represented through a simple weighting method: 0 to 2 (inferior); 2-4 (inferior); 4-6 (middle); 6-8 (good); and 8-10 (optimal), wherein the score is the qualitative characteristic value of the qualitative index, and a quantifiable qualitative index evaluation mode is obtained, so that a qualitative evaluation index sequence is generated. Classifying the quantitative index set to generate a positive excitation quantitative index set and a negative excitation quantitative index set, wherein the positive excitation quantitative index is larger in numerical value and better in quality, and the negative excitation quantitative index is smaller in numerical value and better in quality, and further, a quantitative index reduction formula is obtained:
wherein the content of the first and second substances,X 1 is a set of forward-excited quantitative indicators,X 2 is a negative-direction excitation quantitative index set,xin order to quantify the characteristic value of the index,ris composed ofxAfter regularizationAnd (6) obtaining the result.
After the reduction treatment, the mixture is subjected to the treatment,rthe larger the game quality index sequence is, the better the representative quality is, the positive excitation quantitative index set and the negative excitation quantitative index set are processed according to a quantitative index reduction formula to generate a quantitative evaluation index sequence, and the qualitative evaluation index sequence and the quantitative evaluation index sequence are combined to generate the game quality evaluation index sequence, so that index correlation analysis can be conveniently performed subsequently.
Specifically, according to the (k-1) th game quality evaluation index and the (k) th game quality evaluation index, collecting game quality evaluation record data, wherein the game quality evaluation record data is historical game quality evaluation record data, that is, game quality evaluation record data obtained by evaluating the game quality in the past period of time may have multiple sets of data, each set of data may have the (k-1) th game quality evaluation index and the (k) th game quality evaluation index, may have only one index, or may not have the two indexes, and further, obtaining a support degree calculation formula:
wherein the content of the first and second substances,
the result of the calculation of the degree of support is characterized,r k-1 the (k-1) th game quality evaluation index is represented,r k the k-th game quality evaluation index is represented,f(r k-1 ,r k ) Characterization ofr k-1 Andr k the frequency of the co-occurrence of the two,f(r k-1 ) Characterization ofr k-1 The frequency of the single occurrence of the frequency,f(r k ) Characterization ofr k The frequency of occurrence alone.
Further, a relevancy calculation formula is obtained:
wherein the content of the first and second substances,
calculation of the degree of correlation of the characterization Δr k Characterization of any two sets of recorded datar k Delta. Ofr k-1 Mean sum Δr k In two corresponding sets of recorded datar k-1 The amount of change in the amount of change,nand (5) characterizing the association degree and calculating the statistical group number.
Specifically, according to a support degree calculation formula, traversing game quality evaluation record data, calculating a k-1 support degree, automatically setting a support degree threshold value according to the actual situation, and when the k-1 support degree is greater than or equal to the support degree threshold value, traversing the game quality evaluation record data according to a correlation degree calculation formula, and calculating a k-1 correlation degree, thereby realizing the correlation analysis of the game quality evaluation indexes, and further obtaining the technical effects of a game quality evaluation discrete index set and a game quality evaluation correlation index set according to the correlation.
Step S300: carrying out weight distribution on the game quality evaluation indexes to generate a game quality evaluation index weight distribution result;
specifically, the game quality evaluation indexes are subjected to weight distribution, the weight distribution can be set according to actual conditions, for example, the gender, age, hierarchy, education level, character preference and the like of players are different, so that some players attach more importance to the picture effect, some players attach more importance to the operation experience, some players attach more importance to the social interaction effect, the weight distribution of the game quality evaluation indexes can be set according to users targeted by games, the weight distribution of each evaluation index can be set according to competitive influence relations existing among game design schemes, and then the game quality evaluation index weight distribution result is generated according to the weight distribution of each evaluation index.
Step S400: obtaining an ideal score of the game quality evaluation;
specifically, the game quality evaluation ideal score is a game quality evaluation score when each index meets the ideal condition.
Step S500: traversing the game quality evaluation discrete index set and the game quality evaluation associated index set, and collecting an index characteristic value set;
wherein, the step S500 of traversing the game quality evaluation discrete index set and the game quality evaluation associated index set and collecting an index feature value set in the embodiment of the present application includes:
step S510: screening a plurality of game quality evaluation representative indexes according to the game quality evaluation associated index set;
rage week S520: and traversing the plurality of game quality evaluation representative indexes and the game quality evaluation discrete index set to acquire the index characteristic value, and generating the index characteristic value set.
Specifically, the game quality evaluation discrete index set and the game quality evaluation associated index set are traversed, index characteristic values corresponding to all indexes contained in the game quality evaluation discrete index set and the game quality evaluation associated index set are collected, and an index characteristic value set is generated.
Specifically, according to the game quality evaluation association index set, a plurality of game quality evaluation representative indexes are screened, one index changes, the other index changes, the association relation between the two indexes is represented by the association degree, therefore, the characteristic values of all associated indexes can be obtained by collecting any index characteristic value, namely, any index characteristic value can be collected to be used as the game quality evaluation representative index, and then a plurality of game quality evaluation representative indexes are obtained according to the association, further, the plurality of game quality evaluation representative indexes and the game quality evaluation discrete index set are traversed, the index characteristic values corresponding to all indexes are collected, and then the index characteristic value set is generated.
Step S600: performing comprehensive evaluation according to the game quality evaluation index weight distribution result and the index characteristic value set to generate a game quality evaluation score;
wherein, the step S600 of the embodiment of the present application includes, as shown in fig. 3, performing a comprehensive evaluation according to the game quality evaluation index weight distribution result and the index feature value set to generate a game quality evaluation score:
step S610: sequencing the weight distribution results of the game quality evaluation indexes from small to large to generate a game quality evaluation index weight sequencing result;
step S620: extracting a first evaluation index weight and a second evaluation index weight until a jth evaluation index weight according to the game quality evaluation index weight sorting result;
step S630: comparing the second evaluation index weight with the first evaluation index weight to generate a first weight ratio;
step S640: comparing the jth evaluation index weight with the first evaluation index weight to generate a jth-1 weight ratio;
step S650: acquiring a first evaluation index, a second evaluation index and a jth evaluation index according to the game quality evaluation discrete index set and the game quality evaluation associated index set;
step S660: constructing a first coordinate axis according to the first evaluation index;
step S670: constructing a second coordinate axis according to the first weight ratio and the second evaluation index;
step S680: constructing a jth coordinate axis according to the jth-1 weight ratio and the jth evaluation index;
step S690: combining the first coordinate axis, the second coordinate axis and the j coordinate axis to generate a multi-dimensional coordinate system for evaluating the game quality;
step S6100: inputting the index characteristic value set into the multi-dimensional coordinate system for evaluating the game quality, and outputting a comprehensive evaluation modular length;
step S6110: and setting the comprehensive evaluation modular length as the game quality evaluation score.
Wherein, the step S690 of the embodiment of the present application includes combining the first coordinate axis, the second coordinate axis, and up to the jth coordinate axis to generate a multidimensional coordinate system for evaluating the game quality, where:
step S691: traversing the first coordinate axis and the second coordinate axis until the j coordinate axis, and setting unqualified intervals of j single coordinate axes;
step S692: and marking in the multidimensional coordinate system for evaluating the game quality according to the unqualified intervals of the j single coordinate axes.
Specifically, the game quality is comprehensively evaluated according to the game quality evaluation index weight distribution result and the index characteristic value set, and further, a game quality evaluation score is generated.
Specifically, traversing the game quality evaluation index weight distribution result, sorting the game quality evaluation index weight distribution result in a descending order to generate a game quality evaluation index weight sorting result, extracting a first evaluation index weight and a second evaluation index weight until a jth evaluation index weight according to the game quality evaluation index weight sorting result, wherein j is a positive integer greater than 1, comparing the second evaluation index weight with the first evaluation index weight to generate a first weight ratio, comparing the jth evaluation index weight with the first evaluation index weight according to the game quality evaluation index weight sorting result to generate a jth-1 weight ratio, and further acquiring the first evaluation index and the second evaluation index until the jth evaluation index according to the game quality evaluation discrete index set and the game quality evaluation associated index set, wherein the first evaluation index, the second evaluation index and the jth evaluation index correspond to the first evaluation index weight, the second evaluation index weight and the jth evaluation index weight respectively. Constructing a first coordinate axis according to the first evaluation index; constructing a second coordinate axis according to the first weight ratio and the second evaluation index, wherein the unit scale of the second coordinate axis is the unit scale of the first coordinate axis-the first weight ratio; and constructing a j coordinate axis according to the j-1 weight ratio and the j evaluation index, wherein the unit scale of the j coordinate axis is the unit scale of the first coordinate axis and the j-1 weight ratio. Further, the first coordinate axis, the second coordinate axis and the j coordinate axis are combined to generate a game quality evaluation multidimensional coordinate system, the index characteristic value set is input into the game quality evaluation multidimensional coordinate system, the comprehensive evaluation modular length can be calculated according to the game quality evaluation multidimensional coordinate system, and the comprehensive evaluation modular length is set as a game quality evaluation score.
Specifically, traversing the first coordinate axis and the second coordinate axis to the j-th coordinate axis, and setting the unqualified intervals of j single coordinate axes, because there is a possibility: the comprehensive evaluation modular length meets the ideal score of the game quality evaluation, but the index of a certain dimension is too poor, and under the condition, the game quality is also unqualified, so j unqualified single-coordinate-axis intervals need to be set, and then identification is carried out in a multi-dimensional coordinate system of the game quality evaluation according to the unqualified single-coordinate-axis intervals, so that if the game quality is qualified, two conditions need to be met: comprehensively evaluating that the modular length meets an ideal value; the individual index feature values are not within the identified coordinate system region. The game quality evaluation indexes are comprehensively evaluated by using the coordinate system, so that the visualization degree in the evaluation process is improved, and the technical effects of the deviation between the current game quality and an ideal value and the quality indexes can be visually seen.
Step S700: and when the game quality evaluation score meets the game quality evaluation ideal score, generating a game design scheme qualified instruction.
Specifically, when the game quality evaluation score satisfies the game quality evaluation ideal score, that is, the game quality evaluation score is equal to or greater than the game quality evaluation ideal score, the game design scenario acceptance instruction is generated.
Based on the analysis, the method for evaluating and feeding back the game quality is provided, multi-dimensional and multi-level evaluation indexes are obtained through basic information of the game to be evaluated, weight distribution is set according to factors such as relevant relation influence among the evaluation indexes, competition relation of a design scheme, player requirements and the like, then comprehensive evaluation is carried out on the game to be evaluated according to quality evaluation index weight distribution results and index characteristic values, the relation among the evaluation indexes is accurate, data redundancy is reduced, and the technical effect of accurately evaluating the game quality is achieved.
Example two
Based on the same inventive concept as the game quality evaluation feedback method in the foregoing embodiment, as shown in fig. 4, the present application further provides a game quality evaluation feedback system, including:
the quality evaluation index matching module 11 is used for matching game quality evaluation indexes according to the basic information of the game to be evaluated;
the relevance analysis module 12 is configured to traverse the game quality evaluation indexes to perform relevance analysis, and generate a game quality evaluation discrete index set and a game quality evaluation relevance index set;
the weight distribution module 13, the weight distribution module 13 is configured to perform weight distribution on the game quality evaluation index to generate a game quality evaluation index weight distribution result;
an ideal score obtaining module 14, wherein the ideal score obtaining module 14 is used for obtaining an ideal score of the game quality evaluation;
the index characteristic value set acquisition module 15 is configured to traverse the game quality evaluation discrete index set and the game quality evaluation associated index set, and acquire an index characteristic value set;
the comprehensive evaluation module 16 is used for performing comprehensive evaluation according to the game quality evaluation index weight distribution result and the index characteristic value set to generate a game quality evaluation score;
and the quality evaluation judging module 17 is used for generating a game design scheme qualified instruction when the game quality evaluation score meets the game quality evaluation ideal score.
Further, the system further comprises:
the game basic information evaluation module is used for evaluating the game basic information to be evaluated, wherein the game basic information to be evaluated comprises game type information and a quality evaluation purpose;
the index set acquisition module is used for acquiring a technical index set, a functional index set and an emotional index set;
and the index screening module is used for traversing the technical index set, the functional index set and the emotional index set according to the game type information and the quality evaluation purpose to screen so as to generate the game quality evaluation index.
Further, the system further comprises:
the index regularization processing module is used for traversing the game quality evaluation indexes to carry out regularization processing so as to generate a game quality evaluation index sequence;
the game quality evaluation index acquisition module is used for acquiring a kth-1 game quality evaluation index and a kth game quality evaluation index according to the game quality evaluation index sequence;
the index relevance analysis module is used for carrying out relevance analysis on the kth game quality evaluation index and the kth game quality evaluation index to generate a kth-1 relevance degree;
a relevance degree judging module, configured to add the k-1 game quality evaluation index and the k-1 game quality evaluation index into the game quality evaluation relevance index set when the k-1 relevance degree is greater than a relevance degree threshold;
and the game quality evaluation index adding module is used for traversing the game quality evaluation index sequence and adding the game quality evaluation indexes which are not added into the game quality evaluation associated index set into the game quality evaluation discrete index set.
Further, the system further comprises:
the qualitative and quantitative index set acquisition module is used for acquiring a qualitative index set and a quantitative index set according to the game quality evaluation index;
the qualitative evaluation index sequence generation module is used for carrying out regularization processing on the game quality evaluation index according to a preset score scale rule to generate a qualitative evaluation index sequence;
the quantitative index set classification module is used for classifying the quantitative index set to generate a positive excitation quantitative index set and a negative excitation quantitative index set;
the quantitative index reduced formula acquisition module is used for acquiring a quantitative index reduced formula:
wherein the content of the first and second substances,X 1 is a set of forward-excited quantitative indicators,X 2 is a negative-direction excitation quantitative index set,xin order to quantify the characteristic value of the index,ris composed ofxRegularizing the processed result;
the quantitative evaluation index sequence generation module is used for processing the positive excitation quantitative index set and the negative excitation quantitative index set according to the quantitative index reduction formula to generate a quantitative evaluation index sequence;
and the index sequence merging module is used for merging the qualitative evaluation index sequence and the quantitative evaluation index sequence to generate the game quality evaluation index sequence.
Further, the system further comprises:
the game quality evaluation record data acquisition module is used for acquiring game quality evaluation record data according to the kth-1 game quality evaluation index and the kth game quality evaluation index;
a support calculation formula obtaining module, configured to obtain a support calculation formula:
wherein, the first and the second end of the pipe are connected with each other,
the result of the calculation of the degree of support is characterized,r k-1 the (k-1) th game quality evaluation index is represented,r k the k-th game quality evaluation index is represented,f(r k-1 ,r k ) Characterization ofr k-1 Andr k the frequency of the co-occurrence of the two,f(r k-1 ) Characterization ofr k-1 The frequency of the single occurrence of the frequency,f(r k ) Characterization ofr k Frequency of individual occurrence;
the association calculation formula obtaining module is used for obtaining an association calculation formula:
wherein the content of the first and second substances,
calculation of the degree of correlation of the characterization Δr k Characterization of any two sets of recorded datar k Delta. Ofr k-1 Mean sum Δr k In two corresponding sets of recorded datar k-1 The amount of change in the amount of change,nrepresenting the group number of the correlation calculation statistics;
the k-1 support calculation module is used for traversing the game quality evaluation record data according to the support calculation formula and calculating the k-1 support;
and the k-1 association degree calculation module is used for traversing the game quality evaluation record data according to the association degree calculation formula and calculating the k-1 association degree when the k-1 support degree is greater than or equal to a support degree threshold value.
Further, the system further comprises:
the game quality evaluation representative index screening module is used for screening a plurality of game quality evaluation representative indexes according to the game quality evaluation associated index set;
and the index characteristic value set generating module is used for traversing the plurality of game quality evaluation representative indexes and the game quality evaluation discrete index set to acquire the index characteristic values and generate the index characteristic value set.
Further, the system further comprises:
the index weight sorting module is used for sorting the game quality evaluation index weight distribution results from small to large in a traversal mode to generate game quality evaluation index weight sorting results;
the evaluation index weight acquisition module is used for extracting a first evaluation index weight and a second evaluation index weight until a jth evaluation index weight according to the game quality evaluation index weight sorting result;
a first weight ratio generation module, configured to calculate a ratio between the second evaluation index weight and the first evaluation index weight, and generate a first weight ratio;
the j-1 weight ratio generating module is used for calculating the ratio of the j evaluation index weight and the first evaluation index weight to generate a j-1 weight ratio;
a jth evaluation index acquisition module, configured to acquire a first evaluation index, a second evaluation index, and up to a jth evaluation index according to the game quality evaluation discrete index set and the game quality evaluation associated index set;
the first coordinate axis construction module is used for constructing a first coordinate axis according to the first evaluation index;
the second coordinate axis construction module is used for constructing a second coordinate axis according to the first weight ratio and the second evaluation index;
the j coordinate axis construction module is used for constructing a j coordinate axis according to the j-1 weight ratio and the j evaluation index;
the multi-dimensional coordinate system generation module is used for combining the first coordinate axis, the second coordinate axis and the j coordinate axis to generate a multi-dimensional coordinate system for evaluating the game quality;
the comprehensive evaluation module length output module is used for inputting the index characteristic value set into the game quality evaluation multi-dimensional coordinate system and outputting a comprehensive evaluation module length;
and the game quality evaluation score setting module is used for setting the comprehensive evaluation modular length as the game quality evaluation score.
Further, the system further comprises:
the coordinate axis unqualified interval setting module is used for traversing the first coordinate axis, the second coordinate axis to the jth coordinate axis and setting j single coordinate axis unqualified intervals;
and the multidimensional coordinate system identification module is used for identifying in the multidimensional coordinate system for evaluating the game quality according to the unqualified intervals of the j single coordinate axes.
A specific example of the game quality evaluation feedback method in the first embodiment is also applicable to the game quality evaluation feedback system in the present embodiment, and a person skilled in the art can clearly know the game quality evaluation feedback system in the present embodiment through the foregoing detailed description of the game quality evaluation feedback method, so for the brevity of the description, detailed description is omitted here. The device disclosed in the embodiment corresponds to the method disclosed in the embodiment, so that the description is simple, and the relevant points can be referred to the description of the method part.
EXAMPLE III
Fig. 5 is a schematic diagram according to a third embodiment of the present disclosure, and as shown in fig. 5, an electronic device 800 in the present disclosure may include: a processor 801 and a memory 802.
A memory 802 for storing programs; the Memory 802 may include a volatile Memory (RAM), such as a Static Random Access Memory (SRAM), a Double Data Rate Synchronous Dynamic Random Access Memory (DDR SDRAM), and the like; the memory may also comprise a non-volatile memory, such as a flash memory. The memory 802 is used to store computer programs (e.g., applications, functional modules, etc. that implement the above-described methods), computer instructions, etc., which may be stored in one or more of the memories 802 in a partitioned manner. And the above-described computer programs, computer instructions, data, and the like can be called by the processor 801.
The computer programs, computer instructions, etc. described above may be stored in one or more memories 802 in partitions. And the above-mentioned computer program, computer instruction, or the like can be called by the processor 801.
A processor 801 for executing the computer program stored in the memory 802 to implement the steps of the method according to the above embodiments.
Reference may be made in particular to the description relating to the preceding method embodiment.
The processor 801 and the memory 802 may be separate structures or may be integrated structures integrated together. When the processor 801 and the memory 802 are separate structures, the memory 802 and the processor 801 may be coupled by a bus 803.
The electronic device of this embodiment may execute the technical solution in the method, and the specific implementation process and the technical principle are the same, which are not described herein again.
The present disclosure also provides an electronic device, a readable storage medium, and a computer program product according to embodiments of the present disclosure.
According to an embodiment of the present disclosure, the present disclosure also provides a computer program product comprising: a computer program, stored in a readable storage medium, from which at least one processor of the electronic device can read the computer program, the at least one processor executing the computer program causing the electronic device to perform the solution provided by any of the embodiments described above.
It should be understood that various forms of the flows shown above may be used, with steps reordered, added, or deleted. For example, the steps described in this disclosure may be performed in parallel, sequentially or in a different order,
the disclosure is not limited thereto so long as it achieves the desired results of the presently disclosed embodiments.
The above detailed description should not be construed as limiting the scope of the disclosure. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made in accordance with design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present disclosure should be included in the protection scope of the present disclosure.
Claims (10)
1. A game quality evaluation feedback method, comprising:
matching game quality evaluation indexes according to the basic information of the game to be evaluated;
traversing the game quality evaluation indexes to perform relevance analysis, and generating a game quality evaluation discrete index set and a game quality evaluation relevance index set;
carrying out weight distribution on the game quality evaluation indexes to generate a game quality evaluation index weight distribution result;
obtaining an ideal score of the game quality evaluation;
traversing the game quality evaluation discrete index set and the game quality evaluation associated index set, and collecting an index characteristic value set;
performing comprehensive evaluation according to the game quality evaluation index weight distribution result and the index characteristic value set to generate a game quality evaluation score;
and when the game quality evaluation score meets the game quality evaluation ideal score, generating a game design scheme qualified instruction.
2. The game quality evaluation feedback method according to claim 1, wherein the matching of the game quality evaluation index according to the basic information of the game to be evaluated comprises:
the basic information of the game to be evaluated comprises game type information and a quality evaluation purpose;
acquiring a technical index set, a functional index set and an emotional index set;
and traversing the technical index set, the functional index set and the emotional index set according to the game type information and the quality evaluation purpose to screen and generate the game quality evaluation index.
3. The method as claimed in claim 1, wherein traversing the game quality evaluation index for correlation analysis to generate a game quality evaluation discrete index set and a game quality evaluation correlation index set comprises:
traversing the game quality evaluation indexes to carry out regularization processing to generate a game quality evaluation index sequence;
acquiring a kth-1 game quality evaluation index and a kth game quality evaluation index according to the game quality evaluation index sequence;
performing relevance analysis on the kth-1 game quality evaluation index and the kth game quality evaluation index to generate a kth-1 relevance degree;
when the k-1 association degree is larger than an association degree threshold value, adding the k-1 game quality evaluation index and the k game quality evaluation index into the game quality evaluation association index set;
traversing the game quality evaluation index sequence, and adding the game quality evaluation indexes which are not added into the game quality evaluation associated index set into the game quality evaluation discrete index set.
4. The game quality evaluation feedback method of claim 3, wherein traversing the game quality evaluation indicators for regularization to generate a sequence of game quality evaluation indicators comprises:
acquiring a qualitative index set and a quantitative index set according to the game quality evaluation index;
carrying out regularization processing on the game quality evaluation indexes according to a preset score scaling rule to generate a qualitative evaluation index sequence;
classifying the quantitative index sets to generate a positive excitation quantitative index set and a negative excitation quantitative index set;
obtaining a quantitative index reduction formula:
wherein the content of the first and second substances,X 1 is a set of forward-excited quantitative indicators,X 2 is a negative-direction excitation quantitative index set,xin order to quantify the characteristic value of the index,ris composed ofxRegularizing the processed result;
processing the positive excitation quantitative index set and the negative excitation quantitative index set according to the quantitative index reduction formula to generate a quantitative evaluation index sequence;
and combining the qualitative evaluation index sequence and the quantitative evaluation index sequence to generate the game quality evaluation index sequence.
5. The game quality evaluation feedback method according to claim 3, wherein the performing a correlation analysis on the k-1 game quality evaluation index and the k-1 game quality evaluation index to generate a k-1 correlation degree comprises:
collecting game quality evaluation record data according to the kth-1 game quality evaluation index and the kth game quality evaluation index;
obtaining a support calculation formula:
wherein the content of the first and second substances,
the result of the calculation of the degree of support is characterized,r k-1 the (k-1) th game quality evaluation index is represented,r k the k-th game quality evaluation index is represented,f(r k-1 ,r k ) Characterization ofr k-1 Andr k the frequency of the co-occurrence of the two,f(r k-1 ) Characterization ofr k-1 The frequency of the single occurrence of the frequency,f(r k ) Characterization ofr k Frequency of individual occurrence;
obtaining a relevancy calculation formula:
wherein, the first and the second end of the pipe are connected with each other,
calculation of the degree of correlation of the characterization Δr k Characterization of any two sets of recorded datar k Delta. Ofr k-1 Mean sum Δr k In two corresponding sets of recorded datar k-1 The amount of change in the amount of change,nrepresenting the group number of the correlation calculation statistics;
traversing the game quality evaluation record data according to the support degree calculation formula, and calculating the kth-1 support degree;
and when the k-1 support degree is greater than or equal to a support degree threshold value, traversing the game quality evaluation record data according to the association degree calculation formula, and calculating the k-1 association degree.
6. The game quality evaluation feedback method according to claim 1, wherein traversing the game quality evaluation discrete index set and the game quality evaluation associated index set, and collecting an index feature value set comprises:
screening a plurality of game quality evaluation representative indexes according to the game quality evaluation associated index set;
and traversing the plurality of game quality evaluation representative indexes and the game quality evaluation discrete index set to acquire index characteristic values, and generating the index characteristic value set.
7. The game quality evaluation feedback method according to claim 1, wherein said performing a comprehensive evaluation based on the game quality evaluation index weight distribution result and the index feature value set to generate a game quality evaluation score comprises:
sequencing the weight distribution results of the game quality evaluation indexes from small to large to generate a game quality evaluation index weight sequencing result;
extracting a first evaluation index weight and a second evaluation index weight until a jth evaluation index weight according to the game quality evaluation index weight sorting result;
comparing the second evaluation index weight with the first evaluation index weight to generate a first weight ratio;
comparing the jth evaluation index weight with the first evaluation index weight to generate a jth-1 weight ratio;
acquiring a first evaluation index, a second evaluation index and a jth evaluation index according to the game quality evaluation discrete index set and the game quality evaluation associated index set;
constructing a first coordinate axis according to the first evaluation index;
constructing a second coordinate axis according to the first weight ratio and the second evaluation index;
constructing a jth coordinate axis according to the jth-1 weight ratio and the jth evaluation index;
combining the first coordinate axis, the second coordinate axis and the j coordinate axis to generate a multi-dimensional coordinate system for evaluating the game quality;
inputting the index characteristic value set into the multi-dimensional coordinate system for evaluating the game quality, and outputting a comprehensive evaluation modular length;
and setting the comprehensive evaluation modular length as the game quality evaluation score.
8. The game quality evaluation feedback method of claim 7, wherein said combining the first axis, the second axis up to the j-th axis generates a game quality evaluation multidimensional coordinate system, further comprising:
traversing the first coordinate axis and the second coordinate axis until the j coordinate axis, and setting unqualified intervals of j single coordinate axes;
and marking in the multidimensional coordinate system for evaluating the game quality according to the unqualified intervals of the j single coordinate axes.
9. A game quality evaluation feedback system, comprising:
the quality evaluation index matching module is used for matching game quality evaluation indexes according to the basic information of the game to be evaluated;
the relevance analysis module is used for traversing the game quality evaluation indexes to perform relevance analysis so as to generate a game quality evaluation discrete index set and a game quality evaluation relevance index set;
the weight distribution module is used for carrying out weight distribution on the game quality evaluation indexes to generate a game quality evaluation index weight distribution result;
an ideal score obtaining module, which is used for obtaining the ideal score of the game quality evaluation;
the index characteristic value set acquisition module is used for traversing the game quality evaluation discrete index set and the game quality evaluation associated index set and acquiring an index characteristic value set;
the comprehensive evaluation module is used for carrying out comprehensive evaluation according to the game quality evaluation index weight distribution result and the index characteristic value set to generate a game quality evaluation score;
and the quality evaluation judging module is used for generating a game design scheme qualified instruction when the game quality evaluation score meets the game quality evaluation ideal score.
10. An electronic device, comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310022819.7A CN115738285A (en) | 2023-01-08 | 2023-01-08 | Game quality evaluation feedback method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310022819.7A CN115738285A (en) | 2023-01-08 | 2023-01-08 | Game quality evaluation feedback method and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115738285A true CN115738285A (en) | 2023-03-07 |
Family
ID=85348372
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310022819.7A Pending CN115738285A (en) | 2023-01-08 | 2023-01-08 | Game quality evaluation feedback method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115738285A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116452034A (en) * | 2023-03-23 | 2023-07-18 | 河北省建筑科学研究院有限公司 | Quality supervision method and system for ultra-low energy consumption building construction |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110163460A (en) * | 2018-03-30 | 2019-08-23 | 腾讯科技（深圳）有限公司 | A kind of method and apparatus determined using score value |
| CN111652459A (en) * | 2020-04-09 | 2020-09-11 | 湖北省电力勘测设计院有限公司 | Power grid evaluation method considering new energy consumption multi-index connotation |
-
2023
- 2023-01-08 CN CN202310022819.7A patent/CN115738285A/en active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110163460A (en) * | 2018-03-30 | 2019-08-23 | 腾讯科技（深圳）有限公司 | A kind of method and apparatus determined using score value |
| CN111652459A (en) * | 2020-04-09 | 2020-09-11 | 湖北省电力勘测设计院有限公司 | Power grid evaluation method considering new energy consumption multi-index connotation |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116452034A (en) * | 2023-03-23 | 2023-07-18 | 河北省建筑科学研究院有限公司 | Quality supervision method and system for ultra-low energy consumption building construction |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Archambault et al. | Towards a multilingual, comprehensive and open scientific journal ontology | |
| CN106933806A (en) | The determination method and apparatus of medical synonym | |
| CN111914162B (en) | Method for guiding personalized learning scheme based on knowledge graph | |
| CN114822855B (en) | Cognitive training task pushing method, system and construction method based on FTRL model | |
| CN111831905A (en) | Recommendation method and device based on team scientific research influence and sustainability modeling | |
| CN110334356A (en) | Article matter method for determination of amount, article screening technique and corresponding device | |
| CN112699283A (en) | Test paper generation method and device | |
| CN107220311A (en) | A kind of document representation method of utilization locally embedding topic modeling | |
| CN115738285A (en) | Game quality evaluation feedback method and system | |
| Xie et al. | Automated essay scoring via pairwise contrastive regression | |
| JP2009116457A (en) | Method and device for analyzing internet site information | |
| CN114519508A (en) | Credit risk assessment method based on time sequence deep learning and legal document information | |
| Sinha et al. | NLP-based automatic answer evaluation | |
| CN112836137B (en) | Character network support degree computing system and method, terminal, equipment and storage medium | |
| Wu et al. | Toward effective automated content analysis via crowdsourcing | |
| CN110309411A (en) | A kind of resource recommendation method and device | |
| CN107578785A (en) | The continuous emotional feature analysis evaluation method of music based on Gamma distributional analysis | |
| CN113420946B (en) | News media evaluation method | |
| CN115841269A (en) | Periodical dynamic evaluation method based on multi-dimensional index analysis | |
| CN116778210A (en) | Teaching image evaluation system and teaching image evaluation method | |
| CN108550019A (en) | A kind of resume selection method and device | |
| CN107203632A (en) | Topic Popularity prediction method based on similarity relation and cooccurrence relation | |
| Kulakou | Exploration of time-series models on time series data | |
| CN111402098B (en) | Intelligent early education method, system, equipment and storage medium based on child growth period | |
| CN117708545B (en) | Viewpoint contribution degree evaluation method and system integrating theme extraction and cosine similarity |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |