CN110287103A - Software product assessment processing method, device, computer equipment and storage medium - Google Patents

Software product assessment processing method, device, computer equipment and storage medium Download PDF

Info

Publication number
CN110287103A
CN110287103A CN201910430095.3A CN201910430095A CN110287103A CN 110287103 A CN110287103 A CN 110287103A CN 201910430095 A CN201910430095 A CN 201910430095A CN 110287103 A CN110287103 A CN 110287103A
Authority
CN
China
Prior art keywords
assessment
target
product
original
dimension
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910430095.3A
Other languages
Chinese (zh)
Other versions
CN110287103B (en
Inventor
赵昊
赵晔菲
张佩茜
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
OneConnect Smart Technology Co Ltd
Original Assignee
OneConnect Smart Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by OneConnect Smart Technology Co Ltd filed Critical OneConnect Smart Technology Co Ltd
Priority to CN201910430095.3A priority Critical patent/CN110287103B/en
Publication of CN110287103A publication Critical patent/CN110287103A/en
Application granted granted Critical
Publication of CN110287103B publication Critical patent/CN110287103B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/36—Preventing errors by testing or debugging software
    • G06F11/3604—Software analysis for verifying properties of programs
    • G06F11/3608—Software analysis for verifying properties of programs using formal methods, e.g. model checking, abstract interpretation

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Software Systems (AREA)
  • Computer Hardware Design (AREA)
  • Quality & Reliability (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

The present invention discloses a kind of software product assessment processing method, device, computer equipment and storage medium.This method comprises: the target product type based on Test and analysis request obtains Test and analysis sample, at least one corresponding assessment problem and original assessment dimension are extracted；Importance analysis is carried out to original assessment dimension, obtains at least two targets assessment dimension；Importance analysis is carried out to the corresponding all assessment problems of each target assessment dimension, obtains assessment indicator；Model construction is carried out to target assessment dimension and assessment indicator, obtains target Test and analysis model；It obtains the corresponding target assessment problem of each assessment indicator and carries out consistency desired result, obtain consistency desired result result；If consistency desired result result passes through for verification, product assessment questionnaire information is obtained based on target assessment problem, by the assessment interface of product assessment questionnaire information insertion software under testing product, forms target software product.This method can reduce software product measurement cost, improve efficiency and real-time.

Description

Software product assessment processing method, device, computer equipment and storage medium
Technical field
The present invention relates to software testing technology field more particularly to a kind of software product assessment processing methods, device, calculating Machine equipment and storage medium.
Background technique
The financial institutions such as current bank, security and insurance or other product development mechanisms develop different software products (such as finance product APP of banking institution's exploitation), to carry out promoting service based on the software product.It was promoted in software product Cheng Zhong, user are an important factor for influencing the utilization rate or popularization rate of the software product on the user experience of the software product. In general, user experience is better, then user more actively uses and promote the software product, so that its utilization rate and popularization rate are got over Greatly, be more conducive to the promoting service of software product.Therefore, it before software product is online, generally can all carry out surveying in corresponding, To acquire the assessment investigational data that interior survey personnel are fed back based on preset assessment problem, or after software product is online, meeting By specific research project, the assessment investigational data that user feeds back preset assessment problem is acquired, thus according to being acquired To assessment investigational data determine the corresponding evaluating result of assessment indicator, with according to evaluating result carry out software product optimization change Into.
The assessment of traditional software product is by using traditional investigation mode such as user's interview or questionnaire, in assessment week The assessment problem of product development mechanism setting is commented in phase, obtain assessment investigational data and is analyzed, so as to basis It analyzes result and carries out product optimization processing.It is insufficient to there are following several points in this traditional software product assessment process: one is, cost Higher and efficiency is lower, that is, needs to be equipped with corresponding assessment personnel by product development mechanism and carry out the design of assessment problem and subsequent survey Scoring analysis, human cost and time cost are higher, and efficiency is lower；The second is assessment problem design has one-sidedness, that is, survey The design of problem is commented to be limited to the professional ability and experience of assessment personnel, the assessment problem designed may not be able to reflect well The assessment demand of software product；The third is the acquisition for investigational data of testing and assessing does not have real-time, i.e., it is general only in product development It is commented in the assessment period of mechanism setting, corresponding assessment investigational data can not be acquired in real time.
Summary of the invention
The embodiment of the present invention provides a kind of software product assessment processing method, device, computer equipment and storage medium, with Solve the problems, such as that lower higher cost present in Current software product assessment process, efficiency, one-sidedness and real-time be not strong.
A kind of software product assessment processing method, comprising:
Obtain Test and analysis request, Test and analysis request include software under testing product and with the software under testing product Corresponding target product type；
Based on target product type queries assessment questionnaire information library, if not being stored in the assessment questionnaire information library Original assessment questionnaire information corresponding with the target product type then obtains corresponding survey based on the target product type Scoring analysis sample, extract at least one corresponding assessment problem of each Test and analysis sample and with each assessment problem Corresponding original assessment dimension；
Original assessment dimension corresponding to all assessment problems carries out importance analysis, obtains at least two targets and surveys Comment dimension；
Importance analysis are carried out to the corresponding all assessment problems of each target assessment dimension, obtain the mesh Mapping comments the corresponding assessment indicator of dimension；
It is tested and assessed using Structural Equation Modeling Analysis software at least two target assessment dimensions and each target The corresponding assessment indicator of dimension carries out model construction, obtains target Test and analysis model；
Based on the assessment indicator in the target Test and analysis model, obtains the corresponding target of each assessment indicator and survey Problem is commented, consistency desired result is carried out to each assessment indicator corresponding target assessment problem, obtains consistency desired result result；
If consistency desired result result is that verification passes through, based on the corresponding target assessment problem of all assessment indicators, obtain Product assessment questionnaire information and the target product type association are stored in assessment questionnaire letter by product assessment questionnaire information Cease library；
Based on the information collecting interface on the software under testing product, by product assessment questionnaire information insertion it is described to The assessment interface of software product is surveyed, target software product is formed.
A kind of software product assessment processing unit, comprising:
Test and analysis request module, for obtaining Test and analysis request, the Test and analysis request includes to be measured soft Part product and target product type corresponding with the software under testing product；
Test and analysis sample acquisition module, for being based on target product type queries assessment questionnaire information library, if institute It states in assessment questionnaire information library and is not stored with original assessment questionnaire information corresponding with the target product type, be then based on institute It states target product type and obtains corresponding Test and analysis sample, extract at least one the corresponding survey of each Test and analysis sample Comment problem and original assessment dimension corresponding with each assessment problem；
Target dimension of testing and assessing obtains module, for important to the corresponding original assessment dimension progress of all assessment problems Property analysis, obtain at least two targets test and assess dimension；
Assessment indicator obtains module, and the corresponding all assessment problems of dimension that are used to test and assess to each target carry out Importance analysis obtains the corresponding assessment indicator of the target assessment dimension；
Test and analysis model obtains module, for being surveyed using Structural Equation Modeling Analysis software at least two targets It comments dimension and the corresponding assessment indicator of each target assessment dimension to carry out model construction, obtains target Test and analysis mould Type；
Consistency desired result result obtains module, for obtaining based on the assessment indicator in the target Test and analysis model The corresponding target of each assessment indicator is tested and assessed problem, carries out one to the corresponding target assessment problem of each assessment indicator The verification of cause property, obtains consistency desired result result；
Questionnaire information of testing and assessing obtains module, if being that verification passes through for consistency desired result result, is referred to based on all assessments Corresponding target assessment problem is marked, product assessment questionnaire information is obtained, product assessment questionnaire information and the target is produced Category type associated storage is in assessment questionnaire information library；
Target software product obtains module, will be described for based on the information collecting interface on the software under testing product Product assessment questionnaire information is embedded in the assessment interface of the software under testing product, forms target software product.
A kind of computer equipment, including memory, processor and storage are in the memory and can be in the processing The computer program run on device, the processor realize above-mentioned software product assessment processing side when executing the computer program The step of method.
A kind of computer readable storage medium, the computer-readable recording medium storage have computer program, the meter Calculation machine program realizes the step of above-mentioned software product assessment processing method when being executed by processor.
Above-mentioned software product assessment processing method, device, computer equipment and storage medium, in assessment questionnaire information library When not being stored with original assessment questionnaire information corresponding with target product type, first from survey corresponding with target product type Assessment problem and corresponding original assessment dimension are extracted in scoring analysis sample, it is corresponding with the target product type with determination The assessment problem and original assessment dimension for thering is software product to acquire in assessment process, so that number used by Test and analysis process According to objectivity.Then, original assessment dimension corresponding to all assessment problems carries out importance analysis, according to original survey Importance of the dimension in all Test and analysis samples corresponding with target product type is commented, guarantees target assessment dimension at this The general applicability tested and assessed in the corresponding software product of target product type.Then, to the corresponding institute of each target assessment dimension There is assessment problem to carry out importance analysis, obtains the corresponding assessment indicator of target assessment dimension, guarantee the assessment indicator in the mesh The general applicability tested and assessed in the corresponding software product of mark product type.Then, using Structural Equation Modeling Analysis software to mesh Mapping comments dimension and assessment indicator to carry out model construction, so that constructed target Test and analysis model can reflect between the two With more stable potential relationship, so that the finally target assessment dimension and assessment indicator in determining target Test and analysis model With more objectivity with apply the general applicability in the corresponding software product assessment process of target product type.According to target Assessment indicator in Test and analysis model forms corresponding target assessment problem and carries out consistency desired result, and in consistency school Testing result is to obtain product assessment questionnaire information when verifying to pass through, so that the target assessment problem in product assessment questionnaire information Setting there is objectivity and comprehensive.Product assessment questionnaire information is embedded in the assessment interface of software under testing product, formation Target software product, so that user during using target software product, can input in real time and be arranged for different assessment indicators Target assessment problem feedback, improve the real-time of user comment.
Detailed description of the invention
In order to illustrate the technical solution of the embodiments of the present invention more clearly, below by institute in the description to the embodiment of the present invention Attached drawing to be used is needed to be briefly described, it should be apparent that, the accompanying drawings in the following description is only some implementations of the invention Example, for those of ordinary skill in the art, without any creative labor, can also be according to these attached drawings Obtain other attached drawings.
Fig. 1 is an application environment schematic diagram of software product assessment processing method in one embodiment of the invention；
Fig. 2 is a flow chart of software product assessment processing method in one embodiment of the invention；
Fig. 3 is another flow chart of software product assessment processing method in one embodiment of the invention；
Fig. 4 is another flow chart of software product assessment processing method in one embodiment of the invention；
Fig. 5 is another flow chart of software product assessment processing method in one embodiment of the invention；
Fig. 6 is another flow chart of software product assessment processing method in one embodiment of the invention；
Fig. 7 is another flow chart of software product assessment processing method in one embodiment of the invention；
Fig. 8 is another flow chart of software product assessment processing method in one embodiment of the invention；
Fig. 9 is a schematic diagram of software product assessment processing unit in one embodiment of the invention；
Figure 10 is a schematic diagram of computer equipment in one embodiment of the invention.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete Site preparation description, it is clear that described embodiments are some of the embodiments of the present invention, instead of all the embodiments.Based on this hair Embodiment in bright, every other implementation obtained by those of ordinary skill in the art without making creative efforts Example, shall fall within the protection scope of the present invention.
Software product assessment processing method provided in an embodiment of the present invention, which tests and assesses processing method can be using such as In application environment shown in FIG. 1.Specifically, software product assessment processing method is applied in product Evaluation Platform, the product Evaluation Platform includes client and server as shown in Figure 1, and client is communicated with server by network, for realizing The Test and analysis model that building matches with target product type, so as to be determined according to the assessment indicator in the Test and analysis model Product assessment questionnaire information, and by product assessment questionnaire information insertion software under testing product, it is formed comprising interface of testing and assessing Target software product, guarantees the objectivity of assessment problem, and user is facilitated to be tested and assessed in real time, is based on the Test and analysis to improve Assessment indicator in model carries out the efficiency and quality of software product optimization.Wherein, client is also known as user terminal, refers to and takes Business device is corresponding, provides the program of local service for client.Client it is mountable but be not limited to various personal computers, notes On this computer, smart phone, tablet computer and portable wearable device.Server can be either more with independent server The server cluster of a server composition is realized.
In one embodiment, it as shown in Fig. 2, providing a kind of software product assessment processing method, is applied in this way in Fig. 1 In server for be illustrated, include the following steps:
S201: obtain Test and analysis request, Test and analysis request include software under testing product and with software under testing product phase Corresponding target product type.
Wherein, Test and analysis request is to carry out the request of Test and analysis to specific software product for trigger the server. Software under testing product refers to the software product for needing to carry out Test and analysis, and information collecting interface is reserved on the software under testing product, For receiving the product assessment questionnaire information for carrying out Test and analysis to the software under testing product, so as to based on product assessment questionnaire Information collection is tested and assessed investigational data accordingly, carries out product optimization processing.Target product type refers to this Test and analysis institute needle Pair software product product type, the product type include but is not limited to tool for managing money matters type (such as palm bank), communication work Have type (such as wechat) and office tools type.
S202: based on target product type queries test and assess questionnaire information library, if assessment questionnaire information library in be not stored with The corresponding original assessment questionnaire information of target product type then obtains corresponding Test and analysis sample based on target product type This, extracts at least one corresponding assessment problem of each Test and analysis sample and original assessment corresponding with each assessment problem Dimension.
Wherein, assessment questionnaire information library is for storing original assessment questionnaire information corresponding with each product type Database.The original assessment questionnaire information refers to assessment questionnaire information that is pre-generated and storing.Test and analysis sample be with The corresponding sample that can be used for carrying out Test and analysis of target product type.The Test and analysis sample specifically can be to be produced with target During the investigation questionnaire or assessment that the corresponding existing software product of category type uses during testing and assessing investigation are investigated Carry out art text if using during voice is paid a return visit.Specifically, server can be used keyword extraction algorithm or other Text feature word extraction algorithm carries out keyword (or Feature Words) to each Test and analysis sample and extracts, wherein included with determination Assessment problem and corresponding original assessment dimension, to ensure going on smoothly for subsequent Test and analysis treatment process.
Assessment problem is specifically the particular problem referred in Test and analysis sample, can be the survey for a certain software product Existing various problems, are such as involved in the problems, such as user experience during commenting, and so as to the statistical result based on the assessment problem, carry out Software product carries out performance improvement, it is made more to meet user demand, improves user to the adherence of software product.Original assessment dimension Degree is the dimension being defined in Test and analysis sample to attribute belonging to each assessment problem.
Any Test and analysis sample includes at least one assessment problem, the corresponding original assessment dimension of each assessment problem. I.e. any corresponding original assessment dimension (i.e. 1 pair of 1 relationship) of assessment problem, and any original assessment dimension corresponds at least one survey Comment problem (i.e. 1 pair of M relationship).For example, " operation of this APP good or not " this assessment problem is to belong to " easy-to-use " this original survey Dimension is commented, rather than belongs to the original assessment dimension such as " useful " or " close friend ", there is uniqueness；And for " easy-to-use " this " operation of this APP good or not " this assessment problem for original assessment dimension, can be corresponded to, " this APP can also be corresponded to Operating process whether be readily appreciated that " this assessment problem.In general, in a Test and analysis sample, original assessment dimension It can be the title division of at least one assessment problem.
In the present embodiment, server be based on target product type queries test and assess questionnaire information library, judge whether to be stored with The corresponding original assessment questionnaire information of the target product type；If assessment is stored with and target product type in questionnaire information library (such as certain original assessment questionnaire letter is adaptively adjusted to original assessment questionnaire information in corresponding original assessment questionnaire information Certain functional modules in breath replace with the functional module in software under testing product), to improve the acquisition effect of target software product Rate；If assessment is not stored with original assessment questionnaire information corresponding with target product type in questionnaire information library, step is executed Rapid S203-S208, to obtain target software product, so that the product assessment questionnaire information that target software product insertion is acquired, So that the target assessment problem on the assessment interface of target software product has objectivity and comprehensive, and it can ensure that user tests and assesses Real-time, save measurement cost simultaneously improve assessment efficiency.
S203: original assessment dimension corresponding to all assessment problems carries out importance analysis, obtains at least two targets Assessment dimension.
Specifically, original assessment dimension corresponding to all assessment problems carries out importance analysis particular by assessment All original assessment dimensions for including in analysis sample carry out importance analysis, to make according to the importance determination analyzed For the process of the target assessment dimension of the Test and analysis model corresponding with the target product type finally determined.It is general next It says, the number for a certain original assessment dimension being mentioned in all Test and analysis samples is more (i.e. quantity is more), illustrates that it is got over It is important, the dimension accordingly, it can be determined that target is tested and assessed.Wherein, target assessment dimension is pair determined from all original assessment dimensions The original assessment dimension that the corresponding software product assessment of target product type is affected.
In the present embodiment, can to the corresponding all original assessment dimensions of assessment problems all in all Test and analysis samples into Row importance analysis, to be influenced in all original assessment dimensions of determination on the corresponding software product Test and analysis of target product type Biggish target assessment dimension.For example, can be useful with determination, easy by carrying out importance analysis to all original assessment dimensions With, friendly three dimension is evaluated and tested to the biggish target of the corresponding software product analyzing influence of target product type, can also be to this Three targets assessment dimensions have done specific definition, such as useful finger functional configuration whether meet demand, easy-to-use finger operating experience is No smooth, close friend refers to the Emotional Design of product.
S204: importance analysis is carried out to the corresponding all assessment problems of each target assessment dimension, obtains target assessment The corresponding assessment indicator of dimension.
Since each original assessment dimension corresponds at least one assessment problem, i.e. 1 pair of M relationship, and target assessment dimension is What the significance level according to original assessment dimension determined, also correspond at least one assessment problem.Specifically, server can be to every The corresponding all assessment problems of one target assessment dimension carry out importance analysis, to determine the assessment problem mainly for software product Which function test and assess, to determine corresponding assessment indicator based on these major functions.Wherein, target assessment dimension pair The assessment indicator answered is can be using corresponding with target product type for assessing the index of software product performance quality.
For example, if target product type is tool for managing money matters type, and " easy-to-use " this target assessment dimension is corresponding all In assessment problem, primarily directed to financing software product whether function of transferring accounts smooth, whether open function operation smooth, crucial The assessment problems such as whether functional entrance, which is easy, is searched, whether critical function module distribution is reasonable.Server to " easy-to-use " this The problem of target tests and assesses dimension corresponding all assessment problems when carrying out importance analysis, need to analyze a certain assessment problem quantity accounts for The specific gravity of the corresponding problematic amount of all assessment problems determines whether this assessment problem can be made according to this specific gravity size For the corresponding assessment indicator of target assessment dimension.In general, in the corresponding all assessment problems of a certain target assessment dimension In, the problem of a certain assessment problem quantity account for the corresponding problematic amount of all assessment problems specific gravity it is bigger, illustrate product development Mechanism more pays close attention to this influence of assessment problem to software product, it can be assumed that getting over for it to the importance of software product assessment Greatly, accordingly, it can be determined that the corresponding assessment indicator of target assessment dimension.
S205: using Structural Equation Modeling Analysis software at least two targets assessment dimension and each target assessment dimension Corresponding assessment indicator carries out model construction, obtains target Test and analysis model.
Wherein, structural equation model (Structural Equation Modeling, SEM) structural equation model is a kind of It establishes, the method for estimation and inspection causality model.It had both included observable show in variable in model, it is also possible to include nothing The latent variable that method is directly observed.Structural equation model can substitute multiple regression, path analysis, factorial analysis, covariance point The methods of analysis, clear single index of analyzing is to the correlation between overall effect and single index.
In the present embodiment, used Structural Equation Modeling Analysis software includes but is not limited to AMOS software, i.e. server Using AMOS software, lead to using at least two targets assessment dimension as latent variable using all assessment indicators as observational variable It crosses and factor analysis (i.e. factor analysis confirmatory, determining potential pass between the two is carried out to these observational variables and latent variable System) and stability analysis (i.e. analysis observational variable and latent variable between potential relationship stability) after, determine target survey Comment analysis model.It is to be appreciated that the target Test and analysis model is using Structural Equation Modeling Analysis software to as potential The target assessment dimension of variable and the assessment indicator as observational variable carry out the model determined after factor analysis and modeling.It can To understand ground, model construction is carried out to target assessment dimension and assessment indicator using Structural Equation Modeling Analysis software, so that institute The target Test and analysis model of building can objectively reflect potential relationship between the two, so that finally determining target assessment Dimension and assessment indicator have more objectivity.
Further, step S205 specifically comprises the following steps:
S2051: obtaining at least two original assessment data, and original assessment data include that each target assessment dimension is corresponding Dimension score value and the corresponding index score value of each assessment indicator.
Specifically, after determining at least two targets assessment dimension and corresponding assessment indicator, product development mechanism Each target assessment dimension can be determined according to the problematic amount that summarizes in the corresponding target synonym collection of each target assessment dimension Corresponding dimension score range is spent, such as the dimension score range of " easy-to-use ", " useful " and " close friend " these three targets assessment dimension It is disposed as 0-20 points.It can also be according to accounting ratio the problem of the corresponding On Index quantity of assessment indicator and dimensional problem quantity Example determines the corresponding index marking mode of each assessment indicator and index scoring weight.Server is by dimension score range, index Marking mode and index scoring weight are sent to the corresponding assessment terminal of professional assessment personnel, obtain professional assessment personnel and pass through survey At least two original assessment data for commenting terminal to upload, the original assessment data include the corresponding dimension of each target assessment dimension Spend score value (such as " easy-to-use ", " useful " and " close friend " corresponding dimension score value) and the corresponding index point of each assessment indicator Value.
For example, if target assessment dimension includes " easy-to-use ", " useful " and " close friend ", by " easy-to-use ", " useful " and " friend It is good " it is determined as latent variable；The corresponding assessment indicator of each target assessment dimension is determined as observational variable (i.e. scale topic item), As the corresponding observational variable of " easy-to-use " this target assessment dimension is " function score of transferring accounts ", " function score of opening an account ", " entrance is looked into Look for scoring " and " functional module distribution scoring "；The corresponding observational variable of " useful " this target assessment dimension is " IC module Scoring ", " scoring of Investment & Financing module ", " module scoring of remitting money of transferring accounts ", " account management module scoring " and " security centre's module Scoring "；" close friend " this target test and assess the corresponding observational variable of dimension be " fluency scoring ", " scoring of installation kit size ", " simultaneous Capacitive scoring ", the scoring of prompt accuracy " and " service experience scoring ".And the corresponding scoring of each assessment indicator can use phase With level results, as it is very good, relatively good, it is more bad and it is very good score, can also use 5,4,3, 2 and 1 scores.
S2052: using AMOS software to the corresponding dimension score value of target assessment dimension and the corresponding index of assessment indicator Score value carries out factor analysis confirmatory, obtains the analysis degree of fitting of constructed path simulation model, if analysis degree of fitting is big In default degree of fitting threshold value, then path simulation model is determined as target Test and analysis model.
Wherein, presetting degree of fitting threshold value is the pre-set threshold that can be used for assessment models degree of fitting and reach stability criterion Value.The AMOS software be one of Structural Equation Modeling Analysis software, it can be achieved that between latent variable and observational variable into Row factor analysis confirmatory, to determine the tool of the potential relationship between latent variable and observational variable.Specifically, server can Using AMOS software to the corresponding dimension score value of target assessment dimension and the corresponding finger of assessment indicator in original assessment data It marks score value and carries out factor analysis confirmatory, analysis is determined (to be seen based on target assessment dimension (i.e. latent variable) and assessment indicator Survey variable) building path simulation model analysis degree of fitting.The analysis degree of fitting is compared with default degree of fitting threshold value, If analyzing degree of fitting is greater than default degree of fitting threshold value, assert that the path relation in constructed path simulation model is significant, i.e., The relationship that target is tested and assessed dimension (i.e. latent variable) between assessment indicator (observational variable) is firm, therefore, can be by the path mould Analog model is determined as target Test and analysis model.In the present embodiment, the process of factor analysis confirmatory is carried out using AMOS software It is the common function of AMOS software, is the prior art, this is no longer going to repeat them.
Software product provided by the present embodiment is tested and assessed in processing method, by obtaining at least two original assessment data, The corresponding dimension score value of target assessment dimension and the corresponding index score value of assessment indicator are determined, using AMOS software to target The corresponding dimension score value of dimension of testing and assessing and the corresponding index score value of assessment indicator carry out factor analysis confirmatory, so that finally The target Test and analysis model of acquisition can reflect has more stable potential relationship between the two, so that finally determining target Dimension of testing and assessing and assessment indicator have objectivity.
S206: based on the assessment indicator in target Test and analysis model, the corresponding target assessment of each assessment indicator is obtained Problem carries out consistency desired result to each assessment indicator corresponding target assessment problem, obtains consistency desired result result.
Wherein, target assessment problem refers to according to the assessment indicator in target Test and analysis model, generation with it is to be measured soft The corresponding assessment problem of part product.Specifically, server is pre-configured with different types of assessment question template, the assessment problem Template includes assessment problem framework, the index filling region for filling assessment indicator and special for filling in software under testing product Determine the function filling region of functional module.For example, one judges the assessment problem framework of the assessment question template of type for " this is soft The XX function of part whether YY ", wherein XX is function filling region, and YY is index filling region, is stepped on for a software product When whether recording function is handy, function filling region fills " login ", and index filling region filling " handy ".In the present embodiment, Function filling region in the target assessment problem can leave a blank, so that user independently fills according to actual needs；Or it is configurable Specific option, so that user carries out selection determination according to actual needs.Specifically, in target Test and analysis model Each assessment indicator can control client to enter problematic arrangement corresponding with assessment indicator interface, to match in the problem It sets interface and determines the corresponding assessment question template of each assessment indicator and functional module, to automatically generate corresponding target assessment Problem, to ensure the determination efficiency of target assessment problem.
Wherein, consistency desired result is carried out to each assessment indicator corresponding target assessment problem, obtains consistency desired result knot Fruit, in particular to the assessment of the target by determining to each assessment indicator in target Test and analysis model problem carry out internal survey It comments, to determine target assessment problem, whether the consistency desired result of consistency criterion is as a result, final to aid in determining whether The target assessment specific aim of problem of formation and comprehensive.Consistency criterion herein can be understood as testing and assessing in inside Cheng Zhong determines if to meet pre-set one when different target tests and assesses personnel to target assessment problem progress Test and analysis Cause property judgment criteria (i.e. whether the consistency of the determining assessment score of Test and analysis reaches standard), to ensure target assessment problem The objectivity of setting and comprehensive.
S207: if consistency desired result result is that verification passes through, being based on the corresponding target assessment problem of all assessment indicators, Product assessment questionnaire information is obtained, product assessment questionnaire information and target product type association are stored in assessment questionnaire information Library.
Specifically, if consistency desired result result is that verification passes through, illustrate based on each in target Test and analysis model The target assessment problem that assessment indicator determines carries out reaching preset consistency criterion when internal assessment, assert these targets The Set scale of assessment problem is objective and comprehensive, and therefore, can be tested and assessed problem based on the corresponding target of all assessment indicators, generate with The corresponding product assessment questionnaire information of the software under testing product, to ensure the objective of finally formed product assessment questionnaire information Property and comprehensive.Further, it is also closed using product assessment questionnaire information as original assessment questionnaire information with target product type Connection is stored in assessment questionnaire information library, quickly determines that corresponding original assessment questionnaire is believed according to target product type so as to subsequent Breath, to improve the acquisition efficiency of the corresponding product assessment questionnaire information of software under testing product.
S208: be based on the pre-set information collecting interface of software under testing product, by product assessment questionnaire information insertion to The assessment interface of software product is surveyed, target software product is formed.
Wherein, the pre-set information collecting interface of software under testing product be it is pre-set for receive product assessment ask The interface of volume information.It is connect for example, linking in " helping and feedback " this functional module can be arranged on software under testing product Mouthful, user can click corresponding link interface in " the helping and feedback ", upload product assessment questionnaire information, be based on the product Questionnaire information of testing and assessing forms assessment interface corresponding with software under testing product and assessment button corresponding with the assessment interface, Target software product is formed, enters corresponding assessment interface so that user clicks the assessment button on target software product, thus Investigational data of testing and assessing corresponding with target assessment problem is uploaded in real time.
Software product provided by the present embodiment is tested and assessed in processing method, is not stored with and mesh in assessment questionnaire information library When marking the corresponding original assessment questionnaire information of product type, elder generation is from Test and analysis sample corresponding with target product type Assessment problem and corresponding original assessment dimension are extracted, to determine that existing software product corresponding with the target product type exists The assessment problem and original assessment dimension acquired when assessment process, so that data used by Test and analysis process are with objective Property.Then, original assessment dimension corresponding to all assessment problems carries out importance analysis, with according to original assessment dimension with Importance in the corresponding all Test and analysis samples of target product type guarantees target assessment dimension in the target product class The general applicability tested and assessed in the corresponding software product of type.Then, to the corresponding all assessment problems of each target assessment dimension Importance analysis is carried out, the corresponding assessment indicator of target assessment dimension is obtained, guarantees the assessment indicator in the target product type The general applicability tested and assessed in corresponding software product.Then, using Structural Equation Modeling Analysis software to target assessment dimension Model construction is carried out with assessment indicator, so that constructed target Test and analysis model can reflect between the two with more stable Potential relationship so that finally the target assessment dimension in determining target Test and analysis model and assessment indicator are with more objective Property with apply the general applicability in the corresponding software product assessment process of target product type.According to target Test and analysis mould Assessment indicator in type forms corresponding target assessment problem and carries out consistency desired result, and is school in consistency desired result result Test by when, obtain product test and assess questionnaire information so that product assessment questionnaire information in target assessment problem setting have Objectivity and comprehensive.By the assessment interface of product assessment questionnaire information insertion software under testing product, the target software of formation is produced Product, so that user during using target software product, can input the target assessment for the setting of different assessment indicators in real time The feedback of problem improves the real-time of user comment.
In one embodiment, as shown in figure 3, obtaining corresponding Test and analysis based on target product type in step S202 Sample specifically comprises the following steps:
S301: original analysis sample, the corresponding primary products class of each original analysis sample are obtained from sample database Type.
Wherein, sample database is the database for being previously stored with original analysis sample.Original analysis sample is preparatory The sample of Test and analysis can be used for from crawling and be stored in sample database in internet using reptile instrument, or adopt It is uploaded with local upload mode and is stored in the sample that can be used for Test and analysis in sample database.Each original analysis sample A corresponding primary products type, which is the corresponding product type of original analysis sample, is including but not limited to managed Wealth tool types, communication tool type and office tools type.
S302: duplicate removal processing is carried out to original analysis sample, weight analysis sample is removed in acquisition.
Specifically, server carries out duplicate removal to original analysis sample using text duplicate removal tool or text similarity measurement algorithm Processing, to remove duplicate original analysis sample, so that is got goes weight analysis sample to have uniqueness, to exclude to repeat The interference that subsequent Test and analysis is handled of original analysis sample.For example, if being stored with 100 duplicate originals in sample database Begin analysis sample, is carrying out Test and analysis processing based on this 100 duplicate original analysis samples and other original analysis samples When, the quantity of assessment problem and original assessment dimension in this 100 duplicate original analysis samples will increase, and influence subsequent original The importance analysis of the assessment dimension that begins and problem of testing and assessing is as a result, to influence the quality of its Test and analysis processing.
S303: to going weight analysis sample to carry out standardization detection, effectively assessment sample is obtained, sample of effectively testing and assessing includes extremely A few assessment problem and assessment dimension corresponding with each assessment problem.
Wherein, standardization detection is for detecting whether the content of text gone in weight analysis sample meets subsequent Test and analysis The process of demand.For example, the Test and analysis demand can be including assessment problem and corresponding this form of original assessment dimension It is required that other forms requirement.
In the present embodiment, server can be used regular expression matching algorithm to the content of text gone in weight analysis sample into The detection of professional etiquette generalized, to detect whether the content of text for removing weight analysis sample meets the substantive requirements of form in Test and analysis demand, If meeting, weight analysis sample is gone to be determined as sample of effectively testing and assessing this.It is to be appreciated that by the duplicate removal point after standardization detection Analysis sample is determined as sample of effectively testing and assessing, and can mention from Test and analysis sample during the subsequent Test and analysis of effective guarantee Take assessment problem and corresponding original assessment dimension, the enforceability of guarantee plan.
S304: if the sample size of primary products type effective assessment sample identical with target product type is greater than or waits In preset quantity, then using the corresponding all effective assessment samples of target product type as Test and analysis sample.
Wherein, preset quantity is pre-set quantity, is particularly used for assessing whether to reach any product type of analysis Sample size needed for corresponding Test and analysis model.Primary products type effective assessment sample identical with target product type Sample size, refer to from all effective assessment samples obtained in sample database, filter out its primary products type with The corresponding sample size of the identical effective assessment sample of target product type.
Specifically, server filters out its primary products from all effective assessment samples obtained in sample database Type effective assessment sample identical with target product type, after determining its corresponding sample size, by the sample size with Preset quantity is compared；If sample size is more than or equal to preset quantity, all have target product type is corresponding Effect assessment sample is as Test and analysis sample.The determination of the Test and analysis sample had both guaranteed the sample size of Test and analysis sample Preset quantity needed for reaching analysis Test and analysis model, to ensure the subsequent Test and analysis mould determined based on Test and analysis sample The objectivity of type and its corresponding assessment indicator avoids sample size too small and causes the assessment indicator finally determined with unilateral Property；Make all Test and analysis sample standard deviations corresponding with target product type again, so that in the Test and analysis model of subsequent acquisition Assessment indicator it is more targeted.
S305: it is preset if the sample size of primary products type effective assessment sample identical with target product type is less than Quantity then obtains volume residual based on preset quantity and sample size, by the corresponding all effective assessment samples of target product type This randomly selects having for volume residual as Test and analysis sample, and from the different effective assessment sample of target product type Effect assessment sample is as Test and analysis sample.
Specifically, server filters out its primary products from all effective assessment samples obtained in sample database Type effective assessment sample identical with target product type, after determining its corresponding sample size, by the sample size with Preset quantity is compared；If sample size is less than preset quantity, first determined based on preset quantity and the difference of sample size Volume residual.Then, will all effective assessment samples identical with target product type as Test and analysis sample, and from mesh The mark different effective assessment sample of product type randomly selects effective assessment sample of volume residual as Test and analysis sample. It is to be appreciated that will all effective assessment samples identical with target product type corresponding with sample size and and remainder It measures the corresponding and different effective assessment sample standard deviation of target product type and is determined as Test and analysis sample, so that final survey Scoring analysis sample quantity reach preset quantity, with ensure it is subsequent based on Test and analysis sample determine Test and analysis model and its The objectivity of corresponding assessment indicator avoids sample size too small and the assessment indicator finally determined is caused to have one-sidedness；And It can farthest ensure the specific aim of the assessment indicator in the Test and analysis model of subsequent acquisition.
Software product provided by the present embodiment test and assess processing method in, first to original analysis sample carry out duplicate removal processing and Standardization detection obtains effectively assessment sample, achievees the purpose that the enforceability of exclusive PCR and guarantee plan.According to target The sample size of the identical effective assessment sample of product type and the comparison result of preset quantity, choose and are greater than or equal to present count Effective assessment sample of amount is determined as Test and analysis sample, to ensure the subsequent Test and analysis mould determined based on Test and analysis sample The objectivity of type and its corresponding assessment indicator；It can also divide from the assessment determined based on Test and analysis sample is utmostly ensured Analyse the specific aim of model and its corresponding assessment indicator.
In one embodiment, as shown in figure 4, in step S203, original assessment dimension corresponding to all assessment problems into Row importance analysis obtains at least two targets assessment dimension, specifically comprises the following steps:
S401: original assessment dimension corresponding to all assessment problems carries out synonym analysis, and it is original to obtain at least one Synonym collection.
Wherein, original assessment dimension corresponding to all assessment problems carries out synonym analysis, to determine that at least two is former Whether the assessment dimension that begins is synonym, if synonym, then the corresponding original assessment dimension of these synonyms is stored in an original In beginning synonym collection.The original synonym collection is the collection for storing at least two original assessment dimensions of synonym each other It closes.In the present embodiment, synonym analysis refers to based on predetermined in the original assessment dimension inquiry thesaurus of any two Synonym incidence relation, with determine both whether be synonym process.
In the present embodiment, step S401 specifically comprises the following steps: that (1) (such as L original based on all original assessment dimensions Assessment dimension) creation array to be analyzed, an original synonym collection is first created based on the 1st original assessment dimension, i.e., by the 1st Original assessment dimension is stored in the original synonym collection.(2) 2-L original assessment dimensions in array to be analyzed are traversed It is carried out synonym analysis with original assessment dimension any in the original synonym collection that is pre-created by degree, that is, be based on this two A original assessment dimension inquires thesaurus, determines that the two are original according to thesaurus synonym incidence relation predetermined Dimension of testing and assessing whether each other synonym.(2) if synonym each other, by 2-L original assessments dimensions in the array to be analyzed Degree is stored in the original synonym collection.(4) original based on 2-L in array to be analyzed if not synonym each other The rest may be inferred for the new original synonym collection ... of dimension of testing and assessing creation, until traversing the original assessment of l-th in array to be analyzed Dimension.For example, nouns such as " easy-to-use ", " easy to operate " and " easy to operate " can be pre-defined with synonymous in thesaurus Word association relationship.
S402: in each original synonym collection of statistics, the corresponding Single-issue quantity of each original assessment dimension and institute There is original assessment dimension is corresponding to summarize problematic amount.
As above, any original assessment dimension corresponds at least one assessment problem (i.e. 1 pair of M relationship).Count each original same In adopted set of words, the corresponding Single-issue quantity of each original assessment dimension, in particular to each original assessment dimension pair of statistics The quantity for the assessment problem answered determines the specific value of M in 1 pair of M relationship.It counts in each original synonym collection, owns Original assessment dimension is corresponding to summarize problematic amount, in particular to counts all original assessment dimensions in the original synonym collection Corresponding Single-issue quantity and value, that is, determine Sum M value.For example, in an original synonym collection include A1, A2 and These three original assessment dimensions of A3, corresponding Single-issue quantity is respectively 20,30 and 20, then its corresponding summarizes problem number Amount is 70.
S403: the corresponding problematic amount that summarizes of all original synonym collections is ranked up, problematic amount will be summarized most Preceding X more original synonym collections are determined as target synonym collection.
Specifically, server is first corresponding to original assessment dimensions all in each original synonym collection summarizes problem number Amount is ranked up, and is chosen a fairly large number of preceding X original synonym collection and is determined as target synonym collection, can make final determination Target synonym collection can reflect when testing and assessing to existing software product corresponding with target product type, most pay close attention to Be which original assessment dimension, so as to based on these original assessment dimensions building assessments corresponding with the target product type Analysis model, to determine the assessment indicator that can most reflect that software product assessment is required based on the Test and analysis model.The target Synonym collection refers to that is determined from all original synonym collections summarizes preceding X most original synonyms of problematic amount Set, i.e., determine the corresponding target synonym collection of the target product type based on majority principle, to ensure target synonym Gather determining objectivity.
S404:, will be single according to the corresponding Single-issue quantity of each original assessment dimension in target synonym collection The most original assessment dimension of problematic amount is determined as target assessment dimension.
Specifically, server is according to the corresponding Single-issue number of each original assessment dimension in target synonym collection Amount, to the corresponding Single-issue quantity progress quantity comparison of all original assessment dimensions, by the most original of Single-issue quantity The assessment dimension that begins is determined as target assessment dimension.For example, including " easy-to-use ", " easy to operate " in a target synonym collection The original assessment dimension such as " easy to operate ", and the corresponding Single-issue quantity of " easy-to-use " this original assessment dimension is 60, The corresponding Single-issue quantity of " easy to operate " this original assessment dimension is 40, " easy to operate " this original assessment dimension Corresponding Single-issue quantity is 30, then the most original assessment dimension of Single-issue quantity is " easy-to-use ", therefore, can be incited somebody to action " easy-to-use " is determined as the corresponding target assessment dimension of this target synonym collection.
Software product provided by the present embodiment is tested and assessed in processing method, and it is true to carry out synonym analysis to original assessment dimension Fixed corresponding original synonym collection carries out classification processing to original assessment dimension to realize, helps to ensure that determining target The objectivity and accuracy for dimension of testing and assessing avoid single original assessment dimension that from cannot reaching the standard for being determined as target assessment dimension And multiple synonymous word combinations can achieve this be determined as target assessment dimension standard the case where generation；Or it avoids determining meaning The case where thinking identical two or more target assessment dimensions generation.The most original synonym of problematic amount will be summarized Set is determined as target synonym collection, to exclude to summarize the lesser original synonym collection of problematic amount to determining target assessment The interference that dimension determines improves the determination efficiency of target assessment dimension.By in each target synonym collection, Single-issue quantity Most original assessment dimensions is determined as target assessment dimension, to guarantee target assessment dimension in assessment and target product type pair General applicability in the assessment process for the software product answered defines this using this statement in that is, more Test and analysis samples One target assessment dimension.
In one embodiment, as shown in figure 5, corresponding to all original synonym collections in step S403 summarizes problem Quantity is ranked up, and will be summarized preceding X most original synonym collections of problematic amount and is determined as target synonym collection, specifically Include the following steps:
S501: the problematic amount that summarizes corresponding to all original synonym collections carries out descending sort, obtains descending sort As a result.
Wherein, descending sort result, which refers to, carries out descending based on the corresponding problematic amount that summarizes of all original synonym collections The ranking results determined after sequence.For example, Q1, Q2, Q3, Q4 and Q5 these original synonym collection is corresponding summarizes problem Quantity is respectively 400,60,200,300 and 40, then summarizes the descending sort result that problematic amount carries out after descending sort and be 400,300,200,60 and 40, corresponding original synonym collection is ordered as Q1, Q4, Q3, Q2 and Q5.
S502: corresponding preceding X of statistics descending sort result summarizes the accumulative and value of problematic amount, and calculates all summarize The remittance total value of problematic amount.
Specifically, server usesCorresponding preceding X of descending sort result of this calculation formula statistics is summarized The accumulative and value of problematic amount, i.e. P1 are a accumulative and value for summarizing problematic amount of the corresponding preceding X of descending sort result, xiFor drop Summarize problematic amount i-th in sequence ranking results.Correspondingly, server usesIt calculates and all summarizes problematic amount Remittance total value.Wherein, P2 is the corresponding remittance total value for summarizing problematic amount of all original synonym collections, and H is all originals The quantity of beginning synonym collection.
S503: target proportion value is determined based on accumulative and value and total value of converging, if target proportion value is greater than the first ratio threshold Value then summarizes the corresponding original synonym collection of problematic amount for preceding X and is determined as target synonym collection.
Wherein, the first proportion threshold value is pre-set to reach the standard ratio for being determined as target synonym collection for limiting The threshold value of example.Specifically, server first summarizes the accumulative and value P1 and all problematic amounts that summarize of problematic amount based on preceding X Remittance total value P2 is calculated using P=P1/P2 and is determined that first X are summarized the corresponding target proportion value P of problematic amount.Then, by target Ratio value P is compared with the first proportion threshold value；If target proportion value P is greater than the first proportion threshold value, summarize problem for preceding X The corresponding original synonym collection of quantity is determined as target synonym collection；If target proportion value P is not more than the first proportion threshold value, Assignment again is then carried out to X using X=X+1, repeats step S501 and step S502, until determine the value of X, with from descending X are determined as target synonym collection before choosing in the corresponding original synonym collection of ranking results.For example, if the first ratio threshold Value is 70%, and summarizing the descending sort result that problematic amount carries out after descending sort is 400,300,200,60 and 40, corresponding When being ordered as Q1, Q4, Q3, Q2 and Q5 of original synonym collection, if X=1, calculated P=400/1000=40%, not Greater than 75%；Make X=2, calculated P=700/1000=70%, is not greater than 75%；Make X=3, calculated P=800/ 1000=80% is greater than 75%, then the value of the X finally determined is 3, then is Q1, Q4, Q3, Q2 and Q5 from descending sort result 3 original synonym collections are determined as target synonym collection, i.e. Q1, Q4 and Q3 before middle selection.
Software product provided by the present embodiment is tested and assessed in processing method, determines target based on accumulative and value and total value of converging Ratio value, to determine the value of X according to the comparison result of target proportion value and the first proportion threshold value, thus from descending sort knot X original synonym collections are determined as target synonym collection before choosing in the corresponding original synonym collection of fruit, to guarantee mesh What mark synset was combined into larger proportion summarizes the corresponding original synonym collection of problematic amount, to be based on target synset It closes determining target assessment dimension and has more objectivity and accuracy, make it in the corresponding software product of target product type Assessment has general applicability.
In one embodiment, as shown in fig. 6, in step 204, all assessment problems corresponding to each target assessment dimension Importance analysis is carried out, the corresponding assessment indicator of target assessment dimension is obtained, specifically comprises the following steps:
S601: in the corresponding target synonym collection of each target assessment dimension, all original assessment dimensions are corresponding Assessment problem carries out keyword extraction, obtains the corresponding function keyword of each assessment problem.
Specifically, server uses keyword extraction algorithm, target synset corresponding to each target assessment dimension In conjunction, the corresponding each assessment problem of all original assessment dimensions carries out keyword extraction, and it is corresponding to obtain each assessment problem Target synonym collection is determined that the functional keyword of institute is determined as the corresponding function of target assessment dimension by function keyword It can keyword.In the present embodiment, carrying out keyword extraction process to each assessment problem using keyword extraction algorithm be can wrap It includes and word segmentation processing is carried out to assessment problem, to obtain several participles；Part-of-speech tagging is carried out to each participle again, it is corresponding with determination Function keyword.For example, to " whether function of transferring accounts smooth " carry out word segmentation processing after, obtain " transferring accounts ", " function ", " whether " " smooth " these participles, determine " transferring accounts " this its function keyword according to the part of speech of these participles.
S602: synonymous conflation of words processing is carried out to the corresponding function keyword of each assessment problem, obtains original index.
Specifically, server carries out synonymous conflation of words processing to the corresponding function keyword of each assessment problem, will be mutual Several function key conflations of words for synonym are an original index.Specifically, server can be closed based on any two function Keyword inquires thesaurus, determines whether the two is synonymous each other according to synonym incidence relation predetermined in thesaurus Word；If the two synonym each other, can the direct basis corresponding standard words of synonym incidence relation, determine original index.Example Such as, " transferring accounts " and " remittance " is pre-defined in thesaurus has synonym incidence relation, and corresponding standard words are " transferring accounts "； When then server recognizes the corresponding function keyword of target assessment dimension including " transferring accounts " and " remittance ", thesaurus is inquired It determines that the two has synonym incidence relation, then the standard words " transferring accounts " is directly determined as original index.It is to be appreciated that right Function keyword carries out synonymous conflation of words processing, to determine original index, can effectively reduce the quantity of original index, guarantees final The accuracy of determining assessment indicator.
S603: being determined as the corresponding On Index quantity of original index for the quantity of the assessment problem comprising original index, And count the corresponding dimensional problem quantity of all assessment problems.
Specifically, the quantity of the assessment problem comprising original index is determined as the corresponding index of original index and asks by server Quantity S1 is inscribed, the assessment comprising " original index " this noun should be specifically referred to comprising the quantity of the assessment problem of original index and asked The sum of the quantity of the quantity of topic and the assessment problem comprising " original index " corresponding synonym.For example, if original index is " to turn Account ", then server filters out the assessment problem comprising " transferring accounts " this noun from the corresponding assessment problem of target assessment dimension Quantity with comprising the sum of the quantity with " transferring accounts " assessment problem of the noun (as " remittance ") of synonym each other, be determined as original The corresponding On Index quantity S1 of index.
Specifically, the corresponding dimensional problem quantity S2 of all assessment problems of server statistics, refers to the server statistics mesh Mapping comments the corresponding quantity of the corresponding all assessment problems of dimension, and an even target is tested and assessed the quantity of the corresponding assessment problem of dimension It is 1000, then its dimensional problem quantity is 1000.
S604: if accounting ratio is greater than second the problem of the corresponding On Index quantity of original index and dimensional problem quantity Original index is then determined as the corresponding assessment indicator of target assessment dimension by proportion threshold value.
Wherein, the second proportion threshold value is pre-set for limiting the threshold for reaching the standard proportional for being determined as assessment indicator Value.Specifically, server calculates original index corresponding On Index quantity S1 and dimensional problem quantity S2 using S=S1/S2 Corresponding problem accounting ratio S.Then, problem accounting ratio S is compared with the second proportion threshold value；If the problem accounting Ratio S is greater than the second proportion threshold value, then the original index is determined as the corresponding assessment indicator of target assessment dimension.For example, should Second proportion threshold value is 10%, if problem accounting ratio S corresponding to an original index is 15%, which is that assessment refers to Mark.
Software product provided by the present embodiment is tested and assessed in processing method, by calculating the corresponding On Index of original index The problem of quantity and dimensional problem quantity accounting ratio, according to the comparison result of the problem accounting ratio and the second proportion threshold value, Determine which original index is assessment indicator, so that determined assessment indicator has universality, i.e., it is corresponding in target product type Software product in general applicability.
In one embodiment, as shown in fig. 7, in step S206, to the corresponding target of each assessment indicator test and assess problem into Row consistency desired result obtains consistency desired result as a result, specifically comprising the following steps:
701: being generated based on each target assessment problem and survey request in product, be sent at least two for request is surveyed in product The corresponding assessment terminal of target assessment personnel obtains the to be analyzed assessment determining based on target assessment problem that assessment terminal returns Data, assessment data to be analyzed include the corresponding assessment score of each target assessment problem.
Wherein, target assessment problem is based on the assessment in target Test and analysis model corresponding with target product type Index, the assessment problem corresponding with software under testing product determined.Assessment terminal is for making for target assessment personnel Terminal requests so that target assessment personnel can receive in product to survey by the assessment terminal and uploads assessment data to be analyzed.Mesh Mark reviewer is the professional practitioner that internal assessment is carried out to the software under testing product, generally user study person, product Manager and interaction design teacher, the consistency that can be tested and assessed inside effective guarantee.Assessment data to be analyzed are that target assessment personnel upload For target assessment problem tested and assessed when determine assessment data.The assessment data to be analyzed include target assessment problem pair The assessment score answered.
Specifically, server will survey request and be sent to the corresponding assessment terminal of at least two targets assessment personnel in product, It tests and assesses so that at least two targets assessment personnel are based on target assessment problem to software product to be measured, obtains each target and survey The assessment data to be analyzed determined based on target assessment problem for commenting personnel to return by the assessment terminal, each assessment to be analyzed Data are specially the assessment score determined when target assessment personnel test and assess to target assessment problem.
702: consistency desired result being carried out to the corresponding assessment score of target assessment problem, obtains Kendall coefficient of concordance.
Agreeing Dare (kandall) coefficient of concordance is a kind of correlative for calculating multiple grades variable degree of correlation, Ken Deer It is the relevant ranked data of multiple row that coefficient of concordance, which is suitable for data information, but i.e. k scoring person comments (N) a object, can also be with It is to comment N number of object the same person successive k times.In the present embodiment, user asks in the corresponding target assessment of each assessment indicator of configuration When inscribing and illustrating to the scoring of target assessment problem, user can be reminded to carry out grade scoring, so that the assessment finally obtained Score is a specific assessment grade；Alternatively, being pre-configured with the grade scoring table of comparisons, the grade scoring table of comparisons is every for illustrating The corresponding assessment grade of one assessment score, so as to determine the survey according to the acquired assessment Score Inquiry grade scoring table of comparisons Score the corresponding assessment grade of number, to facilitate the calculating of Kendall coefficient of concordance.
In the present embodiment, when same target assessment personnel are without identical assessment ranking, using formula (1)Calculate Kendall coefficient of concordance；When same target assessment personnel have identical assessment ranking, use Formula (2)Calculate Kendall coefficient of concordance, wherein The problem of N is target assessment problem number, K are personnel's number of target assessment personnel, RiFor all mesh Mapping comments the sum of corresponding assessment grade of problem, and S is the sum of the corresponding assessment grade of all targets assessment problem RiWith all surveys Comment the sum of grade RiAverage sum of squares of deviations, miEvaluating result for i-th of target assessment personnel does not have repetition assessment etc. The number of grade, nijThe same levels number of assessment grade is repeated for j-th in the evaluating result of i-th of target assessment personnel.
703: if Kendall coefficient of concordance is greater than predetermined coefficient threshold value, the consistency desired result result obtained is that verification is logical It crosses.
Wherein, predetermined coefficient threshold value is pre-set for assessing consistency threshold value whether up to standard, such as the default system Number threshold value may be configured as 0.9, that is, when illustrating that all target assessment personnel test and assess to software product to be measured, each assessment indicator pair When the consistency (i.e. Kendall coefficient of concordance) for the assessment score answered need to reach 0.9, it can just assert that the software under testing product is corresponding Consistency desired result result be verification pass through, illustrate these targets assessment personnel to software product to be measured determine target assessment ask The degree of recognition of topic relatively, to avoid target assessment problem setting one-sidedness.
Specifically, the Kendall coefficient of concordance determined according to the corresponding assessment score of assessment indicator, can reflect multiple mesh The consistency that mapping comments personnel to test and assess the target assessment problem of the assessment indicator setting in target Test and analysis model；If Consistency is higher, then illustrates that multiple target assessment personnel relatively connect the degree of recognition for the target assessment problem that assessment indicator is arranged Closely, it can be assumed that its user experience demand for meeting multiple target assessment personnel, assert that consistency desired result result is that verification passes through, To generate product assessment questionnaire information based on target assessment problem.Conversely, then illustrating that multiple targets are surveyed if consistency is lower It comments personnel to have relatively large deviation to the degree of recognition for the target assessment problem that assessment indicator is arranged, illustrates the software under testing product consistent Property the setting of lower assessment indicator target assessment problem on need to improve so that the setting of target assessment problem is more objective Rationally.
Software product provided by the present embodiment test and assess processing method in, software under testing product target test and assess problem into When row consistency desired result, by the assessment data to be analyzed of acquisition at least two targets assessment personnel's feedback, with to be analyzed to this The assessment score of the corresponding target assessment problem of assessment indicator carries out consistency desired result in data of testing and assessing, to obtain Ken Deer harmony Coefficient, and when Kendall coefficient of concordance is greater than predetermined coefficient threshold value, assert that consistency desired result result is that verification passes through, to guarantee Target is tested and assessed the objectivity and comprehensive of problem setting, and software under testing product optimization efficiency is helped to improve.
In one embodiment, as shown in figure 8, after step S208, i.e., product assessment questionnaire information insertion is to be measured The assessment interface of software product is formed after target software product, software product assessment processing method further include:
S801: the assessment investigational data of the assessment interface input based on target software product, investigational data packet of testing and assessing are obtained Include the corresponding assessment functional module of target assessment problem and assessment comment tendency.
Wherein, assessment investigational data is inputted on its interface of testing and assessing using the user of target software product for reflecting The data of idea in its use process.In the present embodiment, user is when using target software product, it is believed that target software product When realization is problematic or improved idea of certain functional modules, the assessment button that can click target software product enters survey Interface is commented, so that assessment at least one target of interface display assessment problem and constraint term corresponding with target assessment problem (i.e. for target assessment several pre-set options of problem) or input frame corresponding with target assessment problem (for the input frame for user from primary input information), user pass through the constraint term or the corresponding assessment investigation of input frame input Data.
Assessment functional module refers to the targeted functional module of a certain target assessment problem.Assessment comment tendency is for anti- The corresponding user of the assessment investigational data is reflected, the user experience of the assessment functional module targeted to target assessment problem inclines To.For example, to this whether handy target of the login function of this APP assessment problem, constraint term includes " handy " and " bad With " two kinds, then its corresponding assessment functional module is login function module, if user clicks " handy ", assessment comment is inclined It is commented on to be positive；If user clicks " not handy ", assessment comment tendency is negative comments.
S802: the corresponding general comment quantity of any assessment functional module of real-time statistics and assessment comment are inclined to as negative comments Negative comments quantity, determine the corresponding negative comments ratio of assessment functional module.
Specifically, the quantity of the corresponding all assessment investigational datas of any assessment functional module of server real-time statistics, really It is set to the corresponding general comment data of the assessment functional module；By in the corresponding all assessment investigational datas of the assessment functional module, Assessment comment is inclined to the quantity of the assessment investigational data for negative comments, is determined as the corresponding passiveness of assessment functional module and comments By quantity；Then, by the quotient of negative comments quantity and general comment quantity, it is determined as the corresponding negative comments of assessment functional module Ratio.
S803: if negative comments ratio is greater than preset ratio threshold value, triggering comment early warning mechanism, generates and assessment function Module modifies prompting message accordingly.
Wherein, preset ratio threshold value is pre-set for the ratio value for whether needing to carry out early warning to be limited.Comment is pre- Alert plane mechanism is pre-set for limiting the mechanism of corresponding response time and responding process.Response time is for offseting Pole comment ratio is greater than the time that the assessment functional module of preset ratio threshold value is responded.Responding process is for commenting passiveness The process responded by the assessment functional module that ratio is greater than preset ratio threshold value and corresponding treatment people, make at its response Reason is more rationally and more efficient, it is ensured that response efficiency improves the optimization efficiency of software product.Modifying prompting message is for reminding phase The information that the treatment people answered is modified.
Software product provided by the present embodiment is tested and assessed in processing method, calculates any assessment functional module by statistics Negative comments ratio is greater than preset ratio threshold value in the negative comments ratio, and triggering comment early warning mechanism comments passiveness with realizing It modifies by more assessment functional module, improves the optimization efficiency of software product.
It should be understood that the size of the serial number of each step is not meant that the order of the execution order in above-described embodiment, each process Execution sequence should be determined by its function and internal logic, the implementation process without coping with the embodiment of the present invention constitutes any limit It is fixed.
In one embodiment, a kind of software product assessment processing unit is provided, the software product test and assess processing unit with it is upper Software product assessment processing method in embodiment is stated to correspond.As shown in figure 9, detailed description are as follows for each functional module:
Test and analysis request module 901, for obtaining Test and analysis request, Test and analysis request includes software under testing Product and target product type corresponding with software under testing product.
Test and analysis sample acquisition module 902 is used for Test and analysis sample acquisition module, for being based on target product type Inquiry assessment questionnaire information library is asked if not being stored with original assessment corresponding with target product type in assessment questionnaire information library Volume information then obtains corresponding Test and analysis sample based on target product type, it is corresponding extremely to extract each Test and analysis sample A few assessment problem and original assessment dimension corresponding with each assessment problem.
Target assessment dimension obtains module 903, carries out for original assessment dimension corresponding to all assessment problems important Property analysis, obtain at least two targets test and assess dimension.
Assessment indicator obtains module 904, important for carrying out to the corresponding all assessment problems of each target assessment dimension Property analysis, obtain the corresponding assessment indicator of target assessment dimension.
Test and analysis model obtains module 905, for being surveyed using Structural Equation Modeling Analysis software at least two targets It comments dimension and the corresponding assessment indicator of each target assessment dimension to carry out model construction, obtains target Test and analysis model.
Consistency desired result result obtains module 906, for obtaining every based on the assessment indicator in target Test and analysis model The corresponding target assessment problem of one assessment indicator carries out consistency desired result to each assessment indicator corresponding target assessment problem, Obtain consistency desired result result.
Questionnaire information of testing and assessing obtains module 907, if being that verification passes through for consistency desired result result, is based on all assessments The corresponding target assessment problem of index, obtains product assessment questionnaire information, by product assessment questionnaire information and target product type Associated storage is in assessment questionnaire information library.
Target software product obtains module 908, for based on the information collecting interface on software under testing product, product to be surveyed The assessment interface for commenting questionnaire information insertion software under testing product, forms target software product
Preferably, Test and analysis sample acquisition module 902, comprising: original analysis sample acquisition unit removes weight analysis sample Acquiring unit, sample acquisition unit of effectively testing and assessing, the first assessment sample acquisition unit and the second assessment sample acquisition unit.
Original analysis sample acquisition unit, for obtaining original analysis sample, each original analysis from sample database Sample corresponds to a primary products type.
Weight analysis sample acquisition unit is gone, for carrying out duplicate removal processing to original analysis sample, weight analysis sample is removed in acquisition.
Effectively assessment sample acquisition unit, for obtaining effectively assessment sample to going weight analysis sample to carry out standardization detection This, sample of effectively testing and assessing includes at least one assessment problem and assessment dimension corresponding with each assessment problem.
First assessment sample acquisition unit, if being used for primary products type effective assessment sample identical with target product type This sample size is greater than or equal to preset quantity, then using the corresponding all effective assessment samples of target product type as assessment Analyze sample.
Second assessment sample acquisition unit, if being used for primary products type effective assessment sample identical with target product type This sample size is less than preset quantity, then volume residual is obtained based on preset quantity and sample size, by target product type Corresponding all effective assessment samples as Test and analysis sample, and from the different effective assessment sample of target product type Effective assessment sample of volume residual is randomly selected as Test and analysis sample.
Preferably, target assessment dimension obtains module 903, comprising: original synonym collection acquiring unit, Set problem number Measure acquiring unit, target synonym collection acquiring unit and target assessment dimension determination unit.
Original synonym collection acquiring unit carries out synonym for original assessment dimension corresponding to all assessment problems Analysis, obtains at least one original synonym collection.
Set problem number obtainment unit, for counting in each original synonym collection, each original assessment dimension pair The Single-issue quantity answered and all original assessment dimensions are corresponding summarizes problematic amount.
Target synonym collection acquiring unit, for being carried out to the corresponding problematic amount that summarizes of all original synonym collections Sequence will summarize preceding X most original synonym collections of problematic amount and be determined as target synonym collection.
Target assessment dimension determination unit, for corresponding according to each original assessment dimension in target synonym collection The most original assessment dimension of Single-issue quantity is determined as target assessment dimension by Single-issue quantity.
Preferably, target synonym collection acquiring unit, comprising: descending sort result obtains at subelement and Data-Statistics Manage subelement and ratio value calculation processing subelement.
Descending sort result obtains subelement, for carrying out to the corresponding problematic amount that summarizes of all original synonym collections Descending sort obtains descending sort result.
Subelement is handled with Data-Statistics, summarizes the accumulative of problematic amount for counting corresponding preceding X of descending sort result And value, and calculate all remittance total values for summarizing problematic amount.
Ratio value calculation processing subelement, for determining target proportion value based on accumulative and value and total value of converging, if target Ratio value is greater than the first proportion threshold value, then preceding X being summarized the corresponding original synonym collection of problematic amount, to be determined as target same Adopted set of words.
Preferably, assessment indicator obtain module 904, comprising: function keyword acquiring unit, original index acquiring unit, Problematic amount acquiring unit of testing and assessing and assessment indicator determination unit.
Function keyword acquiring unit, for owning in the corresponding target synonym collection of each target assessment dimension The corresponding assessment problem of original assessment dimension carries out keyword extraction, obtains the corresponding function keyword of each assessment problem.
Original index acquiring unit, for being carried out at synonymous conflation of words to the corresponding function keyword of each assessment problem Reason obtains original index.
It tests and assesses problematic amount acquiring unit, for will include that the quantity of assessment problem of original index is determined as original index Corresponding On Index quantity, and count the corresponding dimensional problem quantity of all assessment problems.
Assessment indicator determination unit, if the problem of being used for the corresponding On Index quantity of original index and dimensional problem quantity Accounting ratio is greater than the second proportion threshold value, then original index is determined as the corresponding assessment indicator of target assessment dimension.
Preferably, consistency desired result result obtains module 906, comprising: assessment data capture unit to be analyzed, Ken Deer and Humorous coefficient acquiring unit and evaluating result acquiring unit.
Assessment data capture unit to be analyzed is surveyed request for being generated based on each target assessment problem, will produced in product Survey request in product and be sent to the corresponding assessment terminal of at least two targets assessment personnel, obtain that assessment terminal returns based on target The assessment data to be analyzed that assessment problem determines, assessment data to be analyzed include the corresponding assessment point of each target assessment problem Number.
Kendall coefficient of concordance acquiring unit, for carrying out consistency to the corresponding assessment score of each target assessment problem Verification obtains Kendall coefficient of concordance.
Evaluating result acquiring unit, if being greater than predetermined coefficient threshold value, the consistency obtained for Kendall coefficient of concordance Check results are that verification passes through.
Preferably, after target software product obtains module 908, product assessment processing unit further include: assessment investigation Data acquisition module, negative comments ratio acquisition unit and comment early warning processing unit.
Investigational data of testing and assessing obtains module, for obtaining the assessment investigation of the assessment interface input based on target software product Data, assessment investigational data include the corresponding assessment functional module of target assessment problem and assessment comment tendency.
Negative comments ratio acquisition unit is used for the corresponding general comment quantity of any assessment functional module of real-time statistics and survey Comment tendency is the negative comments quantity of negative comments, determines the corresponding negative comments ratio of assessment functional module.
Early warning processing unit is commented on, if being greater than preset ratio threshold value for negative comments ratio, triggers comment early warning plane System generates and tests and assesses that functional module is corresponding modifies prompting message.
Specific restriction about software product assessment processing unit may refer to handle above for software product assessment The restriction of method, details are not described herein.Modules in above-mentioned software product assessment processing unit can be fully or partially through Software, hardware and combinations thereof are realized.Above-mentioned each module can be embedded in the form of hardware or independently of the place in computer equipment It manages in device, can also be stored in a software form in the memory in computer equipment, in order to which processor calls execution or more The corresponding operation of modules.
In one embodiment, a kind of computer equipment is provided, which can be server, internal junction Composition can be as shown in Figure 10.The computer equipment include by system bus connect processor, memory, network interface and Database.Wherein, the processor of the computer equipment is for providing calculating and control ability.The memory packet of the computer equipment Include non-volatile memory medium, built-in storage.The non-volatile memory medium is stored with operating system, computer program and data Library.The built-in storage provides environment for the operation of operating system and computer program in non-volatile memory medium.The calculating The database of machine equipment is used to store the data for executing and using or generate during software product assessment processing method, such as target Test and analysis model.The network interface of the computer equipment is used to communicate with external terminal by network connection.The computer To realize a kind of software product assessment processing method when program is executed by processor.
In one embodiment, a kind of computer equipment is provided, including memory, processor and storage are on a memory And the computer program that can be run on a processor, processor realize software product in above-described embodiment when executing computer program The step of processing method of testing and assessing, such as step S201-S204 or Fig. 3 shown in Fig. 2 is to step shown in fig. 8, to avoid It repeats, which is not described herein again.Alternatively, processor realizes software product assessment this implementation of processing unit when executing computer program The function of each module/unit in example, such as the function of each module/unit shown in Fig. 9, it is no longer superfluous here to avoid repeating It states.
In one embodiment, a computer readable storage medium is provided, meter is stored on the computer readable storage medium Calculation machine program, the computer program realize the step of software product assessment processing method in above-described embodiment when being executed by processor Suddenly, such as step S201-S204 or Fig. 3 shown in Fig. 2 is to step shown in fig. 8, no longer superfluous here to avoid repeating It states.Alternatively, the computer program is realized when being executed by processor in above-mentioned software product assessment this embodiment of processing unit The function of each module/unit, such as the function of each module/unit shown in Fig. 9, to avoid repeating, which is not described herein again.
Those of ordinary skill in the art will appreciate that realizing all or part of the process in above-described embodiment method, being can be with Relevant hardware is instructed to complete by computer program, the computer program can be stored in a non-volatile computer In read/write memory medium, the computer program is when being executed, it may include such as the process of the embodiment of above-mentioned each method.Wherein, To any reference of memory, storage, database or other media used in each embodiment provided herein, Including non-volatile and/or volatile memory.Nonvolatile memory may include read-only memory (ROM), programming ROM (PROM), electrically programmable ROM (EPROM), electrically erasable ROM (EEPROM) or flash memory.Volatile memory may include Random access memory (RAM) or external cache.By way of illustration and not limitation, RAM is available in many forms, Such as static state RAM (SRAM), dynamic ram (DRAM), synchronous dram (SDRAM), double data rate sdram (DDRSDRAM), enhancing Type SDRAM (ESDRAM), synchronization link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic ram (DRDRAM) and memory bus dynamic ram (RDRAM) etc..
It is apparent to those skilled in the art that for convenience of description and succinctly, only with above-mentioned each function Can unit, module division progress for example, in practical application, can according to need and by above-mentioned function distribution by different Functional unit, module are completed, i.e., the internal structure of described device is divided into different functional unit or module, more than completing The all or part of function of description.
Embodiment described above is merely illustrative of the technical solution of the present invention, rather than its limitations；Although referring to aforementioned reality Applying example, invention is explained in detail, those skilled in the art should understand that: it still can be to aforementioned each Technical solution documented by embodiment is modified or equivalent replacement of some of the technical features；And these are modified Or replacement, the spirit and scope for technical solution of various embodiments of the present invention that it does not separate the essence of the corresponding technical solution should all It is included within protection scope of the present invention.

Claims (10)

  1. The processing method 1. a kind of software product is tested and assessed characterized by comprising
    Obtain Test and analysis request, Test and analysis request includes software under testing product and opposite with the software under testing product The target product type answered；
    It is tested and assessed questionnaire information library based on the target product type queries, if not being stored in the assessment questionnaire information library and institute The corresponding original assessment questionnaire information of target product type is stated, then corresponding assessment point is obtained based on the target product type Sample is analysed, at least one corresponding assessment problem of each Test and analysis sample and opposite with each assessment problem is extracted The original assessment dimension answered；
    Original assessment dimension corresponding to all assessment problems carries out importance analysis, obtains at least two targets assessment dimension Degree；
    Importance analysis are carried out to the corresponding all assessment problems of each target assessment dimension, the target is obtained and surveys Comment the corresponding assessment indicator of dimension；
    Using Structural Equation Modeling Analysis software at least two target assessment dimensions and each target assessment dimension The corresponding assessment indicator carries out model construction, obtains target Test and analysis model；
    Based on the assessment indicator in the target Test and analysis model, obtains the corresponding target assessment of each assessment indicator and ask Topic carries out consistency desired result to each assessment indicator corresponding target assessment problem, obtains consistency desired result result；
    If consistency desired result result is that verification passes through, based on the corresponding target assessment problem of all assessment indicators, product is obtained Product assessment questionnaire information and the target product type association are stored in assessment questionnaire information by assessment questionnaire information Library；
    It is based on the information collecting interface on the software under testing product, product assessment questionnaire information insertion is described to be measured soft The assessment interface of part product forms target software product.
  2. The processing method 2. software product as described in claim 1 is tested and assessed, which is characterized in that described to be based on the target product class Type obtains corresponding Test and analysis sample, comprising:
    Original analysis sample, each corresponding primary products type of the original analysis sample are obtained from sample database；
    Duplicate removal processing is carried out to the original analysis sample, weight analysis sample is removed in acquisition；
    It goes weight analysis sample to carry out standardization detection to described, obtains effectively assessment sample, effective assessment sample includes extremely A few assessment problem and assessment dimension corresponding with each assessment problem；
    If the sample size of the primary products type effective assessment sample identical with the target product type is greater than or waits In preset quantity, then using the corresponding all effective assessment samples of the target product type as Test and analysis sample；
    If the sample size of the primary products type effective assessment sample identical with the target product type is less than default Quantity then obtains volume residual based on the preset quantity and the sample size, by the corresponding institute of the target product type Have effective assessment sample as the Test and analysis sample, and from the different effective assessment of the target product type Sample randomly selects effective assessment sample of the volume residual as the Test and analysis sample.
  3. The processing method 3. software product as described in claim 1 is tested and assessed, which is characterized in that described pair of all assessment problem Corresponding original assessment dimension carries out importance analysis, obtains at least two targets assessment dimension, comprising:
    Original assessment dimension corresponding to all assessment problems carries out synonym analysis, obtains at least one original synonym Set；
    It counts in each original synonym collection, the corresponding Single-issue quantity of each original assessment dimension and all The original assessment dimension is corresponding to summarize problematic amount；
    The corresponding problematic amount that summarizes of all original synonym collections is ranked up, to summarize problematic amount most by described The preceding X original synonym collections be determined as target synonym collection；
    According to the corresponding Single-issue quantity of each original assessment dimension in the target synonym collection, by the list The most original assessment dimension of one problematic amount is determined as target assessment dimension.
  4. The processing method 4. software product as claimed in claim 3 is tested and assessed, which is characterized in that described pair all described original synonymous The corresponding problematic amount that summarizes of set of words is ranked up, and summarizes the preceding X most original synonyms of problematic amount for described Set is determined as target synonym collection, comprising:
    The problematic amount that summarizes corresponding to all original synonym collections carries out descending sort, obtains descending sort result；
    The corresponding preceding X accumulative and value for summarizing problematic amount of the descending sort result is counted, and is calculated all described Summarize the remittance total value of problematic amount；
    Target proportion value is determined based on the accumulative and value and the remittance total value, if the target proportion value is greater than the first ratio Threshold value then will summarize the corresponding original synonym collection of problematic amount described in preceding X and be determined as target synonym collection.
  5. The processing method 5. software product as claimed in claim 3 is tested and assessed, which is characterized in that described to test and assess to each target The corresponding all assessment problems of dimension carry out importance analysis, obtain the corresponding assessment indicator of the target assessment dimension, Include:
    To in the corresponding target synonym collection of each target assessment dimension, the corresponding survey of all original assessment dimensions It comments problem to carry out keyword extraction, obtains the corresponding function keyword of each assessment problem；
    Synonymous conflation of words processing is carried out to the corresponding function keyword of each assessment problem, obtains original index；
    The quantity of assessment problem comprising the original index is determined as the corresponding On Index quantity of the original index, and Count the corresponding dimensional problem quantity of all assessment problems；
    If the problem of corresponding On Index quantity of original index and dimensional problem quantity accounting ratio is greater than second The original index is then determined as the corresponding assessment indicator of the target assessment dimension by proportion threshold value.
  6. The processing method 6. software product as described in claim 1 is tested and assessed, which is characterized in that described to each assessment indicator Corresponding target assessment problem carries out consistency desired result, obtains consistency desired result result, comprising:
    It is generated based on each target assessment problem and surveys request in product, be sent at least two for request is surveyed in the product Target is tested and assessed the corresponding assessment terminal of personnel, obtain that the assessment terminal returns based on target assessment problem determine to Analysis assessment data, the assessment data to be analyzed include the corresponding assessment score of each target assessment problem；
    Consistency desired result, acquisition Kendall coefficient of concordance are carried out to the corresponding assessment score of each target assessment problem；
    If the Kendall coefficient of concordance is greater than predetermined coefficient threshold value, the consistency desired result result obtained is that verification passes through.
  7. The processing method 7. software product as described in claim 1 is tested and assessed, which is characterized in that ask product assessment described Volume information is embedded in the assessment interface of the software under testing product, is formed after target software product, at the software product assessment Reason method further include:
    The assessment investigational data of the assessment interface input based on the target software product is obtained, the assessment investigational data includes The corresponding assessment functional module of target assessment problem and assessment comment tendency；
    Any corresponding general comment quantity of functional module and assessment comment tendency the disappearing for negative comments of testing and assessing of real-time statistics Pole number of reviews determines the corresponding negative comments ratio of the assessment functional module；
    If the negative comments ratio is greater than preset ratio threshold value, comment early warning mechanism is triggered, is generated and the assessment function Module modifies prompting message accordingly.
  8. The processing unit 8. a kind of software product is tested and assessed characterized by comprising
    Test and analysis request module, for obtaining Test and analysis request, the Test and analysis request includes that software under testing produces Product and target product type corresponding with the software under testing product；
    Test and analysis sample acquisition module, for being based on target product type queries assessment questionnaire information library, if the survey It comments and is not stored with original assessment questionnaire information corresponding with the target product type in questionnaire information library, be then based on the mesh It marks product type and obtains corresponding Test and analysis sample, extract at least one the corresponding assessment of each Test and analysis sample and ask Topic and original assessment dimension corresponding with each assessment problem；
    Target dimension of testing and assessing obtains module, divides for carrying out importance to the corresponding original assessment dimension of all assessment problems Analysis obtains at least two targets assessment dimension；
    Assessment indicator obtains module, and the corresponding all assessment problems of dimension that are used to test and assess to each target carry out important Property analysis, obtain the corresponding assessment indicator of target assessment dimension；
    Test and analysis model obtains module, for being tieed up using Structural Equation Modeling Analysis software at least two target assessments Degree and the corresponding assessment indicator of each target assessment dimension carry out model construction, acquisition target Test and analysis model；
    Consistency desired result result obtains module, for obtaining each based on the assessment indicator in the target Test and analysis model The corresponding target of the assessment indicator is tested and assessed problem, carries out consistency to the corresponding target assessment problem of each assessment indicator Verification obtains consistency desired result result；
    Questionnaire information of testing and assessing obtains module, if being that verification passes through for consistency desired result result, is based on all assessment indicators pair The target assessment problem answered, obtains product assessment questionnaire information, by product assessment questionnaire information and the target product class Type associated storage is in assessment questionnaire information library；
    Target software product obtains module, for based on the information collecting interface on the software under testing product, by the product Assessment questionnaire information is embedded in the assessment interface of the software under testing product, forms target software product.
  9. 9. a kind of computer equipment, including memory, processor and storage are in the memory and can be in the processor The computer program of upper operation, which is characterized in that the processor realized when executing the computer program as claim 1 to The step of any one of 7 software product assessment processing method.
  10. 10. a kind of computer readable storage medium, the computer-readable recording medium storage has computer program, and feature exists In realization software product assessment processing side as described in any one of claim 1 to 7 when the computer program is executed by processor The step of method.
CN201910430095.3A 2019-05-22 2019-05-22 Software product evaluation processing method and device, computer equipment and storage medium Active CN110287103B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910430095.3A CN110287103B (en) 2019-05-22 2019-05-22 Software product evaluation processing method and device, computer equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910430095.3A CN110287103B (en) 2019-05-22 2019-05-22 Software product evaluation processing method and device, computer equipment and storage medium

Publications (2)

Publication Number Publication Date
CN110287103A true CN110287103A (en) 2019-09-27
CN110287103B CN110287103B (en) 2022-05-17

Family

ID=68002628

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910430095.3A Active CN110287103B (en) 2019-05-22 2019-05-22 Software product evaluation processing method and device, computer equipment and storage medium

Country Status (1)

Country Link
CN (1) CN110287103B (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111554143A (en) * 2020-03-31 2020-08-18 北京学格科技有限公司 Evaluation method and device based on CO-MIRT algorithm model
CN111694802A (en) * 2020-06-12 2020-09-22 百度在线网络技术（北京）有限公司 Duplicate removal information acquisition method and device and electronic equipment
CN113240469A (en) * 2021-05-17 2021-08-10 上海中通吉网络技术有限公司 Method, device and equipment for monitoring user experience through online feedback and storage medium
CN113742243A (en) * 2021-09-17 2021-12-03 京东科技信息技术有限公司 Application evaluation method and device, electronic equipment and computer readable medium
CN114444987A (en) * 2022-04-11 2022-05-06 深圳小库科技有限公司 Automatic analysis method and device for house type graph
WO2023134087A1 (en) * 2022-01-11 2023-07-20 平安科技（深圳）有限公司 Method and apparatus for generating inquiry template, electronic device, and storage medium
CN117670269A (en) * 2023-12-05 2024-03-08 北京智鼎优源管理咨询有限公司 Method and device for realizing questions for multidimensional forced selection test and electronic equipment

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060184416A1 (en) * 2005-02-17 2006-08-17 Abhijit Nag Method and apparatus for evaluation of business performances of business enterprise
JP2015064666A (en) * 2013-09-24 2015-04-09 株式会社富士通マーケティング Questionnaire analysis system and program thereof
CN106384256A (en) * 2016-11-11 2017-02-08 国家电网公司 Power supplying service satisfaction dynamic testing system based on index system dynamic change
CN109241506A (en) * 2018-06-11 2019-01-18 深圳市海云天教育测评有限公司 A kind of questionnaire generation method, device and computer readable storage medium

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060184416A1 (en) * 2005-02-17 2006-08-17 Abhijit Nag Method and apparatus for evaluation of business performances of business enterprise
JP2015064666A (en) * 2013-09-24 2015-04-09 株式会社富士通マーケティング Questionnaire analysis system and program thereof
CN106384256A (en) * 2016-11-11 2017-02-08 国家电网公司 Power supplying service satisfaction dynamic testing system based on index system dynamic change
CN109241506A (en) * 2018-06-11 2019-01-18 深圳市海云天教育测评有限公司 A kind of questionnaire generation method, device and computer readable storage medium

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
唐一杰等: "国有大型医院共享领导力测评问卷编制以及权重系数的确定", 《中国医院》 *
张和平: "基于结构方程的几何直观能力测评模型构建", 《贵州师范大学学报(自然科学版)》 *
张良等: "基于结构方程模型的医患互动关系二元评价模型构建", 《中国医院管理》 *

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111554143A (en) * 2020-03-31 2020-08-18 北京学格科技有限公司 Evaluation method and device based on CO-MIRT algorithm model
CN111694802A (en) * 2020-06-12 2020-09-22 百度在线网络技术（北京）有限公司 Duplicate removal information acquisition method and device and electronic equipment
CN111694802B (en) * 2020-06-12 2023-04-28 百度在线网络技术（北京）有限公司 Method and device for obtaining duplicate removal information and electronic equipment
CN113240469A (en) * 2021-05-17 2021-08-10 上海中通吉网络技术有限公司 Method, device and equipment for monitoring user experience through online feedback and storage medium
CN113742243A (en) * 2021-09-17 2021-12-03 京东科技信息技术有限公司 Application evaluation method and device, electronic equipment and computer readable medium
CN113742243B (en) * 2021-09-17 2024-03-01 京东科技信息技术有限公司 Application evaluation method, device, electronic equipment and computer readable medium
WO2023134087A1 (en) * 2022-01-11 2023-07-20 平安科技（深圳）有限公司 Method and apparatus for generating inquiry template, electronic device, and storage medium
CN114444987A (en) * 2022-04-11 2022-05-06 深圳小库科技有限公司 Automatic analysis method and device for house type graph
CN117670269A (en) * 2023-12-05 2024-03-08 北京智鼎优源管理咨询有限公司 Method and device for realizing questions for multidimensional forced selection test and electronic equipment

Also Published As

Publication number Publication date
CN110287103B (en) 2022-05-17

Similar Documents

Publication Publication Date Title
CN110287103A (en) Software product assessment processing method, device, computer equipment and storage medium
TWI598755B (en) Data analysis system, data analysis method, computer program product storing data analysis program, and storage medium storing data analysis program
WO2020253358A1 (en) Service data risk control analysis processing method, apparatus and computer device
WO2020249125A1 (en) Method and system for automatically training machine learning model
US20160371792A1 (en) Method and Apparatus for Mining Social Relationship Based on Financial Data
CN109299865B (en) Psychological evaluation system and method based on semantic analysis and information data processing terminal
CN107025509A (en) Decision system and method based on business model
CN110119877A (en) A kind of choosing method and equipment of target employee
CN112700325A (en) Method for predicting online credit return customers based on Stacking ensemble learning
CN110349000A (en) Method, apparatus and electronic equipment are determined based on the volume strategy that mentions of tenant group
CN112419029B (en) Similar financial institution risk monitoring method, risk simulation system and storage medium
CN109509087A (en) Intelligentized loan checking method, device, equipment and medium
Brennan et al. Exploring data value assessment: a survey method and investigation of the perceived relative importance of data value dimensions
Gross et al. Systemic test and evaluation of a hard+ soft information fusion framework: Challenges and current approaches
Hasyim The determinant of takaful acceptance: Theory of reasoned action approach
Pozsgai-Alvarez et al. Mapping the (anti-) corruption field: key topics and changing trends, 1968–2020
WO2024164698A1 (en) Method and apparatus for preference and avoidance of test experts in scientific and technological achievement test
CN106202299A (en) A kind of people with disability authority user based on people with disability's feature recommends method
CN112084376A (en) Map knowledge based recommendation method and system and electronic device
CN116881472A (en) Funds penetration and character relation analysis method based on graph database technology
Chauhan et al. Implementing lda topic modelling technique to study user reviews in tourism
CN109300031A (en) Data digging method and device based on stock comment data
Makridis et al. Towards a Unified Multidimensional Explainability Metric: Evaluating Trustworthiness in AI Models
Wambaka et al. Product differentiation strategy and perceived financial performance of commercial banks in Uganda
Augenstein et al. Towards Value Proposition Mining" Exploration of Design Principles.

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant