CN110008101A - Client performance evaluation method, device, storage medium and electronic equipment - Google Patents
Client performance evaluation method, device, storage medium and electronic equipment Download PDFInfo
- Publication number
- CN110008101A CN110008101A CN201910273139.6A CN201910273139A CN110008101A CN 110008101 A CN110008101 A CN 110008101A CN 201910273139 A CN201910273139 A CN 201910273139A CN 110008101 A CN110008101 A CN 110008101A
- Authority
- CN
- China
- Prior art keywords
- performance
- client
- data
- standard
- daily record
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000011156 evaluation Methods 0.000 title claims abstract description 73
- 238000003860 storage Methods 0.000 title claims abstract description 22
- 238000007667 floating Methods 0.000 claims description 8
- 238000004590 computer program Methods 0.000 claims description 5
- 238000013507 mapping Methods 0.000 claims description 5
- 238000000034 method Methods 0.000 abstract description 17
- 238000005516 engineering process Methods 0.000 abstract description 4
- 238000012360 testing method Methods 0.000 description 8
- 238000010586 diagram Methods 0.000 description 7
- 238000004891 communication Methods 0.000 description 6
- 238000004458 analytical method Methods 0.000 description 5
- 238000007405 data analysis Methods 0.000 description 5
- 230000006870 function Effects 0.000 description 5
- 238000012545 processing Methods 0.000 description 5
- 230000008859 change Effects 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 235000013399 edible fruits Nutrition 0.000 description 3
- 238000009434 installation Methods 0.000 description 3
- 238000004519 manufacturing process Methods 0.000 description 3
- 230000002159 abnormal effect Effects 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 230000005611 electricity Effects 0.000 description 2
- 230000008676 import Effects 0.000 description 2
- 230000005291 magnetic effect Effects 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 1
- 230000006978 adaptation Effects 0.000 description 1
- 230000003044 adaptive effect Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 210000004027 cell Anatomy 0.000 description 1
- 238000007796 conventional method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 238000011056 performance test Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000000644 propagated effect Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 230000003014 reinforcing effect Effects 0.000 description 1
- 238000012216 screening Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 210000000352 storage cell Anatomy 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
- 238000012800 visualization Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
- G06F11/3452—Performance evaluation by statistical analysis
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Probability & Statistics with Applications (AREA)
- Evolutionary Biology (AREA)
- Bioinformatics & Computational Biology (AREA)
- Computer Hardware Design (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Quality & Reliability (AREA)
- General Physics & Mathematics (AREA)
- Life Sciences & Earth Sciences (AREA)
- Debugging And Monitoring (AREA)
Abstract
This disclosure relates to field of computer technology, and in particular to a kind of client performance evaluation method, client performance evaluating apparatus, computer readable storage medium and electronic equipment.The client performance evaluation method that the embodiment of the present disclosure provides includes: the daily record data that client to be evaluated is obtained using preset time as the period；Data to be observed are chosen from the daily record data, and determine the performance indicator for corresponding to the data to be observed；The standard configuration information for being directed to the performance indicator is obtained, to determine the performance quality standard for evaluating the client performance；The Evaluation results of the client to be evaluated are generated using the performance quality standard and the daily record data.This method has many advantages, such as that general applicability is strong, accurate without repeated encoding, strong real-time, evaluation result.
Description
Technical field
This disclosure relates to field of computer technology, and in particular to a kind of client performance evaluation method, client performance are commented
Valence device, computer readable storage medium and electronic equipment.
Background technique
In the related fieldss such as development of games and test, client performance problem is always that one of puzzlement developer is intractable
Problem.In terms of the performance test of client and monitoring, the foundation of performance indicator and quality standard is very important.For example,
It needs to be determined which performance indicator goes to measure the performance condition and exception of client.Other than performance indicator, it is also necessary to determine
The standard of client performance index is measured, i.e. index of correlation parameter is reasonable in which kind of value range.Performance indicator and matter
Amount establishment of standard is the infrastructural support of properties of product test and monitoring exception, and solving these problems can faster positioning product
Current client performance state, finds out abnormal point.Index is quickly defined, formulates index, and meet according to Index Establishment
The client quality standard of product requirement is very valuable.
Traditional scheme is configured for independent project, i.e., index and quality standard be by fixed form is arranged,
It is set by the way of code hard coded.Once game item is updated or needs to design new game item,
It then needs to configure related performance indicators and quality standard new template according to new game content, then be compiled again again
There is universality difference in code.And in use, existing client performance index and quality standard are all to apply
It tests under environment, client performance can not be then monitored under regular user environment, in the reality of client performance evaluation
There are also problems in terms of when property.
It should be noted that information is only used for reinforcing the reason to the background of the disclosure disclosed in above-mentioned background technology part
Solution, therefore may include the information not constituted to the prior art known to persons of ordinary skill in the art.
Summary of the invention
The disclosure is designed to provide a kind of client performance evaluation method, client performance evaluating apparatus, computer
Readable storage medium storing program for executing and electronic equipment, and then client caused by the limitation due to the relevant technologies is overcome at least to a certain extent
Hold performance evaluation universality and the poor problem of real-time.
According to one aspect of the disclosure, a kind of client performance evaluation method is provided, is characterized in that, comprising:
The daily record data of client to be evaluated is obtained using preset time as the period；Data to be observed are chosen from the daily record data, and
Determine the performance indicator for corresponding to the data to be observed；The standard configuration information for being directed to the performance indicator is obtained, with determination
For evaluating the performance quality standard of the client performance；Institute is generated using the performance quality standard and the daily record data
State the Evaluation results of client to be evaluated.
In a kind of illustrative embodiments of the disclosure, the performance indicator includes standard index and user-defined counter；
The determination corresponds to the performance indicator of the data to be observed, comprising: the universal performance number in the identification data to be observed
According to non-universal performance data；Standard index corresponding with the universal performance data is determined according to preset mapping relations；
Index allocation information corresponding with the non-universal performance data is obtained, and customized according to index allocation information generation
Index.
In a kind of illustrative embodiments of the disclosure, the index allocation information includes index value type, described
Index value type is numeric type or character type.
In a kind of illustrative embodiments of the disclosure, the index allocation information includes that index checks permission.
It is described to utilize the performance quality standard and the daily record data in a kind of illustrative embodiments of the disclosure
Generate the Evaluation results of the client to be evaluated, comprising: compare the daily record data and a history cycle of current period
Daily record data, to obtain data float information；Using the performance quality standard and the data float information generate it is described to
Evaluate the Evaluation results of client.
In a kind of illustrative embodiments of the disclosure, the standard configuration information includes quality standard type, described
Quality standard type is sliding scales, floating threshold or fixed threshold.
In a kind of illustrative embodiments of the disclosure, the standard configuration information includes that standard checks permission.
According to one aspect of the disclosure, a kind of client performance evaluating apparatus is provided, is characterized in that, comprising:
Data acquisition module is configured as obtaining the daily record data of client to be evaluated using preset time as the period；Index determining module,
It is configured as choosing data to be observed from the daily record data, and determines the performance indicator for corresponding to the data to be observed；
Standard determining module is configured as obtaining the standard configuration information for being directed to the performance indicator, to determine for evaluating the visitor
The performance quality standard of family end performance；Performance evaluation module is configured as utilizing the performance quality standard and the log number
According to the Evaluation results for generating the client to be evaluated.
According to one aspect of the disclosure, a kind of computer readable storage medium is provided, computer program is stored thereon with,
It is characterized in that, the client performance evaluation side of any description above is realized when the computer program is executed by processor
Method.
According to one aspect of the disclosure, a kind of electronic equipment is provided, is characterized in that, including processor and storage
Device；Wherein, memory is used to store the executable instruction of the processor, the processor is configured to via can described in execution
It executes instruction to execute the client performance evaluation method of any description above.
Client performance evaluation method provided by the embodiment of the present disclosure can be by periodically obtaining client to be evaluated
Daily record data, and performance indicator is extracted from daily record data, and then client to be evaluated is generated according to corresponding performance quality standard
The evaluation result at end.This method can get rid of the limitation of fixed project and fixed form, and basis instrument can fit once being formed
It can be changed from bottom to up performance when the daily record data of client is changed with a variety of different client items and referred to
Mark and performance quality standard have general applicability strong, are not necessarily to so as to be reflected into the evaluation result ultimately generated automatically
The advantages that repeated encoding and setting target.In addition, this method can be applied not only to test environment, and can be in production environment
The lower actual operating data for obtaining client, has many advantages, such as that strong real-time, evaluation result are accurate.
It should be understood that above general description and following detailed description be only it is exemplary and explanatory, not
The disclosure can be limited.
Detailed description of the invention
The drawings herein are incorporated into the specification and forms part of this specification, and shows the implementation for meeting the disclosure
Example, and together with specification for explaining the principles of this disclosure.It should be evident that the accompanying drawings in the following description is only the disclosure
Some embodiments for those of ordinary skill in the art without creative efforts, can also basis
These attached drawings obtain other attached drawings.
Fig. 1 schematically shows the step flow chart of client performance evaluation method in disclosure illustrative embodiments.
Fig. 2 schematically shows the part steps process of client performance evaluation method in disclosure illustrative embodiments
Figure.
Fig. 3 schematically shows the part steps process of client performance evaluation method in disclosure illustrative embodiments
Figure.
Fig. 4 shows daily record data acquisition modes schematic diagram of the disclosure illustrative embodiments in an application scenarios.
Fig. 5 shows performance indicator editing interface schematic diagram of the disclosure illustrative embodiments in an application scenarios.
Fig. 6 shows quality standard editing interface schematic diagram of the disclosure illustrative embodiments in an application scenarios.
Fig. 7 shows quality standard of the disclosure illustrative embodiments in an application scenarios and establishes model framework signal
Figure.
Fig. 8 schematically shows the composition block diagram of client performance evaluating apparatus in disclosure illustrative embodiments.
Fig. 9 schematically shows a kind of schematic diagram of program product in disclosure illustrative embodiments.
Figure 10 schematically shows the module diagram of a kind of electronic equipment in disclosure illustrative embodiments.
Specific embodiment
Example embodiment is described more fully with reference to the drawings.However, example embodiment can be real in a variety of forms
It applies, and is not understood as limited to example set forth herein；On the contrary, these embodiments are provided so that the disclosure will more comprehensively and
Completely, and by the design of example embodiment comprehensively it is communicated to those skilled in the art.Described feature, structure or characteristic
It can be incorporated in any suitable manner in one or more embodiments.
In addition, attached drawing is only the schematic illustrations of the disclosure, it is not necessarily drawn to scale.Identical attached drawing mark in figure
Note indicates same or similar part, thus will omit repetition thereof.Some block diagrams shown in the drawings are function
Energy entity, not necessarily must be corresponding with physically or logically independent entity.These function can be realized using software form
Energy entity, or these functional entitys are realized in one or more hardware modules or integrated circuit, or at heterogeneous networks and/or place
These functional entitys are realized in reason device device and/or microcontroller device.
A kind of client performance evaluation method is provided in the illustrative embodiments of the disclosure first, client is also known as used
Family end may be generally mounted in the computer equipments such as mobile phone, the computer of user, for providing local service for user, such as
It may include the various social category softwares, games, video jukebox software, news client of installation and operation on the terminal device
End etc..Other than some application programs in local runtime, client generally can by way of network communication with
Server is used cooperatively.
As shown in Figure 1, the client performance evaluation method that this illustrative embodiment provides mainly may include following step
It is rapid:
Step S110. obtains the daily record data of client to be evaluated using preset time as the period.
Client can generate corresponding daily record data in the process of running, this step can be regular by the period of preset time
Obtain the daily record data of client to be evaluated.Wherein, the mode for obtaining daily record data, which can be to embed in the client, collects day
The script of will data, the script can upload the daily record data being collected into periodically so that analysis is used；It in addition can also be by such as
ELK log analysis platform (log system being made of tri- kinds of open source softwares of Elasticsearch, Logstash and Kibana) is right
Client log data carry out taken at regular intervals with it is synchronous.Preset time in this step can be configured according to specific needs,
Such as corresponding collection period can be arranged according to client type, shorter adopt can be set for game on line class client
Collect the period, to obtain real time data；And longer collection period then can be set for video playback class client, to reduce
System operating load.The daily record data got in this step can be the test log of client to be evaluated under the test environment
Data evaluate client performance for the test phase before product is online；In addition it is also possible to client to be evaluated
Running log data in a production environment, for being monitored in real time under actual user's use environment to client performance
And evaluation；This illustrative embodiment does not do particular determination to this.
Step S120. chooses data to be observed from daily record data, and determines the performance indicator for corresponding to data to be observed.
Based on the daily record data got in step S110, this step can carry out data filtering and screening to it, removal
Extraneous data therein and interference data, selection obtain data to be observed, and can correspondingly be anti-according to data determination to be observed
Reflect the performance indicator of client operating status.Wherein, data to be observed can be business diary number relevant to client performance
According to or abnormal log data.By taking game client as an example, the performance indicator corresponding to data to be observed may include biography per second
Defeated frame number (Frames Per Second, FPS) shows relevant number of vertex to game picture, in addition it can include with it is interior
It deposits, CPU, flow, electricity, start the relevant various performance indicators such as speed, network speed.
Step S130. obtains the standard configuration information for being directed to performance indicator, to determine the property for evaluating client performance
It can quality standard.
For a variety of different performance indicators, this step can preset corresponding criterion, such as can
With the analytical standard of reference line game client performance evaluation commonly used in the trade to form global quality analysis template, pass through load
The template can get the standard configuration information for various performance indicators, may thereby determine that for evaluating client performance
Performance quality standard.Especially when user carries out performance evaluation to client to be evaluated for the first time, without carrying out complex configurations,
Analyzing template by load global quality can easily realize that data are analyzed.In addition, user can also be according to their needs to phase
It closes performance indicator and carries out customizedization configuration, such as can be received input by user by providing criterion configuration interface
Standard configuration information, so that it is determined that the performance quality standard for evaluating client performance.Wherein, standard configuration information can wrap
Quality standard type is included, such as quality standard type can be sliding scales, floating threshold or fixed threshold.In addition, standard
Configuration information can also include that standard checks that permission, such as standard check that permission can be general purpose grade, project level or privately owned grade.
Step S140. utility quality standard and daily record data generate the Evaluation results of client to be evaluated.
The performance quality standard determined using step S130 carries out data analysis to the daily record data that step S110 is got
Produce the Evaluation results of client to be evaluated.For example, being to fix by the quality standard type determined in step S130
Threshold value judges performance then the parameter of a performance indicator involved in daily record data can be compared with the fixed threshold
Index rises or falls situation, so that combined data analysis situation provides three kinds of different performances such as good, warning and danger
Evaluation result, and specific data analysis foundation and analysis result can be provided.In addition, if having determined in step s 130
Standard checks permission, then can use and check that permission is defined to current performance quality standard, such as when standard is looked into
When seeing that permission is general purpose grade, Evaluation results indistinguishably can be checked and be used by all users；When standard is checked
Permission be project level when, Evaluation results only can by the developer of active client project, tester or other
Related personnel checks and uses；When standard checks that permission is privately owned grade, Evaluation results then may only be by performance matter
The practical personnel of establishing of amount standard check and use.By the management to access right, can be effectively protected some quick
Feel data, avoids the leakage of trade secret.
In the client performance evaluation method that this illustrative embodiment provides, by periodically obtaining client to be evaluated
Daily record data, and performance indicator is extracted from daily record data, and then visitor to be evaluated is generated according to corresponding performance quality standard
The evaluation result at family end can get rid of the limitation of fixed project and fixed form, and basis instrument can be applicable in respectively once being formed
Kind different client items, when the daily record data of client changes, can change from bottom to up performance indicator and
Performance quality standard has general applicability strong so as to be reflected into the evaluation result ultimately generated automatically, without repeating
The advantages that coding and setting target.In addition, the client performance evaluation method that this illustrative embodiment provides can not only answer
For testing environment, and the actual operating data of client can be obtained in a production environment, there is strong real-time, evaluation knot
The advantages that fruit is accurate.
On the basis of foregoing exemplary embodiment, the performance indicator in step S120 may include standard index and oneself
Define index.Correspondingly, as shown in Fig. 2, step S120. determine correspond to data to be observed performance indicator, may include with
Lower step:
Step S210. identifies universal performance data and non-universal performance data in data to be observed.
Data to be observed, this step can be determined after the daily record data got to step S110 is filtered and screens
Data to be observed can then be identified with determination universal performance data therein and non-universal performance data.Wherein, general
Performance data can be the data that respective standard index is prestored in system database, rather than universal performance data can be and be
The new acquisition data of match information are not formed in system database.
Step S220. determines standard index corresponding with universal performance data according to preset mapping relations.
For universal performance data, it can be preset in system database and store corresponding standard and refer to
Mark.When identification obtains the universal performance data in data to be observed, can directly be determined using preset mapping relations corresponding
Standard index.
Step S230. obtains index allocation information corresponding with non-universal performance data, and according to index allocation information
Generate user-defined counter.
For non-universal performance data, relevant matches information is not prestored in system database, this step can be with needle
Index allocation information corresponding with non-universal performance data is obtained to property, and customized finger is generated according to index allocation information
Mark.Wherein, index allocation information may include index value type, such as index value type can be numeric type (number)
Or character type (string).In addition, index allocation information can also include that index checks permission, such as index can be checked
Priority assignation is that all members are visible or administrator is visible.When index checks that permission is that all members are visible, ordinary user
It can check；And when index checks that permission is that administrator is visible, then the user-defined counter that generates and corresponding non-universal
Performance data can only then be checked by administrator, and ordinary user then haves no right to check.Such as some sensitivities index (such as
The online number of game) it can be set to administrator as it can be seen that so as to realize the protection to trade secret.
In the client performance evaluation method that this illustrative embodiment provides, system can be automatically from daily record data
Performance indicator is extracted, for universal performance data, mapping can be established with automatic identification and with the standard index of system, and for non-
Universal performance data can be carried out manual setting and typing by user then to form user-defined counter.This method is in use process
In it is not necessary that performance indicator is arranged repeatedly, can greatly simplify the cost of data configuration.
As shown in figure 3, in the another exemplary embodiment of the disclosure, step S140. utility quality standard and
Daily record data generates the Evaluation results of client to be evaluated, may further include following steps:
Step S310. compares the daily record data of current period and the daily record data of a history cycle, to obtain data float
Information.
Since the client performance evaluation method that this illustrative embodiment provides is the daily record data to periodically acquire
As evaluation basis, therefore this step can be compared current period with the daily record data of a history cycle, to obtain
Data float information.The numerical value ascensional range or numerical value fall of related data available for numeric type data.It lifts
For example, when the collection period of daily record data is day, then can be by the daily record data of the daily record data on the same day and the previous day
It is compared to obtain the data float information of adjacent periods, it in addition can also be by the daily record data on the same day and last month on the same day
Daily record data is compared to obtain the data float information of the same period.
Step S320. utility quality standard and data floating information generate the performance evaluation knot of client to be evaluated
Fruit.
Using the data float information that compares in the performance quality standard and step S310 determined in step S130,
The Evaluation results of client to be evaluated can be generated in this step.Quality standard type corresponding to data float information can be with
For sliding scales perhaps floating threshold by by data float information and determine sliding scales or floating threshold compare
Compared with, it can be determined that performance indicator rises or falls situation, so that combined data analysis situation provides different performance evaluation knots
Fruit, and specific data analysis foundation and analysis result can be provided.
In the client performance evaluation method that this illustrative embodiment provides, by the log number in different cycles
The client evaluation result compared based on data can be formed according to being compared, and can further generate intuitive visualization
Chart forms visual understanding to the situation of change of client performance so that exploitation or tester are checked and compared.
It should be noted that, although foregoing exemplary embodiment describes each of method in the disclosure with particular order
Step, still, this does not require that perhaps hint must execute these steps in this particular order or have to carry out whole
The step of be just able to achieve desired result.Additionally or alternatively, it is convenient to omit multiple steps are merged into one by certain steps
A step executes, and/or a step is decomposed into execution of multiple steps etc..
Below with reference to a concrete application scene to the client performance evaluation method provided in foregoing exemplary embodiment
It is described in detail.
As shown in figure 4, system can provide flexible data-interface so that client user is by any type of log number
Reported according to by the format of key-value pair, and reported data script can be embedded in client, to universal performance data into
Row automatic identification and on respond with to form standard index, and user needs to pay close attention to non-universal performance data only to be configured shape to it
At user-defined counter.This part can be by being got through the automatic collection to realize index with the data of ELK system.This
Under data acquisition modes, project is business initializtion versatility index without configuration, system automatically, such as system can daily 0:
The New Set not imported in 00 automatic identification daily record data, and be automatically imported；And personalized index can be by user one
Key imports, and the regular automatic synchronization of simultaneity factor imports, without complicated deployment cost.
For collected daily record data, performance indicator editing interface as shown in Figure 5 can be provided, user can pass through
The interface inputs corresponding index allocation information.For example, can choose " pointer type " is " standard " index or " customized "
Index, input " index name " is "@version ", select " Value Types " (i.e. index value type) for " number " or
" string " selects " permission limitation " (i.e. index checks permission) for " all members are visible " or " only administrator is visible "." meter
Calculate radix " refer to the specific unit of account of target, if data radix is excessive, display can be zoomed in and out to it automatically, such as can
K, M, G, T etc. can be shown as 100K as measurement unit, 100000, to realize that the optimization of logarithm shows that reduction is read
Read difficulty." description " can partially add corresponding descriptive text, to illustrate index purposes, facilitate understanding.
For each performance indicator, quality standard editing interface as shown in FIG. 6 can be provided, user can pass through the interface
Input corresponding standard configuration information.For example, can need to carry out the index of quality standard editor by the selection of " index " column,
Can choose quality standard type by " quality standard " column is " floating % " (i.e. sliding scales), floating threshold or fixation
Threshold value.Accordingly inputting different ratio or threshold value can determine and evaluation results phases such as " good ", " warning " or " danger "
Corresponding referential data.
As shown in fig. 7, the client performance evaluation method used under this application scene realizes quality from bottom to top
Standard establishes model, when the ELK data of bottom change, can successively adjust upward and be reflected in performance quality standard
In, and then be embodied in the client performance evaluation result ultimately generated.This mode has the characteristics that management configuration is easy, and
And do not influenced by project self attributes difference, there is extremely strong general applicability.
In the illustrative embodiments of the disclosure, a kind of client performance evaluating apparatus is also provided.As shown in figure 8, objective
Family end device for evaluating performance 800 mainly may include: data acquisition module 810, index determining module 820, standard determining module
830 and performance evaluation module 840.Wherein, data acquisition module 810 is configured as obtaining visitor to be evaluated by the period of preset time
The daily record data at family end；Index determining module 820 is configured as choosing data to be observed from daily record data, and determination corresponds to
The performance indicator of data to be observed；Standard determining module 830 is configured as obtaining the standard configuration information for being directed to performance indicator, with
Determine the performance quality standard for evaluating the client performance；Performance evaluation module 840 is configured as utility quality
Standard and the daily record data generate the Evaluation results of client to be evaluated.
The detail of above-mentioned client performance evaluating apparatus carries out in corresponding client performance evaluation method
Detailed description, therefore details are not described herein again.
It should be noted that although being referred to several modules or list for acting the equipment executed in the above detailed description
Member, but this division is not enforceable.In fact, according to embodiment of the present disclosure, it is above-described two or more
Module or the feature and function of unit can embody in a module or unit.Conversely, an above-described mould
The feature and function of block or unit can be to be embodied by multiple modules or unit with further division.
In the illustrative embodiments of the disclosure, a kind of computer readable storage medium is also provided, is stored thereon with meter
Calculation machine program can realize the above-mentioned client performance evaluation method of the disclosure when computer program is executed by processor.
In some possible embodiments, various aspects of the disclosure is also implemented as a kind of form of program product comprising
Program code；The program product, which can store, (it is hard to can be CD-ROM, USB flash disk or movement in a non-volatile memory medium
Disk etc.) in or network on；When described program product (can be personal computer, server, terminal installation in a calculating equipment
Or network equipment etc.) on when running, said program code is for making above-mentioned each example in the calculatings equipment execution disclosure
Method and step in property embodiment.
It is shown in Figure 9, it, can according to the program product 900 for realizing the above method of embodiment of the present disclosure
With using portable compact disc read-only memory (CD-ROM) and including program code, and can be to calculate equipment (such as a
People's computer, server, terminal installation or network equipment etc.) on run.However, the program product of the disclosure is without being limited thereto.
In the present example embodiment, computer readable storage medium can be any tangible medium for including or store program, the journey
Sequence can be commanded execution system, device or device use or in connection.
Described program product can use any combination of one or more readable medium.Readable medium can be readable
Signal media or readable storage medium storing program for executing.
Readable storage medium storing program for executing for example can be but be not limited to the system of electricity, magnetic, optical, electromagnetic, infrared ray or semiconductor, device
Or device or any above combination.The more specific example (non exhaustive list) of readable storage medium storing program for executing includes: with one
The electrical connection of a or multiple conducting wires, portable disc, hard disk, random access memory (RAM), read-only memory (ROM), erasable type
Programmable read only memory (EPROM or flash memory), optical fiber, portable compact disc read-only memory (CD-ROM), optical memory
Part, magnetic memory device or above-mentioned any appropriate combination.
Readable signal medium may include in a base band or as the data-signal that carrier wave a part is propagated, wherein carrying
Readable program code.The data-signal of this propagation can take various forms, including but not limited to electromagnetic signal, optical signal
Or above-mentioned any appropriate combination.Readable signal medium can also be any readable medium other than readable storage medium storing program for executing, should
Readable medium can send, propagate or transmit for by instruction execution system, device or device use or it is in connection
The program used.
The program code for including on readable medium can transmit with any suitable medium, including but not limited to wirelessly, have
Line, optical cable, RF etc. or above-mentioned any appropriate combination.
Can with any combination of one or more programming languages come write for execute the disclosure operation program
Code, described program design language include object oriented program language, Java, C++ etc., further include conventional mistake
Formula programming language, such as C language or similar programming language.Program code can be calculated fully in user and be set
Standby upper execution is partly executed on the user computing device, is set as an independent software package execution, partially in user's calculating
Standby upper part executes on a remote computing or executes in remote computing device or server completely.It is being related to remotely
In the situation for calculating equipment, remote computing device can pass through the network of any kind (including local area network (LAN) or wide area network
(WAN) etc.) it is connected to user calculating equipment；Or, it may be connected to external computing device, such as provided using Internet service
Quotient is connected by internet.
In the illustrative embodiments of the disclosure, also offer a kind of electronic equipment, the electronic equipment include at least one
A processor and at least one be used for store the processor executable instruction memory；Wherein, the processor quilt
It is configured to execute the method and step in the disclosure in above-mentioned each exemplary embodiment via the executable instruction is executed.
The electronic equipment 1000 in this illustrative embodiment is described below with reference to Figure 10.Electronic equipment 1000 is only
An only example, should not function to the embodiment of the present disclosure and use scope bring any restrictions.
Shown in Figure 10, electronic equipment 1000 is showed in the form of universal computing device.The component of electronic equipment 1000
It can include but is not limited to: at least one processing unit 1010, at least one storage unit 1020, the different system components of connection
The bus 1030 of (including processing unit 1010 and storage unit 1020), display unit 1040.
Wherein, storage unit 1020 is stored with program code, and said program code can be executed with unit 1010 processed, be made
Obtain the method and step in the execution disclosure of processing unit 1010 in above-mentioned each exemplary embodiment.
Storage unit 1020 may include the readable medium of volatile memory cell form, such as Random Access Storage Unit
1021 (RAM) and/or cache memory unit 1022 can further include read-only memory unit 1023 (ROM).
Storage unit 1020 can also include program/utility with one group of (at least one) program module 1025
1024, such program module includes but is not limited to: operating system, one or more application program, other program modules with
And program data, it may include the realization of network environment in each of these examples or certain combination.
Bus 1030 can be to indicate one of a few class bus structures or a variety of, including storage unit bus or storage
Cell controller, peripheral bus, graphics acceleration port, processing unit use any bus structures in various bus structures
Local bus.
Electronic equipment 1000 can also be with one or more external equipments 1100 (such as keyboard, sensing equipment, bluetooth equipment
Deng) communication, the equipment communication that user can also be allowed to interact with the electronic equipment 1000 with one or more, and/or
With enable the electronic equipment 1000 and one or more other calculate any equipment that equipment are communicated (such as router,
Modem etc.) communication.This communication can be carried out by input/output (I/O) interface 1050.Also, electronic equipment
1000 can also by network adapter 1060 and one or more network (such as local area network (LAN), wide area network (WAN) and/
Or public network, such as internet) communication.As shown in Figure 10, network adapter 1060 can be set by bus 1030 with electronics
Standby 1000 other modules communicate.It should be understood that although not shown in the drawings, other hardware can be used in conjunction with electronic equipment 1000
And/or software module, including but not limited to: microcode, device driver, redundant processing unit, external disk drive array,
RAID system, tape drive and data backup storage system etc..
It will be appreciated by those skilled in the art that various aspects of the disclosure can be implemented as system, method or program product.
Therefore, various aspects of the disclosure can be with specific implementation is as follows, it may be assumed that complete hardware embodiment, complete software
The embodiment that embodiment (including firmware, microcode etc.) or hardware and software combine, may be collectively referred to as here " circuit ",
" module " or " system ".
Those skilled in the art after considering the specification and implementing the invention disclosed here, will readily occur to its of the disclosure
Its embodiment.This application is intended to cover any variations, uses, or adaptations of the disclosure, these modifications, purposes or
Person's adaptive change follows the general principles of this disclosure and including the undocumented common knowledge in the art of the disclosure
Or conventional techniques.The description and examples are only to be considered as illustrative, and the true scope and spirit of the disclosure are by appended
Claim is pointed out.
Above-mentioned described feature, structure or characteristic can be incorporated in one or more embodiment party in any suitable manner
In formula, if possible, it is characterized in discussed in each embodiment interchangeable.In the above description, it provides many specific thin
Section fully understands embodiment of the present disclosure to provide.It will be appreciated, however, by one skilled in the art that this can be practiced
Disclosed technical solution, or can be using other methods, component, material without one or more in specific detail
Deng.In other cases, known features, material or operation are not shown in detail or describe to avoid each side of the fuzzy disclosure
Face.
Claims (10)
1. a kind of client performance evaluation method characterized by comprising
The daily record data of client to be evaluated is obtained using preset time as the period；
Data to be observed are chosen from the daily record data, and determine the performance indicator for corresponding to the data to be observed；
The standard configuration information for being directed to the performance indicator is obtained, to determine the performance quality for evaluating the client performance
Standard；
The Evaluation results of the client to be evaluated are generated using the performance quality standard and the daily record data.
2. client performance evaluation method according to claim 1, which is characterized in that the performance indicator includes that standard refers to
Mark and user-defined counter；The determination corresponds to the performance indicator of the data to be observed, comprising:
Identify the universal performance data and non-universal performance data in the data to be observed；
Standard index corresponding with the universal performance data is determined according to preset mapping relations；
Index allocation information corresponding with the non-universal performance data is obtained, and oneself is generated according to the index allocation information
Define index.
3. client performance evaluation method according to claim 2, which is characterized in that the index allocation information includes referring to
Value type is marked, the index value type is numeric type or character type.
4. client performance evaluation method according to claim 2, which is characterized in that the index allocation information includes referring to
Mark checks permission.
5. client performance evaluation method according to claim 1, which is characterized in that described to utilize the performance quality mark
The quasi- and described daily record data generates the Evaluation results of the client to be evaluated, comprising:
Compare the daily record data of current period and the daily record data of a history cycle, to obtain data float information；
The Evaluation results of the client to be evaluated are generated using the performance quality standard and the data float information.
6. client performance evaluation method described in any one of -5 according to claim 1, which is characterized in that the standard is matched
Confidence breath includes quality standard type, and the quality standard type is sliding scales, floating threshold or fixed threshold.
7. client performance evaluation method described in any one of -5 according to claim 1, which is characterized in that the standard is matched
Confidence breath includes that standard checks permission.
8. a kind of client performance evaluating apparatus characterized by comprising
Data acquisition module is configured as obtaining the daily record data of client to be evaluated using preset time as the period；
Index determining module is configured as choosing data to be observed from the daily record data, and determines corresponding to described wait see
The performance indicator of measured data；
Standard determining module is configured as obtaining the standard configuration information for being directed to the performance indicator, to determine for evaluating
State the performance quality standard of client performance；
Performance evaluation module is configured as generating the client to be evaluated using the performance quality standard and the daily record data
The Evaluation results at end.
9. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the computer program quilt
Client performance evaluation method described in any one of claim 1-7 is realized when processor executes.
10. a kind of electronic equipment characterized by comprising
Processor；
Memory, for storing the executable instruction of the processor；
Wherein, the processor is configured to carrying out any one of perform claim requirement 1-7 via the executable instruction is executed
The client performance evaluation method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910273139.6A CN110008101A (en) | 2019-04-04 | 2019-04-04 | Client performance evaluation method, device, storage medium and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910273139.6A CN110008101A (en) | 2019-04-04 | 2019-04-04 | Client performance evaluation method, device, storage medium and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110008101A true CN110008101A (en) | 2019-07-12 |
Family
ID=67170091
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910273139.6A Pending CN110008101A (en) | 2019-04-04 | 2019-04-04 | Client performance evaluation method, device, storage medium and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110008101A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111651662A (en) * | 2020-04-15 | 2020-09-11 | 车智互联（北京）科技有限公司 | Content generation method and system and computing equipment |
| CN111813644A (en) * | 2020-07-16 | 2020-10-23 | 中国民航信息网络股份有限公司 | System performance evaluation method and device, electronic equipment and computer readable medium |
| CN112306826A (en) * | 2020-02-24 | 2021-02-02 | 北京字节跳动网络技术有限公司 | Method and apparatus for processing information for terminal |
| CN112711228A (en) * | 2019-10-24 | 2021-04-27 | Vega格里沙贝两合公司 | Field device for process automation in an industrial environment |
| CN112968933A (en) * | 2021-01-29 | 2021-06-15 | 北京达佳互联信息技术有限公司 | Data transmission method, device, server and storage medium |
| CN113011138A (en) * | 2019-12-19 | 2021-06-22 | 北京懿医云科技有限公司 | Information processing method, information processing device, electronic equipment and storage medium |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101060435A (en) * | 2007-05-09 | 2007-10-24 | 中兴通讯股份有限公司 | An open-type performance management system and its method |
| US20170091008A1 (en) * | 2015-09-29 | 2017-03-30 | International Business Machines Corporation | Detecting and analyzing performance anomalies of client-server based applications |
| CN106776246A (en) * | 2016-11-22 | 2017-05-31 | 北京奇虎科技有限公司 | The method of evaluating performance and device of a kind of cloud platform |
| CN107315889A (en) * | 2017-07-12 | 2017-11-03 | 北京华如科技股份有限公司 | The performance test methods and storage medium of simulation engine |
| CN107544837A (en) * | 2016-06-24 | 2018-01-05 | 腾讯科技（深圳）有限公司 | Cloud service device performance data acquisition system, method and apparatus |
| CN107943666A (en) * | 2017-12-15 | 2018-04-20 | 广州四三九九信息科技有限公司 | Client performance Data Trend Monitor method, apparatus and computer-readable recording medium |
| CN108446210A (en) * | 2018-02-07 | 2018-08-24 | 平安科技（深圳）有限公司 | Measure, storage medium and the server of system performance |
| CN108874646A (en) * | 2018-06-13 | 2018-11-23 | 北京趣拿软件科技有限公司 | The method and apparatus for analyzing data |
-
2019
- 2019-04-04 CN CN201910273139.6A patent/CN110008101A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101060435A (en) * | 2007-05-09 | 2007-10-24 | 中兴通讯股份有限公司 | An open-type performance management system and its method |
| US20170091008A1 (en) * | 2015-09-29 | 2017-03-30 | International Business Machines Corporation | Detecting and analyzing performance anomalies of client-server based applications |
| CN107544837A (en) * | 2016-06-24 | 2018-01-05 | 腾讯科技（深圳）有限公司 | Cloud service device performance data acquisition system, method and apparatus |
| CN106776246A (en) * | 2016-11-22 | 2017-05-31 | 北京奇虎科技有限公司 | The method of evaluating performance and device of a kind of cloud platform |
| CN107315889A (en) * | 2017-07-12 | 2017-11-03 | 北京华如科技股份有限公司 | The performance test methods and storage medium of simulation engine |
| CN107943666A (en) * | 2017-12-15 | 2018-04-20 | 广州四三九九信息科技有限公司 | Client performance Data Trend Monitor method, apparatus and computer-readable recording medium |
| CN108446210A (en) * | 2018-02-07 | 2018-08-24 | 平安科技（深圳）有限公司 | Measure, storage medium and the server of system performance |
| CN108874646A (en) * | 2018-06-13 | 2018-11-23 | 北京趣拿软件科技有限公司 | The method and apparatus for analyzing data |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112711228A (en) * | 2019-10-24 | 2021-04-27 | Vega格里沙贝两合公司 | Field device for process automation in an industrial environment |
| CN113011138A (en) * | 2019-12-19 | 2021-06-22 | 北京懿医云科技有限公司 | Information processing method, information processing device, electronic equipment and storage medium |
| CN113011138B (en) * | 2019-12-19 | 2023-09-15 | 北京懿医云科技有限公司 | Information processing method, information processing device, electronic equipment and storage medium |
| CN112306826A (en) * | 2020-02-24 | 2021-02-02 | 北京字节跳动网络技术有限公司 | Method and apparatus for processing information for terminal |
| CN111651662A (en) * | 2020-04-15 | 2020-09-11 | 车智互联（北京）科技有限公司 | Content generation method and system and computing equipment |
| CN111651662B (en) * | 2020-04-15 | 2024-02-23 | 车智互联（北京）科技有限公司 | Content generation method, system and computing device |
| CN111813644A (en) * | 2020-07-16 | 2020-10-23 | 中国民航信息网络股份有限公司 | System performance evaluation method and device, electronic equipment and computer readable medium |
| CN111813644B (en) * | 2020-07-16 | 2024-02-27 | 中国民航信息网络股份有限公司 | Evaluation method and device for system performance, electronic equipment and computer readable medium |
| CN112968933A (en) * | 2021-01-29 | 2021-06-15 | 北京达佳互联信息技术有限公司 | Data transmission method, device, server and storage medium |
| CN112968933B (en) * | 2021-01-29 | 2023-03-14 | 北京达佳互联信息技术有限公司 | Data transmission method, device, server and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110008101A (en) | Client performance evaluation method, device, storage medium and electronic equipment | |
| CN110069411A (en) | Client performance quality report generation method, device, medium and electronic equipment | |
| CN103532780B (en) | O＆M for IT field monitors integral system and integrated monitoring method | |
| US10657036B2 (en) | Determining visual testing coverages | |
| Xiong et al. | vPerfGuard: An automated model-driven framework for application performance diagnosis in consolidated cloud environments | |
| CN105830037A (en) | Process for displaying test coverage data during code reviews | |
| CN102231131A (en) | Testing software in electronic device | |
| CN108830837A (en) | A kind of method and apparatus for detecting ladle corrosion defect | |
| KR101312446B1 (en) | Analysis apparatus and method for usability of mobile application using user bebavior log | |
| KR20070080313A (en) | Method and system for analyzing performance of providing services to client terminal | |
| Yu et al. | Experience in predicting fault-prone software modules using complexity metrics | |
| CN112040014A (en) | Internet of things system determination method and device, electronic equipment and storage medium | |
| CN109241343A (en) | A kind of brush amount user identifying system, method and device | |
| CN107246959B (en) | A kind of diagnostic system and method for the equipment fault based on wireless sensor | |
| CN116235151A (en) | Detecting performance degradation in remotely deployed applications | |
| CN109960635A (en) | The monitoring of real-time computing platform and alarm method, system, equipment and storage medium | |
| CN106529283A (en) | Software defined network-oriented controller security quantitative analysis method | |
| CN109976971A (en) | Rigid disc state monitoring method and device | |
| CN110472162A (en) | Appraisal procedure, system, terminal and readable storage medium storing program for executing | |
| CN107562621A (en) | The method and apparatus for determining manual test use-case and tested code incidence relation | |
| CN113656391A (en) | Data detection method and device, storage medium and electronic equipment | |
| CN110222905A (en) | A kind of method and device for predicting flow of the people | |
| CN109697155A (en) | IT system performance estimating method, device, equipment and readable storage medium storing program for executing | |
| CN116989802B (en) | IDC machine room inspection plan configuration strategy method based on GIS and BIM models | |
| CN107430590A (en) | Data compare |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190712 |
|
| RJ01 | Rejection of invention patent application after publication |