CN110059013A - The determination method and device operated normally after software upgrading - Google Patents
The determination method and device operated normally after software upgrading Download PDFInfo
- Publication number
- CN110059013A CN110059013A CN201910335090.2A CN201910335090A CN110059013A CN 110059013 A CN110059013 A CN 110059013A CN 201910335090 A CN201910335090 A CN 201910335090A CN 110059013 A CN110059013 A CN 110059013A
- Authority
- CN
- China
- Prior art keywords
- software
- index
- upgrading
- value
- change degree
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/362—Software debugging
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/362—Software debugging
- G06F11/3644—Software debugging by instrumenting at runtime
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/60—Software deployment
- G06F8/65—Updates
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Software Systems (AREA)
- Computer Security & Cryptography (AREA)
- Stored Programmes (AREA)
Abstract
The application proposes the determination method and device operated normally after a kind of software upgrading, wherein, this method comprises: after determining software upgrading whether it is normal when, whether the change degree magnitude for repeatedly upgrading the key index of front and back in conjunction with software history judges the change degree magnitude of the key index of this upgrading front and back of experimental group software extremely.Thus, repeatedly upgrade the change degree magnitude of the index of front and back in conjunction with software history, accurately define software this upgrading front and back index variation it is whether normal, reduce the work of distribu-tion index threshold value, promote the recall rate checked, abnormal change bring loss is reduced, and provides certain basis for automation O&M.
Description
Technical field
This application involves a kind of determination method operated normally after field of computer technology more particularly to software upgrading and dresses
It sets.
Background technique
In the related art, some core index manually are selected for software, and the index allocation selected is examined extremely in advance
Survey threshold value.When software changes (i.e. the version updating of software), an experimental group (being made of multiple machines) is selected, it then, will
Whether the software of all machines is upgraded in experimental group, and check its coupling index in the threshold range of human configuration.Such as
There are indexs not within the scope of human configuration for fruit, then it is assumed that and software change is abnormal, terminates and carries out software change to remaining machine,
Checking on effect depends entirely on the index of artificial selection and the threshold value for index allocation, since the indication range of artificial selection is logical
It is often the set of a very little, is difficult to select a just right threshold value for index, loose threshold value excessively will lead to abnormal change
It is more undiscovered, cause extensive failure.It crosses harsh threshold value and will lead to and frequently occur erroneous judgement, influence to change efficiency.
Summary of the invention
The application is intended to solve at least some of the technical problems in related technologies.
For this purpose, first purpose of the application is to propose a kind of determination method operated normally after software upgrading.
Second purpose of the application is to propose the determining device operated normally after a kind of software upgrading.
The third purpose of the application is to propose the determining device operated normally after a kind of software upgrading.
The 4th purpose of the application is to propose a kind of computer readable storage medium.
In order to achieve the above object, the application first aspect embodiment proposes the determination side operated normally after a kind of software upgrading
Method, comprising: obtain the first change degree magnitude of experimental group key index before and after this upgrading of software；Acquisition refers to the key
Mark corresponding measure of variation value set, wherein the measure of variation value set includes the variation that software history upgrades front and back every time
Metric；According to the first change degree magnitude and the measure of variation value set, whether the first change degree magnitude is determined
It is abnormal；When determining that the first change degree magnitude is normal, it is determined that experimental group normal operation after this upgrading of software.
The determination method operated normally after software upgrading provided by the embodiments of the present application, after determining software upgrading whether just
Chang Shi repeatedly upgrades the change degree magnitude of the key index of front and back in conjunction with software history, to this upgrading front and back of experimental group software
The change degree magnitude of key index whether judged extremely.Software history is combined repeatedly to upgrade the index of front and back as a result,
Change degree magnitude, accurately define software this upgrading front and back index variation it is whether normal, reduce distribu-tion index threshold value
Work, promote the recall rate of inspection, reduce abnormal change bring loss, and provide certain base to automate O&M
Plinth.
In order to achieve the above object, the application second aspect embodiment propose operate normally after a kind of software upgrading determine dress
It sets, comprising: first obtains module, for obtaining the first measure of variation of experimental group key index before and after this upgrading of software
Value；Second obtains module, for obtaining measure of variation value set corresponding with the key index, wherein the measure of variation
Value set includes the change degree magnitude that software history upgrades front and back every time；First judgment module, for according to first variation
Metric and the measure of variation value set determine whether the first change degree magnitude is abnormal；First determining module is used for
When determining that the first change degree magnitude is normal, it is determined that experimental group normal operation after this upgrading of software.
The determining device operated normally after software upgrading provided by the embodiments of the present application, after determining software upgrading whether just
Chang Shi repeatedly upgrades the change degree magnitude of the key index of front and back in conjunction with software history, to this upgrading front and back of experimental group software
The change degree magnitude of key index whether judged extremely.Software history is combined repeatedly to upgrade the index of front and back as a result,
Change degree magnitude, accurately define software this upgrading front and back index variation it is whether normal, reduce distribu-tion index threshold value
Work, promote the recall rate of inspection, reduce abnormal change bring loss, and provide certain base to automate O&M
Plinth.
In order to achieve the above object, the application third aspect embodiment proposes the determination side operated normally after a kind of software upgrading
Method including memory, processor and stores the computer program that can be run on a memory and on a processor, the processor
The determination method operated normally after software upgrading as described above is realized when executing described program.
To achieve the goals above, the application fourth aspect embodiment proposes a kind of computer readable storage medium, when
When instruction in the storage medium is executed by processor, the determination side operated normally after software upgrading as described above is realized
Method.
The additional aspect of the application and advantage will be set forth in part in the description, and will partially become from the following description
It obtains obviously, or recognized by the practice of the application.
Detailed description of the invention
The application is above-mentioned and/or additional aspect and advantage will become from the following description of the accompanying drawings of embodiments
Obviously and it is readily appreciated that, in which:
Fig. 1 is the flow diagram of the determination method operated normally after a kind of software upgrading provided by the embodiments of the present application；
Fig. 2 is the process signal of the determination method operated normally after another software upgrading provided by the embodiments of the present application
Figure；
Fig. 3 is the process signal of the determination method operated normally after another software upgrading provided by the embodiments of the present application
Figure；
Fig. 4 is the structural schematic diagram of the determining device operated normally after a kind of software upgrading provided by the embodiments of the present application；
Fig. 5 is the structural representation of the determining device operated normally after another software upgrading provided by the embodiments of the present application
Figure；
Fig. 6 is the structural representation of the determining device operated normally after another software upgrading provided by the embodiments of the present application
Figure；
Fig. 7 is the structural schematic diagram of the determining device operated normally after a kind of software upgrading provided by the embodiments of the present application.
Specific embodiment
Embodiments herein is described below in detail, examples of the embodiments are shown in the accompanying drawings, wherein from beginning to end
Same or similar label indicates same or similar element or element with the same or similar functions.Below with reference to attached
The embodiment of figure description is exemplary, it is intended to for explaining the application, and should not be understood as the limitation to the application.
It when software issues new version, repairs Bug or when lifting system performance, requires to carry out online, that is, changes
Publication, change publication are undoubtedly the only way which must be passed of software iteration.But change and be always accompanied by risk, the one of Internet company's generation
A little user's thoughts, lose big failure, often change with software related.Although promoting exploitation, test quality to a certain extent
Number of faults on line can be reduced, but since production environment is different from test environment, and the call relation serviced is more multiple
It is miscellaneous, change can not be avoided to introduce failure completely.
Usually change is divided at least in the related technology in order to reduce influence of the abnormal change to online service stability
Two stages, first stage carry out software version change, second stage, if the index of specified machine to specified machine
Normally, it is determined that software version change is normal, issues software version, so that user can carry out software more according to new software version
Newly.
In first stage, in the related technology, usually during the version after specified machine operation upgrades,
Obtain the index value of its default capabilities index, and in judge index value whether in the threshold range of human configuration.If there is finger
Mark is not within the scope of human configuration, then it is assumed that software change is abnormal.However, the indication range being manually arranged is easy inaccuracy, from
And abnormal change is caused not found in time, cause extensive failure.
For this purpose, the embodiment of the present application proposes a kind of determination method operated normally after software upgrading, this method is in determination
After software upgrading whether it is normal when, repeatedly upgrade in conjunction with software history front and back key index change degree magnitude, to experimental group
Whether the change degree magnitude of the key index of this upgrading front and back of software is judged extremely, that is to say, that determines that experimental group is soft
Whether the variation of key index of the part after this meets the changing rule that software history repeatedly upgrades front and back key index, if soft
This upgrading front and back key index of part, it is determined that experimental group normal operation after this upgrading of software, that is, determine this software liter
After grade, key index will not be caused, that is to say, that this upgrading of software will not cause risk to line upward stability.It combines as a result,
Software history repeatedly upgrades the change degree magnitude of the index of front and back, accurately defines the variation of this upgrading front and back index of software
It is whether normal, reduce the work of distribu-tion index threshold value, promote the recall rate of inspection, reduces abnormal change bring loss, and
Certain basis is provided for automation O&M.
Below with reference to the accompanying drawings the determination method and device operated normally after the software upgrading of the embodiment of the present application is described.
Fig. 1 is the flow diagram of the determination method operated normally after a kind of software upgrading provided by the embodiments of the present application.
Wherein, it should be noted that the execution subject of the determination method operated normally after the software upgrading of the embodiment of the present application is software
The determining device operated normally after upgrading, the determining device operated normally after the software upgrading can be located at electronic equipment, or
In server, which is not construed as limiting this.
As shown in Figure 1, the determination method operated normally after the software upgrading may include:
Step 101, the first change degree magnitude of experimental group key index before and after this upgrading of software is obtained.
Experimental group is made of specified machine, which refers to the machine that this upgrading is executed to software.
The quantity of specified machine in experimental group can be one or more.
Wherein, the first change degree magnitude refers to this upgrading front and back of software, to characterization software operating status in experimental group
The situation of change of key index measured.
Wherein, key index refers to the index of characterization software operating status.It can determine the operation of software by key index
Whether state is normal.
Key index may include that resource metrics (such as cpu resource occupies how many, and memory source occupies how many), business refer to
Mark (response time index, request processing index, the non-response index of request etc.), error log index etc..
It is understood that due to during software changes, machine will appear load variation, individually to a machine into
The variation of row key index is detected, and erroneous judgement is likely to result in, therefore, the present embodiment in order to improve the accuracy of judgement, this
Embodiment combines the finger of key index of multiple machines before and after this upgrading of software to be made of in experimental group multiple machines
Scale value determines the change degree magnitude of key index of the experimental group before and after this upgrading of software.That is, to machines all in experimental group
The index changing value of key index before and after this upgrading of software is measured, to obtain the first change degree magnitude.
Step 102, measure of variation value set corresponding with key index is obtained, wherein measure of variation value set includes soft
Part history upgrades the change degree magnitude of front and back every time.
Step 103, according to the first change degree magnitude and measure of variation value set, determine whether the first change degree magnitude is different
Often.
Wherein, according to the first change degree magnitude and measure of variation value set, determine key index before this upgrading of software
Afterwards whether there are many normal modes, illustrate as follows:
In this example, as shown in Fig. 2, step 103 may include:
Step 1031, upgraded every time according to software history front and back change degree magnitude, calculate key index average value and
Standard deviation square value.
Step 1032, according to average value, standard deviation square value and the first change degree magnitude, counting statistics Z value.
Step 1032, according to statistics Z value and significance of difference relation table, determine key index before and after this upgrading of software
It is whether normal.
In this example, it is assumed that history every time before changing after key target measure of variation value set T, T={ t1,
t2..., tn}。
The average value that historical variations situation (T) calculates measure of variation can be calculated according to measure of variation value set TWith
And the standard deviation sigma of measure of variationT, shown in the formula of Z test such as following formula (3), | Z | it is bigger, then it represents that this occurs
Become
The probability of change is smaller, i.e. the variation of this change can not be explained by historical changing.
Wherein, the t in formula (3) indicates the first change degree magnitude.
Wherein, according to statistics Z value and significance of difference relation table, statistics Z value is determined, if it is significant, if statistics Z value is not
Significantly, then key index is normal before and after this upgrading of software.
For example, statistics Z value is 1.8, by the way that compared with the theoretical Z value in significance of difference relation table, statistics Z value is located at
Within the scope of the inapparent theory Z value of difference, at this point, determining that key index is normal before and after this upgrading of software.
In another example, the normal range (NR) of the measure of variation of key index can be determined according to measure of variation value set,
And compare the first change degree magnitude, if in the normal range (NR) of measure of variation, if, determine key index software this
Upgrading front and back is normal, if not in the normal range, it is determined that key index is abnormal before and after this upgrading of software, that is, software sheet
Secondary upgrading can cause key index variation abnormality.
For example, repeatedly upgrading the measure of variation value set of front and back according to software history, determine in measure of variation value set
Maximum variation magnitude and minimum change metric obtain and according to maximum variation magnitude and minimum change metric
The normal range (NR) of measure of variation, if this upgrading front and back of software, the change degree magnitude of key index is in minimum change metric
Between maximum variation magnitude, it is determined that key index is normal before and after this upgrading of software, otherwise determines key index soft
This upgrading front and back of part is abnormal, that is, this upgrading of software can cause key index variation abnormality.
Step 104, when determining that the first change degree magnitude is normal, it is determined that experimental group is run just after this upgrading of software
Often.
Whether the determination method operated normally after software upgrading disclosed in the present embodiment is normal after determining software upgrading
When, repeatedly upgrade the change degree magnitude of the key index of front and back in conjunction with software history, to this upgrading front and back of experimental group software
Whether the change degree magnitude of key index is judged extremely.Software history is combined repeatedly to upgrade the change of the index of front and back as a result,
Change metric, accurately define software this upgrading front and back index variation it is whether normal, reduce distribu-tion index threshold value
Work promotes the recall rate of inspection, reduces abnormal change bring loss, and provide certain basis for automation O&M.
Wherein, it is to be understood that it is identical as the mode of above-described embodiment for the deterministic process of each key index,
When there is abnormal key index after determining this upgrading of software, it is determined that cause to keep key index different after this upgrading of software
Often, it needs to stop changing, software is adjusted again.
On the basis of upper embodiment, after the software version to experimental group carries out this upgrading, fortune can be potentially encountered
Battalion or focus incident, and these events may make key index that a degree of variation occur.Since these factors can be same
When be applied on the machine not changed (that is, control group), therefore, in order to evade because user behavior change caused by index variation
And the erroneous judgement caused, the present embodiment determine the first change degree magnitude according to the first change degree magnitude and measure of variation value set
When abnormal, herein in connection with the indication information according to control group, whether key index is further judged extremely, that is to say, that
In the change interpretation before and after the variation of key index before and after determining this upgrading of software cannot repeatedly be upgraded by software history, into
One step determines whether the variation of key index in experimental group can be explained by control group.
Therefore, on the basis of embodiment shown in Fig. 1, as shown in Fig. 2, this method can also include:
Step 201, according to prediction model, determine that experimental group is crucial in the third preset time period after this upgrading of software
Multiple index predicted values of index.
Wherein, prediction model is that the time series of the indication information based on control group is fitted, and indication information includes
The history index value of key index, control group are run with the version before this upgrading of software.
Specifically, it according to prediction model, can be predicted when third of each machine after software upgrading is default in experimental group
Between in section key index index predicted value.
Step 202, multiple realities of experimental group key index in the third preset time period after this upgrading of software are obtained
Border index value.
Step 203, according to the diversity factor of multiple index predicted values of key index and multiple practical index values, first is determined
Whether change degree magnitude is abnormal.
Step 204, if it is determined that diversity factor is not significant, it is determined that the first change degree magnitude is normal.
Step 205, if it is determined that diversity factor is significant, it is determined that the first variable quantity is abnormal.
Specifically, after calculating diversity factor the corresponding probability value of the diversity factor can be determined according to t dividing value table, if
Probability value is less than the first probability value, it is determined that the first variable quantity is normal, otherwise determines that the first variable quantity is abnormal.
Wherein, the first probability value is the corresponding probability value of significant difference.
In the present embodiment, it is examined using T to multiple index predicted values of key index and the difference of multiple practical index values
Off course degree is judged, if difference is not significant, then it is assumed that the variation of key index can be explained by control group, otherwise it is assumed that closing
The variation of key index can not be explained by control group.
It should be noted that the measure of variation solution before and after the variation for determining key index cannot repeatedly be upgraded by history
Release, when can not be explained by control group, then can determine be as software this upgrading caused by key index exception.
When determining the exception of key index caused by this upgrading of software, exportable prompt information, so that maintenance personnel
According to prompt information, it is abnormal to determine that software change exists.
The embodiment of the present application is repeatedly upgrading front and back in conjunction with software history, and the measure of variation set of key index is determined and closed
Key index, in conjunction with the indication information of control group, predicts experimental group after the change degree magnitude exception before and after this upgrading of software
The predicted value of key index in preset time period after upgrading, and according to the practical index value and predicted value of key index, into
One step determines whether the first variation magnitude is abnormal, in the practical index value and predicted value according to key index, determines the first variation
When magnitude exception, it is determined that this upgrading of software causes key index abnormal.The change of history software and control group are combined as a result,
Indication information, whether key index is abnormal before and after this upgrading of software is further accurately determined, and further improves the standard of judgement
True property, reduces the work of distribu-tion index threshold value, promotes the recall rate of inspection, the abnormal change bring loss of reduction, and be certainly
Dynamicization O&M provides certain basis.
Fig. 3 is the flow diagram of the determination method operated normally after a kind of software upgrading provided by the embodiments of the present application.
As shown in figure 3, the determination method operated normally after the software upgrading may include:
Step 301, the first reality of experimental group key index in the first preset time period before this upgrading of software is obtained
Border index value sequence.
Step 302, the second reality of experimental group key index in the second preset time period after this upgrading of software is obtained
Border index value sequence.
Wherein, the first practical index value sequence includes multiple the first practical index values according to the sequence of acquisition moment.
Second practical index value sequence includes multiple the second practical index values according to the sequence of acquisition moment.
Since during software changes, machine will appear load variation, key index individually is carried out to a machine
Variation is detected, and erroneous judgement is likely to result in, and therefore, in the present embodiment, experimental group is made of multiple machines, when corresponding to acquisition
Engraving the first corresponding practical index value is the index average value that all machines are engraved in corresponding acquisition in experimental group, corresponding
It is that the index that all machines are engraved in corresponding acquisition in experimental group is average that the second corresponding practical index value is engraved when acquisition
Value.Thus, it is possible to key index changes caused by reducing the load variation because of individual machine, thus the occurrence of causing erroneous judgement,
Further improve software.
Step 303, according to the first practical index value sequence and the second practical index value sequence, determine experimental group in software sheet
First change degree magnitude of key index before and after secondary upgrading.
In the present embodiment, according to the first practical index value sequence and the second practical index value sequence, determine that experimental group exists
First change degree magnitude of this upgrading front and back key index of software, can be accomplished in the following manner: actually refer to according to first
Scale value sequence calculates the first average value and first variance of key index before this upgrades in software；According to the second practical index
Value sequence calculates the second average value and second variance of the key index after this upgrading of software；According to the first average value, first
Variance, the second average value and second variance determine the first measure of variation of experimental group key index before and after this upgrading of software
Value.
In embodiment, variation of the key index after before changing is measured according to T inspection, obtained inspection system
Measure t, as, the first change degree magnitude of key index.
Wherein, shown in the following formula (1) for calculating the first change degree magnitude t of key index:
Wherein, X, Y be respectively key index in software this upgrades forward and backward index value；n1、n2The respectively sample of X, Y
Point number, that is, n1Indicate index value number of the key index before this upgrading of software, n1Indicate key index software this
Index value number before upgrading；The respectively variance of X, Y.spIndicate the standard deviation of paired sample difference.
Step 304, measure of variation value set corresponding with key index is obtained, wherein measure of variation value set includes soft
Part history upgrades the change degree magnitude of front and back every time.
Step 305, according to the first change degree magnitude and measure of variation value set, determine whether the first change degree magnitude is different
Often, no to then follow the steps 306 if so, thening follow the steps 310.
Step 306, according to prediction model, determine that experimental group is crucial in the third preset time period after this upgrading of software
Multiple index predicted values of index.
Step 307, multiple realities of experimental group key index in the third preset time period after this upgrading of software are obtained
Border index value.
Step 308, according to the diversity factor of multiple index predicted values of key index and multiple practical index values, first is determined
Whether change degree magnitude is abnormal, if so, 309 are thened follow the steps, it is no to then follow the steps 310.
Step 309, determine that experimental group is operating abnormally after this upgrading of software.
That is, determining that this upgrading of software causes the Indexes Abnormality of key index.
Step 310, experimental group normal operation after this upgrading of software is determined.
The embodiment of the present application is repeatedly upgrading front and back in conjunction with software history, and the measure of variation set of key index is determined and closed
Key index, in conjunction with the indication information of control group, predicts experimental group after the change degree magnitude exception before and after this upgrading of software
The predicted value of key index in preset time period after upgrading, and according to the practical index value and predicted value of key index, into
One step determines whether the first variation magnitude is abnormal, in the practical index value and predicted value according to key index, determines the first variation
When magnitude exception, it is determined that this upgrading of software causes key index abnormal.The change of history software and control group are combined as a result,
Indication information, whether key index is abnormal before and after this upgrading of software is further accurately determined, and further improves the standard of judgement
True property, reduces the work of distribu-tion index threshold value, promotes the recall rate of inspection, the abnormal change bring loss of reduction, and be certainly
Dynamicization O&M provides certain basis.
Fig. 4 is the structural schematic diagram of the determining device operated normally after a kind of software upgrading provided by the embodiments of the present application.
Shown in Fig. 4, the determining device operated normally after the software upgrading includes that the first acquisition module 110, second obtains mould
Block 120, first judgment module 130 and the first determining module 140, in which:
First obtains module 110, for obtaining the first change degree of experimental group key index before and after this upgrading of software
Magnitude.
Second obtains module 120, for obtaining measure of variation value set corresponding with key index, wherein measure of variation
Value set includes the change degree magnitude that software history upgrades front and back every time.
First judgment module 130, for determining the first change degree according to the first change degree magnitude and measure of variation value set
Whether magnitude is abnormal.
First determining module 140, for when determining that the first change degree magnitude is normal, it is determined that experimental group software this
Normal operation after upgrading.
In one embodiment of the application, according to the first change degree magnitude and measure of variation value set, first is determined
When change degree magnitude exception, on the basis of Installation practice as shown in Figure 4, as shown in figure 5, the device further include:
Second determining module 150, for determining that third of the experimental group after this upgrading of software is default according to prediction model
Multiple index predicted values of key index in period.
Wherein, prediction model is that the time series of the indication information based on control group is fitted, and indication information includes
The history index value of key index, control group are run with the version before this upgrading of software.
Third obtains module 160, crucial in the third preset time period after this upgrading of software for obtaining experimental group
Multiple practical index values of index.
Second judgment module 170, for according to multiple index predicted values of key index and the difference of multiple practical index values
Different degree determines whether the first change degree magnitude is abnormal.
In one embodiment of the application, first judgment module 130 is specifically used for: being upgraded every time according to software history
The change degree magnitude of front and back calculates the average value and standard deviation square value of key index.According to average value, standard deviation square value and first
Change degree magnitude, counting statistics Z value.According to statistics Z value and significance of difference relation table, determine key index in this liter of software
Whether grade front and back is normal.
In the implementation of the application, on the basis of Installation practice as shown in Figure 4, as shown in fig. 6, the device
Further include:
4th obtains module 180, crucial in the first preset time period before this upgrading of software for obtaining experimental group
The practical index value sequence of the first of index.
5th obtains module 190, crucial in the second preset time period after this upgrading of software for obtaining experimental group
The practical index value sequence of the second of index.
Third determining module 200, for determining real according to the first practical index value sequence and the second practical index value sequence
Test the first change degree magnitude of group key index before and after this upgrading of software.
Wherein, it should be noted that the in Installation practice shown in figure 6 above the 4th, which obtains module the 180, the 5th, obtains mould
The structure of block 190 and third determining module 200 also may be embodied in aforementioned Installation practice shown in fig. 5, and the implementation is to this
It is not construed as limiting.
In one embodiment of the application, third determining module 200 is specifically used for: according to the first practical index value sequence
Column calculate the first average value and first variance of key index before this upgrades in software.According to the second practical index value sequence,
Calculate the second average value and second variance of the key index after this upgrading of software.According to the first average value, first variance,
Two average values and second variance determine the first change degree magnitude of experimental group key index before and after this upgrading of software.
Wherein, the first practical index value sequence includes multiple the first practical index values according to the sequence of acquisition moment, experiment
Group is made of multiple machines, when corresponding acquisition engrave the first corresponding practical index value be in experimental group all machines in correspondence
The index average value engraved when acquisition, the second practical index value sequence include that multiple second according to the sequence of acquisition moment actually refer to
Scale value, corresponding to and engraving the second corresponding practical index value when acquisition is that all machines are engraved in corresponding acquisition in experimental group
Index average value.
Wherein, it should be noted that the aforementioned explanation to the determination embodiment of the method operated normally after software upgrading
It is also applied for the determining device operated normally after the software upgrading of the embodiment, details are not described herein again.
Whether the determining device operated normally after software upgrading disclosed in the present embodiment is normal after determining software upgrading
When, repeatedly upgrade the change degree magnitude of the key index of front and back in conjunction with software history, to this upgrading front and back of experimental group software
Whether the change degree magnitude of key index is judged extremely.Software history is combined repeatedly to upgrade the change of the index of front and back as a result,
Change metric, accurately define software this upgrading front and back index variation it is whether normal, reduce distribu-tion index threshold value
Work promotes the recall rate of inspection, reduces abnormal change bring loss, and provide certain basis for automation O&M.
Fig. 7 is the structural schematic diagram of the determining device operated normally after a kind of software upgrading provided by the embodiments of the present application.
As shown in fig. 7, the determining device operated normally after the software upgrading includes:
Memory 1001, processor 1002 and it is stored in the calculating that can be run on memory 1001 and on processor 1002
Machine program.
Processor 1002 realizes the determination side operated normally after the software upgrading provided in above-described embodiment when executing program
Method.
Further, the determination method operated normally after software upgrading further include:
Communication interface 1003, for the communication between memory 1001 and processor 1002.
Memory 1001, for storing the computer program that can be run on processor 1002.
Memory 1001 may include high speed RAM memory, it is also possible to further include nonvolatile memory (non-
Volatile memory), a for example, at least magnetic disk storage.
Processor 1002 realizes the determination side operated normally after the software upgrading of above-described embodiment when for executing program
Method.
If memory 1001, processor 1002 and the independent realization of communication interface 1003, communication interface 1003, memory
1001 and processor 1002 can be connected with each other by bus and complete mutual communication.Bus can be Industry Standard Architecture
Structure (Industry Standard Architecture, referred to as ISA) bus, external equipment interconnection (Peripheral
Component, referred to as PCI) bus or extended industry-standard architecture (Extended Industry Standard
Architecture, referred to as EISA) bus etc..Bus can be divided into address bus, data/address bus, control bus etc..For just
It is only indicated with a thick line in expression, Fig. 7, it is not intended that an only bus or a type of bus.
Optionally, in specific implementation, if memory 1001, processor 1002 and communication interface 1003, are integrated in one
It is realized on block chip, then memory 1001, processor 1002 and communication interface 1003 can be completed mutual by internal interface
Communication.
Processor 1002 may be a central processing unit (Central Processing Unit, referred to as CPU), or
Person is specific integrated circuit (Application Specific Integrated Circuit, referred to as ASIC) or quilt
It is configured to implement one or more integrated circuits of the embodiment of the present application.
The present embodiment also provides a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that
The program realizes the determination method operated normally after software upgrading as above when being executed by processor.
In the description of this specification, reference term " one embodiment ", " some embodiments ", " example ", " specifically show
The description of example " or " some examples " etc. means specific features, structure, material or spy described in conjunction with this embodiment or example
Point is contained at least one embodiment or example of the application.In the present specification, schematic expression of the above terms are not
It must be directed to identical embodiment or example.Moreover, particular features, structures, materials, or characteristics described can be in office
It can be combined in any suitable manner in one or more embodiment or examples.In addition, without conflicting with each other, the skill of this field
Art personnel can tie the feature of different embodiments or examples described in this specification and different embodiments or examples
It closes and combines.
In addition, term " first ", " second " are used for descriptive purposes only and cannot be understood as indicating or suggesting relative importance
Or implicitly indicate the quantity of indicated technical characteristic.Define " first " as a result, the feature of " second " can be expressed or
Implicitly include at least one this feature.In the description of the present application, the meaning of " plurality " is at least two, such as two, three
It is a etc., unless otherwise specifically defined.
Any process described otherwise above or method description are construed as in flow chart or herein, and expression includes
It is one or more for realizing custom logic function or process the step of executable instruction code module, segment or portion
Point, and the range of the preferred embodiment of the application includes other realization, wherein can not press shown or discussed suitable
Sequence, including according to related function by it is basic simultaneously in the way of or in the opposite order, Lai Zhihang function, this should be by the application
Embodiment person of ordinary skill in the field understood.
Expression or logic and/or step described otherwise above herein in flow charts, for example, being considered use
In the order list for the executable instruction for realizing logic function, may be embodied in any computer-readable medium, for
Instruction execution system, device or equipment (such as computer based system, including the system of processor or other can be held from instruction
The instruction fetch of row system, device or equipment and the system executed instruction) it uses, or combine these instruction execution systems, device or set
It is standby and use.For the purpose of this specification, " computer-readable medium ", which can be, any may include, stores, communicates, propagates or pass
Defeated program is for instruction execution system, device or equipment or the dress used in conjunction with these instruction execution systems, device or equipment
It sets.The more specific example (non-exhaustive list) of computer-readable medium include the following: there is the electricity of one or more wirings
Interconnecting piece (electronic device), portable computer diskette box (magnetic device), random access memory (RAM), read-only memory
(ROM), erasable edit read-only storage (EPROM or flash memory), fiber device and portable optic disk is read-only deposits
Reservoir (CDROM).In addition, computer-readable medium can even is that the paper that can print described program on it or other are suitable
Medium, because can then be edited, be interpreted or when necessary with it for example by carrying out optical scanner to paper or other media
His suitable method is handled electronically to obtain described program, is then stored in computer storage.
It should be appreciated that each section of the application can be realized with hardware, software, firmware or their combination.Above-mentioned
In embodiment, software that multiple steps or method can be executed in memory and by suitable instruction execution system with storage
Or firmware is realized.Such as, if realized with hardware in another embodiment, following skill well known in the art can be used
Any one of art or their combination are realized: have for data-signal is realized the logic gates of logic function from
Logic circuit is dissipated, the specific integrated circuit with suitable combinational logic gate circuit, programmable gate array (PGA), scene can compile
Journey gate array (FPGA) etc..
Those skilled in the art are understood that realize all or part of step that above-described embodiment method carries
It suddenly is that relevant hardware can be instructed to complete by program, the program can store in a kind of computer-readable storage medium
In matter, which when being executed, includes the steps that one or a combination set of embodiment of the method.
It, can also be in addition, can integrate in a processing module in each functional unit in each embodiment of the application
It is that each unit physically exists alone, can also be integrated in two or more units in a module.Above-mentioned integrated mould
Block both can take the form of hardware realization, can also be realized in the form of software function module.The integrated module is such as
Fruit is realized and when sold or used as an independent product in the form of software function module, also can store in a computer
In read/write memory medium.
Storage medium mentioned above can be read-only memory, disk or CD etc..Although having been shown and retouching above
Embodiments herein is stated, it is to be understood that above-described embodiment is exemplary, and should not be understood as the limit to the application
System, those skilled in the art can be changed above-described embodiment, modify, replace and become within the scope of application
Type.
Claims (14)
1. a kind of determination method operated normally after software upgrading characterized by comprising
Obtain the first change degree magnitude of experimental group key index before and after this upgrading of software；
Obtain measure of variation value set corresponding with the key index, wherein the measure of variation value set includes that software is gone through
History upgrades the change degree magnitude of front and back every time；
According to the first change degree magnitude and the measure of variation value set, determine whether the first change degree magnitude is different
Often；
When determining that the first change degree magnitude is normal, it is determined that experimental group normal operation after this upgrading of software.
2. the method as described in claim 1, which is characterized in that according to the first change degree magnitude and the measure of variation
Value set, when determining the first change degree magnitude exception, the method also includes:
According to prediction model, experimental group key index in the third preset time period after this upgrading of software is determined
Multiple index predicted values, wherein the prediction model is that the time series of the indication information based on control group is fitted,
The indication information includes the history index value of the key index, and the control group is with the version before this upgrading of software
Operation；
Obtain multiple realities of experimental group key index in the third preset time period after this upgrading of software
Border index value；
According to the diversity factor of multiple index predicted values of the key index and multiple practical index values, first variation is determined
Whether metric is abnormal.
3. the method as described in claim 1, which is characterized in that described according to the first change degree magnitude and the change degree
Magnitude set determines whether the key index is normal before and after this upgrading of software, comprising:
The change degree magnitude for upgrading front and back every time according to software history, calculates the average value and standard variance of the key index
Value；
According to the average value, the standard deviation square value and the first change degree magnitude, counting statistics Z value；
According to the statistics Z value and significance of difference relation table, determine the key index before and after this upgrading of software whether
Normally.
4. the method as described in claim 1, which is characterized in that crucial before and after this upgrading of software in the acquisition experimental group
Before first change degree magnitude of index, further includes:
Experimental group key index in the first preset time period before this upgrading of software is obtained first actually to refer to
Scale value sequence；
Experimental group key index in the second preset time period after this upgrading of software is obtained second actually to refer to
Scale value sequence；
According to the described first practical index value sequence and the second practical index value sequence, determine the experimental group in software sheet
First change degree magnitude of the key index before and after secondary upgrading.
5. method as claimed in claim 3, which is characterized in that described according to the described first practical index value sequence and described
Two practical index value sequences determine the first measure of variation of experimental group key index before and after this upgrading of software
Value, comprising:
According to the described first practical index value sequence, calculate before in software, this upgrades the first average value of the key index and
First variance；
According to the described second practical index value sequence, calculate after this upgrading of software the second average value of the key index and
Second variance；
According to first average value, first variance, the second average value and second variance, determine the experimental group software this
First change degree magnitude of the upgrading front and back key index.
6. method as claimed in claim 4, which is characterized in that the first practical index value sequence includes multiple according to acquisition
First practical index value of moment sequence, the experimental group are made of multiple machines, are corresponded to and are engraved corresponding first when acquisition
Practical index value is the index average value that all machines are engraved in corresponding acquisition in the experimental group, the second practical index
Value sequence includes multiple according to the second practical index value for acquiring moment sequence, corresponds to and engraves the second corresponding reality when acquisition
Index value is the index average value that all machines are engraved in corresponding acquisition in the experimental group.
7. the determining device operated normally after a kind of software upgrading characterized by comprising
First obtains module, for obtaining the first change degree magnitude of experimental group key index before and after this upgrading of software；
Second obtains module, for obtaining measure of variation value set corresponding with the key index, wherein the measure of variation
Value set includes the change degree magnitude that software history upgrades front and back every time；
First judgment module, for determining described first according to the first change degree magnitude and the measure of variation value set
Whether change degree magnitude is abnormal；
First determining module, for when determining that the first change degree magnitude is normal, it is determined that the experimental group is in software sheet
Normal operation after secondary upgrading.
8. device as claimed in claim 7, which is characterized in that according to the first change degree magnitude and the measure of variation
Value set, when determining the first change degree magnitude exception, described device further include:
Second determining module, when being used to determine that third of the experimental group after this upgrading of software is default according to prediction model
Between in section the key index multiple index predicted values, wherein the prediction model is the indication information based on control group
What time series was fitted, the indication information includes the history index value of the key index, and the control group is with soft
What the version before this upgrading of part was run；
Third obtains module, described in the third preset time period after this upgrading of software for obtaining the experimental group
Multiple practical index values of key index；
Second judgment module, for according to multiple index predicted values of the key index and the difference of multiple practical index values
Degree determines whether the first change degree magnitude is abnormal.
9. device as claimed in claim 7, which is characterized in that the first judgment module is specifically used for:
The change degree magnitude for upgrading front and back every time according to software history, calculates the average value and standard variance of the key index
Value；
According to the average value, the standard deviation square value and the first change degree magnitude, counting statistics Z value；
According to the statistics Z value and significance of difference relation table, determine the key index before and after this upgrading of software whether
Normally.
10. device as claimed in claim 7, which is characterized in that further include:
4th obtains module, for obtaining experimental group key in the first preset time period before this upgrading of software
The practical index value sequence of the first of index；
5th obtains module, for obtaining experimental group key in the second preset time period after this upgrading of software
The practical index value sequence of the second of index；
Third determining module, for determining according to the described first practical index value sequence and the second practical index value sequence
First change degree magnitude of experimental group key index before and after this upgrading of software.
11. device as claimed in claim 9, which is characterized in that the third determining module is specifically used for:
According to the described first practical index value sequence, calculate before in software, this upgrades the first average value of the key index and
First variance；
According to the described second practical index value sequence, calculate after this upgrading of software the second average value of the key index and
Second variance；
According to first average value, first variance, the second average value and second variance, determine the experimental group software this
First change degree magnitude of the upgrading front and back key index.
12. device as claimed in claim 11, which is characterized in that the first practical index value sequence includes multiple according to adopting
Collect the first practical index value of moment sequence, the experimental group is made of multiple machines, when corresponding acquisition engrave corresponding to the
One practical index value is the index average value that all machines are engraved in corresponding acquisition in the experimental group, and described second actually refers to
Scale value sequence includes multiple according to the second practical index value for acquiring moment sequence, corresponds to and engraves corresponding second when acquisition in fact
Border index value is the index average value that all machines are engraved in corresponding acquisition in the experimental group.
13. the determining device operated normally after a kind of software upgrading characterized by comprising
Memory, processor and storage are on a memory and the computer program that can run on a processor, which is characterized in that institute
State the determination side realized when processor executes described program as operated normally after software upgrading as claimed in any one of claims 1 to 6
Method.
14. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the program is by processor
The determination method as operated normally after software upgrading as claimed in any one of claims 1 to 6 is realized when execution.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910335090.2A CN110059013B (en) | 2019-04-24 | 2019-04-24 | Method and device for determining normal operation after software upgrading |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910335090.2A CN110059013B (en) | 2019-04-24 | 2019-04-24 | Method and device for determining normal operation after software upgrading |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110059013A true CN110059013A (en) | 2019-07-26 |
| CN110059013B CN110059013B (en) | 2023-06-23 |
Family
ID=67320519
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910335090.2A Active CN110059013B (en) | 2019-04-24 | 2019-04-24 | Method and device for determining normal operation after software upgrading |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110059013B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115599657A (en) * | 2022-12-15 | 2023-01-13 | 浪潮通信信息系统有限公司（Cn） | Software facility abnormity judgment method |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130159247A1 (en) * | 2011-12-14 | 2013-06-20 | Sap Ag | Change data capturing during an upgrade |
| CN103945442A (en) * | 2014-05-07 | 2014-07-23 | 东南大学 | System anomaly detection method based on linear prediction principle in mobile communication system |
| US20160299832A1 (en) * | 2013-11-29 | 2016-10-13 | Gemalto Sa | Method for loading a native code on a secure element |
| CN106980905A (en) * | 2017-03-15 | 2017-07-25 | 南方电网科学研究院有限责任公司 | Distribution network reliability Forecasting Methodology and system |
| CN108595669A (en) * | 2018-04-28 | 2018-09-28 | 国信优易数据有限公司 | A kind of unordered classified variable processing method and processing device |
| CN109241482A (en) * | 2018-08-28 | 2019-01-18 | 优视科技新加坡有限公司 | Determine that altering event issues successful method and device thereof |
| CN109492394A (en) * | 2018-10-25 | 2019-03-19 | 平安科技（深圳）有限公司 | The recognition methods of abnormal traffic request and terminal device |
| CN109558295A (en) * | 2018-11-15 | 2019-04-02 | 新华三信息安全技术有限公司 | A kind of performance indicator method for detecting abnormality and device |
-
2019
- 2019-04-24 CN CN201910335090.2A patent/CN110059013B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130159247A1 (en) * | 2011-12-14 | 2013-06-20 | Sap Ag | Change data capturing during an upgrade |
| US20160299832A1 (en) * | 2013-11-29 | 2016-10-13 | Gemalto Sa | Method for loading a native code on a secure element |
| CN103945442A (en) * | 2014-05-07 | 2014-07-23 | 东南大学 | System anomaly detection method based on linear prediction principle in mobile communication system |
| CN106980905A (en) * | 2017-03-15 | 2017-07-25 | 南方电网科学研究院有限责任公司 | Distribution network reliability Forecasting Methodology and system |
| CN108595669A (en) * | 2018-04-28 | 2018-09-28 | 国信优易数据有限公司 | A kind of unordered classified variable processing method and processing device |
| CN109241482A (en) * | 2018-08-28 | 2019-01-18 | 优视科技新加坡有限公司 | Determine that altering event issues successful method and device thereof |
| CN109492394A (en) * | 2018-10-25 | 2019-03-19 | 平安科技（深圳）有限公司 | The recognition methods of abnormal traffic request and terminal device |
| CN109558295A (en) * | 2018-11-15 | 2019-04-02 | 新华三信息安全技术有限公司 | A kind of performance indicator method for detecting abnormality and device |
Non-Patent Citations (2)
| Title |
|---|
| VEGARD FLOVIK: "How to use machine learning for anomaly detection and condition monitoring", HTTPS://TOWARDSDATASCIENCE.COM/HOW-TO-USE-MACHINE-LEARNING-FOR-ANOMALY-DETECTION-AND-CONDITION-MONITORING-6742F82900D7 * |
| 时之沙: "当我们在做数据异常分析时，我们在分析什么", HTTPS://WWW.WOSHIPM.COM/DATA-ANALYSIS/999413.HTML * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115599657A (en) * | 2022-12-15 | 2023-01-13 | 浪潮通信信息系统有限公司（Cn） | Software facility abnormity judgment method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110059013B (en) | 2023-06-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103392208A (en) | Semiconductor storage apparatus and method for controlling semiconductor storage apparatus | |
| CN102419577B (en) | For showing the method and device of process control equipment information | |
| CN109522175B (en) | Memory evaluation method and device | |
| CN101377748B (en) | Method for checking reading and writing functions of memory device | |
| CN106027691A (en) | Checking and correcting method for network card MAC (Media Access Control) address | |
| EP3361398B1 (en) | Engineering apparatus, engineering method, and program | |
| CN108875013A (en) | Handle the method and device of map datum | |
| CN110489259A (en) | A kind of memory failure detection method and equipment | |
| CN110213258A (en) | Abnormity monitoring method and device for vehicle CAN bus and computer equipment | |
| JP5539301B2 (en) | Logic drawing search device | |
| CN110059013A (en) | The determination method and device operated normally after software upgrading | |
| JP7167992B2 (en) | label correction device | |
| US20100299120A1 (en) | System and method for the combined acquisition of data for scada and simulation or network calculation applications | |
| CN116737515B (en) | Flash memory parameter visualization method, system and storage medium | |
| CN116579572A (en) | Maintenance time-consuming mechanical part spare part analysis method and device obeying normal distribution | |
| CN107341074A (en) | One kind upgrades abnormal restorative procedure, upgrading exception prosthetic device and intelligent terminal | |
| CN109032930A (en) | System detection method and device | |
| US8924180B2 (en) | Maintenance system and maintenance method | |
| KR102275635B1 (en) | Apparatus and method for detecting anomaly through function call pattern analysis | |
| CN1658198B (en) | Method for checking circuit arrangement | |
| CN108332779A (en) | A kind of number reading method and relevant apparatus of liquid column type instrument | |
| CN116244179B (en) | System firmware measuring method capable of self-improving | |
| CN108269004A (en) | Life of product analysis method and terminal device | |
| WO2023248373A1 (en) | Abnormality prediction device, abnormality prediction system, abnormality prediction method, and abnormality prediction program | |
| CN103268296B (en) | The information write-in method of E-token dynamic password card group |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |