CN108363665A - A kind of CMS novel maintenances diagnostic system and method based on high in the clouds - Google Patents

A kind of CMS novel maintenances diagnostic system and method based on high in the clouds Download PDF

Info

Publication number
CN108363665A
CN108363665A CN201810131459.3A CN201810131459A CN108363665A CN 108363665 A CN108363665 A CN 108363665A CN 201810131459 A CN201810131459 A CN 201810131459A CN 108363665 A CN108363665 A CN 108363665A
Authority
CN
China
Prior art keywords
case
cms
library
label
item
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201810131459.3A
Other languages
Chinese (zh)
Inventor
李传咏
赵莉
卢颖
陈宁
左帅
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Xi'an Boda Software Ltd By Share Ltd
Original Assignee
Xi'an Boda Software Ltd By Share Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Xi'an Boda Software Ltd By Share Ltd filed Critical Xi'an Boda Software Ltd By Share Ltd
Priority to CN201810131459.3A priority Critical patent/CN108363665A/en
Publication of CN108363665A publication Critical patent/CN108363665A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/36Preventing errors by testing or debugging software
    • G06F11/362Software debugging
    • G06F11/366Software debugging using diagnostics
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/36Preventing errors by testing or debugging software
    • G06F11/3668Software testing
    • G06F11/3672Test management
    • G06F11/3688Test management for test execution, e.g. scheduling of test suites

Abstract

A kind of CMS novel maintenance systems based on high in the clouds, including use-case retrieve module, diagnosis use-case library, and characteristic extracting module diagnoses computing module, reference characteristic library, patch library, intelligent repair module, label correction module;Its method includes the following steps:According to CMS, phenomenon retrieves corresponding use-case in diagnosis use-case library the problem of using or encountering;Characteristic extracting module extracts CMS the characteristic value for the diagnosis item that current use-case includes, composition characteristic vector;Diagnosing computing module, the corresponding reference characteristic in reference characteristic library is vectorial with current use-case by calculating feature vector, and the characteristic value in vector is compared with the threshold value being set in advance and confirms abnormal diagnosis item;Corresponding patch is matched to according to exception item in patch library to repair CMS automatically;Label correction module adjusts use-case label by repairing the measurement of result;It is diagnosed and is repaired by real time remote, make non-technical personnel also can timely processing problem.

Description

A kind of CMS novel maintenances diagnostic system and method based on high in the clouds
Technical field
The invention belongs to the O&M diagnostic techniques field of computer system, more particularly to a kind of CMS based on high in the clouds is long-range O&M diagnostic system and method.
Background technology
CMS (Content Management System) is chiefly used in the informatization and electronic government affairs of government, colleges and universities and enterprise.With Family is more demanding to the stable operation of system, and can have some in use or operational process because of server running environment, people The problem of causing for operation, compatibility, data exchange etc..
Such issues that layman can not solve, professional are also required to gradually investigate problem in assessment and diagnosis, It is higher to treatment people technology and skill requirement, cause process problem difficulty big, not in time.
Existing technology is confined to the remotely monitor to system running environment and push, and disadvantage is a lack of online to problem reality When diagnose and repair.
Invention content
To overcome above-mentioned the deficiencies in the prior art, the purpose of the present invention is to provide a kind of CMS based on high in the clouds remotely to transport Tie up diagnostic system, have the characteristics that conducive to it is more efficient, more acurrate, more efficiently handling failure and solve the problems, such as.
To achieve the above object, the technical solution adopted by the present invention is:A kind of CMS novel maintenances diagnosis system based on high in the clouds System, which is characterized in that include use-case retrieval module, diagnosis use-case library, reference characteristic library, characteristic extracting module, diagnosis calculating Module, patch library, intelligent repair module, label correction module;
Use-case retrieves module 1, for retrieving the use-case for needing to diagnose;
Use-case library 2 is diagnosed, for storing use-case;
Reference characteristic library 3 is to provide source for the predefined reference characteristic vector of each use-case for diagnosis computing module 5 Data;
Characteristic extracting module 4, extraction use-case include each diagnose item characteristic value, further obtain feature vector, Source data is provided for diagnosis computing module 5;
Computing module 5 is diagnosed, the data in reference characteristic library 3 and the offer of characteristic extracting module 4 are provided, judges to examine by calculating Whether disconnected item is abnormal;
Patch library 6, for storing the corresponding patch of each diagnosis item;
Intelligent repair module 7 repairs CMS according to the patch in patch library 6 automatically;
Label correction module 8 is corrected use-case label in diagnosis use-case library 1.
The diagnosis use-case library 2 and the resource of reference characteristic library 3 and patch library 6 are both needed to predefine, and are deposited using cloud Storage, the use-case that all CMS are generated can be shared, and reusability of resources is improved.
The characteristic extracting module 4 carries out the acquisition of data to CMS run-time environments by diagnosing item, analyzes, carries Take feature.
The described diagnosis computing module 5 pass through calculate the feature vector of extract real-time with after reference characteristic vector, and in advance The threshold value set is compared, and confirms abnormal diagnosis item.
The intelligent repair module 7 be directed in CMS can change in range according to predefined algorithm routine in patch into Row is automatic to be repaired.
The use-case includes label and several diagnosis items, and wherein label is the keyword described to problematic phenomenon, diagnosis Item induces the mistake including configuration file, server hardware environmental parameter, net of the problem to induce a reason of the problem Network environment, third party device intercept, the bug of CMS codes, and corresponding each diagnosis item includes separate feature extraction journey Sequence.
A kind of CMS novel maintenance diagnostic methods based on high in the clouds, include the following steps:
Step 1, the label in the request of extraction CMS ends, calculate label in diagnosis use-case library all use-case labels it is similar Degree confirms the use-case for needing to diagnose according to similarity descending sort;
Step 2, CMS executes the feature extraction program extraction characteristic value of diagnosis item, composition characteristic vector;
Step 3, calculate step 2 feature vector and the corresponding reference characteristic vector in reference characteristic library difference, compare to Each characteristic value and pre-set threshold value (θ in amounti), confirm exception item;
Step 4, intelligent repair module is matched to the corresponding patch of exception item according to exception item in patch library, is repaiied intelligently Algorithm routine in patch is executed in multiple module, carry out automatic repair to CMS system is repaired automatically;
Step 5, according to the automatic label for repairing the current use-case of calibration of the output results.
The label in extraction CMS requests described in step 1 is using segmenter by cloud computing to the description in request Information is segmented, and keyword, that is, label is extracted, and the similarity between use-case is calculated using Method of Cosine, and a large amount of use-case is pressed phase Like degree descending sort so that faster, more accurately navigate to the use-case for needing to diagnose.
CMS extracts the extraction procedure for the characteristic value that item is each diagnosed in use-case in step 2, using asynchronous execution schema extraction The characteristic value of corresponding diagnosis item, prevents holding for some other feature extraction program of feature extraction program occlusive effects in CMS environment Row.
When two kinds whether the result that diagnosis item needs detect in step 3 being only, corresponding characteristic value is identified with 0,1, Corresponding threshold θ is 0.
When being repaired automatically to CMS according to algorithm routine in step 4, only for being repaired in the revisable range of program;
For successful use-case is repaired in step 5, take example label and step 1 in the union of label extracted, make For the new label of the use-case, the accuracy of retrieval is improved.
The beneficial effects of the invention are as follows:
Compared with prior art, the present invention has the following advantages:
1) it accurate lock and can repair, traditional CMS is mostly after encountering problems to be upgraded more in a manner of version iteration etc. Newly, change amplitude is big, and it is a whole updating that the problem of being brought for CMS, which is for he, has in CMS and is much customized for user Part, upgrading update mode traditional in this way is less applicable, may bring conflict, compatibling problem.The present invention is needle The detection and reparation that part is carried out to the particular problem encountered in CMS system use and operational process, compared to mode before It is more accurate, flexible and rapid.
2) learning cost is reduced, all methods described in the present invention are all based on processing side automatically or semi-automatically Formula, using only needing that processing mode is selected to can be solved problem, learning cost levels off to zero.
3) time cost is saved.In traditional settling mode, user can be seeked advice from by service calls, and customer service reinforms engineering Teacher is handled, and in the process, wastes a large amount of time for linking up.The detection of the present invention and repair mechanism, can effectively, quickly Processing FAQs.
The method of O&M using the present invention and diagnosis is conducive to more efficient, more acurrate, more efficiently handling failure reconciliation Certainly problem.
Description of the drawings
Fig. 1 is the system principle diagram of the present invention.
Fig. 2 is the flow chart of the method for the present invention.
Specific implementation mode
Invention is further described in detail with reference to the accompanying drawings and examples.
As shown in Figure 1, the CMS novel maintenance diagnostic systems based on high in the clouds, include use-case retrieval module 1, diagnose use-case Library 2, reference characteristic library 3, characteristic extracting module 4 diagnose computing module 5, intelligent repair module 6, patch library 7, label straightening die Block 8;
The use-case retrieves module 1, for retrieving the use-case for needing to diagnose in diagnosis use-case library, with feature extraction Module input links;The CMS requests received by webservice, and solicited message is analyzed, in diagnosis use-case Corresponding use-case is retrieved in library, specifically includes stop words, the function word for including in removal information, and label is extracted using segmenter, Label is converted into vector and then calculates the similarity with use-case in diagnosis use-case library, and presses similarity descending sort;
The diagnosis use-case library 2, for storing various use-cases;Due to the label warp of use-case in diagnosis use-case library It crosses gradually accumulation to increase, Deta sparseness is strong after making current label converting vector, therefore the similarity between use-case uses Method of Cosine It calculates;
Reference characteristic library 3 is to provide source for the predefined reference characteristic vector of each use-case for diagnosis computing module 5 Data;The reference characteristic library is used to store the reference characteristic value and threshold value corresponding to diagnosis item.The reference characteristic value It is corresponded with threshold value and diagnosis item, what the initial value of the reference characteristic value and threshold value had been predefined in advance by technical staff.
The characteristic extracting module 4 is responsible for each diagnosing the characteristic value of item in extract real-time use-case, further obtains spy Sign vector provides source data for diagnosis computing module;Characteristic extracting module 4 is carried according to the pre-defined feature of item is diagnosed in use-case The characteristic value of each diagnosis item in program fetch extract real-time to CMS, and then obtain feature vector.
The difference that computing module 5 calculates the feature vector and reference characteristic vector of extraction is diagnosed, will be greater than being set in advance Threshold θiCorresponding diagnosis item is labeled as abnormal;The diagnosis computing module receives reference characteristic library 3 and characteristic extracting module 4 The data of offer judge whether diagnosis item is abnormal, after diagnosis computing module is according to characteristic extracting module collection analysis by calculating The data in data and reference characteristic library calculate abnormal diagnosis item.
Patch library 6 provides source data for storing the corresponding patch of diagnosis item, for intelligence repair module;Patch is to examining The algorithm repair procedure of disconnected item, each patch correspond to a diagnosis item, for some diagnosis items, can not be changed in range in program Only notify administrator.
Intelligent repair module 7 is repaired automatically according to the program in patch;For abnormal diagnosis item, closed according to mapping It ties up to patch library and is matched to corresponding patch, the algorithm routine executed in patch repairs CMS automatically.
The use-case includes label and several diagnosis items, and wherein label is the keyword described to problematic phenomenon, diagnoses item To further include the mistake of configuration file the reason of inducing a reason of the problem, induce the problem, server hardware environment ginseng Several is not inconsistent, the bug etc. of code, and corresponding each diagnosis item includes separate feature extraction program.
Label correction module 8 carries out school according to the measurement for diagnosing and repairing result, to use-case label in diagnosis use-case library 1 Just, the adjustment of adaptation is made to use-case label.Label correction module be responsible for repairs successfully, by retrieve module extract label and The use-case label of Current Diagnostic takes the label that union must be new as the use-case;
The diagnosis use-case library 2 and the resource of reference characteristic library 3 and patch library 6 are both needed to predefine, and are deposited using cloud Storage, the use-case that all CMS are generated can be shared, and reusability of resources is improved.
Referring to Fig. 2, the CMS novel maintenance diagnostic methods based on high in the clouds of the embodiment of the present invention, including:
Step 1, the label W (ω of information described in the request of the ends extraction CMS12,…,ωp), it obtains in diagnosis use-case library The label of use-caseTake W withUnion obtain W'(ω1',ω2',…,ωr'), there is max { p, q } accordingly ≤ r converts W to 01 vector P (p of r dimensions1,p2,…,pr), if wherein wi' ∈ W, then pi=1, otherwise pi=0, similarly willIt is converted into 01 vectors of r dimensionsThen use Method of Cosine calculate vector P andSimilarityAnd the use-case for needing to diagnose is confirmed by similarity descending sort;
This step segments use-case using segmenter by cloud computing, extracts label, is calculated using Method of Cosine similar A large amount of use-case is pressed similarity descending sort so that faster, more accurately navigate to the use-case for needing to diagnose by degree;
Step 2, the ends CMS confirm the use-case for needing to diagnose, and the characteristic value that item is each diagnosed in use-case, group are extracted for CMS At feature vector, and the feature extraction program for executing each diagnosis item extracts characteristic value, obtains feature vector ζ (λ12,…,λn);
According to the feature extraction program of multiple diagnosis items in use-case in this step, using asynchronous execution schema extraction CMS rings The characteristic value of corresponding diagnosis item in border prevents the execution of other feature extraction programs of some feature extraction program occlusive effects;
Step 3, feature vector ζ (λ are calculated12,…,λn) vectorial with the corresponding reference characteristic in reference characteristic libraryPoor ζ ' (λ '1,λ'2,…,λ'n), by λ ' in ζ 'iMore than the threshold θ defined in advanceiCorresponding diagnosis item Labeled as exception item;
When two kinds whether the result that diagnosis item needs detect in this step being only, corresponding characteristic value is identified with 0,1, Corresponding threshold θ is 0;
Step 4, intelligent repair module finds patch and according in patch according to exception item in patch library mapping relations Algorithm routine repairs CMS system automatically;For that can change in range, the ends parsing CMS text file, modification text Wrong position in this, for range can not be changed, such as server disk read-write, firewall policy, network environment, third party system System, only notifies administrator;
When being repaired automatically to CMS according to algorithm routine in this step, only for being repaired in the revisable range of program;
Step 5, according to calibration of the output results use-case label is repaired, to repairing successful use-case, the W' that will be obtained in step 1 (ω1',ω2',…,ωr') label new as example is used instead.
For successful use-case is repaired in this step, take example label and step S1 in the union of label extracted, As the new label of the use-case, the accuracy of retrieval is improved.

Claims (10)

1. a kind of CMS novel maintenance diagnostic systems based on high in the clouds, which is characterized in that include:
Use-case retrieves module(1), for retrieving the use-case for needing to diagnose;
Diagnose use-case library(2), for storing use-case;
Reference characteristic library(3), it is for the predefined reference characteristic vector of each use-case, to diagnose computing module(5)Offer source Data;
Characteristic extracting module(4), extraction use-case include each diagnose item characteristic value, further obtain feature vector, be Diagnose computing module(5)Source data is provided;
Diagnose computing module(5), receive reference characteristic library(3)And characteristic extracting module(4)The data of offer are judged by calculating Whether abnormal diagnose item;
Patch library(6), for storing the corresponding patch of each diagnosis item;
Intelligent repair module(7), according to patch library(6)In patch CMS is repaired automatically;
Label correction module(8), to diagnosis use-case library(1)Middle use-case label is corrected.
2. a kind of CMS novel maintenance diagnostic systems based on high in the clouds as described in claim 1, which is characterized in that described examines Disconnected use-case library(2)With reference characteristic library(3)And patch library(6)Content be both needed to predefine, and use cloud storage, all CMS The use-case of generation can be shared, and reusability of resources is improved.
3. a kind of CMS novel maintenance diagnostic systems based on high in the clouds as described in claim 1, which is characterized in that the spy Levy extraction module(4)The acquisition, analysis, extraction feature of data are carried out to CMS run-time environments by diagnosing item.
4. a kind of CMS novel maintenance diagnostic systems based on high in the clouds as described in claim 1, which is characterized in that described examines Disconnected computing module(5)After feature vector and reference characteristic vector by calculating extract real-time, with the threshold value that has been set in advance into Row compares, and confirms abnormal diagnosis item.
5. a kind of CMS novel maintenance diagnostic systems based on high in the clouds as claimed in claim 2, which is characterized in that the use Example includes label and several diagnosis items, and wherein label is the keyword described to problematic phenomenon, and diagnosis item is to induce the problem One reason;The reason of inducing the problem further includes the mistake of configuration file, server hardware environmental parameter, network environment, Three method, apparatus intercept, the bug of CMS codes, and corresponding each diagnosis item includes separate feature extraction program.
6. a kind of CMS novel maintenance diagnostic methods based on high in the clouds, which is characterized in that include the following steps:
Step 1, the label in extraction CMS requests, calculates label and diagnoses the similarity of all use-case labels in use-case library, according to Similarity descending sort confirms the use-case for needing to diagnose;
Step 2, CMS executes the feature extraction program that item is each diagnosed in use-case, obtains characteristic value, composition characteristic vector;
Step 3, the difference for calculating the feature vector and the corresponding reference characteristic vector in reference characteristic library of step 2, in more vectorial Each characteristic value and pre-set threshold value, confirm exception item;
Step 4, intelligent repair module is matched to the corresponding patch of exception item for exception item in patch library, is intelligently repairing mould The algorithm routine in patch is executed in block, and CMS system is repaired automatically;
Step 5, according to the label for repairing the current use-case of calibration of the output results.
7. a kind of CMS novel maintenance diagnostic methods based on high in the clouds according to claim 6, which is characterized in that in step 1 Label in the extraction CMS requests, is to be segmented to the description information in request using segmenter by cloud computing, carried Keyword i.e. label is taken, the similarity between use-case is calculated using Method of Cosine.
8. a kind of CMS novel maintenance diagnostic methods based on high in the clouds according to claim 6, which is characterized in that in step 2 CMS extraction use-case in each diagnose item characteristic value extraction procedure, using in asynchronous execution schema extraction CMS environment to seing patients The characteristic value of disconnected item prevents the execution of other feature extraction programs of some feature extraction program occlusive effects.
9. a kind of CMS novel maintenance diagnostic methods based on high in the clouds according to claim 6, which is characterized in that in step 3 When the result of corresponding characteristic value is two kinds of situations whether being, corresponding characteristic value is identified with 0,1, corresponding threshold valueIt is 0.
10. a kind of CMS novel maintenance diagnostic methods based on high in the clouds according to claim 6, which is characterized in that step 5 In for successful use-case is repaired, take example label and step 1 in the union of label extracted, as the new of the use-case Label improves the accuracy of retrieval.
CN201810131459.3A 2018-02-09 2018-02-09 A kind of CMS novel maintenances diagnostic system and method based on high in the clouds Pending CN108363665A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810131459.3A CN108363665A (en) 2018-02-09 2018-02-09 A kind of CMS novel maintenances diagnostic system and method based on high in the clouds

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810131459.3A CN108363665A (en) 2018-02-09 2018-02-09 A kind of CMS novel maintenances diagnostic system and method based on high in the clouds

Publications (1)

Publication Number Publication Date
CN108363665A true CN108363665A (en) 2018-08-03

Family

ID=63005317

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810131459.3A Pending CN108363665A (en) 2018-02-09 2018-02-09 A kind of CMS novel maintenances diagnostic system and method based on high in the clouds

Country Status (1)

Country Link
CN (1) CN108363665A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109697267A (en) * 2018-12-12 2019-04-30 西安四叶草信息技术有限公司 CMS recognition methods and device
CN111046390A (en) * 2019-07-12 2020-04-21 哈尔滨安天科技集团股份有限公司 Cooperative defense patch protection method and device and storage equipment
CN112269796A (en) * 2020-10-23 2021-01-26 北京浪潮数据技术有限公司 Data retrieval method and related device
US11269901B2 (en) 2020-01-16 2022-03-08 International Business Machines Corporation Cognitive test advisor facility for identifying test repair actions

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW200846901A (en) * 2007-05-16 2008-12-01 Inventec Corp Method for diagnosing system abnormality
CN105610647A (en) * 2015-12-30 2016-05-25 华为技术有限公司 Service abnormity detection method and server
CN105740140A (en) * 2014-12-10 2016-07-06 中兴通讯股份有限公司 Software system failure diagnosis method, server and system
CN107516414A (en) * 2017-08-21 2017-12-26 中国电力科学研究院 A kind of power information acquisition system Analysis on Fault Diagnosis method and system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW200846901A (en) * 2007-05-16 2008-12-01 Inventec Corp Method for diagnosing system abnormality
CN105740140A (en) * 2014-12-10 2016-07-06 中兴通讯股份有限公司 Software system failure diagnosis method, server and system
CN105610647A (en) * 2015-12-30 2016-05-25 华为技术有限公司 Service abnormity detection method and server
CN107516414A (en) * 2017-08-21 2017-12-26 中国电力科学研究院 A kind of power information acquisition system Analysis on Fault Diagnosis method and system

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109697267A (en) * 2018-12-12 2019-04-30 西安四叶草信息技术有限公司 CMS recognition methods and device
CN109697267B (en) * 2018-12-12 2021-02-23 西安四叶草信息技术有限公司 CMS (content management system) identification method and device
CN111046390A (en) * 2019-07-12 2020-04-21 哈尔滨安天科技集团股份有限公司 Cooperative defense patch protection method and device and storage equipment
CN111046390B (en) * 2019-07-12 2023-07-07 安天科技集团股份有限公司 Collaborative defense patch protection method and device and storage equipment
US11269901B2 (en) 2020-01-16 2022-03-08 International Business Machines Corporation Cognitive test advisor facility for identifying test repair actions
CN112269796A (en) * 2020-10-23 2021-01-26 北京浪潮数据技术有限公司 Data retrieval method and related device
CN112269796B (en) * 2020-10-23 2023-12-22 北京浪潮数据技术有限公司 Data retrieval method and related device

Similar Documents

Publication Publication Date Title
CN108363665A (en) A kind of CMS novel maintenances diagnostic system and method based on high in the clouds
US9542255B2 (en) Troubleshooting based on log similarity
US11562304B2 (en) Preventative diagnosis prediction and solution determination of future event using internet of things and artificial intelligence
US9436540B2 (en) Automated diagnosis of software crashes
CN106933728B (en) Method and device for measuring association between requirement and use case
CN109522192B (en) Prediction method based on knowledge graph and complex network combination
US20190108223A1 (en) Automated system data migration
CN111143226B (en) Automatic test method and device, computer readable storage medium and electronic equipment
US20210311860A1 (en) Intelligent application scenario testing and error detection
CN115827895A (en) Vulnerability knowledge graph processing method, device, equipment and medium
CN111930597A (en) Log anomaly detection method based on transfer learning
US11605010B1 (en) Computer incident scoring
CN113032257B (en) Automated testing method, apparatus, computer system, and readable storage medium
CN112068981B (en) Knowledge base-based fault scanning recovery method and system in Linux operating system
CN106874203B (en) A kind of defect positioning method based on the analysis of defect report text subject
CN110795259A (en) Method and device for analyzing application collapse
EP3082085A1 (en) Methods and systems for adaptive and contextual collaboraiton in a network
US10817396B2 (en) Recognition of operational elements by fingerprint in an application performance management system
US6389370B1 (en) System and method for determining which objects in a set of objects should be processed
Grigoriou et al. Report on evaluation experiments using different machine learning techniques for defect prediction.
Xu et al. A Method of Component Prediction for Crash Bug Reports Using Component-Based Features and Machine Learning
US10628395B2 (en) Database comparison system
CN114722061B (en) Data processing method and device, equipment and computer readable storage medium
US20230297494A1 (en) Automatic metamorphic testing
US11599801B2 (en) Method for solving problem, computing system and program product

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20180803

RJ01 Rejection of invention patent application after publication