SG11201909410VA - Machine learned decision guidance for alerts originating from monitoring systems - Google Patents

Abstract

CLIENT CLIENT CLIENT CLIENT COMPONENT 165 11111 \ -- PREDICTIONS A N.._ MODEL MODEL MODEL EVALUATION COMPONENT 1( N- FEATURE VECTOR 4 N FEATURE GENERATOR FEATURE GENERATOR FEATURE GENERATOR FEATURE GENERATION COMPONENT 135 1 - 5,,,_, ISSUE INFORMATION A 180 ? -----. FEEDBACK 4 ISSUE 1 STORAGE LAYER 4) 175 170 160 155 105 110 120 115 ISSUE MONITOR 145 140 MONITOR DATA FEEDING COMPONENT AUTOMATION LAB (12) INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) (19) World Intellectual Property Organization International Bureau (43) International Publication Date 01 November 2018 (01.11.2018) WIPO PCT omit VIII °nolo n OH voimiflo oimIE (10) International Publication Number WO 2018/200154 Al (51) International Patent Classification: GOOF 11/36 (2006.01) (21) International Application Number: PCT/US2018/026380 (22) International Filing Date: 06 April 2018 (06.04.2018) (25) Filing Language: English (26) Publication Language: English (30) Priority Data: 15/495,255 24 April 2017 (24.04.2017) US (71) Applicant: MICROSOFT TECHNOLOGY LI- CENSING, LLC [US/US]; One Microsoft Way, Redmond, Washington 98052-6399 (US). (72) Inventors: VIKJORD, Vidar V.; Microsoft Technology Licensing, LLC, One Microsoft Way, Redmond, Washing- ton 98052-6399 (US). KARLBERG, Jan-Ove; Microsoft Technology Licensing, LLC, One Microsoft Way, Red- mond, Washington 98052-6399 (US). (74) Agent: MINHAS, Sandip S. et al.; Microsoft Technology Licensing, LLC, One Microsoft Way, Redmond, Washing- ton 98052-6399 (US). (81) Designated States (unless otherwise indicated, for every kind of national protection available): AE, AG, AL, AM, AO, AT, AU, AZ, BA, BB, BG, BH, BN, BR, BW, BY, BZ, CA, CH, CL, CN, CO, CR, CU, CZ, DE, DJ, DK, DM, DO, DZ, EC, EE, EG, ES, FI, GB, GD, GE, GH, GM, GT, HN, HR, HU, ID, IL, IN, IR, IS, JO, JP, KE, KG, KH, KN, KP, KR, KW, KZ, LA, LC, LK, LR, LS, LU, LY, MA, MD, ME, MG, MK, MN, MW, MX, MY, MZ, NA, NG, NI, NO, NZ, OM, PA, PE, PG, PH, PL, PT, QA, RO, RS, RU, RW, SA, SC, SD, SE, SG, SK, SL, SM, ST, SV, SY, TH, TJ, TM, TN, TR, TT, TZ, UA, UG, US, UZ, VC, VN, ZA, ZM, ZW. (54) Title: MACHINE LEARNED DECISION GUIDANCE FOR ALERTS ORIGINATING FROM MONITORING SYSTEMS 125 115 130 1-1 FIG. 1 1-1 kr) (57) : Described herein is a system and method for determining whether a detected issue in a computing system is a bug introduced by a developer or an intermittent issue. When an issue is detected, information about the issue is received. A determination is then made as to whether the issue is a new issue or whether it has been previously detected. When it is determined that the issue is a new O O issue, information about the issue is stored in a storage device. A feature vector is generated for the issue and is analyzed to determine N a probability that the issue is a bug. When it is determined that the issue is a bug, the occurrence of the issue is reported to a user of the 00 system that can correct the bug. Once the bug is corrected, the correction is provided back to the system and is used to train the system. 1-1 O N C [Continued on next page] WO 2018/200154 Al MIDEDIMOMOIDEIRDERI001010111M1INHEMOVOIS (84) Designated States (unless otherwise indicated, for every kind of regional protection available): ARIPO (BW, GH, GM, KE, LR, LS, MW, MZ, NA, RW, SD, SL, ST, SZ, TZ, UG, ZM, ZW), Eurasian (AM, AZ, BY, KG, KZ, RU, TJ, TM), European (AL, AT, BE, BG, CH, CY, CZ, DE, DK, EE, ES, FI, FR, GB, GR, HR, HU, IE, IS, IT, LT, LU, LV, MC, MK, MT, NL, NO, PL, PT, RO, RS, SE, SI, SK, SM, TR), OAPI (BF, BJ, CF, CG, CI, CM, GA, GN, GQ, GW, KM, ML, MR, NE, SN, TD, TG). Declarations under Rule 4.17: as to applicant's entitlement to apply for and be granted a patent (Rule 4.17(ii)) as to the applicant's entitlement to claim the priority of the earlier application (Rule 4.17(iii)) Published: — with international search report (Art. 21(3))