JP2024511391A - 自律的なネットワークテストケース生成のための方法、システム、およびコンピュータ読取可能媒体 - Google Patents
自律的なネットワークテストケース生成のための方法、システム、およびコンピュータ読取可能媒体 Download PDFInfo
- Publication number
- JP2024511391A JP2024511391A JP2023557165A JP2023557165A JP2024511391A JP 2024511391 A JP2024511391 A JP 2024511391A JP 2023557165 A JP2023557165 A JP 2023557165A JP 2023557165 A JP2023557165 A JP 2023557165A JP 2024511391 A JP2024511391 A JP 2024511391A
- Authority
- JP
- Japan
- Prior art keywords
- network
- case
- test case
- failure
- test
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/50—Testing arrangements
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N20/00—Machine learning
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/06—Management of faults, events, alarms or notifications
- H04L41/0631—Management of faults, events, alarms or notifications using root cause analysis; using analysis of correlation between notifications, alarms or events based on decision criteria, e.g. hierarchy, tree or time analysis
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/08—Configuration management of networks or network elements
- H04L41/0876—Aspects of the degree of configuration automation
- H04L41/0886—Fully automatic configuration
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/06—Generation of reports
- H04L43/062—Generation of reports related to network traffic
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/06—Management of faults, events, alarms or notifications
- H04L41/069—Management of faults, events, alarms or notifications using logs of notifications; Post-processing of notifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/16—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks using machine learning or artificial intelligence
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/04—Processing captured monitoring data, e.g. for logfile generation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/20—Arrangements for monitoring or testing data switching networks the monitoring system or the monitored elements being virtualised, abstracted or software-defined entities, e.g. SDN or NFV
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Software Systems (AREA)
- Data Mining & Analysis (AREA)
- Theoretical Computer Science (AREA)
- Artificial Intelligence (AREA)
- Medical Informatics (AREA)
- Evolutionary Computation (AREA)
- Physics & Mathematics (AREA)
- Computing Systems (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Mathematical Physics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Automation & Control Theory (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US17/207,393 US11533247B2 (en) | 2021-03-19 | 2021-03-19 | Methods, systems, and computer readable media for autonomous network test case generation |
| US17/207,393 | 2021-03-19 | ||
| PCT/US2022/020182 WO2022197604A1 (en) | 2021-03-19 | 2022-03-14 | Methods, systems, and computer readable media for autonomous network test case generation |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| JP2024511391A true JP2024511391A (ja) | 2024-03-13 |
| JP2024511391A5 JP2024511391A5 (enExample) | 2024-11-06 |
Family
ID=81326011
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| JP2023557165A Pending JP2024511391A (ja) | 2021-03-19 | 2022-03-14 | 自律的なネットワークテストケース生成のための方法、システム、およびコンピュータ読取可能媒体 |
Country Status (5)
| Country | Link |
|---|---|
| US (1) | US11533247B2 (enExample) |
| EP (1) | EP4309348B1 (enExample) |
| JP (1) | JP2024511391A (enExample) |
| CN (1) | CN117242754A (enExample) |
| WO (1) | WO2022197604A1 (enExample) |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11570068B1 (en) * | 2021-12-28 | 2023-01-31 | Rakuten Mobile, Inc. | User-defined network congestion monitoring system |
| US12009983B1 (en) * | 2022-12-13 | 2024-06-11 | At&T Intellectual Property I, L.P. | Automatically configuring network elements in multi-vendor and multi-domain topologies |
| US20240378557A1 (en) * | 2023-05-10 | 2024-11-14 | Dish Network L.L.C. | Digital document and network management (ddms) |
| US12481570B2 (en) | 2023-05-12 | 2025-11-25 | Keysight Technologies, Inc. | Methods, systems, and computer readable media for network testing and collecting generative artificial intelligence training data |
| US12476721B2 (en) * | 2023-05-30 | 2025-11-18 | T-Mobile Usa, Inc. | Generating a test case associated with a test radio access network (RAN) based on key performance indicators associated with a production ran of a wireless telecommunication network |
| US12273255B1 (en) * | 2023-10-02 | 2025-04-08 | Amazon Technologies, Inc. | Adaptive testing service that generates test cases from observed behaviors |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140325278A1 (en) * | 2013-04-25 | 2014-10-30 | Verizon Patent And Licensing Inc. | Method and system for interactive and automated testing between deployed and test environments |
| US20190173761A1 (en) * | 2017-12-01 | 2019-06-06 | Cisco Technology, Inc. | Automated and adaptive generation of test stimuli for a network or system |
Family Cites Families (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6415396B1 (en) * | 1999-03-26 | 2002-07-02 | Lucent Technologies Inc. | Automatic generation and maintenance of regression test cases from requirements |
| WO2002056541A2 (en) | 2000-10-27 | 2002-07-18 | Tekelec Us | Methods and systems for testing comminications network components |
| US6883119B1 (en) * | 2001-11-05 | 2005-04-19 | At&T Corp. | Methods of proactive network maintenance by automatic creation of trouble tickets |
| US7844861B2 (en) * | 2006-11-27 | 2010-11-30 | Red Hat, Inc. | Automatic generation of test cases from error data |
| CN102111801B (zh) | 2010-12-23 | 2013-08-21 | 北京宜富泰网络测试实验室有限公司 | 第三代移动通信网网络管理接口的测试方法及系统 |
| US9047414B1 (en) * | 2011-03-15 | 2015-06-02 | Symantec Corporation | Method and apparatus for generating automated test case scripts from natural language test cases |
| JP6349935B2 (ja) | 2014-05-08 | 2018-07-04 | 日本電気株式会社 | 自動試験シナリオ作成装置、自動試験シナリオ作成方法及びプログラム |
| US10261851B2 (en) | 2015-01-23 | 2019-04-16 | Lightbend, Inc. | Anomaly detection using circumstance-specific detectors |
| US10938687B2 (en) * | 2017-03-29 | 2021-03-02 | Accenture Global Solutions Limited | Enabling device under test conferencing via a collaboration platform |
| CN107908549A (zh) * | 2017-10-24 | 2018-04-13 | 北京小米移动软件有限公司 | 测试用例生成方法、装置及计算机可读存储介质 |
| US10673733B2 (en) * | 2018-01-20 | 2020-06-02 | Hcl Technologies Limited | System for debugging a network environment |
| US20190361759A1 (en) * | 2018-05-22 | 2019-11-28 | At&T Intellectual Property I, L.P. | System and method to identify failed points of network impacts in real time |
| US10771363B2 (en) * | 2018-05-31 | 2020-09-08 | Juniper Networks, Inc. | Devices for analyzing and mitigating dropped packets |
| KR20200046415A (ko) | 2018-10-24 | 2020-05-07 | 주식회사 케이티 | 네트워크 슬라이스 품질 테스트 방법 및 그 시스템 |
| CN110048904B (zh) | 2019-03-25 | 2021-03-23 | 北京天地互连信息技术有限公司 | 一种针对5g核心网中用户平面功能网元的测试系统和方法 |
| CN111193640B (zh) * | 2019-12-26 | 2021-07-13 | 西安交通大学 | 采用策略分解和符号执行的有状态数据平面故障检测方法 |
| CN111209195B (zh) * | 2019-12-30 | 2023-08-15 | 瑞庭网络技术(上海)有限公司 | 一种生成测试用例的方法及装置 |
| US11595288B2 (en) * | 2020-06-22 | 2023-02-28 | T-Mobile Usa, Inc. | Predicting and resolving issues within a telecommunication network |
-
2021
- 2021-03-19 US US17/207,393 patent/US11533247B2/en active Active
-
2022
- 2022-03-14 CN CN202280030708.4A patent/CN117242754A/zh active Pending
- 2022-03-14 JP JP2023557165A patent/JP2024511391A/ja active Pending
- 2022-03-14 WO PCT/US2022/020182 patent/WO2022197604A1/en not_active Ceased
- 2022-03-14 EP EP22717044.6A patent/EP4309348B1/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140325278A1 (en) * | 2013-04-25 | 2014-10-30 | Verizon Patent And Licensing Inc. | Method and system for interactive and automated testing between deployed and test environments |
| US20190173761A1 (en) * | 2017-12-01 | 2019-06-06 | Cisco Technology, Inc. | Automated and adaptive generation of test stimuli for a network or system |
Also Published As
| Publication number | Publication date |
|---|---|
| EP4309348A1 (en) | 2024-01-24 |
| WO2022197604A1 (en) | 2022-09-22 |
| EP4309348B1 (en) | 2026-01-14 |
| US11533247B2 (en) | 2022-12-20 |
| CN117242754A (zh) | 2023-12-15 |
| US20220303206A1 (en) | 2022-09-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP2024511391A (ja) | 自律的なネットワークテストケース生成のための方法、システム、およびコンピュータ読取可能媒体 | |
| US12316523B2 (en) | Cellular network chaos testing | |
| US11838172B2 (en) | Identifying root cause of failures through detection of network scope failures | |
| US12511186B2 (en) | Using user equipment data clusters and spatial temporal graphs of abnormalities for root cause analysis | |
| US20230267326A1 (en) | Machine Learning Model Management Method and Apparatus, and System | |
| US20230396485A1 (en) | Network management actions based on access point classification | |
| US10187272B2 (en) | Interface management service entity, function service entity, and element management method | |
| CN113709777B (zh) | 一种故障处理方法、装置及系统 | |
| US12531773B2 (en) | Root cause analysis | |
| KR102927496B1 (ko) | 통신 네트워크에서 복수의 원격 무선 헤드들을 관리하기 위한 방법 및 장치 | |
| US20230388819A1 (en) | Automatic upgrade planning | |
| US12549431B1 (en) | Conversational assistant for obtaining network information | |
| JP2025505637A (ja) | エアインターフェースプロトコルのセキュリティホールの発見方法、装置及び移動端末 | |
| CN115866634B (zh) | 一种网络性能异常分析方法、装置及可读存储介质 | |
| GB2632329A (en) | Coordinating cross-domain and specific domain management data analytics | |
| García‐Rois et al. | Evaluating management and orchestration impact on closed‐loop orchestration delay | |
| CN112075056A (zh) | 用于测试网络服务的方法 | |
| Kang et al. | OMA DM‐based remote software fault management for mobile devices | |
| Alcalde Cespedes | Log-based monitoring, detection and automated correction of anomalies in the 5G Core | |
| Gao et al. | Evaluating 5G-Enabled Medical Devices: Failure Modes Analysis and Graph Database Implementation | |
| WO2024230375A1 (zh) | 评估信息确定方法及相关系统、存储介质 | |
| WO2026039031A1 (en) | Application programming interface (api) for configuration management (cm) in open radio access network (o-ran) | |
| CN118057870A (zh) | 性能统计模块功能的测试方法、装置、设备及存储介质 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20241028 |
|
| A621 | Written request for application examination |
Free format text: JAPANESE INTERMEDIATE CODE: A621 Effective date: 20241028 |
|
| A977 | Report on retrieval |
Free format text: JAPANESE INTERMEDIATE CODE: A971007 Effective date: 20251015 |
|
| A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20251202 |
|
| A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20260217 |