CN114430823A - 软件知识捕捉方法、装置和系统 - Google Patents
软件知识捕捉方法、装置和系统 Download PDFInfo
- Publication number
- CN114430823A CN114430823A CN201980100741.8A CN201980100741A CN114430823A CN 114430823 A CN114430823 A CN 114430823A CN 201980100741 A CN201980100741 A CN 201980100741A CN 114430823 A CN114430823 A CN 114430823A
- Authority
- CN
- China
- Prior art keywords
- software
- event
- knowledge
- interface
- list
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 45
- 238000013507 mapping Methods 0.000 claims abstract description 17
- 238000007670 refining Methods 0.000 claims abstract description 9
- 238000004088 simulation Methods 0.000 claims description 26
- 230000006870 function Effects 0.000 claims description 24
- 238000012015 optical character recognition Methods 0.000 claims description 19
- 238000004422 calculation algorithm Methods 0.000 claims description 8
- 238000003709 image segmentation Methods 0.000 claims description 8
- 238000004590 computer program Methods 0.000 claims description 3
- 230000009471 action Effects 0.000 description 35
- 230000008569 process Effects 0.000 description 22
- 238000012545 processing Methods 0.000 description 11
- 239000000463 material Substances 0.000 description 9
- 238000010586 diagram Methods 0.000 description 6
- 230000033001 locomotion Effects 0.000 description 6
- 230000004044 response Effects 0.000 description 6
- 230000007246 mechanism Effects 0.000 description 5
- 239000012530 fluid Substances 0.000 description 4
- 238000004458 analytical method Methods 0.000 description 3
- 230000004807 localization Effects 0.000 description 3
- 238000006243 chemical reaction Methods 0.000 description 2
- 206010026749 Mania Diseases 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000003909 pattern recognition Methods 0.000 description 1
- 230000011218 segmentation Effects 0.000 description 1
- 230000008685 targeting Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
一种软件的知识捕捉方法，其中，包括如下步骤：S1，获取所述软件的截屏并进行基于该截屏执行目标及其像素坐标的识别，其中，所述目标包括所述截屏上的复数个功能区域、图标或文字，迭代执行步骤S1，以获取所述目标及其像素分别对应于X坐标轴和Y坐标轴上的最大值和最小值的列表并保存于第一数据库中，然后执行如下步骤：S2，在线捕捉软件操作装置上基于该软件的事件，将所述事件映射于所述列表中以获取该事件所对应的软件操作；S3，基于复数个软件操作提炼基于事件流的知识图谱，并保存于第二数据库中。上述方法速度快效率高，不会影响用户对软件的操作，并且适用于多种软件尤其是建模软件。
Description
PCT国内申请，说明书已公开。
Claims (15)
- PCT国内申请，权利要求书已公开。
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2019/116052 WO2021087818A1 (zh) | 2019-11-06 | 2019-11-06 | 软件知识捕捉方法、装置和系统 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114430823A true CN114430823A (zh) | 2022-05-03 |
Family
ID=75848215
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201980100741.8A Pending CN114430823A (zh) | 2019-11-06 | 2019-11-06 | 软件知识捕捉方法、装置和系统 |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN114430823A (zh) |
| WO (1) | WO2021087818A1 (zh) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116400907A (zh) * | 2023-06-08 | 2023-07-07 | 四川云申至诚科技有限公司 | 基于知识学习的程式自动编写方法、存储介质及装置 |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116400992B (zh) * | 2023-03-30 | 2024-09-10 | 张家界九一游网络科技有限公司 | 一种基于大数据的计算机控制管理系统及方法 |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050060719A1 (en) * | 2003-09-12 | 2005-03-17 | Useractive, Inc. | Capturing and processing user events on a computer system for recording and playback |
| CN105988924A (zh) * | 2015-02-10 | 2016-10-05 | 中国船舶工业综合技术经济研究院 | 一种非侵入式嵌入式软件图形用户界面自动化测试方法 |
| US9883035B1 (en) * | 2017-02-02 | 2018-01-30 | Conduent Business Services, Llc | Methods and systems for automatically recognizing actions in a call center environment using screen capture technology |
| CN109324864A (zh) * | 2018-10-24 | 2019-02-12 | 北京赢销通软件技术有限公司 | 一种人机交互操作信息的获取方法及装置 |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR100488685B1 (ko) * | 2002-08-22 | 2005-05-11 | 한국과학기술원 | 자동 영상등록 및 보정을 위한 영상 처리방법 |
| CN104268006B (zh) * | 2014-10-27 | 2017-10-10 | 北京奇虎科技有限公司 | 键鼠脚本的回放方法及装置 |
| CN108228421B (zh) * | 2017-12-26 | 2021-09-17 | 东软集团股份有限公司 | 数据监测方法、装置、计算机及存储介质 |
-
2019
- 2019-11-06 CN CN201980100741.8A patent/CN114430823A/zh active Pending
- 2019-11-06 WO PCT/CN2019/116052 patent/WO2021087818A1/zh active Application Filing
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050060719A1 (en) * | 2003-09-12 | 2005-03-17 | Useractive, Inc. | Capturing and processing user events on a computer system for recording and playback |
| CN105988924A (zh) * | 2015-02-10 | 2016-10-05 | 中国船舶工业综合技术经济研究院 | 一种非侵入式嵌入式软件图形用户界面自动化测试方法 |
| US9883035B1 (en) * | 2017-02-02 | 2018-01-30 | Conduent Business Services, Llc | Methods and systems for automatically recognizing actions in a call center environment using screen capture technology |
| CN109324864A (zh) * | 2018-10-24 | 2019-02-12 | 北京赢销通软件技术有限公司 | 一种人机交互操作信息的获取方法及装置 |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116400907A (zh) * | 2023-06-08 | 2023-07-07 | 四川云申至诚科技有限公司 | 基于知识学习的程式自动编写方法、存储介质及装置 |
| CN116400907B (zh) * | 2023-06-08 | 2024-02-02 | 四川云申至诚科技有限公司 | 基于知识学习的程式自动编写方法、存储介质及装置 |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2021087818A1 (zh) | 2021-05-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10354225B2 (en) | Method and system for process automation in computing | |
| US9836192B2 (en) | Identifying and displaying overlay markers for voice command user interface | |
| US7076713B1 (en) | Test generator for converting a model of computer component object behavior and stimulus values to test script | |
| JP2022514155A (ja) | ソフトウェアテスト | |
| US10740122B2 (en) | System module of simulating machine operation screen based on non-invasive data-extraction system | |
| CN113255614A (zh) | 一种基于视频分析的rpa流程自动生成方法与系统 | |
| CN111857470B (zh) | 一种生产设备的无人值守控制方法、装置和控制器 | |
| CN114430823A (zh) | 软件知识捕捉方法、装置和系统 | |
| CN114502971A (zh) | 用于提供自动化产品测试的电子产品测试系统 | |
| Jaganeshwari et al. | an Automated Testing Tool Based on Graphical User Interface With Exploratory Behavioural Analysis | |
| CN117573006B (zh) | 用于rpa屏幕界面元素批量拾取的方法及系统 | |
| JP2009134673A (ja) | Ｇｕｉ画面操作シーケンス検証装置、方法、及び、プログラム | |
| US20240168546A1 (en) | Identifying a Place of Interest on a Physical Object Through its 3D Model in Augmented Reality View | |
| US20230169399A1 (en) | System and methods for robotic process automation | |
| US12038832B2 (en) | Electronic product testing systems for providing automated product testing with human-in-the loop component and/or object detection | |
| WO2020124377A1 (zh) | 建模的知识获取方法、装置和系统 | |
| JP7517590B2 (ja) | 分類装置、分類方法、および、分類プログラム | |
| CN118245368A (zh) | 一种基于计算机视觉的gui软件自动化测试系统及方法 | |
| Schnur et al. | PIA-a concept for a personal information assistant for data analysis and machine learning of time-continuous data in industrial applications | |
| US20240184692A1 (en) | Software testing | |
| Barham et al. | Towards LLMCI-Multimodal AI for LLM-Vision UI Operation | |
| CN117877048A (zh) | 一种流程画面校验方法、装置、电子设备和可读存储介质 | |
| Frisini et al. | Technology concept of an automated system for integration testing | |
| Cho et al. | CAAP: Context-Aware Action Planning Prompting to Solve Computer Tasks with Front-End UI Only | |
| CN118503100A (zh) | 一种基于图像识别技术的跨平台测试系统、方法及程序产品 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20220503 |