CN104246696B - 基于图像的应用自动化 - Google Patents
基于图像的应用自动化 Download PDFInfo
- Publication number
- CN104246696B CN104246696B CN201280068226.4A CN201280068226A CN104246696B CN 104246696 B CN104246696 B CN 104246696B CN 201280068226 A CN201280068226 A CN 201280068226A CN 104246696 B CN104246696 B CN 104246696B
- Authority
- CN
- China
- Prior art keywords
- image
- incoming event
- target
- event
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 230000009471 action Effects 0.000 claims description 40
- 238000000034 method Methods 0.000 claims description 39
- 230000004044 response Effects 0.000 claims description 26
- 238000003860 storage Methods 0.000 claims description 7
- 238000010586 diagram Methods 0.000 description 18
- 230000015654 memory Effects 0.000 description 16
- 230000000007 visual effect Effects 0.000 description 11
- 238000001514 detection method Methods 0.000 description 9
- 238000004891 communication Methods 0.000 description 7
- 238000013500 data storage Methods 0.000 description 5
- 230000007246 mechanism Effects 0.000 description 5
- 230000008859 change Effects 0.000 description 4
- 238000012790 confirmation Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 238000009434 installation Methods 0.000 description 3
- 238000009826 distribution Methods 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000008439 repair process Effects 0.000 description 2
- 230000006399 behavior Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000005520 cutting process Methods 0.000 description 1
- 235000013399 edible fruits Nutrition 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
- 238000003825 pressing Methods 0.000 description 1
- 238000012163 sequencing technique Methods 0.000 description 1
- 230000000638 stimulation Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04847—Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/0482—Interaction with lists of selectable items, e.g. menus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04842—Selection of displayed objects or displayed text elements
Abstract
Description
Claims (7)
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/US2012/022741 WO2013112159A1 (en) | 2012-01-26 | 2012-01-26 | Image-based application automation |
Publications (2)
Publication Number | Publication Date |
---|---|
CN104246696A CN104246696A (zh) | 2014-12-24 |
CN104246696B true CN104246696B (zh) | 2017-10-20 |
Family
ID=48873768
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201280068226.4A Expired - Fee Related CN104246696B (zh) | 2012-01-26 | 2012-01-26 | 基于图像的应用自动化 |
Country Status (4)
Country | Link |
---|---|
US (1) | US20150007070A1 (zh) |
EP (1) | EP2807541B1 (zh) |
CN (1) | CN104246696B (zh) |
WO (1) | WO2013112159A1 (zh) |
Families Citing this family (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11256385B2 (en) * | 2013-09-19 | 2022-02-22 | Micro Focus Llc | Application menu modification recommendations |
WO2015042987A1 (en) * | 2013-09-30 | 2015-04-02 | Hewlett-Packard Development Company, L.P. | Record and replay of operations on graphical objects |
US9721186B2 (en) * | 2015-03-05 | 2017-08-01 | Nant Holdings Ip, Llc | Global signatures for large-scale image recognition |
CN106033368B (zh) * | 2015-03-09 | 2019-02-22 | 北京大学 | 一种多核虚拟机确定性重演的方法 |
CN106325841A (zh) * | 2015-06-30 | 2017-01-11 | 腾讯科技(深圳)有限公司 | 控件图像显示方法及装置 |
US9804955B2 (en) * | 2015-07-28 | 2017-10-31 | TestPlant Europe Limited | Method and apparatus for creating reference images for an automated test of software with a graphical user interface |
US10586071B2 (en) | 2017-11-24 | 2020-03-10 | International Business Machines Corporation | Safeguarding confidential information during a screen share session |
US11166079B2 (en) * | 2017-12-22 | 2021-11-02 | International Business Machines Corporation | Viewport selection for hypervideo presentation |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN100454220C (zh) * | 2003-05-08 | 2009-01-21 | 希尔克瑞斯特实验室公司 | 用于组织、选择和启动媒体项的控制架构 |
CN101583919A (zh) * | 2006-10-06 | 2009-11-18 | 索尼电子有限公司 | 用于视听浏览的图形用户界面 |
CN101673177A (zh) * | 2008-09-12 | 2010-03-17 | 索尼株式会社 | 信息处理设备、信息处理方法和计算机程序 |
CN102023975A (zh) * | 2009-09-10 | 2011-04-20 | 联想(北京)有限公司 | 一种放大网页内容的方法、装置及浏览器 |
Family Cites Families (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
NO943269D0 (no) * | 1994-09-02 | 1994-09-02 | Vingmed Sound As | Fremgangsmåte for analyse og måling av ultralydsignaler |
US7676543B2 (en) * | 2005-06-27 | 2010-03-09 | Scenera Technologies, Llc | Associating presence information with a digital image |
US9360985B2 (en) * | 2007-06-27 | 2016-06-07 | Scenera Technologies, Llc | Method and system for automatically linking a cursor to a hotspot in a hypervideo stream |
US8516397B2 (en) * | 2008-10-27 | 2013-08-20 | Verizon Patent And Licensing Inc. | Proximity interface apparatuses, systems, and methods |
US8549478B2 (en) * | 2009-12-02 | 2013-10-01 | Hewlett-Packard Development Company, L.P. | Graphical user interface input element identification |
-
2012
- 2012-01-26 CN CN201280068226.4A patent/CN104246696B/zh not_active Expired - Fee Related
- 2012-01-26 EP EP12866909.0A patent/EP2807541B1/en active Active
- 2012-01-26 WO PCT/US2012/022741 patent/WO2013112159A1/en active Application Filing
- 2012-01-26 US US14/373,843 patent/US20150007070A1/en not_active Abandoned
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN100454220C (zh) * | 2003-05-08 | 2009-01-21 | 希尔克瑞斯特实验室公司 | 用于组织、选择和启动媒体项的控制架构 |
CN101583919A (zh) * | 2006-10-06 | 2009-11-18 | 索尼电子有限公司 | 用于视听浏览的图形用户界面 |
CN101673177A (zh) * | 2008-09-12 | 2010-03-17 | 索尼株式会社 | 信息处理设备、信息处理方法和计算机程序 |
CN102023975A (zh) * | 2009-09-10 | 2011-04-20 | 联想(北京)有限公司 | 一种放大网页内容的方法、装置及浏览器 |
Also Published As
Publication number | Publication date |
---|---|
EP2807541A4 (en) | 2016-03-09 |
EP2807541B1 (en) | 2020-09-02 |
CN104246696A (zh) | 2014-12-24 |
EP2807541A1 (en) | 2014-12-03 |
US20150007070A1 (en) | 2015-01-01 |
WO2013112159A1 (en) | 2013-08-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN104246696B (zh) | 基于图像的应用自动化 | |
US10324828B2 (en) | Generating annotated screenshots based on automated tests | |
US9448908B2 (en) | System and method for model based session management | |
US20200019418A1 (en) | Machine learning analysis of user interface design | |
US20060107234A1 (en) | Computer-implemented graphical user interface previews | |
JP4381436B2 (ja) | シナリオ生成装置およびシナリオ生成プログラム | |
KR102446521B1 (ko) | 로보틱 프로세스 자동화를 위한 로봇 실행의 스크린 응답 검증 | |
US20120159359A1 (en) | System and method for generating graphical dashboards with drill down navigation | |
US20110038542A1 (en) | Computer application analysis | |
US20140074452A1 (en) | System and method for automatic modeling of an application | |
US10303349B2 (en) | Image-based application automation | |
US7043669B2 (en) | Simple scenario builder | |
CN108089737B (zh) | 单台计算机的多鼠标控制方法及装置 | |
CN114868109B (zh) | 用户界面自动化中的自动锚点确定和目标图形元素标识 | |
CN112817817B (zh) | 埋点信息查询方法、装置、计算机设备和存储介质 | |
KR102373942B1 (ko) | 텍스트 검출, 캐럿 추적, 및 활성 엘리먼트 검출 | |
JP4896909B2 (ja) | シナリオ生成装置及びプログラム | |
WO2020250320A1 (ja) | 操作ログ取得装置、操作ログ取得方法および操作ログ取得プログラム | |
US10924362B2 (en) | Management of software bugs in a data processing system | |
US20230131682A1 (en) | Facilitated live analysis of screen content | |
US20140149912A1 (en) | Apparatus and methods for displaying a physical view of a device | |
US10678409B2 (en) | Displaying an off-switch location | |
JP2009259275A (ja) | シナリオ生成装置およびシナリオ生成プログラム | |
CN115904572B (zh) | 一种模板创建方法、调用方法、程序产品、系统及装置 | |
KR102373943B1 (ko) | 텍스트 검출, 캐럿 추적, 및 활성 엘리먼트 검출 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant | ||
TR01 | Transfer of patent right |
Effective date of registration: 20180224 Address after: Texas, USA Patentee after: HEWLETT PACKARD ENTERPRISE DEVELOPMENT L.P. Address before: Texas, USA Patentee before: HEWLETT-PACKARD DEVELOPMENT Co.,L.P. |
|
TR01 | Transfer of patent right | ||
TR01 | Transfer of patent right | ||
TR01 | Transfer of patent right |
Effective date of registration: 20180608 Address after: California, USA Patentee after: Antiy Software Co.,Ltd. Address before: Texas, USA Patentee before: HEWLETT PACKARD ENTERPRISE DEVELOPMENT L.P. |
|
CP03 | Change of name, title or address | ||
CP03 | Change of name, title or address |
Address after: Utah, USA Patentee after: Weifosi Co.,Ltd. Address before: California, USA Patentee before: Antiy Software Co.,Ltd. |
|
CF01 | Termination of patent right due to non-payment of annual fee | ||
CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20171020 Termination date: 20220126 |