WO2009066762A1 - ユーザインタフェース認識装置及びユーザインタフェース認識方法 - Google Patents

ユーザインタフェース認識装置及びユーザインタフェース認識方法 Download PDF

Info

Publication number
WO2009066762A1
WO2009066762A1 PCT/JP2008/071223 JP2008071223W WO2009066762A1 WO 2009066762 A1 WO2009066762 A1 WO 2009066762A1 JP 2008071223 W JP2008071223 W JP 2008071223W WO 2009066762 A1 WO2009066762 A1 WO 2009066762A1
Authority
WO
WIPO (PCT)
Prior art keywords
user interface
parts
search
interface recognition
information
Prior art date
Application number
PCT/JP2008/071223
Other languages
English (en)
French (fr)
Inventor
Kazuya Koyama
Keiichi Iguchi
Original Assignee
Nec Corporation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nec Corporation filed Critical Nec Corporation
Priority to US12/742,833 priority Critical patent/US20100262598A1/en
Priority to JP2009542601A priority patent/JP5413198B2/ja
Publication of WO2009066762A1 publication Critical patent/WO2009066762A1/ja

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/451Execution arrangements for user interfaces

Landscapes

  • Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

 検索ルール生成部(2502)は、ユーザインタフェースを構成する部品群及び部品群の位置関係を示すユーザインタフェース情報と、部品群の中で検索対象とする部品を示す検索対象部品情報と、ユーザインタフェースの構造を定義する構造定義情報とに基づいて、検索対象とする部品を検索するための検索ルールを予め生成する。部品検索部(2503)は、新たなユーザインタフェース情報が入力されたときに、予め生成しておいた検索ルールを用いて、新たなユーザインタフェース情報に示される部品群の中から検索対象とする部品を検索する。これにより、構造が不明確でかつ変化するユーザインタフェースについて、正しく部品を特定できるようになる。
PCT/JP2008/071223 2007-11-21 2008-11-21 ユーザインタフェース認識装置及びユーザインタフェース認識方法 WO2009066762A1 (ja)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US12/742,833 US20100262598A1 (en) 2007-11-21 2008-11-21 User interface recognition device and user interface recognition method
JP2009542601A JP5413198B2 (ja) 2007-11-21 2008-11-21 ユーザインタフェース認識装置、ユーザインタフェース認識方法およびプログラム

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2007-302209 2007-11-21
JP2007302209 2007-11-21

Publications (1)

Publication Number Publication Date
WO2009066762A1 true WO2009066762A1 (ja) 2009-05-28

Family

ID=40667584

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2008/071223 WO2009066762A1 (ja) 2007-11-21 2008-11-21 ユーザインタフェース認識装置及びユーザインタフェース認識方法

Country Status (3)

Country Link
US (1) US20100262598A1 (ja)
JP (1) JP5413198B2 (ja)
WO (1) WO2009066762A1 (ja)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2011170503A (ja) * 2010-02-17 2011-09-01 Hitachi Ltd 検索式提供方法、プログラム、及び、検索式提供システム
JP2011210233A (ja) * 2010-03-29 2011-10-20 Nec (China) Co Ltd Gui要素を識別する方法、装置およびシステム
JP2015109001A (ja) * 2013-12-05 2015-06-11 日本電信電話株式会社 操作ログ管理装置及び方法
JP2018116394A (ja) * 2017-01-17 2018-07-26 東日本電信電話株式会社 操作自動化装置
JP2022001978A (ja) * 2020-06-19 2022-01-06 株式会社オービック 画面要素補完装置、画面要素補完方法および画面要素補完プログラム
JP2022530607A (ja) * 2019-04-30 2022-06-30 ウォークミー リミテッド Gui要素の複数の代替表記を使用したgui要素獲得

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8467987B1 (en) * 2012-05-30 2013-06-18 Google, Inc. Methods and systems for testing mobile device builds

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001005745A (ja) * 1999-06-17 2001-01-12 Sony Corp 送信装置および受信装置
JP2004272871A (ja) * 2003-02-20 2004-09-30 Hitachi Software Eng Co Ltd Webコンテンツ内のデータ抽出配信方法およびシステム

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6724409B1 (en) * 2000-11-16 2004-04-20 Hewlett-Packard Development Company L.P. Tree-based graphical user interface for creating and editing machine control sequences
US20020163535A1 (en) * 2000-12-11 2002-11-07 Mitchell Kathryn L. System and method for generating a graphical user interface from a template
US7191119B2 (en) * 2002-05-07 2007-03-13 International Business Machines Corporation Integrated development tool for building a natural language understanding application
EP1460533A1 (en) * 2003-03-17 2004-09-22 Alcatel Extensible graphical user interface development framework
US7567964B2 (en) * 2003-05-08 2009-07-28 Oracle International Corporation Configurable search graphical user interface and engine
KR100558952B1 (ko) * 2005-05-12 2006-03-10 김길웅 인터페이스 화면 설계 중심의 소프트웨어 생산 공정 자동화방법 및 이 방법을 프로그램화하여 수록한 컴퓨터로 읽을수 있는 기록매체

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001005745A (ja) * 1999-06-17 2001-01-12 Sony Corp 送信装置および受信装置
JP2004272871A (ja) * 2003-02-20 2004-09-30 Hitachi Software Eng Co Ltd Webコンテンツ内のデータ抽出配信方法およびシステム

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2011170503A (ja) * 2010-02-17 2011-09-01 Hitachi Ltd 検索式提供方法、プログラム、及び、検索式提供システム
JP2011210233A (ja) * 2010-03-29 2011-10-20 Nec (China) Co Ltd Gui要素を識別する方法、装置およびシステム
JP2015109001A (ja) * 2013-12-05 2015-06-11 日本電信電話株式会社 操作ログ管理装置及び方法
JP2018116394A (ja) * 2017-01-17 2018-07-26 東日本電信電話株式会社 操作自動化装置
JP2022530607A (ja) * 2019-04-30 2022-06-30 ウォークミー リミテッド Gui要素の複数の代替表記を使用したgui要素獲得
JP7386889B2 (ja) 2019-04-30 2023-11-27 ウォークミー リミテッド Gui要素の複数の代替表記を使用したgui要素獲得
JP2022001978A (ja) * 2020-06-19 2022-01-06 株式会社オービック 画面要素補完装置、画面要素補完方法および画面要素補完プログラム
JP7328938B2 (ja) 2020-06-19 2023-08-17 株式会社オービック 画面要素補完装置、画面要素補完方法および画面要素補完プログラム

Also Published As

Publication number Publication date
JP5413198B2 (ja) 2014-02-12
US20100262598A1 (en) 2010-10-14
JPWO2009066762A1 (ja) 2011-04-07

Similar Documents

Publication Publication Date Title
WO2009066762A1 (ja) ユーザインタフェース認識装置及びユーザインタフェース認識方法
WO2007005536A3 (en) Information retrieving and displaying method and computer-readable medium
WO2009060760A1 (ja) 辞書データの見出し語を検索する電子機器、その制御方法およびプログラム製品
WO2007019691A3 (en) Automatic website generator
WO2010068068A3 (ko) 사용자의 의도에 기반한 정보 검색방법 및 정보 제공방법
WO2013003271A3 (en) System and method for managing projects
WO2007100812A3 (en) Expansion of database search queries
WO2006110684A3 (en) System and method for searching for a query
WO2007108788A3 (en) Method and system for answer extraction
WO2008039542A3 (en) System and method of ad-hoc analysis of data
WO2011059258A3 (en) Mobile device and method for a control generating signal
HK1121266A1 (en) System and method for searching and matching data having ideogrammatic content
WO2008036150A3 (en) Notification system for source code discovery
WO2008081414A3 (en) Method and apparatus for providing a graphical representation of content
WO2008032203A3 (en) Method, apparatus and computer program product for a tag-based visual search user interface
WO2008055120A3 (en) System and method for summarizing search results
CN103310785A (zh) 使用语音识别控制电源的电子装置和方法
ATE398325T1 (de) Synchrones verstehen von semantischen objekten, implementiert unter verwendung von sprachanwendungsmarkierungen
WO2008060834A3 (en) Method and system for a user interface using higher order commands
WO2012071169A3 (en) Efficient forward ranking in a search engine
WO2007001980A3 (en) System to generate related search queries
WO2009129048A3 (en) System and method for trail identification with search results
WO2010011550A3 (en) Method and system for creating a personalized social network in a telecommunication network
GB2441248A (en) Improvements in and relating to searching on a user interface
WO2009099947A3 (en) Methods and apparatus to generate smart text

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 08852846

Country of ref document: EP

Kind code of ref document: A1

DPE1 Request for preliminary examination filed after expiration of 19th month from priority date (pct application filed from 20040101)
DPE1 Request for preliminary examination filed after expiration of 19th month from priority date (pct application filed from 20040101)
WWE Wipo information: entry into national phase

Ref document number: 12742833

Country of ref document: US

WWE Wipo information: entry into national phase

Ref document number: 2009542601

Country of ref document: JP

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 08852846

Country of ref document: EP

Kind code of ref document: A1