WO2009082707A1 - Providing image-based guidance for remote assistance - Google Patents

Providing image-based guidance for remote assistance Download PDF

Info

Publication number
WO2009082707A1
WO2009082707A1 PCT/US2008/087780 US2008087780W WO2009082707A1 WO 2009082707 A1 WO2009082707 A1 WO 2009082707A1 US 2008087780 W US2008087780 W US 2008087780W WO 2009082707 A1 WO2009082707 A1 WO 2009082707A1
Authority
WO
WIPO (PCT)
Prior art keywords
user
image
electronic component
providing
configuration
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/US2008/087780
Other languages
English (en)
French (fr)
Inventor
Brian Hernacki
Sourabh Satish
Timothy G. Brown
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Gen Digital Inc
Original Assignee
Symantec Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Symantec Corp filed Critical Symantec Corp
Priority to EP08864518.9A priority Critical patent/EP2238543B1/en
Priority to JP2010539897A priority patent/JP5264931B2/ja
Priority to CN2008801198192A priority patent/CN101918938B/zh
Publication of WO2009082707A1 publication Critical patent/WO2009082707A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/451Execution arrangements for user interfaces
    • G06F9/453Help systems

Definitions

  • This invention pertains generally to providing remote computing assistance, and more specifically to providing image-based guidance for remote component configuration assistance.
  • a remote administrator is not present at the user site, and thus cannot connect cables, plug- in printers, and otherwise physically configure components for the user.
  • Voice or email guidance directing users through the physical configuration of computer components is often too vague or unfamiliar to the user. For example, instructing a user to "plug that end of the cable into the USB port" does not help a user who does not know what a USB port is. For example, consider an experienced computer expert trying to help his/her mother (over the telephone) to connect her printer to her PC. The conversation would typically sound something like this:
  • Visual images of computer components are provided to remotely guide users through the process of setting up physical connections. Component identifying information is automatically gleaned and provided from a user's computer to a remote administrator.
  • the administrator provides visual images of the components to the user, and remotely annotates them to guide the user through the configuration process.
  • Image annotation can include pointing to a specific section of the image (e.g., the plug into which a cable is to be inserted) and/or drawing or writing on or otherwise marking-up the image to direct the user's attention.
  • the visual image-based guidance can be supplemented by voice communication with the user.
  • Figure 1 is a block diagram illustrating a system in which a remote assistance manager enables robust remote computer component configuration assistance, according to some embodiments of the present invention.
  • Figure 2 is a block diagram illustrating using a webcam to identify components, according to another embodiment of the present invention.
  • Figure 3 is a block diagram illustrating a remote assistance manager providing remote configuration assistance for a plurality of components on a user's home network, according to some embodiment of the present invention.
  • Figure 1 illustrates a system 100 in which a remote assistance manager 101 enables robust remote computer component configuration assistance within a remote management and administration context, according to some embodiments of the present invention.
  • a remote assistance manager 101 enables robust remote computer component configuration assistance within a remote management and administration context, according to some embodiments of the present invention.
  • each illustrated component represents a collection of functionalities which can be implemented as software, hardware, firmware or any combination of these.
  • a component can be implemented as a standalone program, but can also be implemented in other ways, for example as part of a larger program, as a plurality of separate programs, as a kernel loadable module, as one or more device drivers or as one or more statically or dynamically linked libraries .
  • a component identification agent 103 running on a user's 104 computer 105 strongly identifies (e.g., exact make and model number, etc.) the components 106 on the local system 105, and transmits component identification information 107 to the remote assistance manager 101.
  • the component identification agent 103 can poll both the operating system 189 running on the user's 104 computer 105 and/or the components 106 themselves to obtain this information 107.
  • the implementation mechanics of such polling operations is known to those of ordinary skill in the relevant art, and the usage thereof within the context of embodiments of the present invention will be readily apparent to those of such a skill level in light of this specification. In most instances, these polling operations will be sufficient to obtain component identification information 107.
  • Other techniques for identifying difficult components 106 are discussed below.
  • the remote assistance manager 101 uses the component identification information 107 to retrieve images 109 of the components in question.
  • the administrator 111 e.g., the sophisticated party who is providing the technical help
  • the remote assistance manager 101 can run, for example, on a central computer (not illustrated) or on the administrator's computer 113, as desired.
  • the remote assistance manager 101 has access to a collection of images 109 of components 106, e.g., via the internet or a component image database 115, stored locally or remotely.
  • the remote assistance manager 101 also has network connectivity access to the user's 104 computer 105, via. e.g., the internet, another type of wide area network, or a dedicated connection.
  • the administrator 111 While the administrator 111 is in voice or electronic communication with the user 104 (e.g., via telephone, voice over internet, instant messaging, email, etc.), s/he can remotely push the images 109 to the user's 104 screen, along with visual cues 117.
  • the administrator 111 can not only display images 109 of specific components 106 to the user 104, but can also point to specific areas and parts of the components 106, e.g., with a mouse pointer, and annotate the images 109 with a drawing tool or the like.
  • Annotating the image 109 can include, for example, highlighting sections of the image, or drawing or writing on or otherwise marking-up the image 109 to direct the user's 104 attention. This provides much more tangible assistance to the user 104.
  • a webcam 201 can be used as a feedback interface. For example, suppose the component identification agent 103 running on the user's 104 computer
  • the user 104 could point the web camera 201 at the device 106, and the resulting digital image 109 could be used by the administrator 111 for offering configuration help, or for selecting an image 109.
  • the webcam 201 could scan serial numbers or bar codes and the like, to provide strong identification information of components 106 that cannot otherwise be identified. Where a webcam 201 is not available, the user
  • the component identification agent 103 running on the user's 104 computer 105 can identify not only computer peripherals 106 such as printers, display and audio devices, network connectivity devices, etc., but also any component 106 on the user's home network 301, such as other desktop computing devices 303, mobile computing devices 305, digital television recorders 307 (e.g., TIVO® devices), smart appliances 309, etc.
  • computer peripherals 106 such as printers, display and audio devices, network connectivity devices, etc.
  • any component 106 on the user's home network 301 such as other desktop computing devices 303, mobile computing devices 305, digital television recorders 307 (e.g., TIVO® devices), smart appliances 309, etc.
  • a component of the present invention is implemented as software
  • the component can be implemented as a script, as a standalone program, as part of a larger program, as a plurality of separate scripts and/or programs, as a statically or dynamically linked library, as a kernel loadable module, as a device driver, and/or in every and any other way known now or in the future to those of skill in the art of computer programming.
  • the present invention is in no way limited to implementation in any specific programming language, or for any specific operating system or environment.
  • the software components thereof can be stored on computer readable media as computer program products.

Landscapes

  • Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer And Data Communications (AREA)
  • Information Transfer Between Computers (AREA)
  • Selective Calling Equipment (AREA)
  • Accessory Devices And Overall Control Thereof (AREA)
PCT/US2008/087780 2007-12-21 2008-12-19 Providing image-based guidance for remote assistance Ceased WO2009082707A1 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
EP08864518.9A EP2238543B1 (en) 2007-12-21 2008-12-19 Providing image-based guidance for remote assistance
JP2010539897A JP5264931B2 (ja) 2007-12-21 2008-12-19 遠隔支援のための画像ベースの案内の提供
CN2008801198192A CN101918938B (zh) 2007-12-21 2008-12-19 为远程帮助提供基于图像的指导

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US11/963,694 2007-12-21
US11/963,694 US8151193B2 (en) 2007-12-21 2007-12-21 Providing image-based guidance for remote assistance

Publications (1)

Publication Number Publication Date
WO2009082707A1 true WO2009082707A1 (en) 2009-07-02

Family

ID=40790147

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2008/087780 Ceased WO2009082707A1 (en) 2007-12-21 2008-12-19 Providing image-based guidance for remote assistance

Country Status (5)

Country Link
US (1) US8151193B2 (enExample)
EP (1) EP2238543B1 (enExample)
JP (1) JP5264931B2 (enExample)
CN (1) CN101918938B (enExample)
WO (1) WO2009082707A1 (enExample)

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2010108186A1 (en) * 2009-03-20 2010-09-23 Georgia Tech Research Corporation Methods and apparatuses for using a mobile device to provide remote assistance
US10387175B2 (en) * 2009-10-23 2019-08-20 Autodesk, Inc. Method and system for providing software application end-users with contextual access to text and video instructional information
WO2012169157A1 (ja) * 2011-06-07 2012-12-13 パナソニック株式会社 被サポート装置、サポート装置、機器間ガイドシステム、記録媒体、及び集積回路
US20150127746A1 (en) * 2011-12-20 2015-05-07 Telefonaktiebolaget L M Ericsson (Publ) Methods, nodes, computer programs and comuter program products for activating remote access
JP5620434B2 (ja) * 2012-05-02 2014-11-05 株式会社オプティム オペレータシステム、オペレータサーバ、リモートサポート方法、オペレータサーバ用プログラム、サポート対象電化製品、及び、サポート作業画面表示装置
US9436428B2 (en) 2012-11-08 2016-09-06 Ebay Inc. Methods, apparatus, and system for mobile piggybacking
US9258521B2 (en) 2013-05-06 2016-02-09 Globalfoundries Inc. Real-time advisor system with projected augmentable annotations
US9639512B1 (en) * 2014-11-20 2017-05-02 Nicholas M. Carter Apparatus and method for sharing regional annotations of an image
FR3071640B1 (fr) * 2017-09-28 2019-11-08 Airbus Operations (S.A.S.) Procede de restitution d'une representation graphique d'une information de cablage d'un composant electronique et dispositif associe
CN108632273A (zh) * 2018-05-07 2018-10-09 全感(苏州)智能技术有限公司 一种远程作业指导系统
US11093570B2 (en) * 2018-09-13 2021-08-17 Citrix Systems, Inc. Systems and methods for presenting additional content for a network application accessed via an embedded browser of a client application

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6061717A (en) * 1993-03-19 2000-05-09 Ncr Corporation Remote collaboration system with annotation and viewer capabilities
US20040260704A1 (en) * 2003-06-23 2004-12-23 Moore Keith E. User-requested remote assistance for printing devices
US6973482B2 (en) * 2001-10-01 2005-12-06 Microsoft Corporation Remote assistance

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1994029786A1 (en) * 1993-06-11 1994-12-22 Software Publishing Corporation System and methods for automatically displaying graphical help images on a computer
US6658466B1 (en) * 1996-10-16 2003-12-02 Ncr Corporation Method and apparatus for integrating remote human interactive assistance function into software systems
US6144991A (en) * 1998-02-19 2000-11-07 Telcordia Technologies, Inc. System and method for managing interactions between users in a browser-based telecommunications network
US20020087949A1 (en) 2000-03-03 2002-07-04 Valery Golender System and method for software diagnostics using a combination of visual and dynamic tracing
US20030001875A1 (en) 2001-06-29 2003-01-02 Black Jason E. Context-sensitive help for a Web-based user interface
JP2004240498A (ja) * 2003-02-03 2004-08-26 Phoenix Technologies Kk 電子機器のリモートサポートシステム
US7398470B2 (en) * 2003-08-22 2008-07-08 Vistaprint Technologies Limited System and method for remote assistance
US7284155B2 (en) * 2004-03-29 2007-10-16 Hewlett-Packard Development Company, L.P. Remote software support agent system with electronic documents for troubleshooting
US7346846B2 (en) 2004-05-28 2008-03-18 Microsoft Corporation Strategies for providing just-in-time user assistance
JP2006139452A (ja) * 2004-11-11 2006-06-01 Noritsu Koki Co Ltd ネットワークトレーニングシステム
JP4553362B2 (ja) * 2005-01-31 2010-09-29 キヤノン株式会社 システム、画像処理装置、情報処理方法
JP2006245689A (ja) * 2005-02-28 2006-09-14 Nippon Telegr & Teleph Corp <Ntt> 情報提示装置、情報提示方法及びプログラム
JP4738870B2 (ja) * 2005-04-08 2011-08-03 キヤノン株式会社 情報処理方法、情報処理装置および遠隔複合現実感共有装置
US20070038945A1 (en) * 2005-08-10 2007-02-15 Miller Jacob J System and method allowing one computer system user to guide another computer system user through a remote environment
JP4770493B2 (ja) * 2006-02-02 2011-09-14 富士ゼロックス株式会社 遠隔指示システム及び遠隔指示方法
JP5200341B2 (ja) * 2006-06-28 2013-06-05 富士ゼロックス株式会社 遠隔指示システム及び遠隔指示方法
CN101083751B (zh) * 2007-06-22 2010-09-15 腾讯科技(深圳)有限公司 一种视频教学方法及装置

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6061717A (en) * 1993-03-19 2000-05-09 Ncr Corporation Remote collaboration system with annotation and viewer capabilities
US6973482B2 (en) * 2001-10-01 2005-12-06 Microsoft Corporation Remote assistance
US20040260704A1 (en) * 2003-06-23 2004-12-23 Moore Keith E. User-requested remote assistance for printing devices

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP2238543A4 *

Also Published As

Publication number Publication date
JP5264931B2 (ja) 2013-08-14
JP2011508321A (ja) 2011-03-10
CN101918938A (zh) 2010-12-15
EP2238543B1 (en) 2018-04-25
CN101918938B (zh) 2013-03-06
EP2238543A4 (en) 2010-12-22
US8151193B2 (en) 2012-04-03
US20090164899A1 (en) 2009-06-25
EP2238543A1 (en) 2010-10-13

Similar Documents

Publication Publication Date Title
US8151193B2 (en) Providing image-based guidance for remote assistance
Monk Raspberry pi cookbook
US10367944B2 (en) Apparatus, system, and method of conference assistance
CN102298533A (zh) 激活应用程序的方法及终端设备
US9270540B2 (en) Method and apparatus of providing an interface for managing network switches
EP2736008A1 (en) Dynamic tag generating apparatus and dynamic tag generating method thereof for use in display apparatus
US9141958B2 (en) Method for providing data to a user
US20170318064A1 (en) Method and electronic device for editing content
CN101398842B (zh) 用于基于主题和元数据的媒体播放器的系统、装置和方法
CN103596021A (zh) 智能电视端的帐号登录方法、装置及系统
CN111352600A (zh) 一种大屏控制系统、方法、装置及电子设备
CN108958731B (zh) 一种应用程序界面生成方法、装置、设备和存储介质
CN101510833A (zh) 一种设备面板的生成方法和装置
JP2017033103A (ja) デジタルサイネージ制御システム、それを含むデジタルサイネージ制御システムおよびそれらを用いた商品広告または役務広告の提供方法
CN113449185A (zh) 一种信息提醒方法及服务器
US20030086109A1 (en) Printer help apparatus and method
EP4315759B1 (en) Systems and methods for managing digital notes for collaboration
CN114357279B (zh) 一种显示设备及基于网站内页面的语音搜索方法
CN104346117B (zh) 一种数据信号输出的方法和装置
CN116450681A (zh) 信息处理方法和装置
US20200322293A1 (en) Information processing system and method
CN107733779B (zh) 基于联系人的功能扩展方法及装置
CN103777745A (zh) 现场勘验开放式系统
CN110059215A (zh) 适用于输电线路缺陷照片快速命名归档的整理系统
CN103777784A (zh) 存储勘验信息的方法及设备

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 200880119819.2

Country of ref document: CN

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 08864518

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2010539897

Country of ref document: JP

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 2008864518

Country of ref document: EP