DE60321145D1 - Sprachgesteuerte benutzeroberfläche - Google Patents

Sprachgesteuerte benutzeroberfläche

Info

Publication number
DE60321145D1
DE60321145D1 DE60321145T DE60321145T DE60321145D1 DE 60321145 D1 DE60321145 D1 DE 60321145D1 DE 60321145 T DE60321145 T DE 60321145T DE 60321145 T DE60321145 T DE 60321145T DE 60321145 D1 DE60321145 D1 DE 60321145D1
Authority
DE
Germany
Prior art keywords
user interface
voice
extension module
controlled user
document
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Lifetime
Application number
DE60321145T
Other languages
English (en)
Inventor
Jeff Roelands
Richard J Swan
Rama Gurram
Frankie James
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
SAP SE
Original Assignee
SAP SE
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by SAP SE filed Critical SAP SE
Application granted granted Critical
Publication of DE60321145D1 publication Critical patent/DE60321145D1/de
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/226—Procedures used during a speech recognition process, e.g. man-machine dialogue using non-speech characteristics
    • G10L2015/228—Procedures used during a speech recognition process, e.g. man-machine dialogue using non-speech characteristics of application context

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • User Interface Of Digital Computer (AREA)
  • Machine Translation (AREA)
  • Selective Calling Equipment (AREA)
  • Communication Control (AREA)
DE60321145T 2002-02-15 2003-02-14 Sprachgesteuerte benutzeroberfläche Expired - Lifetime DE60321145D1 (de)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US35674602P 2002-02-15 2002-02-15
US10/184,072 US7246063B2 (en) 2002-02-15 2002-06-28 Adapting a user interface for voice control
PCT/US2003/004569 WO2003071385A2 (en) 2002-02-15 2003-02-14 Voice-controlled user interfaces

Publications (1)

Publication Number Publication Date
DE60321145D1 true DE60321145D1 (de) 2008-07-03

Family

ID=27737024

Family Applications (1)

Application Number Title Priority Date Filing Date
DE60321145T Expired - Lifetime DE60321145D1 (de) 2002-02-15 2003-02-14 Sprachgesteuerte benutzeroberfläche

Country Status (7)

Country Link
US (1) US7246063B2 (de)
EP (1) EP1485773B1 (de)
CN (1) CN100409173C (de)
AT (1) ATE396446T1 (de)
AU (1) AU2003215239A1 (de)
DE (1) DE60321145D1 (de)
WO (1) WO2003071385A2 (de)

Families Citing this family (106)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7447637B1 (en) * 1998-12-23 2008-11-04 Eastern Investments, Llc System and method of processing speech within a graphic user interface
JP4004839B2 (ja) * 2002-04-15 2007-11-07 株式会社東芝 通信装置及びネットワークシステム
US10489449B2 (en) 2002-05-23 2019-11-26 Gula Consulting Limited Liability Company Computer accepting voice input and/or generating audible output
US8611919B2 (en) * 2002-05-23 2013-12-17 Wounder Gmbh., Llc System, method, and computer program product for providing location based services and mobile e-commerce
US7307615B2 (en) * 2003-08-08 2007-12-11 Lucent Technologies Inc. Method and apparatus for voice-controlled graphical user interface pointing device
KR20050028150A (ko) * 2003-09-17 2005-03-22 삼성전자주식회사 음성 신호를 이용한 유저-인터페이스를 제공하는휴대단말기 및 그 방법
US7647227B1 (en) * 2004-04-06 2010-01-12 Tuvox, Inc. Machine assisted speech generation for a conversational voice response system
US7657844B2 (en) * 2004-04-30 2010-02-02 International Business Machines Corporation Providing accessibility compliance within advanced componentry
US8788271B2 (en) * 2004-12-22 2014-07-22 Sap Aktiengesellschaft Controlling user interfaces with contextual voice commands
US9083798B2 (en) * 2004-12-22 2015-07-14 Nuance Communications, Inc. Enabling voice selection of user preferences
US7409344B2 (en) 2005-03-08 2008-08-05 Sap Aktiengesellschaft XML based architecture for controlling user interfaces with contextual voice commands
US7904300B2 (en) * 2005-08-10 2011-03-08 Nuance Communications, Inc. Supporting multiple speech enabled user interface consoles within a motor vehicle
US7958131B2 (en) 2005-08-19 2011-06-07 International Business Machines Corporation Method for data management and data rendering for disparate data types
US8977636B2 (en) 2005-08-19 2015-03-10 International Business Machines Corporation Synthesizing aggregate data of disparate data types into data of a uniform data type
US20070061712A1 (en) * 2005-09-14 2007-03-15 Bodin William K Management and rendering of calendar data
US8266220B2 (en) 2005-09-14 2012-09-11 International Business Machines Corporation Email management and rendering
US8694319B2 (en) 2005-11-03 2014-04-08 International Business Machines Corporation Dynamic prosody adjustment for voice-rendering synthesized data
US20070100872A1 (en) * 2005-11-03 2007-05-03 Bodin William K Dynamic creation of user interfaces for data management and data rendering
US20070124507A1 (en) * 2005-11-28 2007-05-31 Sap Ag Systems and methods of processing annotations and multimodal user inputs
US20070147355A1 (en) * 2005-12-08 2007-06-28 International Business Machines Corporation Composite services generation tool
US20070165538A1 (en) * 2006-01-13 2007-07-19 Bodin William K Schedule-based connectivity management
US8271107B2 (en) 2006-01-13 2012-09-18 International Business Machines Corporation Controlling audio operation for data management and data rendering
US9135339B2 (en) 2006-02-13 2015-09-15 International Business Machines Corporation Invoking an audio hyperlink
US20070192675A1 (en) * 2006-02-13 2007-08-16 Bodin William K Invoking an audio hyperlink embedded in a markup document
US9196241B2 (en) 2006-09-29 2015-11-24 International Business Machines Corporation Asynchronous communications using messages recorded on handheld devices
US20090013255A1 (en) * 2006-12-30 2009-01-08 Matthew John Yuschik Method and System for Supporting Graphical User Interfaces
US9318100B2 (en) 2007-01-03 2016-04-19 International Business Machines Corporation Supplementing audio recorded in a media file
US8462165B1 (en) * 2007-03-19 2013-06-11 Nvidia Corporation System, method, and computer program product for voice control of a graphics hardware processor
US8635069B2 (en) * 2007-08-16 2014-01-21 Crimson Corporation Scripting support for data identifiers, voice recognition and speech in a telnet session
US8595642B1 (en) 2007-10-04 2013-11-26 Great Northern Research, LLC Multiple shell multi faceted graphical user interface
US20090125813A1 (en) * 2007-11-09 2009-05-14 Zhongnan Shen Method and system for processing multiple dialog sessions in parallel
US8689203B2 (en) * 2008-02-19 2014-04-01 Microsoft Corporation Software update techniques based on ascertained identities
US20090248397A1 (en) * 2008-03-25 2009-10-01 Microsoft Corporation Service Initiation Techniques
US20100070863A1 (en) * 2008-09-16 2010-03-18 International Business Machines Corporation method for reading a screen
KR101545582B1 (ko) * 2008-10-29 2015-08-19 엘지전자 주식회사 단말기 및 그 제어 방법
BRPI0921978A2 (pt) 2008-11-26 2019-01-15 Calgary Scient Inc método de fornecimento de acesso remoto a estado de programa de aplicativo e meios de armazenamento.
US10055105B2 (en) 2009-02-03 2018-08-21 Calgary Scientific Inc. Method and system for enabling interaction with a plurality of applications using a single user interface
KR20110125647A (ko) * 2009-02-03 2011-11-21 캘거리 싸이언티픽 인코포레이티드 단일 사용자 인터페이스를 사용하여 복수의 애플리케이션과 상호작용하기 위한 방법 및 시스템
JP4826662B2 (ja) * 2009-08-06 2011-11-30 コニカミノルタビジネステクノロジーズ株式会社 画像処理装置および音声操作履歴情報共有方法
US8903073B2 (en) 2011-07-20 2014-12-02 Zvi Or-Bach Systems and methods for visual presentation and selection of IVR menu
US8625756B1 (en) 2010-02-03 2014-01-07 Tal Lavian Systems and methods for visual presentation and selection of IVR menu
US8537989B1 (en) 2010-02-03 2013-09-17 Tal Lavian Device and method for providing enhanced telephony
US8548135B1 (en) 2010-02-03 2013-10-01 Tal Lavian Systems and methods for visual presentation and selection of IVR menu
US8572303B2 (en) 2010-02-03 2013-10-29 Tal Lavian Portable universal communication device
US8681951B1 (en) 2010-02-03 2014-03-25 Tal Lavian Systems and methods for visual presentation and selection of IVR menu
US8406388B2 (en) 2011-07-18 2013-03-26 Zvi Or-Bach Systems and methods for visual presentation and selection of IVR menu
US8548131B1 (en) 2010-02-03 2013-10-01 Tal Lavian Systems and methods for communicating with an interactive voice response system
US8687777B1 (en) 2010-02-03 2014-04-01 Tal Lavian Systems and methods for visual presentation and selection of IVR menu
US8879698B1 (en) 2010-02-03 2014-11-04 Tal Lavian Device and method for providing enhanced telephony
US8553859B1 (en) 2010-02-03 2013-10-08 Tal Lavian Device and method for providing enhanced telephony
US8594280B1 (en) 2010-02-03 2013-11-26 Zvi Or-Bach Systems and methods for visual presentation and selection of IVR menu
US9001819B1 (en) 2010-02-18 2015-04-07 Zvi Or-Bach Systems and methods for visual presentation and selection of IVR menu
US8434134B2 (en) 2010-05-26 2013-04-30 Google Inc. Providing an electronic document collection
US9741084B2 (en) 2011-01-04 2017-08-22 Calgary Scientific Inc. Method and system for providing remote access to data for display on a mobile device
CA2734860A1 (en) * 2011-03-21 2012-09-21 Calgary Scientific Inc. Method and system for providing a state model of an application program
JP6164747B2 (ja) 2011-08-15 2017-07-19 カルガリー サイエンティフィック インコーポレイテッド 協働環境におけるフロー制御のためのおよび信頼性のある通信のための方法
AU2012296247B2 (en) 2011-08-15 2017-06-22 Calgary Scientific Inc. Non-invasive remote access to an application program
JP6322140B2 (ja) 2011-09-30 2018-05-09 カルガリー サイエンティフィック インコーポレイテッド 協働遠隔アプリケーションの共用および注釈のための双方向デジタル表層を含む非連結アプリケーション拡張
WO2013076554A1 (en) 2011-11-23 2013-05-30 Calgary Scientific Inc. Methods ans systems for collaborative remote application sharing and conferencing
US8856640B1 (en) 2012-01-20 2014-10-07 Google Inc. Method and apparatus for applying revision specific electronic signatures to an electronically stored document
US9602581B2 (en) 2012-03-02 2017-03-21 Calgary Scientific Inc. Remote control of an application using dynamic-linked library (DLL) injection
US8731148B1 (en) 2012-03-02 2014-05-20 Tal Lavian Systems and methods for visual presentation and selection of IVR menu
US8867708B1 (en) 2012-03-02 2014-10-21 Tal Lavian Systems and methods for visual presentation and selection of IVR menu
US20130246920A1 (en) * 2012-03-19 2013-09-19 Research In Motion Limited Method of enabling voice input for a visually based interface
CN102662496A (zh) * 2012-04-06 2012-09-12 深圳共银网络技术有限公司 多功能鼠标及其控制方法
US9729673B2 (en) 2012-06-21 2017-08-08 Calgary Scientific Inc. Method and system for providing synchronized views of multiple applications for display on a remote computing device
CN102929385A (zh) * 2012-09-05 2013-02-13 四川长虹电器股份有限公司 语音控制应用程序的方法
US11308037B2 (en) 2012-10-30 2022-04-19 Google Llc Automatic collaboration
US9529916B1 (en) 2012-10-30 2016-12-27 Google Inc. Managing documents based on access context
US9384285B1 (en) 2012-12-18 2016-07-05 Google Inc. Methods for identifying related documents
US9495341B1 (en) 2012-12-18 2016-11-15 Google Inc. Fact correction and completion during document drafting
CN103885693B (zh) * 2012-12-20 2018-07-06 联想(北京)有限公司 一种信息处理方法及电子设备
US9734819B2 (en) * 2013-02-21 2017-08-15 Google Technology Holdings LLC Recognizing accented speech
CN103280217B (zh) * 2013-05-02 2016-05-04 锤子科技（北京）有限公司 一种移动终端的语音识别方法及其装置
US20140372892A1 (en) * 2013-06-18 2014-12-18 Microsoft Corporation On-demand interface registration with a voice control system
US9514113B1 (en) 2013-07-29 2016-12-06 Google Inc. Methods for automatic footnote generation
CN104347075A (zh) * 2013-08-02 2015-02-11 迪欧泰克有限责任公司 以语音识别来选择控制客体的装置及方法
KR101447879B1 (ko) * 2013-08-09 2014-10-08 주식회사 디오텍 음성인식을 통해 컨트롤 객체를 선택하기 위한 장치 및 방법
US9842113B1 (en) 2013-08-27 2017-12-12 Google Inc. Context-based file selection
KR101474854B1 (ko) * 2013-09-12 2014-12-19 주식회사 디오텍 음성인식을 통해 컨트롤 객체를 선택하기 위한 장치 및 방법
KR101474856B1 (ko) * 2013-09-24 2014-12-30 주식회사 디오텍 음성인식을 통해 이벤트를 발생시키기 위한 장치 및 방법
US10175938B2 (en) 2013-11-19 2019-01-08 Microsoft Technology Licensing, Llc Website navigation via a voice user interface
US9600227B2 (en) 2013-11-21 2017-03-21 Google Technology Holdings LLC System and method for speech-based navigation and interaction with a device's visible screen elements using a corresponding view hierarchy
EP3075111B1 (de) 2013-11-29 2017-12-20 Calgary Scientific Inc. Verfahren zur bereitstellung einer verbindung mit einem nicht verwalteten dienst in einem client-server-fernzugangssystem
US9529791B1 (en) 2013-12-12 2016-12-27 Google Inc. Template and content aware document and template editing
WO2015100107A1 (en) * 2013-12-26 2015-07-02 Kopin Corporation User configurable speech commands
CN103886882B (zh) * 2014-03-17 2017-05-24 联想(北京)有限公司 一种进度调节方法及电子设备
US9703763B1 (en) 2014-08-14 2017-07-11 Google Inc. Automatic document citations by utilizing copied content for candidate sources
US10033797B1 (en) 2014-08-20 2018-07-24 Ivanti, Inc. Terminal emulation over HTML
KR20170110612A (ko) 2015-01-30 2017-10-11 캘거리 싸이언티픽 인코포레이티드 고 확장가능한, 고장 저항력이 있는 원격 액세스 아키텍처 및 접속 방법
US10015264B2 (en) 2015-01-30 2018-07-03 Calgary Scientific Inc. Generalized proxy architecture to provide remote access to an application framework
CN105100460A (zh) * 2015-07-09 2015-11-25 上海斐讯数据通信技术有限公司 一种声音操控智能终端的方法及系统
CN106409295B (zh) * 2015-07-31 2020-06-16 腾讯科技（深圳）有限公司 从自然语音信息中识别时间信息的方法和装置
CN105260080A (zh) * 2015-09-22 2016-01-20 广东欧珀移动通信有限公司 一种在移动终端显示屏实现声控操作的方法及装置
CN105551492A (zh) * 2015-12-04 2016-05-04 青岛海信传媒网络技术有限公司 语音控制的方法、装置与终端
US20170315849A1 (en) * 2016-04-29 2017-11-02 Microsoft Technology Licensing, Llc Application target event synthesis
US11100278B2 (en) 2016-07-28 2021-08-24 Ivanti, Inc. Systems and methods for presentation of a terminal application screen
US11507216B2 (en) 2016-12-23 2022-11-22 Realwear, Inc. Customizing user interfaces of binary applications
US11099716B2 (en) 2016-12-23 2021-08-24 Realwear, Inc. Context based content navigation for wearable display
US10620910B2 (en) * 2016-12-23 2020-04-14 Realwear, Inc. Hands-free navigation of touch-based operating systems
CN109147776A (zh) * 2017-06-19 2019-01-04 丽宝大数据股份有限公司 具有声控功能的显示装置及声控时机指示方法
CN107507614B (zh) * 2017-07-28 2018-12-21 北京小蓦机器人技术有限公司 结合ui执行自然语言命令的方法、设备、系统与存储介质
CN110211586A (zh) * 2019-06-19 2019-09-06 广州小鹏汽车科技有限公司 语音交互方法、装置、车辆以及机器可读介质
CN112256263B (zh) * 2020-09-23 2024-02-06 杭州讯酷科技有限公司 一种基于自然语言的ui界面智能制作系统及方法
CN114625297A (zh) * 2022-03-15 2022-06-14 上海小度技术有限公司 一种交互方法、装置、设备以及存储介质
US11922096B1 (en) * 2022-08-30 2024-03-05 Snap Inc. Voice controlled UIs for AR wearable devices

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5619708A (en) 1994-10-25 1997-04-08 Korteam International, Inc. System and method for generating database input forms
US5884262A (en) * 1996-03-28 1999-03-16 Bell Atlantic Network Services, Inc. Computer network audio access and conversion system
US6125376A (en) * 1997-04-10 2000-09-26 At&T Corp Method and apparatus for voice interaction over a network using parameterized interaction definitions
US6108629A (en) * 1997-04-25 2000-08-22 At&T Corp. Method and apparatus for voice interaction over a network using an information flow controller
US6012030A (en) * 1998-04-21 2000-01-04 Nortel Networks Corporation Management of speech and audio prompts in multimodal interfaces
US6434524B1 (en) * 1998-09-09 2002-08-13 One Voice Technologies, Inc. Object interactive user interface using speech recognition and natural language processing
US6175820B1 (en) * 1999-01-28 2001-01-16 International Business Machines Corporation Capture and application of sender voice dynamics to enhance communication in a speech-to-text environment
US20010043234A1 (en) * 2000-01-03 2001-11-22 Mallik Kotamarti Incorporating non-native user interface mechanisms into a user interface
JP2002023996A (ja) * 2000-07-04 2002-01-25 Advanced Media Inc 音声対応スクリプト動作装置
US6791529B2 (en) * 2001-12-13 2004-09-14 Koninklijke Philips Electronics N.V. UI with graphics-assisted voice control system

Also Published As

Publication number Publication date
EP1485773A2 (de) 2004-12-15
US7246063B2 (en) 2007-07-17
AU2003215239A1 (en) 2003-09-09
EP1485773A4 (de) 2006-10-18
US20030156130A1 (en) 2003-08-21
ATE396446T1 (de) 2008-06-15
WO2003071385A2 (en) 2003-08-28
CN1643491A (zh) 2005-07-20
WO2003071385A3 (en) 2003-12-31
EP1485773B1 (de) 2008-05-21
AU2003215239A8 (en) 2003-09-09
CN100409173C (zh) 2008-08-06

Similar Documents

Publication Publication Date Title
DE60321145D1 (de) Sprachgesteuerte benutzeroberfläche
DE60318021D1 (de) Sprachgesteuerte dateneingabe
MY142974A (en) Semantic object synchronous understanding implemented with speech application language tags
DE60045473D1 (de) Spracherkennungsverfahren zur aktivierung von internet-hyperlinks
DE60125397D1 (de) Sprachunabhängige stimmbasierte benutzeroberfläche
CA2490430A1 (en) Method and apparatus for automatically building conversational systems
DE602004018290D1 (de) Spracherkennungs- und korrektursystem, korrekturvorrichtung und verfahren zur erstellung eines lexikons von alternativen
DE60322985D1 (de) Text-zu-sprache-system und verfahren, computerprogramm dafür
WO2001053984A3 (en) Apparatus and method for context-based highlighting of an electronic document
ATE426887T1 (de) Globale sprachbenutzerschnittstelle
ATE239336T1 (de) Verfahren und vorrichtung zur konfiguration eines spracherkennungssystems
WO2007008798A3 (en) System and method for searching for network-based content in a multi-modal system using spoken keywords
ATE470929T1 (de) Mehrere spracherkennungs-engine
WO2003054731A3 (de) Verfahren zur rechnergestützten transformation strukturierter dokumente
WO2006076077A3 (en) Device user interface through recognized text and bounded areas
ATE527652T1 (de) Mehrstufige spracherkennung
TW200703233A (en) Natural language business system and method based on unisolated performance metric
ATE514162T1 (de) Dynamische erzeugung von kontexten zur spracherkennung
WO2006062707A3 (en) System and method for speech recognition-enabled automated call routing
MY137374A (en) Dialog recognition and control in a voice browser
BR0214042A (pt) Método para pré-processar um dicionário de pronúncia para compressão em um dispositivo de processamento de dados, dispositivo eletrônico para converter uma entrada de uma cadeia de textos em uma seqüência de unidades de fonemas, dispositivo eletrônico configurado para converter a entrada de informação de voz em uma seqüência de unidades de caracter, sistema compreendendo o primeiro e o segundo dispositivos eletrônicos, e, programa de computador
WO2007001637A3 (en) Using strong data types to express speech recognition grammars in software programs
EP1152326A3 (de) Verfahren zur Ausführung kontinuierlicher Spracherkennung als Alternativeingabegerät zu verarbeitungsleistungsbegrenzten Einheiten
EP1542467A4 (de) Videoeingabeeinrichtung zur konversation mit zeichensprache, video-e/a-einrichtung zur konversation mit zeichensprache und zeichenspracheinterpretationssystem
WO2002071393A8 (en) Natural language query system for accessing an information system

Legal Events

Date Code Title Description
8364 No opposition during term of opposition