CN1735929A - 用于通信系统的语音浏览器对话启用器 - Google Patents

用于通信系统的语音浏览器对话启用器 Download PDF

Info

Publication number
CN1735929A
CN1735929A CNA2004800020601A CN200480002060A CN1735929A CN 1735929 A CN1735929 A CN 1735929A CN A2004800020601 A CNA2004800020601 A CN A2004800020601A CN 200480002060 A CN200480002060 A CN 200480002060A CN 1735929 A CN1735929 A CN 1735929A
Authority
CN
China
Prior art keywords
voice
browser
voice browser
driver
segmentation
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CNA2004800020601A
Other languages
English (en)
Other versions
CN1333385C (zh
Inventor
詹姆斯·弗兰斯
乔纳森·恩格斯玛
迈克尔·皮尔斯
马克·兰道夫
杰罗姆·沃格迪斯
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Motorola Mobility LLC
Google Technology Holdings LLC
Original Assignee
Motorola Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Motorola Inc filed Critical Motorola Inc
Publication of CN1735929A publication Critical patent/CN1735929A/zh
Application granted granted Critical
Publication of CN1333385C publication Critical patent/CN1333385C/zh
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M3/00—Automatic or semi-automatic exchanges
    • H04M3/42—Systems providing special services or facilities to subscribers
    • H04M3/487—Arrangements for providing information services, e.g. recorded voice services or time announcements
    • H04M3/493—Interactive information services, e.g. directory enquiries ; Arrangements therefor, e.g. interactive voice response [IVR] systems or voice portals
    • H04M3/4938—Interactive information services, e.g. directory enquiries ; Arrangements therefor, e.g. interactive voice response [IVR] systems or voice portals comprising a voice browser which renders and interprets, e.g. VoiceXML
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/28—Constructional details of speech recognition systems
    • G10L15/30—Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F15/00—Digital computers in general; Data processing equipment in general
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/26—Speech to text systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72445—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality for supporting Internet browser applications
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M2207/00—Type of exchange or network, i.e. telephonic medium, in which the telephonic communication takes place
    • H04M2207/40—Type of exchange or network, i.e. telephonic medium, in which the telephonic communication takes place terminals with audio html browser
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M2250/00—Details of telephonic subscriber devices
    • H04M2250/74—Details of telephonic subscriber devices with voice recognition means

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • Computational Linguistics (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Software Systems (AREA)
  • Mathematical Physics (AREA)
  • Databases & Information Systems (AREA)
  • Computer Hardware Design (AREA)
  • Data Mining & Analysis (AREA)
  • Telephonic Communication Services (AREA)

Abstract

一种用于多模式对话的语音浏览器对话启用器，它使用的是多模式标记文档(22)，该文档具有与各个字段关联并定义了分段(45)的基于标记的表单。语音浏览器驱动器(43)驻留在通信设备(10)上，并且提供了分段(45)和识别分段(45)的标识符(48)。语音浏览器执行器(46)驻留在远程语音服务器(38)上，它从驱动器(43)接收分段并且下载多个语音语法。输入语音依照这些语音语法来进行匹配，其中所述语法与接收自语音浏览器驱动器(43)的识别请求中的相应标识符(48)相关联。

Description

用于通信系统的语音浏览器对话启用器
发明领域
本发明涉及的是对无线电通信设备的工作模式进行控制。更为特别的是，本发明涉及一种用于在不同系统中操作多模式无线电通信设备的方法。
发明背景
诸如蜂窝电话之类的无线电通信设备具有不断发展的处理能力，随之还具有运行于其上的软件应用。然而举例来说，设备的尺寸使之很难附加那些通常可用于计算机的用户接口硬件。蜂窝电话只具有很小的键盘和显示器。然而，目前已经开发了多种技术，以便利用蜂窝电话固有的基本语音通信能力。很明显，随着包括互联网应用在内的数据服务的来临，语音激活服务可以极大增强通信设备的功能。为此目的，目前已经开发了语音可扩展标记语言(VoiceXML)，以便促进无线通信设备的语音激活服务。然而，随着消费者可用的语音激活服务的出现，产生了某些关于便携通信设备的严重问题。
在与多模式服务结合使用时，语音激活服务提出了非常困难的挑战。在多模式对话中，输入可能来自言语、键盘、鼠标以及其他输入形式，并且输出可以是扬声器、显示器以及其他输出形式。标准的万维网浏览器实施的是键盘和鼠标输入以及显示器输出。标准的语音浏览器则实施语音输入和音频输出。多模式系统需要将这两种浏览器(有可能包含其他浏览器)以某种形式加以组合。通常，这需要多种技术来对具有不同模式的应用进行适当的同步。并且在3GPP TR22.977，“3rd Generation Partnership Project；Technical Specification GroupServices and Systems Aspects；Feasibility study for speech enabledservices；(第6版)v2.0.0(2002-09)”中对其中某些技术进行了描述。
在第一种方法中，“具有本地语音资源的胖客户机”方法是将万维网(视觉)浏览器、语音浏览器以及基本语音辨识和语音合成(文字-语言)引擎置于同一设备上(计算机、移动电话、机顶盒等等)。由于需要大量的软件和处理能力，因此这种方法是无法在小型无线通信设备上实现的。第二种方法是“具有基于服务器的语音资源的胖客户机”，在该方法中，语音引擎处于网络上，而视觉浏览器和语音浏览器则仍旧处于设备上。在小型设备上，这种解决方案要比第一种解决方案稍微实用一些，但是仍旧难以在移动电话之类的小型设备上实现。第三种方法则是“瘦客户机”，其中设备只具有视觉浏览器，并且该浏览器必须与网络上的语音浏览器以及语音引擎进行协调。这种方法适合移动电话之类的设备，但是需要在两个被协调的浏览器之间保持同步，由此使得整个系统非常复杂。
所有这些方法还存在一个问题，那就是这些解决方案要么不适合置于更小的设备上，要么需要进行复杂的同步。
由此需要缓解这个将语音浏览器技术以及多模式技术引入无线通信设备的问题。此外，较为有益的是提供一种无需扩展通信设备处理能力就能解决该问题的解决方案。此外，较为利的是在没有向通信设备增加任何显著和附加硬件或成本的情况下避免复杂性。
附图简述
图1显示的是第一现有技术中的多模式通信系统的框图；
图2显示的第二现有技术中的多模式通信系统的框图；
图3显示的第三现有技术中的多模式通信系统的框图；
图4显示的是依照本发明并具有改进的语音浏览器的多模式通信系统的框图；以及
图5是描述依照本发明优选实施例来执行多模式对话的步骤的流程图。
优选实施例详述
本发明将语音浏览器应用分为两个组件，而不是将其视为单一整体。这样一来，设备上的软件数量将会大为减少，由此与别的方式相比，本发明允许在更小的设备上以更低的费用来执行多模式对话。通过在设备上执行浏览器同步，可以避免现有技术解决方案的高复杂性。此外，通过提供公用的语音浏览器驱动器，可以将多模式应用编写为独立程序而不是浏览器应用。在通信设备中，这种改进是以非常低的费用来完成的。与通过增加成本和增大设备尺寸来提高处理能力所不同，本发明有利地将通信设备的现有处理能力与多模式对话中需要的语音浏览器的软件解决方案结合在一起加以使用。
参考图1，该图提供的是现有技术架构，在这个架构中，大多数或所有用于多模式通信的处理都是在脱离(瘦)通信设备的情况下完成的。应该理解的是，要想恰当操作多模式对话，则需要更多相互连接，但是为了清楚起见，在这里并未显示这些相互连接。在所示实施例中，客户通信设备10希望访问应用服务器18上给出的多模式应用。通常，应用服务器18在因特网上是使用现有的常驻网络服务器20来进行通信的。例如，在服务供应商的通信系统中，多模式/语音服务器14与因特网16相耦合并为蜂窝网络12提供服务，蜂窝网络12则转而耦合到客户通信设备10。网络服务器提供了多模式标记文档22，其中包括视觉(XHTML)标记和语音(VoiceXML)标记，以便提供与用户对接的接口。如所示，XHTML标记文件是视觉表单，它可以提供若干个用于与用户交互信息的字段。举个例子，用户可以指向并点击“无线电按钮”字段，以便指示一种选择，此外也可以将文本键入空白字段，以便输入信息。VoiceXML结合XHTML来进行工作，以便提供用于将信息输入标记文档字段的语音接口。例如，VoiceXML标记可以指定一个要求用户将信息输入字段的音频提示符。然后，用户可以说话(如果需要的话，也可以输入文本)，语音浏览器VoiceXML则侦听并转换这些言语，并且将其与定义了关于该提示的可接受响应的VoiceXML标记所规定或引用的语法相比较。VoiceXML标记可以与文档的任何字段、也就是焦点字段相关联。并且在现有标准中已经规定了包括XHTML和VoiceXML在内的标记文档的操作。
蜂窝网络12借助了编解码器28来为客户设备10提供标准的音频输入和输出，如在现有技术中已知的那样，所述编解码器使用了在RTF或类似传输协议中标准化的音频分组，并且包含了分布式语音识别(DSR)。此外，网络12还提供了用于向客户设备的视觉浏览器26供应多模式信息的信道。多模式信息则是作为XHTML文件24来传送的。在这个实例中，多模式/语音服务器14分解并组合客户设备10与网络服务器20之间通信的语音(VoiceXML)和视觉(XHTML)部分。这种分解和组合需要进行协调，并且这种协调是借助多模式同步蜂窝文档22的语音和视觉部分提供的，由此客户设备是以一种符合信息的语音部分的方式来接收和给出多模式信息的。客户设备借助了常驻的视觉浏览器26来处理多模式信息24，同时还通过现有技术中已知的编解码器28来处理音频分组信息。语音和视觉信息的分离处理可以导致某些需要用到本地互锁的协调问题，如果希望的话，这类互锁问题会为用户提供正确的操作。例如，用户可以在确定字段焦点之前按下按钮。在确定字段焦点之前，本地互锁可以冻结屏幕。作为另一个实例，当在客户设备上显示XHTML表单并输入了语音信息的时候，本地设备可以封锁设备屏幕。用户在表单的同一字段提供文本信息将会导致经由多模式/语音服务器14的冲突语音和文本信息进行竞争，而屏幕封锁则可以阻止这种用户行为。
多模式/语音服务器14包含了用于与客户设备10交换多模式信息的大多数或全部处理。这类处理由同步管理器30进行控制。同步管理器30将文档22分解或拆分成语音对话信息32(例如VoiceXML)以及多模式信息(XHTML)，并且按照上述方式来对这些信息进行同步。语音对话信息将会传送到语音浏览器34，以便与服务器14上的语音引擎36对接，由此为客户设备10提供适当格式的音频信息。然而不幸的是，这种同步需要两个浏览器26、34保持协调，由此导致整个系统非常复杂，并且还需要在客户设备10上执行本地锁定。另外，在这里不但需要专用的多模式服务器14，而且还需要用于对浏览器进行同步的特定协议。
正如在现有技术中已知的那样，语音引擎36将会回放音频并提供语音识别。语音引擎的计算范围很大，并且需要大量的随机存取存储器(RAM)。在无线电话这类客户设备上，这些资源通常是无法得到的，因此本实例中使用了单独的多模式/语音服务器14。语音浏览器34是一个更高层处理器，它对对话进行处理、获取标记文档的相关事件、指示语音引擎播放语音提示以及侦听语音响应。然后，语音引擎会向语音浏览器的匹配表单字段发送语音响应。例如，XHTML文档上的字段可能需要“是”或“否”的响应，并且这些响应是唯一可以接受的响应。语音引擎会将引入的语音输入映射成一个识别结果，该结果可以表示当前的一个或多个语法所允许的已认定话语，也可以表示一个错误码。然后，它会将识别结果传送到语音浏览器，该浏览器随后则通过更新其内部状态来反映这个结果，并且其中有可能通过将这些言语指定到某个特定字段来反映该结果。语音浏览器转而向同步管理器通告识别结果。在这种情况下，语音引擎会尝试将语音响应与可接受语法列表中的“是”或“否”响应进行匹配，并且将结果转发给语音浏览器，所述浏览器则将“是/否”结果指定到恰当的字段并且通知同步管理器。
同步管理器30向万维网和语音浏览器告知当前被作用的是文档中的什么字段，以便协调响应。换句话说，同步管理器为浏览器确定焦点字段。虽然从字面上看这并不是同步，但其效果却是相同的。通过定义，多模式对话可以在字段中包含一个有效响应，这个响应可以借助了编解码器28的音频，也可以是借助了视觉浏览器26的按键文本输入。同步管理器对发生这些事件的概率进行处理，以便提供多模式信息的协调变换。
图2显示的是一种现有技术架构，其中大多数或所有用于多模式通信的处理都是在(胖)通信设备上完成的。与先前一样，客户通信设备10希望访问应用服务器18上给出的多模式应用，其中应用服务器18使用了常驻的网络服务器20来进行通信。网络服务器20则提供了直接与客户设备10进行的多模式标记文档22的交换(通常借助了蜂窝网络12，该网络通过服用供应商来提供因特网连接，例如通用分组无线服务或GPRS)。现在，先前实例中的所有多模式/语音服务器处理都驻留在客户设备10上并且按照先前所述的方式来工作。然而不幸的是，(胖)设备10现在需要极大扩展其处理能力和存储器，这其中的费用将会很高。
图3显示的是一种现有技术架构，其中某些用于多模式通信的处理是在远端完成的，由此适应通信设备10上的有限处理和存储限制。与先前一样，客户通信设备10希望访问应用服务器18上给出的多模式应用，该应用服务器18则使用常驻的网络服务器20来进行通信。网络服务器20提供了直接与客户设备10进行的多模式文件22的交换(通常借助于蜂窝网络12，其中该网络通过服务供应商来提供因特网连接)。先前实例中的大多数多模式/语音服务器处理仍旧驻留在客户设备10上，并且是像先前所述的那样来工作的。然而，远程语音服务器38现在具有驻留在其上的语音引擎36。并且现有的服务供应商或企业可以提供远程语音服务器38。语音浏览器34借助于指定的介质资源控制协议(MRCP)来与语音引擎36进行通信。然而不幸的是，实际上，具有远程资源的(胖)设备10仍旧需要扩展的处理能力和存储器，这其中的成本仍旧过高。此外，在语音浏览器与语音引擎之间将会传送大量代码，这会加重网络负担并且放慢通信。
在最简单的实施例中，本发明是通信系统的语音浏览器对话启动器。语音浏览器启用器包括一个语音识别应用，该应用包含了多个应用交互单元，这些单元是多个相关用户接口输入部件。其中举例来说，如果用户希望在通信录中创建新的地址条目，那么他们需要输入姓名和电话号码。在这种情况下，应用交互单元是两个紧密相关的输入字段(即姓名字段和地址字段)。每一个应用交互单元都具有用于定义分段的相关语音对话表单。例如，语音识别应用可以是一个处理XHTML+VoiceXML文档的多模式浏览应用。每一个XHTML+VoiceXML文档都设立了一个单独的应用交互单元，并且包含了与一个或多个字段相关联的一个或多个VoiceXML表单。每一个VoiceXML表单都定义了一个分段。驻留在通信设备上的语音浏览器驱动器则提供了源自应用的分段并且产生了用于识别分段的标识符。驻留在远程语音服务器上的语音浏览器执行器接收来自语音浏览器驱动器的分段，并且下载多个语音语法，其中后续输入语音是对照这些语法来进行匹配的，并且这些语法与源自语音浏览器驱动器的语音识别请求中的相应标识符是关联的。
图4显示的是依照本发明并使用语音浏览器启用器来促成多模式对话的语音浏览器的实际结构。在这个实例中，应用服务器18、网络服务器20、因特网连接16以及标记文档22与先前描述的是相同的，但是在这里显示了更多的细节，以便更好地说明本发明，并且其中对语音浏览器的功能进行了划分。例如，标记文档22还包含了用于显示语音语法和音频文件方向的URL。此外，语音引擎36与先前描述的引擎是相同的，但是在这里则具有更多的细节。其中举例来说，如本领域中已知的那样，语音引擎36包含了与应用服务器提供的语音语法结合使用的语音识别单元40，以及可以提供源自被记录音频URL的音频提示或是文本-语音(TSS)的媒体服务器42。
本发明的一个新颖方面在于本发明将语音浏览器分成了通信设备上的语音浏览器“占位器”44以及远程语音服务器38上的语音浏览器“执行器”46。在优选实施例中则将语音浏览器占位器44细分为与语音浏览器执行器46对接的语音浏览器驱动器43以及用于协调语音浏览器占位器44和视觉浏览器26的同步器47。作为选择，同步器47依据用户是否对编解码器28说话(输入同步)来启用和禁用可视觉浏览器27的输入。对语音浏览器占位器进行这种细分将允许使用在客户设备上运行的独立应用(例如J2ME应用)，以此替换视觉浏览器27和/或同步器47，此外还允许重新使用语音浏览器占位器44的剩余部分的能力。
本发明的另一个新颖方面在于视觉浏览器27现在将对完整的标记文档、语音以及音频进行操作，由此不再需要远程同步。结果，与现有技术中的同步管理器(在先前各图中显示为30)相比，该同步器47具有更小并且更简单的实施方式。此外，语音浏览器43、46并不像现有技术中那样使用输入字段和值。取而代之的是，语音浏览器将会与焦点字段合作。如下所述，这样有助于简化语音浏览器实施器46。
在操作中，在从网络服务器20那里提取了多模式标记文档22之后，视觉浏览器会将其拷贝发送到语音浏览器占位器。视觉浏览器将其拷贝发送到语音浏览器占位器。语音浏览器占位器44则从文档中分离或断开语音浏览器标记(例如VoiceXML)，由此产生可显示标记(例如XHTML)以及语音浏览器标记(例如VoiceXML)。然后，语音浏览器占位器44将视觉标记发送到视觉浏览器，以便对其进行处理并且将其显示在前述客户设备上。然而，语音浏览器占位器44的语音浏览器驱动器43是以不同于现有技术的实施方式来对语音浏览器标记进行操作的。在本发明中，语音浏览器驱动器对标记文档分段进行操作。分段则是单独的VoiceXML表单(不与XHTML表单混淆；虽然与XHTML表单类似，但其间并没有一一对应的关系)，它可以被视为是较大的XHTML+VoiceXML文档的相应部分。在VoiceXML中，表单只是一个用于提示用户的对话单元，它通常以这种形式填充一个或多个字段。在XHTML表单中，单独的输入字段可以具有单独的VoiceXML表单或是与之相关的分段。此外，一组密切关联的XHTML表单还可以具有能够填充所有XHTML表单输入的单个VoiceXML表单。与现有技术中对表单和值的整个文档进行操作的语音浏览器不同，该语音浏览器驱动器一次只对标记文档中的一个聚焦字段或分段进行操作。
此外，由于在文档的报头部分已经将这些表单/分段收集在一起，因此，要想从XHTML+VoiceXML文档中产生VoiceXML表单/分段将是非常困难的，这样一来，与现有技术中的语音浏览器相比，该语音浏览器驱动器将会使用更少的处理。对语音浏览器驱动器而言，它要做的就是找出分段/表单，将唯一的标识符与之关联(如下所述)，并使语音浏览器占位器对其进行封装，以便将其传送到语音浏览器执行器。标识符则是唯一识别单个VoiceXML表单的字串(其中只有在提供给语音浏览器执行器的分段集合范围内才需要这种唯一性，这种唯一性是从单个多模式标记文档中产生的)。使用分段和标识符将会减少在客户设备10与远程服务器38之间经由网络12传送的数据量。
特别地，对所聚焦的字段而言，其中将会关联一个分段。应该指出的是，不管字段是XHTML还是VoiceXML，语音浏览器驱动器都可以进行操作。例如，XHTML表单向用户询问街道地址。在这种情况下将会存在一个用于街道地址的文本字段(编号和街道)、另一个用于(可选)公寓编号的文本字段、另一个用于城市的文本字段，一个用于州的弹出式菜单以及一个用于邮编的最终文本字段。现在，假设给出这种XHTML表单，那么将会存在一组通过合作来填充这些字段的VoiceXML表单。例如，其中一个VoiceXML表单能够填充街道地址和公寓编号字段，另一个VoiceXML表单可用于填充城市和州的字段，并且第三个VoiceXML表单可以填充邮编。而这些表单则被定义为页面分段。
这三个VoiceXML表单中的每一个都具有自己的唯一标识符(也就是指定的VoiceXML表单)。例如，这些标识符分别可以称为“street+apt”、“city+state”以及“zipeode”，“street+apt”这个VoiceXML标记包含了一个音频提示，在被激活的时候，该提示会使用户听到“saythe street address and apartment number”。此外还可以启用一种理解街道地址和可选公寓编号的语法。VoiceXML表单“city+state”则包含了一个与“say the city name and state”相类似的音频提示以及一种适用于该提示的语法。相似的情况同样适用于zipcode。
语音浏览器占位器将相关VoiceXML分段45的页面发送到语音浏览器执行器46。然后，当语音浏览器占位器44需要侦听用户输入时，它会向语音浏览器执行器46发送一个表明表单名称和标识符的识别请求48，以便进行识别。与先前一样，语音服务器38包含了语音语法，但在本实施例中发送的标识符将对语音浏览器执行器进行编码，以便只在“street+apt”、“city+state以及“zipcode”语法中进行搜索，从而找出与先前发送的语音之间的匹配关系。在这里可以只向话音服务器38发送一次VoiceXML并对其进行处理，然后则对其进行缓存。后续请求可以借助其标识符来识别所缓存的VoiceXML表单。由此可以免去对于传送和处理每一个请求的VoiceXML标记的需要。结果，语法搜索将会得到简化，从而节省处理能力和时间。在将用于文档中的街道+公寓字段的表单/分段标识符作为识别请求48发送到语音浏览器执行器的时候，语音浏览器执行器将会输入语音，并且语音浏览器46将会使用恰当语法来激活语音识别器40，从而搜索匹配关系，例如与输入语音“Main Street”的匹配关系。一旦发现匹配，则语音浏览器执行器会将用户言语作为文本(“M-a-i-n-S-t-r-e-e-t”)反向传送到语音浏览器驱动器43，以此作为识别结果49，这一点与现有技术相似。然后，语音浏览器占位器44获取该结果并且对视觉浏览器27进行更新，以便显示结果。虽然语音浏览器执行器46可以等同于现有技术中具有用于语音浏览器占位器的接口的语音浏览器，但由于语音浏览器现在只处理简单VoiceXML标记的小型分段，并且这其中并未使用VoiceXML语言中的众多标签和特征，因此本发明提供的是一种更简单的实施方式。
在实践中，语音浏览器占位器44可以同时向语音浏览器实施46发送页面中所有字段的相关分段45。然后，语音浏览器占位器44为所有聚焦字段协调多模式交互作用的语音部分，并且发送语音浏览器执行器46所需要的语音识别请求标识符，以及获取响应于该分段的识别结果。优选地，较为理想的是使识别请求48和识别结果48以标记为基础(例如XML)，而不是使用MRCP这类现有技术中使用的低级API。
图5可以结合图4来说明依照本发明的多模式对话交互。图5显示的是结合了标记文档中的两个文本字段所进行的简化交互，其中一个字段是用语音(A)填充的，另一个字段则是直接作为文本(B)填充的。应该了解的是，在多模式对话中可以使用多个语音字段或文本字段。例如，用户可以通过点击因特网地址来发起对话。这将会指示视觉浏览器向应用网络服务器20发送一个HTTP GET/POST请求50，以便获取51预期的标记文档22。该文档还包含了文档的可接受语法的URL，并且该文档是可以下载到语音服务器38的。一旦接收到文档，则视觉浏览器27将会运行该文档并在客户设备10的屏幕上显现该文档。然后，音频和视觉文档将被移交到语音浏览器占位器44，该占位器从文档中分离出语音(VoiceXML)标记。此外，语音浏览器占位器还对标记的VoiceXML表单(分段)进行识别，并且将这些分段发送到语音服务器38。这时，语音浏览器执行器46以及语音服务器38的语音引擎可以实施可选的背景检查，以便了解是否恰当构成文档，此外还可以对文档进行预处理(也就是编译)，获取/预处理(也就是编译、解码/编码)该文档可能引用的任何外部语音语法或音频提示，以及将文本合成为语音。
然后，用户将会选择所显示的标记文档中的定义了焦点53的字段。
视觉浏览器27接收焦点改变，正确地跳转到聚焦字段，并且将字段焦点传送到语音浏览器占位器44。然后，语音浏览器占位器44的语音浏览器驱动器43将表单字段焦点的标识符作为识别请求48发送54到话音服务器38，该服务器则确认该请求。这时，话音服务器38可选地向用户发送56作为实时流协议(RTF)音频分组57的一个或多个音频提示，从而提示用户执行语音输入。而音频则传递到客户设备的扬声器41音频源。然后，用户可以按下按键通话(PTT)按钮并且经由客户设备的编解码器28音频源而将语音58发送到语音服务器38，由此用语音做出响应。编解码器将语音作为RTF DSR分组59传递到语音服务器的语音引擎，该服务器则根据表单和字段的相关标识符来将语音匹配给可接受的语法，并且将一个文本响应作为识别结果发送到语音浏览器占位器44的语音浏览器驱动器43。语音浏览器占位器则与视觉浏览器27对接，以便更新设备的显示屏以及字段与值的映射关系。
用户还可以选择所显示文档中定义了焦点61的字段，以便输入文本。与先前一样，视觉浏览器27接收焦点变化，正确地跳转到所聚焦的字段，并且将字段焦点传送62到语音浏览器占位器44。然后，语音浏览器占位器44的语音浏览器驱动器将这个焦点字段的表单63作为识别请求传送到语音服务器44，而该服务器则会确认64该请求。假设在这里并未使用音频提示(虽然可以像先前所描述的那样使用该提示)，那么用户可以以输入文本65来作为响应，其中该响应将会直接更新字段与值的映射关系。一旦向网络服务器20提交了66表单数据(保持在字段与值的映射关系中)，则视觉浏览器还通过语音浏览器占位器44来向语音服务器发送取消命令67，以便指示语音服务器停止侦听语法。然后，对话处理自身可以重复执行。
本发明给出了一种使用有限资源来提供多模式对话的解决方案。本发明尤其适合在保持同步多模式通信的过程中使用。本方法提供了一种处理，它使用了通信设备上的最小限度的处理器和存储器需要来对语音浏览器的处理需要进行划分。这种处理只要使用最低限度的软件修改即可完成，其中并不需要外部同步或是专用的多模式服务器。
虽然在以上的说明书和附图中对本发明进行了描述和图示，但是应该理解，本说明书仅仅作为实例，并且本领域技术人员可以在不脱离本发明的较宽范围的情况下进行多种修改和改变。虽然本发明特别适合在便携蜂窝无线电电话中使用，但是本发明同样适用于任何通信设备中的多模式对话，这些设备包括寻呼机、电子管理器以及计算机。申请人的发明仅仅受到下列权利要求的限制。

Claims (10)

1.一种用于通信系统的语音浏览器对话启用器，该浏览器启用器包括：
语音识别应用，其中包括多个应用交互单元，其中每一个单元都具有用于定义分段的相关语音对话表单；
语音浏览器驱动器，该语音浏览器驱动器驻留在通信设备上；语音浏览器驱动器提供了来自应用的分段，并且产生了用于识别分段的标识符；以及
驻留在远程语音服务器上的语音浏览器执行器，该语音浏览器执行器接收来自语音浏览器驱动器的分段，并且下载多个语音语法，其中后续输入语音是对照这些语音语法来进行匹配的，并且这些语音语法与接收自语音浏览器驱动器的语音识别请求中的响应标识符是关联的。
2.权利要求1的语音浏览器启用器，其中语音识别请求和后续语音识别结构是基于标记的。
3.权利要求1的语音浏览器启用器，其中分段包含了所识别的表单的VoiceXML页面。
4.权利要求1的语音浏览器启用器，其中语音识别应用是对多模式标记文档进行处理的多模式浏览器，并且语音浏览器驱动器驻留在语音浏览器占位器上，该占位器对多模式标记文档进行操作，以便将多模式标记文档分成可显示的标记部分以及语音标记部分，其中语音浏览器驱动器和语音浏览器执行器可以对语音标记部分进行操作。
5.权利要求4的语音浏览器启用器，还包括具有网络服务器的因特网应用服务器，该服务器包含了多模式标记文档以及语音语法，并且还包括通信设备中的视觉浏览器，该浏览器可以对多模式标记文档的可显示标记部分以及语音标记部分进行操作。
6.一种结合通信系统中的语音浏览器来进行对话的方法，该方法包括以下步骤：
提供驻留在通信设备上的语音浏览器驱动器以及包含了驻留在远程语音服务器上的多个语音语法的语音浏览器执行器；
运行包含了多个应用交互单元的语音识别应用，其中每一个单元都具有用于定义分段的相关语音对话表单；
定义与各个分段相关联的标识符；
将分段提供给语音浏览器执行器；
聚焦到其中一个应用交互单元的分段上；
将语音识别请求从语音浏览器驱动器发送到语音浏览器执行器，其中该请求包含了与所聚焦字段相关联的表单的标识符；
输入并识别语音；
将语音与关联该标识符的可接受语音语法相匹配；以及
获取语音识别结果。
7.权利要求6的方法，其中发送步骤的语音识别请求以及获取步骤的语音识别结果是基于标记的，并且其中供应步骤还包括为语音浏览器执行器提供所识别的表单的VoiceXML页面。
8.权利要求6的方法，其中提供步骤包括将语音浏览器驱动器与同步器一起引入到语音浏览器占位器中，其中该占位器与语音浏览器执行器以及通信设备上的视觉浏览器对接。
9.权利要求6的方法，其中运行步骤包括下载多模式标记文档，以此作为语音识别应用文档。
10.权利要求6的方法，其中在运行步骤之后还包括将多模式标记文档分成可显示标记部分以及包含了交互单元的语音标记部分的步骤，其中后续步骤只用于文档的语音标记部分，并且其中提供步骤包括在通信设备中提供视觉浏览器，该浏览器可以对多模式标记文档的可显示标记部分以及语音标记部分进行操作。
CNB2004800020601A 2003-01-09 2004-01-08 用于通信系统的语音浏览器启用器 Expired - Lifetime CN1333385C (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US10/339,067 US7003464B2 (en) 2003-01-09 2003-01-09 Dialog recognition and control in a voice browser
US10/339,067 2003-01-09

Publications (2)

Publication Number Publication Date
CN1735929A true CN1735929A (zh) 2006-02-15
CN1333385C CN1333385C (zh) 2007-08-22

Family

ID=32711032

Family Applications (1)

Application Number Title Priority Date Filing Date
CNB2004800020601A Expired - Lifetime CN1333385C (zh) 2003-01-09 2004-01-08 用于通信系统的语音浏览器启用器

Country Status (8)

Country Link
US (1) US7003464B2 (zh)
EP (1) EP1588353B1 (zh)
KR (1) KR101027548B1 (zh)
CN (1) CN1333385C (zh)
MY (1) MY137374A (zh)
RU (1) RU2349970C2 (zh)
TW (1) TWI249729B (zh)
WO (1) WO2004064299A2 (zh)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101257538B (zh) * 2008-03-25 2010-09-29 华为技术有限公司 一种在浏览器中处理请求的方法、装置
CN101207585B (zh) * 2006-12-22 2011-04-27 国际商业机器公司 向文本交换形态添加上下文的方法和系统
CN101287043B (zh) * 2007-04-12 2011-05-25 纽昂斯通讯公司 用于提供与多模式应用之间的表达用户交互的方法和设备
CN101207586B (zh) * 2006-12-19 2012-01-11 纽奥斯通讯有限公司 用于实时自动通信的方法和系统
CN102629246A (zh) * 2012-02-10 2012-08-08 北京百纳信息技术有限公司 识别浏览器语音命令的服务器及浏览器语音命令识别方法
CN102968992A (zh) * 2012-11-26 2013-03-13 北京奇虎科技有限公司 用于浏览器的语音识别处理方法和浏览器
US8831950B2 (en) 2008-04-07 2014-09-09 Nuance Communications, Inc. Automated voice enablement of a web page
CN104240707A (zh) * 2012-11-26 2014-12-24 北京奇虎科技有限公司 用于浏览器的语音识别处理方法和浏览器
US9047869B2 (en) 2008-04-07 2015-06-02 Nuance Communications, Inc. Free form input field support for automated voice enablement of a web page

Families Citing this family (356)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8645137B2 (en) 2000-03-16 2014-02-04 Apple Inc. Fast, language-independent method for user authentication by voice
US7506022B2 (en) * 2001-05-04 2009-03-17 Microsoft.Corporation Web enabled recognition architecture
US7610547B2 (en) 2001-05-04 2009-10-27 Microsoft Corporation Markup language extensions for web enabled recognition
US7409349B2 (en) 2001-05-04 2008-08-05 Microsoft Corporation Servers for web enabled speech recognition
US8229753B2 (en) * 2001-10-21 2012-07-24 Microsoft Corporation Web server controls for web enabled recognition and/or audible prompting
US7711570B2 (en) * 2001-10-21 2010-05-04 Microsoft Corporation Application abstraction with dialog purpose
US6910911B2 (en) 2002-06-27 2005-06-28 Vocollect, Inc. Break-away electrical connector
US7260535B2 (en) * 2003-04-28 2007-08-21 Microsoft Corporation Web server controls for web enabled recognition and/or audible prompting for call controls
US20040230637A1 (en) * 2003-04-29 2004-11-18 Microsoft Corporation Application controls for speech enabled recognition
US20050010418A1 (en) * 2003-07-10 2005-01-13 Vocollect, Inc. Method and system for intelligent prompt control in a multimodal software application
US8311835B2 (en) * 2003-08-29 2012-11-13 Microsoft Corporation Assisted multi-modal dialogue
GB0328035D0 (en) * 2003-12-03 2004-01-07 British Telecomm Communications method and system
US7660400B2 (en) * 2003-12-19 2010-02-09 At&T Intellectual Property Ii, L.P. Method and apparatus for automatically building conversational systems
US7552055B2 (en) 2004-01-10 2009-06-23 Microsoft Corporation Dialog component re-use in recognition systems
US8160883B2 (en) * 2004-01-10 2012-04-17 Microsoft Corporation Focus tracking in dialogs
US7552225B2 (en) * 2004-04-28 2009-06-23 International Business Machines Corporation Enhanced media resource protocol messages
US20060015335A1 (en) * 2004-07-13 2006-01-19 Ravigopal Vennelakanti Framework to enable multimodal access to applications
GB0415925D0 (en) * 2004-07-16 2004-08-18 Koninkl Philips Electronics Nv Communication system and method
GB0415928D0 (en) * 2004-07-16 2004-08-18 Koninkl Philips Electronics Nv Communication method and system
US20060036770A1 (en) * 2004-07-30 2006-02-16 International Business Machines Corporation System for factoring synchronization strategies from multimodal programming model runtimes
US20060047511A1 (en) * 2004-09-01 2006-03-02 Electronic Data Systems Corporation System, method, and computer program product for content delivery in a push-to-talk communication system
US7739117B2 (en) * 2004-09-20 2010-06-15 International Business Machines Corporation Method and system for voice-enabled autofill
US8024194B2 (en) * 2004-12-08 2011-09-20 Nuance Communications, Inc. Dynamic switching between local and remote speech rendering
US9083798B2 (en) * 2004-12-22 2015-07-14 Nuance Communications, Inc. Enabling voice selection of user preferences
US20060136870A1 (en) * 2004-12-22 2006-06-22 International Business Machines Corporation Visual user interface for creating multimodal applications
US7751431B2 (en) * 2004-12-30 2010-07-06 Motorola, Inc. Method and apparatus for distributed speech applications
US20060219663A1 (en) * 2005-03-31 2006-10-05 Applied Materials, Inc. Metal CMP process on one or more polishing stations using slurries with oxidizers
US20060235694A1 (en) * 2005-04-14 2006-10-19 International Business Machines Corporation Integrating conversational speech into Web browsers
US20060253272A1 (en) * 2005-05-06 2006-11-09 International Business Machines Corporation Voice prompts for use in speech-to-speech translation system
US20060287858A1 (en) * 2005-06-16 2006-12-21 Cross Charles W Jr Modifying a grammar of a hierarchical multimodal menu with keywords sold to customers
US7917365B2 (en) * 2005-06-16 2011-03-29 Nuance Communications, Inc. Synchronizing visual and speech events in a multimodal application
US8090584B2 (en) * 2005-06-16 2012-01-03 Nuance Communications, Inc. Modifying a grammar of a hierarchical multimodal menu in dependence upon speech command frequency
US20060287865A1 (en) * 2005-06-16 2006-12-21 Cross Charles W Jr Establishing a multimodal application voice
US20070043868A1 (en) * 2005-07-07 2007-02-22 V-Enable, Inc. System and method for searching for network-based content in a multi-modal system using spoken keywords
KR100724868B1 (ko) 2005-09-07 2007-06-04 삼성전자주식회사 다수의 합성기를 제어하여 다양한 음성 합성 기능을제공하는 음성 합성 방법 및 그 시스템
US8677377B2 (en) 2005-09-08 2014-03-18 Apple Inc. Method and apparatus for building an intelligent automated assistant
US8073700B2 (en) 2005-09-12 2011-12-06 Nuance Communications, Inc. Retrieval and presentation of network service results for mobile device using a multimodal browser
US8015304B2 (en) * 2005-12-12 2011-09-06 International Business Machines Corporation Method to distribute speech resources in a media server
US8140695B2 (en) * 2005-12-12 2012-03-20 International Business Machines Corporation Load balancing and failover of distributed media resources in a media server
US20070274297A1 (en) * 2006-05-10 2007-11-29 Cross Charles W Jr Streaming audio from a full-duplex network through a half-duplex device
US7848314B2 (en) * 2006-05-10 2010-12-07 Nuance Communications, Inc. VOIP barge-in support for half-duplex DSR client on a full-duplex network
US9208785B2 (en) * 2006-05-10 2015-12-08 Nuance Communications, Inc. Synchronizing distributed speech recognition
US20070276651A1 (en) * 2006-05-23 2007-11-29 Motorola, Inc. Grammar adaptation through cooperative client and server based speech recognition
US8332218B2 (en) * 2006-06-13 2012-12-11 Nuance Communications, Inc. Context-based grammars for automated speech recognition
US7676371B2 (en) * 2006-06-13 2010-03-09 Nuance Communications, Inc. Oral modification of an ASR lexicon of an ASR engine
US9318108B2 (en) 2010-01-18 2016-04-19 Apple Inc. Intelligent automated assistant
US8145493B2 (en) * 2006-09-11 2012-03-27 Nuance Communications, Inc. Establishing a preferred mode of interaction between a user and a multimodal application
US8374874B2 (en) * 2006-09-11 2013-02-12 Nuance Communications, Inc. Establishing a multimodal personality for a multimodal application in dependence upon attributes of user interaction
US7957976B2 (en) 2006-09-12 2011-06-07 Nuance Communications, Inc. Establishing a multimodal advertising personality for a sponsor of a multimodal application
US8086463B2 (en) 2006-09-12 2011-12-27 Nuance Communications, Inc. Dynamically generating a vocal help prompt in a multimodal application
US8073697B2 (en) * 2006-09-12 2011-12-06 International Business Machines Corporation Establishing a multimodal personality for a multimodal application
US7827033B2 (en) * 2006-12-06 2010-11-02 Nuance Communications, Inc. Enabling grammars in web page frames
US7680816B2 (en) * 2006-12-22 2010-03-16 Verizon Patent And Licensing Inc. Method, system, and computer program product providing for multimodal content management
US7962963B2 (en) * 2006-12-22 2011-06-14 Verizon Patent And Licensing Inc. Multimodal resource management system
US8417529B2 (en) 2006-12-27 2013-04-09 Nuance Communications, Inc. System and methods for prompting user speech in multimodal devices
US8612230B2 (en) 2007-01-03 2013-12-17 Nuance Communications, Inc. Automatic speech recognition with a selection list
US8069047B2 (en) * 2007-02-12 2011-11-29 Nuance Communications, Inc. Dynamically defining a VoiceXML grammar in an X+V page of a multimodal application
US8150698B2 (en) * 2007-02-26 2012-04-03 Nuance Communications, Inc. Invoking tapered prompts in a multimodal application
US7801728B2 (en) 2007-02-26 2010-09-21 Nuance Communications, Inc. Document session replay for multimodal applications
US8713542B2 (en) * 2007-02-27 2014-04-29 Nuance Communications, Inc. Pausing a VoiceXML dialog of a multimodal application
US7809575B2 (en) * 2007-02-27 2010-10-05 Nuance Communications, Inc. Enabling global grammars for a particular multimodal application
US7822608B2 (en) * 2007-02-27 2010-10-26 Nuance Communications, Inc. Disambiguating a speech recognition grammar in a multimodal application
US9208783B2 (en) * 2007-02-27 2015-12-08 Nuance Communications, Inc. Altering behavior of a multimodal application based on location
US20080208586A1 (en) * 2007-02-27 2008-08-28 Soonthorn Ativanichayaphong Enabling Natural Language Understanding In An X+V Page Of A Multimodal Application
US20080208594A1 (en) * 2007-02-27 2008-08-28 Cross Charles W Effecting Functions On A Multimodal Telephony Device
US20080208589A1 (en) * 2007-02-27 2008-08-28 Cross Charles W Presenting Supplemental Content For Digital Media Using A Multimodal Application
US7840409B2 (en) * 2007-02-27 2010-11-23 Nuance Communications, Inc. Ordering recognition results produced by an automatic speech recognition engine for a multimodal application
US8938392B2 (en) * 2007-02-27 2015-01-20 Nuance Communications, Inc. Configuring a speech engine for a multimodal application based on location
US20090030685A1 (en) * 2007-03-07 2009-01-29 Cerra Joseph P Using speech recognition results based on an unstructured language model with a navigation system
US20110054895A1 (en) * 2007-03-07 2011-03-03 Phillips Michael S Utilizing user transmitted text to improve language model in mobile dictation application
US20090030691A1 (en) * 2007-03-07 2009-01-29 Cerra Joseph P Using an unstructured language model associated with an application of a mobile communication facility
US20110054899A1 (en) * 2007-03-07 2011-03-03 Phillips Michael S Command and control utilizing content information in a mobile voice-to-speech application
US8838457B2 (en) * 2007-03-07 2014-09-16 Vlingo Corporation Using results of unstructured language model based speech recognition to control a system-level function of a mobile communications facility
US20080221900A1 (en) * 2007-03-07 2008-09-11 Cerra Joseph P Mobile local search environment speech processing facility
US20090030687A1 (en) * 2007-03-07 2009-01-29 Cerra Joseph P Adapting an unstructured language model speech recognition system based on usage
US20090030688A1 (en) * 2007-03-07 2009-01-29 Cerra Joseph P Tagging speech recognition results based on an unstructured language model for use in a mobile communication facility application
US8635243B2 (en) * 2007-03-07 2014-01-21 Research In Motion Limited Sending a communications header with voice recording to send metadata for use in speech recognition, formatting, and search mobile search application
US10056077B2 (en) * 2007-03-07 2018-08-21 Nuance Communications, Inc. Using speech recognition results based on an unstructured language model with a music system
US20110054896A1 (en) * 2007-03-07 2011-03-03 Phillips Michael S Sending a communications header with voice recording to send metadata for use in speech recognition and formatting in mobile dictation application
US20110054898A1 (en) * 2007-03-07 2011-03-03 Phillips Michael S Multiple web-based content search user interface in mobile search application
US8949266B2 (en) * 2007-03-07 2015-02-03 Vlingo Corporation Multiple web-based content category searching in mobile search application
US20080221884A1 (en) * 2007-03-07 2008-09-11 Cerra Joseph P Mobile environment speech processing facility
US8886540B2 (en) * 2007-03-07 2014-11-11 Vlingo Corporation Using speech recognition results based on an unstructured language model in a mobile communication facility application
US20110060587A1 (en) * 2007-03-07 2011-03-10 Phillips Michael S Command and control utilizing ancillary information in a mobile voice-to-speech application
US8886545B2 (en) 2007-03-07 2014-11-11 Vlingo Corporation Dealing with switch latency in speech recognition
US8949130B2 (en) * 2007-03-07 2015-02-03 Vlingo Corporation Internal and external speech recognition use with a mobile communication facility
US20110054897A1 (en) * 2007-03-07 2011-03-03 Phillips Michael S Transmitting signal quality information in mobile dictation application
US20090030697A1 (en) * 2007-03-07 2009-01-29 Cerra Joseph P Using contextual information for delivering results generated from a speech recognition facility using an unstructured language model
US8843376B2 (en) 2007-03-13 2014-09-23 Nuance Communications, Inc. Speech-enabled web content searching using a multimodal browser
US7945851B2 (en) * 2007-03-14 2011-05-17 Nuance Communications, Inc. Enabling dynamic voiceXML in an X+V page of a multimodal application
US8515757B2 (en) 2007-03-20 2013-08-20 Nuance Communications, Inc. Indexing digitized speech with words represented in the digitized speech
US8670987B2 (en) * 2007-03-20 2014-03-11 Nuance Communications, Inc. Automatic speech recognition with dynamic grammar rules
US20080235029A1 (en) * 2007-03-23 2008-09-25 Cross Charles W Speech-Enabled Predictive Text Selection For A Multimodal Application
US8909532B2 (en) * 2007-03-23 2014-12-09 Nuance Communications, Inc. Supporting multi-lingual user interaction with a multimodal application
US8977255B2 (en) 2007-04-03 2015-03-10 Apple Inc. Method and system for operating a multi-function portable electronic device using voice-activation
US8788620B2 (en) * 2007-04-04 2014-07-22 International Business Machines Corporation Web service support for a multimodal client processing a multimodal application
US8862475B2 (en) * 2007-04-12 2014-10-14 Nuance Communications, Inc. Speech-enabled content navigation and control of a distributed multimodal browser
US8060371B1 (en) 2007-05-09 2011-11-15 Nextel Communications Inc. System and method for voice interaction with non-voice enabled web pages
US20090100340A1 (en) * 2007-10-10 2009-04-16 Microsoft Corporation Associative interface for personalizing voice data access
US10002189B2 (en) 2007-12-20 2018-06-19 Apple Inc. Method and apparatus for searching using an active ontology
US8370160B2 (en) * 2007-12-31 2013-02-05 Motorola Mobility Llc Methods and apparatus for implementing distributed multi-modal applications
US8386260B2 (en) 2007-12-31 2013-02-26 Motorola Mobility Llc Methods and apparatus for implementing distributed multi-modal applications
US9330720B2 (en) 2008-01-03 2016-05-03 Apple Inc. Methods and apparatus for altering audio output signals
USD626949S1 (en) 2008-02-20 2010-11-09 Vocollect Healthcare Systems, Inc. Body-worn mobile device
WO2009105652A2 (en) * 2008-02-22 2009-08-27 Vocollect, Inc. Voice-activated emergency medical services communication and documentation system
US8837465B2 (en) 2008-04-02 2014-09-16 Twilio, Inc. System and method for processing telephony sessions
CN102027721B (zh) 2008-04-02 2015-05-13 特维里奥公司 处理电话会话的系统和方法
US8996376B2 (en) 2008-04-05 2015-03-31 Apple Inc. Intelligent text-to-speech conversion
US8543404B2 (en) * 2008-04-07 2013-09-24 Nuance Communications, Inc. Proactive completion of input fields for automated voice enablement of a web page
US8082148B2 (en) * 2008-04-24 2011-12-20 Nuance Communications, Inc. Testing a grammar used in speech recognition for reliability in a plurality of operating environments having different background noise
US8214242B2 (en) * 2008-04-24 2012-07-03 International Business Machines Corporation Signaling correspondence between a meeting agenda and a meeting discussion
US8229081B2 (en) * 2008-04-24 2012-07-24 International Business Machines Corporation Dynamically publishing directory information for a plurality of interactive voice response systems
US9349367B2 (en) * 2008-04-24 2016-05-24 Nuance Communications, Inc. Records disambiguation in a multimodal application operating on a multimodal device
US8121837B2 (en) * 2008-04-24 2012-02-21 Nuance Communications, Inc. Adjusting a speech engine for a mobile computing device based on background noise
US10496753B2 (en) 2010-01-18 2019-12-03 Apple Inc. Automatically adapting user interfaces for hands-free interaction
US20100030549A1 (en) 2008-07-31 2010-02-04 Lee Michael M Mobile device having human language translation capability with positional feedback
WO2010040010A1 (en) 2008-10-01 2010-04-08 Twilio Inc Telephony web event system and method
US8676904B2 (en) 2008-10-02 2014-03-18 Apple Inc. Electronic devices with voice command and contextual data processing capabilities
US8386261B2 (en) 2008-11-14 2013-02-26 Vocollect Healthcare Systems, Inc. Training/coaching system for a voice-enabled work environment
EP2404412B1 (en) 2009-03-02 2019-05-01 Twilio Inc. Method and system for a multitenancy telephone network
US8509415B2 (en) 2009-03-02 2013-08-13 Twilio, Inc. Method and system for a multitenancy telephony network
US8380513B2 (en) * 2009-05-19 2013-02-19 International Business Machines Corporation Improving speech capabilities of a multimodal application
US10706373B2 (en) 2011-06-03 2020-07-07 Apple Inc. Performing actions associated with task items that represent tasks to perform
US9858925B2 (en) 2009-06-05 2018-01-02 Apple Inc. Using context information to facilitate processing of commands in a virtual assistant
US10241644B2 (en) 2011-06-03 2019-03-26 Apple Inc. Actionable reminder entries
US10241752B2 (en) 2011-09-30 2019-03-26 Apple Inc. Interface for a virtual digital assistant
US8290780B2 (en) 2009-06-24 2012-10-16 International Business Machines Corporation Dynamically extending the speech prompts of a multimodal application
US9431006B2 (en) 2009-07-02 2016-08-30 Apple Inc. Methods and apparatuses for automatic speech recognition
US8510117B2 (en) * 2009-07-09 2013-08-13 Nuance Communications, Inc. Speech enabled media sharing in a multimodal application
US8416714B2 (en) * 2009-08-05 2013-04-09 International Business Machines Corporation Multimodal teleconferencing
US8582737B2 (en) * 2009-10-07 2013-11-12 Twilio, Inc. System and method for running a multi-module telephony application
US20110083179A1 (en) * 2009-10-07 2011-04-07 Jeffrey Lawson System and method for mitigating a denial of service attack using cloud computing
US9210275B2 (en) 2009-10-07 2015-12-08 Twilio, Inc. System and method for running a multi-module telephony application
TWI413938B (zh) * 2009-12-02 2013-11-01 Phison Electronics Corp 情感引擎、情感引擎系統及電子裝置的控制方法
US10705794B2 (en) 2010-01-18 2020-07-07 Apple Inc. Automatically adapting user interfaces for hands-free interaction
US10276170B2 (en) 2010-01-18 2019-04-30 Apple Inc. Intelligent automated assistant
US10553209B2 (en) 2010-01-18 2020-02-04 Apple Inc. Systems and methods for hands-free notification summaries
US10679605B2 (en) 2010-01-18 2020-06-09 Apple Inc. Hands-free list-reading by intelligent automated assistant
US8638781B2 (en) * 2010-01-19 2014-01-28 Twilio, Inc. Method and system for preserving telephony session state
DE202011111062U1 (de) 2010-01-25 2019-02-19 Newvaluexchange Ltd. Vorrichtung und System für eine Digitalkonversationsmanagementplattform
US8548131B1 (en) 2010-02-03 2013-10-01 Tal Lavian Systems and methods for communicating with an interactive voice response system
US8548135B1 (en) 2010-02-03 2013-10-01 Tal Lavian Systems and methods for visual presentation and selection of IVR menu
US8903073B2 (en) 2011-07-20 2014-12-02 Zvi Or-Bach Systems and methods for visual presentation and selection of IVR menu
US8406388B2 (en) 2011-07-18 2013-03-26 Zvi Or-Bach Systems and methods for visual presentation and selection of IVR menu
US8537989B1 (en) 2010-02-03 2013-09-17 Tal Lavian Device and method for providing enhanced telephony
US8687777B1 (en) 2010-02-03 2014-04-01 Tal Lavian Systems and methods for visual presentation and selection of IVR menu
US8681951B1 (en) 2010-02-03 2014-03-25 Tal Lavian Systems and methods for visual presentation and selection of IVR menu
US8572303B2 (en) 2010-02-03 2013-10-29 Tal Lavian Portable universal communication device
US9001819B1 (en) 2010-02-18 2015-04-07 Zvi Or-Bach Systems and methods for visual presentation and selection of IVR menu
US8625756B1 (en) 2010-02-03 2014-01-07 Tal Lavian Systems and methods for visual presentation and selection of IVR menu
US8879698B1 (en) 2010-02-03 2014-11-04 Tal Lavian Device and method for providing enhanced telephony
US8594280B1 (en) 2010-02-03 2013-11-26 Zvi Or-Bach Systems and methods for visual presentation and selection of IVR menu
US8553859B1 (en) 2010-02-03 2013-10-08 Tal Lavian Device and method for providing enhanced telephony
US8682667B2 (en) 2010-02-25 2014-03-25 Apple Inc. User profiling for selecting user specific voice input processing information
CN102237087B (zh) * 2010-04-27 2014-01-01 中兴通讯股份有限公司 语音控制方法和语音控制装置
US9459926B2 (en) 2010-06-23 2016-10-04 Twilio, Inc. System and method for managing a computing cluster
US9590849B2 (en) 2010-06-23 2017-03-07 Twilio, Inc. System and method for managing a computing cluster
US9459925B2 (en) 2010-06-23 2016-10-04 Twilio, Inc. System and method for managing a computing cluster
US20120208495A1 (en) 2010-06-23 2012-08-16 Twilio, Inc. System and method for monitoring account usage on a platform
US8416923B2 (en) 2010-06-23 2013-04-09 Twilio, Inc. Method for providing clean endpoint addresses
US9338064B2 (en) 2010-06-23 2016-05-10 Twilio, Inc. System and method for managing a computing cluster
US8838707B2 (en) 2010-06-25 2014-09-16 Twilio, Inc. System and method for enabling real-time eventing
US8659397B2 (en) 2010-07-22 2014-02-25 Vocollect, Inc. Method and system for correctly identifying specific RFID tags
USD643400S1 (en) 2010-08-19 2011-08-16 Vocollect Healthcare Systems, Inc. Body-worn mobile device
USD643013S1 (en) 2010-08-20 2011-08-09 Vocollect Healthcare Systems, Inc. Body-worn mobile device
US9600135B2 (en) 2010-09-10 2017-03-21 Vocollect, Inc. Multimodal user notification system to assist in data capture
US8649268B2 (en) 2011-02-04 2014-02-11 Twilio, Inc. Method for processing telephony sessions of a network
CN102088696B (zh) * 2011-03-15 2015-04-29 广州市动景计算机科技有限公司 一种移动终端从目标服务器下载大文件的方法和系统
US9262612B2 (en) 2011-03-21 2016-02-16 Apple Inc. Device access using voice authentication
CN102781075B (zh) * 2011-05-12 2016-08-24 中兴通讯股份有限公司 一种降低移动终端通话功耗的方法及移动终端
US9398622B2 (en) 2011-05-23 2016-07-19 Twilio, Inc. System and method for connecting a communication to a client
US9648006B2 (en) 2011-05-23 2017-05-09 Twilio, Inc. System and method for communicating with a client application
US20140044123A1 (en) 2011-05-23 2014-02-13 Twilio, Inc. System and method for real time communicating with a client application
US10057736B2 (en) 2011-06-03 2018-08-21 Apple Inc. Active transport based notifications
US8994660B2 (en) 2011-08-29 2015-03-31 Apple Inc. Text correction processing
EP2759123B1 (en) 2011-09-21 2018-08-15 Twilio, Inc. System and method for authorizing and connecting application developers and users
US10182147B2 (en) 2011-09-21 2019-01-15 Twilio Inc. System and method for determining and communicating presence information
AU2012232977A1 (en) * 2011-09-30 2013-04-18 Apple Inc. Using context information to facilitate processing of commands in a virtual assistant
US9495227B2 (en) 2012-02-10 2016-11-15 Twilio, Inc. System and method for managing concurrent events
US8731148B1 (en) 2012-03-02 2014-05-20 Tal Lavian Systems and methods for visual presentation and selection of IVR menu
US10134385B2 (en) 2012-03-02 2018-11-20 Apple Inc. Systems and methods for name pronunciation
US8867708B1 (en) 2012-03-02 2014-10-21 Tal Lavian Systems and methods for visual presentation and selection of IVR menu
US9483461B2 (en) 2012-03-06 2016-11-01 Apple Inc. Handling speech synthesis of content for multiple languages
US9240941B2 (en) 2012-05-09 2016-01-19 Twilio, Inc. System and method for managing media in a distributed communication network
US9602586B2 (en) 2012-05-09 2017-03-21 Twilio, Inc. System and method for managing media in a distributed communication network
US20130304928A1 (en) 2012-05-09 2013-11-14 Twilio, Inc. System and method for managing latency in a distributed telephony network
US9280610B2 (en) 2012-05-14 2016-03-08 Apple Inc. Crowd sourcing information to fulfill user requests
US10417037B2 (en) 2012-05-15 2019-09-17 Apple Inc. Systems and methods for integrating third party services with a digital assistant
US9721563B2 (en) 2012-06-08 2017-08-01 Apple Inc. Name recognition system
US9247062B2 (en) 2012-06-19 2016-01-26 Twilio, Inc. System and method for queuing a communication session
US9495129B2 (en) 2012-06-29 2016-11-15 Apple Inc. Device, method, and user interface for voice-activated navigation and browsing of a document
US8737962B2 (en) 2012-07-24 2014-05-27 Twilio, Inc. Method and system for preventing illicit use of a telephony platform
US8738051B2 (en) 2012-07-26 2014-05-27 Twilio, Inc. Method and system for controlling message routing
US10157612B2 (en) 2012-08-02 2018-12-18 Nuance Communications, Inc. Methods and apparatus for voice-enabling a web application
US9292252B2 (en) * 2012-08-02 2016-03-22 Nuance Communications, Inc. Methods and apparatus for voiced-enabling a web application
US9400633B2 (en) * 2012-08-02 2016-07-26 Nuance Communications, Inc. Methods and apparatus for voiced-enabling a web application
US9292253B2 (en) * 2012-08-02 2016-03-22 Nuance Communications, Inc. Methods and apparatus for voiced-enabling a web application
US9781262B2 (en) 2012-08-02 2017-10-03 Nuance Communications, Inc. Methods and apparatus for voice-enabling a web application
US9547647B2 (en) 2012-09-19 2017-01-17 Apple Inc. Voice-based media searching
US8938053B2 (en) 2012-10-15 2015-01-20 Twilio, Inc. System and method for triggering on platform usage
US8948356B2 (en) 2012-10-15 2015-02-03 Twilio, Inc. System and method for routing communications
US9253254B2 (en) 2013-01-14 2016-02-02 Twilio, Inc. System and method for offering a multi-partner delegated platform
KR20240132105A (ko) 2013-02-07 2024-09-02 애플 인크. 디지털 어시스턴트를 위한 음성 트리거
US9282124B2 (en) 2013-03-14 2016-03-08 Twilio, Inc. System and method for integrating session initiation protocol communication in a telecommunications platform
US9001666B2 (en) 2013-03-15 2015-04-07 Twilio, Inc. System and method for improving routing in a distributed communication platform
US9582608B2 (en) 2013-06-07 2017-02-28 Apple Inc. Unified ranking with entropy-weighted information for phrase-based semantic auto-completion
WO2014197334A2 (en) 2013-06-07 2014-12-11 Apple Inc. System and method for user-specified pronunciation of words for speech synthesis and recognition
WO2014197336A1 (en) 2013-06-07 2014-12-11 Apple Inc. System and method for detecting errors in interactions with a voice-based digital assistant
WO2014197335A1 (en) 2013-06-08 2014-12-11 Apple Inc. Interpreting and acting upon commands that involve sharing information with remote devices
US10176167B2 (en) 2013-06-09 2019-01-08 Apple Inc. System and method for inferring user intent from speech inputs
KR101772152B1 (ko) 2013-06-09 2017-08-28 애플 인크. 디지털 어시스턴트의 둘 이상의 인스턴스들에 걸친 대화 지속성을 가능하게 하기 위한 디바이스, 방법 및 그래픽 사용자 인터페이스
US9240966B2 (en) 2013-06-19 2016-01-19 Twilio, Inc. System and method for transmitting and receiving media messages
US9225840B2 (en) 2013-06-19 2015-12-29 Twilio, Inc. System and method for providing a communication endpoint information service
US9338280B2 (en) 2013-06-19 2016-05-10 Twilio, Inc. System and method for managing telephony endpoint inventory
US9483328B2 (en) 2013-07-19 2016-11-01 Twilio, Inc. System and method for delivering application content
US9137127B2 (en) 2013-09-17 2015-09-15 Twilio, Inc. System and method for providing communication platform metadata
US9338018B2 (en) 2013-09-17 2016-05-10 Twilio, Inc. System and method for pricing communication of a telecommunication platform
US9274858B2 (en) 2013-09-17 2016-03-01 Twilio, Inc. System and method for tagging and tracking events of an application platform
US9325624B2 (en) 2013-11-12 2016-04-26 Twilio, Inc. System and method for enabling dynamic multi-modal communication
US9553799B2 (en) 2013-11-12 2017-01-24 Twilio, Inc. System and method for client communication in a distributed telephony network
US10296160B2 (en) 2013-12-06 2019-05-21 Apple Inc. Method for extracting salient dialog usage from live data
US9344573B2 (en) 2014-03-14 2016-05-17 Twilio, Inc. System and method for a work distribution service
US9226217B2 (en) 2014-04-17 2015-12-29 Twilio, Inc. System and method for enabling multi-modal communication
US10078631B2 (en) 2014-05-30 2018-09-18 Apple Inc. Entropy-guided text prediction using combined word and character n-gram language models
US9760559B2 (en) 2014-05-30 2017-09-12 Apple Inc. Predictive text input
US9633004B2 (en) 2014-05-30 2017-04-25 Apple Inc. Better resolution when referencing to concepts
US9715875B2 (en) 2014-05-30 2017-07-25 Apple Inc. Reducing the need for manual start/end-pointing and trigger phrases
CN110797019B (zh) 2014-05-30 2023-08-29 苹果公司 多命令单一话语输入方法
US10170123B2 (en) 2014-05-30 2019-01-01 Apple Inc. Intelligent assistant for home automation
US9842101B2 (en) 2014-05-30 2017-12-12 Apple Inc. Predictive conversion of language input
US9430463B2 (en) 2014-05-30 2016-08-30 Apple Inc. Exemplar-based natural language processing
US9785630B2 (en) 2014-05-30 2017-10-10 Apple Inc. Text prediction using combined word N-gram and unigram language models
US10659851B2 (en) 2014-06-30 2020-05-19 Apple Inc. Real-time digital assistant knowledge updates
US9338493B2 (en) 2014-06-30 2016-05-10 Apple Inc. Intelligent automated assistant for TV user interactions
US9251371B2 (en) 2014-07-07 2016-02-02 Twilio, Inc. Method and system for applying data retention policies in a computing platform
US9246694B1 (en) 2014-07-07 2016-01-26 Twilio, Inc. System and method for managing conferencing in a distributed communication network
US9774687B2 (en) 2014-07-07 2017-09-26 Twilio, Inc. System and method for managing media and signaling in a communication platform
US9516101B2 (en) 2014-07-07 2016-12-06 Twilio, Inc. System and method for collecting feedback in a multi-tenant communication platform
US10446141B2 (en) 2014-08-28 2019-10-15 Apple Inc. Automatic speech recognition based on user feedback
US9818400B2 (en) 2014-09-11 2017-11-14 Apple Inc. Method and apparatus for discovering trending terms in speech requests
US10789041B2 (en) 2014-09-12 2020-09-29 Apple Inc. Dynamic thresholds for always listening speech trigger
US9646609B2 (en) 2014-09-30 2017-05-09 Apple Inc. Caching apparatus for serving phonetic pronunciations
US10127911B2 (en) 2014-09-30 2018-11-13 Apple Inc. Speaker identification and unsupervised speaker adaptation techniques
US9886432B2 (en) 2014-09-30 2018-02-06 Apple Inc. Parsimonious handling of word inflection via categorical stem + suffix N-gram language models
US9668121B2 (en) 2014-09-30 2017-05-30 Apple Inc. Social reminders
US10074360B2 (en) 2014-09-30 2018-09-11 Apple Inc. Providing an indication of the suitability of speech recognition
EP3210350B1 (en) 2014-10-21 2020-05-20 Twilio, Inc. Method for providing a miro-services communication platform
US10552013B2 (en) 2014-12-02 2020-02-04 Apple Inc. Data detection
US9959129B2 (en) * 2015-01-09 2018-05-01 Microsoft Technology Licensing, Llc Headless task completion within digital personal assistants
RU2646350C2 (ru) * 2015-01-27 2018-03-02 Общество С Ограниченной Ответственностью "Яндекс" Способ ввода данных в электронное устройство, способ обработки голосового запроса, машиночитаемый носитель (варианты), электронное устройство, сервер и система
US9508339B2 (en) * 2015-01-30 2016-11-29 Microsoft Technology Licensing, Llc Updating language understanding classifier models for a digital personal assistant based on crowd-sourcing
US9477975B2 (en) 2015-02-03 2016-10-25 Twilio, Inc. System and method for a media intelligence platform
US9865280B2 (en) 2015-03-06 2018-01-09 Apple Inc. Structured dictation using intelligent automated assistants
US10152299B2 (en) 2015-03-06 2018-12-11 Apple Inc. Reducing response latency of intelligent automated assistants
US10567477B2 (en) 2015-03-08 2020-02-18 Apple Inc. Virtual assistant continuity
US9886953B2 (en) 2015-03-08 2018-02-06 Apple Inc. Virtual assistant activation
US9721566B2 (en) 2015-03-08 2017-08-01 Apple Inc. Competing devices responding to voice triggers
US9899019B2 (en) 2015-03-18 2018-02-20 Apple Inc. Systems and methods for structured stem and suffix language models
US9842105B2 (en) 2015-04-16 2017-12-12 Apple Inc. Parsimonious continuous-space phrase representations for natural language processing
US9948703B2 (en) 2015-05-14 2018-04-17 Twilio, Inc. System and method for signaling through data storage
US10419891B2 (en) 2015-05-14 2019-09-17 Twilio, Inc. System and method for communicating through multiple endpoints
US10460227B2 (en) 2015-05-15 2019-10-29 Apple Inc. Virtual assistant in a communication session
US10083688B2 (en) 2015-05-27 2018-09-25 Apple Inc. Device voice control for selecting a displayed affordance
US10127220B2 (en) 2015-06-04 2018-11-13 Apple Inc. Language identification from short strings
US10101822B2 (en) 2015-06-05 2018-10-16 Apple Inc. Language input correction
US9578173B2 (en) 2015-06-05 2017-02-21 Apple Inc. Virtual assistant aided communication with 3rd party service in a communication session
US11025565B2 (en) 2015-06-07 2021-06-01 Apple Inc. Personalized prediction of responses for instant messaging
US10186254B2 (en) 2015-06-07 2019-01-22 Apple Inc. Context-based endpoint detection
US10255907B2 (en) 2015-06-07 2019-04-09 Apple Inc. Automatic accent detection using acoustic models
US20160378747A1 (en) 2015-06-29 2016-12-29 Apple Inc. Virtual assistant for media playback
US10671428B2 (en) 2015-09-08 2020-06-02 Apple Inc. Distributed personal assistant
US10747498B2 (en) 2015-09-08 2020-08-18 Apple Inc. Zero latency digital assistant
US9697820B2 (en) 2015-09-24 2017-07-04 Apple Inc. Unit-selection text-to-speech synthesis using concatenation-sensitive neural networks
US10366158B2 (en) 2015-09-29 2019-07-30 Apple Inc. Efficient word encoding for recurrent neural network language models
US11010550B2 (en) 2015-09-29 2021-05-18 Apple Inc. Unified language modeling framework for word prediction, auto-completion and auto-correction
US11587559B2 (en) 2015-09-30 2023-02-21 Apple Inc. Intelligent device identification
US10691473B2 (en) 2015-11-06 2020-06-23 Apple Inc. Intelligent automated assistant in a messaging environment
US10049668B2 (en) 2015-12-02 2018-08-14 Apple Inc. Applying neural network language models to weighted finite state transducers for automatic speech recognition
US10223066B2 (en) 2015-12-23 2019-03-05 Apple Inc. Proactive assistance based on dialog communication between devices
US10659349B2 (en) 2016-02-04 2020-05-19 Twilio Inc. Systems and methods for providing secure network exchanged for a multitenant virtual private cloud
US10446143B2 (en) 2016-03-14 2019-10-15 Apple Inc. Identification of voice inputs providing credentials
US10372804B2 (en) 2016-05-17 2019-08-06 Bruce HASSEL Interactive audio validation/assistance system and methodologies
US10063713B2 (en) 2016-05-23 2018-08-28 Twilio Inc. System and method for programmatic device connectivity
US10686902B2 (en) 2016-05-23 2020-06-16 Twilio Inc. System and method for a multi-channel notification service
US9934775B2 (en) 2016-05-26 2018-04-03 Apple Inc. Unit-selection text-to-speech synthesis based on predicted concatenation parameters
US9972304B2 (en) 2016-06-03 2018-05-15 Apple Inc. Privacy preserving distributed evaluation framework for embedded personalized systems
US11227589B2 (en) 2016-06-06 2022-01-18 Apple Inc. Intelligent list reading
US10249300B2 (en) 2016-06-06 2019-04-02 Apple Inc. Intelligent list reading
US10049663B2 (en) 2016-06-08 2018-08-14 Apple, Inc. Intelligent automated assistant for media exploration
DK179588B1 (en) 2016-06-09 2019-02-22 Apple Inc. INTELLIGENT AUTOMATED ASSISTANT IN A HOME ENVIRONMENT
US10192552B2 (en) 2016-06-10 2019-01-29 Apple Inc. Digital assistant providing whispered speech
US10509862B2 (en) 2016-06-10 2019-12-17 Apple Inc. Dynamic phrase expansion of language input
US10490187B2 (en) 2016-06-10 2019-11-26 Apple Inc. Digital assistant providing automated status report
US10586535B2 (en) 2016-06-10 2020-03-10 Apple Inc. Intelligent digital assistant in a multi-tasking environment
US10067938B2 (en) 2016-06-10 2018-09-04 Apple Inc. Multilingual word prediction
DK201670540A1 (en) 2016-06-11 2018-01-08 Apple Inc Application integration with a digital assistant
DK179415B1 (en) 2016-06-11 2018-06-14 Apple Inc Intelligent device arbitration and control
DK179343B1 (en) 2016-06-11 2018-05-14 Apple Inc Intelligent task discovery
DK179049B1 (en) 2016-06-11 2017-09-18 Apple Inc Data driven natural language event detection and classification
US10474753B2 (en) 2016-09-07 2019-11-12 Apple Inc. Language identification using recurrent neural networks
US10043516B2 (en) 2016-09-23 2018-08-07 Apple Inc. Intelligent automated assistant
US11281993B2 (en) 2016-12-05 2022-03-22 Apple Inc. Model and ensemble compression for metric learning
US10593346B2 (en) 2016-12-22 2020-03-17 Apple Inc. Rank-reduced token representation for automatic speech recognition
US11204787B2 (en) 2017-01-09 2021-12-21 Apple Inc. Application integration with a digital assistant
US10417266B2 (en) 2017-05-09 2019-09-17 Apple Inc. Context-aware ranking of intelligent response suggestions
DK201770383A1 (en) 2017-05-09 2018-12-14 Apple Inc. USER INTERFACE FOR CORRECTING RECOGNITION ERRORS
DK201770439A1 (en) 2017-05-11 2018-12-13 Apple Inc. Offline personal assistant
US10395654B2 (en) 2017-05-11 2019-08-27 Apple Inc. Text normalization based on a data-driven learning network
US10726832B2 (en) 2017-05-11 2020-07-28 Apple Inc. Maintaining privacy of personal information
DK201770428A1 (en) 2017-05-12 2019-02-18 Apple Inc. LOW-LATENCY INTELLIGENT AUTOMATED ASSISTANT
DK179496B1 (en) 2017-05-12 2019-01-15 Apple Inc. USER-SPECIFIC Acoustic Models
DK179745B1 (en) 2017-05-12 2019-05-01 Apple Inc. SYNCHRONIZATION AND TASK DELEGATION OF A DIGITAL ASSISTANT
US11301477B2 (en) 2017-05-12 2022-04-12 Apple Inc. Feedback analysis of a digital assistant
DK201770431A1 (en) 2017-05-15 2018-12-20 Apple Inc. Optimizing dialogue policy decisions for digital assistants using implicit feedback
DK201770432A1 (en) 2017-05-15 2018-12-21 Apple Inc. Hierarchical belief states for digital assistants
DK179549B1 (en) 2017-05-16 2019-02-12 Apple Inc. FAR-FIELD EXTENSION FOR DIGITAL ASSISTANT SERVICES
US20180336275A1 (en) 2017-05-16 2018-11-22 Apple Inc. Intelligent automated assistant for media exploration
US10311144B2 (en) 2017-05-16 2019-06-04 Apple Inc. Emoji word sense disambiguation
US10403278B2 (en) 2017-05-16 2019-09-03 Apple Inc. Methods and systems for phonetic matching in digital assistant services
US10657328B2 (en) 2017-06-02 2020-05-19 Apple Inc. Multi-task recurrent neural network architecture for efficient morphology handling in neural language modeling
US10445429B2 (en) 2017-09-21 2019-10-15 Apple Inc. Natural language understanding using vocabularies with compressed serialized tries
US10755051B2 (en) 2017-09-29 2020-08-25 Apple Inc. Rule-based natural language processing
US10636424B2 (en) 2017-11-30 2020-04-28 Apple Inc. Multi-turn canned dialog
US10733982B2 (en) 2018-01-08 2020-08-04 Apple Inc. Multi-directional dialog
US10733375B2 (en) 2018-01-31 2020-08-04 Apple Inc. Knowledge-based framework for improving natural language understanding
US11776059B1 (en) 2018-02-19 2023-10-03 State Farm Mutual Automobile Insurance Company Voice analysis systems and methods for processing digital sound data over a communications network
US10789959B2 (en) 2018-03-02 2020-09-29 Apple Inc. Training speaker recognition models for digital assistants
US10592604B2 (en) 2018-03-12 2020-03-17 Apple Inc. Inverse text normalization for automatic speech recognition
US10818288B2 (en) 2018-03-26 2020-10-27 Apple Inc. Natural assistant interaction
US10909331B2 (en) 2018-03-30 2021-02-02 Apple Inc. Implicit identification of translation payload with neural machine translation
US10928918B2 (en) 2018-05-07 2021-02-23 Apple Inc. Raise to speak
US11145294B2 (en) 2018-05-07 2021-10-12 Apple Inc. Intelligent automated assistant for delivering content from user experiences
US10984780B2 (en) 2018-05-21 2021-04-20 Apple Inc. Global semantic word embeddings using bi-directional recurrent neural networks
DK201870355A1 (en) 2018-06-01 2019-12-16 Apple Inc. VIRTUAL ASSISTANT OPERATION IN MULTI-DEVICE ENVIRONMENTS
US11386266B2 (en) 2018-06-01 2022-07-12 Apple Inc. Text correction
DK180639B1 (en) 2018-06-01 2021-11-04 Apple Inc DISABILITY OF ATTENTION-ATTENTIVE VIRTUAL ASSISTANT
US10892996B2 (en) 2018-06-01 2021-01-12 Apple Inc. Variable latency device coordination
DK179822B1 (da) 2018-06-01 2019-07-12 Apple Inc. Voice interaction at a primary device to access call functionality of a companion device
US11076039B2 (en) 2018-06-03 2021-07-27 Apple Inc. Accelerated task performance
US11010561B2 (en) 2018-09-27 2021-05-18 Apple Inc. Sentiment prediction from textual data
US11170166B2 (en) 2018-09-28 2021-11-09 Apple Inc. Neural typographical error modeling via generative adversarial networks
US11462215B2 (en) 2018-09-28 2022-10-04 Apple Inc. Multi-modal inputs for voice commands
US10839159B2 (en) 2018-09-28 2020-11-17 Apple Inc. Named entity normalization in a spoken dialog system
US11475898B2 (en) 2018-10-26 2022-10-18 Apple Inc. Low-latency multi-speaker speech recognition
US11638059B2 (en) 2019-01-04 2023-04-25 Apple Inc. Content playback on multiple devices
US11348573B2 (en) 2019-03-18 2022-05-31 Apple Inc. Multimodality in digital assistant systems
US11307752B2 (en) 2019-05-06 2022-04-19 Apple Inc. User configurable task triggers
US11423908B2 (en) 2019-05-06 2022-08-23 Apple Inc. Interpreting spoken requests
DK201970509A1 (en) 2019-05-06 2021-01-15 Apple Inc Spoken notifications
US11475884B2 (en) 2019-05-06 2022-10-18 Apple Inc. Reducing digital assistant latency when a language is incorrectly determined
US11140099B2 (en) 2019-05-21 2021-10-05 Apple Inc. Providing message response suggestions
DK180129B1 (en) 2019-05-31 2020-06-02 Apple Inc. USER ACTIVITY SHORTCUT SUGGESTIONS
US11289073B2 (en) 2019-05-31 2022-03-29 Apple Inc. Device text to speech
US11496600B2 (en) 2019-05-31 2022-11-08 Apple Inc. Remote execution of machine-learned models
US11360641B2 (en) 2019-06-01 2022-06-14 Apple Inc. Increasing the relevance of new available information
WO2021056255A1 (en) 2019-09-25 2021-04-01 Apple Inc. Text detection using global geometry estimators

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5459814A (en) * 1993-03-26 1995-10-17 Hughes Aircraft Company Voice activity detector for speech signals in variable background noise
US5915001A (en) * 1996-11-14 1999-06-22 Vois Corporation System and method for providing and using universally accessible voice and speech data files
US6157705A (en) * 1997-12-05 2000-12-05 E*Trade Group, Inc. Voice control of a server
US6662163B1 (en) * 2000-03-30 2003-12-09 Voxware, Inc. System and method for programming portable devices from a remote computer system
US20020007379A1 (en) * 2000-05-19 2002-01-17 Zhi Wang System and method for transcoding information for an audio or limited display user interface
FI20001918A (fi) 2000-08-30 2002-03-01 Nokia Corp Monimodaalinen sisältö ja automaattinen puheen tunnistus langattomassa tietoliikennejärjestelmässä
US6745163B1 (en) * 2000-09-27 2004-06-01 International Business Machines Corporation Method and system for synchronizing audio and visual presentation in a multi-modal content renderer
US6934756B2 (en) 2000-11-01 2005-08-23 International Business Machines Corporation Conversational networking via transport, coding and control conversational protocols
US7028306B2 (en) 2000-12-04 2006-04-11 International Business Machines Corporation Systems and methods for implementing modular DOM (Document Object Model)-based multi-modal browsers
US20020097692A1 (en) 2000-12-29 2002-07-25 Nokia Mobile Phones Ltd. User interface for a mobile station
US20040117804A1 (en) 2001-03-30 2004-06-17 Scahill Francis J Multi modal interface
US7409349B2 (en) * 2001-05-04 2008-08-05 Microsoft Corporation Servers for web enabled speech recognition
US7174006B2 (en) * 2001-06-18 2007-02-06 Nms Communications Corporation Method and system of VoiceXML interpreting
US7711570B2 (en) * 2001-10-21 2010-05-04 Microsoft Corporation Application abstraction with dialog purpose
US8229753B2 (en) * 2001-10-21 2012-07-24 Microsoft Corporation Web server controls for web enabled recognition and/or audible prompting

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101207586B (zh) * 2006-12-19 2012-01-11 纽奥斯通讯有限公司 用于实时自动通信的方法和系统
CN101207585B (zh) * 2006-12-22 2011-04-27 国际商业机器公司 向文本交换形态添加上下文的方法和系统
CN101287043B (zh) * 2007-04-12 2011-05-25 纽昂斯通讯公司 用于提供与多模式应用之间的表达用户交互的方法和设备
CN101257538B (zh) * 2008-03-25 2010-09-29 华为技术有限公司 一种在浏览器中处理请求的方法、装置
US8831950B2 (en) 2008-04-07 2014-09-09 Nuance Communications, Inc. Automated voice enablement of a web page
US9047869B2 (en) 2008-04-07 2015-06-02 Nuance Communications, Inc. Free form input field support for automated voice enablement of a web page
CN102629246A (zh) * 2012-02-10 2012-08-08 北京百纳信息技术有限公司 识别浏览器语音命令的服务器及浏览器语音命令识别方法
CN102968992A (zh) * 2012-11-26 2013-03-13 北京奇虎科技有限公司 用于浏览器的语音识别处理方法和浏览器
CN102968992B (zh) * 2012-11-26 2014-11-05 北京奇虎科技有限公司 用于浏览器的语音识别处理方法和浏览器
CN104240707A (zh) * 2012-11-26 2014-12-24 北京奇虎科技有限公司 用于浏览器的语音识别处理方法和浏览器

Also Published As

Publication number Publication date
TWI249729B (en) 2006-02-21
KR101027548B1 (ko) 2011-04-08
RU2005125208A (ru) 2006-01-10
TW200426780A (en) 2004-12-01
CN1333385C (zh) 2007-08-22
WO2004064299A2 (en) 2004-07-29
US20040138890A1 (en) 2004-07-15
KR20050100608A (ko) 2005-10-19
RU2349970C2 (ru) 2009-03-20
EP1588353A4 (en) 2012-01-25
EP1588353A2 (en) 2005-10-26
US7003464B2 (en) 2006-02-21
WO2004064299A3 (en) 2005-07-07
MY137374A (en) 2009-01-30
EP1588353B1 (en) 2018-03-07

Similar Documents

Publication Publication Date Title
CN1333385C (zh) 用于通信系统的语音浏览器启用器
EP1143679B1 (en) A conversational portal for providing conversational browsing and multimedia broadcast on demand
US9761241B2 (en) System and method for providing network coordinated conversational services
EP1125279B1 (en) System and method for providing network coordinated conversational services
KR100561228B1 (ko) 보이스엑스엠엘 문서를 엑스에이치티엠엘플러스보이스문서로 변환하기 위한 방법 및 이를 이용한 멀티모달서비스 시스템
US20070043868A1 (en) System and method for searching for network-based content in a multi-modal system using spoken keywords
US20030139933A1 (en) Use of local voice input and remote voice processing to control a local visual display
CN101291336A (zh) 用于并行多模通信的系统和方法
JP2003050594A (ja) 自動スピーチ認識とスピーチサービス提供方法およびシステム
CN102439661A (zh) 用于车辆内自动交互的面向服务语音识别
CN105955967A (zh) 数据处理方法及装置
JP3322262B2 (ja) 無線携帯端末通信システム
CN101527755A (zh) 基于VoiceXML移动终端语音交互方法及移动终端
WO2015023138A1 (ko) 음성인식 기반의 메시징 통역서비스 제공 시스템 및 그 방법
US8073930B2 (en) Screen reader remote access system
JP2002182684A (ja) 音声認識用データ配信システム、方法および音声認識用データ配信サーバ

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
ASS Succession or assignment of patent right

Owner name: MOTOROLA MOBILE CO., LTD.

Free format text: FORMER OWNER: MOTOROLA INC.

Effective date: 20110112

C41 Transfer of patent application or patent right or utility model
TR01 Transfer of patent right

Effective date of registration: 20110112

Address after: Illinois State

Patentee after: MOTOROLA MOBILITY, Inc.

Address before: Illinois, USA

Patentee before: Motorola, Inc.

C41 Transfer of patent application or patent right or utility model
C56 Change in the name or address of the patentee
CP01 Change in the name or title of a patent holder

Address after: Illinois State

Patentee after: MOTOROLA MOBILITY LLC

Address before: Illinois State

Patentee before: MOTOROLA MOBILITY, Inc.

TR01 Transfer of patent right

Effective date of registration: 20160517

Address after: California, USA

Patentee after: Google Technology Holdings LLC

Address before: Illinois State

Patentee before: MOTOROLA MOBILITY LLC

CX01 Expiry of patent term
CX01 Expiry of patent term

Granted publication date: 20070822