CN1385783A - 在游戏环境中以菜单驱动的语音来控制角色的系统和方法 - Google Patents

在游戏环境中以菜单驱动的语音来控制角色的系统和方法 Download PDF

Info

Publication number
CN1385783A
CN1385783A CN02119255A CN02119255A CN1385783A CN 1385783 A CN1385783 A CN 1385783A CN 02119255 A CN02119255 A CN 02119255A CN 02119255 A CN02119255 A CN 02119255A CN 1385783 A CN1385783 A CN 1385783A
Authority
CN
China
Prior art keywords
menu
command
order
role
voice
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN02119255A
Other languages
English (en)
Inventor
赛斯C·H·路易斯
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Interactive Entertainment Inc
Sony Interactive Entertainment LLC
Original Assignee
Sony Computer Entertainment America LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Computer Entertainment America LLC filed Critical Sony Computer Entertainment America LLC
Publication of CN1385783A publication Critical patent/CN1385783A/zh
Pending legal-status Critical Current

Links

Classifications

    • A63F13/10—
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10—Services
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/40—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment
    • A63F13/42—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
    • A63F13/424—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle involving acoustic input signals, e.g. by using the results of pitch or rhythm extraction or voice recognition
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/215—Input arrangements for video game devices characterised by their sensors, purposes or types comprising means for detecting acoustic signals, e.g. using a microphone
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/45—Controlling the progress of the video game
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/50—Controlling the output signals based on the game progress
    • A63F13/53—Controlling the output signals based on the game progress involving additional visual information provided to the game scene, e.g. by overlay to simulate a head-up display [HUD] or displaying a laser sight in a shooting game
    • A63F13/533—Controlling the output signals based on the game progress involving additional visual information provided to the game scene, e.g. by overlay to simulate a head-up display [HUD] or displaying a laser sight in a shooting game for prompting the player, e.g. by displaying a game menu
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/26—Speech to text systems
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/10—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
    • A63F2300/1081—Input via voice recognition
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/226—Procedures used during a speech recognition process, e.g. man-machine dialogue using non-speech characteristics
    • G10L2015/228—Procedures used during a speech recognition process, e.g. man-machine dialogue using non-speech characteristics of application context

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Theoretical Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Computational Linguistics (AREA)
  • Business, Economics & Management (AREA)
  • General Health & Medical Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Tourism & Hospitality (AREA)
  • Optics & Photonics (AREA)
  • Economics (AREA)
  • Human Resources & Organizations (AREA)
  • Marketing (AREA)
  • Primary Health Care (AREA)
  • Strategic Management (AREA)
  • General Business, Economics & Management (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

在游戏系统中,用户使用语音命令控制游戏环境中的角色的动作。在学习模式中,系统在显示设备上把语音命令显示在命令菜单中。在非学习模式下,系统不会显示可用的语音命令。一个独立于说话者的、对当前环境敏感的语音识别模块包含一个可用语音命令的词汇表。用户可以把语音命令和控制器设备的输入结合起来使用,以便控制游戏环境中的一个或多个角色的动作。

Description

在游戏环境中以菜单驱动的语音来控制角色的系统和方法
技术领域
本发明主要与电子娱乐系统相关，特别指一种在游戏环境中实现以菜单驱动的语音来控制角色的系统和方法。
背景技术
在电子娱乐系统(例如游戏系统)中，用户通常使用某种类型的手动操纵的控制器装置来与游戏程序交互。常见的控制器设备有按钮、游戏杆、开关、键盘、以及这些装置的混合运用。某些游戏系统使用专门设计的控制装置，例如使用方向盘和踏板来模拟驾驶，使用操纵杆和踏板模拟飞行等。
对于每个游戏系统，通常只为运行在系统上的大多数游戏使用通用设计的手工控制器设备。对于不同的游戏，按钮和按键被赋予了不同的意义。在一个游戏中，某个特定的按钮可能对应着出拳，而在另一个游戏中，该按钮可能对应着发射鱼雷。在特定的游戏环境中，对用户来说，以这种方法来使用控制装置不太直观。
使用手工操纵的控制器设备需要用户记忆按钮或按键与特定动作的对应关系。对于复杂的游戏来说，按钮的数量或按键的组合数量可能非常庞大复杂。在许多游戏中，一个用户只控制一个角色的动作。在一个用户控制一组角色的游戏中，角色是以组的方式动作，因此，角色组实际上是作为单个角色活动。让单个用户使用手动操纵的控制器装置来控制多个独立动作的角色虽然可能，但是却非常复杂，用户很难学会和使用。
发明内容
在已有发明的基础上，我们提供了一种在游戏环境中实现以菜单驱动的语音来控制角色的系统和方法。本发明的系统包含游戏软件和一个语音识别模块。该语音识别模块与说话者无关，并且是环境敏感的，它为可用命令词或短语提供了一个词汇表，实现以语音控制游戏环境中的一个或多个角色。用户从词汇表中向麦克风说出命令来控制游戏环境中一个或多个角色的动作。
在学习模式中，系统把可用命令的菜单显示给用户。第一级命令菜单显示要控制的角色。第二级命令菜单为在一级菜单中选定的一个或多个角色显示可用的动作。第三级命令菜单为在第二级菜单中选定的角色动作显示可用的选项。第三级菜单中的可用选项还可能与游戏的当前状态有关。
在非学习模式中，系统不会为用户显示可用命令的菜单。用户凭自己的记忆说出语音识别模块的词汇表中的命令。语音识别模块是环境敏感的，如果不输入第一级命令，那么它不会对第二级命令做出反应；同样，如果不输入第二级命令，它不会对第三级命令做出反应。因此，用户可以输入语句型的命令(角色+动作)来控制游戏环境中的一个或多个角色。
附图说明
图1是根据本发明实现的一个电子娱乐系统的结构图。
图2是根据本发明实现的图1的主存储器的结构图。
图3A是根据本发明设计的显示设备上显示的一个第一级菜单命令屏幕的示意图。
图3B是根据本发明设计的显示设备上显示的一个第二级菜单命令屏幕的示意图。
图3C是根据本发明设计的显示设备上显示的一个第三级菜单命令屏幕的示意图。
图4是根据本发明实现的以菜单驱动的语音命令来控制角色的方法步骤流程图。
具体实施方式
图1是根据本发明实现的一个电子娱乐系统100的结构图。系统100包括(但不仅限于)一个主存储器110、一个中央处理单元(CPU)112、矢量处理单元VU0111和VU1113、一个图形处理单元(GPU)114、一个输入/输出处理器(IOP)116、一个IOP存储器118、一个控制器接口120、一个内存卡122、一个通用串行总线(USB)接口124、和一个IEEE 1394接口126。系统100还带有一个驻留操作系统的只读存储器(OS ROM)128，以及一个硬盘驱动器(HDD)136，该硬盘驱动器通过总线146与IOP116连接。系统100可以作为一个电子游戏控制台，但也可以作为一台通用计算机、一个机顶盒、或者是一种手持游戏设备。
CPU112、VU0111、VU1113、GPU114、和IOP116通过系统总线144相互通信。CPU112通过一条专用总线142与主存储器110通信。VU1113和GPU114还可以通过专用总线140相互通信。CPU112执行存储在OS ROM 128和主存储器110中的程序。主存储器110可以包含预存储的程序，也可以包含从CD-ROM、DVD ROM、或者其它可选的光碟(没有示出，使用可选的光碟控制单元134控制)通过IOP116传入的程序。IOP116控制着CPU112、VU0111、VU1116、GPU114和系统100的其它设备(例如控制器接口120)之间的数据交换。
GPU114执行从GPU112和VUO111传入的画图命令，在显示设备(没有示出)上生成图像。VUI113把游戏中的各种对象从三维坐标转换为二维坐标，并向GPU114发送这些二维坐标。SPU132执行指令来产生音频信号，并把音频信号输出到音频设备上(没有示出)。
系统100的用户通过控制器接口120向GPU112发送指令，例如，用户可以指令GPU112把特定游戏信息存储到内存卡122上，也可以指令游戏中的某个角色执行某个特定的动作。其它设备可以通过USB接口124和IEEE 1394接口126连接到系统100上。在一个更好的实例中，USB接口124上连接了一个USB麦克风(没有示出)，可以支持用户向系统100提供语音命令。
图2是图1中的主存储器110的结构图。根据本发明，主存储器110包含(但不仅限于)游戏软件212和和语音识别模块214，它们从光碟控制单元134选件的光碟中被调入到主存储器中。游戏软件212包含可以由GPU112、VU0111、VU1113和SPU132执行的指令，使系统100的用户可以玩游戏。在图2的实例中，游戏软件212是一个战斗模拟游戏，用户控制该游戏中的一个三人步兵组。在其它实例中，游戏软件212可以是其它的游戏，包括(但不仅限于)角色扮演游戏(RPG)、飞行模拟游戏、以及文明建造游戏等。
语音识别模块214是一个独立于说话者的、环境敏感的语音识别程序，它可由CPU112执行。在本发明的另一个实例中，IOP116执行语音识别模块。语音识别模块带有一个语音词汇表，该词汇表对应着游戏软件212中的指令。语音命令中包含单个词的命令和多个词的命令。当一个输入语音信号(说话)与词汇表中的某个命令相匹配时，语音识别模块214会通知游戏软件212，然后游戏软件212向CPU112发出相应的指令。
系统100的用户和游戏软件212通过麦克风和USB接口124输入一个或多个命令，控制游戏软件212中的角色的动作。所说出的命令最好与控制器命令联合使用，但是，在游戏软件212的一些实例中，也可以实现纯语音命令。
图3A是在连接到系统100的显示设备310上显示的一个第一级菜单命令屏幕222。本实例中的菜单包含3个一级命令条目、一个“组”条目332、一个alpha条目334、以及一个bravo条目336。虽然屏幕上只显示了三个一级菜单命令条目，但是游戏软件212可以使用任意数量的一级菜单条目。当用户说出一个命令然后松开控制器上专用于此功能的按钮或其它装置时，会出现一级菜单命令屏幕322。在一级菜单命令屏幕322上的一级菜单220下，还包含一个当前游戏图形(没有示出)。在显示设备310上出现的一级菜单330为用户指明了一级命令的可用选项。
在图2中显示了游戏软件的一个实例，用户使用控制器的动作(例如按按钮或操纵游戏杆)来控制一个角色组组长的动作。用户输入语音命令来控制一个2人组的动作。“组”条目222代表某个组命令是否可用，该命令控制这个组中的两个角色执行特定的动作。Alpha组334代表选择一个组成员alpha的命令是否可用。Bravo条目336代表选择另一个组成员bravo的命令是否可用。
用户对着麦克风说出“组”一词来选择组条目222。说出“alpha”一词来选择alpha条目334，说出“barvo”一词来选择barvo条目336。当语音识别模块214识别到一个一级命令时，它会通知游戏软件212，而游戏软件212或者显示一个二级菜单命令屏幕。
图3B是根据本发明设计的一个设备的屏幕截取图，该设备在显示设备310上正在显示一个二级菜单命令屏幕324。在图3B的设备中，用户已经对着麦克风说出“组”一词来选择组条目332，此时，二级菜单命令屏幕324显示一个二级菜单340。二级菜单340包含刚才选择的一级菜单命令(组条目322)，还有3个二级命令：一个“待命”条目342、一个“执行”条目344、一个“开火”条目346。虽然屏幕上只显示了3个二级命令，但是游戏软件212可以使用任意数量的二级命令条目。
二级菜单340为上述二人组显示了可用的命令。这些命令取决于游戏的当前状态。例如，如果用户用语音选择“待命”条目342，那么游戏中的这个二人组将原地待命。如果下一次用户用语音选择组条目332，那么屏幕上不会出现“待命”条目342，而会出现一个相关的条目(没有示出)。
组条目332和“待命”条目342的组合是一个完整的命令，所以，如果用户在说出“待命”时系统所显示的是屏幕324，那么游戏软件212将不再显示屏幕324，并且使所选的角色执行在游戏环境中选择的动作(组中的两个角色都会原地待命)。同样，“组”条目332和“开火”条目346的组合是一个完整的命令，所以如果在显示屏幕324时用户说出“开火”一词，那么游戏软件212不再显示屏幕324，并且使所选的角色执行游戏环境中的所选动作(该组的两个成员都会开火)。“组”条目332和“执行”条目344的组合不是一个完整的命令。如果在显示屏幕324的时候用户说出“执行”一词，那么游戏软件会显示一个三级菜单命令屏幕。
图3C是根据本发明设计的一个设备的屏幕截取图，该设备在显示设备310上正在显示一个第三级菜单命令屏幕324。第三级命令屏幕326显示一个三级菜单350，该菜单中包含一个已选定的一级命令条目332，一个已选定的二级命令(执行344)、以及两个3级命令：“打开手榴弹”条目352和“拉弦”条目354。在图2的游戏软件实例中，这个步兵两人组可以执行“打开手榴弹”和“拉弦”命令。虽然当前屏幕上只显示了2个三级命令，但是游戏软件212可以包含任意数量的第三级命令。
“组”条目332、“执行”条目344和“打开手榴弹”的组合是一个完整的命令，所以，如果当显示屏幕326时用户说出“打开手榴弹”一词，软件模块212不再显示屏幕326，并且使所选的角色执行游戏环境中所选的动作(该组的两名成员都会打开手榴弹)。“组”条目332、“执行”条目344、以及“拉弦”条目354的组合是一个完整的命令，所以如果当显示屏幕326时用户说出“拉弦”一词，软件模块212不再显示屏幕326，并且使所选的角色执行游戏环境中所选的动作(该组的两名成员都会拉弦)。
虽然在图3C中只显示了三个菜单层次，但是本发明可支持任意层的菜单结构。在本发明的一个较好的实例中，为了便于使用，同时也为了帮助学习各种命令组合，设置了一个三层的菜单。当用户已经学会或记住了各种命令组合后，用户可以抛开菜单命令来玩游戏(非学习模式)。
我们已经说过，语音识别模块214是环境敏感的。例如，虽然“执行”一词是在语音识别模块214的词汇表中，但是只有在第一级命令有效时(例如“组”或“alpha”)，语音识别模块才会识别“执行”一词。换句话说，如果没有输入第一级命令，那么语音识别模块不会对输入的任何二级命令做出反应。同样，如果没有输入第二级命令，那么语音识别模块不会对输入的任何第三级命令做出反应。因此语音识别模块可以识别语句型的命令(角色+动作)，游戏软件可以使用这些命令控制游戏环境中的角色的动作。
虽然图3A-3C中显示的命令菜单330、340、350把其子菜单以从左向右的方式显示，但是本发明可以支持以任何方法为用户显示可用的命令。
图4显示的是本发明的另一个实例的流程图，它说明了以菜单驱动的语音命令来控制角色的步骤。首先，在步骤412中，游戏软件212检测用户是否按住了一个分配给某个语音命令功能的控制器按钮。如果没有，那么游戏软件212或者继续监视控制器按钮的信号。如果按住了某个语音按钮，那么在步骤414中，游戏软件212会检测该按钮是否被释放。如果该按钮已经被释放，那么系统会继续执行步骤416的学习模式。如果该按钮还没有被释放，那么系统会进入步骤428的非学习模式。
在步骤416中，游戏软件212在一个第一级菜单命令屏幕上显示一级命令。在步骤418中，语音识别模块214或者检测用户是否用语音输入了一个一级命令。如果没有，那么程序会返回到步骤416。如果用户用语音输入了一个第一级命令，那么在步骤420中，游戏软件212会在一个第二级菜单命令屏幕上显示第二级命令。在步骤422中，语音识别模块会检测用户是否用语音输入了一个第二级命令。如果没有，那么程序会返回到步骤420。如果用户用语音输入了一个第二级命令，那么程序会转到步骤242。
如果输入的第二级命令没有下一级命令，那么在步骤438中，游戏软件212会执行该命令，使游戏环境中的一个或多个角色执行所选的动作。如果输入的第二级命令有相关的第三级命令，那么在步骤426中，软件模块212会在一个第三级菜单命令屏幕上显示第三级命令。在步骤428中，语音识别模块214会检测用户是否用语音输入了一个第三级命令。如果没有，那么程序会返回到步骤424。如果用户用语音输入了一个第三级命令，那么在步骤438中，游戏软件212或者执行该命令，使游戏环境中的一个或多个角色执行所选的动作。
在非学习模式中，系统不会为用户显示各级可用命令。在步骤430中，语音识别模块214会检测用户是否用语音输入了一个第一级命令。如果没有，那么语音识别模块214继续监听第一级命令。如果用户用语音输入了一个第一级命令，那么在步骤432中，语音识别模块214或者检测用户是否用语音输入了一个第二级命令。如果没有，那么语音识别模块214继续监听第二级命令。如果用户用语音输入了一个第二级命令，那么程序会转到步骤434。
如果输入的第二级命令如果输入的第二级命令没有下一级命令，那么程序会转到步骤438，游戏软件212会执行该命令，使游戏环境中的一个或多个角色执行所选的动作。如果输入的第二级命令有相关的第三级命令，那么在步骤436中，语音识别模块会检测用户是否用语音输入了一个第三级命令。如果没有，那么程序会继续监听第三级命令。如果用户用语音输入了一个第三级命令，那么在步骤438中，游戏软件212或者执行该命令，使游戏环境中的一个或多个角色执行所选的动作。
在非学习模式中，用户会对游戏环境有一种身临其境的感觉，就像真正在向一个或多个角色发出命令一样。因此，游戏会更加直观真实。在游戏软件212的一个实例中，当用户向角色发出语音命令时，系统会使用扬声器或耳机(没有示出)向用户播放预先录制的命令回应或其它有声回应。

Claims (30)

1、一种使用语音控制游戏角色的系统，其特征在于：包括：
一个可以从用户接收语音命令的麦克风；
一个存储在存储器中的语音识别模块，该语音识别模式可以识别语音命令；
存储在存储器中的软件，该软件可以响应识别出的语音命令，从而控制游戏角色的动作。
2、如权利要求1项中所述的系统，其特征在于：其中的软件在显示设备上显示一个包含可用命令的菜单。
3、如权利要求2项中所述的系统，其特征在于：其中的软件在响应控制器设备的信号时在显示设备上显示包含可用命令的一个第一级菜单。
4、如权利要求3项中所述的系统，其特征在于：其中的软件在响应语音识别模块识别到的一个由用户以语音方式发出和第一级命令时在显示设备上显示包含可用命令的一个第二级菜单。
5、如权利要求4项中所述的系统，其特征在于：其中的软件在响应语音识别模块识别到的一个由用户以语音方式发出的第二级命令时执行一个命令来控制游戏角色的动作。
6、如权利要求4项中所述的系统，其特征在于：其中的软件在响应语音识别模块识别到的一个由用户以语音方式发出的第二级命令时在显示设备上显示包含可用命令的一个第三级菜单。
7、如权利要求6项中所述的系统，其特征在于：其中的软件在响应语音识别模块识别到的一个由用户以语音方式发出的第三级命令时执行一个命令来控制游戏角色的动作。
8、如权利要求1项中所述的系统，其特征在于：其中带有一个用于向软件输入命令从而控制一个或多个角色的动作的控制器设备。
9、如权利要求8项中所述的系统，其特征在于：其中用户使用控制设备控制一个角色的动作，使用语音命令控制至少另外一个角色的动作。
10、如权利要求1项中所述的系统，其特征在于：其中的语音命令包含两个以上按顺序说出的词。
11、一种控制游戏中的角色的方法，其特征在于：包含下列步骤：
为用户显示一个命令菜单；
识别一条与菜单中的某个命令相对应的语音；
执行一个识别出的命令，使游戏中的角色执行一个动作。
12、如权利要求11项中所述的方法，其特征在于：其中的命令菜单包含一个可用角色的菜单。
13、如权利要求11项中所述的方法，其特征在于：其中的命令菜单包含一个所选角色的可用命令的菜单，可用动作菜单中的条目取决于游戏环境的当前状态。
14、如权利要求11项中所述的方法，其特征在于：其中识别语音命令的步骤包含确定语音命令的当前环境。
15、如权利要求11项中所述的方法，其特征在于：其中的语音命令至少包含2个词。
16、如权利要求15项中所述的方法，其特征在于：其中的语音命令是一个语句型的命令。
17、一种可以被计算机读取的媒质，其特征在于：其通过执行下列步骤控制游戏角色的指令：
为用户显示一个命令菜单；
识别一条与菜单中的某个命令相对应的语音；
执行一个识别出的命令，使游戏中的角色执行一个动作。
18、如权利要求17项中所述的可被计算机读取的媒质，其特征在于：其中的命令菜单包含一个可用角色的菜单。
19、如权利要求17项中所述的可被计算机读取的媒质，其特征在于：其中的命令菜单包含一个所选角色的可用动作菜单，可用动作菜单中的条目取决于游戏环境的当前状态。
20、如权利要求17项中所述的可被计算机读取的媒质，其特征在于：其中识别语音命令的步骤包含确定语音命令的当前环境。
21、如权利要求17项中所述的可被计算机读取的媒质，其特征在于：其中的语音命令至少包含两个词。
22、如权利要求21项中所述的可被计算机读取的媒质，其特征在于：其中的语音命令是一种语句型的命令。
23、一种用于控制游戏中的角色的系统，其特征在于：包括：
为用户显示命令菜单的方法；
识别一条与菜单中的某个命令相对应的语音的方法；
执行一个识别出的命令，使游戏中的角色执行一个动作的方法。
24、如权利要求23项中所述的系统，其特征在于：其中的命令菜单包含一个可用角色的菜单。
25、如权利要求23项中所述的系统，其特征在于：其中的命令菜单包含一个所选角色的可用动作菜单，可用动作菜单中的条目取决于游戏环境的当前状态。
26、如权利要求23项中所述的系统，其特征在于：其中识别语音命令的步骤包含确定语音命令的当前环境。
27、如权利要求23项中所述的系统，其特征在于：其中的语音命令包含至少两个词。
28、如权利要求范围27项中所述的系统，其特征在于：其中的语音命令是一种语句型的命令。
29、如权利要求23项中所述的系统，其特征在于：其中用于识别语音命令的方法是一种独立于说话者的、对当前环境敏感的语音识别程序。
30、如权利要求23项中所述的系统，其特征在于：其中的命令菜单作为一种展开菜单显示给用户。
CN02119255A 2001-05-14 2002-05-14 在游戏环境中以菜单驱动的语音来控制角色的系统和方法 Pending CN1385783A (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US09/859,034 2001-05-14
US09/859,034 US7085722B2 (en) 2001-05-14 2001-05-14 System and method for menu-driven voice control of characters in a game environment

Publications (1)

Publication Number Publication Date
CN1385783A true CN1385783A (zh) 2002-12-18

Family

ID=25329828

Family Applications (1)

Application Number Title Priority Date Filing Date
CN02119255A Pending CN1385783A (zh) 2001-05-14 2002-05-14 在游戏环境中以菜单驱动的语音来控制角色的系统和方法

Country Status (6)

Country Link
US (4) US7085722B2 (zh)
EP (1) EP1262955B1 (zh)
JP (2) JP2003047768A (zh)
KR (1) KR100464877B1 (zh)
CN (1) CN1385783A (zh)
DE (1) DE60235674D1 (zh)

Cited By (60)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100456234C (zh) * 2005-06-16 2009-01-28 国际商业机器公司 在多模式应用中同步视觉和语音事件的方法和系统
US7676371B2 (en) 2006-06-13 2010-03-09 Nuance Communications, Inc. Oral modification of an ASR lexicon of an ASR engine
US7801728B2 (en) 2007-02-26 2010-09-21 Nuance Communications, Inc. Document session replay for multimodal applications
US7809575B2 (en) 2007-02-27 2010-10-05 Nuance Communications, Inc. Enabling global grammars for a particular multimodal application
US7822608B2 (en) 2007-02-27 2010-10-26 Nuance Communications, Inc. Disambiguating a speech recognition grammar in a multimodal application
US7827033B2 (en) 2006-12-06 2010-11-02 Nuance Communications, Inc. Enabling grammars in web page frames
US7840409B2 (en) 2007-02-27 2010-11-23 Nuance Communications, Inc. Ordering recognition results produced by an automatic speech recognition engine for a multimodal application
US7848314B2 (en) 2006-05-10 2010-12-07 Nuance Communications, Inc. VOIP barge-in support for half-duplex DSR client on a full-duplex network
US7945851B2 (en) 2007-03-14 2011-05-17 Nuance Communications, Inc. Enabling dynamic voiceXML in an X+V page of a multimodal application
US7957976B2 (en) 2006-09-12 2011-06-07 Nuance Communications, Inc. Establishing a multimodal advertising personality for a sponsor of a multimodal application
US8069047B2 (en) 2007-02-12 2011-11-29 Nuance Communications, Inc. Dynamically defining a VoiceXML grammar in an X+V page of a multimodal application
US8073697B2 (en) 2006-09-12 2011-12-06 International Business Machines Corporation Establishing a multimodal personality for a multimodal application
US8082148B2 (en) 2008-04-24 2011-12-20 Nuance Communications, Inc. Testing a grammar used in speech recognition for reliability in a plurality of operating environments having different background noise
US8086463B2 (en) 2006-09-12 2011-12-27 Nuance Communications, Inc. Dynamically generating a vocal help prompt in a multimodal application
US8090584B2 (en) 2005-06-16 2012-01-03 Nuance Communications, Inc. Modifying a grammar of a hierarchical multimodal menu in dependence upon speech command frequency
US8121837B2 (en) 2008-04-24 2012-02-21 Nuance Communications, Inc. Adjusting a speech engine for a mobile computing device based on background noise
US8145493B2 (en) 2006-09-11 2012-03-27 Nuance Communications, Inc. Establishing a preferred mode of interaction between a user and a multimodal application
US8150698B2 (en) 2007-02-26 2012-04-03 Nuance Communications, Inc. Invoking tapered prompts in a multimodal application
US8214242B2 (en) 2008-04-24 2012-07-03 International Business Machines Corporation Signaling correspondence between a meeting agenda and a meeting discussion
US8229081B2 (en) 2008-04-24 2012-07-24 International Business Machines Corporation Dynamically publishing directory information for a plurality of interactive voice response systems
CN102671381A (zh) * 2011-03-08 2012-09-19 德信互动科技（北京）有限公司 基于声控的游戏实现装置和方法
CN102671383A (zh) * 2011-03-08 2012-09-19 德信互动科技（北京）有限公司 基于声控的游戏实现装置和方法
US8290780B2 (en) 2009-06-24 2012-10-16 International Business Machines Corporation Dynamically extending the speech prompts of a multimodal application
US8332218B2 (en) 2006-06-13 2012-12-11 Nuance Communications, Inc. Context-based grammars for automated speech recognition
CN102855873A (zh) * 2012-08-03 2013-01-02 海信集团有限公司 一种控制电子设备的方法及电子设备
US8374874B2 (en) 2006-09-11 2013-02-12 Nuance Communications, Inc. Establishing a multimodal personality for a multimodal application in dependence upon attributes of user interaction
US8380513B2 (en) 2009-05-19 2013-02-19 International Business Machines Corporation Improving speech capabilities of a multimodal application
US8416714B2 (en) 2009-08-05 2013-04-09 International Business Machines Corporation Multimodal teleconferencing
CN103052940A (zh) * 2010-08-09 2013-04-17 三菱电机株式会社 信息处理装置
CN103127718A (zh) * 2011-11-30 2013-06-05 北京德信互动网络技术有限公司 基于声控的游戏实现装置和方法
US8510117B2 (en) 2009-07-09 2013-08-13 Nuance Communications, Inc. Speech enabled media sharing in a multimodal application
US8515757B2 (en) 2007-03-20 2013-08-20 Nuance Communications, Inc. Indexing digitized speech with words represented in the digitized speech
CN103366743A (zh) * 2012-03-30 2013-10-23 北京千橡网景科技发展有限公司 操作语音命令的方法和装置
US8612230B2 (en) 2007-01-03 2013-12-17 Nuance Communications, Inc. Automatic speech recognition with a selection list
US8670987B2 (en) 2007-03-20 2014-03-11 Nuance Communications, Inc. Automatic speech recognition with dynamic grammar rules
US8713542B2 (en) 2007-02-27 2014-04-29 Nuance Communications, Inc. Pausing a VoiceXML dialog of a multimodal application
US8725513B2 (en) 2007-04-12 2014-05-13 Nuance Communications, Inc. Providing expressive user interaction with a multimodal application
US8781840B2 (en) 2005-09-12 2014-07-15 Nuance Communications, Inc. Retrieval and presentation of network service results for mobile device using a multimodal browser
US8788620B2 (en) 2007-04-04 2014-07-22 International Business Machines Corporation Web service support for a multimodal client processing a multimodal application
US8843376B2 (en) 2007-03-13 2014-09-23 Nuance Communications, Inc. Speech-enabled web content searching using a multimodal browser
US8862475B2 (en) 2007-04-12 2014-10-14 Nuance Communications, Inc. Speech-enabled content navigation and control of a distributed multimodal browser
US8909532B2 (en) 2007-03-23 2014-12-09 Nuance Communications, Inc. Supporting multi-lingual user interaction with a multimodal application
US8938392B2 (en) 2007-02-27 2015-01-20 Nuance Communications, Inc. Configuring a speech engine for a multimodal application based on location
US9083798B2 (en) 2004-12-22 2015-07-14 Nuance Communications, Inc. Enabling voice selection of user preferences
CN105009202A (zh) * 2013-01-04 2015-10-28 寇平公司 分为两部分的语音识别
US9208783B2 (en) 2007-02-27 2015-12-08 Nuance Communications, Inc. Altering behavior of a multimodal application based on location
US9208785B2 (en) 2006-05-10 2015-12-08 Nuance Communications, Inc. Synchronizing distributed speech recognition
US9349367B2 (en) 2008-04-24 2016-05-24 Nuance Communications, Inc. Records disambiguation in a multimodal application operating on a multimodal device
CN106062734A (zh) * 2013-12-02 2016-10-26 亚马逊技术股份有限公司 二级装置的自然语言控制
CN106528137A (zh) * 2016-10-11 2017-03-22 深圳市天易联科技有限公司 与虚拟角色对话的方法及装置
US9833707B2 (en) 2012-10-29 2017-12-05 Sony Interactive Entertainment Inc. Ambient light control and calibration via a console
US10128914B1 (en) 2017-09-06 2018-11-13 Sony Interactive Entertainment LLC Smart tags with multiple interactions
CN109196464A (zh) * 2016-05-17 2019-01-11 微软技术许可有限责任公司 基于上下文的用户代理
CN109360561A (zh) * 2018-11-13 2019-02-19 东软集团股份有限公司 语音控制方法及系统、存储介质、语音模块、主控系统
US10486069B2 (en) 2007-09-05 2019-11-26 Sony Interactive Entertainment America Llc Ranking of user-generated game play advice
US10561942B2 (en) 2017-05-15 2020-02-18 Sony Interactive Entertainment America Llc Metronome for competitive gaming headset
CN111957044A (zh) * 2020-09-04 2020-11-20 网易（杭州）网络有限公司 多人对抗游戏的角色控制方法、装置和电子设备
CN112742024A (zh) * 2020-08-20 2021-05-04 腾讯科技（深圳）有限公司 虚拟对象的控制方法、装置、设备及存储介质
CN113707144A (zh) * 2021-08-24 2021-11-26 深圳市衡泰信科技有限公司 一种高尔夫模拟器的控制方法及系统
CN114931747A (zh) * 2022-07-25 2022-08-23 深圳市景创科技电子股份有限公司 一种游戏控制器和智能语音控制方法

Families Citing this family (233)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
AU6630800A (en) 1999-08-13 2001-03-13 Pixo, Inc. Methods and apparatuses for display and traversing of links in page character array
US8645137B2 (en) 2000-03-16 2014-02-04 Apple Inc. Fast, language-independent method for user authentication by voice
FR2823896B1 (fr) * 2001-04-23 2003-10-24 E Bourgeois Ets Simulateur de vol adapte a une famille d'aeronefs
US7085722B2 (en) * 2001-05-14 2006-08-01 Sony Computer Entertainment America Inc. System and method for menu-driven voice control of characters in a game environment
ITFI20010199A1 (it) 2001-10-22 2003-04-22 Riccardo Vieri Sistema e metodo per trasformare in voce comunicazioni testuali ed inviarle con una connessione internet a qualsiasi apparato telefonico
US20030083881A1 (en) * 2001-11-01 2003-05-01 Shu-Ming Liu Voice input module that stores personal data
US7099829B2 (en) * 2001-11-06 2006-08-29 International Business Machines Corporation Method of dynamically displaying speech recognition system information
US7669134B1 (en) 2003-05-02 2010-02-23 Apple Inc. Method and apparatus for displaying information during an instant messaging session
US8133115B2 (en) 2003-10-22 2012-03-13 Sony Computer Entertainment America Llc System and method for recording and displaying a graphical path in a video game
US20050169252A1 (en) * 2004-02-03 2005-08-04 Andrew Riggs Game controller including an integrated communicator
KR100576555B1 (ko) * 2004-03-25 2006-05-08 (주)이진공작 사용자의 참여 및 대화가 가능한 텔레비전 방송을 통한에이 알 에스 게임 서비스 장치 및 방법
JP4452541B2 (ja) 2004-04-01 2010-04-21 本田技研工業株式会社 シミュレーション装置
DE102005014486B4 (de) * 2004-03-31 2009-04-09 Honda Motor Co., Ltd. Fahrrad-Simulationsvorrichtung
US7976385B2 (en) * 2004-05-11 2011-07-12 Mattel, Inc. Game controller with sensitivity adjustment
US7704135B2 (en) * 2004-08-23 2010-04-27 Harrison Jr Shelton E Integrated game system, method, and device
US20060046845A1 (en) * 2004-08-26 2006-03-02 Alexandre Armand Device for the acoustic control of a game system and application
US20060071933A1 (en) 2004-10-06 2006-04-06 Sony Computer Entertainment Inc. Application binary interface for multi-pass shaders
US7636126B2 (en) 2005-06-22 2009-12-22 Sony Computer Entertainment Inc. Delay matching in audio/video systems
TWI278762B (en) * 2005-08-22 2007-04-11 Delta Electronics Inc Method and apparatus for speech input
US8677377B2 (en) 2005-09-08 2014-03-18 Apple Inc. Method and apparatus for building an intelligent automated assistant
US7633076B2 (en) 2005-09-30 2009-12-15 Apple Inc. Automated response to and sensing of user activity in portable devices
US7880746B2 (en) 2006-05-04 2011-02-01 Sony Computer Entertainment Inc. Bandwidth management through lighting control of a user environment via a display device
US7965859B2 (en) 2006-05-04 2011-06-21 Sony Computer Entertainment Inc. Lighting control of a user environment via a display device
US8279171B2 (en) * 2006-07-06 2012-10-02 Panasonic Corporation Voice input device
US9318108B2 (en) 2010-01-18 2016-04-19 Apple Inc. Intelligent automated assistant
KR100780531B1 (ko) * 2007-01-10 2007-11-30 한국문화콘텐츠진흥원 구화 교육용 게임 시스템
US8977255B2 (en) 2007-04-03 2015-03-10 Apple Inc. Method and system for operating a multi-function portable electronic device using voice-activation
US8328637B2 (en) * 2007-06-21 2012-12-11 Microsoft Corporation Combat action selection using situational awareness
ITFI20070177A1 (it) 2007-07-26 2009-01-27 Riccardo Vieri Sistema per la creazione e impostazione di una campagna pubblicitaria derivante dall'inserimento di messaggi pubblicitari all'interno di uno scambio di messaggi e metodo per il suo funzionamento.
US9108108B2 (en) 2007-09-05 2015-08-18 Sony Computer Entertainment America Llc Real-time, contextual display of ranked, user-generated game play advice
US9053089B2 (en) 2007-10-02 2015-06-09 Apple Inc. Part-of-speech tagging using latent analogy
US8595642B1 (en) 2007-10-04 2013-11-26 Great Northern Research, LLC Multiple shell multi faceted graphical user interface
US8165886B1 (en) 2007-10-04 2012-04-24 Great Northern Research LLC Speech interface system and method for control and interaction with applications on a computing system
US8364694B2 (en) 2007-10-26 2013-01-29 Apple Inc. Search assistant for digital media assets
US8620662B2 (en) 2007-11-20 2013-12-31 Apple Inc. Context-aware unit selection
US10002189B2 (en) 2007-12-20 2018-06-19 Apple Inc. Method and apparatus for searching using an active ontology
US9330720B2 (en) 2008-01-03 2016-05-03 Apple Inc. Methods and apparatus for altering audio output signals
US8327272B2 (en) 2008-01-06 2012-12-04 Apple Inc. Portable multifunction device, method, and graphical user interface for viewing and managing electronic calendars
US8065143B2 (en) 2008-02-22 2011-11-22 Apple Inc. Providing text input using speech data and non-speech data
US8289283B2 (en) 2008-03-04 2012-10-16 Apple Inc. Language input interface on a device
US20090247293A1 (en) 2008-03-26 2009-10-01 Aristocrat Technologies Australia Pty Limited Gaming machine
US8996376B2 (en) 2008-04-05 2015-03-31 Apple Inc. Intelligent text-to-speech conversion
AU2009201551A1 (en) 2008-05-02 2009-11-19 Aristocrat Technologies Australia Pty Limited A gaming system and a method of monitoring a gaming device
US10496753B2 (en) 2010-01-18 2019-12-03 Apple Inc. Automatically adapting user interfaces for hands-free interaction
US8464150B2 (en) 2008-06-07 2013-06-11 Apple Inc. Automatic language identification for dynamic text processing
US20100030549A1 (en) 2008-07-31 2010-02-04 Lee Michael M Mobile device having human language translation capability with positional feedback
JP5349860B2 (ja) * 2008-08-07 2013-11-20 株式会社バンダイナムコゲームス プログラム、情報記憶媒体及びゲーム装置
US8768702B2 (en) 2008-09-05 2014-07-01 Apple Inc. Multi-tiered voice feedback in an electronic device
US8898568B2 (en) 2008-09-09 2014-11-25 Apple Inc. Audio user interface
US8355919B2 (en) 2008-09-29 2013-01-15 Apple Inc. Systems and methods for text normalization for text to speech synthesis
US8583418B2 (en) 2008-09-29 2013-11-12 Apple Inc. Systems and methods of detecting language and natural language strings for text to speech synthesis
US8352272B2 (en) 2008-09-29 2013-01-08 Apple Inc. Systems and methods for text to speech synthesis
US8352268B2 (en) 2008-09-29 2013-01-08 Apple Inc. Systems and methods for selective rate of speech and speech preferences for text to speech synthesis
US8712776B2 (en) 2008-09-29 2014-04-29 Apple Inc. Systems and methods for selective text to speech synthesis
US8396714B2 (en) 2008-09-29 2013-03-12 Apple Inc. Systems and methods for concatenation of words in text to speech synthesis
US8676904B2 (en) 2008-10-02 2014-03-18 Apple Inc. Electronic devices with voice command and contextual data processing capabilities
US11287939B2 (en) 2008-10-09 2022-03-29 Aristocrat Technologies Australia Pty Limited Gaming system and gaming system processor module
AU2009222627B2 (en) 2008-10-09 2011-07-21 Aristocrat Technologies Australia Pty Limited Gaming system and gaming system processor module
US11385758B2 (en) 2008-10-09 2022-07-12 Aristocrat Technologies Australia Pty Limited Gaming system and gaming system processor module
WO2010067118A1 (en) 2008-12-11 2010-06-17 Novauris Technologies Limited Speech recognition involving a mobile device
US8862252B2 (en) 2009-01-30 2014-10-14 Apple Inc. Audio user interface for displayless electronic device
US8380507B2 (en) 2009-03-09 2013-02-19 Apple Inc. Systems and methods for determining the language to use for speech generated by a text to speech engine
US10540976B2 (en) 2009-06-05 2020-01-21 Apple Inc. Contextual voice commands
US10241752B2 (en) 2011-09-30 2019-03-26 Apple Inc. Interface for a virtual digital assistant
US10255566B2 (en) 2011-06-03 2019-04-09 Apple Inc. Generating and processing task items that represent tasks to perform
US9858925B2 (en) 2009-06-05 2018-01-02 Apple Inc. Using context information to facilitate processing of commands in a virtual assistant
US10241644B2 (en) 2011-06-03 2019-03-26 Apple Inc. Actionable reminder entries
US9431006B2 (en) 2009-07-02 2016-08-30 Apple Inc. Methods and apparatuses for automatic speech recognition
US9737796B2 (en) 2009-07-08 2017-08-22 Steelseries Aps Apparatus and method for managing operations of accessories in multi-dimensions
US8719714B2 (en) 2009-07-08 2014-05-06 Steelseries Aps Apparatus and method for managing operations of accessories
US8682649B2 (en) 2009-11-12 2014-03-25 Apple Inc. Sentiment prediction from textual data
US10912991B2 (en) * 2009-12-09 2021-02-09 Sony Interactive Entertainment LLC Portable game controller settings
US8523673B1 (en) * 2009-12-14 2013-09-03 Markeith Boyd Vocally interactive video game mechanism for displaying recorded physical characteristics of a player in a virtual world and in a physical game space via one or more holographic images
US8600743B2 (en) 2010-01-06 2013-12-03 Apple Inc. Noise profile determination for voice-related feature
US8381107B2 (en) 2010-01-13 2013-02-19 Apple Inc. Adaptive audio feedback system and method
US8311838B2 (en) 2010-01-13 2012-11-13 Apple Inc. Devices and methods for identifying a prompt corresponding to a voice input in a sequence of prompts
US10553209B2 (en) 2010-01-18 2020-02-04 Apple Inc. Systems and methods for hands-free notification summaries
US10705794B2 (en) 2010-01-18 2020-07-07 Apple Inc. Automatically adapting user interfaces for hands-free interaction
US10276170B2 (en) 2010-01-18 2019-04-30 Apple Inc. Intelligent automated assistant
US10679605B2 (en) 2010-01-18 2020-06-09 Apple Inc. Hands-free list-reading by intelligent automated assistant
WO2011089450A2 (en) 2010-01-25 2011-07-28 Andrew Peter Nelson Jerram Apparatuses, methods and systems for a digital conversation management platform
US8682667B2 (en) 2010-02-25 2014-03-25 Apple Inc. User profiling for selecting user specific voice input processing information
US10786736B2 (en) 2010-05-11 2020-09-29 Sony Interactive Entertainment LLC Placement of user information in a game space
US9183560B2 (en) 2010-05-28 2015-11-10 Daniel H. Abelow Reality alternate
US8639516B2 (en) 2010-06-04 2014-01-28 Apple Inc. User-specific noise suppression for voice quality improvements
US8713021B2 (en) 2010-07-07 2014-04-29 Apple Inc. Unsupervised document clustering using latent semantic density analysis
US9104670B2 (en) 2010-07-21 2015-08-11 Apple Inc. Customized search or acquisition of digital media assets
US20120032779A1 (en) * 2010-08-04 2012-02-09 Nokia Corporation Method and apparatus for accessing content within a device
US8719006B2 (en) 2010-08-27 2014-05-06 Apple Inc. Combined statistical and rule-based part-of-speech tagging for text-to-speech synthesis
US8719014B2 (en) 2010-09-27 2014-05-06 Apple Inc. Electronic device with text error correction based on voice recognition data
US10515147B2 (en) 2010-12-22 2019-12-24 Apple Inc. Using statistical language models for contextual lookup
US10762293B2 (en) 2010-12-22 2020-09-01 Apple Inc. Using parts-of-speech tagging and named entity recognition for spelling correction
US8562434B2 (en) 2011-01-16 2013-10-22 Google Inc. Method and system for sharing speech recognition program profiles for an application
US8781836B2 (en) 2011-02-22 2014-07-15 Apple Inc. Hearing assistance system for providing consistent human speech
US9262612B2 (en) 2011-03-21 2016-02-16 Apple Inc. Device access using voice authentication
US10057736B2 (en) 2011-06-03 2018-08-21 Apple Inc. Active transport based notifications
US10672399B2 (en) 2011-06-03 2020-06-02 Apple Inc. Switching between text data and audio data based on a mapping
US9911349B2 (en) * 2011-06-17 2018-03-06 Rosetta Stone, Ltd. System and method for language instruction using visual and/or audio prompts
US8812294B2 (en) 2011-06-21 2014-08-19 Apple Inc. Translating phrases from one language into another using an order-based set of declarative rules
US9342817B2 (en) 2011-07-07 2016-05-17 Sony Interactive Entertainment LLC Auto-creating groups for sharing photos
US8706472B2 (en) 2011-08-11 2014-04-22 Apple Inc. Method for disambiguating multiple readings in language conversion
US8994660B2 (en) 2011-08-29 2015-03-31 Apple Inc. Text correction processing
US8762156B2 (en) 2011-09-28 2014-06-24 Apple Inc. Speech recognition repair using contextual information
US9256396B2 (en) * 2011-10-10 2016-02-09 Microsoft Technology Licensing, Llc Speech recognition for context switching
KR102022318B1 (ko) 2012-01-11 2019-09-18 삼성전자 주식회사 음성 인식을 사용하여 사용자 기능을 수행하는 방법 및 장치
US10134385B2 (en) 2012-03-02 2018-11-20 Apple Inc. Systems and methods for name pronunciation
US9483461B2 (en) 2012-03-06 2016-11-01 Apple Inc. Handling speech synthesis of content for multiple languages
US9280610B2 (en) 2012-05-14 2016-03-08 Apple Inc. Crowd sourcing information to fulfill user requests
US10417037B2 (en) 2012-05-15 2019-09-17 Apple Inc. Systems and methods for integrating third party services with a digital assistant
US8775442B2 (en) 2012-05-15 2014-07-08 Apple Inc. Semantic search using a single-source semantic model
WO2013185109A2 (en) 2012-06-08 2013-12-12 Apple Inc. Systems and methods for recognizing textual identifiers within a plurality of words
JP5306518B1 (ja) * 2012-06-08 2013-10-02 株式会社 ディー・エヌ・エー ゲームを提供する装置
US9721563B2 (en) 2012-06-08 2017-08-01 Apple Inc. Name recognition system
US9495129B2 (en) 2012-06-29 2016-11-15 Apple Inc. Device, method, and user interface for voice-activated navigation and browsing of a document
FI124994B (fi) 2012-06-29 2015-04-15 Tribe Studios Oy Epälineaarisen tietokonepelin parannettu rakenne
KR101987255B1 (ko) 2012-08-20 2019-06-11 엘지이노텍 주식회사 음성 인식 장치 및 이의 음성 인식 방법
US9576574B2 (en) 2012-09-10 2017-02-21 Apple Inc. Context-sensitive handling of interruptions by intelligent digital assistant
US9547647B2 (en) 2012-09-19 2017-01-17 Apple Inc. Voice-based media searching
US8935167B2 (en) 2012-09-25 2015-01-13 Apple Inc. Exemplar-based latent perceptual modeling for automatic speech recognition
US9433856B2 (en) 2012-10-26 2016-09-06 Infosys Limited Methods for synthesizing a voice guiding signal to a gaming controller and devices thereof
US10373615B2 (en) * 2012-10-30 2019-08-06 Google Technology Holdings LLC Voice control user interface during low power mode
DE112014000709B4 (de) 2013-02-07 2021-12-30 Apple Inc. Verfahren und vorrichtung zum betrieb eines sprachtriggers für einen digitalen assistenten
US9368114B2 (en) 2013-03-14 2016-06-14 Apple Inc. Context-sensitive handling of interruptions
US10642574B2 (en) 2013-03-14 2020-05-05 Apple Inc. Device, method, and graphical user interface for outputting captions
US9977779B2 (en) 2013-03-14 2018-05-22 Apple Inc. Automatic supplementation of word correction dictionaries
US10572476B2 (en) 2013-03-14 2020-02-25 Apple Inc. Refining a search based on schedule items
US10652394B2 (en) 2013-03-14 2020-05-12 Apple Inc. System and method for processing voicemail
US9733821B2 (en) 2013-03-14 2017-08-15 Apple Inc. Voice control to diagnose inadvertent activation of accessibility features
WO2014144579A1 (en) 2013-03-15 2014-09-18 Apple Inc. System and method for updating an adaptive speech recognition model
KR101857648B1 (ko) 2013-03-15 2018-05-15 애플 인크. 지능형 디지털 어시스턴트에 의한 사용자 트레이닝
US9687730B2 (en) 2013-03-15 2017-06-27 Steelseries Aps Gaming device with independent gesture-sensitive areas
US10748529B1 (en) 2013-03-15 2020-08-18 Apple Inc. Voice activated device for use with a voice-based digital assistant
AU2014233517B2 (en) 2013-03-15 2017-05-25 Apple Inc. Training an at least partial voice command system
US10078487B2 (en) 2013-03-15 2018-09-18 Apple Inc. Context-sensitive handling of interruptions
US9604147B2 (en) 2013-03-15 2017-03-28 Steelseries Aps Method and apparatus for managing use of an accessory
US9423874B2 (en) 2013-03-15 2016-08-23 Steelseries Aps Gaming accessory with sensory feedback device
US20140329589A1 (en) * 2013-05-03 2014-11-06 Steelseries Aps Method and apparatus for configuring a gaming environment
US9582608B2 (en) 2013-06-07 2017-02-28 Apple Inc. Unified ranking with entropy-weighted information for phrase-based semantic auto-completion
WO2014197336A1 (en) 2013-06-07 2014-12-11 Apple Inc. System and method for detecting errors in interactions with a voice-based digital assistant
WO2014197334A2 (en) 2013-06-07 2014-12-11 Apple Inc. System and method for user-specified pronunciation of words for speech synthesis and recognition
WO2014197335A1 (en) 2013-06-08 2014-12-11 Apple Inc. Interpreting and acting upon commands that involve sharing information with remote devices
US10176167B2 (en) 2013-06-09 2019-01-08 Apple Inc. System and method for inferring user intent from speech inputs
EP3937002A1 (en) 2013-06-09 2022-01-12 Apple Inc. Device, method, and graphical user interface for enabling conversation persistence across two or more instances of a digital assistant
AU2014278595B2 (en) 2013-06-13 2017-04-06 Apple Inc. System and method for emergency calls initiated by voice command
DE112014003653B4 (de) 2013-08-06 2024-04-18 Apple Inc. Automatisch aktivierende intelligente Antworten auf der Grundlage von Aktivitäten von entfernt angeordneten Vorrichtungen
US10258886B2 (en) 2013-09-04 2019-04-16 Nvidia Corporation Dynamic interface control device mapping when game sharing
US11130055B2 (en) 2013-09-04 2021-09-28 Nvidia Corporation System and method for granting remote access to a video game executed on a video game console or network client
WO2015063610A2 (en) * 2013-11-04 2015-05-07 Intralot S.A. -Integrated Lottery Systems And Services Computer systems and computer-implemented methods for conducting and playing personalized games based on vocal and non-vocal game entries
US10296160B2 (en) 2013-12-06 2019-05-21 Apple Inc. Method for extracting salient dialog usage from live data
US9620105B2 (en) 2014-05-15 2017-04-11 Apple Inc. Analyzing audio input for efficient speech and music recognition
US10592095B2 (en) 2014-05-23 2020-03-17 Apple Inc. Instantaneous speaking of content on touch devices
US9502031B2 (en) 2014-05-27 2016-11-22 Apple Inc. Method for supporting dynamic grammars in WFST-based ASR
US9734193B2 (en) 2014-05-30 2017-08-15 Apple Inc. Determining domain salience ranking from ambiguous words in natural speech
US9633004B2 (en) 2014-05-30 2017-04-25 Apple Inc. Better resolution when referencing to concepts
US9842101B2 (en) 2014-05-30 2017-12-12 Apple Inc. Predictive conversion of language input
US10289433B2 (en) 2014-05-30 2019-05-14 Apple Inc. Domain specific language for encoding assistant dialog
US9760559B2 (en) 2014-05-30 2017-09-12 Apple Inc. Predictive text input
US10170123B2 (en) 2014-05-30 2019-01-01 Apple Inc. Intelligent assistant for home automation
US9430463B2 (en) 2014-05-30 2016-08-30 Apple Inc. Exemplar-based natural language processing
US9715875B2 (en) 2014-05-30 2017-07-25 Apple Inc. Reducing the need for manual start/end-pointing and trigger phrases
US9785630B2 (en) 2014-05-30 2017-10-10 Apple Inc. Text prediction using combined word N-gram and unigram language models
TWI566107B (zh) 2014-05-30 2017-01-11 蘋果公司 用於處理多部分語音命令之方法、非暫時性電腦可讀儲存媒體及電子裝置
US10078631B2 (en) 2014-05-30 2018-09-18 Apple Inc. Entropy-guided text prediction using combined word and character n-gram language models
US9338493B2 (en) 2014-06-30 2016-05-10 Apple Inc. Intelligent automated assistant for TV user interactions
US10659851B2 (en) 2014-06-30 2020-05-19 Apple Inc. Real-time digital assistant knowledge updates
US10446141B2 (en) 2014-08-28 2019-10-15 Apple Inc. Automatic speech recognition based on user feedback
US9818400B2 (en) 2014-09-11 2017-11-14 Apple Inc. Method and apparatus for discovering trending terms in speech requests
US10789041B2 (en) 2014-09-12 2020-09-29 Apple Inc. Dynamic thresholds for always listening speech trigger
US20160078864A1 (en) * 2014-09-15 2016-03-17 Honeywell International Inc. Identifying un-stored voice commands
US10127911B2 (en) 2014-09-30 2018-11-13 Apple Inc. Speaker identification and unsupervised speaker adaptation techniques
US10074360B2 (en) 2014-09-30 2018-09-11 Apple Inc. Providing an indication of the suitability of speech recognition
US9886432B2 (en) 2014-09-30 2018-02-06 Apple Inc. Parsimonious handling of word inflection via categorical stem + suffix N-gram language models
US9646609B2 (en) 2014-09-30 2017-05-09 Apple Inc. Caching apparatus for serving phonetic pronunciations
US9668121B2 (en) 2014-09-30 2017-05-30 Apple Inc. Social reminders
US10552013B2 (en) 2014-12-02 2020-02-04 Apple Inc. Data detection
US9711141B2 (en) 2014-12-09 2017-07-18 Apple Inc. Disambiguating heteronyms in speech synthesis
US9865280B2 (en) 2015-03-06 2018-01-09 Apple Inc. Structured dictation using intelligent automated assistants
US10567477B2 (en) 2015-03-08 2020-02-18 Apple Inc. Virtual assistant continuity
US9886953B2 (en) 2015-03-08 2018-02-06 Apple Inc. Virtual assistant activation
US9721566B2 (en) 2015-03-08 2017-08-01 Apple Inc. Competing devices responding to voice triggers
US9899019B2 (en) 2015-03-18 2018-02-20 Apple Inc. Systems and methods for structured stem and suffix language models
US9987561B2 (en) 2015-04-02 2018-06-05 Nvidia Corporation System and method for multi-client control of a common avatar
US9842105B2 (en) 2015-04-16 2017-12-12 Apple Inc. Parsimonious continuous-space phrase representations for natural language processing
US10083688B2 (en) 2015-05-27 2018-09-25 Apple Inc. Device voice control for selecting a displayed affordance
US10127220B2 (en) 2015-06-04 2018-11-13 Apple Inc. Language identification from short strings
US9578173B2 (en) 2015-06-05 2017-02-21 Apple Inc. Virtual assistant aided communication with 3rd party service in a communication session
US10101822B2 (en) 2015-06-05 2018-10-16 Apple Inc. Language input correction
US10255907B2 (en) 2015-06-07 2019-04-09 Apple Inc. Automatic accent detection using acoustic models
US10186254B2 (en) 2015-06-07 2019-01-22 Apple Inc. Context-based endpoint detection
US11025565B2 (en) 2015-06-07 2021-06-01 Apple Inc. Personalized prediction of responses for instant messaging
US10671428B2 (en) 2015-09-08 2020-06-02 Apple Inc. Distributed personal assistant
US10747498B2 (en) 2015-09-08 2020-08-18 Apple Inc. Zero latency digital assistant
US9697820B2 (en) 2015-09-24 2017-07-04 Apple Inc. Unit-selection text-to-speech synthesis using concatenation-sensitive neural networks
US11010550B2 (en) 2015-09-29 2021-05-18 Apple Inc. Unified language modeling framework for word prediction, auto-completion and auto-correction
US10366158B2 (en) 2015-09-29 2019-07-30 Apple Inc. Efficient word encoding for recurrent neural network language models
US11587559B2 (en) 2015-09-30 2023-02-21 Apple Inc. Intelligent device identification
US10691473B2 (en) 2015-11-06 2020-06-23 Apple Inc. Intelligent automated assistant in a messaging environment
US10049668B2 (en) 2015-12-02 2018-08-14 Apple Inc. Applying neural network language models to weighted finite state transducers for automatic speech recognition
US10223066B2 (en) 2015-12-23 2019-03-05 Apple Inc. Proactive assistance based on dialog communication between devices
US10446143B2 (en) 2016-03-14 2019-10-15 Apple Inc. Identification of voice inputs providing credentials
US9934775B2 (en) 2016-05-26 2018-04-03 Apple Inc. Unit-selection text-to-speech synthesis based on predicted concatenation parameters
US9972304B2 (en) 2016-06-03 2018-05-15 Apple Inc. Privacy preserving distributed evaluation framework for embedded personalized systems
US10249300B2 (en) 2016-06-06 2019-04-02 Apple Inc. Intelligent list reading
US10049663B2 (en) 2016-06-08 2018-08-14 Apple, Inc. Intelligent automated assistant for media exploration
DK179588B1 (en) 2016-06-09 2019-02-22 Apple Inc. INTELLIGENT AUTOMATED ASSISTANT IN A HOME ENVIRONMENT
US10509862B2 (en) 2016-06-10 2019-12-17 Apple Inc. Dynamic phrase expansion of language input
US10586535B2 (en) 2016-06-10 2020-03-10 Apple Inc. Intelligent digital assistant in a multi-tasking environment
US10067938B2 (en) 2016-06-10 2018-09-04 Apple Inc. Multilingual word prediction
US10490187B2 (en) 2016-06-10 2019-11-26 Apple Inc. Digital assistant providing automated status report
US10192552B2 (en) 2016-06-10 2019-01-29 Apple Inc. Digital assistant providing whispered speech
DK179343B1 (en) 2016-06-11 2018-05-14 Apple Inc Intelligent task discovery
DK201670540A1 (en) 2016-06-11 2018-01-08 Apple Inc Application integration with a digital assistant
DK179049B1 (en) 2016-06-11 2017-09-18 Apple Inc Data driven natural language event detection and classification
DK179415B1 (en) 2016-06-11 2018-06-14 Apple Inc Intelligent device arbitration and control
CN106056989B (zh) * 2016-06-23 2018-10-16 广东小天才科技有限公司 一种语言学习方法及装置、终端设备
US10043516B2 (en) 2016-09-23 2018-08-07 Apple Inc. Intelligent automated assistant
US10553212B2 (en) * 2016-10-05 2020-02-04 Gentex Corporation Vehicle-based remote control system and method
US11281993B2 (en) 2016-12-05 2022-03-22 Apple Inc. Model and ensemble compression for metric learning
US10593346B2 (en) 2016-12-22 2020-03-17 Apple Inc. Rank-reduced token representation for automatic speech recognition
DK201770383A1 (en) 2017-05-09 2018-12-14 Apple Inc. USER INTERFACE FOR CORRECTING RECOGNITION ERRORS
DK201770439A1 (en) 2017-05-11 2018-12-13 Apple Inc. Offline personal assistant
DK179745B1 (en) 2017-05-12 2019-05-01 Apple Inc. SYNCHRONIZATION AND TASK DELEGATION OF A DIGITAL ASSISTANT
DK201770428A1 (en) 2017-05-12 2019-02-18 Apple Inc. LOW-LATENCY INTELLIGENT AUTOMATED ASSISTANT
DK179496B1 (en) 2017-05-12 2019-01-15 Apple Inc. USER-SPECIFIC Acoustic Models
DK201770431A1 (en) 2017-05-15 2018-12-20 Apple Inc. Optimizing dialogue policy decisions for digital assistants using implicit feedback
DK201770432A1 (en) 2017-05-15 2018-12-21 Apple Inc. Hierarchical belief states for digital assistants
DK179560B1 (en) 2017-05-16 2019-02-18 Apple Inc. FAR-FIELD EXTENSION FOR DIGITAL ASSISTANT SERVICES
US11998313B2 (en) 2018-01-05 2024-06-04 Children's Hospital Medical Center Systems and methods for respiration-controlled virtual experiences
US11698927B2 (en) 2018-05-16 2023-07-11 Sony Interactive Entertainment LLC Contextual digital media processing systems and methods
WO2020068202A2 (en) * 2018-06-27 2020-04-02 Cubic Corporation Phonic fires trainer
CN109646952A (zh) * 2018-12-14 2019-04-19 北京智明星通科技股份有限公司 一种互动游戏界面显示方法、装置及终端
CN109857363B (zh) * 2019-01-17 2021-10-22 腾讯科技（深圳）有限公司 一种音效播放的方法以及相关装置
CN109741745A (zh) * 2019-01-28 2019-05-10 中国银行股份有限公司 一种交易导航方法及装置

Family Cites Families (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS58195957A (ja) 1982-05-11 1983-11-15 Casio Comput Co Ltd 音声によるプログラム実行方式
US4757525A (en) 1982-09-29 1988-07-12 Vmx, Inc. Electronic audio communications system with voice command features
US5274560A (en) 1990-12-03 1993-12-28 Audio Navigation Systems, Inc. Sensor free vehicle navigation system utilizing a voice input/output interface for routing a driver from his source point to his destination point
JPH05293252A (ja) * 1992-04-07 1993-11-09 Robert M Best 音声対立を利用する対話ビデオゲーム方法
US5446714A (en) 1992-07-21 1995-08-29 Pioneer Electronic Corporation Disc changer and player that reads and stores program data of all discs prior to reproduction and method of reproducing music on the same
US5890122A (en) * 1993-02-08 1999-03-30 Microsoft Corporation Voice-controlled computer simulateously displaying application menu and list of available commands
NO954684L (no) * 1994-11-21 1996-05-22 Compaq Computer Corp Apparat og fremgangsmåte for interaktiv lek med en datamaskin
US5617407A (en) 1995-06-21 1997-04-01 Bareis; Monica M. Optical disk having speech recognition templates for information access
US6028593A (en) * 1995-12-01 2000-02-22 Immersion Corporation Method and apparatus for providing simulated physical interactions within computer generated environments
GB9602701D0 (en) 1996-02-09 1996-04-10 Canon Kk Image manipulation
JP3933698B2 (ja) 1996-07-11 2007-06-20 株式会社セガ 音声認識装置、音声認識方法及びこれを用いたゲーム機
CN1103076C (zh) 1997-05-30 2003-03-12 刘达民 利用语音讯号控制游戏软件的方法及装置
US6077164A (en) 1997-08-18 2000-06-20 Liu; Da-Ming Method of using speech to control a game program, and game machine controller therefor
JP3829014B2 (ja) * 1998-06-03 2006-10-04 株式会社コナミデジタルエンタテインメント ビデオゲーム装置
US7251315B1 (en) * 1998-09-21 2007-07-31 Microsoft Corporation Speech processing for telephony API
TW495710B (en) 1998-10-15 2002-07-21 Primax Electronics Ltd Voice control module for control of game controller
JP2000181676A (ja) * 1998-12-11 2000-06-30 Nintendo Co Ltd 画像処理装置
JP2000229172A (ja) 1999-02-10 2000-08-22 Konami Co Ltd ゲームシステムおよびゲーム用プログラムが記録されたコンピュータ読み取り可能な記憶媒体
US6529876B1 (en) * 1999-03-26 2003-03-04 Stephen H. Dart Electronic template medical records coding system
JP4258890B2 (ja) 1999-05-26 2009-04-30 株式会社デンソー 音声認識装置、その装置を用いたナビゲーションシステム
JP2001029649A (ja) 1999-07-21 2001-02-06 Taito Corp 音声認識により音声視覚表示を行うゲーム機
US6554707B1 (en) 1999-09-24 2003-04-29 Nokia Corporation Interactive voice, wireless game system using predictive command input
US6571208B1 (en) * 1999-11-29 2003-05-27 Matsushita Electric Industrial Co., Ltd. Context-dependent acoustic models for medium and large vocabulary speech recognition with eigenvoice training
KR20000072753A (ko) 2000-09-25 2000-12-05 오재덕 근거리 무선통신 수단을 내장한 지능형 장난감
JP2002222436A (ja) * 2000-11-22 2002-08-09 Sony Computer Entertainment Inc オブジェクト制御方法、コンピュータに実行させるためのオブジェクト制御処理プログラム、コンピュータに実行させるためのオブジェクト制御処理プログラムを記録したコンピュータ読み取り可能な記録媒体、オブジェクト制御処理プログラムを実行するプログラム実行装置
US6928433B2 (en) 2001-01-05 2005-08-09 Creative Technology Ltd Automatic hierarchical categorization of music by metadata
US7085722B2 (en) 2001-05-14 2006-08-01 Sony Computer Entertainment America Inc. System and method for menu-driven voice control of characters in a game environment
KR20010079324A (ko) * 2001-07-06 2001-08-22 신호철 유,무선 네트웍게임상의 음성인식 시스템

Cited By (90)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9083798B2 (en) 2004-12-22 2015-07-14 Nuance Communications, Inc. Enabling voice selection of user preferences
CN100456234C (zh) * 2005-06-16 2009-01-28 国际商业机器公司 在多模式应用中同步视觉和语音事件的方法和系统
US8090584B2 (en) 2005-06-16 2012-01-03 Nuance Communications, Inc. Modifying a grammar of a hierarchical multimodal menu in dependence upon speech command frequency
US8055504B2 (en) 2005-06-16 2011-11-08 Nuance Communications, Inc. Synchronizing visual and speech events in a multimodal application
US8571872B2 (en) 2005-06-16 2013-10-29 Nuance Communications, Inc. Synchronizing visual and speech events in a multimodal application
US7917365B2 (en) 2005-06-16 2011-03-29 Nuance Communications, Inc. Synchronizing visual and speech events in a multimodal application
US8781840B2 (en) 2005-09-12 2014-07-15 Nuance Communications, Inc. Retrieval and presentation of network service results for mobile device using a multimodal browser
US9208785B2 (en) 2006-05-10 2015-12-08 Nuance Communications, Inc. Synchronizing distributed speech recognition
US7848314B2 (en) 2006-05-10 2010-12-07 Nuance Communications, Inc. VOIP barge-in support for half-duplex DSR client on a full-duplex network
US8566087B2 (en) 2006-06-13 2013-10-22 Nuance Communications, Inc. Context-based grammars for automated speech recognition
US8332218B2 (en) 2006-06-13 2012-12-11 Nuance Communications, Inc. Context-based grammars for automated speech recognition
US7676371B2 (en) 2006-06-13 2010-03-09 Nuance Communications, Inc. Oral modification of an ASR lexicon of an ASR engine
US9292183B2 (en) 2006-09-11 2016-03-22 Nuance Communications, Inc. Establishing a preferred mode of interaction between a user and a multimodal application
US9343064B2 (en) 2006-09-11 2016-05-17 Nuance Communications, Inc. Establishing a multimodal personality for a multimodal application in dependence upon attributes of user interaction
US8374874B2 (en) 2006-09-11 2013-02-12 Nuance Communications, Inc. Establishing a multimodal personality for a multimodal application in dependence upon attributes of user interaction
US8494858B2 (en) 2006-09-11 2013-07-23 Nuance Communications, Inc. Establishing a preferred mode of interaction between a user and a multimodal application
US8145493B2 (en) 2006-09-11 2012-03-27 Nuance Communications, Inc. Establishing a preferred mode of interaction between a user and a multimodal application
US8600755B2 (en) 2006-09-11 2013-12-03 Nuance Communications, Inc. Establishing a multimodal personality for a multimodal application in dependence upon attributes of user interaction
US8086463B2 (en) 2006-09-12 2011-12-27 Nuance Communications, Inc. Dynamically generating a vocal help prompt in a multimodal application
US8498873B2 (en) 2006-09-12 2013-07-30 Nuance Communications, Inc. Establishing a multimodal advertising personality for a sponsor of multimodal application
US8862471B2 (en) 2006-09-12 2014-10-14 Nuance Communications, Inc. Establishing a multimodal advertising personality for a sponsor of a multimodal application
US7957976B2 (en) 2006-09-12 2011-06-07 Nuance Communications, Inc. Establishing a multimodal advertising personality for a sponsor of a multimodal application
US8239205B2 (en) 2006-09-12 2012-08-07 Nuance Communications, Inc. Establishing a multimodal advertising personality for a sponsor of a multimodal application
US8706500B2 (en) 2006-09-12 2014-04-22 Nuance Communications, Inc. Establishing a multimodal personality for a multimodal application
US8073697B2 (en) 2006-09-12 2011-12-06 International Business Machines Corporation Establishing a multimodal personality for a multimodal application
US7827033B2 (en) 2006-12-06 2010-11-02 Nuance Communications, Inc. Enabling grammars in web page frames
US8612230B2 (en) 2007-01-03 2013-12-17 Nuance Communications, Inc. Automatic speech recognition with a selection list
US8069047B2 (en) 2007-02-12 2011-11-29 Nuance Communications, Inc. Dynamically defining a VoiceXML grammar in an X+V page of a multimodal application
US8150698B2 (en) 2007-02-26 2012-04-03 Nuance Communications, Inc. Invoking tapered prompts in a multimodal application
US7801728B2 (en) 2007-02-26 2010-09-21 Nuance Communications, Inc. Document session replay for multimodal applications
US8744861B2 (en) 2007-02-26 2014-06-03 Nuance Communications, Inc. Invoking tapered prompts in a multimodal application
US7809575B2 (en) 2007-02-27 2010-10-05 Nuance Communications, Inc. Enabling global grammars for a particular multimodal application
US8938392B2 (en) 2007-02-27 2015-01-20 Nuance Communications, Inc. Configuring a speech engine for a multimodal application based on location
US8713542B2 (en) 2007-02-27 2014-04-29 Nuance Communications, Inc. Pausing a VoiceXML dialog of a multimodal application
US9208783B2 (en) 2007-02-27 2015-12-08 Nuance Communications, Inc. Altering behavior of a multimodal application based on location
US8073698B2 (en) 2007-02-27 2011-12-06 Nuance Communications, Inc. Enabling global grammars for a particular multimodal application
US7822608B2 (en) 2007-02-27 2010-10-26 Nuance Communications, Inc. Disambiguating a speech recognition grammar in a multimodal application
US7840409B2 (en) 2007-02-27 2010-11-23 Nuance Communications, Inc. Ordering recognition results produced by an automatic speech recognition engine for a multimodal application
US8843376B2 (en) 2007-03-13 2014-09-23 Nuance Communications, Inc. Speech-enabled web content searching using a multimodal browser
US7945851B2 (en) 2007-03-14 2011-05-17 Nuance Communications, Inc. Enabling dynamic voiceXML in an X+V page of a multimodal application
US8515757B2 (en) 2007-03-20 2013-08-20 Nuance Communications, Inc. Indexing digitized speech with words represented in the digitized speech
US9123337B2 (en) 2007-03-20 2015-09-01 Nuance Communications, Inc. Indexing digitized speech with words represented in the digitized speech
US8670987B2 (en) 2007-03-20 2014-03-11 Nuance Communications, Inc. Automatic speech recognition with dynamic grammar rules
US8706490B2 (en) 2007-03-20 2014-04-22 Nuance Communications, Inc. Indexing digitized speech with words represented in the digitized speech
US8909532B2 (en) 2007-03-23 2014-12-09 Nuance Communications, Inc. Supporting multi-lingual user interaction with a multimodal application
US8788620B2 (en) 2007-04-04 2014-07-22 International Business Machines Corporation Web service support for a multimodal client processing a multimodal application
US8862475B2 (en) 2007-04-12 2014-10-14 Nuance Communications, Inc. Speech-enabled content navigation and control of a distributed multimodal browser
US8725513B2 (en) 2007-04-12 2014-05-13 Nuance Communications, Inc. Providing expressive user interaction with a multimodal application
US10486069B2 (en) 2007-09-05 2019-11-26 Sony Interactive Entertainment America Llc Ranking of user-generated game play advice
US8214242B2 (en) 2008-04-24 2012-07-03 International Business Machines Corporation Signaling correspondence between a meeting agenda and a meeting discussion
US8229081B2 (en) 2008-04-24 2012-07-24 International Business Machines Corporation Dynamically publishing directory information for a plurality of interactive voice response systems
US9396721B2 (en) 2008-04-24 2016-07-19 Nuance Communications, Inc. Testing a grammar used in speech recognition for reliability in a plurality of operating environments having different background noise
US9349367B2 (en) 2008-04-24 2016-05-24 Nuance Communications, Inc. Records disambiguation in a multimodal application operating on a multimodal device
US8121837B2 (en) 2008-04-24 2012-02-21 Nuance Communications, Inc. Adjusting a speech engine for a mobile computing device based on background noise
US8082148B2 (en) 2008-04-24 2011-12-20 Nuance Communications, Inc. Testing a grammar used in speech recognition for reliability in a plurality of operating environments having different background noise
US9076454B2 (en) 2008-04-24 2015-07-07 Nuance Communications, Inc. Adjusting a speech engine for a mobile computing device based on background noise
US8380513B2 (en) 2009-05-19 2013-02-19 International Business Machines Corporation Improving speech capabilities of a multimodal application
US8521534B2 (en) 2009-06-24 2013-08-27 Nuance Communications, Inc. Dynamically extending the speech prompts of a multimodal application
US8290780B2 (en) 2009-06-24 2012-10-16 International Business Machines Corporation Dynamically extending the speech prompts of a multimodal application
US9530411B2 (en) 2009-06-24 2016-12-27 Nuance Communications, Inc. Dynamically extending the speech prompts of a multimodal application
US8510117B2 (en) 2009-07-09 2013-08-13 Nuance Communications, Inc. Speech enabled media sharing in a multimodal application
US8416714B2 (en) 2009-08-05 2013-04-09 International Business Machines Corporation Multimodal teleconferencing
CN103052940A (zh) * 2010-08-09 2013-04-17 三菱电机株式会社 信息处理装置
CN103052940B (zh) * 2010-08-09 2015-09-30 三菱电机株式会社 信息处理装置
CN102671383A (zh) * 2011-03-08 2012-09-19 德信互动科技（北京）有限公司 基于声控的游戏实现装置和方法
CN102671381A (zh) * 2011-03-08 2012-09-19 德信互动科技（北京）有限公司 基于声控的游戏实现装置和方法
CN103127718A (zh) * 2011-11-30 2013-06-05 北京德信互动网络技术有限公司 基于声控的游戏实现装置和方法
CN103366743A (zh) * 2012-03-30 2013-10-23 北京千橡网景科技发展有限公司 操作语音命令的方法和装置
CN102855873A (zh) * 2012-08-03 2013-01-02 海信集团有限公司 一种控制电子设备的方法及电子设备
US9833707B2 (en) 2012-10-29 2017-12-05 Sony Interactive Entertainment Inc. Ambient light control and calibration via a console
US9950259B2 (en) 2012-10-29 2018-04-24 Sony Interactive Entertainment Inc. Ambient light control and calibration via a console
CN105009202A (zh) * 2013-01-04 2015-10-28 寇平公司 分为两部分的语音识别
CN105009202B (zh) * 2013-01-04 2019-05-07 寇平公司 分为两部分的语音识别
CN106062734A (zh) * 2013-12-02 2016-10-26 亚马逊技术股份有限公司 二级装置的自然语言控制
CN106062734B (zh) * 2013-12-02 2019-09-13 亚马逊技术股份有限公司 二级装置的自然语言控制
US11416212B2 (en) 2016-05-17 2022-08-16 Microsoft Technology Licensing, Llc Context-based user agent
CN109196464A (zh) * 2016-05-17 2019-01-11 微软技术许可有限责任公司 基于上下文的用户代理
CN109196464B (zh) * 2016-05-17 2022-03-29 微软技术许可有限责任公司 基于上下文的用户代理
CN106528137A (zh) * 2016-10-11 2017-03-22 深圳市天易联科技有限公司 与虚拟角色对话的方法及装置
US10561942B2 (en) 2017-05-15 2020-02-18 Sony Interactive Entertainment America Llc Metronome for competitive gaming headset
US10541731B2 (en) 2017-09-06 2020-01-21 Sony Interactive Entertainment LLC Smart tags with multiple interactions
US10128914B1 (en) 2017-09-06 2018-11-13 Sony Interactive Entertainment LLC Smart tags with multiple interactions
CN109360561A (zh) * 2018-11-13 2019-02-19 东软集团股份有限公司 语音控制方法及系统、存储介质、语音模块、主控系统
CN112742024A (zh) * 2020-08-20 2021-05-04 腾讯科技（深圳）有限公司 虚拟对象的控制方法、装置、设备及存储介质
CN112742024B (zh) * 2020-08-20 2023-02-10 腾讯科技（深圳）有限公司 虚拟对象的控制方法、装置、设备及存储介质
CN111957044A (zh) * 2020-09-04 2020-11-20 网易（杭州）网络有限公司 多人对抗游戏的角色控制方法、装置和电子设备
WO2022048104A1 (zh) * 2020-09-04 2022-03-10 网易（杭州）网络有限公司 多人对抗游戏的角色控制方法、装置和电子设备
CN113707144A (zh) * 2021-08-24 2021-11-26 深圳市衡泰信科技有限公司 一种高尔夫模拟器的控制方法及系统
CN113707144B (zh) * 2021-08-24 2023-12-19 深圳市衡泰信科技有限公司 一种高尔夫模拟器的控制方法及系统
CN114931747A (zh) * 2022-07-25 2022-08-23 深圳市景创科技电子股份有限公司 一种游戏控制器和智能语音控制方法

Also Published As

Publication number Publication date
US20020169617A1 (en) 2002-11-14
US7085722B2 (en) 2006-08-01
KR20020088058A (ko) 2002-11-25
JP2006099125A (ja) 2006-04-13
KR100464877B1 (ko) 2005-01-06
US20100029387A1 (en) 2010-02-04
DE60235674D1 (de) 2010-04-29
EP1262955A3 (en) 2004-03-03
JP2003047768A (ja) 2003-02-18
US7613616B2 (en) 2009-11-03
US7877262B2 (en) 2011-01-25
US20070244704A1 (en) 2007-10-18
US7233904B2 (en) 2007-06-19
EP1262955A2 (en) 2002-12-04
EP1262955B1 (en) 2010-03-17
US20060190270A1 (en) 2006-08-24

Similar Documents

Publication Publication Date Title
CN1385783A (zh) 在游戏环境中以菜单驱动的语音来控制角色的系统和方法
US6424356B2 (en) Command of force sensations in a forceback system using force effect suites
JP5932917B2 (ja) 複数のプラットフォームを越える触覚フィードバックを用いた対話式タッチスクリーンゲーミング比喩
US7623114B2 (en) Haptic feedback sensations based on audio output from computer devices
US7372450B2 (en) Analog input mapping for hand-held computing devices
JP2001229392A (ja) 少ないメッセージ交信により会話式キャラクタを実施する合理的アーキテクチャ
JP2011044183A (ja) ハプティックフィードバック機能性を備えたチャットインターフェース
CN113398590B (zh) 声音处理方法、装置、计算机设备及存储介质
JP4406615B2 (ja) コマンド処理装置およびコマンド処理プログラム
JP3963547B2 (ja) 情報処理装置
Larsen et al. Multi modal user interaction in an automatic pool trainer
JP4476255B2 (ja) ゲームプログラム、ゲーム装置及びゲーム制御方法
JP2001273473A (ja) 会話用エージェントおよびそれを用いる会話システム
Spöhrer A History of Disability and Voice-Enabled Gaming from the 1970s to Intelligent Personal Assistants
TWI774208B (zh) 故事展演系統及其方法
JP2004135910A (ja) ゲームプログラム及びゲーム装置
CN117919694A (zh) 一种游戏控制方法、装置、计算机设备及存储介质
JP4676469B2 (ja) 音処理プログラム、音処理装置、および音制御方法
CN115193062A (zh) 游戏的控制方法、装置、存储介质及计算机设备
JP2009034375A (ja) ゲームプログラム、ゲーム装置及びゲーム制御方法
CN118576971A (zh) 一种游戏控制方法、装置、计算机设备及存储介质
CN117389410A (zh) Vr交互方法、装置、终端设备及存储介质
WO2000067246A1 (en) Command of force sensations in a force feedback system using force effect suites

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C02 Deemed withdrawal of patent application after publication (patent law 2001)
WD01 Invention patent application deemed withdrawn after publication