CN101557432B - Mobile terminal and menu control method thereof - Google Patents

Mobile terminal and menu control method thereof Download PDF

Info

Publication number
CN101557432B
CN101557432B CN 200810127910 CN200810127910A CN101557432B CN 101557432 B CN101557432 B CN 101557432B CN 200810127910 CN200810127910 CN 200810127910 CN 200810127910 A CN200810127910 A CN 200810127910A CN 101557432 B CN101557432 B CN 101557432B
Authority
CN
Grant status
Grant
Patent type
Prior art keywords
menu
mobile terminal
voice
user
controller
Prior art date
Application number
CN 200810127910
Other languages
Chinese (zh)
Other versions
CN101557432A (en )
Inventor
尹种根
郑大成
杻在勋
金兑俊
赵在珉
郭宰到
申宗壕
Original Assignee
Lg电子株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Grant date

Links

Abstract

一种移动终端包括:输入单元,其被配置成接收输入以激活移动终端上的语音识别功能;存储器,其被配置成存储与移动终端的菜单和操作有关的多个域。 A mobile terminal comprising: an input unit configured to receive an input to activate a voice recognition function on the mobile terminal; a memory configured to store menu and operation of the mobile terminal related to a plurality of domains. 它还包括控制器,其被配置成基于所接收的用于激活所述语音识别功能的输入访问包括在所述存储器中的多个域中的特定域,以基于所访问的域的语言模型和声学模型识别用户语音,并基于所访问的特定域和所识别的用户语音确定所述移动终端的至少一个菜单和操作。 It also includes a controller configured to access based on the received input to activate the voice recognition function include a plurality of domain-specific domains in the memory, based on the language model of the accessed domain, and speech acoustic models to identify a user, and based on a specific domain and the recognized user speech accessed the mobile terminal determining at least one menu and operation.

Description

移动终端及其菜单控制方法 Menu control method and the mobile terminal

[0001] 发明背景 [0001] Background of the Invention

1.技术领域 1. FIELD

[0002] 本发明涉及移动终端,以及相应的能够通过将用于语音识别的域设置成与特定菜单或服务有关的信息来提高语音识别率的方法。 [0002] The present invention relates to a mobile terminal, and a method related to a particular menu or information service to improve the speech recognition rate can be provided by the respective speech recognition for fields.

[0003] 2.背景技术描述 [0003] 2. Description of Background Art

[0004] 除基本的通话服务外,现在移动终端还提供很多附加服务。 [0004] In addition to the basic call services, mobile terminals now provide many additional services. 例如,用户现在可访问因特网、玩游戏、观看视频、听音乐、捕捉图像和视频、记录音频文件等。 For example, users can now access the Internet, play games, watch videos, listen to music, capturing images and videos, record audio files. 移动终端现在还提供广播节目,使得用户可观看电视节目、体育节目、视频等。 Mobile terminals also now provide broadcasting programs such that user can watch television shows, sporting programs, videos and the like.

[0005] 此外,因为移动终端包括的功能已经显著增加,所以用户界面也已经变得更加复杂。 [0005] Further, since the function included in the mobile terminal has increased significantly, so the user interfaces have also become more complex. 例如,现在用户界面包括使用户能触摸并选择具体项或菜单选项的触摸屏。 For example, now include user interface enables the user to touch the touch screen and select specific items or menu options. 移动终端还包括使用户能执行初步功能的非常有限的语音识别功能。 The mobile terminal further includes a user can perform the voice recognition of a very limited initial function. 然而,在确定用户语音指令的含义时的差错率非常高,因此用户一般不使用终端上的有限的语音识别功能部件。 However, the error rate in determining the meaning the user's voice instruction is very high, so users generally do not use the limited voice recognition features on the terminal.

发明内容 SUMMARY

[0006] 因此,本发明的一个目的是解决以上指出的问题及其它问题。 [0006] It is therefore an object of the present invention is to solve the above noted problems and others.

[0007] 本发明的另一个目的是提供一种移动终端,以及相应的通过基于背景和内容识别语音命令的含义来控制与其特定功能或服务有关的菜单的方法。 [0007] Another object of the present invention is to provide a mobile terminal and corresponding controlling its particular functions or services through a menu-based context and meaning of the voice command content identification method.

[0008] 本发明的又一个目的是提供一种移动终端以及相应的通过将用于语音识别的域指定为与特定菜单或服务有关的域来显著提高语音识别率的方法。 [0008] Yet another object of the present invention is to provide a mobile terminal and a corresponding voice recognition by a method specified domain specific menu or service related domains improve the speech recognition rate.

[0009] 本发明的再一个目的是提供一种移动终端以及相应的通过在激活语音识别功能的同时应用其一个或多个用户界面(UI)以便检测用户操纵来控制与特定功能或服务有关的菜单的方法。 [0009] A further object of the present invention is to provide a mobile terminal and one or more application user interface (UI) by simultaneously activating the corresponding voice recognition function to detect user manipulation to control a particular function or service related methods menu.

[0010] 本发明的又一个目的是提供一种移动终端和相应的方法,用于通过根据移动终端的操作状态或操作模式提供关于语音命令的输入的帮助信息,甚至由初学用户经由他或她的语音命令,来控制与特定功能或服务有关的菜单。 [0010] Yet another object of the present invention is to provide a mobile terminal and corresponding method for providing help information about the input through a voice command according to an operation state or an operation mode of the mobile terminal, even by a beginner user through his or her voice commands to control associated with a particular function or service menu.

[0011] 为了实现这些或其它优点并根据本发明的目的,如本文具体表达和广泛描述的,在一个方面中提供了一种移动终端,包括:输入单元,其被配置成接收用于激活移动终端上的语音识别功能的输入;存储器,其被配置成存储与移动终端的菜单和操作有关的多个域;以及控制器,其被配置成基于所接收的用于激活语音识别功能的输入访问包括在该存储器中的多个域中的特定域,以基于所访问的域的语言模型和声学模型识别用户语音,并基于所访问的特定域和所识别的用户语音确定移动终端的至少一个菜单和操作。 [0011] To achieve these and other advantages and in accordance with the purpose of the present invention, as embodied and broadly described herein, there is provided in one aspect a mobile terminal, comprising: an input unit configured to receive a mobile activation a voice recognition function on the input terminal; a memory configured to store menu and operation of the mobile terminal related to a plurality of domains; and a controller, which is configured for activating the voice recognition function based on the received input access a plurality of domains comprising a specific domain in the memory, the language model based on the accessed domain acoustic models and speech recognition user, and determines that the mobile terminal based on a specific domain and the recognized user speech accessed at least one menu and operations.

[0012] 在另一方面,本发明提供了一种控制移动终端的方法。 [0012] In another aspect, the present invention provides a method of controlling a mobile terminal. 该方法包括:接收用于激活移动终端上的语音识别功能的输入;基于所接收的用于激活语音识别功能的输入,访问包括在移动终端的存储器中所存储的多个域中的特定域;基于所访问的域的语言模型和声学模型识别用户语音;以及基于所访问的特定域和所识别的用户语音输出移动终端的至少一个菜单和操作。 The method comprising: receiving an input to activate a voice recognition function on the mobile terminal; based on the received input for activating the voice recognition function, accessing a plurality of domains in a specific domain memory of the mobile terminal stored; based on a language model and an acoustic model speech recognition user visited domain; and based on the accessed specific domain and the recognized user speech output menu of the mobile terminal and the at least one operation.

[0013] 本发明的适用性的进一步的范围将在下文给出的详细描述中变得显而易见。 [0013] Further scope of applicability of the present invention will become apparent from the detailed description given hereinafter. 然而,应当理解,详细描述和特定例子尽管指示了本发明的较佳实施例但仅作为说明给出,因为在本发明的精神和范围内的各种变化和修改对本领域的技术人员来说在阅读详细描述之后是显而易见的。 However, it should be understood that the detailed description and specific examples, while indicating preferred embodiments of the present invention are given by way of illustration only, since various changes and modifications within the spirit and scope of the invention to those skilled in the art that after reading the following detailed description are obvious.

[0014] 附图简要说明 [0014] BRIEF DESCRIPTION OF DRAWINGS

[0015] 从下文给出的详细描述和附图将更全面地理解本发明,该详细描述和附图仅作为说明给出,因此不是对本发明的限制,在附图中: [0015] fully understood from the detailed description given hereinbelow and the accompanying drawings of the present invention will be more, the detailed description and the accompanying drawings given by illustration only, and thus are not limitative of the present invention, in the drawings:

[0016] 图1是根据本发明的实施例的移动终端的框图; [0016] FIG. 1 is a block diagram of a mobile terminal according to embodiments of the present invention;

[0017] 图2是根据本发明的实施例的移动终端的前侧立体图; [0017] FIG. 2 is a front perspective view of a mobile terminal according to an embodiment of the present invention;

[0018] 图3是图2中所示的移动终端的后侧立体图; [0018] FIG. 3 is a rear perspective view of the mobile terminal shown in FIG 2;

[0019] 图4是可在本发明的移动终端上操作的通信系统的概观; [0019] Overview of Communication System FIG. 4 is operable on the mobile terminal according to the present invention;

[0020] 图5是示出根据本发明的一个实施例的通过语音命令的移动终端菜单控制方法的流程图; [0020] FIG. 5 is a flowchart showing a control method of a mobile terminal through a voice menu of the embodiment of the present invention a command;

[0021] 图6A是示出根据本发明的一个实施例的激活移动终端的语音识别功能的方法的概观; [0021] FIG 6A is an overview of a method for activating a voice recognition function of the mobile terminal according to an embodiment of the present invention;

[0022] 图6B和6C是示出根据本发明的一个实施例的输出移动终端的帮助信息的方法的概观; [0022] Figures 6B and 6C are diagrams illustrating an overview of a method in accordance with the output of help information in a mobile terminal of the present embodiment of the invention;

[0023] 图7A是示出根据本发明的一个实施例的识别移动终端的语音命令的方法的流程图; [0023] FIG 7A is a flowchart illustrating a voice recognition method of a mobile terminal according to one embodiment of the present invention in order;

[0024] 图7B是示出根据本发明的一个实施例的识别移动终端的语音命令的方法的概观; [0024] FIG 7B is an overview illustrating a mobile terminal according to a voice recognition method according to an embodiment of the present invention, the command of;

[0025] 图8是示出根据本发明的一个实施例的用于显示移动终端的语音识别率的菜单的方法的概观; [0025] FIG. 8 is a diagram illustrating an overview of a method embodiment of the present invention, a voice recognition rate of a menu of a mobile terminal display embodiment;

[0026] 图9是示出根据本发明的另一个实施例的识别移动终端的语音命令的方法的概观; [0026] FIG. 9 is a diagram illustrating an overview of a speech recognition method according to the present invention, a mobile terminal according to another embodiment of the command;

[0027] 图10是根据本发明的一个实施例的用作移动终端的语音命令识别的基准的数据库配置的概观; [0027] FIG. 10 is an overview configuration of a mobile terminal according to the voice as an embodiment of the present invention, a reference database of command recognition;

[0028] 图11是示出根据本发明的一个实施例的移动终端的语音识别功能正被执行的状态的概观; [0028] FIG. 11 is a diagram illustrating an overview of the state of the voice recognition function of the mobile terminal according to one embodiment of the present invention being performed;

[0029] 图12是示出根据本发明的一个实施例的在移动终端中通过语音命令处理与特定菜单有关的子命令的方法的概观; [0029] FIG. 12 is a diagram illustrating an overview of a method embodiment in a mobile terminal through a voice command process related to the present invention specific menu subcommands;

[0030] 图13是示出根据本发明的一个实施例的在移动终端中通过语音命令搜索地铁地图的方法的概观; [0030] FIG. 13 is a diagram illustrating an overview of a search method according to the subway map through a voice command in a mobile terminal of one embodiment of the present invention;

[0031] 图14是示出根据本发明的一个实施例的在移动终端中通过语音命令再现多媒体文件的方法的概观; [0031] FIG. 14 is a diagram illustrating an overview of a mobile terminal according to the method of reproducing multimedia files through a voice command to an embodiment of the present invention;

[0032] 图15是示出根据本发明的一个实施例的在移动终端中通过语音命令发送电子邮件的方法的概观; [0032] FIG. 15 is a diagram illustrating an overview of a method of transmitting e-mail in the mobile terminal through a voice command to an embodiment of the present invention;

[0033] 图16是示出根据本发明的一个实施例的在移动终端中通过语音命令进行电话呼叫的方法的概观;[0034] 图17是示出根据本发明的一个实施例的在移动终端中通过语音命令使用电话簿信息的方法的概观;[0035] 图18是示出根据本发明的一个实施例的在移动终端中通过语音命令改变背景屏幕的方法的概观;[0036] 图19是示出根据本发明的一个实施例的在移动终端中通过语音命令再现多媒体文件的方法的概观。 [0033] FIG. 16 is a diagram illustrating an overview of a method of a telephone call through a voice command in a mobile terminal according to one embodiment of the present invention; [0034] FIG 17 is a diagram illustrating a mobile terminal according to embodiments of the present invention. Overview of using the phone book information through a voice command process; [0035] FIG. 18 is a diagram illustrating an overview of changing a background screen through a voice command in a mobile terminal in a method according to embodiments of the present invention; [0036] FIG 19 is It shows an overview of a method in a mobile terminal reproducing multimedia files through a voice command according to one embodiment of the present invention. 具体实施方式[0037] 下面将详细参考本发明的较佳实施方式,其具体示例图示于附图中。 DETAILED DESCRIPTION [0037] in detail below with reference to the preferred embodiment of the present invention, specific examples thereof illustrated in the accompanying drawings. [0038] 图1是根据本发明的实施例的移动终端100的框图。 [0038] FIG. 1 is a block diagram of a mobile terminal 100 according to an embodiment of the present invention. 如图所示,移动终端100包括无线通信单元110,该无线通信单元110具有允许在移动终端100与该移动终端所在的无线通信系统或网络之间进行无线通信的一个或多个组件。 As shown, the mobile terminal 100 includes a wireless communication unit 110, the wireless communication unit 110 having one or more components allowing radio communication between a wireless communication system or network of the mobile terminal 100 is located with the mobile terminal. [0039] 例如,无线通信单元110包括经由广播频道从外部广播管理实体接收广播信号和/或广播关联信息的广播接收模块111。 [0039] For example, wireless communication unit 110 includes a broadcast channel receiving a broadcast signal from an external broadcast managing entity via and / or broadcast associated information broadcast receiving module 111. 广播频道可包括卫星频道和地面频道。 The broadcast channel may include a satellite channel and a terrestrial channel. [0040] 此外,广播管理实体通常是指发送广播信号和/或广播关联信息的系统。 [0040] In addition, the broadcast managing entity generally refers to transmitting a broadcast signal and / or broadcast associated information. 广播关联信息的示例包括与广播频道、广播节目、广播服务提供商等相关联的信息。 Examples of broadcast associated information include information associated with a broadcast channel, a broadcast program, a broadcast service provider, etc. 例如,广播关联信息可包括数字多媒体广播(DMB)的电子节目指南(EPG)和手持数字视频广播(DVB-H)的电子服务指南(ESG)。 For example, broadcast associated information may include digital multimedia broadcasting (DMB) electronic program guide (EPG) and digital video broadcast handheld (DVB-H) Electronic Service Guide (ESG). [0041] 此外,广播信号可被实现为TV广播信号、无线电广播信号以及数据广播信号等。 [0041] In addition, the broadcast signal may be implemented as a TV broadcast signal, a radio broadcast signal, and a data broadcast signal. 广播信号还可包括与TV或无线电广播信号组合的广播信号。 The broadcast signal may further include a broadcast signal combined with a broadcast TV signal or radio. [0042] 广播接收模块111还被配置成接收从各种类型广播系统发送的广播信号。 [0042] The broadcast receiving module 111 is further configured to receive broadcast signals transmitted from various types of broadcast systems. 例如,这种广播系统包括地面数字多媒体广播(DMB-T)、卫星数字多媒体广播(DMB-S)、手持数字视频广播(DVB-H)系统、称为媒体单一前向链路(MediaFLO® )的数据广播系统和地面综合业务数字广播(ISDB-T)等。 For example, such broadcasting systems include digital multimedia broadcasting-terrestrial (DMB-T), digital multimedia broadcasting-satellite (DMB-S), digital video broadcast-handheld (DVB-H) system known as media forward link only (MediaFLO®) data broadcasting systems and terrestrial integrated services digital broadcasting (ISDB-T) and so on. 接收多播信号也是有可能的。 Receiving multicast signals is also possible. 此外,由广播接收模块111接收的数据可被存储在诸如存储器160的合适设备中。 Moreover, received by the broadcast receiving module 111 may be stored in a suitable device such as a memory 160. [0043] 无线通信单元110还包括移动通信模块112,它向一个或多个网络实体(例如基站、节点-B)发送无线信号或从其接收无线信号。 [0043] The wireless communication unit 110 also includes a mobile communication module 112, which sends a wireless signal to one or more network entities (e.g., base station, Node -B) or receive wireless signals. 这些信号可表示音频、视频、多媒体、控制信令和数据等。 Such signals may represent audio, video, multimedia, control signaling, and data. [0044] 还包括的是无线因特网模块113,它支持移动终端的因特网接入。 [0044] Also included is a wireless Internet module 113 that supports Internet access for the mobile terminal. 该模块113可内置或外置地耦合到终端上。 The module 113 may be internally or externally coupled to the terminal. 无线通信单元Iio还包括短距离通信模块114,其有助于相对较短距离的通信。 Iio wireless communication unit further comprises a short-range communication module 114 that facilitates relatively short distance communication. 实现该模块的合适技术包括例如在网络技术中通常称为蓝牙和ZigBee的射频标识(RFID)、红外数据关联(IrDA)以及超宽带(UWB),谨此略举几例。 Suitable techniques include, for example, implementing this module in the network is commonly referred to in the art as Bluetooth and ZigBee radio frequency identification (RFID), infrared data association (IrDA), ultra-wideband (UWB), to name a few. [0045] 定位模块115也被包括在无线通信单元110中,并标识或以其它方式获得移动终端100的位置。 [0045] The location module 115 is also included in the wireless communication unit 110 and identifies or otherwise obtains the location of the mobile terminal 100 otherwise. 该定位模块115可用与相关联的卫星、网络组件及其组合协作的全球定位系统(GPS)组件实现。 The position-location module 115 can be used with associated satellites, network components, and combinations cooperate global positioning system (GPS) components implemented. [0046] 此外,如图1所示,移动终端100还包括音频/视频(A/V)输入单元120,它向移动终端100提供音频或视频信号。 [0046] Further, as shown, the mobile terminal 100 further includes an audio / video (A / V) input unit 120 that provides audio or video signals to the mobile terminal 100 1. 如图所示,A/V输入单元120包括相机121和话筒122。 As shown, A / V input unit 120 includes a camera 121 and a microphone 122. 相机121接收并处理静止图片或视频的图像帧。 The camera 121 receives and processes image frames of still pictures or video. [0047] 此外,在便携式设备处于诸如电话呼叫模式、记录模式和语音识别模式之类的特定模式下时,话筒122接收外部音频信号。 [0047] Further, the portable device is such as a phone call mode, recording mode and a specific mode, a voice recognition mode, the microphone 122 receives an external audio signal. 所接收的音频信号然后被处理并转换成数字数据。 The received audio signal is then processed and converted into digital data. 同样,该便携式设备,尤其是A/V输入单元120,通常包括用于去除在接收外部音频信号过程中生成的噪声的混杂噪声去除算法。 Also, the portable device, in particular A / V input unit 120, typically includes assorted noise removing generated in the course of receiving the external audio signal noise removing algorithms. 此外,由A/V输入单元120生成的数据可存储在存储器160中、由输出单元150使用、或者经由通信单元110的一个或多个模块发送。 In addition, generated by the A / V input unit 120 may store data in the memory 160, utilized by output unit 150, or transmitted via one or more modules of the communication unit 110. 如果需要的话,可使用两个或更多话筒和/或相机。 If necessary, use two or more microphones and / or cameras.

[0048] 移动终端100还包括用户输入单元130,它响应于用户对一个或多个关联输入设备的操纵而生成输入数据。 [0048] The mobile terminal 100 further includes a user input unit 130 generates input data responsive to user manipulation of an associated input device. 这种设备的示例包括键盘、按键开关、触摸板(例如静态压力/电容)、转动轮和转动开关。 Examples of such devices include a keypad, a dome switch, a touchpad (e.g., static pressure / capacitance), a rotating wheel and rotary switch. 具体示例是用户输入单元130被配置成与触摸屏显示器协作的触摸板的终端,这将在以下更详细描述。 A specific example is a user input unit 130 is configured to cooperate with a touch screen display of the touch panel terminal, which will be described in more detail below.

[0049] 感测单元140也被包括在移动终端100中,并提供对移动终端100的各个方面的状态测量。 [0049] The sensing unit 140 is also included in the mobile terminal 100 and provides status measurements of various aspects of the mobile terminal 100. 例如,感测单元140可检测移动终端100的开/关状态、移动终端100的组件(例如显示器和键区)的相对定位、移动终端100或移动终端100的组件的位置变化、用户与移动终端100接触与否、移动终端100的取向或加速/减速等。 For example, the sensing unit 140 may detect the mobile terminal 100. The open / close state, the movable component (e.g., a display and keypad) of the terminal 100, relative positioning, the position change of components of the mobile terminal 100 or the mobile terminal 100, the user and the mobile terminal 100 or not in contact with the mobile terminal, orientation or acceleration / deceleration of 100.

[0050] 作为示例,当移动终端100是滑盖型移动终端时,感测单元140可感测移动终端100的滑动部分是打开还是关闭。 [0050] As an example, when the mobile terminal 100 is a slide-type mobile terminal, the sensing unit 140 may sense whether a sliding portion of the mobile terminal 100 is open or closed. 其它示例包括感测单元140感测电源190是否提供功率、接口单元170和外部设备之间是否存在耦合或其它连接。 Other examples include the sensing unit 140 sensing the presence or absence of power supply 190, provides coupling or other connection between the power, the interface unit 170 and an external device.

[0051] 此外,接口单元170往往实现成将移动终端与外部设备耦合。 [0051] Further, the interface unit 170 is often implemented to couple the mobile terminal with external devices. 典型的外部设备包括有线/无线头戴受话机、外部充电器、电源、用于存储数据(例如音频、视频、图片等)的存储设备、耳机和话筒等。 Typical external devices include wired / wireless headphones, external chargers, power supplies, for storing data (e.g. audio, video, pictures, etc.), earphones, and microphones, among others. 此外,接口单元170可用有线/无线数据端口、卡插槽(例如,用于耦合到储存卡、客户识别模块(SIM)卡、用户识别模块(ΠΜ)卡、可移动用户识别模块(RUIM)卡等)、音频输入/输出端口和视频输入/输出端口。 Further, the interface unit 170 may be a wired / wireless data port, a card socket (e.g., for coupling to a memory card, subscriber identity module (SIM) card, user identity module (ΠΜ) card, a removable user identity module (RUIM) card etc.), audio input / output ports and video input / output ports.

[0052] 输出单元150通常包括支持移动终端100输出要求的各种组件。 [0052] The output unit 150 generally includes various components which support the mobile terminal 100 outputs required. 移动终端100还包括显示器151,它以可视方式显示与移动终端100相关联的信息。 The mobile terminal 100 further includes a display 151, which displays information associated with the mobile terminal 100 visually. 例如,如果移动终端100运行于电话呼叫模式,则显示器151通常提供包括与呼出、进行和终止电话呼叫相关联的信息的用户界面或图形用户界面。 For example, if the mobile terminal 100 is operating in a phone call mode, the display 151 comprises a generally provide with placing, conducting, and terminating a phone call information associated with a user interface or graphical user interface. 作为另一示例,如果移动终端100处于视频呼叫模式或照相模式下,则显示器151可附加地或替代地显示与这些模式相关联的图像。 As another example, if the mobile terminal 100 is in a video call mode or a photographing mode, the display 151 may additionally or alternatively display images associated with these modes.

[0053] 此外,显示器151较佳地还包括与诸如触摸板之类的输入设备协同工作的触摸屏。 [0053] In addition, the display 151 also preferably includes an input device such as a touchpad touch screen working in cooperation. 该配置允许显示器151同时充当输出设备和输入设备。 This configuration permits the display 151 to function both as an output device and an input device. 此外,显示器151可用包括例如液晶显示器(IXD)、薄膜晶体管液晶显示器(TFT-1XD)、有机发光二极管显示器(OLED)、柔性显示器和三维显示器的显示技术实现。 In addition, display 151 may be, for example, display technologies including a liquid crystal display (IXD), a thin film transistor liquid crystal display (TFT-1XD), an organic light emitting diode display (the OLED), a flexible display and a three-dimensional display is realized.

[0054] 移动终端100还可包括一个或多个这样的显示器。 [0054] The mobile terminal 100 may also include one or more of such displays. 双显示器实施例的示例是一个显示器被配置成内部显示器(当终端处于打开位置时可以查看)以及第二显示器被配置成外部显示器(在打开和关闭位置都可以查看)。 Exemplary embodiment of a two-display embodiment is one display is configured as an internal display (can be viewed when the terminal is in the open position) and a second display configured as an external display (can be viewed in the open and closed positions).

[0055] 图1还示出具有支持移动终端100的音频输出需要的音频输出模块152的输出单兀150。 [0055] FIG 1 further shows a mobile terminal supporting audio output 100. The audio output module 152 requires the output unit 150 Wu. 音频输出模块152通常用一个或多个扬声器、蜂鸣器、其它音频产生设备及其组合来实现。 The audio output module 152 is often implemented using one or more speakers, buzzers, other audio producing devices, and combinations thereof. 此外,音频输出模块152可在包括呼叫接收模式、呼叫进行模式、记录模式、语音识别模式和广播接收模式在内的各种模式中运行。 Further, the audio output module 152 may operate in various modes including a call-receiving mode, a call mode, a recording mode, a voice recognition mode and broadcast reception mode in the inner. 在运行过程中,音频输出模块152输出与特定功能(例如,呼叫接收、消息接收和错误)相关的音频。 During operation, the audio output module 152 outputs a particular function (e.g., call received, message received, and errors) audio. [0056] 此外,图中的输出单元150还具有用于发出信号或以其它方式标识发生了与移动终端100相关联的特定事件的警报器153。 [0056] Further, FIG. 150 further includes an alarm output unit 153 for emitting a signal or otherwise identify the occurrence of a particular event associated with the mobile terminal 100 is. 警报事件包括收到呼叫、收到消息和收到用户输入。 Alert events include a call received, message received and user input. 这种输出的示例包括向用户提供触觉感知(例如振动)。 An example of such output includes the providing of tactile sensations (e.g., vibration) to a user. 例如,警报器153可被配置成响应于移动终端100接收到呼叫或消息而振动。 For example, the alarm 153 may be configured to respond to the mobile terminal 100 receiving a call or message to vibrate. [0057] 作为另一示例,可由警报器153响应于在移动终端100处收到用户输入而提供振动,因而提供一种触觉反馈机制。 [0057] As another example, vibration is provided by alarm 153 responsive to receiving user input at the mobile terminal 100, thus providing a tactile feedback mechanism. 另外,由输出单元150的组件提供的各种输出可独立实现,或者这种输出可用这些组件的任意组合实现。 Further, the various outputs provided by the components of output unit 150 may be separately performed, or such output may be any combination of such components. [0058] 此外,存储器160被用于存储各种类型的数据以支持移动终端100的处理、控制和存储需要。 [0058] In addition, the memory 160 is used to store various types of data to support the processing 100, control, and storage requirements. 这些数据的示例包括在移动终端100上操作的应用程序的程序指令、呼叫历史、联系人数据、电话簿数据、消息、图片、视频等。 Examples of such data include program instructions for applications operating on the mobile terminal 100, call history, contact data, phonebook data, messages, pictures, videos and the like. [0059] 此外,在图1中示出的存储器160可用任何类型(或组合)的合适易失性和非易失性存储器或存储设备来实现,包括随机存取存储器(RAM)、静态随机存取存储器(SRAM)、电可擦可编程只读存储器(EEPROM)、可擦可编程只读存储器(EPROM)、可编程只读存储器(PROM)、只读存储器(ROM)、磁性存储器、闪存、磁盘或光盘、卡式存储器、或其它类似存储器或数据存储设备。 [0059] In addition, the memory 160 shown using any type (or combination) of suitable volatile and nonvolatile memory or storage devices implemented in FIG. 1, including a random access memory (RAM), static random access memory access memory (SRAM), electrically erasable programmable read only memory (EEPROM), erasable programmable read only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disk, card-type memory, or other similar memory or data storage device. [0060] 终端100还包括控制器180,它通常控制移动终端100的总体操作。 [0060] The terminal 100 further includes a controller 180 that typically controls the overall operations of the mobile terminal 100. 例如,控制器进行与语音呼叫、数据通信、即时消息通信、视频呼叫、相机操作和记录操作相关联的控制和处理。 For example, the controller performs a voice call, the control and processing data communications, instant message communications, video calls, camera operations and recording operations associated. 如图1所示,控制器180可包括提供多媒体回放功能的多媒体模块181。 1, the controller 180 may include a multimedia module 181 that provides multimedia playback functions. 多媒体模块181可被配置成控制器180的一部分,或者该模块可被实现为独立组件。 The multimedia module 181 may be configured as part of the controller 180, or this module may be implemented as a separate component. [0061] 此外,电源190提供便携式设备的各个组件所需的电力。 [0061] In addition, power supply 190 provides power required by various components of the portable device. 所提供电力可以是内部电力、外部电力或其组合。 The provided power may be internal power, external power, or combinations thereof. [0062] 接下来,图2是根据本发明的实施例的移动终端100的前侧视图。 [0062] Next, FIG. 2 is a front side view of a mobile terminal according to an embodiment of the present invention 100. 如图2所示,移动终端100包括配置成与第二机身205滑动配合的第一机身200。 As shown, the mobile terminal 1002 is configured to include a first body 205 and the second sliding body 200 of the fitting. 图1中所述的用户输入单元130可包括诸如功能键210之类的第一输入单元和诸如键区215之类的第二输入单元以及诸如侧键245之类的第三输入单元。 The user input unit in FIG third input unit 130 may include a second input unit such as function keys 210 and the like and a first input unit such as keypad 215, and side keys 245 or the like as. [0063] 功能键210与第一机身200相关联,而键区215与第二机身205相关联。 [0063] The function keys 210 are associated with first body 200, the keypad 215 is associated with second body 205. 键区包括使用户能够呼出电话、准备文本或多媒体消息、或以其它方式操作移动终端100的各种键(例如数字、字符和符号)。 Button to enable a user to place a call, prepare a text or multimedia message, and otherwise operate various keys (e.g., numbers, characters, and symbols) to the mobile terminal 100. [0064] 此外,第一机身200相对于第二机身205在打开和关闭位置之间滑动。 [0064] In addition, the first body 200 slides relative to second body 205 between open and closed positions. 在关闭位置时,第一机身200以这种方式在第二机身205上定位:键区215基本上或完全被第一机身200遮蔽。 In the closed position, the first body 200 is positioned over the second body 205 in such a manner: the keypad 215 is substantially or completely obscured by the first body 200. 在打开位置时,用户访问键区215以及显示器151和功能键210成为可能。 In the open position, user access to the keypad 215 and the display 151 and function keys 210, is possible. 功能键方便用户输入诸如开始、停止和滚动的命令。 Function keys facilitate user input such as start, stop and scroll commands. [0065] 此外,移动终端100可在待机模式(例如,能够接收呼叫或消息、接收和响应网络控制信令)或活动呼叫模式下工作。 [0065] Further, the mobile terminal 100 may be in a standby mode (e.g., able to receive a call or message, receive and respond to network control signaling), or an active call mode. 通常,移动终端100在处于关闭位置时在待机模式下运行,而在打开位置时在活动模式下运行。 Typically, the mobile terminal 100 functions in a standby mode when in the closed position, while operating in the active mode in the open position. 然而,该模式配置可按要求或需要更改。 However, the mode configuration may be changed as required or desired. [0066] 此外,第一机身200由第一外壳220和第二外壳225形成,而第二机身205由第一外壳230和第二外壳235形成。 [0066] In addition, the first body 200 of the housing 225 is formed from a first and a second housing 220, the second body 205 is formed from a first case 230 and second case 235. 各第一和第二外壳通常由诸如注入成型塑料之类的适当刚性(ridge)材料来形成,或者用诸如不锈钢(STS)和钛(Ti)的金属材料形成。 Respective first and second cases are usually formed from a suitably rigid such as injection molded plastic or the like (Ridge) material, such as stainless steel or formed (STS) and titanium metal material (Ti) of. [0067] 如果需要,可在第一和第二机身200、205之一或两者的第一和第二外壳之间设置一个或多个中间外壳。 [0067] If desired, one may be disposed between the first and second housing 200, 205 or both the first and second one or more intermediate body housing. 此外,第一和第二机身200、205的大小被调整成可容纳用于支持移动终端100的操作的电子组件。 In addition, the size of the first and second bodies 200, 205 is adjusted to accommodate for the electronic component to support the mobile terminal 100.

[0068] 第一机身200还包括相机121和被配置成相对于显不器151定位的扬声器的音频输出单元152。 [0068] The first body 200 further includes a camera 121 and is not configured to substantially 151 with respect to the positioning of the speaker audio output unit 152. 相机121还可以这种方式构成:它可相对于第一机身200选择性地定位(例如,转动、旋转等)。 The camera 121 may also be configured in this way: it relative to the first body 200 may be selectively positioned (e.g., rotated, rotation, etc.).

[0069] 此外,功能键210靠近显示器151的下侧定位。 [0069] Further, the function keys 210 are positioned at the side close to the display 151. 如上所述,显示器151被实现为IXD或0LED。 As described above, the display 151 is implemented as IXD or 0LED. 显示器151还可被配置成具有响应于用户接触(例如,手指、输入笔等)触摸屏而生成信号的底层触摸板的触摸屏。 Display 151 may also be configured to have an underlying touchpad responsive to user contact (e.g., finger, stylus, etc.) which generates signals touchscreen touch screen.

[0070] 第二机身205还包括与键区215相邻定位的话筒122和侧键245,该侧键245是沿第二机身205的侧面定位的一类用户输入单元。 [0070] The second body 205 also includes a microphone 215 positioned adjacent to the keypad 122 and side keys 245, the side keys 245 along a side of the second type of user input unit body 205 is positioned. 较佳地,侧键245可被配置成热键,使得侧键245与移动终端100的特定功能相关联。 Preferably, the side keys 245 may be configured as hot keys, such that the side keys 245 are associated with a particular function of the mobile terminal 100. 如图所示,接口单元170与侧键245相邻定位,而电池形式的电源190位于第二机身205的下部。 As shown, the interface unit 170 and positioned adjacent to the side keys 245, and the battery power supply 190 form a lower portion of the second body 205 is positioned.

[0071] 图3是图2中所示的移动终端的后侧视图。 [0071] FIG. 3 is a rear side view of the mobile terminal shown in FIG. 如图3所示,第二机身205包括相机121、以及相关联的闪光灯250和反射镜255。 As shown in FIG. 3, the second body 205 includes a camera flash 121, and 250 and the associated reflector 255. 闪光灯250结合第二机身205的相机121操作,反射镜255用于帮助用户在自拍模式中定位相机121。 250 121 operating in conjunction with a camera flash, a mirror 205 of the second body 255 to help the user to position the camera 121 in selfie mode. 此外,第二机身205的相机121朝向与图2所示的第一机身200的相机121所朝向的方向相反的方向。 Further, the direction of the camera 121 of the first body 200 shown in the second body 205 toward the camera 121 in FIG. 2 facing opposite directions.

[0072] 此外,第一和第二机身的相机121各自可具有相同或不同的能力。 [0072] In addition, the first camera 121 and the second body each may have the same or different capabilities. 例如,在一实施例中,第一机身200的相机121以比第二机身205的相机121相对较低的分辨率操作。 For example, in one embodiment, the camera 121 of the first body 200 is relatively lower than the camera 121 of the second operating body 205 resolution. 这一安排在例如其中反向链路带宽能力受到限制的视频会议通话期间十分有效。 This arrangement, for example, during a video conference call in which reverse link bandwidth capabilities may be limited very effective. 此外,第二机身205 (图3)的相机的相对较高分辨率对获取较高质量图片以备后续使用而言十分有用。 Further, the second body 205 (FIG. 3) relatively higher resolution of the camera is very useful for obtaining higher quality pictures for later use concerned.

[0073] 第二机身205还包括配置成位于第二机身205上侧的扬声器的音频输出模块152。 [0073] The second body 205 further includes a second body 205 configured to be positioned on the side of the speaker audio output module 152. 第一和第二机身200、205的音频输出模块还可协作提供立体声输出。 First and second bodies 200, 205 cooperate to provide the audio output module may also stereo output. 此外,这些音频输出模块的任意一个或两者可被配置成充当扬声器电话。 In addition, either or both of these audio output modules may be configured to operate as a speakerphone.

[0074] 终端100还包括广播信号接收天线260,它位于第二机身205的上端。 [0074] The terminal 100 also includes a broadcast signal receiving antenna 260, which is located in the upper end 205 of the second body. 天线260与广播接收模块111(图1)协作运行。 Antenna 260 and the broadcast receiving module 111 (FIG. 1) operate in cooperation. 如果需要的话,天线260可以是固定的,或是配置成缩回第二机身205中。 If desired, the antenna 260 may be fixed or configured to retract into the second body 205. 此外,第一机身200的背侧包括与位于第二机身205前侧的相应滑动模块可滑动地耦合的滑动模块265。 Further, the back side of the first body 200 includes slide module located on the respective front side of the second body 205 slidably coupled to the slide module 265.

[0075] 此外,第一和第二机身200、205的各种组件的所示安排可按要求和需要进行更改。 [0075] Further, arrangements need to be changed according to requirements and the various components shown in the first and second bodies 200, 205. 通常,一个机身的组件中的一部分或全部能够可替换地在另一机身上实现。 Typically, a body part or all components may alternatively be implemented on the other body. 此外,这些组件的位置和相对定位可以定位在不同于代表性附图所示的位置上。 Further, the positions and relative positioning of the components may be positioned in a different position as shown by the representative figures.

[0076] 此外,图1-3的移动终端100可被配置成在经由帧或分组发送数据的通信系统中操作,包括无线、有线通信系统和基于卫星的通信系统。 [0076] Further, the mobile terminal 100 of FIGS. 1-3 may be configured to operate via a communication system for transmitting data frames or packets, including wireless and wireline communication systems, and satellite-based communication system in. 这些通信系统使用不同的空中接口和/或物理层。 Such communication systems utilize different air interfaces and / or physical layers.

[0077] 由通信系统使用的这种空中接口的示例包括例如频分多址(FDMA)、时分多址(TDMA)、码分多址(CDMA)和通用移动电信系统(UMTS)、UMTS的长期演进(LTE)以及全球移动通信系统(GSM)。 [0077] Examples of such air interfaces utilized by the communication systems include frequency division multiple access, for example, long-term (FDMA), time division multiple access (TDMA), code division multiple access (CDMA), and universal mobile telecommunications system (UMTS), UMTS is Evolution (LTE) and global system for mobile (GSM). 仅作为非限制性示例,进一步的描述将涉及CDMA通信系统,但是这些教导同样地适用于其它系统类型。 As a non-limiting example only, further description will relate to a CDMA communication system, but such teachings apply equally to other system types.

[0078] 接下来,图4示出具有多个移动终端100、多个基站270、多个基站控制器(BSC) 275和移动交换中心(MSC) 280的CDMA无线通信系统。 [0078] Next, 100 shown in FIG. 4, a plurality of base stations 270, a plurality of base station controllers (BSC) 275 and a mobile switching center (MSC) CDMA wireless communication system having a plurality of mobile terminals 280. [0079] MSC 280配置成与公共交换电话网(PSTN) 290接口,且MSC 280还被配置成与BSC275接口。 [0079] 290 MSC 280 is configured to interface with a public switched telephone network (PSTN), and the MSC 280 is also configured to BSC275 interface. 此外,BSC 275经由回程线路耦合到基站270。 In addition, BSC 275 couples to base stations 270 via backhaul lines. 此外,回程线路可根据若干公知接口中的任一种来配置,包括例如El/Tl、ATM、IP、PPPjm**、HDSL、ADSL、*xDSL。 In addition, the backhaul lines may be configured in accordance with any of several known interfaces including, for example, El / Tl, ATM, IP, PPPjm **, HDSL, ADSL, * xDSL. 此外,系统可包括两个以上的BSC 275。 Further, the system may include more than two BSC 275. [0080] 每个基站270还可包括一个或多个扇区,每个扇区具有全向天线或指向径向远离基站270的特定方向的天线。 [0080] Each base station 270 may also include one or more sectors, each sector having an omnidirectional antenna or an antenna pointed in a particular direction radially away from the base station 270. 或者,每个扇区可包括用于分集接收的两个天线。 Alternatively, each sector may comprise two antennas for diversity reception. 此外,每个基站270可被配置成支持多个频率分配,并且各个频率分配具有特定频谱(例如,1.25MHz、5MHz)。 In addition, each base station 270 may be configured to support a plurality of frequency assignments, with each frequency assignment having a particular spectrum (e.g., 1.25MHz, 5MHz). [0081] 扇区和频率分配的交集被称为CDMA信道。 [0081] The intersection of a sector and frequency assignment may be referred to as a CDMA channel. 基站270还可被称为基站收发机子系统(BTS)。 The base station 270 may also be referred to as a base transceiver subsystem (BTS). 在一些情形中,术语“基站”可用于通指BSC 275、以及一个或多个基站270。 In some cases, the term "base station" may be used to refer collectively to a BSC 275, and one or more base stations 270. [0082] 基站还可表示成“小区站点(cell site)”。 [0082] The base stations may also be denoted "cell site (cell site)". 或者,给定基站270的各个扇区可被称为小区站点。 Alternatively, individual sectors of a given base station 270 may be referred to as cell sites. 另外,地面数字多媒体广播(DMB)发射机295被示为向工作在该系统中的移动终端100广播。 Further, a terrestrial digital multimedia broadcasting (DMB) transmitter 295 is shown broadcasting to the operation of the mobile terminal 100 in the system. [0083] 此外,移动终端100的广播接收模块111 (图1)通常被配置成接收由DMB发射机295发射的广播信号。 [0083] Further, the mobile terminal broadcast receiving module 111 (FIG. 1) 100 is typically configured to receive broadcast signals transmitted by the DMB transmitter 295. 如上所述,可对其它类型的广播和多播信令实现类似的安排。 As described above, a similar arrangement may be implemented for other types of broadcast and multicast signaling. [0084] 图4还示出了若干全球定位系统(GPS)卫星300。 [0084] FIG 4 further illustrates several global positioning system (GPS) satellites 300. 这些卫星有助于定位一部分或者所有移动终端100的位置。 Such satellites facilitate locating the position of a part or all of the mobile terminal 100. 在图4中示出了两个卫星,但是,可使用更多或更少的卫星来获取定位信息。 In FIG 4 shows two satellites, however, may use more or fewer satellites to acquire positioning information. [0085] 另外,移动终端100的定位模块115 (图1)通常被配置成与卫星300协作以获得期望的位置信息。 [0085] Further, the mobile terminal location module 115 (FIG. 1) 100 is typically configured to cooperate with the satellites 300 to obtain desired position information. 然而,或者也可以实现其它类型的位置检测技术,比如可添加到或替代GPS定位技术的定位技术。 However, it may be implemented or other types of position detection technology, such as can be added to or instead of GPS location technology positioning technology. 一部分的或者全部的GPS卫星300可选择性地或附加地配置成提供卫星DMB传送。 A part or all of the GPS satellites 300 may alternatively or additionally be configured to provide satellite DMB transmissions. [0086] 此外,在无线通信系统的典型操作期间,基站270从各个移动终端100接收多组反向链路信号。 [0086] Further, during typical operation of the wireless communication system, the base stations 270 receive sets of reverse-link signals from various mobile terminals 100. 移动终端100进行呼叫、收发消息、以及其它通信。 The mobile terminal 100 calls, messaging, and other communications. [0087] 另外,在基站270内处理由给定基站270接收到的每个反向链路信号,且所得数据被转发到相关联的BSC 275。 [0087] Further, the processing of each reverse-link signal received by a given base station 270 to the base station 270 in, and the resulting data is forwarded to an associated BSC 275. BSC提供呼叫资源分配以及包括基站270之间的软切换的移动性管理功能。 The BSC provides call resource allocation and mobility management functionality including soft handoffs between base stations 270. [0088] 此外,BSC 275还将收到的数据路由至MSC 280,MSC 280提供附加路由服务用于与PSTN 290 接口。 [0088] In addition, BSC 275 also routes the data received to MSC 280, MSC 280 provides additional routing services for interface to the PSTN 290. 类似地,PSTN 与MSC 280 接口,并且MSC 280 与BSC 275 接口。 Similarly, PSTN interfaces with the MSC 280, and BSC 275 interfaces with the MSC 280. BSC 275还控制基站270,向移动终端100发送多组前向链路信号。 BSC 275 further controls the base station 270, transmit sets of forward link signals to the mobile terminal 100. [0089] 在以下的描述中,参照各实施例解释适用于以上配置的移动终端100的控制方法。 [0089] In the following description, with reference to the embodiments explained above configuration applicable to a mobile terminal control method 100. 然而,以下的实施例可单独实现或通过其组合实现。 However, the following embodiments may be implemented individually or through combinations thereof. 此外,在以下的描述中,假设显示器151包括触摸屏。 In the following description, it is assumed that the display 151 includes a touchscreen. 另外,触摸屏或其屏幕可由附图标记'400'指示。 Further, the screen may be a touch screen or a reference numeral '400' indicates. [0090] 在本发明的实施例中,一种终端将用作语音命令识别基准的数据库的域(或信息搜索范围)指定为与特定菜单或服务有关的域。 [0090] In an embodiment of the present invention, a voice command to be used as a terminal domain (or information search range) of the database designated as the reference identification associated with a particular domain or menu service. 因此,语音命令的识别率提高,且由移动终端使用的资源总量减少。 Therefore, to improve the recognition rate of a voice command, and reduce the amount of resources used by the mobile terminal. [0091] 此外,用作语音识别的基准的数据库的域可通过移动终端的环境设置菜单来指定。 [0091] Further, the voice recognition domain as a reference database may be specified by an environment setting menu of the mobile terminal. 同样,一旦语音识别功能被激活,指定的域被自动应用。 Similarly, once the voice recognition function is activated, the specified domain is automatically applied. [0092] 在下文中,假设用于语音命令识别的数据库的预置域包括与当前显示器151上显示的菜单有关的信息,或与诸菜单之一的子菜单有关的信息。 [0092] In the following, it is assumed for voice command recognition domain database including preset information menus currently displayed on the display 151 relating to, or information relating to sub-menus of one of the various menus.

[0093] 接下来,图5是示出根据本发明的一个实施例的通过语音命令的移动终端菜单控制方法的流程图。 [0093] Next, FIG 5 is a flowchart illustrating a control method of a mobile terminal through a voice menu of the embodiment of the present invention a command. 在以下的描述中还将参考图1。 In the following description, with reference to FIG. 1 also. 如图5所示,控制器180确定语音识别功能是否已经被激活(SlOl)。 5, the controller 180 determines whether the voice recognition function has been activated (SlOl).

[0094] 此外,语音识别功能可通过用户选择移动终端上的硬件按钮或显示模块151上的软触摸按钮来激活。 [0094] Further, the voice recognition function may be selected hardware buttons on the mobile terminal by a user or a soft-touch button on the display module 151 activated. 用户还可通过操纵显示器151上显示的特定菜单来激活语音识别功能。 The user may also activate the voice recognition function by manipulating specific menus displayed on the display 151. 语音识别功能还可通过用户生成特定声音或声音效果、通过短距离或长距离无线信号或通过诸如手势或体态之类的用户肢体信息来激活。 Voice recognition function may also generate a specific sound or sound effects by the user is activated by short- or long- range wireless signals, or by user information such as a limb or body gesture like.

[0095] 更详细地,特定声音或声音效果可包括具有比特定级别高的级别的撞击声。 [0095] In more detail, the specific sound or sound effects may include impact sounds having a level higher than a certain level. 此外,特定声音或声音效果可利用声级检测算法来检测。 Further, the specific sound or sound effects may be detected using a sound level detecting algorithm. 另外,声级检测算法较佳地比语音识别算法更简单,因此消耗较少的移动终端资源,同样,声级检测算法(或电路)可由语音识别算法或电路单独地实现,或可被实现为指定语音识别算法的部分功能。 Further, the sound level detecting algorithm is preferably more simple than a voice recognition algorithm, and thus consumes less resources of the mobile terminal, similarly, sound level detection algorithm (or circuit) may be a voice recognition algorithm or circuit implemented separately, or may be implemented as a Specifies the voice recognition algorithm of some functions.

[0096] 另外,无线信号可通过无线通信单元110来接收,而用户的手势或体态可通过感测单元140来接收。 [0096] Further, the wireless signals may be received by the wireless communication unit 110, and a user or body gestures may be received through the sensing unit 140. 因此,在本发明的实施例中,无线通信单元110、用户输入单元130和感测单元140可被称为信号输入单元。 Thus, in the embodiment of the present invention, the wireless communication unit 110, the user input unit 130 and the sensing unit 140 may be referred to as a signal input unit. 此外,语音识别功能还可以以类似的方式终止。 Further, the voice recognition function may also be terminated in a similar manner.

[0097] 使用户以物理方式激活语音识别功能是特别有利的,因为用户更能意识到他们将要使用语音命令来控制终端。 [0097] enables the user physically activate the voice recognition function is particularly advantageous, because the user is more aware they are about to use voice commands to control the terminal. 即,因为用户需要首先执行对终端的物理操纵,所以他或她直观地意识到他们将输入语音命令或指令至终端,因此说得更清楚或更慢从而激活特定功能。 That is, since the user must first perform a physical manipulation of the terminal, so that he or she intuitively realize that they will enter a voice command or instruction to the terminal, so say it more clearly or more slowly in order to activate a particular function. 因此,例如,因为用户说得更清楚或更慢,准确识别语音指令的概率增加。 Thus, for example, because the user put it more clearly or more slowly, increasing the probability of accurately recognizing the voice instruction. 即,在本发明的实施例中,语音识别功能的激活由终端上按钮的物理操纵来执行,而不是通过对终端讲话来激活语音识别功能。 That is, in the embodiment of the present invention, the activation of the voice recognition function is performed by a physical manipulation of a button on the terminal, rather than by speaking into the terminal to activate the voice recognition function.

[0098] 此外,控制器180可基于用户触摸特定按钮或触摸屏的部分的次数、用户触摸特定按钮或触摸屏的部分的时间长度等来开始或终止语音识别功能的激活。 [0098] Further, the controller 180 may be based on the number of times the user touches a particular portion of a button or touch screen, the user portion of the length of time a particular button or touch a touch screen to start or terminate activation of the voice recognition function. 用户还可设置控制器180如何利用由本发明提供的适当菜单选项来激活语音识别功能。 The user can also set how the controller 180 using the appropriate menu option provided by the present invention is to activate the voice recognition function. 例如,用户可选择终端上的菜单选项,其包括I)基于语音激活按钮被选择的次数X设置语音识别的激活、2)基于语音激活按钮被选择的时间量X设置语音识别的激活、3)当按钮X和Y被选择时设置语音识别的激活等。 For example, the user may select a menu option on the terminal, which includes a number of times the voice activation based on the activation button is provided to select the speech recognition X, X is set activation of voice recognition I) 2) based on the amount of time the voice activation button is selected, 3) provided voice recognition activation, etc. when X and Y are selected button. 用户于是可输入X和Y的值,以便可改变地设置控制器180如何确定语音激活功能被激活。 The user can then enter the values ​​of X and Y, so as to be variably set how the controller 180 determines the voice activation function is activated. 因此,根据本发明的实施例,用户积极地使用其移动终端的语音识别功能,这增加了控制器180确定与用户语音指令相对应的正确功能的概率,这也允许用户根据他或她的需要修改语音激活功能。 Thus, according to an embodiment of the present invention, a user actively using their voice recognition function of the mobile terminal, which increases the function of the controller 180 to determine the proper corresponding to the probability that a user voice instruction, which also allows the user according to his or her needs modify the voice activation function.

[0099] 控制器180还可在指定的按钮被触摸或选择的同时维持语音识别功能的激活状态,并在指定的按钮被放开时停止语音识别功能。 [0099] The controller 180 may also simultaneously touched or selected button specified in the activated state to maintain the voice recognition function, and stop the voice recognition function when the designated button is released. 或者,控制器180可在指定按钮被触摸或选择后将语音识别功能的激活维持预定的时间间隔,并在预定时间间隔结束时停止或终止语音识别功能。 Alternatively, the controller 180 may be a touch activated or selected to maintain the voice recognition function after a predetermined time interval designation button, and stop or terminate the voice recognition function at the end of a predetermined time interval. 在又一个实施例中,控制器180可将所接收的语音指令存储在存储器160中,同时将语音识别功能维持为激活状态。 In yet another embodiment, the controller 180 may store received voice instructions in the memory 160 while the voice recognition function activation state is maintained.

[0100] 另外,如图5所示,用作识别语音命令的含义的基准的数据库的域被指定给与终端上的特定功能或菜单有关的信息(S102)。 Domain [0100] Further, as shown in Figure 5, as the meaning of the voice command recognition reference information database is designated given specific functions or menus on the terminal associated (S102). 例如,数据库的特定域可以是与当前显示器151上显示的菜单有关的信息,或与所显示的菜单之一的子菜单有关的信息。 For example, a particular domain database may be information with the menu currently displayed on the display 151 relating to, or information relating to sub-menus of one of the displayed menu. 另外,因为数据库的域被指定,所以输入语音命令的识别率提高。 Further, because the domain of database is specified, the recognition rate of the input voice command is improved. 域的例子包括电子邮件域、所接收的呼叫域和多媒体域等。 Examples of domains include e-mail domain, a received calls domain, and multimedia domain, etc. [0101] 同样,与子菜单有关的信息可被配置为数据库中的数据。 [0101] Similarly, information relating to sub-menus may be configured as data in a database. 例如,信息可被配置成关键词的形式,且多个信息可对应于一个功能或菜单。 For example, the information may be configured in the form of keywords and a plurality of information may correspond to one function or menu. 另外,根据信息的特征,数据库可以是多个数据库,且可被存储在存储器160中[0102] 此外,数据库中的信息可通过学习过程有利地更新或翻新。 Further, according to characteristic information, the database may be a plurality of databases, and may be stored [0102] In addition, information in the database can be updated or refurbished in the memory 160 through the learning process advantageously. 相应数据库的各个域也可被指定为与当前正被输出的功能或菜单有关的域,以便提高语音命令的识别率。 Each of corresponding database fields may also be specified as domain functions or menus being currently output related to improve the recognition rate of the voice command. 该域也可随着菜单步骤继续前进而改变。 This field can also move forward with steps to change the menu. [0103] 一旦语音识别功能被激活(S101中的是)且域已被指定(S102),控制器180就确定用户是否已经输入语音命令(S103)。 [0103] Once the voice recognition function is activated (S101 are) and the domain has been specified (S102), the controller 180 determines whether the user has input a voice command (S103). 当控制器180确定用户已经输入了语音命令(S103中的是)时,控制器180基于特定的数据库分析通过话筒122输入的语音命令或指令的背景和内容,从而判断语音命令的含义(S104)。 When the controller 180 determines that the user has input a voice command (S103 is YES), the controller 180 through the background and content of the voice command or instruction input microphone 122, to determine the meaning of the voice command based on the analysis of a specific database (S104) . [0104] 此外,控制器180可基于所访问的域的语言模型和声学模型确定语音指令或命令的含义。 [0104] Further, the controller 180 may determine that voice instruction based on a language model and an acoustic model of the accessed domain or command meaning. 更详细地,语言模型涉及词本身,而声学模型对应于说出词的方式(例如,所说词或短语的频率组分)。 In more detail, the language model relates to the words themselves and the acoustic model corresponds to the way the words spoken (e.g., frequency components of said word or phrase). 将语言和声学模型与特定域和移动终端100的状态一起使用,控制器180可高效率地确定输入语音指令或命令的含义。 The acoustic model and the language used with a specific domain and a state of the mobile terminal 100, the controller 180 determines the meaning of the input voice instructions or commands can be efficiently. [0105] 此外,当控制器180将输入语音命令存储在存储器160中时,控制器180可在用户解除语音识别功能的激活时立即开始判断输入语音命令的含义的过程,或者可在语音命令被输入时同时执行语音激活功能。 [0105] Further, when the controller 180 stores the input voice command start determination process of the input voice command meaning immediately when the memory 160, the controller 180 may deactivate the voice recognition function to the user, or may be in a voice command while performing voice activation function input. [0106] 另外,如果语音命令还未被完全输入(S103中的否),则控制器180还可执行其它功能。 [0106] Further, if the voice command has not been fully input (No in S103), the controller 180 may also perform other functions. 例如,如果用户通过触摸菜单选项等执行另一个动作,或按下终端上的按钮(S109中的是),则控制器180执行相对应的所选功能(SllO)。 For example, a button on the terminal (S109 are) pressed if the user performs another action by touching a menu option, etc., or, the controller 180 performs the corresponding selected function (SllO). [0107] 此外,在控制器180在步骤S104确定输入语音命令的含义之后,控制器180输出含义的结果值(S105)。 [0107] Further, after the controller 180 determines the input voice command in step S104, the meaning, the controller 180 outputs a result value of the meaning (S105). 即,结果值可包括用于执行与对应于所确定含义的功能或服务有关的菜单、用于控制移动终端的特定组件等的控制信号。 That is, the result value may include performing menu functions or services corresponding to the determined meaning, for controlling specific components of the control signal of the mobile terminal or the like. 结果值还可包括用于显示与所识别的语音命令有关的信息的数据。 Result value may also include data relating to the recognized voice command display. [0108] 控制器还可请求用户确认输出结果值是否正确(S106)。 [0108] The controller may also request the user confirm the output result value is correct (S106). 例如,当语音命令具有低识别率或被确定具有多个含义时,控制器180可输出与相应含义有关的多个菜单,然后执行由用户选择的菜单(S107)。 For example, when a voice command has a low recognition rate or is determined to have a plurality of meanings, the controller 180 may output a plurality of menus relating to the respective meanings, and then execute a menu selected by the user (S107). 同样,控制器180可询问用户是否要执行具有高识别率的特定菜单,然后根据用户的选择或响应执行或显示相应的功能或菜单。 Similarly, the controller 180 may ask the user whether to execute a specific menu having a high recognition rate, and then execute or display a corresponding function or menu according to a user's selection or response. [0109] 另外,控制器180还可输出语音消息,以请求用户选择具体菜单或选项,譬如“您想要执行相册菜单吗?回答是或否”。 [0109] In addition, the controller 180 can also output a voice message to request the user to select a specific menu or option, such as "Do you want to do an album menu? Answer yes or no." 然后,控制器180基于用户响应执行或不执行对应于具体菜单或选项的功能。 Then, the controller 180 based on the user response corresponds to or may not perform the function of particular menu or option. 如果用户在具体的时间间隔(例如,5秒)中不响应,则控制器180也可立即执行具体的菜单或选项。 If the user at a specific time interval (e.g., 5 seconds) does not respond, the controller 180 may also be performed immediately particular menu or option. 即,如果没有来自用户的响应,则控制器180可通过将无响应判断为肯定回答来自动执行功能或菜单。 That is, if there is no response from the user, the controller 180 is determined by the non-responsive to the affirmative answer to automatically perform the function or menu. [0110] 此外,用户可利用他或她的语音(例如,是或否)或经由诸如硬件或软件按钮、触摸板等其它输入单元回答来自控制器180的问题。 [0110] In addition, the user may use his or her voice (e.g., yes or no) answer questions from the controller 180, or via other input units such as hardware or software buttons, a touch panel and the like. 另外,在步骤S106,如果有来自用户的否定回答(S106中的否),即,如果语音命令的含义未被准确地判断,则控制器180可执行附加的差错处理步骤(S108)。 Further, at step S106, if there is a negative answer from the user (NO in S106), i.e., if the meaning of the voice command is not precisely judged, the controller 180 can perform additional error processing step (S108). [0111] 即,差错处理步骤可通过再次接收语音命令的输入来执行,或可通过显示具有高于特定级别的识别率的多个菜单或可被判断为具有类似含义的多个菜单来执行。 [0111] That is, the error processing step may be performed by again receiving input of a voice command, or may have a recognition rate more than a certain level menu is displayed, or may be determined by a plurality of menus having similar meanings performed. 然后用户可选择多个菜单之一。 Then the user can select one of the plurality of menus. 同样,当具有高于特定级别的识别率的功能或菜单的数量小于预定数量(例如,2)时,控制器180可自动执行对应的功能或菜单。 Similarly, when the number of functions or menus having a recognition rate higher than a certain level is less than the predetermined number (e.g., 2), the controller 180 can automatically execute the corresponding function or menu.

[0112] 接下来,图6A是示出根据本发明的一个实施例的激活移动终端的语音识别功能的方法的概观。 [0112] Next, FIG 6A is an overview of a method for activating a voice recognition function of the mobile terminal according to an embodiment of the present invention. 如显示屏410所示,用户可通过触摸软按钮411来激活语音识别功能。 As shown in display screen 410, the user can activate the voice recognition function by touching the soft button 411. 用户还可通过放开软按钮411来终止语音识别功能。 411 user may also terminate the voice recognition function by releasing the soft button. 更具体地,用户可通过触摸软按钮411来激活语音识别功能,并继续触摸软按钮411或硬按钮412直到完成语音指令。 More specifically, the user can activate the voice recognition function by touching the soft button 411, and continues to touch the soft button 411 or hard button 412 until the voice instruction. 即,当已完成语音指令时用户可放开软按钮411或硬按钮412。 That is, when the voice instruction has been completed the user can release the soft button 411 or hard button 412. 因此控制器180知道何时语音指令要被输入以及何时语音指令已完成。 Thus the controller 180 to know when a voice instruction is inputted and when the voice instruction has been completed. 如上所述,因为用户直接参与该确定,所以输入语音命令的解释的准确度增加。 As mentioned above, since the user directly involved in this determination, the input accuracy of the interpretation of the voice command is increased.

[0113] 控制器180还可被配置成例如在用户第一次触摸软按钮411时识别语音激活功能部件的启动,然后在用户再次触摸软按钮411时识别语音指令已经完成。 [0113] The controller 180 may also be configured to enable a soft touch, for example, the first button member 411 identified the voice activation function of the user, then the user touches the soft button 411 again recognize the voice instruction has been completed. 其它的选择方法也是可能的。 Other selection methods are also possible. 另外,如图6A中的显示屏410所示,除使用软按钮411外,语音激活和停用可通过操纵终端上的硬按钮412来执行。 Further, as shown in the display screen 410 shown in FIG. 6A, except using the soft button 411 outside, voice activation and deactivation can be performed 412 by manipulating the hard button on the terminal.

[0114] 另外,显示屏410中所示的软按钮411可以是用户按下或放开以激活/停用语音识别功能的单个软按钮,或者可以是在被选择时产生诸如“1.开始语音激活和2.停止语音激活”的菜单列表的菜单按钮。 [0114] In addition, the soft button 410 shown in the display 411 or may be the user pressing the release to activate / deactivate the voice recognition soft button single function, or may produce such as "1. Start voice when selected, 2. stop and activate voice-activated "menu button menu list. 例如,软按钮411还可以在待机状态期间显示。 For example, the soft button 411 may also be displayed during a standby state.

[0115] 在另一个例子中,如显示屏420所示,用户还可通过触摸屏幕的任意位置来激活和停用语音识别功能。 [0115] In another example, as shown in display screen 420, the user can also activate and deactivate the voice recognition function by touching an arbitrary position of the screen. 显示屏430示出又一个例子,其中用户通过产生高于特定级别的特定声音或音效来激活和停用语音识别功能。 Display 430 shows still another example in which the user by generating a specific sound or sound effects more than a specific level to activate and deactivate the voice recognition function. 例如,用户可拍手以产生这一撞击声。 For example, a user may clap to produce the impact sound.

[0116] 因此,根据本发明的一个实施例,语音识别功能可按两种模式来实现。 [0116] Thus, according to one embodiment of the present invention, the voice recognition function may be implemented in two modes. 例如,语音识别功能可被实现成用于检测具体声音或音效高于某一级别的第一模式、以及用于识别语音命令并确定语音命令的含义的第二模式。 For example, the voice recognition function may be implemented to detect the specific sound or sound level above a first mode, and means for recognizing a voice command and the second mode is determined meaning of the voice command. 如果在第一模式中声音或音效高于某一级别,则第二模式被激活从而识别语音命令。 If in the first mode or the sound level is above a certain sound, the second mode is activated to recognize the voice command.

[0117] 显示屏440示出用户激活和停用语音识别功能的又一种方法。 [0117] Display 440 shows a further method for a user to activate and deactivate the voice recognition function. 在该例子中,控制器180被配置成解释用户的肢体运动来开始或停止语音激活功能。 In this example, the controller 180 is configured to interpret the user's body movement to start or stop the voice activation function. 例如,如显示屏440所示,控制器180可被配置成将用户向显示器移动手解释为要激活语音识别功能的指令,并将用户将手从显示器移开解释为要终止语音识别功能的指令。 For example, as shown in a display screen 440, the controller 180 may be configured to display a user moves a hand to explain to the command to activate the voice recognition function, and the user will be interpreted as a hand away to terminate the voice recognition function from the display instruction . 近程或远程无线信号也可用于启动和停止语音识别功能。 Short- or long-range wireless signals may also be used to start and stop the voice recognition function.

[0118] 因此,根据本发明的实施例,因为语音激活功能被启动和停止,所以语音识别功能未被连续执行。 [0118] Thus, according to an embodiment of the present invention, because the voice activation function is started and stopped, the voice recognition function is not continuously executed. 即,当语音识别功能被连续保持为激活状态时,与本发明的实施例相比移动终端上的资源的量增加。 That is, when the voice recognition function is continuously maintained as the active state, compared with the embodiment of the present invention to increase the amount of resources on the mobile terminal.

[0119] 此外,如以上参考图5所讨论的,当语音识别功能被激活时,控制器180将用作语音命令识别的基准的特定数据库的域指定为与显示器151上的菜单列表有关的域。 [0119] Further, as discussed above with reference to FIG. 5, when the voice recognition function is activated, the controller 180 serving as a domain-specific database for voice command recognition domain specified as a reference to the menu list on the display 151 of . 然而,如果从菜单列表中选择或执行特定的菜单,则数据库的域可被指定为与特定菜单的所选菜单或子菜单有关的信息。 However, if a specific menu is selected or executed from the menu list, the domain of the database may be designated as the information relating to the selected menu or sub-menus of the specific menu.

[0120] 此外,当通过语音命令或触摸输入选择或执行特定菜单时,控制器180可以以语音消息或弹出窗口或气球的形式输出与特定菜单的子菜单有关的帮助信息。 [0120] Further, when an input is selected by a voice command or touch or implement particular menu, the controller 180 may be in the form of a voice message, or pop-up windows or balloons output help information relating to sub-menus of the specific menu. 例如,如图6B所示,当用户经由触摸或语音操作选择“多媒体菜单”时,控制器180将与“多媒体菜单”的子菜单(例如,广播、照相机、文本浏览器、游戏等)有关的信息显示为气球形状的帮助信息441。 For example, shown in Figure 6B, when the user via a touch or voice operation of selecting "Display Menu", the controller 180 and "Display Menu" submenu (e.g., broadcasting, camera, text viewer, game, etc.) related to help information is displayed as balloon-shaped information 441. 或者,控制器180可输出包括帮助信息的语音信号442。 Alternatively, the controller 180 may output a voice signal comprising help information 442. 用户然后可利用语音命令或通过触摸操作选择所显示的帮助选项之一。 The user can then use voice commands or help one of the options displayed by the touch operation selection. [0121] 图6C示出用户利用他或她的肢体运动(在该例子中为用户的手势)选择菜单项的实施例。 [0121] FIG 6C shows a user with his or her limb movements embodiments were chosen menu item (for the user's gesture in this example). 更具体地,当用户将他或她的手指移到更靠近菜单项443时,控制器180显示与菜单443有关的子菜单444。 More specifically, when the user places his or her finger moved closer to 443 when a menu item, the controller 180 displays a menu 443 associated submenu 444. 例如,控制器180可经由感测单元140识别用户的肢体移动信息。 For example, the controller 180 may move the limbs information sensing unit 140 via the user identification. 此外,所显示的帮助信息可被显示成具有根据用户的距离控制的透明度或亮度。 In addition, the displayed help information can be displayed to have a transparency or brightness controlled according to the distance of the user. 即,随着用户的手越来越接近,所显示的项可被进一步突出显示。 That term, as more and more close to the user's hand, the display can be further highlighted. [0122] 如上所讨论的,控制器180可被配置成基于各种不同的方法确定语音识别功能的启动和停止。 [0122] As discussed above, the controller 180 may be configured to determine the start and stop the voice recognition function based on a variety of different methods. 例如,用户可选择/操纵软或硬按钮,触摸触摸屏上的任意位置等。 For example, a user can select / manipulate soft or hard buttons, touch an arbitrary position on the touch screen. 控制器180还可将语音识别功能的激活保持预定的时间量,然后在预定时间量的结束处自动终止激活。 The controller 180 can also activate the voice recognition function to maintain a predetermined amount of time, and then terminates automatically activated at the end of a predetermined amount of time. 同样,控制器180可仅在执行特定按钮或触摸操作时保持激活,然后在输入被解除时自动终止激活。 Similarly, the controller 180 may be executed only when a specific button or touch operation remains activated, and then terminates automatically activated when the input is released. 控制器180还可在不再输入语音命令达一定时间量时终止激活过程。 The controller 180 may also terminate the voice command is no longer input for a certain amount when the activation time. [0123] 接下来,图7A是示出根据本发明的一个实施例的识别移动终端中的语音命令的方法的流程图。 [0123] Next, FIG 7A is a flowchart illustrating a method of recognizing a mobile terminal according to one embodiment of the present invention of the voice command. 参考图7A,当语音识别功能被激活时,控制器180将可用作语音命令识别基准的数据库的域指定为与显示器151上显示的菜单或该菜单的子菜单有关的域(S201)。 Referring to Figure 7A, when the voice recognition function is activated, the controller 180 may be used as reference for voice command recognition domain database specified domain or sub-menus of the menu with a menu on the display 151 displays the related (S201). 用户还利用准确的菜单名称或利用自然语言(例如,英语口语)输入语音命令(S202)。 Users also use the exact name of the menu or the use of natural language (eg, English speaking) voice input command (S202). [0124] 控制器180然后将输入的语音命令存储在存储器160中(S203)。 [0124] The controller 180 then stores the input voice command in the memory 160 (S203). 此外,当在所指定的域下输入语音命令时,控制器180通过使用语音识别算法基于所指定的域分析语音命令的背景和内容。 Further, when the input voice command in the specified domain, the controller 180 by using a voice recognition algorithm based on the specified domain analysis of the background and the content of the voice command. 同样,语音命令可被转换成文本类信息以供分析(S204),然后存储在存储器160的特定数据库中。 Also, the voice command may be converted into text-based information for analysis (S204), and then stored in a specific database of the memory 160. 然而,可省略将语音命令变换成文本类信息的步骤。 However, the step of converting the voice command into text-based information may be omitted. [0125] 然后,为了分析语音命令的背景和内容,控制器180检测语音命令的特定词或关键词(S205)。 Particular words or keywords [0125] Then, to analyze the context and content of the voice command, the controller 180 detects a voice command (S205). 基于所检测的词或关键词,控制器180分析语音命令的背景和内容,并通过参照特定数据库中所存储的信息确定或判断语音命令的含义。 Based on the background and the content of the detected words or keywords, the controller 180 analyzes the voice command and determines or judges a meaning of the voice command by referring to information stored in a particular database. [0126] 此外,如以上所讨论的,用作基准的数据库包括特定域,且与基于数据库判断的语音命令的含义相对应的功能或菜单被执行(S207)。 [0126] Further, used as a reference as discussed above include a particular database fields, and the meaning of the database is determined based on a voice command corresponding to the function or menu is executed (S207). 同样,因为用于语音识别的数据库被指定为与特定菜单有关的各个信息,所以识别率和识别语音命令的速度提高,且终端上所使用的资源量减小,此外,识别率指示与特定菜单的预置名称的匹配度。 Also, because the database for voice recognition is specified to each information relating to specific menus, the recognition rate and speed of the voice command is improved, and the amount of resources used on the terminal is reduced, moreover, the recognition rate indicates specific menu match preset name. [0127] 输入语音命令的识别率还可根据与语音命令的特定功能或菜单有关的多个信息来判断。 [0127] The recognition rate of the input voice command may also be a plurality of information related to the determination according to specific functions or menus of the voice command. 因此,当信息准确匹配包括在语音命令中的特定功能或菜单(例如,菜单名)时,输入语音命令的识别率提高。 Thus, when an exact match information includes specific functions or menus of the voice command (e.g., menu name), the recognition rate of the input voice command is improved. [0128] 更详细地,图7B是示出根据本发明的一个实施例的识别移动终端的语音命令的方法的概观。 [0128] In more detail, FIG 7B is an overview illustrating a voice recognition method of a mobile terminal according to an embodiment of the present invention the command. 如图7B所示,用户输入由六个单词组成的作为自然语言的语音命令“I wantto see my pictures (我想看我的图片)”。 7B, the user inputs a voice command six-word as the natural language of "I wantto see my pictures (I want to see my picture)." 在这个例子中,识别率可基于与特定菜单(例如,相册)有关的多个有意义单词(例如,see、picture)来判断。 In this example, the recognition rate can be judged based on the specific menu (e.g., photo album) related to a plurality of meaningful words (e.g., see, picture). 此外,控制器180可基于存储在数据库中的信息确定包括在语音命令中的单词是否是与特定功能或菜单有关的有意义的单词。 Further, the controller 180 may determine based on the information stored in the database is included in the voice command are meaningful words in the word associated with a particular function or menu. 例如,包括在自然语音语音命令中、与特定菜单无关的无意义的单词可以是主语(I),介词(to)和所有格代名词(my)。 For example, included in the natural speech voice commands, independent of the specific menu meaningless word may be subject (I), prepositions (to) and possessive synonymous with (my). [0129] 同样,自然语言是由人们通用的语言,且具有与人工语言相反的概念。 [0129] Also, the natural language is a language common people, and has a concept opposite to an artificial language. 此外,自然语言可利用自然语言处理算法来处理。 In addition, natural language can be treated using natural language processing algorithms. 自然语言可以包括或可以不包括与特定菜单有关的精确名称,这有时会导致在完全精确地识别语音命令时的困难。 The natural language may or may not include exact name associated with a particular menu, which can sometimes lead to difficulty in completely precisely recognize the voice commands. 因此,根据本发明的实施例,当语音命令具有比某一级别(例如,80%)高的识别率时,控制器180判断该识别是精确的。 Thus, according to the embodiment of the present invention, when a voice command than a certain level (e.g., 80%) is high recognition rate, the controller 180 determines that the recognition is accurate.

[0130] 此外,当控制器180判断多个菜单具有类似的含义时,控制器180显示该多个菜单,且用户可选择所显示的菜单之一以使其功能被执行。 [0130] Further, when the controller 180 judges a plurality of menus to have similar meanings, the controller 180 displays the plurality of menus and the user can select one of the displayed menu function is executed so. 此外,可首先显示具有相对较高的识别率的菜单或与其它菜单相比有区别地显示。 Further, the first display menu having a relatively higher recognition rate or distinctively displayed compared to the other menus.

[0131] 例如,图8是示出根据本发明的一个实施例的用于显示移动终端的语音识别率的菜单的方法的概观。 [0131] For example, FIG. 8 is a diagram illustrating an overview of a method embodiment of the present invention, a voice recognition rate of a menu of a mobile terminal display embodiment. 如图8所示,具有较高识别率的菜单图标被显示在显示屏510的中心部分,或者如显示屏520中所示地以较大的尺寸或较暗的颜色显示。 8, a menu icon having a higher recognition rate is displayed at the center part of the display 510, or displayed in a larger size or a darker color as shown in the display 520. 还可首先显示具有较高识别率的菜单图标,然后依次或按照顺序是较低识别率菜单。 It may also be displayed first icon having a higher recognition rate of the menu, and in order or successively lower recognition rate menus.

[0132] 此外,控制器180可通过改变菜单的大小、位置、颜色、亮度中的至少一个或通过以较高识别率的顺序突出显示来有区别地显示多个菜单。 [0132] Further, the controller 180 can change the menu size, position, color, brightness, or by at least one projection in order of higher recognition rate to show a plurality of menus displayed distinctively. 菜单的透明度也可被适当地改变或控制。 The transparency of the menus may also be appropriately changed or controlled.

[0133] 此外,如图8的下部所示,具有较高用户选择率的菜单可被更新或设置成具有识别率。 [0133] Further, the lower portion as shown in FIG. 8, the user has selected a higher rate menu can be updated or set to have a recognition rate. 即,控制器180存储用户选择的历史(S301)并执行学习过程(S302),从而更新被用户选择的次数比其它菜单选项多的菜单选项的具体识别率(S303)。 That is, the controller 180 stores the user's selection history (S301) and performs a learning process (S302), thereby updating the specific recognition rate (S303) the number of times the user selects an option other than the plurality of menu options menu. 因此,频繁使用菜单被用户选择的次数可被应用到菜单的识别率。 Thus, the number of frequently used menu is selected the user may be applied to recognition rate of the menu. 因此,根据用户选择具体菜单的次数,以发音或内容相同或类似的方式输入的语音命令可具有不同的识别率。 Thus, according to the number of times the user selects a specific menu, to the same or similar pronunciation or content of the input voice command manner may have a different recognition rate.

[0134] 此外,控制器180还可存储用户执行具体功能的时间。 [0134] Further, the controller 180 may also store the time the user performs a particular function. 例如,用户可在周一至周五醒来时检查电子邮件或错过的消息。 For example, users can check e-mail messages or missed wake up on Monday through Friday. 该时间信息也可用于提高识别率。 This time information may also be used to improve the recognition rate. 终端的状态(例如,待机模式等)也可用于提高识别率。 State (e.g., standby mode, etc.) of the terminal may also be used to improve the recognition rate. 例如,当第一次打开它们的移动终端时,当该终端从关闭位置打开时等等,用户可检查电子邮件或错过的消息。 For example, when first opened their mobile terminal, when the terminal is opened from a closed position, etc., the user may check emails or missed messages.

[0135] 接着,图9是示出根据本发明的另一个实施例的识别移动终端的语音命令的方法的概观。 [0135] Next, FIG. 9 is a diagram illustrating an overview of a speech recognition method according to the present invention, a mobile terminal according to another embodiment of the command. 如图9所示,用户激活语音识别功能,并输入语音命令“I want to see mypictures (我想看我的图片)”。 As shown in Figure 9, the user activates the voice recognition, voice command and enter "I want to see mypictures (I want to see my picture)." 控制器180然后将用于语音命令识别的数据库的域指定为与所显示的子菜单有关的域。 The controller 180 would then be used for voice command recognition domain database designated as domain displayed submenu related. 在该例子中,控制器180然后解释语音命令(S401),显示具有大于具体值(80% )的概率的多个菜单(S402)。 In this example, the controller 180 then interprets the voice command (S401), displays a plurality of menus (S402) having a probability greater than a particular value (80%) of. 如图9中的显示屏610所示,控制器显示四个多媒体菜单。 , The controller displays four multimedia menu screen 610 in FIG. 9.

[0136] 控制器180还有区别地显示具有最高概率的菜单(例如,在该例子中的“相册”菜单选项621)。 [0136] The controller 180 also distinctively displays a menu (e.g., in this example the "Album" menu option 621) with the highest probability. 用户然后可选择所显示菜单中的任一个以执行对应于所选菜单的功能。 User may then select any of the displayed menus to execute a function corresponding to the selected menu. 在图9所示的例子中,用户选择相册菜单选项621,且控制器180显示所选相册中的图片,如显示屏620所示。 In the example shown in FIG. 9, the user selects the photo album menu option 621 and the controller 180 displays pictures in the selected album, the display 620 as shown.

[0137] 同样,如图9下部中的步骤S402所示,当只有单个菜单被确定为高于预定概率时,控制器180还可立即执行功能。 [0137] Similarly, the lower part of step S402 in FIG. 9, when only a single menu is determined to be higher than the predetermined probability, the controller 180 can also immediately execute a function. 即,当相册菜单选择621被确定为是具有高于预定阈值的识别率或概率的唯一菜单时,用户不必选择菜单相册菜单选项621控制器180就立即显示相册中的图片,如显示屏620所示。 That is, when the album selection menu 621 is determined to be the only menu having the recognition rate or probability than a predetermined threshold value, the user does not select a menu Album menu option 621, the controller 180 immediately displays the images in the album, as a display screen 620 shows. 此外,即使菜单具有诸如“相册”之类的明确名称,存储器160也可存储与该菜单有关的多个信息,诸如“照片、图片、相册”。 In addition, even if the menu with a clear name such as "Album" and the like, the memory 160 can also store multiple information related to the menu, such as "photos, pictures, photo albums."

[0138] 此外,如以上参考图6B所讨论的,当特定的菜单根据操作状态或模式(例如,用于指示语音识别功能的模式)通过语音命令或触摸输入被选择或执行时,控制器180还可将帮助信息输出给用户。 [0138] Further, as discussed above with reference to FIG. 6B, when a specific menu is selected or executed according to an operation state or mode (e.g., mode for indicating a voice recognition function) through a voice command or touch input, the controller 180 the information can also help output to the user. 此外,用户可利用设置在环境设置菜单中的适当菜单选项来设置操作模式,用于输出帮助。 Further, the user can use the appropriate menu options provided in environment setting menu to set the operation mode, for outputting help. 因此,用户可在不需要或不具有高级技能的情况下操作本发明的终端。 Accordingly, the user terminal of the present invention can operate without the need for or without having advanced skills. 即,很多老人可能没有体验过操作终端中设置的多个不同的菜单。 That is, many elderly people may not have experienced a number of different menu operation terminal set. 然而,利用本发明的终端,一般不熟悉终端设置的错综复杂的用户界面的用户可容易地操作该移动终端。 However, with the terminal of the present invention, generally not familiar with the intricacies of the user interface of the terminal may be set by a user to easily operate the mobile terminal. [0139] 此外,当控制器180将语音命令识别为具有多个含义时(S卩,当自然语言语音命令不包括明确的菜单名时,诸如当菜单包括在“多媒体”范畴内但不具有“相机”、“相册”和“视频”之一的明确名称时),控制器180显示具有高于某一值(例如,80%)的识别率的多个菜单。 [0139] Further, when the controller 180 recognizes the voice command having a plurality of meanings (S Jie, when a natural language voice command does not include explicit when the menu name such as when a menu is included in the "Display" category but does not have " camera "," album name is explicitly "and" one video "), the controller 180 displays having higher than a certain value (e.g., a plurality of menu 80%) of the recognition rate. [0140] 接下来,图10是根据本发明的一个实施例由控制器180用于识别移动终端的语音命令的多个数据库的概观。 [0140] Next, FIG 10 is an embodiment of the present invention consists of a plurality of the controller 180 for an overview of a speech recognition database of the mobile terminal commands. 在该实施例中,数据库存储控制器180用于判断语音命令的含义的信息,且根据信息特征可以是任何数量的数据库。 In this embodiment, the controller 180 stores the database information for determining the meaning of the voice command, and wherein the information may be any number of databases. 此外,根据信息特征配置的相应数据库可在控制器180的控制下通过连续的学习过程来更新。 Further, it may be updated through a continuous learning process according to the respective aspects of the configuration database information under the control of the controller 180. [0141] 例如,学习过程试图将用户的语音与相应的词相匹配。 [0141] For example, the process of trying to learn the user's voice with the corresponding word matches. 例如,当由用户说出来的韩语“ Saeng-1 I ”(指“生日”)被误解为“ Saeng-hwal ”(指“生活”)时,用户将该词“ Saeng-hwal ”修改为“ Saeng-1 I ”。 For example, when a user say when the Korean "Saeng-1 I" (referred to as "Birthday") be misinterpreted as "Saeng-hwal" (means "life"), the user word "Saeng-hwal" changed to "Saeng -1 I ". 因此,后来由用户输入的相同发音将被识别为“Saeng-1I”。 Accordingly, the same pronunciation later input by the user will be identified as "Saeng-1I". [0142] 如图10所示,根据信息特征的相应数据库包括第一数据库161、第二数据库162、第三数据库163和第四数据库164。 [0142], according to the respective characteristic information database 161 comprises a first database, the second database 162, a third database 163, and a fourth database 164 in FIG. 10. 在该实施例中,第一数据库161以音位、音节或词素为单位存储用于识别通过话筒输入的语音的语音信息。 In this embodiment, the first database 161 to phonemes, syllables, or morphemes storage unit for recognizing speech through the microphone input voice information. 第二数据库162存储基于所识别的语音信息判断语音命令的整体含义的信息(例如,语法、发音精确度、句子结构等)。 The second database 162 stores information based on the overall meaning of the recognized voice command is determined voice information (e.g., grammar, pronunciation precision, sentence structure, etc.). 第三数据库163存储与移动终端的功能或服务的菜单有关的信息,而第四数据库164存储从移动终端输出的消息或语音信息,以便于接收关于语音命令所判断含义的用户确认。 The third database 163 stores information related to functions or services of the mobile terminal menu, message, or the fourth database 164 stores voice information outputted from the mobile terminal, so as to confirm the user regarding the received voice command meaning determination. [0143] 此外,可根据为语音命令识别预置的域,将第三数据库163指定为与特定范畴的菜单有关的信息。 [0143] Further, according to a domain preset for voice command recognition, the third database 163 as specified information related to a particular menu category. 同样,相应的数据库还可存储声音(发音)信息、以及与发音信息相对应的音位、音节、词素、单词、关键词或句子。 Also, the respective database may store sound (pronunciation) information, and information corresponding to the pronunciation of phonemes, syllables, morphemes, words, keywords, or sentences. 因此,控制器180可通过使用多个数据库161至164中的至少一个来确定或判断语音命令的含义,并执行与对应于语音命令所判断的含义的功能或服务有关的菜单。 Accordingly, the controller 180 may be determined by using at least one of the plurality of databases 161 to 164 or a voice command meaning determination, and performs the relevant meaning corresponding to the judged voice command function or menu service. [0144] 接下来,图11是示出根据本发明的一个实施例的移动终端的语音识别功能正在被执行的状态的概观。 [0144] Next, FIG 11 is a diagram illustrating an overview of the state of the voice recognition function of the mobile terminal according to one embodiment of the present invention is being executed. 如图所示,当控制器180执行语音识别功能时,控制器180显示特定指示符或图标500,它通知用户语音识别功能正在被执行。 As shown, when the controller 180 performs the voice recognition function, the controller 180 displays a specific indicator or an icon 500 that informs the user the voice recognition function is being executed. 控制器180还可输出声音或消息,以通知用户语音识别功能正在被执行。 The controller 180 may also output a sound or message to inform the user of the voice recognition function is being executed. [0145] 此外,上述的实施例涉及识别用户的语音指令。 [0145] Further, the above embodiments relate to recognizing a user's voice instruction. 然而,本发明还适用于用户在语音指令正在被识别的同时执行附加输入功能。 However, the present invention is also applicable to the user performing an additional input function while the voice instruction is being recognized. 例如,语音识别和触摸输入、语音识别和按钮输入、或语音识别或触摸/按钮输入可同时执行。 For example, voice recognition and a touch input, a voice recognition and a button input, or a voice recognition or touch / button inputs may be performed simultaneously. [0146] 此外,控制器180可防止语音识别功能以特定模式或菜单或在特定操作状态下执行。 [0146] Further, the controller 180 may prevent the voice recognition function or perform in a specific operation state mode or in a particular menu. 另外,音频信息(例如,语音通知或指导信息)或指示语音识别功能正在被应用的视频信息(例如,图11中的指示符500)可在语音识别模式、菜单或操作状态下显示。 Further, audio information, video information (e.g., voice announcement or guidance information) or indicating a voice recognition function is being applied (e.g., the indicator 500 in FIG. 11) can be displayed in the voice recognition mode, menu or operational state. 同样,可将正在应用语音识别功能的信息通过输出帮助信息来提供给用户。 Likewise, the voice recognition function is being applied to the information provided to the user by outputting help information. [0147] 图12是示出根据本发明的一个实施例的通过语音命令处理与移动终端的特定菜单有关的子命令的方法的概观。 [0147] FIG. 12 is a diagram illustrating an overview of a method for processing a command associated with a particular sub-menu of the mobile terminal through a voice command according to one embodiment of the present invention. 在该实施例中,假设用户已经激活语音识别功能。 In this embodiment, it is assumed that the user has activated the voice recognition function.

[0148] 然后,如图12的左侧所示,用户触摸闹钟/日程表图标,且控制器180显示弹出帮助菜单,其列出可用功能(例如,I)闹钟,2)日程表,3)计划任务以及4)备忘录)。 [0148] Then, the left side of FIG. 12, the user touches the Alarm / Schedule icon, and the controller 180 displays a help pop-up menu which lists the available functions (e.g., I) Alarm, 2) Schedule, 3) Scheduled tasks and 4) memorandum). 然后,用户输入语音命令“计划任务”,且控制器180解释语音命令的含义并显示被确定为对应于语音命令的多个菜单,如显示屏611所示。 Then, the user inputs a voice command "Program Tasks", and the controller 180 to explain the meaning of the voice command and displays a plurality of menus is determined to correspond to a voice command, as shown in the display 611.

[0149] S卩,如显示屏611所示,控制器180显示与计划任务功能有关的四个事件。 [0149] S Jie, as shown in display 611, the controller 180 displays four events related to the scheduled tasks feature. 用户然后输入语音命令“选择第2”,且控制器180选择第2选项(会议I)。 The user then inputs the voice command "Select 2", and the controller 180 selects the second option (Meeting I). 用户然后输入语音命令“我想删除它”。 The user then inputs the voice command, "I want to remove it." 控制器180然后显示弹出菜单613,请求用户关于删除条目确认是或否。 The controller 180 then displays the pop-up menu 613, the user request to delete an entry confirm yes or no. 然后用户输入语音命令“是”,控制器180然后删除条目,如图12的显示屏616所示。 The user then enters the voice command "YES", the controller 180 then delete the entry, display screen 12 as shown in FIG 616.

[0150] 此外,如果没有来自用户的响应,则控制器180可通过将响应判断为肯定回答来自动执行子命令。 [0150] In addition, if there is no response from the user, the controller 180 is determined by the response to the affirmative answer automatically execute subcommand. 控制器180还输出语音命令615,通知用户该项被删除。 The controller 180 also outputs voice command 615 to inform the user is deleted. 同样,除了通过触摸菜单选择第一菜单闹钟/日程表外,用户可发出另一语音命令作为代替。 Similarly, in addition to selecting the first menu Alarm / Schedule by touching the menu, the user can issue voice commands instead of another. 同样,当用户首先选择闹钟/日程表图标来通知用户相应的任务将被执行时,控制器180可发出语音消息617。 Similarly, when a user first selects the Alarm / Schedule icon to inform the user the corresponding task will be executed, the controller 180 may issue a voice message 617.

[0151] 此外,如以上所讨论的,当特定菜单被执行时,控制器180将用作语音命令识别基准的数据库的域指定为与所执行的菜单有关的域。 [0151] Further, as discussed above, when the specific menu is executed, the controller 180 is used as a reference voice command recognition domain database designated as domain related menu executed. 即,该域包括与特定菜单的子菜单有关的信息,或与从特定菜单执行的子命令有关的信息。 That is, the domain includes information relating to sub-menus of the specific menu, or from a particular sub-menu command execution related information.

[0152] 接下来,图13是示出根据本发明的一个实施例的在移动终端中通过语音命令搜索地铁地图的方法的概观。 [0152] Next, FIG 13 is a diagram illustrating an overview of the search in a mobile terminal subway map through a voice command in a method according to one embodiment of the present invention. 在该例子中,再次假设用户已经激活语音识别功能。 In this example, again assume that the user has activated the voice recognition function. 此外,还假设控制器180基于用户的语音命令或利用其它输入单元的操纵来执行与显示地铁地图有关的特定菜单。 In addition, the controller 180 is also assumed based on a user's voice command or manipulation using other input units to execute a specific menu associated with the display subway map.

[0153] S卩,控制器180如显示屏621所示显示地铁地图。 [0153] S Jie, the controller 180 as shown in display screen 621 subway map. 如以上所讨论的,当特定菜单被执行时,控制器180可将用作语音命令识别基准的数据库的域指定为与所执行菜单有关的域(例如,地铁站的名称、各站之间的距离(时间)信息)。 As discussed above, when the specific menu is executed, the controller 180 may be used as reference for voice command recognition domain database is designated as the executed menu associated domain (e.g., names of subway station, between the station distance (time) information). 此外,该域包括与特定菜单的子菜单有关的信息,或与可从特定菜单执行的子命令有关的域。 Further, the domain includes information relating to sub-menus of the specific menu, or command may be performed from the sub-menu related to a specific domain.

[0154] 控制器180然后发出语音命令626,请求用户输入起始或终点站。 [0154] The controller 180 then issues a voice command 626, a user input requesting the starting or terminal. 用户然后在显示屏621上选择两个站。 The user then selects two stations on the display screen 621. 即,控制器180从所显示的地铁地图接收两个站622和623,用户想知道经过这两个站所需的时间量。 That is, the controller 180 receives from the displayed subway map two stations 622 and 623, the user wants to know the amount of time required after these two stations. 当由终端(即,说出起始和终点站)或通过触摸两个站622和623提示时,用户可利用语音命令选择两个站。 When the terminal (i.e., say the start and terminal) or by touching the two stations 622 and 623 prompts the user may select the two stations using a voice command. 选择两个站的其它方法也是可能的。 Additional methods of selecting the two stations are also possible. 在用户选择两个站之后,控制器180输出语音消息624,它包括经由扬声器选择的两个站(即,ISU和Seoul站被选择)。 After the user selects the two stations, the controller 180 outputs a voice message 624, which comprises two stations selected via a speaker (i.e., the ISU and Seoul station were selected). 同样,除输出语音消息外,控制器180可显示带有所请求或输入信息的弹出窗口作为代替。 Similarly, in addition to outputting the voice message, the controller 180 may display with a pop-up window or enter the requested information as a substitute.

[0155] 此外,当两个站被选择时,控制器180还可输出帮助信息。 [0155] Further, when the two stations is selected, the controller 180 may output help information. 例如,如图13中的显示屏621所示,控制器显示列出站名和地铁线路颜色的帮助弹出气球窗口。 For example, the display 621 shown in FIG. 13, the controller displays the station name and line colors listed underground pop-up balloon help window. 用户然后请求经过两个所选站所需的时间。 The user then requests the time required after the two selected stations. 用户可通过输入语音指令“我想知道从ISU到Seoul站将用多长时间”来请求该信息。 Users can input a voice command "I want to know from ISU to Seoul station will be how long" to request the information.

[0156] 控制器180然后检测与域内处理地铁地图信息有关的有意义的词(例如,多长时间、用、Isu、Seoul站),以便分析语音命令的背景和内容。 [0156] The controller 180 then detects meaningful words relating to subway map information within the processes (e.g., how long, with, Isu, Seoul Station), to analyze the context and content of the voice command. 基于所分析的信息,控制器180确定语音命令具有请求两个地铁站Isu和Seoul站之间的时间信息的含义。 Based on the analyzed information, the controller 180 determines the meaning of the voice command has a request time information between the two subway stations Isu and Seoul Station. [0157] 此外,当控制器180判断语音指令的含义时,控制器180可首先请求用户确认所判断的语音命令的含义是否准确。 [0157] Further, when the controller 180 determines the meaning of the voice instruction, the controller 180 may first request the user to confirm the judged meaning of the voice command is accurate. 控制器180然后在地铁地图上显示这两个站,连通两站之间的距离(或时间)、两站之间的站数等等,并输出语音消息627,通知用户有关如图13中的显示屏625所示的结果。 The controller 180 then displays the two stations on the subway map, the distance (or time) between the two communication stations, the number of stations between the two stations, etc. and outputs a voice message 627, notifies the user 13 of FIG. the results shown in the display 625. 此外,如上所述,如果用户在具体时间间隔内不对确认请求作出响应,则控制器180可将其解释为肯定回答并提供所请求服务的结果。 As described above, if the user does not request confirmation within a specific time interval in response, the controller 180 may be interpreted as a result of an affirmative answer and provide the requested service. [0158] 接下来,图14是示出根据本发明的一个实施例的在移动终端中通过语音命令再现多媒体文件的方法的概观。 [0158] Next, FIG 14 is a diagram illustrating an overview of a method in a mobile terminal reproducing multimedia files through a voice command according to one embodiment of the present invention. 此外,以下的描述假设用户已经输入激活控制信号,且控制器180开始激活语音识别功能。 In addition, the following description assumes the user has input the activation control signal, and the controller 180 starts activating the voice recognition function. 还假设控制器180已通过接收语音命令的输入或利用其它输入单元的用户操纵来执行与多媒体再现菜单有关的特定菜单。 It is also assumed the controller 180 has performed the specific menu related to multimedia reproduction menu by receiving a user voice command input or manipulation using other input units. [0159] S卩,如显示屏631所示,控制器180显示用户可选择播放的歌曲列表。 [0159] S Jie, as shown in 631, the display controller 180 displays a list of user-selectable song played. 因此,在本发明中,用户期望的多媒体文件可通过语音命令直接搜索,并由此再现。 Accordingly, in the present invention, a user's desired multimedia file may be directly searched through a voice command, and thereby reproduced. 更具体地,一旦执行多媒体再现菜单,控制器180就将用作语音命令识别基准的数据库的域指定为与所执行菜单有关的域。 More specifically, upon execution of the multimedia reproduction menu, the controller 180 will be used as a reference for voice command recognition domain of database is specified as the domain relating to a menu executed. [0160] 如上所述,域包括与多媒体再现菜单的子菜单有关的信息、与可从多媒体再现菜单执行的子命令有关的信息、或与多媒体文件有关的信息(例如,文件名、再现时间、版权所有者等)。 [0160] As described above, the domain includes information related to multimedia reproduction menu and submenu, with a sub-menu to perform the multimedia playback command information or information related to a multimedia file (e.g., file names, reproduction time, copyright owner, etc.). [0161] 此外,控制器180可通过接收语音命令的输入或利用其它输入单元的用户操纵来显示多媒体文件列表。 [0161] Further, the controller 180 may command received by the voice input or other user using the manipulation input unit display a list of multimedia files. 在图14的例子中,如显示屏631所示,在从文件列表中选择一个文件的状态下,用户输入其自然语言语音命令(例如,让我们播放这首歌吧)。 In the example of FIG. 14, as shown in the display screen 631, in selecting a file from the file list status, the user enters their natural language voice command (for example, let's play this song). [0162] 一旦语音命令被输入,控制器180就检测与子菜单或子命令有关的有意义的词(例如,播放、这首歌),用于在域内处理所选菜单。 [0162] Once the voice command is input, the controller 180 detects meaningful words relating to sub-menus or sub-commands (e.g., play, this song) for processing the selected menu within the domain. 此外,控制器180通过分析所检测到的词与语音命令的整体背景和内容来判断语音命令的含义。 In addition, the overall context and content controller 180 detected by analyzing the voice command words and to determine the meaning of the voice command. [0163] 一旦判断语音命令的含义,控制器180就接收用户关于所判断的语音命令的含义是否准确的确认。 [0163] If it is determined meaning of the voice command, the controller 180 receives the user whether the judged meaning of the voice command to confirm accurate. 例如,如图13所示,控制器180显示弹出窗口633,请求用户关于所选歌曲的播放说“是”或“否”。 For example, as shown in FIG. 13, the controller 180 displays a pop-up window 633, the user requests playback of the selected song on to say "yes" or "no." 控制器还可输出语音消息632,询问用户歌曲2是否是要播放的歌曲。 The controller 632 can also output a voice message asking the user Song 2 song whether you want to play. 用户然后可说“是”,控制器180于是输出所示的歌曲,如显示屏634所示。 The user can then say "Yes", then the controller 180 shown in FIG song output, as shown in the display 634. [0164] 或者,控制器180可自动播放所选的歌曲,而不请求用户确认选择。 [0164] Alternatively, the controller 180 can automatically play the selected song without requesting the user to confirm the selection. 用户还可使用适当的菜单选项,来将控制器180请求关于所选任务的确认或不请求确认设置为默认。 Users can also use appropriate menu option, the controller 180 to request confirmation regarding the selected task or set as the default without requesting confirmation. 此夕卜,如果没有来自用户的响应,则控制器180可通过将响应判断为肯定回答来自动执行所判断的语首命令。 Bu this evening, if there is no response from the user, the controller 180 is determined by the response to the affirmative answer automatically execute the first command language determination. [0165] 因此,在该实施例中,选择要再现的文件,并通过语音命令输入所选文件的再现命令。 [0165] Thus, in this embodiment, select the file to be reproduced, the reproduction command and the selected file is input through a voice command. 然而,当用户已知文件名时,可通过语音命令将文件名从上层菜单中直接输入。 However, when a user known file name, file name can be entered directly from the top menu via voice commands. [0166] 接下来,图15是示出根据本发明的一个实施例的在移动终端中通过语音命令发送电子邮件或文本消息的方法的概观。 [0166] Next, FIG 15 is a diagram illustrating an overview of a method of transmitting e-mail or text message in a mobile terminal through a voice command according to one embodiment of the present invention. 再次假设已经输入激活控制信号,控制器180开始激活语音识别功能,且控制器180通过接收语音命令的输入或利用其它输入单元的用户操纵来执行特定菜单(例如,邮件/消息发送/接收菜单)来描述本实施例。 Again assume active control signal has been input, the controller 180 starts activating the voice recognition function, and performs a specific menu (e.g., mail / message send / reception menu) by a user manipulating the controller 180 receives a voice input or other input means by using the command The present embodiment will be described. . [0167] 更具体地,一旦执行邮件(或消息)发送/接收菜单,控制器180就将用作语音命令识别基准的数据库指定为与所执行的菜单有关的域。 [0167] More specifically, upon execution of the message (or message) send / reception menu, the controller 180 will be used as a reference for voice command recognition domain database designated as a menu related to performed. 该域包括与邮件/消息发送/接收菜单的子菜单有关的信息、与可从邮件/消息发送/接收菜单执行的子命令有关的信息、与发送/接收邮件/消息有关的信息(例如,发送器、接收器、发送/接收时间、标题等)。 The domain includes information relating to sub-menus of the mail / message send / reception menu, with a child from the mail / message send / reception menu execution command information related to the transmit / receive information about the mail / messages (e.g., transmitting , a receiver, a transmission / receiving time, title, etc.).

[0168] 控制器180还通过接收语音命令的输入或利用其它输入单元的用户操纵来显示邮件/消息发送/接收列表。 [0168] The controller 180 also receives input through a voice command or other user using the manipulation input unit to display the mail / message send / reception list. 如显示屏641中所示,用户输入语音指令“我想要回复”。 As shown in display screen 641, the user inputs a voice command "I want to reply." 控制器180然后显示所接收的用户可回复的消息,如显示屏645所示。 The controller 180 then displays the received messages the user can reply to as shown in the display 645. 在该例子中,如显示屏645所示,在从邮件/消息列表中选择一个邮件/消息的状态下,用户使用其自然语言(例如,回复该消息)。 In this example, a state as shown in display screen 645, select a mail / message from the mail / message list, the user uses his natural language (e.g., Reply to this message).

[0169] 另外,一旦语音命令被输入,控制器180就检测与对域内所选邮件/消息的回复处理有关的有意义的词(例如,回复、该消息)。 [0169] Further, once the voice command is input, the controller 180 detects the selected messages within and / message reply meaningful words relating to process (e.g., reply, this message). 然后,控制器180通过分析所检测的词和语音命令的整体背景和上下文来判断语音命令的含义(执行邮件/消息回复菜单)。 Then, the overall background and context controller 180 detected by analyzing the voice command words and to determine the meaning of the voice command (to perform a mail / message reply menu).

[0170] 一旦判断语音命令的含义,控制器180就可接收用户关于所判断的语音命令的含义是否准确的确认。 [0170] Upon determination of the meaning of the voice command, the controller 180 can receive the user's confirmation regarding the accuracy of the judged meaning of the voice command. 例如,为了用户的确认,可输出语音消息642,或者可输出文本类消息643。 For example, for confirmation by the user, may output a voice message 642, or 643 may output a text-based message. 当输出针对用户确认的消息时,用户可通过语音或其它输入单元回复。 When output messages for the user's confirmation, the user can reply through a voice or other input units. 如果没有来自用户的响应,则控制器180可通过将响应判断为肯定回答来自动执行与所判断的含义对应的功能。 If there is no response from the user, the controller 180 is determined by the response to the affirmative answer automatically execute the judged meaning of the corresponding functions. 然后,当执行邮件/消息回复菜单时,控制器180在邮件/消息写入窗口644中自动输入所选呼叫方的地址/电话号码。 Then, when performing the mail / message reply menu, the controller 180 is written in the mail / message input window 644 is automatically selected caller's address / phone number.

[0171] 因此,在该实施例中,首先选择要回复的邮件/消息,并利用语音命令输入所选邮件/消息的回复命令。 [0171] Thus, in this embodiment, first select the reply message / message, and the selected message with a voice command input return instructions / messages. 然而,当用户知道关于呼叫方的信息时,对呼叫方的邮件/消息回复可通过语音命令直接输入。 However, when a user knows information about the calling party, the calling party of the mail / message reply may be directly input through a voice command.

[0172] 此外,图15所示的实施例可被修改以对应于发送文本消息。 [0172] Further, the embodiment shown in FIG. 15 may be modified to correspond to sending text messages. 更具体地,控制器180包括将用户的语音转换成文本的软件,使得用户可告诉终端他或她想说什么,且控制器180将输入语音转换成文本消息。 More specifically, the controller 180 comprises a user's voice into text software, so that the user can tell the terminal what he or she has to say, the controller 180 and the input voice into a text message. 控制器180还可向用户显示经转换的文本,因此用户可确认该转换是可接受的。 The controller 180 may also display the converted text to the user, so the user can confirm the conversion is acceptable. 然后用户可请求终端将文本消息发送给期望用户。 The user can then request the terminal send the text message to a desired user.

[0173] 经修改的实施例是特别有利的,因为用手输入文本消息是非常费力且乏味的过程。 [0173] The modified embodiment is particularly advantageous because entering a text message by hand is a very laborious and tedious process. 由于很多不同的原因,很多用户想要发送文本消息而不是呼叫用户,但不想要经历手动选择多个键来发送单个文本消息的费力过程。 Since many different reasons, many users want to send a text message rather than calling user, but do not want to undergo a plurality of manual selection keys to send a single text message laborious process. 本发明的经修改的实施例使用户能利用其语音输入期望的文本信息,然后将该文本消息发送到期望方。 A modified embodiment of the present invention enables a user to use speech input text information that is desired, and then transmits the text message to a desired party.

[0174] 图16是示出根据本发明的一个实施例的在移动终端中通过语音命令进行电话呼叫的方法的概观。 [0174] FIG. 16 is a diagram illustrating an overview of a method of a telephone call through a voice command in a mobile terminal according to one embodiment of the present invention. 类似于以上的实施例,该实施例也假设用户已经输入激活控制信号,控制器180已经激活语音识别功能,且控制器180已经通过接收语音命令的输入或利用其它输入单元的用户操作来执行与电话呼叫有关的特定菜单(例如,关于最近接收呼叫的电话号码簿或菜单列表)。 Similar to the above embodiment, this embodiment also assumes the user has input the activation control signal, the controller 180 has activated the voice recognition function, and the controller 180 has input or by using other input means receives a user operation is performed with a voice command telephone calls related to a particular menu (for example, telephone directory, or menu list of recently received calls).

[0175] —旦关于电话呼叫的菜单被执行,控制器180将用作语音命令识别的基准的数据库的域指定为与电话呼叫有关的域。 [0175] - Once on the phone call menu is executed, the controller 180 serving as a reference for voice command recognition domain of database is specified as a domain associated with the telephone call. 此外,该域包括与发起呼叫、呼入、错过呼叫等有关的信息,以及每一个电话相关信息(例如,发起时间、呼入时间、发送器、接收器、呼叫持续时间、呼叫频率等)。 In addition, the domain comprises a call, information about the incoming, missed calls, etc. and each phone-related information (e.g., originating time, incoming time, transmitter, receiver, a call duration, calling frequency, etc.).

[0176] 此外,控制器180通过接收语音命令的输入或利用其它输入单元的用户操纵来显示电话呼叫列表。 [0176] Further, the controller 180 displays a phone call list by receiving voice input or other user using the manipulation command input unit. 即,用户使用他或她的自然语言输入语音命令(例如,我想要看所接收的电话呼叫),如显示屏711所示。 That is, the user uses his or her natural language input voice commands (for example, I want to see received a telephone call), the display screen 711 as shown. [0177] 一旦输入语音命令,控制器180就检测与域内的电话呼叫有关的有意义的词(例如,看、接收的、电话、呼叫),并通过分析所检测的词和语音命令的整体背景和内容来判断语音命令具有“输出所接收的电话呼叫”的含义。 [0177] Once the voice command is input, the controller 180 detects meaningful words relating to a call with the telephone domain (e.g., see, received, phone, calls), and by analyzing the detected words and the overall context of the voice command and determining the content of the voice command to have a meaning, "output received phone calls" in. 一旦语音命令的含义被判断,控制器180就输出针对所接收的电话呼叫的列表,如显示屏712所示。 Once the meaning of the voice command is judged, the controller 180 outputs a list for received phone calls as shown in the display 712.

[0178] 另外,用户然后在从输出列表中选择一项的状态下输入语音命令“呼叫该人”。 [0178] Further, the user can then select the input voice command in an output from the status list "to call the person." 结果,控制器180判断语音命令具有“呼叫所选择的已接收呼叫的对方”的含义。 As a result, the controller 180 judges the voice command has a meaning, "call to the selected call partner has been received," the. 然后,控制器180接收用户关于所判断的语音命令的含义是否准确的确认。 Then, the controller 180 receives the user determines the meaning of the voice command is accurate confirmation. S卩,控制器180可输出语音消息713或文本类消息715。 S Jie, the controller 180 may output a voice message or a text-based message 713 715.

[0179] 用户还可通过语音或其它输入单元回复。 [0179] The user can also reply through a voice or other input units. 如上所述,如果没有来自用户的响应,则控制器180可通过将响应判断为肯定回答来自动执行与所判断的含义对应的功能。 As described above, if there is no response from the user, the controller 180 determines that the response by the affirmative answer to automate the meaning corresponding to the judged function. 控制器180还输出指示呼叫连接正在进行的消息714。 The controller 180 also outputs a message indicating ongoing call connection 714.

[0180] 因此,在该实施例中,从电话呼叫列表中选出呼叫方,并通过语音命令输入对所选呼叫方的呼叫命令。 [0180] Thus, in this embodiment, a telephone call from a calling party is selected in the list, and the incoming call command to the selected calling party by voice command. 然而,当用户已经知道关于呼叫方的信息时,可通过语音命令直接执行对该人的呼叫。 However, when the user already knows the information about the caller, the call can be executed directly by the people's voice commands.

[0181] 接下来,图17是示出根据本发明的一个实施例的在移动终端中通过语音命令使用电话簿信息的方法的概观。 [0181] Next, FIG 17 is a diagram illustrating an overview of a method of using the phone book information in the mobile terminal through a voice command to an embodiment of the present invention. 在这里的描述中作出与以上其它实施例中描述相同的假设。 In the above description made with the same assumed herein described in other embodiments. 即,假设一旦输入激活控制信息,控制器180就开始激活语音识别功能,且控制器180通过接收语音命令输入或利用其它输入单元的用户操纵来选择或执行特定菜单(例如,电话簿菜单),如显示屏720所示。 That is, it is assumed upon activation control input information, the controller 180 starts activating the voice recognition function, and the controller 180 receives a voice command input by a user or with other manipulation of the input unit a specific menu is selected or executed (e.g., phonebook menu), The display screen 720 shown in FIG.

[0182] 一旦执行电话簿菜单,控制器180就将用作语音命令识别基准的数据库的域指定成与可从电话簿菜单执行的电话簿菜单的子菜单或子命令有关的域。 [0182] Upon executing a phonebook menu, the controller 180 will be used as reference for voice command recognition domain database designated as domain submenus or phonebook menu commands may be executed from the phone book menu related. 此外,域被指定以便提高识别率,但并非必须指定。 Additionally, the domain is specified so as to improve the recognition rate, but not necessarily specified.

[0183] 此外,在待机状态或与电话簿有关的菜单被选择的状态下,用户以其自然语言输入语音命令(例如,编辑James,添加James,查找James,呼叫James,我想发消息给James)。 [0183] In addition, in the state of standby or phonebook-related menu is selected, the user inputs its natural language voice command (for example, editor James, James added, to find James, call James, I want a message to James ). 一旦输入语音命令,控制器180就检测域内与电话呼叫有关的有意义的词,并通过分析检测的词和语音命令的整体背景和内容来判断语音命令的各自含义。 Once the voice command is input, the controller 180 detects the art and meaningful words relating to a telephone call, the background and the overall content and commands by analyzing the detected words and to determine the respective meanings speech voice command.

[0184] 一旦判断语音命令的各自含义,控制器180就执行与相应语音命令对应的功能或菜单,如显示屏722至724所示。 [0184] Once each meaning of the voice command is judged, the controller 180 executes functions or menus corresponding to the respective voice commands as shown in display screen 722 to 724. 此外,在执行之前,控制器180可接收用户的关于所判断的语音命令含义是否准确的确认。 Further, before performing, the controller 180 may receive a user's voice command meaning determination regarding the confirmation of the accuracy. 如上所述,为了用户的确认,可输出语音消息或文本类消肩、O As described above, in order to confirm the user can output a voice message or a text-based elimination shoulder, O

[0185] 此外,当输出针对用户确认的消息时,用户可通过语音或其它输入单元回复。 [0185] Further, when the output message for the user's confirmation, the user can reply through a voice or other input units. 如果没有来自用户的响应,则控制器180可通过将响应判断为肯定回答来自动执行与所判断含义对应的功能。 If there is no response from the user, the controller 180 is determined by the response to the affirmative answer automatically executes the function corresponding to the determined meaning.

[0186] 接下来,图18是示出根据本发明的一个实施例的在移动终端中通过语音命令改变背景屏幕的方法的概观。 [0186] Next, FIG 18 is a diagram illustrating overview of a method for changing a background screen through a voice command in a mobile terminal according to one embodiment of the present invention. 该描述再次假设:一旦输入激活控制信息控制器180就开始激活语音识别功能,并通过接收语音命令的输入或利用其它输入单元的用户操纵执行特定菜单(例如,相册菜单)。 Assuming again that the description: upon activation control information input controller 180 starts activating the voice recognition function, and by receiving voice input commands or other user using the manipulation input unit performs a specific menu (e.g., photo album menu).

[0187] 相册菜单可通过语音命令的输入或利用其它输入单元的多步骤子菜单来执行。 [0187] album menu may be input through a voice command or using other input units to perform multi-step submenus. 同样,相册菜单可由自然语言语言命令直接执行(例如,我想看我的相册),如显示屏731所示。 Similarly, the album menu can be executed directly natural language command language (for example, I want to see my album), as shown in the display 731. 根据语音命令的判断含义,控制器180通过执行相册菜单输出照片列表,如显示屏732所示。 The meaning of the voice command is judged, the controller 180 by executing a photo album menu list output, the display 732 as shown. 然后,控制器180接收从输出的相册列表中选出的一张照片。 Then, the controller 180 receives the output selected from the list of albums in the photo. [0188] 在此状态下,如果输入用户语音命令(例如,用该图片改变我的壁纸),则控制器180检测与所执行菜单的子菜单或子命令有关的有意义信息(例如,改变、壁纸)。 [0188] In this state, if a user inputs a voice command (e.g., by changing the I picture wallpaper), the controller 180 detects the executed sub-command menu or submenu meaningful information (e.g., change, wallpaper). 然后,控制器180通过分析检测到的词和语音命令的整体背景和内容来判断语音命令的含义。 Then, the controller 180 determines the meaning of the voice command by analyzing the detected overall context and content words and voice commands. SP,控制器180判断语音命令具有“将背景屏幕变成所选照片”的含义。 SP, the controller 180 judges the voice command has a "background screen into a selected photo" means. [0189] 一旦判断语音命令的含义,控制器180就显示与所选照片对应的背景屏幕,并接收用户关于所判断的语音命令的含义是否准确的确认。 [0189] Upon determination of the meaning of the voice command, the controller 180 displays the background screen corresponding to the selected photo, and receives the user whether the judged meaning of the voice command to confirm accurate. 在这里,为了用户确认,可输出语音消息733,或者可输出文本类消息734。 Here, the user confirms the order, may output a voice message 733, or 734 may output a text-based message. 所判断的语音命令还可根据高识别率或预定的环境设置菜单在没有用户确认的情况下直接执行。 Judged voice command may also be directly executed without the user's confirmation according to a high recognition rate or a case where a predetermined environment setting menu. [0190] 当输出用于用户确认的消息时,用户可通过语音或其它输入单元回复。 [0190] When the user outputs a confirmation message, the user can reply through a voice or other input units. 如果没有来自用户的响应,则控制器180可通过将响应判断为肯定回答来自动执行与所判断的语音命令对应的功能。 If there is no response from the user, the controller 180 may be determined by in response to an affirmative answer to automate the determination of the function corresponding to the voice command. [0191] 为了改变背景屏幕,可不必首先执行相册菜单,如本发明的实施例所示。 [0191] In order to change a background screen, may be performed without first album menu as shown in the embodiment, as in the present invention. 相反,在执行背景屏幕菜单之后,可搜索用户期望的照片以用于改变。 On the contrary, after the execution of the background screen menu, the user can search desired pictures for change. [0192] 图19是示出根据本发明的一个实施例的在移动终端中通过语音命令再现多媒体文件的方法的概观。 [0192] FIG. 19 is a diagram illustrating an overview of a method in a mobile terminal reproducing multimedia files through a voice command according to one embodiment of the present invention. 类似于以上的实施例,该描述假设:一旦输入激活控制信号,控制器180就开始激活语音识别功能,并通过接收语音命令的输入或利用其它输入单元的用户操纵来执行特定菜单(例如,多媒体再现菜单)。 Similar to the above embodiments, the description assumes that: upon activation of a control signal input, the controller 180 starts activating the voice recognition function, and inputs received by the user using voice commands or other input manipulation unit performs a specific menu (e.g., multimedia reproduction menu). [0193] 为了通过用户再现多媒体文件,执行特定菜单,特定菜单的子菜单之一被选择以显示文件列表,并从文件列表中选出一个文件由此再现。 [0193] To reproduce a multimedia file by a user, performs a specific menu, one of the sub menus of the specific menu is selected to display a file list, and selects a file from the file list thus reproduced. 然而,在本发明中,可通过语音命令直接搜索用户期望的多媒体文件由此再现。 However, in the present invention, the user can search for a desired commands directly through the multimedia file to thereby reproduce a voice. [0194] 例如,如果在语音识别功能被激活后输入特定的语音命令(例如,移至Beatles相册),则控制器180通过分析语音命令的整体背景和内容来判断语音命令的含义,如显示屏741所示。 [0194] For example, if a specific voice command input after the voice recognition function is activated (e.g., move Beatles album), the controller 180 judges the voice command by analyzing the entire context and content of the meaning of the voice command, such as a display screen As shown in 741. 基于所分析的信息,控制器180执行特定功能或菜单,或通过移至特定文件夹显示文件列表,如显示屏742所示。 Based on the analyzed information, the controller 180 performs a particular function or menu, or by moving to a specific file folder list display screen 742 as shown in FIG. [0195] 当从文件列表选出一个文件后输入语音命令(例如,播放这首歌或播放第3)时,控制器180通过分析语音命令的整体背景和内容判断语音命令的含义。 When [0195] When a file is selected from a list of file input voice command (e.g., Play this song or Play 3), controller 180 determines the meaning of the entire context and content of the voice analysis of the voice command of the command. 另外,与语音命令的含义对应的功能或菜单可根据高识别率或预定的环境设置菜单直接执行。 In addition, functions or menus corresponding to a meaning of the voice command may be directly executed according to a high recognition rate or a predefined environment setting menu. [0196] 一旦判断语音命令的含义,控制器180就接收用户关于所判断的语音命令的含义是否准确的确认。 [0196] If it is determined meaning of the voice command, the controller 180 receives the user whether the judged meaning of the voice command to confirm accurate. 在这里,为了用户的确认,可输出文本类消息或语音消息743。 Here, for the user's confirmation, a text-based message may output a voice message or 743. 当输出针对用户确认的消息时,用户可通过语音或其它输入单元回复。 When output messages for the user's confirmation, the user can reply through a voice or other input units. 如果没有来自用户的响应,则控制器180可通过将响应判断为肯定回答来自动执行所判断的语音命令的功能。 If there is no response from the user, the controller 180 is determined by the response to the affirmative answer automatic execution function is the judged voice command. 控制器18然后执行并播放所选的歌曲,如显示屏744所示。 The controller 18 then executes and displays the selected song, the display 744 as shown. [0197] 因此,在该实施例中,选择要再现的文件,通过语音命令输入对所选文件的再现命令。 [0197] Thus, in this embodiment, the file to be reproduced is selected, the selected file reproduction command input by voice command. 然而,当用户知道文件名时,可通过语音从上级菜单直接输入文件名以用于再现。 However, when the user knows the file name, the file name can be input by voice for reproduction from the upper menu directly. [0198] 因此,根据本发明的各个实施例,在语音识别功能被激活的状态下,将输入语音命令转换成特定形式,并将其背景和内容与指定为用作基准的域的数据库进行比较。 [0198] Thus, in accordance with various embodiments of the present invention, the voice recognition function is activated, the input voice command into a specific form, and the specified context and content of the database used as a reference field is compared . 另外,将与语音命令所判断的含义相对应的结果值输出到移动终端的特定组件。 Further, the voice command corresponding to the determined meaning of the result value is output to a specific component of the mobile terminal. [0199] 本发明的移动终端可通过基于背景和内容判断输入语音命令的含义来控制与其特定功能或服务有关的菜单。 [0199] The mobile terminal according to the present invention can be controlled to their specific functions or services related to the determined meaning of the input voice menu commands and context-based content. 另外,本发明的移动终端可通过根据其操作状态或操作模式将用于语音识别的域指定为与特定菜单或服务有关的域来提高语音识别率。 Further, the mobile terminal of the present invention may be associated with a particular service domain menu or a voice recognition rate by improving its operating state according to an operation mode or the specified domain for voice recognition.

[0200] 同样,本发明的移动终端可通过应用其一个或多个用户界面(Π),甚至在语音识别功能被激活时,同时选择或执行与特定功能或服务有关的菜单,以便于检测用户的操纵。 [0200] Likewise, a mobile terminal of the present invention can be applied one or more user interfaces ([pi), even when the voice recognition function is activated, selected or executed simultaneously with a particular function or related service menu, in order to detect the user manipulation. 另外,本发明的移动终端可根据其操作状态或操作模式通过提供关于语音命令的输入的帮助信息经由语音命令控制与特定功能或服务有关的菜单,而不管用户的技巧如何。 Further, the mobile terminal of the present invention by providing help information about the input voice command in accordance with its operating state or mode of operation via voice command control menus relating to a particular function or service, regardless of user's skill.

[0201] 另外,多个域可包括以下域中的至少两个域:对应于移动终端上发送和接收的电子邮件的电子邮件域、对应于分配在移动终端上的日程安排事件的日程安排任务域、对应于移动终端上的联系人的联系人域、对应于存储在移动终端上的电话号码的电话簿域、对应于由移动终端提供的地图信息的地图域、对应于存储在移动终端上的照片的照片域、对应于移动终端上发送和接收的消息的消息域、对应于移动终端上执行的多媒体功能的多媒体域、对应于移动终端可连接至的外部设备的外部设备域、对应于移动终端上发送和接收的呼叫的呼叫历史域、以及对应于移动终端上执行的设置功能的设置域。 [0201] Further, a plurality of domains may include domains at least two domains: corresponding to a mail transmitting and receiving e-mail domain of the mobile terminal, schedule task schedule event corresponding to the allocation on the mobile terminal domain, the domain corresponding to contacts on the mobile terminal contacts, phonebook domain corresponding to the mobile terminal phone number stored corresponding to the map information provided by the mobile terminal domain of the map corresponding to the mobile terminal stores in message field pictures photo domain corresponding to messages sent and received on the mobile terminal, corresponding to the multimedia domain multimedia functions performed on the mobile terminal, corresponding to the external device domain of the mobile terminal may be connected to an external device, corresponding to call history domain call transmission and reception on the mobile terminal, and a domain corresponding to setting functions performed on the set of the mobile terminal.

[0202] 另外,可由移动终端的制造商或由移动终端的用户设置识别率的预定阈值。 [0202] Further, by the manufacturer or set by a user of the mobile terminal identification of a predetermined threshold value of the mobile terminal.

[0203] 此外,以上各个实施例可使用例如计算机软件、硬件、或其某种组合而在计算机可读介质中实现。 [0203] In addition, the above various embodiments may be implemented in a computer-readable medium using, for example, computer software, hardware, or some combination thereof. 对于硬件实现,上述实施例可在一个或多个专用集成电路(ASIC)、数字信号处理器(DSP)、数字信号处理设备(DSro)、可编程逻辑设备(PLD)、现场可编程门阵列(FPGA)、处理器、控制器、微控制器、微处理器、设计成执行本文所述功能的其它电子单元、或其选择性组合内实现。 For a hardware implementation, the embodiments described above may be one or more application specific integrated circuits (ASIC), a digital signal processor (DSP), digital signal processing devices (DSro), programmable logic devices (PLD), field programmable gate arrays ( the FPGA), processors, controllers, micro-controllers, microprocessors, other electronic units designed to perform the functions described herein, or a selective combination thereof.

[0204] 对于软件实现,本文所述的实施例可通过诸如程序和函数的独立软件模块实现,每个软件模块实现本文所述的功能和操作中的一个或多个。 [0204] For a software implementation, the embodiments described herein may be implemented by separate software modules, such as procedures and functions, each of which perform one or more of the functions and operations described herein. 软件代码可通过以任何合适编程语言编写的软件应用程序实现,并且可被存储在存储器(例如,存储器160)中,而且可由控制器或处理器(例如,控制器180)执行。 The software codes can be implemented with a software application written in any suitable programming language and may be stored in a memory (e.g. memory 160) in and executed by a controller or processor (e.g., controller 180).

[0205] 另外,移动终端100可以以各种不同配置实现。 [0205] Further, the mobile terminal 100 may be implemented in a variety of different configurations. 这些配置的示例包括翻盖式、滑盖型、直板型、旋转型、回转型及其组合。 Examples of such configurations include folder-type, slide-type, bar-type, rotational-type, rotary type, and combinations thereof.

[0206] 本领域内技术人员可以理解,可对本发明作出各种修改和变化而不脱离本发明的精神或范围。 [0206] skilled in the art may be appreciated that various modifications and variations of this invention without departing from the spirit or scope of the invention. 因此,本发明旨在涵盖本发明的所有这些修改和变形,只要它们落在所附权利要求书及其等价技术方案的范围中即可。 Accordingly, the present invention is intended to cover all such modifications and variations of this invention provided they come within the scope of the claims appended hereto and their equivalents in the art to program.

Claims (18)

  1. 1.一种移动终端,其包括: 输入单元,其被配置成接收输入以激活所述移动终端上的语音识别功能; 显示单元,其被配置为显示菜单或该菜单的子菜单; 存储器,其被配置成存储与所述移动终端的菜单和操作有关的数据库的多个域;以及控制器,其被配置成: 当所述语音识别功能被激活时,将可被用作语音命令识别基准的数据库的域指定为和所述显示单元上所显示的菜单或子菜单相关联的域; 检测经由所述输入单元所接收到的语音命令的至少一个关键词; 基于经检测到的所述至少一个关键词,分析所述语音命令的内容和背景; 通过参照存储在所述数据库中的信息来确定所述语音命令的含义;以及执行对应于所述语音命令的、和所述菜单或子菜单相关联的功能。 A mobile terminal, comprising: an input unit configured to receive an input to activate a voice recognition function on the mobile terminal; and a display unit configured to display a menu or sub-menu of the menu; a memory menu configured to store the operation of the mobile terminal and a plurality of domains related database; and a controller, configured to: when the voice recognition function is activated, can be used as a reference for voice command recognition field specifies a domain database menu or submenu associated and displayed on the display unit; detecting the received voice command via the input unit of at least one keyword; based on the detected at least one of the Key words, analyzing the voice command content and context; determining the meaning of the voice command by the information stored in the reference database; and performing corresponding to the voice command, and the related menu or submenu associated function.
  2. 2.如权利要求1所述的移动终端,其特征在于,所述菜单包括多媒体菜单或操作、联系人菜单或操作、消息收发菜单或操作、声音菜单或操作、组织器菜单或操作、屏幕菜单或操作、实用工具菜单或操作、相机菜单或操作以及设置菜单或操作中的至少一个。 , Contacts menu or operation, a messaging menu or operation, sound menu or operation, an organizer menu or operation 2. The mobile terminal according to claim 1, wherein the menu comprises a menu display or operation, a screen menu or operations, utilities menu or operation, or operating the camera menu and settings menu or operation of at least one.
  3. 3.如权利要求1所述的移动终端,其特征在于,所述控制器还被配置成确定所确定的菜单和操作准确地对应于所述语音命令的识别率。 The mobile terminal according to claim 1, wherein the controller is further configured to determine accurately the determined menu and operation corresponds to a recognition rate of the voice command.
  4. 4.如权利要求3所述的移动终端,其特征在于,所述控制器还被配置成基于所述功能先前被以正确方式选择的次数来调节所述功能的识别率。 The mobile terminal as claimed in claim 3, wherein the controller is further configured to adjust the recognition rate based on the number of the function is the function in the right manner previously selected.
  5. 5.如权利要求1所述的移动终端,其特征在于,所述输入单元包括以下单元中的至少一个:1)被触摸以激活所述语音识别功能的触摸软按钮,2)被按下或操纵以激活所述语音识别功能的硬按钮,3)包括在所述输入单元中的触摸屏的被触摸以激活所述语音识别功能的任意位置,4)被输入以激活所述语音识别功能的撞击声,5)本地区域无线电信号或远程区域无线电信号,以及6)来自用户的肢体信息信号。 Means comprising at least one unit 5. The mobile terminal according to claim 1, wherein said input: 1) is touched to activate the voice recognition function is a touch soft button, 2) is pressed or manipulated to activate the voice recognition function of the hard buttons, 3) comprises a touch screen in the input unit is touched to activate the voice recognition function in any position, and 4) is input to activate the voice recognition striking feature sound, 5) a local area radio signal or a remote area radio signal, and 6) a body information signal from a user.
  6. 6.如权利要求1所述的移动终端,其特征在于,还包括: 第一数据库,配置成存储由所述控制器用来识别所述语音命令的语音或发音信息; 第二数据库,配置成存储由所述控制器用来识别所述语音命令的词、关键词或句子信息; 第三数据库,配置成存储与所述移动终端的功能或菜单有关的信息;以及第四数据库,配置成存储将被输出以通知用户所述控制器正试图确定所述语音命令的含义的帮助信息。 The mobile terminal according to claim 1, characterized in that, further comprising: a first database configured to store voice or pronunciation information identifying the voice command by the controller; a second database configured to store word, sentence or keyword information is used by the controller to recognize the voice command; a third database configured to store information of functions or menus related to the mobile terminal; and a fourth database configured to store to be output to inform the user that the controller is trying to help determine the meaning of the voice command.
  7. 7.如权利要求1所述的移动终端,其特征在于,所述控制器还被配置成输出指示所述语音识别功能处于激活状态的音频或视频信息。 The mobile terminal according to claim 1, wherein the controller is further configured to output an indication of the voice recognition function in an active state audio or video information.
  8. 8.如权利要求1所述的移动终端,其特征在于,所述多个域包括以下域中的至少两个域:对应于所述移动终端上发送和接收的电子邮件的电子邮件域、对应于分配在所述移动终端上的日程安排事件的日程安排任务域、对应于所述移动终端上的联系人的联系人域、对应于存储在所述移动终端上的电话号码的电话簿域、对应于由所述移动终端提供的地图信息的地图域、对应于存储在所述移动终端上的照片的照片域、对应于所述移动终端上发送和接收的消息的消息域、对应于所述移动终端上执行的多媒体功能的多媒体域、对应于所述移动终端可连接的外部设备的外部设备域、对应于所述移动终端上发送和接收的呼叫的呼叫历史域、以及对应于所述移动终端上执行的设置功能的设置域。 The mobile terminal according to claim 1, wherein said plurality of domains comprises domains at least two domains: e-mail domain corresponding to emails sent and received on the mobile terminal, corresponding to schedule task schedule event in field distribution on the mobile terminal, a contact domain corresponding to contacts on the mobile terminal, a phonebook domain corresponding to phone numbers stored on the mobile terminal, corresponding to map information provided by the mobile terminal in the map domain corresponding to photos on the mobile terminal storing the photo domain corresponding to messages transmitted and received on the mobile terminal, a message domain corresponding to the multimedia functions performed on the mobile multimedia terminal domain, an external device domain corresponding to external devices the mobile terminal can be connected, corresponding to the call history domain call transmission and reception on the mobile terminal, and corresponding to the mobile setting field setting functions performed on the terminal.
  9. 9.一种控制移动终端的方法,其特征在于,所述方法包括: 接收用于激活所述移动终端上的语音识别功能的输入; 接收到用于激活所述语音识别功能的输入时,将可被用作语音命令识别基准的数据库的域指定为和所述显示单元上所显示的菜单或子菜单相关联的域; 检测所接收到的语音命令的至少一个关键词; 基于经检测到的所述至少一个关键词,分析所述语音命令的内容和背景; 通过参照存储在所述数据库中的信息来确定所述语音命令的含义;以及执行对应于所述语音命令的、和所述菜单或子菜单相关联的功能。 9. A method of controlling a mobile terminal, wherein the method comprises: receiving an input of a voice recognition function on the activation of the mobile terminal; receiving an input for activating the voice recognition function when the may be used as a reference for voice command recognition database domains and domain designated menu is displayed on the display unit or the sub-menu associated with the display; detecting voice command received at least one keyword; based on the detected at least one keyword, analyzes content and context of the voice command; determining the meaning of the voice command by referring to information stored in the database; and performing corresponding to the voice command, and the menu or functional sub-menus associated with it.
  10. 10.如权利要求9所述的方法,其特征在于,所述具体菜单或操作包括多媒体菜单或操作、联系人菜单或操作、消息收发菜单或操作、声音菜单或操作、组织器菜单或操作、屏幕菜单或操作、实用工具菜单或操作、相机菜单或操作以及设置菜单或操作中的至少一个。 10. The method according to claim 9, wherein the specific menu or operation comprises a multimedia menu or operation, contacts menu or operation, a messaging menu or operation, sound menu or operation, an organizer menu or operation, screen menu or operation, the utilities menu or operation, or operating the camera menu and settings menu or operation of at least one.
  11. 11.如权利要求9所述的方法,其特征在于,所述确定语音命令的步骤还包括: 在所述移动终端的显示单元上输出所述移动终端的属于所述特定域且被确定为具有高于预定阈值的识别率的所有菜单或子菜单。 11. The method according to claim 9, wherein said determining step further voice commands comprising: on a display unit of the mobile terminal outputs the mobile terminal belonging to the specific domain and is determined to have recognition rate higher than a predetermined threshold value, all the menu or submenu.
  12. 12.如权利要求11所述的方法,其特征在于,还包括: 接收用于选择所述所有菜单或子菜单之一的语音输入命令; 识别所述输入语音命令;以及输出询问有关所识别的输入语音命令是否准确的信息。 12. The method according to claim 11, characterized in that, further comprising: receiving a voice menu to select one or all of the sub-menu for inputting a command; identifying the input speech command; and outputting the identified ask about enter the voice command accuracy of information.
  13. 13.如权利要求11所述的方法,其特征在于,还包括: 在所述显示单元上,输出所述移动终端的属于所访问的特定域的,且以较高识别率至较低识别率的顺序将语音命令和高于预定阈值的识别率相匹配的所述所有菜单或子菜单。 13. The method according to claim 11, characterized in that, further comprising: means at the output of the mobile terminal belonging to the accessed specific domain and a higher recognition rate to a lower recognition rate of the display the sequence of the voice command above a predetermined threshold and a recognition rate that matches all menu or submenu.
  14. 14.如权利要求11所述的方法,其特征在于,所述预定阈值由移动终端的制造商或由所述移动终端的用户设置。 14. The method according to claim 11, wherein said predetermined threshold is set by the manufacturer of the mobile terminal or by a user of the mobile terminal.
  15. 15.如权利要求11所述的方法,其特征在于,还包括: 通过控制所述菜单或操作的大小、位置、颜色、亮度和突出显示中的至少一个,在所述显示单元上可分辨地显示所述所有菜单或子菜单中具有最高识别率的特定菜单或子菜单。 15. The method according to claim 11, characterized in that, further comprising: controlling the operation of the menu or the size, position, color, brightness, and at least one of highlighting, the display unit may be resolved displaying the menu or submenu all specific menu or submenu having the highest recognition rate.
  16. 16.如权利要求9所述的方法,其特征在于,还包括: 基于所述功能先前曾被以正确方式选择的次数来调节所述功能的识别率。 16. The method according to claim 9, characterized in that, further comprising: adjusting function based on the recognition rate of the number of times the function has previously been selected in a correct manner.
  17. 17.如权利要求9所述的方法,其特征在于,还包括: 输出指示所述语音识别功能处于激活状态的音频或视频信息。 17. The method according to claim 9, characterized in that, further comprising: an output indicating that the voice recognition function activation state is audio or video information.
  18. 18.如权利要求9所述的方法,其特征在于,所述多个域包括以下域中的至少两个域:对应于所述移动终端上发送和接收的电子邮件的电子邮件域、对应于分配在所述移动终端上的日程安排事件的日程安排任务域、对应于所述移动终端上的联系人的联系人域、对应于存储在所述移动终端上的电话号码的电话簿域、对应于由所述移动终端提供的地图信息的地图域、对应于存储在所述移动终端上的照片的照片域、对应于所述移动终端上发送和接收的消息的消息域、对应于所述移动终端上执行的多媒体功能的多媒体域、对应于所述移动终端可连接的外部设备的外部设备域、对应于所述移动终端上发送和接收的呼叫的呼叫历史域、以及对应于所述移动终端上执行的设置功能的设置域。 18. The method according to claim 9, wherein said plurality of domains comprises domains at least two domains: e-mail domain corresponding to emails sent and received on the mobile terminal, corresponding to schedule task schedule event field distribution on the mobile terminal, a contact domain corresponding to contacts on the mobile terminal, a phonebook domain corresponding to phone numbers stored on the mobile terminal, corresponding to field map in the map information provided by the mobile terminal, corresponding to the pictures stored on the mobile terminal of the picture field corresponding to the message transmission and reception on the mobile terminal, a message domain corresponding to the mobile multimedia functions performed on a multimedia terminal domain, an external device domain corresponding to external devices the mobile terminal can be connected, corresponding to the call history domain call transmission and reception on the mobile terminal, and corresponding to the mobile terminal setting domain setting function of the execution.
CN 200810127910 2008-04-08 2008-07-02 Mobile terminal and menu control method thereof CN101557432B (en)

Priority Applications (6)

Application Number Priority Date Filing Date Title
KR10-2008-0032841 2008-04-08
KR10-2008-0032843 2008-04-08
KR20080032843A KR101521908B1 (en) 2008-04-08 2008-04-08 Mobile terminal and its menu control method
KR20080032841A KR20090107364A (en) 2008-04-08 2008-04-08 Mobile terminal and its menu control method
KR10-2008-0033350 2008-04-10
KR20080033350A KR101521909B1 (en) 2008-04-10 2008-04-10 Mobile terminal and its menu control method

Publications (2)

Publication Number Publication Date
CN101557432A true CN101557432A (en) 2009-10-14
CN101557432B true CN101557432B (en) 2013-06-19

Family

ID=41175373

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 200810127910 CN101557432B (en) 2008-04-08 2008-07-02 Mobile terminal and menu control method thereof

Country Status (2)

Country Link
KR (1) KR20090107364A (en)
CN (1) CN101557432B (en)

Families Citing this family (32)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3005668A1 (en) * 2013-06-08 2016-04-13 Apple Inc. Application gateway for providing different user interfaces for limited distraction and non-limited distraction contexts
US9413869B2 (en) 2010-02-10 2016-08-09 Qualcomm Incorporated Mobile device having plurality of input modes
CN101931701A (en) * 2010-08-25 2010-12-29 宇龙计算机通信科技(深圳)有限公司 Method, system and mobile terminal for prompting contact information in communication process
CN102467336B (en) * 2010-11-19 2013-10-30 联想(北京)有限公司 Electronic equipment and object selection method thereof
CN102685307A (en) * 2011-03-15 2012-09-19 中兴通讯股份有限公司 Method, device and system for processing command information
US20130143525A1 (en) * 2011-12-02 2013-06-06 The Boeing Company Point of Use Verified Aircraft Assembly Time Collection
US8793136B2 (en) * 2012-02-17 2014-07-29 Lg Electronics Inc. Method and apparatus for smart voice recognition
KR101889836B1 (en) 2012-02-24 2018-08-20 삼성전자주식회사 Method and apparatus for cotrolling lock/unlock state of terminal through voice recognition
CN103366743A (en) * 2012-03-30 2013-10-23 北京千橡网景科技发展有限公司 Voice-command operation method and device
US9721563B2 (en) 2012-06-08 2017-08-01 Apple Inc. Name recognition system
CN103514882B (en) * 2012-06-30 2017-11-10 北京百度网讯科技有限公司 A speech recognition method and system
US9093072B2 (en) * 2012-07-20 2015-07-28 Microsoft Technology Licensing, Llc Speech and gesture recognition enhancement
CN103593134B (en) * 2012-08-17 2018-01-23 上海博泰悦臻电子设备制造有限公司 Vehicle equipment control method and voice functions
CN103593081B (en) * 2012-08-17 2017-11-07 上海博泰悦臻电子设备制造有限公司 Vehicle equipment control method and voice functions
US10042603B2 (en) 2012-09-20 2018-08-07 Samsung Electronics Co., Ltd. Context aware service provision method and apparatus of user device
CN103885661A (en) * 2012-12-20 2014-06-25 联想(北京)有限公司 Control method and control device
CN103064530B (en) * 2012-12-31 2017-03-08 华为技术有限公司 Input processing method and apparatus
KR20140103634A (en) * 2013-02-19 2014-08-27 엘지전자 주식회사 Mobile terminal and method for controlling of the same
US9691382B2 (en) * 2013-03-01 2017-06-27 Mediatek Inc. Voice control device and method for deciding response of voice control according to recognized speech command and detection output derived from processing sensor data
CN104049722B (en) * 2013-03-11 2017-07-25 联想(北京)有限公司 Information processing method, and an electronic device
CN104077105B (en) * 2013-03-29 2018-04-27 联想(北京)有限公司 An information processing method and an electronic apparatus
US20140337031A1 (en) * 2013-05-07 2014-11-13 Qualcomm Incorporated Method and apparatus for detecting a target keyword
CN103699293A (en) * 2013-12-02 2014-04-02 联想(北京)有限公司 Operation method and electronic equipment
KR20150086030A (en) 2014-01-17 2015-07-27 엘지전자 주식회사 Mobile terminal and controlling method thereof
CN103885596B (en) * 2014-03-24 2017-05-24 联想(北京)有限公司 An information processing method and an electronic device
US9633004B2 (en) 2014-05-30 2017-04-25 Apple Inc. Better resolution when referencing to concepts
CN104239043B (en) * 2014-09-04 2017-10-31 百度在线网络技术(北京)有限公司 Instruction execution method and apparatus
CN104715754A (en) * 2015-03-05 2015-06-17 北京华丰亨通科贸有限公司 Method and device for rapidly responding to voice commands
CN105094331B (en) * 2015-07-27 2018-08-07 联想(北京)有限公司 Information processing method, and electronic equipment
CN105208204A (en) * 2015-08-27 2015-12-30 北京羽乐创新科技有限公司 Communication service processing method and apparatus
CN105573582A (en) * 2015-12-14 2016-05-11 魅族科技(中国)有限公司 Display method and terminal
US10043516B2 (en) 2016-09-23 2018-08-07 Apple Inc. Intelligent automated assistant

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1346566A (en) 1999-02-08 2002-04-24 高通股份有限公司 Voice recognition user interface for telephone handsets
US7280970B2 (en) 1999-10-04 2007-10-09 Beepcard Ltd. Sonic/ultrasonic authentication device

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1346566A (en) 1999-02-08 2002-04-24 高通股份有限公司 Voice recognition user interface for telephone handsets
US7280970B2 (en) 1999-10-04 2007-10-09 Beepcard Ltd. Sonic/ultrasonic authentication device

Also Published As

Publication number Publication date Type
KR20090107364A (en) 2009-10-13 application
CN101557432A (en) 2009-10-14 application

Similar Documents

Publication Publication Date Title
US20090060452A1 (en) Display of Video Subtitles
US20100227640A1 (en) Mobile terminal and operation control method thereof
US20100122195A1 (en) Mobile terminal with touch screen and method of processing data using the same
US20110050975A1 (en) Display device in a mobile terminal and method for controlling the same
US20110105190A1 (en) Terminal and control method thereof
US20090037477A1 (en) Portable terminal and image information managing method therefor
US20100125405A1 (en) Method for controlling map and mobile terminal using the same
US20090131117A1 (en) Mobile terminal and key input method thereof
US20120071208A1 (en) Mobile terminal and control method thereof
US20100058253A1 (en) Mobile terminal and method for controlling music play thereof
US20090239588A1 (en) Mobile terminal and screen displaying method thereof
US20100315358A1 (en) Mobile terminal and controlling method thereof
US20090164905A1 (en) Mobile terminal and equalizer controlling method thereof
US20090006100A1 (en) Identification and selection of a software application via speech
US20110066976A1 (en) Function executing method and apparatus for mobile terminal
US20100318366A1 (en) Touch Anywhere to Speak
US20100199176A1 (en) Electronic device with text prediction function and method
US20100105364A1 (en) Mobile terminal and control method thereof
US20100022276A1 (en) Menu display method of mobile terminal
US20090300657A1 (en) Intelligent menu in a communication device
US20080209546A1 (en) Event display method and apparatus for mobile terminal
US20090209240A1 (en) Auto messaging to currently connected caller
US20150065200A1 (en) Mobile terminal and method for controlling the same
US20100332226A1 (en) Mobile terminal and controlling method thereof
KR20100010072A (en) Controlling method of user interface for multitasking of mobile devices

Legal Events

Date Code Title Description
C06 Publication
C10 Entry into substantive examination
C14 Grant of patent or utility model