KR20090107365A - Mobile terminal and its menu control method - Google Patents

Mobile terminal and its menu control method Download PDF

Info

Publication number
KR20090107365A
KR20090107365A KR1020080032842A KR20080032842A KR20090107365A KR 20090107365 A KR20090107365 A KR 20090107365A KR 1020080032842 A KR1020080032842 A KR 1020080032842A KR 20080032842 A KR20080032842 A KR 20080032842A KR 20090107365 A KR20090107365 A KR 20090107365A
Authority
KR
South Korea
Prior art keywords
information
mobile terminal
meaning
voice command
voice
Prior art date
Application number
KR1020080032842A
Other languages
Korean (ko)
Inventor
신종호
윤종근
곽재도
Original Assignee
엘지전자 주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 엘지전자 주식회사 filed Critical 엘지전자 주식회사
Priority to KR1020080032842A priority Critical patent/KR20090107365A/en
Publication of KR20090107365A publication Critical patent/KR20090107365A/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16Sound input; Sound output
    • G06F3/167Audio in a user interface, e.g. using voice commands for navigating, audio feedback
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/038Indexing scheme relating to G06F3/038
    • G06F2203/0381Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance interaction with lists of selectable items, e.g. menus
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/226Procedures used during a speech recognition process, e.g. man-machine dialogue using non-speech characteristics
    • G10L2015/228Procedures used during a speech recognition process, e.g. man-machine dialogue using non-speech characteristics of application context
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers; Analogous equipment at exchanges
    • H04M1/72Substation extension arrangements; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selecting
    • H04M1/725Cordless telephones
    • H04M1/72519Portable communication terminals with improved user interface to control a main telephone operation mode or to indicate the communication status
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M2250/00Details of telephonic subscriber devices
    • H04M2250/74Details of telephonic subscriber devices with voice recognition means

Abstract

The present invention relates to a mobile terminal and a method for controlling the function of the mobile terminal to control the various functions provided in the mobile terminal by recognizing the context or content of the command input by voice, and a microphone for receiving a voice command and a voice recognition function. A signal input unit for receiving a signal for controlling activation of the mobile terminal; a memory configured to include information related to each menu or function included in the mobile terminal; and a voice input function for receiving the activation control signal to activate a voice recognition function. The controller may be configured to determine a meaning based on the content and context of the received voice command based on the stored information and to output a result corresponding to the determined meaning to a specific component of the terminal.

Description

Mobile terminal and its menu control method {MOBILE TERMINAL AND ITS MENU CONTROL METHOD}

The present invention relates to a mobile terminal and a menu control method thereof, which are capable of controlling various functions provided in the mobile terminal by recognizing the context or content of a command input by voice.

The mobile terminal may be configured to perform various functions.

Examples of such various functions include data and voice communication functions, taking pictures or videos through a camera, storing voices, playing music files through a speaker system, and displaying images or videos. Some mobile terminals include additional functionality to play games, while others are implemented as multimedia devices. Moreover, recent mobile terminals can receive broadcast or multicast signals to watch video or television programs.

In addition, efforts to support and increase the function of the mobile terminal continue. The foregoing efforts include not only changes and improvements in the structural components forming the mobile terminal, but also improvements in software or hardware. As such a design form, a folder form, a slide form, a bar form or a rotation form design is applied to the mobile terminal.

In addition, the mobile terminal has various user interfaces for executing functions. For example, a function for voice recognition, a touch pad, a keypad, or a pen input is applied. However, the user interface has a problem in that a recognition error rate is high or user satisfaction is low according to each characteristic.

An object of the present invention is to provide a mobile terminal and a menu control method thereof capable of recognizing a meaning included in a context or content of a command input by voice in order to control various functions provided in the mobile terminal.

In addition, the present invention provides a mobile terminal and a method for controlling the menu to recognize a meaning included in the context or content of a voice command input to control the mobile terminal and to display a menu of functions related to the recognized command. It is to provide.

In addition, the present invention recognizes the meaning contained in the context or content of the voice command input to control the mobile terminal, the movement to display a menu of the recognition rate is a certain value or more of the menu of the function related to the recognized command It is to provide a terminal and a menu control method thereof.

Another object of the present invention is to provide a mobile terminal having function information related to various menus that can correspond to the command, and a method for controlling the menu, in order to improve recognition of a voice command.

In addition, the present invention provides a mobile terminal and a method for controlling the menu having means and methods for controlling the activation of the voice recognition function in order to reduce power consumption and resource consumption required to perform the voice recognition function and improve the recognition rate for the voice command. It is to provide.

The present invention also provides a mobile terminal and a menu control method for controlling the functions of the mobile terminal by simultaneously applying at least two or more of a plurality of user interfaces provided for detecting a user's manipulation in the mobile terminal. will be.

Mobile terminal according to an embodiment of the present invention for realizing the above object is a microphone for receiving a voice command, a signal input unit for receiving a signal for controlling the activation of the voice recognition function, and each menu or function provided in the mobile terminal A memory configured to store information related to the database, the activation control signal is activated to activate a voice recognition function, and the meaning is determined based on the content and context of the received voice command with reference to information stored in the database. And a controller for outputting a result corresponding to the determined meaning to a specific component of the terminal.

In addition, the present invention for realizing the above object is to receive a specific activation signal to activate the voice recognition function of the mobile terminal, convert the voice command input in the activation state to a specific information format, and then After determining the meaning of the voice command based on the content and context, a result corresponding to the meaning of the voice command is output to a specific element of the terminal.

The mobile terminal according to the present invention configured as described above has an effect of controlling various functions provided in the mobile terminal by recognizing a meaning included in a context or content of a command inputted by voice.

In addition, the mobile terminal according to the present invention has the effect of recognizing the meaning included in the context or content of a command input by voice and displaying a menu of functions related to the recognized command.

In addition, the mobile terminal according to the present invention has an effect of recognizing the meaning included in the context or content of a command input by voice and displaying menus having a recognition rate equal to or greater than a specific value among menus of functions related to the recognized command. .

In addition, the mobile terminal according to the present invention has an effect of improving the recognition rate of the context or content for the voice command by providing a plurality of pieces of function information related to various menus that can correspond to the voice command.

In addition, the mobile terminal according to the present invention controls the activation of the voice recognition function to perform the voice recognition function only when necessary, thereby reducing the power consumption and resource consumption required to perform the voice recognition function, and improve the recognition rate for the voice command It is effective to make it.

In addition, the mobile terminal according to the present invention has the effect of improving the user's convenience and voice command recognition rate by complementing the user interface having different characteristics by applying a plurality of user interfaces at the same time.

Hereinafter, various embodiments of the present invention will be described in detail with reference to the accompanying drawings. However, the detailed description of the well-known technology and its configuration which are determined to obscure the gist of the present invention will be omitted. In addition, in the business card according to the present invention with reference to the drawings, components that perform the same function will be described with the same reference numerals.

Hereinafter, a mobile terminal according to the present invention will be described in more detail with reference to the drawings.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.

The mobile terminal can be implemented in various forms. For example, the mobile terminal described herein may be a mobile phone, a smart phone, a notebook computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), navigation, or the like. have.

The illustrated mobile terminal 100 includes a wireless communication unit 110, an A / V input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, The interface unit 170 may include a controller 180, a power supply unit 190, and the like. 1 illustrates a mobile terminal having various components. However, not all illustrated components are essential components. The mobile terminal may be implemented by more components than the illustrated components, or the mobile terminal may be implemented by fewer components.

Hereinafter, the components will be described in turn.

The wireless communication unit 110 may include one or more components for wireless communication between the mobile terminal 100 and the wireless communication system or wireless communication between the mobile terminal 100 and a network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless internet module 113, a short range communication module 114, a location information module 115, and the like. .

The broadcast receiving module 111 receives a broadcast signal and / or broadcast related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may mean a server that generates and transmits a broadcast signal and / or broadcast related information or a server that receives a previously generated broadcast signal and / or broadcast related information and transmits the same to a terminal. The broadcast related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast signal may include not only a TV broadcast signal, a radio broadcast signal, and a data broadcast signal, but also a broadcast signal having a data broadcast signal combined with a TV broadcast signal or a radio broadcast signal.

Meanwhile, the broadcast related information may be provided through a mobile communication network, and in this case, may be received by the mobile communication module 112.

The broadcast related information may exist in various forms. For example, it may exist in the form of Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB) or Electronic Service Guide (ESG) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast receiving module 111 receives a broadcast signal using various broadcasting systems, and in particular, digital multimedia broadcasting-terrestrial (DMB-T), digital multimedia broadcasting-satellite (DMB-S), and media forward link (MediaFLO). Digital broadcast signals can be received using digital broadcasting systems such as only), digital video broadcast-handheld (DVB-H), integrated services digital broadcast-terrestrial (ISDB-T), and the like. Of course, the broadcast receiving module 111 is configured to be suitable for all broadcast systems providing broadcast signals as well as the digital broadcast system described above.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

In addition, the mobile communication module 112 transmits and receives a radio signal with at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data according to transmission and reception of a voice call signal, a video call call signal, or a text / multimedia message.

The wireless internet module 113 refers to a module for wireless internet access, and the wireless internet module 113 may be internal or external.

The short range communication module 114 refers to a module for short range communication. As a short range communication technology, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and the like may be used.

In addition, the location information module 115 is a module for checking or obtaining the location of the mobile terminal. One example is the Global Position System (GPS) module. The GPS module receives location information from a plurality of satellites. Here, the location information may include coordinate information represented by latitude and longitude. For example, the GPS module can measure the exact time and distance from three or more satellites and accurately calculate the current position by triangulating three different distances. A method of obtaining distance and time information from three satellites and correcting the error with one satellite may be used. In particular, the GPS module can obtain not only the location of latitude, longitude, and altitude but also accurate time together with three-dimensional speed information from the location information received from the satellite.

Meanwhile, the A / V input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video call mode or the photographing mode. The processed image frame may be displayed on the display unit 151.

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. Two or more cameras 121 may be provided according to the configuration aspect of the terminal.

The microphone 122 receives an external sound signal by a microphone in a call mode, a recording mode, a voice recognition mode, etc., and processes the external sound signal into electrical voice data. The processed voice data may be converted into a form transmittable to the mobile communication base station through the mobile communication module 112 and output in the call mode. The microphone 122 may be implemented with various noise removing algorithms for removing noise generated in the process of receiving an external sound signal.

The user input unit 130 generates input data for the user to control the operation of the terminal. The user input unit 130 may include a key pad dome switch, a touch pad (static pressure / capacitance), a jog wheel, a jog switch, and the like. In particular, when the touch pad has a mutual layer structure with the display unit 151 described later, this may be referred to as a touch screen.

The sensing unit 140 detects a current state of the mobile terminal 100 such as an open / closed state of the mobile terminal 100, a location of the mobile terminal 100, presence or absence of a user contact, orientation of the mobile terminal, acceleration / deceleration of the mobile terminal, and the like. To generate a sensing signal for controlling the operation of the mobile terminal 100. For example, when the mobile terminal 100 is in the form of a slide phone, it may sense whether the slide phone is opened or closed. In addition, it is responsible for sensing functions related to whether the power supply unit 190 is supplied with power or whether the interface unit 170 is coupled to an external device.

The interface unit 170 serves as an interface with all external devices connected to the mobile terminal 100. For example, wired / wireless headset ports, external charger ports, wired / wireless data ports, memory card ports, ports for connecting devices with identification modules, audio input / output (I / O) ports, Video I / O (Input / Output) port, earphone port, etc. may be included.

Here, the identification module is a chip that stores various types of information for authenticating the use authority of the mobile terminal 100, and includes a user identification module (UIM) and a subscriber identify module (SIM). ), A Universal Subscriber Identity Module (“USIM”), and the like. In addition, the device equipped with the identification module (hereinafter, 'identification device') may be manufactured in the form of a smart card. Therefore, the identification device may be connected to the terminal 100 through a port. The interface unit 170 receives data from an external device or receives power and transmits the data to each component inside the mobile terminal 100 or transmits the data inside the mobile terminal 100 to an external device.

The output unit 150 is for outputting an audio signal, a video signal, or an alarm signal. The output unit 150 may include a display unit 151, a sound output module 152, an alarm unit 153, and the like.

The display unit 151 displays and outputs information processed by the mobile terminal 100. For example, when the mobile terminal is in a call mode, a user interface (UI) or a graphic user interface (GUI) related to a call is displayed. When the mobile terminal 100 is in a video call mode or a photographing mode, the mobile terminal 100 displays a photographed and / or received image, a UI, or a GUI.

Meanwhile, as described above, when the display unit 13 and the touch pad form a mutual layer structure to form a touch screen, the display unit 151 may be used as an input device in addition to the output device. The display unit 151 may include a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, and a three-dimensional display. 3D display) may include at least one. In addition, two or more display units 151 may exist according to the implementation form of the mobile terminal 100. For example, an external display unit (not shown) and an internal display unit (not shown) may be simultaneously provided in the mobile terminal 100.

The sound output module 152 outputs audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. In addition, the sound output module 152 outputs a sound signal related to a function (eg, a call signal reception sound, a message reception sound, etc.) performed in the mobile terminal 100. The sound output module 152 may include a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying occurrence of an event of the mobile terminal 100. Examples of events occurring in the mobile terminal include call signal reception, message reception, and key signal input. The alarm unit 153 may output a signal for notifying occurrence of an event in a form other than an audio signal or a video signal. For example, the signal may be output in the form of vibration. When a call signal is received or a message is received, the alarm unit 153 may output a vibration to inform this. Alternatively, when a key signal is input, the alarm unit 153 may output a vibration in response to the key signal input. Through the vibration output as described above, the user can recognize the occurrence of the event. Of course, the signal for notification of event occurrence may be output through the display unit 151 or the voice output module 152.

The memory 160 may store a program for processing and controlling the controller 180 and may provide a function for temporarily storing input / output data (for example, a phone book, a message, a still image, a video, etc.). It can also be done.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), RAM Random Access Memory (RAM) Static Random Access Memory (SRAM), Read-Only Memory (ROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Programmable Read-Only Memory (PROM) magnetic memory, It may include at least one type of storage medium of the optical disk. In addition, the mobile terminal 100 may operate a web storage that performs a storage function of the memory 150 on the Internet.

The controller 180 typically controls the overall operation of the mobile terminal. For example, perform related control and processing for voice calls, data communications, video calls, and the like. In addition, the controller 180 may include a multimedia module 181 for playing multimedia. The multimedia module 181 may be implemented in the controller 180 or may be implemented separately from the controller 180.

The power supply unit 190 receives an external power source or an internal power source under the control of the controller 180 to supply power for operation of each component.

Various embodiments described herein may be implemented in a computer-readable recording medium using, for example, software, hardware or a combination thereof.

According to a hardware implementation, the embodiments described herein include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), and the like. It may be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing the functions. It may be implemented by the controller 180.

In a software implementation, embodiments such as procedures or functions may be implemented with separate software modules that allow at least one function or operation to be performed. The software code may be implemented by a software application written in a suitable programming language. In addition, the software code may be stored in the memory 160 and executed by the controller 180.

 In the above, the mobile terminal related to the present invention has been described in terms of components according to functions. Hereinafter, referring to FIGS. 2 and 3, the mobile terminal related to the present invention will be further described in terms of components according to appearance. Hereinafter, for simplicity, a slider type mobile terminal is described as an example among various types of mobile terminals such as a folder type, a bar type, a swing type, a slider type, and the like. Therefore, the present invention is not limited to the slider type mobile terminal, but can be applied to all types of mobile terminals including the above-described type.

2 is a front perspective view of an example of a mobile terminal according to the present invention;

The mobile terminal of the present invention includes a first body 200 and a second body 205 configured to be slidable in at least one direction on the first body 200.

A state in which the first body 200 is disposed to overlap with the second body 205 may be referred to as a closed configuration, and as shown in the drawing, the first body 200 may be referred to as the second body 205. The exposed state of at least a portion of the N may be referred to as an open configuration.

The mobile terminal mainly operates in a standby mode in a closed state, but the standby mode may be released by a user's operation. In addition, although the mobile terminal operates mainly in a call mode or the like in an open state, the mobile terminal may be switched to a standby mode by a user's manipulation or a lapse of a predetermined time.

The case (casing, housing, cover, etc.) forming the exterior of the first body 200 is formed by the first front case 220 and the first rear case 225. Various electronic components are embedded in the space formed by the first front case 220 and the first rear case 225. At least one intermediate case may be further disposed between the first front case 220 and the first rear case 225.

The cases may be formed by injecting a synthetic resin or may be formed of a metal material, for example, a metal material such as stainless steel (STS) or titanium (Ti).

The display module 151, the audio output module 152, the camera 121, or the first user input unit 210 may be disposed on the first body 200, specifically, the first front case 220.

The display module 151 includes a liquid crystal display (LCD), organic light emitting diodes (OLED), and the like, which visually express information.

In addition, since the touch pad is superimposed on the display module 151 in a layer structure, the display module 151 may operate as a touch screen to enable input of information by a user's touch.

The sound output module 152 may be implemented in the form of a speaker.

The camera 121 may be implemented to be suitable for capturing an image or a video of a user or the like.

Like the first body 200, the case forming the exterior of the second body 205 is formed by the second front case 230 and the second rear case 235.

The second user input unit 215 may be disposed on the second body 205, specifically, on the front face of the second front case 230.

The third user input unit 245, the microphone 122, and the interface unit 170 may be disposed in at least one of the second front case 230 or the second rear case 235.

The first to third user inputs 210, 215, and 245 may be collectively referred to as a manipulating portion 130, and may be any type as long as the user is tactile in a tactile manner. Can be employed.

For example, the user input unit may be implemented as a dome switch or a touch pad capable of receiving a command or information by a user's push or touch operation, or a wheel or jog method of rotating a key, or a manipulation method such as a joystick. May also be implemented.

In functional terms, the first user input unit 210 is for inputting a command such as start, end, scroll, etc., and the second user input unit 215 is for inputting numbers, letters, symbols, and the like.

In addition, the third user input unit 245 may operate as a hot key for activating a special function in the mobile terminal.

The microphone 122 may be implemented in a form suitable for receiving a user's voice, other sounds, and the like.

The interface unit 170 serves as a passage for allowing the mobile terminal according to the present invention to exchange data with an external device. For example, the interface unit 170 is wired or wirelessly, a connection terminal for connecting with an earphone, a port for short-range communication (for example, an infrared port (IrDA port), a Bluetooth port, a wireless LAN port) wireless LAN port), or at least one of power supply terminals for supplying power to the mobile terminal.

The interface unit 170 may be a card socket that accommodates an external card such as a subscriber identification module (SIM) or a user identity module (UIM) and a memory card for storing information.

The power supply unit 190 for supplying power to the mobile terminal is mounted on the second rear case 235 side.

The power supply unit 190 may be detachably coupled for charging, for example, as a rechargeable battery.

3 is a rear perspective view of the mobile terminal of FIG.

Referring to FIG. 3, a camera 121 may be additionally mounted on the rear surface of the second rear case 235 of the second body 205. The camera 121 of the second body 205 has a photographing direction substantially opposite to the camera 121 of the first body 200, and the camera 121 and the camera 121 of the first body 200. And may have different pixels.

For example, the camera 121 of the first body 200 has a low pixel so that it is easy to take a picture of the user's face and transmit it to the counterpart in the case of a video call, and the camera 121 of the second body is generally It is desirable to have a high pixel because the subject is often photographed and not immediately transmitted.

The flash 250 and the mirror 255 may be further disposed adjacent to the camera 121 of the second body 205. The flash 250 illuminates the subject when the subject is photographed by the camera 121 of the second body 205. The mirror 255 allows the user to see the user's face or the like when photographing (self-photographing) the user by using the camera 121 of the second body 205.

The sound output module 152 may be further disposed on the second rear case 235.

The sound output module 152 of the second body 205 may implement a stereo function together with the sound output module 152 of the first body 200, and may be used for a call in a speakerphone mode.

In addition, an antenna 260 for receiving a broadcast signal may be disposed on one side of the second rear case 235. The antenna 260 may be installed to be pulled out of the second body 205.

A portion of the slide module 265 that slidably couples the first body 200 and the second body 205 is disposed on the side of the first rear case 225 of the first body 200.

The other part of the slide module 265 may be disposed on the second front case 230 side of the second body 205 and may not be exposed to the outside as shown in this drawing.

In the above description, the second camera 121 and the like have been described as being disposed on the second body 205, but the present invention is not limited thereto.

For example, at least one or more of the components 260, 121 to 250, and 152 described as disposed on the second rear case 235, such as the camera 121 of the second body, may be the first body 200. May be mounted on the first rear case 225. In such a case, there is an advantage that the configuration (s) disposed in the first rear case 225 in the closed state are protected by the second body 205. In addition, even if the camera 121 of the second body is not provided separately, the camera 121 of the first body may be rotatably formed so that the camera 121 of the second body may be photographed up to the photographing direction of the camera 121. .

The terminal 100 illustrated in FIGS. 1 to 3 may operate in a communication system capable of transmitting data through a frame or packet, including a wired / wireless communication system and a satellite-based communication system. It can be configured to.

Hereinafter, referring to FIG. 4, a communication system capable of operating a terminal according to the present invention will be described.

The communication system may use different air interfaces and / or physical layers. For example, a radio interface usable by a communication system may include frequency division multiple access (FDMA), time division multiple access (TDMA), and code division multiple access (Code Division). Multiple Access (CDMA), Universal Mobile Telecommunications Systems (UMTS) (especially Long Term Evolution (LTE), Global System for Mobile Communications (GSM), etc.) In the following, for convenience of explanation, the description will be limited to CDMA, but the present invention is naturally applicable to all communication systems including the CDMA wireless communication system.

As shown in FIG. 4, the CDMA wireless communication system includes a plurality of terminals 100, a plurality of base stations (BSs) 270, and base station controllers (BSCs) 275. ), And a mobile switching center (MSC) 280. The MSC 280 is configured to be connected to a public switched telephone network (PSTN) 290 and is also configured to be connected to BSCs 275. The BSCs 275 may be coupled to the BS 270 through a backhaul line. The backhaul line may be provided according to at least one of E1 / T1, ATM, IP, PPP, Frame Relay, HDSL, ADSL, or xDSL. Thus, a plurality of BSCs 275 may be included in the system shown in FIG.

Each BS 270 may include at least one sector, and each sector may include an omnidirectional antenna or an antenna pointing radially out of BS 270. In addition, each sector may include two or more antennas of various types. Each BS 270 may be configured to support a plurality of frequency assignments, each of which has a specific spectrum (eg, 1.25 MHz, 5 MHz, etc.).

The intersection of sectors and frequency assignments may be called a CDMA channel. BS 270 may be called Base Station Transceiver Subsystem ('BTSs'). In this case, the word "base station" may be called the sum of one BSC 275 and at least one BS 270. The base station may also indicate “cell site”. Alternatively, each of the plurality of sectors for a particular BS 270 may be called a plurality of cell sites.

As shown in FIG. 4, a broadcasting transmitter (BT) 295 transmits a broadcast signal to terminals 100 operating in the system. The broadcast module 111 shown in FIG. 1 is provided in the terminal 100 to receive a broadcast signal transmitted by the BT 295.

In addition, FIG. 4 illustrates several satellite positioning systems (GPS) satellites 300. The satellites 300 help to locate the at least one terminal of the plurality of terminals 100. Although two satellites are shown in FIG. 4, useful location information may be obtained by two or less or more satellites. The GPS module 115 shown in FIG. 1 cooperates with the satellites 300 to obtain desired location information. Here, the location can be tracked using all the techniques that can track the location, not just the GPS tracking technology. In addition, at least one of the GPS satellites 300 may optionally or additionally be responsible for satellite DMB transmission.

During typical operation of a wireless communication system, BS 270 receives a reverse link signal from various terminals 100. At this time, the terminals 100 are connecting a call, transmitting or receiving a message, or performing another communication operation. Each of the reverse link signals received by a particular base station 270 is processed within by the particular base station 270. The data generated as a result of the processing is transmitted to the connected BSC 275. BSC 275 provides call resource allocation and mobility management functionality, including the organization of soft handoffs between base stations 270. In addition, the BSC 275 transmits the received data to the MSC 280, and the MSC 280 provides an additional transmission service for connection with the PSTN 290. Similarly, PSTN 290 connects with MSC 280, MSC 280 connects with BSCs 275, and BSCs 275 send BSs 270 to transmit a forward link signal to terminals 100. ).

5 is a flowchart illustrating a function control method using voice of a mobile terminal according to the present invention.

When the voice recognition function is activated (S101), the controller 180 of the mobile terminal recognizes a command (hereinafter referred to as a voice command) input by the user's voice (S102), and indicates the meaning included in the recognized voice command. It is determined (S103).

In order to control activation of the voice recognition function, the controller 180 may receive a specific button or touch. The controller 180 may start or end the activation of the voice recognition function according to the number of inputs of the button or touch.

As the activation is started, the controller 180 can maintain the activation state while the button or touch is being input, and terminate the activation when the button or touch is released. Alternatively, after the voice recognition activation starts, the activation state may be maintained for a preset specific time, and then the activation may be automatically terminated after the specific time elapses.

The controller 180 may store the received voice command in the memory 160 while the voice recognition function is activated.

The determination of the meaning included in the voice command may be performed immediately after the activation of the voice recognition function ends, or may be simultaneously performed while the activation state of the voice recognition function is maintained. Here, the voice recognition may mean simultaneously performing an operation of recognizing a voice command and determining its meaning.

When the voice recognition function is activated, the controller 180 analyzes a word, a key word, or a sentence structure used in the input voice command, and determines the meaning based on contents or context included in the voice command. can do. For example, content means content that can be immediately determined, such as a menu name, and context can mean contextual information related to the menu although there is no direct menu name.

In order to determine the meaning of the voice command, information related to a function, a service, or a menu provided in the mobile terminal may be configured as a specific type of information in a database. The specific form may be a keyword or sentence form.

The database may be stored in memory 160.

The information in the database can be updated through learning.

The controller 180 determines the meaning of the voice command and outputs the result (S104). The result may include a control signal for executing a function corresponding to the recognized voice command or controlling a specific element, or data information for displaying a menu related to the recognized command.

The voice command may be input in an exact name of a specific menu (eg, taking a picture, making a voice call, sending a message, etc.) or in a natural language (eg, displaying a picture to save battery). The natural language voice command may or may not include an exact name associated with a particular menu.

Here, the natural language is a concept of calling a language that people commonly use from an artificial language, which is an artificially created language, and may be processed using a natural language processing algorithm.

If the meaning of the voice command is not clearly determined, the controller 180 may display a plurality of menus having a specific recognition rate (eg, 80%) or more and receive a user selection or confirmation (S105). That is, the controller 180 can confirm to the user whether to execute the function or menu determined to have the highest recognition rate, and receive the user's response to execute the corresponding function or menu.

The form to be confirmed by the user may use a message or voice or a display position or form (shape or size) of a menu, and the response form may be a user's voice or a specific button or touch input.

If the recognition rate of the input voice command is low, an error processing process may be performed. The error processing process may receive a user's selection after receiving a voice command again or displaying a plurality of menus having a specific recognition rate or more. If a function or menu having a specific recognition rate or more is less than or equal to a certain number, the function or menu may be automatically executed (S106).

6 is an exemplary view for explaining a method of controlling activation of a voice recognition function of a mobile terminal according to the present invention.

The voice recognition function not only consumes a lot of resources of the mobile terminal, but also sustains power consumption when the voice recognition function is kept activated even in a standby state. Therefore, in order to prevent power consumption and reduce resource consumption of the mobile terminal, it is necessary to control the activation start and end of the voice recognition function.

As an example for controlling the activation of the voice recognition function, as shown in FIG. 6A, the user input unit 130 provided in the mobile terminal, that is, any button or touch pad, controls the activation of the voice recognition function. Can be used as a means for. The arbitrary buttons may be hardware buttons or software buttons displayed on the display unit 151. The software button may be a button shape or an icon of a specific shape.

Alternatively, as shown in (b) of FIG. 6, an arbitrary area of the display unit 151 on which a button or an icon is not displayed may be input by a touch method.

In addition, as another example for controlling the activation of the voice recognition function, as shown in (c) of FIG. 6, a specific sound may be input using the microphone 122 provided in the mobile terminal to control the activation of the voice recognition function. have.

The specific sound may include a kind of impact sound having a certain level or more, such as a clapping sound. The impact sound may be detected using an algorithm or a circuit that determines the level of the sound input through the microphone 122. The algorithm or circuit for detecting the impact sound may detect a sound or sound of a predetermined level or more, and may be configured to have relatively low resource consumption and low power consumption as compared with the voice recognition function.

Alternatively, the controller 180 may drive the voice recognition function in a plurality of modes. For example, the driving mode may be divided into a first mode that simply detects only a sound or sound above a specific level and a second mode that receives a voice command and determines the content or meaning of the voice command. That is, the controller 180 activates the voice command recognition function by driving the second mode when a sound or sound of a specific level or more is detected in the first mode.

In addition, the controller 180 may start activation of the voice recognition function by receiving body information including a gesture or gesture of a user, and receive the voice signal by receiving a wireless signal of a short distance or a long distance using another wireless device. The activation of the function can be started.

The wireless signal may be input through the wireless communication unit 110, and the gesture or gesture of the user may be input through the sensing unit 140. The wireless communication unit 110, the user input unit 130, and the sensing unit 140 that receive a signal for activating the voice recognition function may be collectively referred to as an activation signal input unit.

After receiving the voice command after the activation of the voice recognition function as described above, it is necessary to terminate the activation of the voice recognition function in order to reduce power consumption and resource consumption. In the method, the activation of the voice recognition function is terminated by inputting a button, a touch, a sound, a wireless signal, or information according to the user's approach such as a user's hand gesture or gesture, in the same way as the activation of the voice recognition function. You can.

On the other hand, as an example of a method of maintaining the activation state after starting the activation, the controller 180 may maintain the activation state for a specific time after starting the activation and then automatically terminate the activation after the specific time. . Alternatively, while maintaining the activation only while the button or touch is continuously input, the activation may be terminated when the input is released. Alternatively, if no voice is input for a specific time in the activation state, the controller 180 may automatically terminate the activation.

7A is a flowchart for explaining a voice recognition method of a mobile terminal according to the present invention.

As shown in FIG. 2, when the activation of the voice recognition function is started, the controller 180 stores the input voice command in the memory 160 (S201 and S202) and processes the voice command by a specific voice recognition algorithm. It may be (S203).

The speech recognition algorithm may convert the received speech into text information and store the text information in an arbitrary area of the memory 160 (S204). The text information is processed to determine the meaning included in the command.

The meaning of the voice command is preferably understood at the same time as the voice input.

However, after all of the input of the voice command is completed, the meaning may be understood. For example, when the input of the voice command is completed, when the voice is not input for a predetermined time, it may be determined that the input of the voice command is completed and the process of determining the meaning of the voice command may be started.

The controller 180 may detect a specific word or keyword included in the text information to determine the meaning included in the voice command (S205). Then, the detected word or keyword may be compared with information related to various functions or menus stored in a specific database of the mobile terminal (S206).

When there is a word or a key word that has the same or similar meaning as the information stored in the database through the comparison of the information, the recognition rate of the voice command may be determined based on the number of the corresponding word or key word (S207). .

In this case, the information for determining the recognition rate of the voice command is not limited to information on the number of words or keywords included in the voice command. That is, by setting different values for determining the recognition rate for each keyword, even if the number is small, the recognition rate may be changed by the keyword having the high recognition rate.

The speech recognition rate is information indicating whether the meaning of the recognized speech command is correct. When the name of a specific menu is correctly input, a recognition rate of 100% can be obtained. It is difficult to obtain a recognition rate of virtually 100% because it can be included in the user, and similar pronunciations having different meanings can be input to each user. Therefore, if the recognition rate is above a certain value (eg, 80%), it can be determined to be accurate, and when there are a plurality of meanings determined as the similar recognition rate (that is, the recognition rate is similar but the voice command is interpreted in various meanings). If possible), a plurality of executable menus may be displayed and any one of them may be selected by the user (S208).

The recognition rate may be set by the terminal manufacturer or may be set by a user.

In displaying the menus, the menus may be displayed in order of relatively high recognition rates. For example, as illustrated in FIG. 7B, a menu icon having a high recognition rate may be displayed closer to the center of the screen (410). Alternatively, the menu icon having a high recognition rate may be displayed larger or darker (420).

The recognition rate may learn the number of selections for a menu frequently selected by a user and change the recognition rate for the selected menu. Therefore, the recognition rate may be different for voice commands input after the same or similar pronunciation or content.

7C is an exemplary view for explaining a voice recognition method of a mobile terminal according to the present invention. For example, the user may use "I want to see my pictures." When a voice command is inputted, the controller 180 detects a meaningful word or key word (eg, see, picture) in a sentence constituting the voice command and compares it with information of a database embedded in the mobile terminal. do.

Whether the detected word or the key word is a meaningful word can be determined by a part-of-speech or only a predetermined key word can be detected as a meaningful word. The controller 180 may search the database for information corresponding to the meaningful word or key word.

The database may store a plurality of keyword information related to various menus or functions provided in the mobile terminal. For example, as keyword information corresponding to "photo album" which is a submenu of the camera menu, a plurality of keyword information such as "photo, picture, video, album" may be matched in addition to the exact name information of "photo album". Can be stored.

If there is no information related to a menu or a function in which a voice command is exactly matched as described above, the controller 180 can display a plurality of menus having a recognition rate of a specific value or more. In this case, the menu icon 521 having a high recognition rate may be displayed larger or darker (510).

Alternatively, when there are less than two menus or functions having a recognition rate higher than a specific value, the corresponding functions or menus may be automatically executed (520). In this case, the controller 180 may output the voice command having the determined meaning as a message or a voice and then execute the user's confirmation.

For example, assuming that a user inputs a voice command of "Enable battery saving" as a natural language, as shown in FIG. 7D, the controller 180 may use a meaningful word or key word in a sentence constituting the voice command. Example: Battery, saving) can be detected and its meaning can be determined through comparison with information stored in the database.

However, since a menu corresponding to the voice command does not exactly exist, the controller 180 can display a plurality of menus (eg, a background screen, a backlight, a standby screen, etc.) related to a function of reducing battery power consumption. have.

At least one of a size, a position, a color, and a contrast may be differently displayed and highlighted according to the order of recognition rate among the plurality of menus. In this case, a recognition rate of a menu having a high user selectivity among the plurality of displayed menus may be changed higher.

8 is an exemplary view for explaining the configuration of a database for voice command recognition of a mobile terminal according to the present invention.

The database stores information for determining the meaning of the voice command, and may configure a plurality of databases according to the characteristics of the information. Each database configured according to the characteristics of the information may be updated under continuous learning under the control of the controller 180.

The learning of the database corresponds to a word that the user pronounces and a word corresponding thereto. For example, when the user pronounces "birthday" but recognizes "life", the user "birthday" By correcting it, the same pronunciation will be learned to be recognized as "birthday" from now on.

Through the learning, a plurality of pieces of voice information may correspond to respective pieces of information in the database.

Each database according to the characteristics of the information includes a first database 161 for storing voice information for recognizing a voice input through a microphone in a phoneme, syllable, or morpheme unit, and based on the recognized voice information. A second database 162 for storing information for determining the overall meaning (eg, grammar, pronunciation accuracy, sentence structure, etc.), and a third for storing information related to a menu for performing a function or service included in the mobile terminal; The database 163 may include a fourth database 164 that stores a message or voice information to be output from the terminal to receive the meaning of the determined voice command from the user.

Each database may store voice (pronounced) information and phoneme, syllable, morpheme, word, keyword, or sentence information corresponding to the voice (pronounced) information.

Accordingly, the controller 180 performs an operation of determining a meaning included in a voice recognition operation and a voice command using at least one of the plurality of databases 161 to 164, and the meaning of the determined voice command. You can execute the menu related to the corresponding function or service.

9 is an exemplary view for explaining a method of indicating that the voice command recognized by the mobile terminal according to the present invention is being executed.

The controller 180 outputs a result when the voice command is recognized or determines the meaning of the voice command. The result may be a control signal for executing a specific function included in the mobile terminal, menu information related to the recognized command, or data information output when the function is executed. Therefore, the result may be output to any one of various components of the mobile terminal.

Meanwhile, in the above embodiment, a method of recognizing and executing a voice command has been described. However, at least one of other user interfaces provided in the mobile terminal may be simultaneously applied while the voice command is recognized. For example, voice recognition and touch input, voice recognition and button input, or voice recognition and touch / button input may be simultaneously applied.

Also, voice recognition may not be applied depending on a specific mode, a menu, or a specific operation state. Accordingly, the audio information (eg, voice guidance) or video information (eg, the indicator 500) indicating that the voice recognition is applied may be displayed in the mode, menu, or operation state to which the voice recognition is applied. Alternatively, the help information output may be used to notify the user that voice recognition is being applied.

According to an embodiment of the present invention, the above-described method may be embodied as computer readable code on a medium in which a program is recorded. The computer-readable medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of computer-readable media include ROM, RAM, CD-ROM, magnetic tape, floppy disks, optical data storage devices, and the like, which are also implemented in the form of carrier waves (eg, transmission over the Internet). It also includes. In addition, the computer may include the controller 180 of the terminal.

The mobile terminal of the present invention described above is not limited to the configuration and method of the above-described embodiments, the embodiments are a combination of all or part of the embodiments selectively so that various modifications can be made It may be configured.

1 is a block diagram of a mobile terminal associated with one embodiment of the present invention;

Figure 2 is a front perspective view of an example of a mobile terminal according to the present invention.

3 is a rear perspective view of the mobile terminal of FIG. 2;

4 is an exemplary diagram of a communication system operable by a terminal according to the present invention;

5 is a flowchart for explaining a function control method using voice of a mobile terminal according to the present invention;

6 is an exemplary diagram for explaining a method of controlling activation of a voice recognition function of a mobile terminal according to the present invention;

7A is a flowchart for explaining a voice recognition method of a mobile terminal according to the present invention;

7B is an exemplary diagram for explaining a method of displaying a menu according to a voice recognition rate of a mobile terminal according to the present invention.

Figure 7c is an exemplary view for explaining a voice recognition method of a mobile terminal according to the present invention.

7D is another exemplary view for explaining a method of displaying a menu according to a voice recognition rate of a mobile terminal according to the present invention.

8 is an exemplary view for explaining the configuration of a database for speech recognition of a mobile terminal according to the present invention.

9 is an exemplary view for explaining a method for indicating that the voice command recognized by the mobile terminal according to the present invention is being executed.

Claims (12)

  1. A microphone for receiving a voice command;
    A signal input unit configured to receive a signal for controlling activation of a voice recognition function;
    A memory for organizing information related to each menu or function included in the mobile terminal into a database;
    The voice recognition function is activated by receiving the activation control signal, and the meaning is determined based on the content and context of the received voice command by referring to the information stored in the database, and a result corresponding to the determined meaning is obtained. And a control unit for outputting to a specific component of the terminal.
  2. The method of claim 1, wherein the control unit,
    A mobile terminal characterized by outputting a function corresponding to the meaning of the determined voice command, a control signal for controlling a specific component of the terminal, or data for outputting a menu corresponding to the meaning of the voice command. .
  3. The method of claim 2, wherein the control unit,
    And determining a recognition rate with respect to the meaning of the voice command, and displaying a menu corresponding to a meaning of a relatively high recognition rate according to the recognition rate differently from other menus.
  4. The method of claim 3, wherein the control unit,
    And controlling at least one of a menu size, a display position, color, contrast, and highlight information according to the order of the recognition rate being higher.
  5. The method of claim 1, wherein the signal input unit,
    Button or touch, sound, near or far radio signals, or
    And at least one of physical information including a user's approach, gestures, and gestures as a control signal for activating a voice recognition function.
  6. The method of claim 1, wherein the database,
    A first database storing voice or pronunciation information for the recognition;
    A second database storing word, key word or sentence information for determining the meaning of the recognized voice;
    A third database for storing information related to various functions and menus provided in the mobile terminal;
    And at least one of a fourth database storing help information to be output to receive the meaning of the recognized voice command from a user.
  7. The method of claim 1, wherein the control unit,
    A mobile terminal characterized by outputting audio or video information indicating the activation state of the voice recognition function.
  8. Activating a voice recognition function;
    Receiving a voice command and determining the meaning of the voice command based on contents and context included in the voice command;
    And outputting a result corresponding to the meaning of the voice command to a specific component of the terminal.
  9. The method of claim 8, wherein the voice command,
    And outputting information for confirming whether or not the function or menu corresponding to the meaning is executed, and executing the corresponding function or menu in response to a user's response or selection of the information. Menu control method of a mobile terminal.
  10. The method of claim 8 or 9, wherein the voice command,
    A plurality of menus corresponding to the meaning that the recognition rate is greater than or equal to a certain value may be displayed.
    And at least one of display position, size, color, contrast, and highlight of each menu is differentially displayed in order of high recognition rate.
  11. The method of claim 8, wherein the determining of the meaning of the voice command comprises:
    Converting the input voice command into information of a specific format;
    Detecting a specific word or key word included in the specific information;
    Comparing the detected word or key word with information stored in a specific database;
    And determining the meaning of the voice command by using the information having the same or similar meaning through the comparison of the information.
  12. The method of claim 11, wherein the voice command,
    The recognition rate may be determined by the number of words stored in the database or information having a meaning similar to or similar to a keyword.
    And a value for determining a recognition rate for each word or keyword can be set differently.
KR1020080032842A 2008-04-08 2008-04-08 Mobile terminal and its menu control method KR20090107365A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020080032842A KR20090107365A (en) 2008-04-08 2008-04-08 Mobile terminal and its menu control method

Applications Claiming Priority (7)

Application Number Priority Date Filing Date Title
KR1020080032842A KR20090107365A (en) 2008-04-08 2008-04-08 Mobile terminal and its menu control method
US12/140,107 US8150700B2 (en) 2008-04-08 2008-06-16 Mobile terminal and menu control method thereof
RU2008126782A RU2394386C2 (en) 2008-04-08 2008-07-01 Mobile communication terminal and menu navigation method for said terminal
CN200810127912XA CN101557651B (en) 2008-04-08 2008-07-02 Mobile terminal and menu control method thereof
JP2008298799A JP5481058B2 (en) 2008-04-08 2008-11-21 Mobile terminal and menu control method thereof
EP08021190.7A EP2109298B1 (en) 2008-04-08 2008-12-05 Mobile terminal and menu control method thereof
US13/362,353 US8560324B2 (en) 2008-04-08 2012-01-31 Mobile terminal and menu control method thereof

Publications (1)

Publication Number Publication Date
KR20090107365A true KR20090107365A (en) 2009-10-13

Family

ID=40445594

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020080032842A KR20090107365A (en) 2008-04-08 2008-04-08 Mobile terminal and its menu control method

Country Status (6)

Country Link
US (2) US8150700B2 (en)
EP (1) EP2109298B1 (en)
JP (1) JP5481058B2 (en)
KR (1) KR20090107365A (en)
CN (1) CN101557651B (en)
RU (1) RU2394386C2 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2013047968A1 (en) * 2011-09-26 2013-04-04 Lg Electronics Inc. User interface method and device
KR101331122B1 (en) * 2013-03-15 2013-11-19 주식회사 에이디자인 Method for connecting call in mbile device
WO2016117774A1 (en) * 2015-01-20 2016-07-28 Lg Electronics Inc. Mobile terminal and method for controlling the same
US10261566B2 (en) 2013-01-07 2019-04-16 Samsung Electronics Co., Ltd. Remote control apparatus and method for controlling power

Families Citing this family (195)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8645137B2 (en) 2000-03-16 2014-02-04 Apple Inc. Fast, language-independent method for user authentication by voice
US8677377B2 (en) 2005-09-08 2014-03-18 Apple Inc. Method and apparatus for building an intelligent automated assistant
US8977255B2 (en) 2007-04-03 2015-03-10 Apple Inc. Method and system for operating a multi-function portable electronic device using voice-activation
US9330720B2 (en) 2008-01-03 2016-05-03 Apple Inc. Methods and apparatus for altering audio output signals
US8996376B2 (en) 2008-04-05 2015-03-31 Apple Inc. Intelligent text-to-speech conversion
KR20090107365A (en) * 2008-04-08 2009-10-13 엘지전자 주식회사 Mobile terminal and its menu control method
US20100030549A1 (en) 2008-07-31 2010-02-04 Lee Michael M Mobile device having human language translation capability with positional feedback
US8676904B2 (en) 2008-10-02 2014-03-18 Apple Inc. Electronic devices with voice command and contextual data processing capabilities
WO2010067118A1 (en) 2008-12-11 2010-06-17 Novauris Technologies Limited Speech recognition involving a mobile device
KR101566379B1 (en) * 2009-05-07 2015-11-13 삼성전자주식회사 Method For Activating User Function based on a kind of input signal And Portable Device using the same
US10241752B2 (en) 2011-09-30 2019-03-26 Apple Inc. Interface for a virtual digital assistant
US9858925B2 (en) 2009-06-05 2018-01-02 Apple Inc. Using context information to facilitate processing of commands in a virtual assistant
US9431006B2 (en) 2009-07-02 2016-08-30 Apple Inc. Methods and apparatuses for automatic speech recognition
US10496753B2 (en) 2010-01-18 2019-12-03 Apple Inc. Automatically adapting user interfaces for hands-free interaction
US9318108B2 (en) 2010-01-18 2016-04-19 Apple Inc. Intelligent automated assistant
US10276170B2 (en) 2010-01-18 2019-04-30 Apple Inc. Intelligent automated assistant
US10679605B2 (en) 2010-01-18 2020-06-09 Apple Inc. Hands-free list-reading by intelligent automated assistant
US10553209B2 (en) 2010-01-18 2020-02-04 Apple Inc. Systems and methods for hands-free notification summaries
WO2011089450A2 (en) 2010-01-25 2011-07-28 Andrew Peter Nelson Jerram Apparatuses, methods and systems for a digital conversation management platform
US8682667B2 (en) 2010-02-25 2014-03-25 Apple Inc. User profiling for selecting user specific voice input processing information
US20110246194A1 (en) * 2010-03-30 2011-10-06 Nvoq Incorporated Indicia to indicate a dictation application is capable of receiving audio
US8738377B2 (en) 2010-06-07 2014-05-27 Google Inc. Predicting and learning carrier phrases for speech input
US8296151B2 (en) * 2010-06-18 2012-10-23 Microsoft Corporation Compound gesture-speech commands
RU2596994C2 (en) * 2010-11-09 2016-09-10 Конинклейке Филипс Электроникс Н.В. User interface with tactile feedback
US10762293B2 (en) 2010-12-22 2020-09-01 Apple Inc. Using parts-of-speech tagging and named entity recognition for spelling correction
KR101802522B1 (en) * 2011-02-10 2017-11-29 삼성전자주식회사 Apparatus having a plurality of touch screens and screen changing method thereof
JP5039214B2 (en) * 2011-02-17 2012-10-03 株式会社東芝 Voice recognition operation device and voice recognition operation method
US8630860B1 (en) * 2011-03-03 2014-01-14 Nuance Communications, Inc. Speaker and call characteristic sensitive open voice search
CN102685307A (en) * 2011-03-15 2012-09-19 中兴通讯股份有限公司 Method, device and system for processing command information
US9262612B2 (en) 2011-03-21 2016-02-16 Apple Inc. Device access using voice authentication
EP2506202A1 (en) * 2011-03-29 2012-10-03 Research In Motion Limited Mobile wireless communications device for selecting a payment account to use with a payment processing system based upon a microphone or device profile and associated methods
JP2015039071A (en) * 2011-03-30 2015-02-26 株式会社東芝 Voice recognition operation device and voice recognition operation method
US20120304067A1 (en) * 2011-05-25 2012-11-29 Samsung Electronics Co., Ltd. Apparatus and method for controlling user interface using sound recognition
US10057736B2 (en) 2011-06-03 2018-08-21 Apple Inc. Active transport based notifications
US10255566B2 (en) 2011-06-03 2019-04-09 Apple Inc. Generating and processing task items that represent tasks to perform
US10241644B2 (en) 2011-06-03 2019-03-26 Apple Inc. Actionable reminder entries
US8994660B2 (en) 2011-08-29 2015-03-31 Apple Inc. Text correction processing
US9992745B2 (en) 2011-11-01 2018-06-05 Qualcomm Incorporated Extraction and analysis of buffered audio data using multiple codec rates each greater than a low-power processor rate
EP2788978A4 (en) 2011-12-07 2015-10-28 Qualcomm Technologies Inc Low power integrated circuit to analyze a digitized audio stream
KR101889836B1 (en) 2012-02-24 2018-08-20 삼성전자주식회사 Method and apparatus for cotrolling lock/unlock state of terminal through voice recognition
JP5814823B2 (en) * 2012-02-28 2015-11-17 京セラ株式会社 Mobile terminal, specific mode setting program, and specific mode setting method
US10276156B2 (en) 2012-02-29 2019-04-30 Nvidia Corporation Control using temporally and/or spectrally compact audio commands
US10134385B2 (en) 2012-03-02 2018-11-20 Apple Inc. Systems and methods for name pronunciation
US9483461B2 (en) 2012-03-06 2016-11-01 Apple Inc. Handling speech synthesis of content for multiple languages
WO2013162414A1 (en) * 2012-04-23 2013-10-31 Janovskiy Igor Vladimirovich Terminal for wireless voice communication
JP2013238935A (en) * 2012-05-11 2013-11-28 Sharp Corp Input device, input device controlling method, controlling program, and recording medium
US9280610B2 (en) 2012-05-14 2016-03-08 Apple Inc. Crowd sourcing information to fulfill user requests
US9721563B2 (en) 2012-06-08 2017-08-01 Apple Inc. Name recognition system
US9495129B2 (en) 2012-06-29 2016-11-15 Apple Inc. Device, method, and user interface for voice-activated navigation and browsing of a document
US10157612B2 (en) 2012-08-02 2018-12-18 Nuance Communications, Inc. Methods and apparatus for voice-enabling a web application
US9781262B2 (en) * 2012-08-02 2017-10-03 Nuance Communications, Inc. Methods and apparatus for voice-enabling a web application
CN102883041A (en) * 2012-08-02 2013-01-16 聚熵信息技术(上海)有限公司 Voice control device and method for mobile terminal
US9292253B2 (en) 2012-08-02 2016-03-22 Nuance Communications, Inc. Methods and apparatus for voiced-enabling a web application
US9292252B2 (en) 2012-08-02 2016-03-22 Nuance Communications, Inc. Methods and apparatus for voiced-enabling a web application
US9400633B2 (en) * 2012-08-02 2016-07-26 Nuance Communications, Inc. Methods and apparatus for voiced-enabling a web application
CN103578472A (en) * 2012-08-10 2014-02-12 海尔集团公司 Method and device for controlling electrical equipment
CN103593081B (en) * 2012-08-17 2017-11-07 上海博泰悦臻电子设备制造有限公司 The control method of mobile unit and phonetic function
CN103593134B (en) * 2012-08-17 2018-01-23 上海博泰悦臻电子设备制造有限公司 The control method of mobile unit and phonetic function
US9576574B2 (en) 2012-09-10 2017-02-21 Apple Inc. Context-sensitive handling of interruptions by intelligent digital assistant
US9547647B2 (en) 2012-09-19 2017-01-17 Apple Inc. Voice-based media searching
JP6068901B2 (en) * 2012-09-26 2017-01-25 京セラ株式会社 Information terminal, voice operation program, and voice operation method
US8468023B1 (en) 2012-10-01 2013-06-18 Google Inc. Handsfree device with countinuous keyword recognition
JP6133564B2 (en) * 2012-10-05 2017-05-24 京セラ株式会社 Electronic device, control method, and control program
WO2014078980A1 (en) * 2012-11-20 2014-05-30 华为终端有限公司 Voice response method and mobile device
CN103871401B (en) * 2012-12-10 2016-12-28 联想(北京)有限公司 A kind of method of speech recognition and electronic equipment
CN103869948B (en) * 2012-12-14 2019-01-15 联想(北京)有限公司 Voice command processing method and electronic equipment
CN110889265A (en) 2012-12-28 2020-03-17 索尼公司 Information processing apparatus, information processing method, and computer program
AU2014214676A1 (en) 2013-02-07 2015-08-27 Apple Inc. Voice trigger for a digital assistant
KR102057629B1 (en) * 2013-02-19 2020-01-22 엘지전자 주식회사 Mobile terminal and method for controlling of the same
US9734819B2 (en) * 2013-02-21 2017-08-15 Google Technology Holdings LLC Recognizing accented speech
US20140244273A1 (en) * 2013-02-27 2014-08-28 Jean Laroche Voice-controlled communication connections
US10652394B2 (en) 2013-03-14 2020-05-12 Apple Inc. System and method for processing voicemail
US9368114B2 (en) 2013-03-14 2016-06-14 Apple Inc. Context-sensitive handling of interruptions
WO2014144579A1 (en) 2013-03-15 2014-09-18 Apple Inc. System and method for updating an adaptive speech recognition model
US9661136B2 (en) 2013-03-15 2017-05-23 Adesign Mobile device having function of controlling call connection in lock mode by using voice signal
AU2014233517B2 (en) 2013-03-15 2017-05-25 Apple Inc. Training an at least partial voice command system
US9582608B2 (en) 2013-06-07 2017-02-28 Apple Inc. Unified ranking with entropy-weighted information for phrase-based semantic auto-completion
WO2014197336A1 (en) 2013-06-07 2014-12-11 Apple Inc. System and method for detecting errors in interactions with a voice-based digital assistant
WO2014197334A2 (en) 2013-06-07 2014-12-11 Apple Inc. System and method for user-specified pronunciation of words for speech synthesis and recognition
WO2014197335A1 (en) 2013-06-08 2014-12-11 Apple Inc. Interpreting and acting upon commands that involve sharing information with remote devices
US10176167B2 (en) 2013-06-09 2019-01-08 Apple Inc. System and method for inferring user intent from speech inputs
CN110442699A (en) 2013-06-09 2019-11-12 苹果公司 Operate method, computer-readable medium, electronic equipment and the system of digital assistants
WO2014200731A1 (en) 2013-06-13 2014-12-18 Apple Inc. System and method for emergency calls initiated by voice command
GB2518002B (en) * 2013-09-10 2017-03-29 Jaguar Land Rover Ltd Vehicle interface system
US9508345B1 (en) 2013-09-24 2016-11-29 Knowles Electronics, Llc Continuous voice sensing
KR20150043807A (en) * 2013-10-15 2015-04-23 삼성전자주식회사 Image processing apparatus and control method thereof
US9532155B1 (en) 2013-11-20 2016-12-27 Knowles Electronics, Llc Real time monitoring of acoustic environments using ultrasound
CN104754203B (en) * 2013-12-31 2018-07-31 华为技术有限公司 Image pickup method, device and terminal
US9462169B2 (en) 2013-12-31 2016-10-04 Huawei Technologies Co., Ltd. Shooting method, apparatus, and terminal
KR20150086030A (en) * 2014-01-17 2015-07-27 엘지전자 주식회사 Mobile terminal and controlling method thereof
CN104917904A (en) * 2014-03-14 2015-09-16 联想(北京)有限公司 Voice information processing method and device and electronic device
US9437188B1 (en) 2014-03-28 2016-09-06 Knowles Electronics, Llc Buffered reprocessing for multi-microphone automatic speech recognition assist
US9620105B2 (en) 2014-05-15 2017-04-11 Apple Inc. Analyzing audio input for efficient speech and music recognition
US10592095B2 (en) 2014-05-23 2020-03-17 Apple Inc. Instantaneous speaking of content on touch devices
US9502031B2 (en) 2014-05-27 2016-11-22 Apple Inc. Method for supporting dynamic grammars in WFST-based ASR
US9430463B2 (en) 2014-05-30 2016-08-30 Apple Inc. Exemplar-based natural language processing
US9842101B2 (en) 2014-05-30 2017-12-12 Apple Inc. Predictive conversion of language input
US9734193B2 (en) 2014-05-30 2017-08-15 Apple Inc. Determining domain salience ranking from ambiguous words in natural speech
US9633004B2 (en) 2014-05-30 2017-04-25 Apple Inc. Better resolution when referencing to concepts
US10289433B2 (en) 2014-05-30 2019-05-14 Apple Inc. Domain specific language for encoding assistant dialog
US10078631B2 (en) 2014-05-30 2018-09-18 Apple Inc. Entropy-guided text prediction using combined word and character n-gram language models
US10170123B2 (en) 2014-05-30 2019-01-01 Apple Inc. Intelligent assistant for home automation
US9715875B2 (en) 2014-05-30 2017-07-25 Apple Inc. Reducing the need for manual start/end-pointing and trigger phrases
US9760559B2 (en) 2014-05-30 2017-09-12 Apple Inc. Predictive text input
TWI566107B (en) 2014-05-30 2017-01-11 蘋果公司 Method for processing a multi-part voice command, non-transitory computer readable storage medium and electronic device
US9785630B2 (en) 2014-05-30 2017-10-10 Apple Inc. Text prediction using combined word N-gram and unigram language models
EP2983065B1 (en) * 2014-06-11 2018-08-01 Huawei Technologies Co., Ltd. Method and terminal for quickly starting application service
US9338493B2 (en) 2014-06-30 2016-05-10 Apple Inc. Intelligent automated assistant for TV user interactions
US10659851B2 (en) 2014-06-30 2020-05-19 Apple Inc. Real-time digital assistant knowledge updates
KR20160016491A (en) * 2014-07-31 2016-02-15 삼성전자주식회사 Device and method for performing functions
WO2016017978A1 (en) * 2014-07-31 2016-02-04 Samsung Electronics Co., Ltd. Device and method for performing functions
US10446141B2 (en) 2014-08-28 2019-10-15 Apple Inc. Automatic speech recognition based on user feedback
US10044591B2 (en) 2014-09-04 2018-08-07 Home Box Office, Inc. Two-way remote communication system for testing a client device program
US9846496B2 (en) * 2014-09-04 2017-12-19 Home Box Office, Inc. Virtual input device system
RU2601152C2 (en) 2014-09-09 2016-10-27 ХЕРЕ Глобал Б.В. Device, method and computer program to provide information to user
US9818400B2 (en) 2014-09-11 2017-11-14 Apple Inc. Method and apparatus for discovering trending terms in speech requests
CN104267922B (en) * 2014-09-16 2019-05-31 联想(北京)有限公司 A kind of information processing method and electronic equipment
US10127911B2 (en) 2014-09-30 2018-11-13 Apple Inc. Speaker identification and unsupervised speaker adaptation techniques
US9668121B2 (en) 2014-09-30 2017-05-30 Apple Inc. Social reminders
US9646609B2 (en) 2014-09-30 2017-05-09 Apple Inc. Caching apparatus for serving phonetic pronunciations
US10074360B2 (en) 2014-09-30 2018-09-11 Apple Inc. Providing an indication of the suitability of speech recognition
US9886432B2 (en) 2014-09-30 2018-02-06 Apple Inc. Parsimonious handling of word inflection via categorical stem + suffix N-gram language models
US10552013B2 (en) 2014-12-02 2020-02-04 Apple Inc. Data detection
US10444977B2 (en) * 2014-12-05 2019-10-15 Verizon Patent And Licensing Inc. Cellphone manager
US9711141B2 (en) 2014-12-09 2017-07-18 Apple Inc. Disambiguating heteronyms in speech synthesis
US9865280B2 (en) 2015-03-06 2018-01-09 Apple Inc. Structured dictation using intelligent automated assistants
US9886953B2 (en) 2015-03-08 2018-02-06 Apple Inc. Virtual assistant activation
US9721566B2 (en) 2015-03-08 2017-08-01 Apple Inc. Competing devices responding to voice triggers
US10567477B2 (en) 2015-03-08 2020-02-18 Apple Inc. Virtual assistant continuity
US9899019B2 (en) 2015-03-18 2018-02-20 Apple Inc. Systems and methods for structured stem and suffix language models
CN106155504B (en) * 2015-03-26 2019-09-10 小米科技有限责任公司 Mould group awakening method and device
US9842105B2 (en) 2015-04-16 2017-12-12 Apple Inc. Parsimonious continuous-space phrase representations for natural language processing
US10083688B2 (en) 2015-05-27 2018-09-25 Apple Inc. Device voice control for selecting a displayed affordance
KR20160142528A (en) * 2015-06-03 2016-12-13 엘지전자 주식회사 Terminal device, network system and controlling method thereof
US10127220B2 (en) 2015-06-04 2018-11-13 Apple Inc. Language identification from short strings
US10101822B2 (en) 2015-06-05 2018-10-16 Apple Inc. Language input correction
US9578173B2 (en) 2015-06-05 2017-02-21 Apple Inc. Virtual assistant aided communication with 3rd party service in a communication session
US10186254B2 (en) 2015-06-07 2019-01-22 Apple Inc. Context-based endpoint detection
US10255907B2 (en) 2015-06-07 2019-04-09 Apple Inc. Automatic accent detection using acoustic models
US9407989B1 (en) 2015-06-30 2016-08-02 Arthur Woodrow Closed audio circuit
US10671428B2 (en) 2015-09-08 2020-06-02 Apple Inc. Distributed personal assistant
US10747498B2 (en) 2015-09-08 2020-08-18 Apple Inc. Zero latency digital assistant
US9697820B2 (en) 2015-09-24 2017-07-04 Apple Inc. Unit-selection text-to-speech synthesis using concatenation-sensitive neural networks
US10366158B2 (en) 2015-09-29 2019-07-30 Apple Inc. Efficient word encoding for recurrent neural network language models
US10691473B2 (en) 2015-11-06 2020-06-23 Apple Inc. Intelligent automated assistant in a messaging environment
US10049668B2 (en) 2015-12-02 2018-08-14 Apple Inc. Applying neural network language models to weighted finite state transducers for automatic speech recognition
US10223066B2 (en) 2015-12-23 2019-03-05 Apple Inc. Proactive assistance based on dialog communication between devices
JP2017146437A (en) * 2016-02-17 2017-08-24 本田技研工業株式会社 Voice input processing device
US10446143B2 (en) 2016-03-14 2019-10-15 Apple Inc. Identification of voice inputs providing credentials
US9934775B2 (en) 2016-05-26 2018-04-03 Apple Inc. Unit-selection text-to-speech synthesis based on predicted concatenation parameters
US9972304B2 (en) 2016-06-03 2018-05-15 Apple Inc. Privacy preserving distributed evaluation framework for embedded personalized systems
US10249300B2 (en) 2016-06-06 2019-04-02 Apple Inc. Intelligent list reading
US10049663B2 (en) 2016-06-08 2018-08-14 Apple, Inc. Intelligent automated assistant for media exploration
DK179588B1 (en) 2016-06-09 2019-02-22 Apple Inc. Intelligent automated assistant in a home environment
US10586535B2 (en) 2016-06-10 2020-03-10 Apple Inc. Intelligent digital assistant in a multi-tasking environment
US10192552B2 (en) 2016-06-10 2019-01-29 Apple Inc. Digital assistant providing whispered speech
US10067938B2 (en) 2016-06-10 2018-09-04 Apple Inc. Multilingual word prediction
US10490187B2 (en) 2016-06-10 2019-11-26 Apple Inc. Digital assistant providing automated status report
US10509862B2 (en) 2016-06-10 2019-12-17 Apple Inc. Dynamic phrase expansion of language input
DK179415B1 (en) 2016-06-11 2018-06-14 Apple Inc Intelligent device arbitration and control
DK179049B1 (en) 2016-06-11 2017-09-18 Apple Inc Data driven natural language event detection and classification
DK201670540A1 (en) 2016-06-11 2018-01-08 Apple Inc Application integration with a digital assistant
DK179343B1 (en) 2016-06-11 2018-05-14 Apple Inc Intelligent task discovery
US20180039478A1 (en) * 2016-08-02 2018-02-08 Google Inc. Voice interaction services
US10261752B2 (en) * 2016-08-02 2019-04-16 Google Llc Component libraries for voice interaction services
US10474753B2 (en) 2016-09-07 2019-11-12 Apple Inc. Language identification using recurrent neural networks
US10043516B2 (en) 2016-09-23 2018-08-07 Apple Inc. Intelligent automated assistant
JP6613382B2 (en) 2016-10-27 2019-11-27 株式会社Nttドコモ Communication terminal device, program, and information processing method
US10593346B2 (en) 2016-12-22 2020-03-17 Apple Inc. Rank-reduced token representation for automatic speech recognition
CN106683675A (en) * 2017-02-08 2017-05-17 张建华 Control method and voice operating system
US10355931B2 (en) * 2017-04-17 2019-07-16 Essential Products, Inc. Troubleshooting voice-enabled home setup
US10353480B2 (en) 2017-04-17 2019-07-16 Essential Products, Inc. Connecting assistant device to devices
CN106910503A (en) * 2017-04-26 2017-06-30 海信集团有限公司 Method, device and intelligent terminal for intelligent terminal display user's manipulation instruction
US10417266B2 (en) 2017-05-09 2019-09-17 Apple Inc. Context-aware ranking of intelligent response suggestions
DK201770383A1 (en) 2017-05-09 2018-12-14 Apple Inc. User interface for correcting recognition errors
DK201770439A1 (en) 2017-05-11 2018-12-13 Apple Inc. Offline personal assistant
US10395654B2 (en) 2017-05-11 2019-08-27 Apple Inc. Text normalization based on a data-driven learning network
DK179496B1 (en) 2017-05-12 2019-01-15 Apple Inc. USER-SPECIFIC Acoustic Models
DK201770432A1 (en) 2017-05-15 2018-12-21 Apple Inc. Hierarchical belief states for digital assistants
US10403278B2 (en) 2017-05-16 2019-09-03 Apple Inc. Methods and systems for phonetic matching in digital assistant services
US10303715B2 (en) 2017-05-16 2019-05-28 Apple Inc. Intelligent automated assistant for media exploration
US10311144B2 (en) 2017-05-16 2019-06-04 Apple Inc. Emoji word sense disambiguation
DK179549B1 (en) 2017-05-16 2019-02-12 Apple Inc. Far-field extension for digital assistant services
US10657328B2 (en) 2017-06-02 2020-05-19 Apple Inc. Multi-task recurrent neural network architecture for efficient morphology handling in neural language modeling
CN107544827A (en) * 2017-08-23 2018-01-05 金蝶软件(中国)有限公司 The method and relevant apparatus of a kind of funcall
US10445429B2 (en) 2017-09-21 2019-10-15 Apple Inc. Natural language understanding using vocabularies with compressed serialized tries
US10755051B2 (en) 2017-09-29 2020-08-25 Apple Inc. Rule-based natural language processing
CN207199277U (en) * 2017-10-11 2018-04-06 京东方科技集团股份有限公司 A kind of display device
US10636424B2 (en) 2017-11-30 2020-04-28 Apple Inc. Multi-turn canned dialog
US10733982B2 (en) 2018-01-08 2020-08-04 Apple Inc. Multi-directional dialog
US10733375B2 (en) 2018-01-31 2020-08-04 Apple Inc. Knowledge-based framework for improving natural language understanding
US10592604B2 (en) 2018-03-12 2020-03-17 Apple Inc. Inverse text normalization for automatic speech recognition
DK179822B1 (en) 2018-06-01 2019-07-12 Apple Inc. Voice interaction at a primary device to access call functionality of a companion device
DK201870382A1 (en) 2018-06-01 2020-01-13 Apple Inc. Attention aware virtual assistant dismissal
US20190371316A1 (en) 2018-06-03 2019-12-05 Apple Inc. Accelerated task performance

Family Cites Families (89)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS6237734A (en) * 1985-08-12 1987-02-18 Matsushita Electric Ind Co Ltd Instruction selector
JPH05341951A (en) * 1992-06-11 1993-12-24 Toshiba Comput Eng Corp Voice input operation unit
JP3725566B2 (en) * 1992-12-28 2005-12-14 東芝デジタルメディアエンジニアリング株式会社 Speech recognition interface
US5452289A (en) * 1993-01-08 1995-09-19 Multi-Tech Systems, Inc. Computer-based multifunction personal communications system
CA2115210C (en) 1993-04-21 1997-09-23 Joseph C. Andreshak Interactive computer system recognizing spoken commands
FI981154A (en) 1998-05-25 1999-11-26 Nokia Mobile Phones Ltd Voice identification procedure and apparatus
KR20010024521A (en) 1998-08-17 2001-03-26 이데이 노부유끼 Speech recognizing device and method, navigation device, portable telephone, and information processor
US6965863B1 (en) * 1998-11-12 2005-11-15 Microsoft Corporation Speech recognition user interface
US7881936B2 (en) * 1998-12-04 2011-02-01 Tegic Communications, Inc. Multimodal disambiguation of speech recognition
US6233560B1 (en) * 1998-12-16 2001-05-15 International Business Machines Corporation Method and apparatus for presenting proximal feedback in voice command systems
CN1143503C (en) * 1998-12-30 2004-03-24 三星电子株式会社 Method for voice dialing of mobile telephone terminal
US6519479B1 (en) * 1999-03-31 2003-02-11 Qualcomm Inc. Spoken user interface for speech-enabled devices
US6434527B1 (en) * 1999-05-17 2002-08-13 Microsoft Corporation Signalling and controlling the status of an automatic speech recognition system for use in handsfree conversational dialogue
US6931384B1 (en) * 1999-06-04 2005-08-16 Microsoft Corporation System and method providing utility-based decision making about clarification dialog given communicative uncertainty
US6622119B1 (en) * 1999-10-30 2003-09-16 International Business Machines Corporation Adaptive command predictor and method for a natural language dialog system
US7725307B2 (en) * 1999-11-12 2010-05-25 Phoenix Solutions, Inc. Query engine for processing voice based queries including semantic decoding
GB2358987B (en) 2000-02-01 2003-10-29 Ericsson Telefon Ab L M Electronic devices
US6895380B2 (en) * 2000-03-02 2005-05-17 Electro Standards Laboratories Voice actuation with contextual learning for intelligent machine control
US6934684B2 (en) * 2000-03-24 2005-08-23 Dialsurf, Inc. Voice-interactive marketplace providing promotion and promotion tracking, loyalty reward and redemption, and other features
JP2001296881A (en) * 2000-04-14 2001-10-26 Sony Corp Device and method for information processing and recording medium
US6587824B1 (en) * 2000-05-04 2003-07-01 Visteon Global Technologies, Inc. Selective speaker adaptation for an in-vehicle speech recognition system
CA2413657A1 (en) * 2000-06-16 2001-12-20 Healthetech, Inc. Speech recognition capability for a personal digital assistant
US20080154601A1 (en) * 2004-09-29 2008-06-26 Microsoft Corporation Method and system for providing menu and other services for an information processing system using a telephone or other audio interface
US6658386B2 (en) * 2000-12-12 2003-12-02 International Business Machines Corporation Dynamically adjusting speech menu presentation style
JP3919210B2 (en) * 2001-02-15 2007-05-23 アルパイン株式会社 Voice input guidance method and apparatus
GB2372864B (en) * 2001-02-28 2005-09-07 Vox Generation Ltd Spoken language interface
US20020152071A1 (en) * 2001-04-12 2002-10-17 David Chaiken Human-augmented, automatic speech recognition engine
JP2003241790A (en) 2002-02-13 2003-08-29 Internatl Business Mach Corp <Ibm> Speech command processing system, computer device, speech command processing method, and program
US7398209B2 (en) * 2002-06-03 2008-07-08 Voicebox Technologies, Inc. Systems and methods for responding to natural language speech utterance
EP1400953B1 (en) * 2002-09-12 2013-03-20 me2me AG Method for building speech and/or language recognition models
US20070186480A1 (en) * 2002-11-22 2007-08-16 Brian Freeman Automatic door control system
US6993482B2 (en) * 2002-12-18 2006-01-31 Motorola, Inc. Method and apparatus for displaying speech recognition results
KR100668297B1 (en) * 2002-12-31 2007-01-12 삼성전자주식회사 Method and apparatus for speech recognition
US7333803B2 (en) * 2004-01-20 2008-02-19 Lucent Technologies Inc. Network support for voice-to-text memo service
US20050177373A1 (en) * 2004-02-05 2005-08-11 Avaya Technology Corp. Methods and apparatus for providing context and experience sensitive help in voice applications
US20090164215A1 (en) * 2004-02-09 2009-06-25 Delta Electronics, Inc. Device with voice-assisted system
US20050197843A1 (en) * 2004-03-07 2005-09-08 International Business Machines Corporation Multimodal aggregating unit
KR100617711B1 (en) 2004-06-25 2006-08-28 삼성전자주식회사 Method for initiating voice recognition in wireless terminal
US8942985B2 (en) * 2004-11-16 2015-01-27 Microsoft Corporation Centralized method and system for clarifying voice commands
US7376645B2 (en) * 2004-11-29 2008-05-20 The Intellection Group, Inc. Multimodal natural language query system and architecture for processing voice and proximity-based queries
CN100521707C (en) 2004-12-24 2009-07-29 深圳市金立通信设备有限公司 Control method of handset with sound controlled dialing function
US8185399B2 (en) * 2005-01-05 2012-05-22 At&T Intellectual Property Ii, L.P. System and method of providing an automated data-collection in spoken dialog systems
US7437297B2 (en) * 2005-01-27 2008-10-14 International Business Machines Corporation Systems and methods for predicting consequences of misinterpretation of user commands in automated systems
US8200495B2 (en) * 2005-02-04 2012-06-12 Vocollect, Inc. Methods and systems for considering information about an expected response when performing speech recognition
US7640160B2 (en) * 2005-08-05 2009-12-29 Voicebox Technologies, Inc. Systems and methods for responding to natural language speech utterance
CA2618626C (en) * 2005-08-09 2016-10-18 Stephen S. Burns A voice controlled wireless communication device system
US7620549B2 (en) * 2005-08-10 2009-11-17 Voicebox Technologies, Inc. System and method of supporting adaptive misrecognition in conversational speech
US8265939B2 (en) * 2005-08-31 2012-09-11 Nuance Communications, Inc. Hierarchical methods and apparatus for extracting user intent from spoken utterances
JP2007065347A (en) * 2005-08-31 2007-03-15 Denso Corp Speech recognition system
US7693716B1 (en) * 2005-09-27 2010-04-06 At&T Intellectual Property Ii, L.P. System and method of developing a TTS voice
US20070112571A1 (en) * 2005-11-11 2007-05-17 Murugappan Thirugnana Speech recognition at a mobile terminal
JP2007142840A (en) * 2005-11-18 2007-06-07 Canon Inc Information processing apparatus and information processing method
EP1969456A4 (en) * 2005-12-12 2015-11-04 Tegic Comm Llc Mobile device retrieval and navigation
JP4755918B2 (en) * 2006-02-22 2011-08-24 東芝テック株式会社 Data input device and method, and program
KR100735820B1 (en) * 2006-03-02 2007-07-06 삼성전자주식회사 Speech recognition method and apparatus for multimedia data retrieval in mobile device
JP4809101B2 (en) 2006-03-31 2011-11-09 京セラ株式会社 Mobile communication terminal and program
JP2007280179A (en) * 2006-04-10 2007-10-25 Mitsubishi Electric Corp Portable terminal
US8121838B2 (en) * 2006-04-11 2012-02-21 Nuance Communications, Inc. Method and system for automatic transcription prioritization
US20080233937A1 (en) 2006-05-08 2008-09-25 Marja-Leena Nurmela Mobile communication terminal and method
US7774202B2 (en) * 2006-06-12 2010-08-10 Lockheed Martin Corporation Speech activated control system and related methods
US8150383B2 (en) 2006-06-20 2012-04-03 Telefonaktiebolaget Lm Ericsson (Publ) Arrangement and method for controlling service activation on a mobile terminal
KR100783105B1 (en) 2006-08-22 2007-12-07 삼성전자주식회사 Apparatus and method for telecommunication in phone with voice recognition technology
US7957972B2 (en) * 2006-09-05 2011-06-07 Fortemedia, Inc. Voice recognition system and method thereof
KR100774927B1 (en) 2006-09-27 2007-11-09 엘지전자 주식회사 Mobile communication terminal, menu and item selection method using the same
KR20080032842A (en) 2006-10-11 2008-04-16 삼성전자주식회사 Electronic device having flat display panel
US20080091426A1 (en) * 2006-10-12 2008-04-17 Rod Rempel Adaptive context for automatic speech recognition systems
US7904298B2 (en) * 2006-11-17 2011-03-08 Rao Ashwin P Predictive speech-to-text input
JP4471128B2 (en) * 2006-11-22 2010-06-02 セイコーエプソン株式会社 Semiconductor integrated circuit device, electronic equipment
US20090192898A1 (en) * 2006-11-29 2009-07-30 E-Meal, Llc Remote Ordering System
US20080154612A1 (en) * 2006-12-26 2008-06-26 Voice Signal Technologies, Inc. Local storage and use of search results for voice-enabled mobile communications devices
US8880405B2 (en) * 2007-03-07 2014-11-04 Vlingo Corporation Application text entry in a mobile environment using a speech processing facility
US7870000B2 (en) * 2007-03-28 2011-01-11 Nuance Communications, Inc. Partially filling mixed-initiative forms from utterances having sub-threshold confidence scores based upon word-level confidence data
EP1976255B1 (en) * 2007-03-29 2015-03-18 Intellisist, Inc. Call center with distributed speech recognition
JP4412504B2 (en) * 2007-04-17 2010-02-10 本田技研工業株式会社 Speech recognition apparatus, speech recognition method, and speech recognition program
US7809664B2 (en) * 2007-12-21 2010-10-05 Yahoo! Inc. Automated learning from a question and answering network of humans
US8099289B2 (en) * 2008-02-13 2012-01-17 Sensory, Inc. Voice interface and search for electronic devices including bluetooth headsets and remote systems
US7917368B2 (en) * 2008-02-25 2011-03-29 Mitsubishi Electric Research Laboratories, Inc. Method for interacting with users of speech recognition systems
US20090234655A1 (en) * 2008-03-13 2009-09-17 Jason Kwon Mobile electronic device with active speech recognition
US8958848B2 (en) * 2008-04-08 2015-02-17 Lg Electronics Inc. Mobile terminal and menu control method thereof
KR20090107365A (en) * 2008-04-08 2009-10-13 엘지전자 주식회사 Mobile terminal and its menu control method
KR101466027B1 (en) * 2008-04-30 2014-11-28 엘지전자 주식회사 Mobile terminal and its call contents management method
KR101462930B1 (en) * 2008-04-30 2014-11-19 엘지전자 주식회사 Mobile terminal and its video communication control method
KR101462932B1 (en) * 2008-05-28 2014-12-04 엘지전자 주식회사 Mobile terminal and text correction method
KR100988397B1 (en) * 2008-06-09 2010-10-19 엘지전자 주식회사 Mobile terminal and text correcting method in the same
US8600762B2 (en) * 2008-06-12 2013-12-03 Lg Electronics Inc. Mobile terminal and method for recognizing voice thereof
KR101502003B1 (en) * 2008-07-08 2015-03-12 엘지전자 주식회사 Mobile terminal and method for inputting a text thereof
KR20100007625A (en) * 2008-07-14 2010-01-22 엘지전자 주식회사 Mobile terminal and method for displaying menu thereof
US8412531B2 (en) * 2009-06-10 2013-04-02 Microsoft Corporation Touch anywhere to speak
US9263034B1 (en) * 2010-07-13 2016-02-16 Google Inc. Adapting enhanced acoustic models

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2013047968A1 (en) * 2011-09-26 2013-04-04 Lg Electronics Inc. User interface method and device
US9613623B2 (en) 2011-09-26 2017-04-04 Lg Electronics Inc. User interface method and device comprising repeated output of an audible signal and a visual display and vibration for user notification
US10261566B2 (en) 2013-01-07 2019-04-16 Samsung Electronics Co., Ltd. Remote control apparatus and method for controlling power
KR101331122B1 (en) * 2013-03-15 2013-11-19 주식회사 에이디자인 Method for connecting call in mbile device
WO2014142431A1 (en) * 2013-03-15 2014-09-18 주식회사 에이디자인 Method for connecting call when received on mobile device
WO2016117774A1 (en) * 2015-01-20 2016-07-28 Lg Electronics Inc. Mobile terminal and method for controlling the same

Also Published As

Publication number Publication date
RU2008126782A (en) 2010-01-10
EP2109298B1 (en) 2017-11-22
JP2009252238A (en) 2009-10-29
EP2109298A1 (en) 2009-10-14
CN101557651A (en) 2009-10-14
US20090254351A1 (en) 2009-10-08
RU2394386C2 (en) 2010-07-10
JP5481058B2 (en) 2014-04-23
US20120130712A1 (en) 2012-05-24
US8560324B2 (en) 2013-10-15
CN101557651B (en) 2012-12-12
US8150700B2 (en) 2012-04-03

Similar Documents

Publication Publication Date Title
US9900414B2 (en) Mobile terminal and menu control method thereof
US9430082B2 (en) Electronic device for executing different functions based on the touch patterns using different portions of the finger and control method thereof
US8560324B2 (en) Mobile terminal and menu control method thereof
EP2846256A2 (en) Mobile terminal and method for controlling the same
US9509959B2 (en) Electronic device and control method thereof
US9465794B2 (en) Terminal and control method thereof
CN102446060B (en) The method of mobile terminal and control mobile terminal
EP2261784B1 (en) Mobile terminal and method of displaying information in mobile terminal
KR100969790B1 (en) Mobile terminal and method for synthersizing contents
KR101961139B1 (en) Mobile terminal and method for recognizing voice thereof
EP2065786B1 (en) Mobile terminal and key input method thereof
US20130331152A1 (en) Mobile terminal and control method thereof
EP2549723B1 (en) Mobile terminal and method of controlling the same
KR20140141269A (en) Mobile terminal and controlling method thereof
US8423087B2 (en) Mobile terminal with touch screen and method of processing message using the same
KR101012379B1 (en) Terminal and method of displaying information therein
KR101574117B1 (en) Mobile Terminal and Method Of Executing Call Function Using Same
EP2114073B1 (en) Mobile terminal and method for controlling video call thereof
DE202013012304U1 (en) Mobile terminal
KR101467758B1 (en) Terminal and method of controlling broadcasting therein
US8473297B2 (en) Mobile terminal
US9665268B2 (en) Mobile terminal and control method thereof
KR101562582B1 (en) Mobile terminal using flexible lcd and picture enlarging method thereof
KR101510484B1 (en) Mobile Terminal And Method Of Controlling Mobile Terminal
KR101495164B1 (en) Mobile terminal and method for processing screen thereof

Legal Events

Date Code Title Description
A201 Request for examination
AMND Amendment
E902 Notification of reason for refusal
AMND Amendment
E90F Notification of reason for final refusal
AMND Amendment
E601 Decision to refuse application
J201 Request for trial against refusal decision
AMND Amendment
B601 Maintenance of original decision after re-examination before a trial
J301 Trial decision

Free format text: TRIAL DECISION FOR APPEAL AGAINST DECISION TO DECLINE REFUSAL REQUESTED 20150515

Effective date: 20160222