KR101951417B1 - Mobile device and control method for the same - Google Patents

Abstract

The present invention provides a control method of a portable electronic device having a voice recognition function, comprising the steps of: receiving a voice command; acquiring a search query from the received voice command based on natural language processing; Obtaining a request result based on a database relating to the user context, and outputting the request result.

Description

TECHNICAL FIELD [0001] The present invention relates to a portable electronic device,

The present invention relates to a portable electronic device having a voice recognition function and a control method thereof.

The portable electronic device can be configured to perform various functions. Examples of such various functions include a data and voice communication function, a function of photographing a video or a moving image through a camera, a voice storage function, a music file playback function through a speaker system, and an image or video display function. Some portable electronic devices include additional functions to play games, and some other portable electronic devices are also implemented as multimedia devices. Moreover, recent portable electronic devices can receive a broadcast or multicast signal to view a video or television program.

Further, efforts for supporting and increasing the functions of the portable electronic device have been continued. Such efforts include not only changes and improvements in structural components that form portable electronic devices, but also improvements in software or hardware.

In response to these demands, recent portable electronic devices support voice recognition functions.

1

1 is a diagram showing an example of use of a portable electronic device having a voice recognition function.

Referring to FIG. 1, a user can instruct a portable electronic device 10 to perform a predetermined operation through voice.

The portable electronic device 10 stores data on voice commands. When the portable electronic device 10 receives the stored voice command from the user, the portable electronic device can perform a corresponding operation.

For example, the portable electronic device may store a voice command 'mother'. In addition, the voice command 'mother' may be an instruction to call the phone number of the mother item stored in the contact. Therefore, when the user inputs a voice command 'mother' to the portable electronic device, the portable electronic device can call the mother stored in the telephone directory.

As described above, the portable electronic device having the voice recognition function has a disadvantage in that it can perform a predetermined function only when a predetermined command is input.

The user would like to naturally input voice commands to the portable electronic device as if they were talking in daily life. However, the accuracy of speech command analysis using natural language processing is not high.

Accordingly, the present specification aims at providing measures to solve the above-mentioned problems.

Specifically, the present specification aims to provide a method for constructing a database relating to a user context.

It is another object of the present invention to provide a method for enhancing the accuracy of an unambiguous term analysis in order to enhance the accuracy of natural language processing.

It is another object of the present invention to provide a method for a portable electronic device to accurately perform an operation on a voice command by comparing a database of the user context with a search query by natural language processing.

It is also an object of the present invention to provide a method for allowing a natural language interpretation method to be changed based on a language pattern of a user.

A control method of a portable electronic device according to an aspect of the present invention is a control method of a portable electronic device having a voice recognition function, the method comprising: receiving a voice command; Acquiring a query, obtaining a request result based on the acquired search query and a database regarding a user context, and outputting the request result.

According to another aspect of the present invention, there is provided a control method of a portable electronic device, wherein the search query includes at least one of request information, time information, spatial information, companion information, context information, and movement information.

According to another aspect of the present invention, there is provided a method of controlling a portable electronic device, the method including setting a database, the database including at least one of photograph information, music information, AC information, application execution information, And / or information.

The control method of the portable electronic device according to another aspect of the present invention may further include the step of acquiring the request result acquiring the request result based on the acquired search query and the response from the web server .

According to another aspect of the present invention, a method for controlling a portable electronic device may include the step of acquiring the search query and changing at least one of time information and spatial information.

According to another aspect of the present invention, a method of controlling a portable electronic device may include the step of outputting a request result, the step of classifying the request result by priority, and the step of outputting the classified request result.

According to another aspect of the present invention, there is provided a method of controlling a portable electronic device, the method comprising the steps of: outputting the acquired time information; receiving a user input on the output time information; And changing the acquired time information based on one user input.

According to still another aspect of the present invention, there is provided a method for controlling a portable electronic device, the method comprising the steps of: outputting the acquired spatial information; receiving a user input of the output spatial information; And changing the step of changing the obtained spatial information based on one user input.

According to another aspect of the present invention, there is provided a method of controlling a portable electronic device, the method including storing a change history of the time information and the spatial information, wherein the step of acquiring the search query includes: May be obtained.

The control method of the portable electronic device according to still another aspect of the present invention may further include displaying the obtained search query.

A portable electronic device according to an aspect of the present invention includes a microphone for receiving a voice command, a search query obtaining unit for obtaining a search query from the received voice command based on natural language processing, and based on the obtained search query and a database on the user context A control unit for obtaining a request result, and an output unit for outputting the request result.

The portable electronic device according to another aspect of the present invention may include at least one of request information, time information, spatial information, companion information, context information, and movement information.

A portable electronic device according to another aspect of the present invention further includes a memory including a database, wherein the database includes at least one of picture information, music information, AC information, application execution information, web search information, . ≪ / RTI >

In the portable electronic device according to another aspect of the present invention, the controller may change at least one of time information and spatial information.

In the portable electronic device according to another aspect of the present invention, the memory stores a change history of the time information and the spatial information, and the control unit obtains a search query based on the change history.

Disclosure of the present invention solves the problems of the prior art described above.

Specifically, by the teachings of the present disclosure, it is possible to provide a user with a way to build a database of user contexts.

In addition, by the disclosure of the present specification, it is possible to provide a user with a method for enhancing the accuracy of an unclear term interpretation in order to increase the accuracy of natural language processing.

In addition, according to the disclosure of the present specification, the portable electronic device can provide the user with a method for accurately performing the operation on the voice command by comparing the database of the user context with the search query by natural language processing.

Further, by the disclosure of the present specification, it is possible to provide a method for allowing a user to change the interpretation method of the natural language based on the language pattern of the user.

1 is a diagram showing an example of use of a portable electronic device having a voice recognition function.
2 is a block diagram illustrating a portable electronic device according to an embodiment disclosed herein.
3 is a flowchart illustrating a control method of a portable electronic device according to an embodiment of the present invention.
4 is a diagram showing an example of a method of setting a database relating to a user context by a portable electronic device.
5 is a diagram showing another example of a method of setting a database relating to a user context by a portable electronic device.
6 is a diagram showing another example of a method of setting a database related to a user context by a portable electronic device.
7 is a diagram showing another example of a method of setting a database related to a user context by a portable electronic device.
8 is a diagram showing another example of a method of setting a database related to a user context by a portable electronic device.
9 is a diagram showing another example of a method of setting a database relating to a user context by a portable electronic device.
10 is a diagram illustrating an example of a method for a portable electronic device to obtain a search query from a received voice command and obtain a request result based on the obtained search query and a database related to the user context.
11 is a view showing another example of a method for a portable electronic device to acquire a search query from a received voice command and acquire a request result based on the acquired search query and a database related to the user context.
12 is a diagram illustrating another example of a method for a portable electronic device to obtain a search query from a voice command received and obtain a request result based on the acquired search query and a database related to the user context.
13 is a view showing another example of a method for a portable electronic device to obtain a search query from a voice command received and obtain a request result based on the obtained search query and a database relating to the user context.
14 is a diagram showing another example of a method for a portable electronic device to obtain a search query from a voice command received and obtain a request result based on the obtained search query and a database regarding the user context.
15 is a view showing another example of a method for a portable electronic device to obtain a search query from a received voice command and acquire a request result based on the acquired search query and a database related to the user context.
16 is a diagram showing an example of a method of outputting a request result acquired by the portable electronic device.
17 is a diagram showing another example of a method of outputting a request result acquired by the portable electronic device.
18 is a diagram showing an example of a method by which a portable electronic device changes information contained in a search query.

It is noted that the technical terms used herein are used only to describe specific embodiments and are not intended to limit the invention. It is also to be understood that the technical terms used herein are to be interpreted in a sense generally understood by a person skilled in the art to which the present invention belongs, Should not be construed to mean, or be interpreted in an excessively reduced sense. Further, when a technical term used herein is an erroneous technical term that does not accurately express the spirit of the present invention, it should be understood that technical terms that can be understood by a person skilled in the art are replaced. In addition, the general terms used in the present invention should be interpreted according to a predefined or prior context, and should not be construed as being excessively reduced.

Also, the singular forms "as used herein include plural referents unless the context clearly dictates otherwise. In the present application, the term " comprising " or " comprising " or the like should not be construed as necessarily including the various elements or steps described in the specification, Or may be further comprised of additional components or steps.

Also, suffixes "module", "unit" and "part" for the components used in the present specification are given or mixed in consideration of ease of specification, and each component having its own distinct meaning or role no.

Furthermore, terms including ordinals such as first, second, etc. used in this specification can be used to describe various elements, but the elements should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings, wherein like reference numerals refer to like or similar elements throughout the several views, and redundant description thereof will be omitted.

In the following description, well-known functions or constructions are not described in detail since they would obscure the invention in unnecessary detail. It is to be noted that the accompanying drawings are only for the purpose of facilitating understanding of the present invention, and should not be construed as limiting the scope of the present invention with reference to the accompanying drawings.

The portable electronic device described in this specification may include a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), navigation and the like.

However, it will be readily apparent to those skilled in the art that the configuration according to the embodiments described herein may be applied to fixed terminals such as a digital TV, a desktop computer, and the like, except when applicable only to portable electronic devices.

2

2 is a block diagram illustrating a portable electronic device according to an embodiment disclosed herein.

The portable electronic device 100 includes a wireless communication unit 110, an A / V input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, An interface unit 170, a control unit 180, a power supply unit 190, and the like. The components shown in Fig. 2 are not essential, and a portable electronic device having components having more or fewer components may be implemented.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more modules that enable wireless communication between the portable electronic device 100 and the wireless communication system or between the portable electronic device 100 and the network in which the portable electronic device 100 is located . For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short range communication module 114, and a location information module 115 .

The broadcast receiving module 111 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel.

The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may refer to a server for generating and transmitting broadcast signals and / or broadcast related information, or a server for receiving broadcast signals and / or broadcast related information generated by the broadcast management server and transmitting the generated broadcast signals and / or broadcast related information. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

The broadcast-related information may refer to a broadcast channel, a broadcast program, or information related to a broadcast service provider. The broadcast-related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.

The broadcast-related information may exist in various forms. For example, an EPG (Electronic Program Guide) of DMB (Digital Multimedia Broadcasting) or an ESG (Electronic Service Guide) of Digital Video Broadcast-Handheld (DVB-H).

For example, the broadcast receiving module 111 may be a Digital Multimedia Broadcasting-Terrestrial (DMB-T), a Digital Multimedia Broadcasting-Satellite (DMB-S), a Media Forward Link Only And a Digital Broadcasting System (ISDB-T) (Integrated Services Digital Broadcast-Terrestrial). Of course, the broadcast receiving module 111 may be adapted to other broadcasting systems as well as the digital broadcasting system described above.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 transmits and receives radio signals to at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data depending on a voice call signal, a video call signal or a text / multimedia message transmission / reception.

The mobile communication module 112 is configured to implement a video communication mode and a voice communication mode. The video call mode refers to a state of talking while viewing a video of the other party, and the voice call mode refers to a state in which a call is made without viewing the other party's video. In order to implement the video communication mode and the voice communication mode, the mobile communication module 112 is configured to transmit and receive at least one of voice and image.

The wireless Internet module 113 refers to a module for wireless Internet access, and may be built in or enclosed in the portable electronic device 100. WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) and the like can be used as wireless Internet technologies.

The short-range communication module 114 refers to a module for short-range communication. Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and the like can be used as a short range communication technology.

The position information module 115 is a module for acquiring the position of the portable electronic device, and a representative example thereof is a GPS (Global Position System) module.

Referring to FIG. 2, an A / V (Audio / Video) input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame can be displayed on the display unit 151. [

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. [ Two or more cameras 121 may be provided depending on the use environment.

The microphone 122 receives an external sound signal through a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 when the voice data is in the call mode, and output. Various noise reduction algorithms may be implemented in the microphone 122 to remove noise generated in receiving an external sound signal. Also, the microphone 122 may receive a voice command from a user.

The user input unit 130 generates input data for a user to control the operation of the terminal. The user input unit 130 may include a key pad, a dome switch, a touch pad (static / static), a jog wheel, a jog switch, and the like.

The sensing unit 140 senses the position of the portable electronic device 100 such as the open / closed state of the portable electronic device 100, the position of the portable electronic device 100, the presence or absence of user contact, the orientation of the portable electronic device, And generates a sensing signal for controlling the operation of the portable electronic device 100. For example, when the portable electronic device 100 is in the form of a slide phone, it is possible to sense whether the slide phone is opened or closed. It is also possible to sense whether the power supply unit 190 is powered on, whether the interface unit 170 is connected to an external device, and the like. Meanwhile, the sensing unit 140 may include a proximity sensor 141.

The output unit 150 may include a display unit 151, an audio output module 152, an alarm unit 153, and a haptic module 154, for example, for generating output related to visual, auditory, have.

The display unit 151 displays (outputs) information to be processed by the portable electronic device 100. For example, when the portable electronic device is in the call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with the call is displayed. When the portable electronic device 100 is in the video communication mode or the photographing mode, the photographed and / or received video or UI and GUI are displayed. The display unit may display a server connectable to the portable electronic device. The display unit may display the search result when receiving a search result for the content from the server. In addition, the display unit may display various guide windows related to the search reservation including the search reservation guide window.

The display unit 151 may be a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display display, a 3D display, and an e-ink display.

Some of these displays may be transparent or light transmissive so that they can be seen through. This can be referred to as a transparent display, and a typical example of the transparent display is TOLED (Transparent OLED) and the like. The rear structure of the display unit 151 may also be of a light transmission type. With this structure, the user can see the object located behind the terminal body through the area occupied by the display unit 151 of the terminal body.

There may be two or more display units 151 according to the embodiment of the portable electronic device 100. [ For example, in the portable electronic device 100, a plurality of display portions may be spaced apart from one another or integrally disposed, or may be disposed on different surfaces, respectively.

(Hereinafter, referred to as a 'touch screen') in which a display unit 151 and a sensor for sensing a touch operation (hereinafter, referred to as 'touch sensor') form a mutual layer structure, It can also be used as an input device. The touch sensor may have the form of, for example, a touch film, a touch sheet, a touch pad, or the like.

The touch sensor may be configured to convert a change in a pressure applied to a specific portion of the display unit 151 or a capacitance generated in a specific portion of the display unit 151 into an electrical input signal. The touch sensor can be configured to detect not only the position and area to be touched but also the pressure at the time of touch.

If there is a touch input to the touch sensor, the corresponding signal (s) is output to the touch controller. The touch controller processes the signal (s) and transmits the corresponding data to the controller 180. Thus, the control unit 180 can know which area of the display unit 151 is touched or the like.

Referring to FIG. 2, proximity sensors 141 may be disposed in an inner area of the portable electronic device to be wrapped by the touch screen or in the vicinity of the touch screen. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or a nearby object without mechanical contact using the force of an electromagnetic field or infrared rays. The proximity sensor has a longer life span than the contact sensor and its utilization is also high.

Examples of the proximity sensor include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. And to detect the proximity of the pointer by the change of the electric field along the proximity of the pointer when the touch screen is electrostatic. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, the act of recognizing that the pointer is positioned on the touch screen while the pointer is not in contact with the touch screen is referred to as " proximity touch & The act of actually touching the pointer on the screen is called " contact touch. &Quot; The position where the pointer is proximately touched on the touch screen means a position where the pointer is vertically corresponding to the touch screen when the pointer is touched.

The proximity sensor detects a proximity touch and a proximity touch pattern (e.g., a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, a proximity touch movement state, and the like). Information corresponding to the detected proximity touch operation and the proximity touch pattern may be output on the touch screen.

The audio output module 152 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output module 152 also outputs sound signals related to functions (e.g., call signal reception tones, message reception tones, etc.) performed in the portable electronic device 100. [ The audio output module 152 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying the occurrence of an event of the portable electronic device 100. Examples of events that occur in portable electronic devices include call signal reception, message reception, key signal input, touch input, and the like. The alarm unit 153 may output a signal for notifying the occurrence of an event in a form other than the video signal or the audio signal, for example, vibration. The video signal or the audio signal may be output through the display unit 151 or the audio output module 152 so that they may be classified as a part of the alarm unit 153.

The haptic module 154 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 154 is vibration. The intensity and pattern of the vibration generated by the hit module 154 can be controlled. For example, different vibrations may be synthesized and output or sequentially output.

In addition to the vibration, the haptic module 154 may include a pin arrangement vertically moving with respect to the contact skin surface, a spraying force or a suction force of the air through the injection port or the suction port, a touch on the skin surface, contact with an electrode, And various tactile effects such as an effect of reproducing a cold sensation using an endothermic or exothermic element can be generated.

The haptic module 154 can be implemented not only to transmit the tactile effect through the direct contact but also to allow the user to feel the tactile effect through the muscular sensation of the finger or arm. The haptic module 154 may include two or more haptic modules 154 according to the configuration of the portable electronic device 100.

The memory 160 may store a program for the operation of the controller 180 and temporarily store input / output data (e.g., a phone book, a message, a still image, a moving picture, etc.). The memory 160 may store data on vibration and sound of various patterns outputted when a touch is input on the touch screen. Also, the memory 160 may store a database related to the user context. In addition, the memory 160 may store items related to change details such as time information and spatial information.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), a RAM (Random Access Memory), a static random access memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read- A disk, and / or an optical disk. The portable electronic device 100 may operate in connection with a web storage that performs a storage function of the memory 160 on the Internet.

The interface unit 170 serves as a pathway to all the external devices connected to the portable electronic device 100. The interface unit 170 receives data from an external device or supplies power to each component in the portable electronic device 100 or allows data in the portable electronic device 100 to be transmitted to an external device. For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port, A video input / output (I / O) port, an earphone port, and the like may be included in the interface unit 170.

The identification module is a chip for storing various information for authenticating the usage right of the portable electronic device 100 and includes a user identification module (UIM), a subscriber identity module (SIM) a universal subscriber identity module (USIM), and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the port.

When the portable electronic device 100 is connected to an external cradle, the interface unit 170 may be a path through which power from the cradle is supplied to the portable electronic device 100, Various command signals can be transmitted to the portable electronic device. The various command signals input from the cradle or the power source may be operated as a signal for recognizing that the portable electronic device is correctly mounted on the cradle.

The controller 180 typically controls the overall operation of the portable electronic device. For example, voice communication, data communication, video communication, and the like. The control unit 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the control unit 180 or may be implemented separately from the control unit 180. [

 In addition, the control unit 180 may perform a pattern recognition process for recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively. The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for operation of the respective components.

Also, the control unit 180 can acquire a search query from a voice command based on natural language processing. In addition, the controller 180 may control the predetermined operation to be performed based on the obtained search query and the database of the user context.

3

3 is a flowchart illustrating a control method of a portable electronic device according to an embodiment of the present invention.

Referring to FIG. 3, the portable electronic device can set a database related to a user context (S310).

Herein, information on when and what the portable electronic device 100 performed by the user and what data the portable electronic device 100 contains is referred to as a user context.

That is, when the portable electronic device 100 performs a predetermined function, the portable electronic device 100 can store contents related to the performance. The database related to the user context may include a photo database, a music database, an AC database, an application execution database, a web search database, a payment database, and the like.

The photo database refers to information stored when a portable electronic device performs a photographing operation or the like.

The music database refers to information stored when a portable electronic device performs a music reproduction function or the like.

The AC database refers to information stored when a portable electronic device performs a call reception / reception, a message transmission / reception, a schedule recording function, and the like.

The application execution database means information stored when the portable electronic device executes an arbitrary application.

The web search database refers to information stored when the portable electronic device executes a search for a keyword or the like through a web browser.

The payment database refers to information stored when the portable electronic device is used for a payment function.

4

4 is a diagram showing an example of a method of setting a database relating to a user context by a portable electronic device.

Referring to FIG. 4 (a), the portable electronic device 100 can perform a photographing function. At this time, the portable electronic device 100 can set the photo database 300-1.

Referring to FIG. 4 (b), the photo database 300-1 may include information on a photo file, time information, spatial information, schedule information, companion information, situation information, movement information, have.

The information contained in the photo database 300-1 can be automatically set by a function included in the portable electronic device 100. [ Or may be set based on additional information that the user has spoken or entered.

The information about the photo file 310 may include a file name (e.g., 001.JPG) for the image 210 photographed by the portable electronic device 100, and the like.

The time information 321 may include information on the time when the portable electronic device 100 took a picture. The time information 321 may be set using time information included in the portable electronic device 100. [

The space information 322 may include information on a position where the portable electronic device 100 has photographed the photograph. The spatial information 322 may be set by a location information module 115 included in the portable electronic device.

The schedule information 323 may include information about a schedule that has been in progress during a period in which the portable electronic device 100 has taken a photograph. The schedule information 323 may be set by recording data such as a schedule management program included in the portable electronic device.

The companion information 324 may include information about a person included in the image photographed by the portable electronic device 100. The companion information 324 may be set by recording data such as a schedule management program included in the portable electronic device. Alternatively, the companion information 324 may be set based on tag information added to the file at the time of storing the photo file.

The status information 325 may include information about a situation occurring at the time when the portable electronic device 100 was taking a picture. The status information 325 may be set based on the tag information added to the photo file when the photo file is stored.

The movement information 326 may include information as to whether or not the portable electronic device 100 is moving when the portable electronic device 100 is photographing. The movement information may be set based on a position change value by the position information module 115 included in the portable electronic device 100. [

The other information 326 may include additional information when necessary.

For example, referring to FIG. 4, the time information 321 may include a photographing date, time, etc. based on a time function included in the portable electronic device 100. The spatial information 322 may include information about a point at which a photograph was photographed, based on the position information module 115 included in the portable electronic device. In addition, the control unit 180 can extract a specific photographing place from the tag information that the user further inputs. For example, when the user adds the tag 'at the golden fish restaurant' to the photo file, the control unit 180 may include the information 'golden fish restaurant' in the spatial information 322. The schedule information 323 may include information such as 'Busy Travel' when the schedule management program of the portable electronic device 100 includes information 'Busan Travel Period'. The companion information 324 may set the companion information to 'withdraw' if the schedule management program of the portable electronic device 100 includes information of 'withdrawal and Busan trip period'. Alternatively, the control unit 180 may perform face recognition on a person included in the photograph to confirm the companion. The status information 325 may include information such as 'during a meal' when a user inputs a tag 'during meal' at the time of photographing. The movement information 326 may include information that the mobile terminal is not moving when the positional change by the GPS is not detected. The other information 327 may include information not previously used among the photo tag information input by the user.

5

5 is a diagram showing another example of a method of setting a database relating to a user context by a portable electronic device.

Referring to FIG. 5 (a), the portable electronic device 100 may perform a music playback function. At this time, the portable electronic device 100 can set the music database 300-2.

Referring to FIG. 5B, the music database 300-2 includes information 311 on a music file, information on a music genre 312, time information 321, space information 322, Information 323, companion information 324, situation information 325, movement information 326, other information 327, and the like.

The information included in the music database 300-2 can be automatically set by a function included in the portable electronic device 100. [ Or may be set based on additional information that the user has spoken or entered.

The information 311 on the music file may include a title (e.g., Good Bye) of a music file played back by the portable electronic device 100, and the like.

The genre information 312 may include a genre (e.g., ballad) for a music file played back by the portable electronic device 100. [

The time information 321 may include information on a time at which the portable electronic device 100 reproduces music.

The space information 322 may include information on a position at which the portable electronic device 100 reproduces music.

The schedule information 323 may include information about a schedule that has been in progress during a period in which the portable electronic device 100 reproduces music.

The companion information 324 may include information about a person who was present when the portable electronic device 100 reproduces music.

The status information 325 may include information about a situation occurring at the time when the portable electronic device 100 is playing music.

The movement information 326 may include information as to whether or not the portable electronic device 100 is moving when the portable electronic device 100 is playing music.

The other information 327 may include additional information when necessary.

For example, referring to FIG. 5, the portable electronic device 100 reproduces the music file 220. The title (Good bye) and genre (ballad) of the music file 220 to be reproduced may be included in the tag of the music file.

Therefore, the music file information 311 may include title information of the music file being reproduced based on the tag information of the music file. The genre information 312 may include genre information of the music file being reproduced based on the tag information of the music file.

On the other hand, each item of the music database can be set by the above-described method.

6

6 is a diagram showing another example of a method of setting a database related to a user context by a portable electronic device.

6 (a), the portable electronic device 100 can perform a call function. At this time, the portable electronic device 100 can set the AC database 300-3.

6B, the AC database 300-2 includes information 313 about an AC person, information about a communication method 314, time information 321, spatial information 322, Information 325, movement information 326, other information 327, and the like.

The information included in the AC database 300-3 can be automatically set by a function included in the portable electronic device 100. [ Or may be set based on additional information that the user has spoken or entered.

The information 313 about the contact person may include information about a person who has made contact via the portable electronic device 100, and the like. Referring to FIG. 6, since the user has made a communication with the mother at 06.12 pm, the contact information 313 may include information that the contact with 'mother' is established.

The information on the contact method may include information on how to contact the portable electronic device 100. Examples of how to make contact with another person using the portable electronic device 100 include telephone conversation, message sending and receiving, and the like. For example, referring to FIG. 6, since the user has made a communication with the mother at 06.12 pm, the information 313 on the contact method may include information that the user has made a 'telephone call'.

Alternatively, in the case of the subject person whom the user directly met, the AC database may set a record of having a direct meeting with the subject based on the schedule data of the schedule management program.

The method of setting the time information 321, the spatial information 322, the situation information 325, the movement information 326 and the other information 327 for the AC database is applicable similarly to the above-described method. Therefore, a detailed description thereof will be omitted.

7

7 is a diagram showing another example of a method of setting a database related to a user context by a portable electronic device.

Referring to FIG. 7 (a), the portable electronic device 100 can execute an arbitrary application 240. At this time, the portable electronic device 100 can set the application execution database 300-4.

7B, the application execution database 300-4 includes information 315 for an execution application, information 316 about an application genre, time information 321, spatial information 322, Schedule information 323, companion information 324, situation information 325, movement information 326, other information 327, and the like.

The information included in the application execution database 300-4 can be automatically set by a function included in the portable electronic device 100. [

The information 315 on the execution application may include information on the title of the application executed by the portable electronic device 100. [ Referring to FIG. 7, since the portable electronic device 100 executes a game application (Tetris) at 06.12 pm, the execution application information 315 may include a title for the executed application .

The genre information may include information on an application genre that the portable electronic device 100 is executing. For example, referring to FIG. 7, since the portable electronic device 100 executes a game application (Tetris) at 06.12 pm, the information 316 about the application genre includes information of a 'game application' can do.

A method of setting the time information 321, the spatial information 322, the schedule information 323, the companion information 324, the situation information 325, the movement information 326, and other information 327 for the application execution database Can be applied similarly to the above-described method. Therefore, a detailed description thereof will be omitted.

8

8 is a diagram showing another example of a method of setting a database related to a user context by a portable electronic device.

Referring to FIG. 8A, the portable electronic device 100 may perform a web search function. At this time, the portable electronic device 100 can set the web search database 300-5.

Referring to FIG. 8B, the web search database 300-5 includes information 317 on search keywords, time information 321, spatial information 322, schedule information 323, companion information 324, status information 325, movement information 326, other information 327, and the like.

The information included in the web search database 300-5 can be automatically set by a function included in the portable electronic device 100. [

The information 317 on the search keyword may include information on a keyword used when the web search is performed through the portable electronic device 100. [ Referring to FIG. 8, since the search has been performed through the search site at 06:12 pm with the search term 'one piece', the search keyword information 317 may store a search keyword 'one piece'.

The setting method of the time information 321, the spatial information 322, the schedule information 323, the companion information 324, the situation information 325, the movement information 326 and the other information 327 for the web search database Can be applied similarly to the above-described method. Therefore, a detailed description thereof will be omitted.

9

9 is a diagram showing another example of a method of setting a database relating to a user context by a portable electronic device.

Referring to FIG. 9A, the portable electronic device 100 may perform a payment function. At this time, the portable electronic device 100 can set the payment database 300-6.

Referring to FIG. 9B, the payment database 300-6 includes information on a payment object 318, payment method information 319, time information 321, space information 322, Information 323, companion information 324, situation information 325, movement information 326, other information 327, and the like.

The information contained in the payment database 300-6 can be automatically set by a function included in the portable electronic device 100. [ Or may be set based on additional information that the user has spoken or entered while executing another program. For example, the portable electronic device 100 can confirm the payment details of the user through the data recorded through the household part program.

The information on the payment object 318 may include information on a payment made through the portable electronic device 100 and the like. Alternatively, the payment object information 318 may include information about a payment product input to the portable electronic device 100. [ Referring to FIG. 9, since the user has paid for the China travel product using the mobile payment function at 06:12 pm, the payment subject information 318 may include information that the user paid for the China travel product.

The information on the payment method may include information on a payment method for the goods that the user made payment. The information on the payment method may be confirmed using a message, a household part program, or the like. Referring to FIG. 9, since the user has paid for the China travel product using the mobile payment function at 06:12 pm, the payment method information 319 may include information that the user has used mobile payment .

Alternatively, when the user records an object and method of payment in the portable electronic device 100 through a household part program or the like, the payment database may set a payment object and a method based on the household part program.

The setting method of the time information 321, the spatial information 322, the situation information 325, the movement information 326 and the other information 327 for the settlement database is applicable similarly to the above-described method. Therefore, a detailed description thereof will be omitted.

Meanwhile, according to an embodiment of the present invention, the portable electronic device can receive a voice command from a user (S320).

According to an embodiment of the present invention, since the portable electronic device 100 has a voice recognition function, the portable electronic device 100 can receive a voice command. In addition, the portable electronic device 100 can extract an action requested by the user from the voice command based on natural language processing.

Meanwhile, according to an embodiment of the present invention, the portable electronic device can acquire a search query from the received voice command based on natural language processing (S330). The search query is information used by the portable electronic device 100 to search for a predetermined data item from a database related to a user context. In addition, the search query may be information used by the portable electronic device 100 to search for a predetermined data item from a web server.

The search query may include request information, time information, spatial information, companion information, context information, movement information, and the like.

The request information may include information for determining which of the databases related to the user context is searched for. For example, when the request information includes information related to a photo file, the control unit 180 may search the photo database. If the request information includes information related to the execution of the application, the control unit 180 may search the application execution database.

Meanwhile, according to an embodiment of the present invention, the portable electronic device can obtain a request result based on the acquired search query and a database related to the user context (S340).

10

10 is a diagram illustrating an example of a method for a portable electronic device to obtain a search query from a received voice command and obtain a request result based on the obtained search query and a database related to the user context.

Referring to FIG. 10, the portable electronic device 100 may receive a voice command 400-1 of the form shown in FIG.

The voice command 400-1 is a command to display a photo file meeting a predetermined condition from a photo file stored in the portable electronic device 100. [

The portable electronic device 100 may extract the meaning of the command from the voice command 400-1 based on natural language processing.

In addition, the portable electronic device 100 may obtain the search queries 421-1, 422-1, 424-1, and 427-1 necessary for performing the voice command 400-1 from the voice command . The search query is information used by the portable electronic device 100 to search for a predetermined data item from a database related to a user context.

The portable electronic device 100 can display a photo file meeting a predetermined condition from a photo file stored in the portable electronic device 100. [ At this time, the predetermined condition may be determined by the search query acquired by the portable electronic device 100.

10, the portable electronic device 100 receives time information 421-1, spatial information 422-1, companion information 424-1, and other information from the voice command 400-1 427-1). ≪ / RTI > The retrieval query acquisition process may be performed based on natural language processing.

For example, the time information 421-1 may be determined by the phrase 'before' included in the voice command.

On the other hand, the word 'old' means past, but it is unclear what time it means before. Therefore, it is necessary that the time point at which such an ambiguous word implies becomes clear based on the user's context. A method for clarifying the meaning of an unambiguous word will be described later.

If the word 'old' is set to interpret 'old one year', the time information 421-1 may include 'one year old'.

Also, the companion information 424-1 may be determined by the phrase 'withdrawal' included in the voice command. That is, the companion information 424-1 may include information of 'withdrawal'.

In addition, the spatial information 422-1 can be determined by the phrase 'there' included in the voice command.

On the other hand, the word 'from there' means a predetermined point, but it is unclear which point it means. Therefore, the point at which such an ambiguous word implies needs to be clarified based on the context of the user. A method for clarifying the meaning of an unambiguous word will be described later.

If the word " from there " is set to be interpreted as a meaning of an 'area outside the predetermined area at the current position', the space information 422-1 is 'an area outside the predetermined area at the current position' Called Information.

Further, the other information 427-1 can be determined by the phrase 'birthday' included in the voice command. That is, the other information 424-1 may include information such as 'birthday'.

Then, the portable electronic device 100 can obtain search results matching the above conditions from the photo database using the search queries 421-1, 422-1, 424-1, and 427-1. Alternatively, the portable electronic device 100 may obtain search results that are similar to or partially identical to the conditions from the photo database using the search queries 421-1, 422-1, 424-1, and 427-1 . For example, when the time information is set to one year in the photo database, the space information is set to an area outside the predetermined area at the current position, the companion information is set to the withdrawal number, It is possible to acquire information on the set photo file.

The control unit 180 may display the photo file corresponding to the information on the display unit 151 based on the obtained information.

Meanwhile, the portable electronic device 100 may obtain a search result matching the above condition from the memory 160 using the search queries 421-1, 422-1, 424-1, and 427-1 .

11

11 is a view showing another example of a method for a portable electronic device to acquire a search query from a received voice command and acquire a request result based on the acquired search query and a database related to the user context.

Referring to FIG. 11, the portable electronic device 100 may receive a voice command 400-2 of the form shown in FIG.

The voice command 400-2 is an instruction to reproduce a music file meeting a predetermined condition from the music file that the portable electronic device 100 has reproduced.

The portable electronic device 100 can extract the meaning of the command from the voice command 400-2 based on natural language processing.

Also, the portable electronic device 100 may acquire search queries 421-2, 422-2, and 412-2 necessary for performing the voice command 400-2 from the voice command.

The portable electronic device 100 can reproduce a music file meeting a predetermined condition from the music file that the portable electronic device 100 has reproduced.

11, the portable electronic device 100 receives a voice command 400-2 including search time information 421-2, space information 422-2, and genre information 412-2 The query can be obtained.

The time information 421-2 can be determined by the phrase 'before' included in the voice command.

On the other hand, the word 'aka' means past, but it is unclear what time it means before. Therefore, it is necessary that the time point at which such an ambiguous word implies becomes clear based on the user's context. A method for clarifying the meaning of an unambiguous word will be described later.

If the word 'before' is set to be interpreted as '3 hours ago', the time information 421-2 may include '3 hours ago'.

In addition, the spatial information 422-2 may be determined by the phrase 'here' included in the voice command. That is, the spatial information 422-2 may include information of 'current location'. Here, the current position may be determined by the position information module 115 of the portable electronic device 100.

In addition, the genre information 412-2 can be determined by the phrase 'ballad music' included in the voice command. That is, the genre information 412-2 may include 'ballad' information.

Then, the portable electronic device 100 can obtain search results matching the above conditions from the photo database using the search queries 421-2, 422-2, and 412-2. For example, information on a music file in which time information is set to '3 hours ago' in the music database, space information is set to 'current position', and genre information is set to 'ballad' . Alternatively, the portable electronic device 100 can acquire information on a music file that is similar to or partially matches the condition from the music database using the search queries 421-2, 422-2, and 412-2 have.

The control unit 180 may output the music file corresponding to the information through the sound output module 152 based on the obtained information.

12

12 is a diagram illustrating another example of a method for a portable electronic device to obtain a search query from a voice command received and obtain a request result based on the acquired search query and a database related to the user context.

Referring to FIG. 12, the portable electronic device 100 may receive a voice command 400-3 of the form shown in FIG.

The voice command 400-3 is an instruction to search a person who has contacted through the portable electronic device 100 according to a predetermined condition.

The portable electronic device 100 can extract the meaning of the command from the voice command 400-3 based on natural language processing.

In addition, the portable electronic device 100 may acquire search queries 421-3 and 414-3 necessary for executing the voice command 400-3 from the voice command.

The portable electronic device 100 can search for a person who matches a predetermined condition from a person who has been contacted through the portable electronic device 100. [

Referring to FIG. 12, the portable electronic device 100 may obtain a search query including the time information 421-3 and the contact method 414-3 from the voice command 400-3.

The time information 421-3 may be determined by the phrase " night of first sight last year " included in the voice command.

In addition, the contact method 414-3 can be determined by the phrase 'telephone' included in the voice command.

The portable electronic device 100 can acquire search results matching the above conditions from the AC database using the search queries 421-3 and 414-3.

The control unit 180 may output the person information corresponding to the search result, based on the obtained search result.

Meanwhile, the portable electronic device 100 can search the Web server for the date of the first snow last year to specify the time of 'the first snowy night last year'. Alternatively, the portable electronic device can search for a tag 'first eye' among the data stored last year from the photo database. In this manner, the portable electronic device 100 can search for a predetermined condition using a plurality of databases, a web server, and the like.

13

13 is a view showing another example of a method for a portable electronic device to obtain a search query from a voice command received and obtain a request result based on the obtained search query and a database relating to the user context.

Referring to FIG. 13, the portable electronic device 100 may receive a voice command 400-4 of the form shown in FIG.

The voice command 400-4 is an instruction to search for an application matching a predetermined condition among the applications executed by the portable electronic device 100. [

The portable electronic device 100 can extract the meaning of the command from the voice command 400-4 based on natural language processing.

In addition, the portable electronic device 100 may acquire search queries 421-4, 426-4, and 416-4 necessary for executing the voice command 400-4 from the voice command.

The portable electronic device 100 can search for an application that matches a predetermined condition among the applications executed by the portable electronic device 100. [

Referring to FIG. 13, the portable electronic device 100 receives a voice command 400-4 including search time information 421-4, movement information 426-4, and genre information 416-4 The query can be obtained.

The time information 421-2 may be determined by the phrase 'last week' included in the voice command.

In addition, the movement information 426-4 can be determined by the phrase 'when going to Chuncheon' included in the voice command. Here, since the user wants to search for an application executed in 'Chuncheon Go', the movement information may be set to 'YES'.

In addition, the genre information 416-4 may be determined by the phrase 'game' included in the voice command. That is, the genre information 412-2 may include 'game' information.

Then, the portable electronic device 100 can obtain search results matching the above conditions from the application execution database using the search queries 421-4, 426-4, and 416-4. For example, if the time information in the application execution database is set to 'last week (for example, Feb. 1, 2012) from the current time point, movement information is set to' YES ' Can be obtained.

The control unit 180 may output the application information corresponding to the information based on the acquired information.

14

14 is a diagram showing another example of a method for a portable electronic device to obtain a search query from a voice command received and obtain a request result based on the obtained search query and a database regarding the user context.

Referring to FIG. 14, the portable electronic device 100 can receive a voice command 400-5 of the form shown in FIG.

The voice command 400-5 is an instruction to display a search result meeting a predetermined condition among web search results through the portable electronic device 100. [

The portable electronic device 100 can extract the meaning of the command from the voice command 400-5 based on natural language processing.

In addition, the portable electronic device 100 may obtain the search queries 421-5 and 417-5 necessary for performing the voice command 400-5 from the voice command.

The portable electronic device 100 may display a search result corresponding to a predetermined condition among web search results through the portable electronic device 100. [

Referring to FIG. 14, the portable electronic device 100 can obtain a search query including the time information 421-5 and the search keyword information 417-5 from the voice command 400-5.

The time information 421-5 may be determined by the phrase '' in the voice command ''.

On the other hand, the word 'aka' means past, but it is unclear what time it means before. Therefore, it is necessary that the time point at which such an ambiguous word implies becomes clear based on the user's context. A method for clarifying the meaning of an unambiguous word will be described later.

If the word 'before' is set to be interpreted as '3 hours ago', the time information 421-2 may include '3 hours ago'.

In addition, the search keyword information 417-5 may be determined by the phrase 'one-piece' included in the voice command. That is, the search keyword information 422-2 may include 'one piece' information.

The portable electronic device 100 can acquire a web search result matching the above condition from the web search database using the search queries 421-5 and 417-5. For example, the portable electronic device 100 can obtain a search result in which the time information is set to '3 hours ago' in the web search database and the search keyword information is set to 'One Piece'.

The control unit 180 may display information on the search result on the display unit 151 based on the obtained search result.

15

15 is a view showing another example of a method for a portable electronic device to obtain a search query from a received voice command and acquire a request result based on the acquired search query and a database related to the user context.

Referring to FIG. 15, the portable electronic device 100 may receive a voice command 400-6 of the form shown in FIG.

The voice command 400-6 is an instruction to display payment information conforming to a predetermined condition from the payment database included in the portable electronic device 100. [

The portable electronic device 100 can extract the meaning of the command from the voice command 400-6 based on natural language processing.

Also, the portable electronic device 100 may acquire a search query 424-6 necessary for executing the voice command 400-6 from the voice command.

The portable electronic device 100 can retrieve payment information that conforms to a predetermined condition from the payment database included in the portable electronic device 100. [

Referring to FIG. 15, the portable electronic device 100 may obtain a search query including companion information 424-6 from the voice command 400-6.

The companion information 424-6 may be determined by the phrase 'withdrawal' included in the voice command.

Then, the portable electronic device 100 can obtain a search result matching the condition from the payment database using the search query 424-6. For example, payment information in which the companion information is set to 'withdrawal' in the payment database can be obtained.

The control unit 180 may display the acquired payment information on the display unit 151.

At this time, the portable electronic device 100 can display the payment information in which the companion information is set to 'withdraw' in chronological order.

Meanwhile, according to an embodiment of the present invention, the portable electronic device 100 may include outputting the request result (S350).

16

16 is a diagram showing an example of a method of outputting a request result acquired by the portable electronic device.

In the example illustrated in FIG. 16A, it is assumed that a music database is set as described in FIG. 5, and a voice command as shown in FIG. 11 is received. It is also assumed that the position of the user is not changed.

11, the search query 421-2 matches the time information 321, the other search query 422-2 matches the spatial information, and The other search query 412-2 may match the genre information 312.

Therefore, the portable electronic device can acquire information on the music file (Good Bye.mp3) reproduced at 06:12 pm from the music database in response to the voice command 400-2. Then, the portable electronic device can reproduce the music file (Good Bye.mp3) corresponding to the voice command 400-2.

In the example described in FIG. 16B, it is assumed that a picture database is set as described in FIG. 4, and a voice command as shown in FIG. 10 is received.

10, the search queries 421-1, 424-1, 422-1, and 427-1 by the voice command and the photo database 300-1, Lt; / RTI >

Therefore, the portable electronic device can acquire information on the photo file (001.JPG) photographed on September 24, 2010 from the photo database in response to the voice command 400-1. Then, the portable electronic device can display the picture file (001.jpg) corresponding to the voice command (400-1).

17

17 is a diagram showing another example of a method of outputting a request result acquired by the portable electronic device.

Referring to FIG. 17A, according to an embodiment of the present invention, the portable electronic device 100 can display a plurality of music files corresponding to predetermined search queries 421, 422, and 412 have.

Also, the portable electronic device 100 can display the search queries 421, 422, and 412 used to display the output results on the display unit.

At this time, the number of search queries can be adjusted based on user input. For example, if the user wants more search results, the results by the two search queries 421, 422 may be displayed. Alternatively, a search result by one search query 421 may be displayed. That is, the user can adjust the number of search queries used in the search by inputting through the user input unit.

Alternatively, the portable electronic device 100 may preferentially display the search query on the display unit before displaying the output result. At this time, the user can input an incorrect item, an item to be corrected, and a correction content of the displayed search query to the portable electronic device 100. In addition, the portable electronic device 100 may perform the request of the user using the modified search query, thereby improving the accuracy and efficiency of the performance of the operation.

In addition, the portable electronic device 100 can display a plurality of output results on the display unit according to predetermined conditions. For example, among the output results conforming to the voice command, the output result likely to match the user's intention can be displayed on the upper side (see Fig. 17 (a)). For example, in the case where the items of the search query and the database are partially different, the priority can be set higher when the items of the search query and the database match.

In addition, the portable electronic device 100 can sequentially display the output result on the basis of a predetermined criterion (for example, music files reproduced close to the present time) (see Fig. 17 (b)).

Meanwhile, according to an embodiment of the present invention, the portable electronic device 100 can change a search query.

18

18 is a diagram showing an example of a method by which a portable electronic device changes information contained in a search query.

When the portable electronic device 100 acquires a search query based on a voice command, the search query may include uncertain information.

For example, when the phrase corresponding to the time information is expressed as 'before', 'before', 'before', etc., the question of how to interpret the phrase may be a problem. That is, the term 'aka' may mean 'one hour before' depending on the person, and it may not mean 'three hours ago'. Also, the term 'aka' may mean 'an hour ago' or '3 hours ago', depending on the situation.

Likewise, when the syntax corresponding to the spatial information is expressed as 'here', 'there', 'there', etc., it may be a problem how to interpret the syntax in detail.

This is because there are many individual differences in the range of time and space.

Therefore, it is necessary to introduce a method that can accurately interpret unambiguous words as described above.

According to an embodiment of the present invention, after the portable electronic device 100 outputs the request result, the portable electronic device 100 may receive a correction command through the user input unit (S810).

In the example described in Fig. 18, the music database is set as described in Fig. 5, a voice command as described in Fig. 11 is received, and the portable electronic device is played back three hours before It is assumed that a music file is played back.

When the music file is reproduced by the above process, when the user inputs a correction command (for example, " listen to music before that "), the portable electronic device 100 displays a time point (3 hours before) For example, five hours before) can be reproduced.

On the other hand, when receiving the modification command, the portable electronic device can change the search query (S820).

The portable electronic device 100 can be used in a process of interpreting an unambiguous word based on the change history of the search query. For example, if a user accumulates a lot of situations in which the word 'I' is interpreted in the sense of '5 hours ago', the portable electronic device 100 can interpret the word 'before' as '5 hours ago' .

As the situation data is continuously accumulated, the portable electronic device 100 can accurately predict the word indicating an unspecified point in time or a space.

Alternatively, when the portable electronic device 100 receives the voice command 400-2, the portable electronic device 100 can display the ballad music that was heard three hours ago in a first order (i.e., '3 hours I "). In addition, the portable electronic device 100 may simultaneously display music files reproduced before and after the time point. At this time, if the user selects music 1 hour ago, the criterion of 'aka' can be interpreted as being closer to '1 hour before' than '3 hours before'. When the selection is accumulated (the case where the user interprets '1 hour ago' when the word 'I' is used 'is accumulated), the portable electronic device 100 calculates the time corresponding to the word' To '1 hour before'.

This method is applicable to all unambiguous vocabularies representing time and space.

The above-described method according to the embodiment of the present invention can be used individually or in combination. Further, the steps constituting each embodiment can be used individually or in combination with the steps constituting the other embodiments.

In addition, the above-described method can be implemented in a recording medium readable by a computer or the like using, for example, software, hardware, or a combination thereof.

According to a hardware implementation, the methods described so far can be applied to various types of application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays processors, controllers, micro-controllers, microprocessors, and other electronic units for performing other functions.

According to a software implementation, the procedures and functions described herein may be implemented in separate software modules. The software modules may be implemented in software code written in a suitable programming language. The software code may be stored in a storage unit and executed by a processor.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It falls within the scope of the invention.

100: portable electronic device 110: wireless communication unit
120: A / V input unit 130: user input unit
140: sensing unit 150: output unit
160: memory 170: interface section
180: control unit 190: power supply unit

Claims (15)

A control method of a portable electronic device having a voice recognition function and collecting context information of a user related to a function to be performed and storing the collected context information in a database related to the performed function,
A voice command including request information for determining at least one of a specific time, a specific space, a specific person, and information related to a specific situation and a database required to be searched among a plurality of databases related to different functions in which the user context information is stored ;
Obtaining at least one search query corresponding to at least one of the specific time, the specific space, the specific person and the specific situation from the received voice command based on natural language processing;
Obtaining a request result based on the obtained at least one search query and a database determined based on the request information; And
And outputting the request result,
The step of obtaining the request result comprises:
Selecting any database corresponding to the request information from the plurality of databases; And
And acquiring, from the selected database, a search result including at least one context information corresponding to the at least one search query. 2. The method of claim 1,
The method of claim 1, further comprising moving information. The information processing apparatus according to claim 1,
A picture database for storing user context information related to picture information, a music database for storing user context information related to music information, an AC database for storing user context information related to AC information, user context information related to application execution information A web search database for storing user context information related to the web search information, and a payment database for storing user context information related to the payment information. 2. The method of claim 1, wherein obtaining the request result comprises:
And obtaining a request result based on a response from the web server to the obtained search query. 3. The method of claim 2, wherein obtaining the search query comprises:
And changing at least one of the time information and the space information. 2. The method according to claim 1,
Classifying the request results by priority; And
And outputting the classified request result to the portable electronic device. 6. The method of claim 5, wherein changing the time information comprises:
Outputting the acquired time information;
Receiving user input for the output time information; And
And changing the acquired time information based on the received user input. 6. The method of claim 5, wherein changing the spatial information comprises:
Outputting the acquired spatial information;
Receiving user input for the output spatial information; And
And changing the acquired spatial information based on the received user input. 6. The method of claim 5,
Further comprising storing a change history of the time information and the spatial information,
Wherein the obtaining of the search query comprises:
Further comprising the step of acquiring a search query based on the change history. delete A portable electronic device having a voice recognition function and collecting context information of a user related to a function to be performed and storing the collected context information in a database related to the performed function,
A voice command including request information for determining at least one of a specific time, a specific space, a specific person, and information related to a specific situation and a database required to be searched among a plurality of databases related to different functions in which the user context information is stored A microphone for receiving the microphone;
Obtaining at least one search query corresponding to at least one of the specific time, the specific space, the specific person and the specific situation from the received voice command based on the natural language processing, A control unit for obtaining a request result based on the database;
And an output unit for outputting the request result,
Wherein,
Selecting one database corresponding to the request information from the plurality of databases and obtaining a search result including at least one context information corresponding to the at least one search query from the selected database when the voice command is received Wherein the portable electronic device is a portable electronic device.

delete delete delete delete

Images