KR101426949B1 - Apparatus and method for performing random function processing natural language in mobile terminal - Google Patents

Abstract

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to a portable terminal, and more particularly to a portable terminal for processing a natural language. The present invention relates to a method and apparatus for performing an arbitrary function using a natural language in a portable terminal, Extracting an object name included in the character data, grasping a command of the input character data using the extracted object name, searching for a function of the portable terminal corresponding to the command of the recognized character data, and performing .

Natural language, mobile terminal, robot remote control

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an apparatus and a method for processing a natural language in a mobile terminal to perform an arbitrary function,

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to a portable terminal, and more particularly to a portable terminal for processing a natural language.

Generally, a user selects a menu according to a procedure (hereinafter referred to as a UI scenario) provided by a user interface (UI) (hereinafter, referred to as UI) Function.

Here, the portable terminal is a portable terminal that provides a specific function such as a remote control function of a robot as well as a portable terminal that provides a call function and various functions. Various functions of the portable terminal can be a phone book function, an electronic notebook function, a music playback function, a camera function, a home appliance control function, and a robot control function.

The mobile terminals having different types provide different UIs, and thus perform specific functions of the mobile terminal through different UI scenarios. Here, the UI scenario differs depending on the type of portable terminal, and is composed of a combination of key signals generated according to the key input of the user. For example, when the portable terminal is changed from the first portable terminal to the second portable terminal, the user must be aware of the UI scenario of the second portable terminal to perform various functions of the second portable terminal.

As the processing speed of the processor gradually increases due to the development of the semiconductor industry and the memory capacity increases, the functions provided by the mobile terminal are increasing. For example, the portable terminal is equipped with a bluetooth function to listen to music through a wireless headphone, and has a DMB (Digital Multimedia Broadcasting) function to view a TV program while moving.

Accordingly, when the user changes the portable terminal, the UI scenarios of the portable terminal need to be recognized. In addition, when the user performs a specific function of the portable terminal, there is an inconvenience in selecting a plurality of menus according to the UI scenario. Also, as the various functions provided by the portable terminal increase, UI scenarios to be recognized by users also increase.

Accordingly, the present invention provides an apparatus and method for minimally recognizing a UI scenario of a replaced portable terminal when the user is replacing the portable terminal.

The present invention provides an apparatus and method for performing a specific function without selecting a plurality of menus when a user performs a specific function of the portable terminal.

In addition, the present invention provides an apparatus and method for minimizing a UI scenario that a user should recognize even if various functions provided by a portable terminal are increased.

In order to solve the above problems, there is provided a method of processing a natural language in a portable terminal to perform an arbitrary function, the method comprising: receiving, when character data is input, a knowledge base which is a set of data for processing the natural language, Extracts an object name included in the inputted character data, grasps the command of the input character data by using the extracted object name, and performs a function of the portable terminal corresponding to the command of the recognized character data And searching for and performing the search.

In order to solve the above-described problem, an apparatus for processing a natural language in a portable terminal, the apparatus comprising: a memory unit for storing a knowledge base, which is a set of data for natural language analysis; Extracts an object name from the input character data by analyzing the inputted character data based on the knowledge base and a natural language analysis method, grasps the command of the inputted character data by using the extracted object name, A natural language processing unit for searching for a function of the portable terminal corresponding to the identified character data command and a control unit for outputting the character data received from the outside to the natural language processing unit and performing the function of the searched portable terminal .

Accordingly, the present invention minimally recognizes the UI scenario of the replaced portable terminal when the user changes the portable terminal, and when the user performs a specific function of the portable terminal, performs a specific function without selecting a plurality of menus And it is possible to minimize the UI scenario that the user must recognize even though various functions provided by the portable terminal are increased.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the following description, well-known functions or constructions are not described in detail since they would obscure the invention in unnecessary detail.

1 is a block diagram of a portable terminal according to a preferred embodiment of the present invention. 1, the portable terminal includes a control unit 101, a radio unit 103, a baseband processing unit 105, a sound processing unit 107, a natural language processing unit 109, a key input unit 111, a memory unit 115 And a display unit 117. [0033]

The radio unit 103 includes an RF (Radio Frequency) transmitter for up-converting and amplifying the frequency of a transmitted signal, an RF receiver for low-noise amplifying the received signal and down-converting the frequency of the received signal . In particular, in the present invention, the wireless unit 103 receives a short message or a multimedia message from any portable terminal or transmits a control signal for controlling any of the devices. For example, when the portable terminal provides the home appliance control function and the robot control function, the radio section 103 transmits the home appliance control signal or the robot control signal to the home appliance or the robot in accordance with the control of the control section 101 .

The baseband processing unit 105 includes a transmitter for encoding and modulating a transmitted signal and a receiver for demodulating and decoding the received signal. The sound processing unit 107 converts the sound signal output from the control unit 101 into an audible sound and outputs the audible sound. The key input unit 111 includes numeric keys (a special key including a * key and a # key) for a call function of the portable terminal and function keys for various functions. The key input unit 111 generates a key signal corresponding to a key pressed by the user, (101).

The display unit 117 displays the current state and the operation state of the portable terminal under the control of the control unit 101 and may be generally composed of an LCD (Liquid Crystal Display) or an OLED (Organic Light Emitting Diodes). The memory unit 115 stores data necessary for controlling the portable terminal. In particular, in the present invention, the memory unit 115 includes a knowledge base storage unit 113 for storing a knowledge base. Here, the knowledge base is data accumulated by arranging the character data necessary for natural language processing in a certain format, and may include the ota correction learning data, the spacing error learning data, the object name learning data, and the user dictionary. At this time, the misrecognition learning data is a set of character data necessary for correcting a typographical error of externally inputted character data, and the spacing error learning data is a set of character data necessary for correcting an error in spacing of externally input character data And the object name learning data is a set of character data necessary for extracting the object name from the character data input from the outside. The user dictionary is a set of character data pre-inputted by the user.

The natural language processing unit 109 analyzes the character data input by the user or the character data included in the message under the control of the control unit 101 and grasps the command of the character data. 2, the natural language processing unit 109 includes a character correction unit 201, a character analysis unit 203, an output presentation unit 205, a behavior unit, a result notification unit 209, And a presentation adjustment unit 215.

The character corrector 201 detects a mistake in typing and spacing errors in the input character data using the knowledge base stored in the knowledge base storage unit 113 and corrects the detected errors and spacing errors . For example, when the character data is 'Hong Gil Dong or a number', the character correcting unit 201 can correct 'Hong Gil Dong or a number' to 'Hong Gil Dong phone number'.

The character analyzing unit 203 receives the corrected character data from the character correcting unit 201 and analyzes the corrected character data in units of morpheme, extracts the object name, and stores the extracted object name in the character data using the extracted object name (Hereinafter referred to as the intention of the character data) of the user. For example, when the character data inputted from the character correcting unit 201 is 'What is the phone number of Hong Gil Dong', the character analyzing unit 203 obtains 'What is the phone number of Hong Gil Dong' You can do morpheme analysis with number> <> <what> + <i> + <y>>. Then, the character analyzing unit 203 analyzes the morpheme analyzed 'Hong Gi-dong> <phone> + <number> <a> <what> + <i> + < WHAT 'can be extracted. Then, the character analyzing unit 203 can analyze the intention of the character data having the Request_FindPhoneNumberof ("Hongdong") in the extracted object name 'Hong Kil Dong: PERSON, Phone Number: PHONE NUMBER, WHAT'.

The output presentation unit 205 receives the intent of the character data analyzed by the character analysis unit 203 and changes the intention of the inputted character data to a specific format using a predetermined character data analysis field.

3, the 315 character data analysis field includes a DOMAIN field 301, an OPERATION field 303, a CATEGORY field 305, and a WHERE field. Field 307 and a DATE TIME field 311, a name PERSON field 311 and a title TITLE field 313.

The domain field 301 includes' DEVICE ',' HOME_NETWORK ',' ROBOT ', and' ETC '. The' DEVICE 'or' Any one of 'HOME_NETWORK', 'ROBOT' or 'ETC' is selected. In this case, 'DEVICE' is selected when the command subject of the character data is the portable terminal itself, 'HOME_NETWORK' is selected when the command subject of the character data is household appliances, 'ROBOT' 'ETC' is selected when the subject of the character data does not correspond to either 'DEVICE' or 'HOME_NETWORK' or 'ROBOT'.

The operation field 303 is composed of 'CALL', 'FIND', 'REGISTER', 'REMOVE', 'UPDATE', 'CONNECTION' and 'ETC' Any one of 'CALL', 'FIND' or 'REGISTER' or 'REMOVE', 'UPDATE', or 'CONNECTION' or 'ETC' is selected. Here, 'CALL' is selected when performing a call connection function, 'FIND' is selected when searching for arbitrary data, and 'REGISTER' is selected when registering character data. 'REMOVE' is selected when random data is removed, 'UPDATE' is selected when performing an update function, and 'CONNECTION' is selected when connecting to an external device (home appliance or robot). And 'ETC' is selected when the purpose contained in the command of the character data is neither CALL nor FIND or REGISTER or REMOVE, UPDATE or CONNECTION.

The category field 305 is composed of 'NUMBER', 'SCHEDULE', 'MEMORIAL DAY' and 'ETC', and may be 'NUMBER' or 'SCHEDULE' or 'MEMORIAL DAY' Any one of 'ETC' is selected. Here, 'NUMBER' is selected when the command of the character data is related to the telephone number, 'SCHEDULE' is selected when the command of the character data is related to schedule, and 'MEMORIAL DAY' Is selected. And 'ETC' is selected when the category included in the command of the character data does not correspond to any of 'NUMBER', 'SCHEDULE', or 'MEMORIAL DAY'.

The location field 307 is composed of '{OBJECT_NAME}'. When an object name related to the place exists in the object name of the character data, the object name related to the place is recorded in '{OBJECT_NAME}'. Object names for places are not recorded in '{OBJECT_NAME}'. The appointment time field 309 is composed of '{OBJECT_NAME}'. When an object name related to the appointment time is present among the object names of the character data, the object name related to the appointment time is recorded in '{OBJECT_NAME}'. Object name is not recorded in appointment time in '{OBJECT_NAME}' when object name does not exist.

The name field 311 is composed of '{OBJECT_NAME}'. When an object name related to the name exists in the object name of the character data, the object name related to the name is recorded in '{OBJECT_NAME}'. Object names for names are not recorded in '{OBJECT_NAME}'. The title field 313 is composed of '{OBJECT_NAME}' and 'ETC'. When the object name of the title exists in the object name of the character data, the object name related to the title is recorded in {OBJECT_NAME} 'ETC' is selected when no object name exists. For example, the title may be a movie title, a book title, a drama title, and the like.

As described with reference to FIG. 3, the output presentation unit 205 extracts character data analysis fields corresponding to commands of the input character data among the character data analysis fields. The output presentation unit 205 expresses the inputted character data command as extracted character data analysis fields.

For example, when the command of the character data input from the character analyzing unit 203 is 'Request_FindPhoneNumberof' ("Hongdil"), the output presentation unit 205 generates a "Request_FindPhoneNumberof" ) 'Can be expressed as follows.

[DOMAIN] DEVICE

[OPERATION] FIND

[CATEGORY] NUMBER

[PERSON] Hong Gil Dong

The output presentation unit 205 grasps the command of the character data represented by the character data analysis fields and outputs the character data to the portable terminal 200 corresponding to the command of the character data recognized by using the creation unit 211 of the presentation adjustment unit 215. [ Quot;

The action unit 207 displays the function of the searched mobile terminal so that the user can check the result of analyzing the command of the character data after preparing the searched mobile terminal to perform the function of the searched mobile terminal. When a request to execute the function of the displayed portable terminal is input from the user, the behavior unit 207 uses the analysis unit 213 of the presentation adjustment unit 215 to convert the command of the character data into a code usable in the portable terminal And performs a function of the portable terminal according to the changed code. The result notification unit 209 notifies the user of the result of performing the function of the portable terminal. At this time, the result notification unit 209 notifies the user of the result of performing the function of the portable terminal through at least one of a pop-up window and a sound.

The presentation adjustment unit 215 includes a creation unit 211 and an analysis unit 213. Here, the creator 211 searches the functions of the specific portable terminal corresponding to the character data analysis fields in order to perform the function of the specific portable terminal corresponding to the character data analysis fields. The analysis unit 213 changes the functions of the displayed wireless terminal to codes that can be used in the wireless terminal, and performs functions of the wireless terminal according to the changed codes.

Referring back to FIG. 1, the control unit 101 controls each part of the portable terminal to perform various functions provided by the portable terminal. Particularly, in the present invention, the control unit 101 displays a character input window through which characters can be input through the display unit 117 when a user inputs a character input request. The control unit 101 generates character data corresponding to the key signals input from the user, closes the displayed character input window when the user requests termination of the character input, and outputs the generated character data to the natural language processing unit 109 do. The control unit 101 receives the message through the radio unit 103 and outputs the character data included in the message to the natural language processing unit 109 when the processing of the character data included in the message received from the user is requested .

4 is a flowchart illustrating a specific function of the portable terminal according to a natural language according to an exemplary embodiment of the present invention.

Referring to FIG. 4, in step 401, the mobile terminal determines whether a character input is requested from a user. If the character input is requested by the user, the portable terminal proceeds to step 403, and if the character input is not requested from the user, the portable terminal proceeds to step 419.

If it is determined in step 403 that the character input window is displayed, the mobile terminal generates character data according to the user's key input. If the character input window is requested to be terminated by the user, the character input window is closed do.

If it is determined in step 419 that the mobile terminal has received the text message, When the portable terminal receives the text message, the process proceeds to step 421, and if the text message is not received, step 401 is repeatedly performed. Here, the text message may be any message including character data, for example, a short message or a multimedia message.

If the mobile terminal proceeds to step 421, the mobile terminal checks whether or not the processing of the character data is requested from the user. The mobile terminal proceeds to step 405 if it is requested to process character data from the user, and repeats step 401 if it is not requested to process the character data.

In step 405, the mobile terminal corrects the misspelling of the character data using the ota correction learning data included in the knowledge base stored in the memory unit 115, and uses the space error learning data included in the knowledge base to generate character data And then proceeds to step 407. In step 407,

In step 407, the mobile terminal analyzes character data corrected for typos and spacing by morpheme units, and extracts object names referring to the user dictionary and object name learning data included in the knowledge base. Then, the portable terminal analyzes the intention of the character data using the extracted object names, and then proceeds to step 409.

In step 409, the mobile terminal searches character data analysis fields corresponding to the intent of the character data using the character data analysis fields, and recognizes the character data command using the retrieved character data analysis fields, and then proceeds to step 411.

In step 411, the portable terminal searches for the function of the portable terminal corresponding to the command of the character data, displays the function of the found portable terminal to check whether the intention analysis of the character data is correct, and then proceeds to step 413.

In step 413, the portable terminal determines whether the user performs the function of the displayed portable terminal. If the request is received from the user to perform the function of the displayed mobile terminal, the mobile terminal proceeds to step 415, and if the request to perform the displayed function of the mobile terminal is input,

In step 423, the portable terminal outputs the character data including the command of the character data to the user so that the character data can be edited. When the editing of the character data output by the user is completed, the mobile terminal proceeds to step 415.

In step 415, the portable terminal performs the function of the portable terminal corresponding to the command of the character data, and then proceeds to step 417. In step 417, the portable terminal notifies the user of the result of performing the function of the portable terminal. At this time, the portable terminal can notify the user of the result of performing the function of the portable terminal through at least one of a pop-up window and a sound.

By performing the above steps, the mobile terminal can recognize the command of the character data by processing the character data inputted from the user without going through the UI scenario, and can immediately perform the function of the mobile terminal corresponding to the detected command. Accordingly, the portable terminal can directly perform the function of the portable terminal corresponding to the character input of the user.

5 is an exemplary view of a screen displayed when the portable terminal according to an exemplary embodiment of the present invention performs a specific function of the portable terminal according to a natural language.

In FIG. 5, the 501 screen is a standby screen indicating that the portable terminal is in the idle mode. Here, the standby mode is a mode in which the portable terminal does not receive any signal from the outside, and the portable terminal in the standby mode does not perform any function of the portable terminal.

When a mobile terminal that is outputting a 501 screen as a standby screen requests a character input from a user, it outputs a screen such as a 507 screen and outputs a character corresponding to a user's key input to the character input window 505. When the end of the character input is requested from the user, the portable terminal closes the output character input window 505. For example, when a character input is requested from a user, the portable terminal outputs a character input window 505 and displays a phrase 'connect an animator' (503) to a character input window 505 output according to a user's key input Can be output. When the user requests termination of the character input, the portable terminal can close the character input window 505 in which the phrase &quot; Connect Any Bot "503 is output. Here, the ANYBOT refers to a robot designated in advance in the portable terminal, can communicate with the portable terminal, and can perform the ANYBOT function according to the control of the portable terminal.

The portable terminal analyzes character data generated corresponding to the key input of the user to grasp the command of the character data, and searches for the function of the specific portable terminal corresponding to the command of the recognized character data. Then, the portable terminal displays a window 509 for confirming whether or not the searched portable terminal performs a function, as shown in a screen 515.

For example, if character data including the phrase 'connect to an animated bot' is input, the portable terminal displays an 'Yes' 511 for confirming whether or not the animated robot is connected to the animated robot, And &quot; NO &quot; (513). &Lt; / RTI &gt;

Then, the portable terminal is informed by the user whether to perform the function of the searched portable terminal or not. At this time, if a request to perform the function of the mobile terminal searched by the user is input, the mobile terminal performs the function of the searched mobile terminal and outputs a window 517 showing the result of the search as a screen 519. [ For example, if 'YES' 511 is selected from the user on the 515 screen, the portable terminal can perform communication with the predetermined anybit. When the communication with the ANY Bot is established, the mobile terminal can display the window 517 including the phrase &quot; connected with ANYBOT &quot; Alternatively, if the communication with the ANYBOT is not established, the portable terminal can display a window containing the phrase &quot; not connected to ANYBOT. &Quot;

While the invention has been shown and described with reference to certain preferred embodiments thereof, it will be understood by those skilled in the art that various changes and modifications may be made therein without departing from the spirit and scope of the invention. For example, in the present invention, in order to perform a function of a specific portable terminal, a character is input directly from a user, character data corresponding to the input character is generated, and the function of the specific portable terminal corresponding to the generated character data is performed Respectively. However, when the portable terminal has a voice recognition unit (not shown), it receives voice from a user, generates character data according to the inputted voice, and can perform functions of a specific portable terminal corresponding to the generated character data have. Here, the voice recognition unit (not shown) converts the voice of the user into character data.

1 is a block diagram of a portable terminal according to an embodiment of the present invention;

2 is a block diagram of a natural language processing unit according to an embodiment of the present invention;

3 illustrates an example of a character data analysis field according to an embodiment of the present invention.

4 is a flowchart illustrating a specific function of a mobile terminal according to a natural language according to an exemplary embodiment of the present invention.

FIG. 5 is an exemplary view of a screen displayed when a mobile terminal performs a specific function of a mobile terminal according to a natural language according to an exemplary embodiment of the present invention. FIG.

Claims (21)

A method for processing a natural language in a mobile terminal to perform an arbitrary function, Extracting an object name included in the inputted character data by using a knowledge base and a natural language analysis method which are a set of data for processing the natural language, Recognizing an instruction of inputted character data; And searching for and executing a function of the portable terminal corresponding to the identified character data command. The method according to claim 1, Further comprising the step of notifying a user of the performed function of the portable terminal. 3. The method of claim 2, Wherein the notification uses at least one of a pop-up window and a sound. 3. The method of claim 2, Wherein the step of grasping the command of the input character data comprises correcting a mistyping and spacing of the input character data by using a knowledge base including the ota correction learning data, the spacing error learning data, and the object name learning data, Extracting at least one object name from the character data, And recognizing an instruction of the input character data using the extracted object name. 5. The method of claim 4, The searching and performing the functions of the portable terminal may include searching for functions of the portable terminal corresponding to the command of the recognized character data among various functions of the portable terminal, Notifying a user of the searched function of the portable terminal, Determining whether a function execution request to perform the function of the searched portable terminal is received from the user, And performing a function of the searched mobile terminal when the function execution request is received. 6. The method of claim 5, Outputting character data including a command of the detected character data when a non-performing request for not performing the function of the searched portable terminal is received from the user; Editing the output character data from the user; And re-searching and performing the functions of the portable terminal corresponding to the edited character data. The method according to claim 1, Wherein the character data is not generated according to a predetermined format but is generated according to a free format. 8. The method of claim 7, The character data includes at least one of character data generated corresponding to a key input of a user, character data included in a text message received from another portable terminal, and character data generated corresponding to a user's voice signal input The method comprising the steps of: The method according to claim 1, The various functions of the portable terminal include at least one of a communication function, an electronic organizer function, a music reproducing function, a camera function, a home appliance control function, a robot remote control function, an internet function, and a digital broadcast receiving function. The method comprising: An apparatus for processing a natural language in a portable terminal to perform an arbitrary function, A memory unit for storing a knowledge base which is a set of data for natural language analysis; Extracting an object name from the input character data by analyzing the input character data based on the knowledge base and the natural language analysis method, and inputting the input character data A natural language processing unit for recognizing an instruction of the character data and searching for a function of the portable terminal corresponding to the command of the recognized character data, And a controller for outputting the character data received from the outside to the natural language processor and performing the function of the searched mobile terminal. 11. The method of claim 10, Wherein the controller informs the user of the function of the portable terminal. 12. The method of claim 11, Wherein the control unit informs the user of at least one of a pop-up window and a sound. 12. The method of claim 11, Wherein the memory unit stores a knowledge base including ota correction learning data, spacing error learning data, and object name learning data, Wherein the natural language processing unit corrects typographical and spacing of the inputted character data by using the otha correction learning data, the spacing error learning data, and the object name learning data when grasping the instruction of the input character data, Extracts at least one object name from the corrected character data, and grasps the command of the input character data using the extracted object name. 14. The method of claim 13, Wherein the natural language processing unit searches for a function of the portable terminal corresponding to the identified character data command among various functions of the portable terminal when searching for the function of the portable terminal. 15. The method of claim 14, The control unit notifies the user of the searched function of the portable terminal when performing the function of the portable terminal, and then checks whether or not a function execution request to perform the function of the searched portable terminal is received from the user And when the function execution request is received, performs the function of the searched terminal. 16. The method of claim 15, Wherein the control unit outputs character data including a command of the detected character data when receiving a non-performing request to perform the function of the searched portable terminal from the user, And performs a function of the portable terminal corresponding to the edited character data and re-searches the function of the portable terminal. 11. The method of claim 10, Wherein the character data is generated not according to a predetermined format but according to a free format. 18. The method of claim 17, Wherein the character data is at least one of character data generated corresponding to a key input of a user and character data included in a text message received from another portable terminal. 11. The method of claim 10, The various functions of the portable terminal include at least one of a communication function, an electronic organizer function, a music reproducing function, a camera function, a home appliance control function, a robot remote control function, an internet function, and a digital broadcast receiving function. Wherein the portable terminal is a portable terminal. 11. The method of claim 10, Further comprising a voice recognition unit for receiving a user's voice signal and converting the received voice signal into character data and outputting the converted character data to the control unit. 21. The method of claim 20, Wherein the character data is generated in correspondence with the voice signal of the user.

Images