KR20030047153A - The New User Interface System and Method Using Voice Recognition for Electronic Devices that were controlled by Remote Controller or Keypad - Google Patents

Abstract

PURPOSE: A new user interface system and method of an electronic system employing voice recognition are provided to allow a user to control the interface system and method rapidly and conveniently. CONSTITUTION: A user interface system includes a voice transmitter(10), a memory(21), a voice recognition engine(22), a microcomputer(23), and a CPU(30) of an electronic system. The voice transmitter receives a voice command of a user to convert the voice command into an electric signal. The memory stores reference voice data previously learnt. The voice recognition engine compares the voice signal received from the voice transmitter with the reference voice data to recognize a user's command and transmits the recognized result. The microcomputer delivers a single command code allocated to each of functions of the electronic system to the electronic system according to the recognized result of the voice recognition engine. The CPU executes a function corresponding to the voice command.

Description

The New User Interface System and Method Using Voice Recognition for Electronic Devices that were controlled by Remote Controller or Keypad}

The present invention relates to a user interface system, and more particularly, to a new user interface method and an interface using the method, which are configured in a tree structure in order to control electronic devices so that functions processed in multiple stages can be processed at once with a single command. It's about the system.

Since the development of electronic devices such as AV systems including televisions and display devices, the remote controller (Remote Controller), which is a remote control device, has been dominantly used as a mediator between these devices and users. It is configured to execute basic functions by direct operation.

However, as the functions of digital electronic devices are gradually increased and advanced, power, volume control, channel change, and numbers are limited by the limitations of the remote control itself, such as the limit of the number of input buttons, the limit of the number of IR keys, and the miniaturization trend. In addition to the specific functions such as the one-touch function is extremely limited, and is designed to be executed in a multi-step manner by configuring the structure such as "menu" through a graphical user interface (Graphic User Interface). In other words, the field of user interface has been developed to be limited to the GUI only with respect to remote control operation, and it is impossible to escape the method of executing a multi-level system consisting of a tree structure when adding a new function.

1 is an embodiment of a television operation performed in a conventional multi-step.

If the user wants to adjust the brightness of the screen while watching TV, there is no input button on the remote to directly adjust the brightness of the screen. As shown in FIG. 1A, various menus are displayed, and in general, since a "screen" menu is located at the top of a television, the preset value of FIG. If you select one of the sub menus ('Normal', 'Natural' or Soft), the brightness is terminated, but if you want to adjust it arbitrarily, go to 'Custom' and select it (after about 3 seconds). Moving to and selecting the "Brightness" item among the detailed items displayed as 1c (about 3 seconds have elapsed), the brightness bar is displayed as shown in FIG. 1d so that the screen can be adjusted with the left and right arrow keys. Since it is not possible to select one or two levels of adjustment here, at least 3 ~ 5 adjustments (3 ~ 5 seconds have elapsed) are set to the user's desired brightness. It takes

Such multi-step functions are frequently shown in the case of digital television as shown in FIG. In the tens to hundreds of digital broadcasts, users can be classified by category ("movie", "news", "sports", "education", "drama", etc.) to reduce the inconvenience of searching for programs by channel. A method is used to make it easier to select a desired channel, which is also performed in multiple stages.

Therefore, in terms of user convenience and efficiency, there is an urgent need to escape the current user interface consisting of a combination of remote control and GUI.

In general, as the functions of a device increase, a tree structure map is formed to accommodate all of them. In other words, it is composed of more steps, and the use is cumbersome, and the increase of operation time results in useful functions of each device being ignored by the consumer.

This inconvenience comes from the assumption that the remote control having a limitation on the number and size of input keys is the only means of communication between the device and a person. The present invention provides an interface method that can be quickly and conveniently controlled by a user by improving an interface method, and an interface system using the method.

1 shows an example of a function executed in multiple stages in a conventional television.

2 is a diagram showing an example in which channel or program information retrieval is executed in multiple stages in a conventional digital television;

3 is a view showing the configuration of a user interface system according to the present invention.

4 is a flowchart illustrating a process of performing a function according to the present invention.

5 is a view showing an example of a sequential code combination for each function configured for each control path according to each function of a remote controller corresponding to an existing electronic device according to the present invention.

Figure 6 is a view showing an example of a functional single command code combination of the present invention.

7 and 8 show examples of a grouping of single command codes grouped by function of the present invention.

* Explanation of symbols for main parts of the drawings

1: user interface system 10: voice transmission unit

20: voice recognition unit 21: memory

22: voice recognition engine 23: micom

30: central processing unit in the electronic device 40: microphone

In order to achieve the above object, the user interface system of the present invention recognizes and recognizes a voice signal received from a voice transmission unit and a voice transmission unit that receive and convert a voice signal into an electrical signal and then minimize and transfer voice data. According to the results, the voice recognition unit outputs the data value according to the present invention, and the central processing unit in the electronic device for processing to receive data from the voice recognition unit to perform a function.

The user interface method of the present invention includes the steps of receiving and converting a user's voice into an electrical signal, comparing and searching the electrical voice signal with previously learned reference voice data, and recognizing a code value corresponding to the recognized result. The transmitting step comprises the step of performing a function according to the received control code value.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

3 is a configuration diagram of a user interface system 1 according to the present invention.

The voice transmission unit 10 receives the user's voice and converts it into an electrical signal to minimize the loss or noise of the voice signal, which will be described later through wired and wireless communication technologies such as RF communication, infrared communication, Bluetooth, or WLAN. Transmit to voice recognition unit. The voice transmission method of the voice transmission unit 10 is not limited to the above-described technologies, and any technology capable of transmitting by wire or wireless may be used. That is, the mobile phone and the headset may be used to transmit voice at a long distance, and the microphone 40 may be mounted to control the electronic device by giving a voice command at a short distance.

The voice recognition unit 20 recognizes the voice signal received from the voice transmission unit 10 and outputs preset data according to the present invention according to the recognition result. The voice recognition unit 20 may be implemented as an external type separated from the electronic device or embedded in the electronic device, and its configuration and output data value vary according to each case. That is, in the case of the external type, the voice recognition unit 20 compares the electric voice signal received from the memory 21 and the voice transfer unit 10 to store the pre-learned reference voice data with the reference voice data of the memory 21. In the method according to the present invention described below, the voice recognition engine 22 which recognizes and outputs a recognition result ID and the voice recognition unit 20 when power is supplied and receive the recognition result of the voice recognition engine 22 are received. The microcomputer 23 transmits preset data for each function, and the central processing unit 30 in the electronic device performs the function of the electronic device according to the data received from the microcomputer 23 of the voice recognition unit 20. Process as much as possible. In the case of the built-in type, the functions of the memory 21 and the voice recognition engine 22 are the same as those of the external type, except that the function of the microcomputer 23 is absorbed and performed by the central processing unit 30 in the electronic device. That is, the central processing unit 30 performs system initialization of the electronic device including the voice recognition engine 22, immediately receives a recognition result from the voice recognition engine 22, and executes a function corresponding to the received recognition result. do. The function of the central processing unit 30 of the present invention may be configured and operate differently according to each embodiment described later. Each embodiment of this invention is described below in detail.

The reference voice data stored in the memory 21 may be stored by learning a voice of a specific user (speaker dependent) or by learning (speaker independent) a plurality of unspecified voices. Function-specific commands can facilitate user convenience by constructing one or more intuitive commands that are commonly known for a single function. For example, when turning the device on or off, in addition to the term "power", build commands such as "on", "off", "on", and "off". In recognition, the speech recognition technology itself uses a conventional speech recognition technology, and thus description thereof will be omitted.

4 is a flowchart illustrating a process of processing functions made in multiple steps in one step using the user interface system 1 according to the present invention.

First, the user gives a voice command to the voice transmitting unit 10 (step 401).

The voice transmitting unit 10 converts the received voice into an electrical signal and transmits the received voice to the voice recognition engine 22 using a wired or wireless communication technology such as RF communication, infrared communication, Bluetooth, or wireless LAN (step 402). .

The speech recognition engine 22 compares the received speech signal with the reference speech data stored in the memory 21 and recognizes it (step 403), and then transfers the recognition result to the microcomputer 23, and the microcomputer 23 recognizes it. Upon receiving the result, a series of code values for the corresponding function are transmitted, and the central processing unit 30 in the electronic device processes to perform the corresponding function according to the code value received from the microcomputer 23 (step 404). Subsequently, it is determined whether additional command input is required (step 405), and if a subsequent command is required, it waits (step 406) to receive the input and executes the function (step 407). To exit. For example, in the case of the "Brightness" command, when the "Brightness control bar" is displayed on the screen, the user needs to input additional brightness adjustment value to complete the function. Therefore, the user waits for the next command and recognizes when the user increases or decreases the brightness of the screen. After adjustment, it is finished.

The above is a function processing process when the voice recognition unit 20 is an external type, and when the voice recognition unit 20 is embedded in the device, the microcomputer 23 of the voice recognition unit 20 in steps 404 to 407 is executed. There is a difference in executing the function by directly receiving the recognition result from the voice recognition engine 22 in the central processing unit 30 in the electronic device without transmitting the code value.

At this time, the characteristics of the present invention is a control code processing method and a corresponding method for each electronic device transmitted by the microcomputer 23 of the voice recognition unit 20 to perform the function of the electronic device consisting of a conventional multi-step, the following embodiments In the following, only the difference between the control code processing method in steps 404 to 407 and the corresponding method of the central processing unit 30 in the electronic device will be described.

First embodiment

The first embodiment relates to a method for performing a function of an electronic device which is performed in a multi-step without changing hardware or software of a central processing unit 30 of a conventional electronic device, and a system for implementing the method. In steps 404 to 407 of 4, the microcomputer 23 of the voice recognition unit 20 may react at the speed at which the central processing unit 30 of the electronic device reacts according to the control path for each function of the remote controller corresponding to the existing electronic device. At least one code value for each function is sequentially transmitted, and a method is performed to sequentially perform functions according to the control code value received by the central processing unit 30 of the electronic device. This voice recognition user interface method has the advantage of being able to use both voice commands and manual operation of the remote control. 5 is a control code configuration ("menu", "right", "down", "down", "down", "sequentially transmits code values according to the control path of the existing remote controller for performing the" brightness "command) Select "," down "," down "," select "). These control codes may have different paths and code value configurations for each manufacturer and model of each electronic device.

Second embodiment

The second embodiment specifies that each function of the electronic device and the output code value of the microcomputer 23 correspond one-to-one, and the central processing unit 30 of the electronic device such that the code value and the function of the electronic device correspond one-to-one. Is implemented in software so that a corresponding function can be performed or displayed at a time during a voice command.

In this embodiment, the microcomputer 23 receives the recognition result from the voice recognition engine 22 and transmits a single code assigned to each function of the electronic device to the central processing unit 30 of the electronic device according to the recognition result as shown in FIG. 6. Send it out. In this single command code system, all functions performed by the electronic device are arranged at the same level according to the importance and frequency of use, and each function is given a new code value instead of the existing remote control code value. At this time, the central processing unit 30 receives a single command code corresponding to the voice command sent from the microcomputer 23 to process the corresponding function in the voice command.

The advantage of this approach is that it can provide a true user interface system. For example, in the case of the adjustment of "brightness", the same method as in the first embodiment shows the increase and decrease of the "brightness" after the "menu" screen floats sequentially and the "brightness adjustment bar" appears at the end after the "menu" screen floats without additional button manipulation. In the same manner as in the present embodiment, when the "brightness control" is pronounced, the "brightness control bar" immediately floats on the screen to express the increase and decrease of brightness, and the "brightness" with a specific numerical value pronunciation. You can also use the command to "darken" to perform brightness adjustments at once. You can also create new features and courses by combining existing features. For example, a washing machine may generate a single function or a washing course by combining existing washing functions, and in the case of a kimchi refrigerator, a new kimchi storage method may be generated using a combination of existing functions.

Third embodiment

According to the present embodiment, as shown in FIG. 7, a single command code classified into layers is classified according to a code layer criterion preset for each function of an electronic device corresponding to a recognition result received from the voice recognition engine 22 in the microcomputer 23. It is a method of sending to the central processing unit 30 of the equipment. The grouped single command code system includes the upper code layer (first class) classifying each function of the electronic device according to preset criteria (e.g., screen control function, volume control function, etc.) and the electronic device belonging to the higher code layer. It consists of subcode layers (second class) separated according to each function.

The grouped single command codes of the present embodiment may be used by extending the hierarchy as shown in FIG. 8, which is more effective in a home automation system.

The central processing unit 30 of the electronic device is implemented in software such that the grouped single command code received from the microcomputer 23 and the functions of the electronic device correspond to the one-to-one correspondence as in the second embodiment, so that the corresponding function is immediately performed during the voice command. Process to be executed or displayed. As in the second embodiment, the present embodiment has the characteristics of shortening the electronic device operation time and various various applications.

On the other hand, when the voice recognition unit 20 is embedded in the electronic device, the central processing unit 30 of the electronic device receives the recognition result directly from the voice recognition engine 22 and processes to execute the corresponding function. The central processing unit 30 of the electronic device should be implemented in software so that the functions of the electronic device and the electronic device correspond to each other.

When a new function is added in the electronic device and the program of the voice recognition unit 20 or the central processing unit 30 in the electronic device is changed, the program is automatically downloaded and maintained through communication such as the Internet.

By applying the above-described interface system (1) to the electronic device, the present invention can be applied directly without modification of each electronic device or by modifying only a part of the processing method of the central processing unit 30 associated with the user interface, all electronics controlled by the conventional remote controller. Compatible with the device.

The interface system of the present invention can control several electronic devices by using the same voice transmitter 10.

While the above-described embodiment has described a menu setting process of a television, it does not limit the scope of the present invention, and it is natural that various other changes are possible within the scope described in the present invention. Do.

As described above, it is possible to reduce the time required for device control and function execution and bring convenience in use by designing to execute functions executed in multiple steps using a single command at a time using a single command.

Claims (6)

In the user interface system for executing the functions of the electronic device to be executed in a single voice command, A voice transmission unit which receives a user's voice command and converts the same into an electrical signal; A memory storing previously learned reference voice data; A speech recognition engine that recognizes a user's command by comparing and searching the speech signal received from the speech transmitting unit with the reference speech data and delivers a recognition result; A microcomputer sequentially transmitting at least one code value corresponding to a recognition result of the voice recognition engine according to a control path for each function of the remote controller corresponding to the electronic device at a speed that can be corresponding to the central processing unit of the electronic device; And And a central processing unit of the electronic device to process a function according to a code value received from the microcomputer. In the user interface system for executing the functions of the electronic device to be executed in a single voice command, A voice transmission unit which receives a user's voice command and converts the same into an electrical signal; A memory storing previously learned reference voice data; A speech recognition engine that recognizes a user's command by comparing and searching the speech signal received from the speech transmitting unit with the reference speech data and delivers a recognition result; A microcomputer for transmitting a single command code allocated to each function of the electronic device to the electronic device according to a recognition result of the voice recognition engine; And And a central processing unit of the electronic device configured to perform one-to-one correspondence between the single command code and the function of the electronic device to perform a function corresponding to the voice command. In the user interface system for executing the functions of the electronic device to be executed in a single voice command, A voice transmission unit which receives a user's voice command and converts the same into an electrical signal; A memory storing previously learned reference voice data; A speech recognition engine that recognizes a user's command by comparing and searching the speech signal received from the speech transmitting unit with the reference speech data and delivers a recognition result; And And a central processing unit of the electronic device configured to correspond to the recognition result of the voice recognition engine and each function of the electronic device to perform a function corresponding to the voice command. In the user interface method for executing the function of the electronic device to be executed in a single voice command, 1) receiving a voice command of the user and converting the signal to an electrical signal; 2) comparing the electrical voice signal with previously learned reference data and recognizing it; 3) sequentially transmitting code values at a speed corresponding to the electronic device according to a control path of a remote controller for each function of the electronic device corresponding to the voice recognition result; And 4) receiving the code value of step 3) and performing a function of the electronic device. In the user interface method for executing the functions of the multi-level electronic device in a single voice command 1) receiving a voice command of the user and converting the signal to an electrical signal; 2) comparing the electrical voice signal with previously learned reference data and recognizing it; 3) transmitting a single command code allocated to each function of the electronic device according to the recognition result; And 4) receiving the single command code and performing a function corresponding to the voice command. In the user interface method for executing the functions of the multi-level electronic device in a single voice command 1) receiving a voice command of the user and converting the signal to an electrical signal; 2) comparing the electrical voice signal with previously learned reference data and recognizing it; 3) outputting a single command code grouped for each function of the electronic device corresponding to the recognition result; And 4) receiving the grouped single command code and performing a function corresponding to the voice command, The grouped single command code is An upper code layer classifying each function of the electronic device according to a preset criterion; And And a classification scheme consisting of at least one lower code layer according to each device-specific function belonging to the higher code layer.