KR101048321B1 - Integrated voice recognition remote control and its operation method - Google Patents

Abstract

The present invention relates to a voice recognition integrated remote control, and to recognize the voice of each user to configure a GUI screen suitable for it, even if the same command, different operation control is performed for each user. The present invention provides a wireless interface unit for performing remote wireless communication with each electronic product to be controlled by a remote control, a voice recognition unit for recognizing a voice command, a memory storing a wireless interface specification of each electronic product to be controlled by a remote control, and the voice command. According to the usage pattern of the user who inputs the display unit to display the graphic screen to give priority to each menu, extract the usage pattern of the user who inputs the voice command, and save the user's usage history after using the remote control According to the user pattern analysis unit and the use pattern extracted from the user pattern analysis unit, the graphic screen is configured to give priority to each menu and provided to the display unit. Performs remote wireless communication control in accordance with the wireless interface specification of electronics It is a control unit.

Remote Control, Electronics, Integrated, Voice Recognition, Habits, Patterns

Description

Apparatus for universial remote controller and method for operating the same using speech recognition}

The present invention relates to an integrated remote controller capable of remotely controlling various electronic products by recognizing voice.

In recent years, with the development of electronic technology, a remote control using infrared rays has been widely used to conveniently use various home appliances such as televisions, video tape recorders, DVD players, and audio, which are used at home. The remote control performs a function for easily controlling the above electronic products at a long distance.

Electronics with built-in sensors and controls are ready to provide services based on user needs, and interactions with all current and future peripherals require remote control, not direct contact. have. Remote controllers have played this role, but to fully accommodate the ubiquitous environment, new integration of the user interface, which means the contact between the user and the user device, is required.

There is an increasing demand for the development of a remote control that provides an appropriate visual interface to users of various ages and users with limited use of the remote control. In addition, the remote control in the ubiquitous era is increasingly used as an interface between various electronic devices in the home and office and the user.

Therefore, the development of the integrated remote controller is essential not only as a tool for home appliances but also to accelerate the dissemination of the home network environment in the ubiquitous era by remotely manipulating all the appliances in the home including lighting and doors.

However, despite this increasing use, the lack of consideration of integrated remote controls that provide multiple functions with one remote control is a reality.

Currently, the remote controller is being used as an interface between various electronic devices in a home and an office and a user, but as it becomes more common, its usability and usability are decreasing.

In other words, the remote control is used almost daily and hourly to operate various electronic devices in the home such as TV, DVD, audio and air conditioner. Using an independent remote control for each specific electronic product is not efficient from the viewpoint of convenience. to be. This situation is overcome by the emergence of an integrated remote controller that provides several functions with a single remote controller, but there is still a lack of consideration in terms of usability, usability and sensitivity.

Many remote controllers are not overly demanding of the user's learning ability. In particular, consideration should be given to the elderly who are learning how to use the remote control.

According to the present invention, in the integrated remote control for remote control of a plurality of electronic products, the screen GUI of the integrated remote control is configured differently according to the user, and the integrated remote control operation control also varies according to the user, so that anyone can conveniently operate the integrated remote control. Make it available.

The present invention provides a wireless interface unit for performing remote wireless communication with each electronic product to be controlled by a remote control, a voice recognition unit for recognizing a voice command, a memory storing a wireless interface specification of each electronic product to be controlled by a remote control, and the voice command. According to the usage pattern of the user who inputs the display unit to display the graphic screen to give priority to each menu, extract the usage pattern of the user who inputs the voice command, and save the user's usage history after using the remote control According to the user pattern analysis unit and the use pattern extracted from the user pattern analysis unit, the graphic screen is configured to give priority to each menu and provided to the display unit. Performs remote wireless communication control in accordance with the wireless interface specification of electronics It is a control unit.

The user pattern analysis unit checks the usage pattern preferred by the public for each electronic product according to personal information including age group and gender, and stores a default pattern DB previously stored as a DB, and the use of the electronic product by remote control ends. And a pattern learning module for classifying usage patterns including usage time and remote control contents of the electronic product used by the user by items, and a history pattern DB for registering and storing the usage patterns classified in the pattern learning module as history. And, as a result of voice command recognition, if the voice of the user registered in advance, the usage pattern of the user is extracted from the history pattern DB, and if the voice of the unregistered user includes the age and gender identified by the user's voice The use pattern matched with the corresponding personal information according to the personal information is converted into the default pattern DB. Extracted by the pattern extraction module comprises providing to the controller.

The present invention provides a process of recognizing a voice command of a user, a process of extracting a use pattern of a user who has input the voice command, and configuring and displaying a graphic screen with priority for each menu corresponding to the use pattern, and using the Remote wireless communication control by controlling the operation of the remote controller according to the pattern according to the pattern, and usage pattern including the usage time of the electronic product used by the user and the contents of the remote control after the use of the electronic product by the remote control is finished. It includes the process of storing the history classified by item.

The present invention provides an integrated voice recognition remote control, thereby providing a customized GUI screen for each user to easily achieve the desired remote control for each user. In addition, by recognizing the voice command for each user to perform a different remote control operation according to each user, there is an effect that the remote control for each user is performed immediately.

Hereinafter, a detailed description of embodiments of the present invention will be described with reference to the accompanying drawings. In the following description of the reference numerals to the components of the drawings it should be noted that the same reference numerals as possible even if displayed on different drawings.

1 is a block diagram of a voice recognition integrated remote control according to an embodiment of the present invention.

The wireless interface unit 20 functions to perform a wireless interface with the electronic products to be controlled remotely. To this end, the wireless interface unit includes a Bluetooth module, an infrared module (IrDA module), a wireless LAN module. For example, when the Bluetooth communication electronics are remotely controlled, the Bluetooth module of the wireless interface unit is operated. When the Bluetooth module is remotely controlled through infrared transmission and reception, such as a TV, the infrared module of the wireless interface unit is operated. In this case, the wireless LAN module of the wireless interface unit is operated to remotely control the corresponding electronic product.

The memory 30 stores the air interface specification of each electronic product registered in the remote controller to be controlled by type. In addition, the remote control call name is registered and stored for each user in the memory 30, and used to read the user of the call name when voice recognition is performed.

The memory 30 may include a flash memory, a compact flash card, a secure digital card, a smart media card, a multi-media card, or a memory stick. A module capable of inputting / outputting information such as a stick) may be provided inside the device, or may be provided in a separate device.

The display unit 40 displays an electronic product to be remotely controlled and also displays a graphic interface for each user pattern for the selected electronic product.

Integrated voice recognition remote control of the present invention stores the user's repetitive use habits based on the analysis of the use pattern and displays the priority of execution through the display unit 40. For example, as a result of analyzing the usage pattern of the user, when the user wants to watch a video, as shown in FIG. 2, the TV icon for TV control, so as to remotely control the TV + video + home theater system together, An audio icon for audio control, a DVD icon for DVD control, an air conditioning control icon for air temperature control, a light icon for indoor light control, a security icon for security control, and the like are displayed on the display unit 40 of the voice recognition integrated remote controller. Display on the screen.

By collectively displaying the necessary icons according to the user's usage pattern, it is possible to eliminate the hassle of selecting the electronic products to be remotely controlled by the user.

In addition, the display unit 40 displays the usage pattern analyzed according to the user's repetitive usage habits for each electronic product according to the priority of execution. For example, when a user selects a TV icon in a state in which a plurality of electronics icons are displayed as shown in FIG. 2 when a video is viewed, as shown in FIG. 3, prioritize the channels most used by the user when using the TV. By displaying the size differently in turn, the user's channel selection inconvenience is minimized. As a result, in the case of TV channel selection, a channel that is frequently watched according to the user's preference is preferentially displayed in the case of channel illness, thereby eliminating the trouble of long channel selection operation.

In addition, the display unit 40 may be implemented in various hardware forms, for example, a liquid crystal touch pad structure, a button structure, a voice recognition structure, or the like.

The voice recognition unit 50 receives a user's voice command and analyzes user information according to the voice command. For example, when there is a voice command input, when the voice recognized through frequency analysis or the like is a voice of "Hong Gil Dong", a man in his 40s registered in the memory 30, the input voice is "Hong Gil Dong", a man in his 40s. The information of the voice of the voice and the command content information of the voice recognition is transmitted to the control unit 10.

The user pattern analysis unit 60 extracts a user's use pattern of the user who wants to use the voice recognition integrated remote controller (pattern extraction function) and provides it to the controller 10. After the use of the voice recognition integrated remote controller is completed, This function analyzes and saves the usage pattern (pattern recording function).

The pattern extraction function will be described in detail. When the user makes a voice command to use the voice recognition integrated remote controller, the user pattern analyzer 40 recognizes the user's voice and extracts a pattern suitable for the user and provides it to the controller. The control unit 10 accordingly outputs a graphic screen of the display unit 40.

For example, when a male in his 40s enters a voice command of “TV on,” the user pattern analyzer 60 may register a male in his 40s through his voice recognition unit 50. Recognizing that the user is a user, according to the command voice of "Hong Gil-dong" called "TV on", the "Hong Gil-dong" favorite TV channels are extracted and provided to the controller.

The controller 10 receives the usage pattern of the corresponding 'Hong Gil-dong' from the user pattern analyzer, and places channel 11, which is the favorite channel, at the top, and then places the favorite subordinated channel on the next line. The ranking is arranged as shown in FIG. Therefore, 'Hong Gil-dong' can directly watch the channel screen by clicking on the channel 11 he likes most without any manipulation.

If the user is not registered for the spoken voice, the user pattern analyzer 60 analyzes voice frequency and age of the command voice, extracts a default use pattern suitable for the age of the corresponding user, and provides the same to the controller. The control unit displays the display unit graphic accordingly.

Meanwhile, when the pattern recording function of the user pattern analyzer 60 is described, after the use of a specific electronic product is finished, the user pattern analyzer analyzes and stores usage information such as usage time and remote control content of the electronic product used by the user. do. This is for use in pattern analysis extraction when the user uses the function again later.

After "Hong Gil-dong", a man in his 40s, finishes watching TV programs, the user pattern analysis unit uses information such as channel viewing and other viewing information (viewing time, volume, screen brightness, contrast brightness, etc.). Analyze and save

For example, if the user watched the cartoon channel 40 minutes, the entertainment channel 15 minutes, and the drama channel 5 minutes out of the total 60 minutes of viewing time as the medium volume state, the user pattern analysis unit may view such viewing information ( TV channel rankings). Thus, in the future, when the same user, a man in his 40s, "Hong Gil-dong" uses the remote control, the user pattern analyzer extracts a usage pattern in order of comic channel-> entertainment channel-> drama channel and provides it to the controller, and the controller prioritizes. The channel icon may be displayed on the display unit.

The user pattern analyzer 60 performs a pattern extraction function and a pattern recording function as described above. In order to perform such a function, the default pattern DB 63, the pattern history DB 64, the pattern learning module 62, The pattern extraction module 61 is provided.

The default pattern DB 63 is a database that stores, as a default, a usage pattern for each of the most preferred electronic products by user age group, gender, and other personal information. The usage pattern information is information that is stored in advance when the integrated voice recognition remote control is released, and the average control pattern is stored as a DB through surveys for each age group and gender.

4 is a table showing a list of analysis patterns of use of each electronic product, and the general movement patterns of users for each TV, DVD player, audio, and air conditioner are identified and DBized through a survey.

For reference, FIG. 5 is a diagram illustrating an example of a usage pattern of all preferred broadcasting channels for TV electronic products after survey analysis, and FIG. 6 is a diagram illustrating an example of a usage pattern of all preferred broadcasting genres for TV electronic products. 7 is a diagram illustrating an example of a usage pattern of the entire viewing time zone for TV electronic products.

Similarly, FIG. 8 illustrates examples of usage patterns for DVD electronics and audio electronics after survey analysis, and FIG. 9 illustrates examples of usage patterns for radio preference channels for audio electronics after survey analysis. 10 shows examples of usage patterns for radio listening time for audio electronics after survey analysis, and FIG. 11 illustrates examples of general usage patterns for air conditioner electronics after survey analysis. to be.

As described above, the usage pattern according to the personal information is stored in the default pattern DB 63.

The history pattern DB 64 is a DB in which usage patterns such as usage time, remote control content, etc. of the electronic product used by the user are stored after the use of the electronic product is finished. This is for use in extracting the user's usage pattern when the user later uses the function.

For example, after "Hong Gil-dong", a man in his 40s, finishes watching TV shows, usage information such as channels and other viewing information (viewing time, volume, screen brightness, contrast brightness, etc.) viewed by the user is displayed in the history pattern. Stored in DB 64

After the use of the electronic product, the pattern learning module 62 analyzes, classifies, and stores the usage pattern such as the use time of the electronic product used by the user, the contents of the remote control, and stores the pattern in the history pattern DB 64. For example, "Hong Gil-dong", a man in his 40s, has watched TV programs for 60 minutes (40 minutes of cartoon channels, 15 minutes of entertainment channels, 5 minutes of drama channels). Is stored in the history pattern DB 64

The pattern extraction module 61 performs a function of extracting a pattern of a user who wants to use the voice recognition integrated remote controller (pattern extraction function) and providing it to the controller.

As a result of the voice command recognition, when the voice command is a command that is stored and registered in advance, the pattern of the corresponding user is extracted from the history pattern DB 64 and provided to the controller 62.

For example, if a male in his 40s, Hong Gil-dong, utters a voice command of “TV on,” the user pattern analysis unit recognizes that the male in his 40s, “Hong Gil-dong,” is a registered user. According to the command voice of "Hong Gil-Dong", "Hong Gil-Dong" extracts the favorite TV channels in order and provides them to the controller.

In addition, when the recognized command voice is not registered in advance and does not exist in the history pattern DB, after analyzing the frequency of the input voice and reading the gender and age band, the corresponding gender and the gender are stored in the default pattern DB stored by default. Extract the pattern for age group and provide it to the controller.

For example, if a 50-year-old housewife who is not a user registered on the integrated voice recognition remote control utters the voice command "Turn on TV," the survey shows that the 50s housewives most favorite broadcast channels and 50s housewives The volume set as the average is extracted from the default pattern DB and provided to the controller. As a result, the icons of the broadcasting channels of the 50's most favorite morning 8 hours can be arranged on the display unit 40 in the order of priority.

The controller 10 configures and displays a graphic interface (UI) on the display unit according to the usage pattern information received from the user pattern analyzer 60. For example, in the case of the 40s " Hong Gil Dong " voice command " turn on TV ", the pattern extraction module 61 receives the usage pattern of " Hong Gil Dong " from the pattern extraction module 61 and displays the display unit as shown in FIG.

 In addition, the controller 10 may recognize the command according to the whole sentence when operating by voice recognition, but may implement a control for each situation by extracting a specific word of the sentence.

For example, FIG. 12 illustrates an example of operation of a voice command situation for a TV. When a teenage son performs a voice command of "Mom or TV," the voice recognition unit 50 may predetermine according to voice frequency analysis. At the same time, it recognizes the words "TV" and "Look" syllables, and the channel and volume that the teenage son enjoys most on a weekday afternoon from the user pattern analyzer 64. Provided, it can be implemented to control the TV remote control straight.

In addition, the controller 10 may cope with each electronic product for each situation. When there is a voice command for the air conditioner as illustrated in FIG. 13, the controller 10 may perform a remote control operation differently according to each voice command subject. . For example, when a grandmother gives a "cold" voice command, she performs a remote control operation that raises the temperature by 3 ° C. When a teenage son gives a "cold" voice command, she performs a remote control operation that raises the temperature by 1.5 ° C. do. In general, the older women are, the more sensitive they are to the cold, so even if they are the same command, their behavior is different (if it is dawn, the temperature is raised to 4 ° C (when it is a grandmother's voice command) and 2 ° C units (10 units). Son voice commands).

As described above, the usage pattern information may be provided with the usage pattern information through the user pattern analyzer.

14 is a flowchart illustrating an operation process of a voice recognition integrated remote controller according to an exemplary embodiment of the present invention.

When the user's voice command is recognized (S141), the user's usage pattern according to the voice command is extracted for a screen and a control operation for configuring a graphic user interface (GUI) for the voice command (S142).

In the case of the voice command of the user registered in advance, the usage pattern of the remote control function used by the user is extracted from the history pattern DB 64, and in the case of the voice command of the unregistered user, the preset default pattern DB The user pattern is extracted from the user's age, gender, and time zone.

After extracting the usage pattern of the user as described above (S142), a GUI screen suitable for the usage pattern is configured and displayed, and if necessary, a remote control control operation is performed (S143).

For example, when the 40-year-old "Hong Gil-dong" registered in advance receives a "TV on" voice command, the usage pattern of "Hong Gil-dong" is received from the history pattern DB 64, and the display unit is configured and displayed as shown in FIG.

In addition, the remote control control operation can be performed immediately according to the voice command, it can be implemented to control by the situation according to the voice command.

For example, as shown in FIG. 12, when the teenage son commands the voice to say "Mom or T-Bee," the speech recognition unit 50 recognizes that the teenage boy is a pre-registered teenage boy according to the voice frequency analysis. At the same time, by recognizing the syllables of "TV" and "see", the teenage son receives the most favorite channel and volume on the weekday afternoon from the user pattern analysis unit, and the most favorite channel through the remote control. The TV on operation may be performed as the volume.

In addition, as shown in FIG. 13, when there is a voice command for the air conditioner, the remote control operation may be performed differently according to each voice command subject. For example, when a grandmother gives a "cold" voice command, she performs a remote control operation that raises the temperature by 3 ° C. When a teenage son gives a "cold" voice command, she performs a remote control operation that raises the temperature by 1.5 ° C. do. In general, the older women are, the more sensitive they are to the cold, so even if they are the same command, their behavior is different (if it is dawn, the temperature is raised to 4 ° C (when it is a grandmother's voice command) and 2 ° C units (10 Son voice commands).

As described above, the GUI screen display and the remote control control operation are performed according to the user's usage pattern, and when there is another user's input (voice command input) (S145), the user's usage pattern for the voice command input is extracted (S142). In step S143, the GUI display and control operation according to the usage pattern of the user is performed.

On the other hand, when the use of the electronic product through the remote control input is completed and the remote control operation is completed (S144), the user analyzes the voice command pattern to use the electronic product to store the history (S146).

That is, after the use of the electronic product, the usage pattern information such as the usage time of the electronic product used by the user and the remote control contents are analyzed and stored in the history pattern DB.

After "Hong Gil Dong", a man in his 40s, finishes watching TV programs, user information such as the channel and other viewing information (viewing time, volume, screen brightness, contrast brightness, etc.) viewed by the user is stored in the history pattern DB. Is stored

For example, if Hong Gil-dong, a man in his 40s, watched TV programs for 60 minutes (40 minutes of cartoon channels, 15 minutes of entertainment channels, and 5 minutes of drama channels), the channels watched by analyzing the channels watched (cartoons) Channel-> entertainment channel-> drama channel) are stored in the history pattern DB.

Storing the usage pattern of the user as described above is to extract the user's usage pattern from the stored pattern when the same user uses the remote controller later, and perform the GUI screen display and operation control of the remote controller more efficiently.

In the above description of the present invention, specific embodiments have been described, but various modifications may be made without departing from the scope of the present invention. Therefore, the scope of the present invention is not to be determined by the embodiments described above, but will be apparent in the claims as well as equivalent scope.

1 is a block diagram of a voice recognition integrated remote control according to an embodiment of the present invention.

FIG. 2 is a diagram illustrating an example in which a plurality of electronic product remote icons are displayed on a display unit of a voice recognition integrated remote controller according to an exemplary embodiment of the present invention.

FIG. 3 is a diagram illustrating an example in which a user displays channels, which are most frequently used when a TV is used, in different sizes in order according to an embodiment of the present invention.

4 is a diagram illustrating a list to be analyzed for usage patterns for each electronic product.

5 is a diagram illustrating an example of a usage pattern of all preferred broadcast channels for TV electronic products.

6 is a diagram illustrating an example of a usage pattern of the overall preferred broadcasting genre for TV electronic products.

7 is a diagram illustrating an example of a usage pattern of the entire viewing time zone for TV electronic products.

8 is a diagram illustrating an example of a usage pattern for DVD electronics and audio electronics after survey analysis.

9 is a diagram illustrating an example of a usage pattern of a radio preference channel for radio electronic products.

10 is a diagram illustrating an example of a usage pattern of a listening time zone for a radio electronic product.

FIG. 11 is a diagram illustrating an example of a general usage pattern for an air conditioner electronic product. FIG.

12 is a diagram illustrating an operation example of a voice command situation for a TV according to an embodiment of the present invention.

FIG. 13 is a diagram illustrating an example of differently performing a remote controller operation according to each voice command subject when there is a voice command for the air conditioner according to an exemplary embodiment of the present invention.

14 is a flowchart illustrating an operation process of a voice recognition integrated remote controller according to an exemplary embodiment of the present invention.

Claims (12)

A wireless interface unit performing remote wireless communication with each electronic product to be controlled by a remote control unit; A voice recognition unit for recognizing voice commands; Memory that stores the air interface specifications of each electronic product to be controlled by the remote control, A display unit for displaying a graphic screen with priority for each menu according to a usage pattern of a user who inputs the voice command; A user pattern analysis unit which extracts a usage pattern of a user who inputs a voice command, and stores a user history of use after the use of the remote controller; According to the usage pattern extracted from the user pattern analyzer, the graphic screen is configured to give priority to each menu and provided to the display unit. Control unit for performing remote wireless communication control in accordance with Integrated voice recognition remote control comprising a. The integrated voice recognition remote control of claim 1, wherein the wireless interface unit comprises at least one Bluetooth module, an infrared communication module, and a wireless LAN module. The voice recognition integrated remote controller of claim 1, wherein the display unit integrates and displays icons for remotely controlling a plurality of electronic products in a single screen according to a function that a user wants to operate. The method of claim 1, wherein the display unit displays the graphic screen by giving priority to each menu by arranging the most-used menus at the top and then placing the most-used menus at the next stage in turn. Integrated voice recognition remote control. The method according to claim 1 or 4, wherein the display unit displays the graphic screen with priority on each menu, displaying the most used menu as the icon of the largest size, and then displays the most used menu. Integrated voice recognition remote control for displaying small icons in sequence. The method of claim 1, wherein the voice recognition unit recognizes the voice command in syllable units, recognizes the instruction content of the voice command, and recognizes the gender and age of the user who input the voice command through voice frequency analysis. Integrated voice recognition remote control. The method of claim 1, wherein the user pattern analysis unit, The default pattern DB, which is pre-stored and stored as a DB by investigating usage patterns preferred by the public for each electronic product according to personal information including age group and gender, A pattern learning module for classifying the usage pattern including the usage time of the electronic product used by the user and the contents of the remote control after the use of the electronic product by the remote control is finished; A history pattern DB for registering and storing the usage patterns classified by the pattern learning module as history; As a result of voice command recognition, in the case of the voice of a pre-registered user, the usage pattern of the user is extracted from the history pattern DB, and in the case of the voice of an unregistered user, the personal information including age group and gender identified through the voice of the user A pattern extraction module for extracting from the default pattern DB a usage pattern matching the corresponding personal information according to the information and providing it to the controller. Integrated voice recognition remote control that includes. The method of claim 7, wherein the controlling of the remote control by each user according to the usage pattern is performed by controlling the remote control adjusting step according to each user even if the contents of the same voice command are used. Recognition integrated remote control. Recognizing a user's voice command, Extracting a usage pattern of the user who inputs the voice command; Constructing and displaying a graphic screen with priority for each menu corresponding to the usage pattern, and controlling remote wireless communication by changing a remote controller control operation for each user according to the usage pattern; After the use of electronic products by remote control is terminated, the process of storing history by classifying the usage pattern of the electronic products used by the user and the usage patterns including the contents of remote control. Operation method of the voice recognition integrated remote control comprising a. The method of claim 9, wherein the recognizing of the voice command comprises recognizing the voice command in syllable units, recognizing the instruction content of the voice command, and recognizing the gender and age of the user who inputs the voice command through voice frequency analysis. Operation method of the voice recognition integrated remote control, characterized in that. 10. The method of claim 9, wherein the graphic screen is configured by displaying the menus according to the usage patterns in priority order, and the menus with the most usage are arranged at the top, and the menus with the most usage are next in sequence. Operation method of the voice recognition integrated remote control, characterized in that arranged to display. 12. The method according to claim 9 or 11, wherein the graphic screen is configured by displaying the menus according to the usage patterns in order of priority, displaying the most used menus as the icons of the largest size, and then using them. Operation method of the integrated voice recognition remote control characterized by displaying a number of menus in order of smaller icons in order.

Images