KR20050088538A - Electric appliances controlling service system and method using web browser capable of recognizing voice - Google Patents

Abstract

Disclosed are a home appliance control service system using a web browser capable of speech recognition, and a method thereof. In the home appliance control service system, when the web browser execution apparatus calls a web page for home appliance control from a home server and gives a command list to the user, the user selects a necessary command and inputs it by voice, and the web browser execution apparatus By recognizing this and transmitting it to the home server, the home server controls various home appliances according to a voice command of the user.

Description

Electric appliances controlling service system and method using web browser capable of recognizing voice}

The present invention relates to a home appliance control service system, and more particularly, to a home appliance control service system for home automation and a method thereof.

Recently, many methods for controlling home appliances using a graphical user interface (GUI) of a web browser have been studied and demonstrated. Currently, there are three major home appliance control technologies for home automation. First, there is a method in which a user gives a command to a home appliance directly by using a voice or a remote control. For example, when a user gives a command required by a voice or a remote control directly to a predetermined circuit built in the home appliance, on / off of a home appliance such as a fluorescent lamp, a rice cooker, a washing machine, a refrigerator, or a digital door ( door), the opening and closing of home appliances such as a digital gas valve and the like can be controlled. Secondly, there is a method in which a user controls home appliances in a home through a mobile station or a landline. For example, when a user calls home and inputs a required key according to the guidance provided by a home server that supports a mode for controlling home appliances, the user connects to a mobile communication network or a wired communication network. The connected home appliance may be operated according to a corresponding command. Third, in a predetermined system based on the Internet, there is a method of accepting a home appliance control command input by a user directly using a GUI-based web browser and allowing a home server connected through the Internet to control the home appliance. For example, a user may access a home server through a computer connected to the Internet anytime, anywhere to retrieve a web page provided by the home server. The user directly inputs a command required for controlling a home appliance on a loaded web page, and accordingly, the home server executes the command to control various home appliances.

In such a conventional home appliance control service system, a home appliance is directly recognized by voice, or a user inputs a necessary command directly by a user through a remote controller, a mobile terminal, or other GUI to control the home appliance. Therefore, when the home appliance needs to directly recognize the voice or directly inputs a necessary command to the remote control to control the home appliance, it is inconvenient and has a problem in that the remote control is limited. In addition, when using a terminal such as a computer equipped with a web browser, the user has to enter a required key directly through a GUI such as a web page, there is a problem that is limited in time and space.

Accordingly, the present invention has been made to solve the above problems, the technical problem to be achieved by the present invention, the user inputs a command for controlling the home appliance by voice using a web browser capable of speech recognition, accordingly A home server connected to a wired / wireless integrated internet controls home appliances, and provides a home appliance control service system and method for providing a service without time and space constraints.

Home appliance control service system according to the present invention for achieving the above technical problem, characterized in that it comprises a wired and wireless integrated Internet, a voice recognition terminal, a home server, and home appliances. The voice recognition terminal extracts the command selection information included in the web page information and outputs it as voice, and transmits the selected command corresponding to the input information through the wired / wireless integrated internet. The home server manages the web page information and generates a control signal according to the selected command. The household appliances execute the selected command in response to the control signal. The voice recognition terminal is characterized in that for receiving the input information by voice. The voice recognition terminal may receive the input information as a key input through a keyboard, a mouse, or a touch panel. The voice recognition terminal is characterized in that for loading the web page information in the form of HTTP (hypertext transfer protocol) based data, and transmitting the selected command in the form of HTTP-based data.

The voice recognition terminal is characterized by comprising a voice input microphone, a voice output speaker, and a web browser execution device. The voice input microphone receives the input information as voice. The voice output speaker outputs the command selection information as voice. The web browser executing apparatus retrieves the web page information through the wired / wireless integrated internet, extracts the command selection information, and transmits the selected command corresponding to the received voice input information through the wired / wireless integrated internet. The voice recognition terminal may further include a display device for displaying the web page information.

The web browser execution apparatus includes a speech recognition module, an HTTP conversion module, an HTTP client, and a web page parser. The voice recognition module recognizes a user and generates a corresponding digital signal in response to the received voice input information. The HTTP conversion module converts the digital signal into HTTP-based data corresponding to the selected command and outputs the converted digital signal. The HTTP client reads the web page information and transmits HTTP-based data corresponding to the selected command through the wired / wireless integrated internet. The web page parser extracts the command selection information from the web page information. The voice recognition terminal may further include an input key for receiving the input information as a key input and generating the digital signal.

According to another aspect of the present invention, there is provided a method of controlling a home appliance, the method including: extracting command selection information included in web page information and outputting the voice; Transmitting the selected command corresponding to the input information via the wired / wireless integrated internet; Generating a control signal according to the selected command; And executing control of the home appliances corresponding to the selected command in response to the control signal. The input information may be received by voice. In addition, the input information may be received as a key input through a keyboard, a mouse or a touch panel.

In order to fully understand the present invention, the operational advantages of the present invention, and the objects achieved by the practice of the present invention, reference should be made to the accompanying drawings which illustrate preferred embodiments of the present invention and the contents described in the accompanying drawings.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. Like reference numerals in the drawings denote like elements.

1 is a block diagram showing a home appliance control service system 100 according to an embodiment of the present invention. Referring to FIG. 1, the home appliance control service system 100 includes a voice recognition terminal 110, a wired / wireless integrated internet 120, a home server 130, and home appliances 140.

The voice recognition terminal 110 is a device for controlling the home appliances 140 to execute a command by transmitting a command received as a voice from a user to the home appliances 140 without time and space constraints. . The voice recognition terminal 110 may be provided in a mobile station, a computer, a television, or the like, or may be used as a dedicated device. The voice recognition terminal 110 reads the web page information from the home server 130 in the form of a hypertext transfer protocol (HTTP) based data through the wired / wireless integrated internet 120. The voice recognition terminal 110 extracts command selection information in the form of a list included in web page information and outputs it as voice. Accordingly, the user receives input information selected and input from the list, and transmits the selected command corresponding thereto through the wired / wireless integrated Internet 120. The selected command is transmitted to the home server 130 in the form of HTTP-based data. Here, the input information selected and input by the user is preferably input by voice. However, the input information may be received as a key input through the input key 115 in the form of a keyboard, a mouse, or a touch panel. The voice recognition terminal 110 will be described in more detail below.

The home server 130 manages the web page information. A program including the web page information, that is, a command selection information in the form of a list for controlling the home appliance 140 may be changed or maintained and modified by the user. That is, the user may change the web page information such that other home appliances under control, in addition to a washing machine, a refrigerator, a door, or a gas valve constituting the home appliances 140 are added or deleted. In addition to the on / off of the home appliances 140, detailed control settings, that is, a washing method setting in the washing machine, a temperature setting in the refrigerator, a timer setting in the rice cooker, etc. may be added or deleted by the user. . In addition, the home server 130 receives a selected command corresponding to the input information selected by the user from the voice recognition terminal 110 and generates a control signal of the home appliance 140 according to the command. Accordingly, the home appliances 140 respond to the control signal of the home appliance 140, the selected command (on / off, washing method setting in the washing machine, temperature setting in the refrigerator, timer setting in the rice cooker, etc.) Run

 In FIG. 1, the voice recognition terminal 110 uses a voice input microphone 111, a web browser execution device 112, a display device 113, a voice output speaker 114, and an input key 115. Equipped.

The web browser execution apparatus 112 retrieves the web page information from the home server 130 through the wired / wireless integrated Internet 120 and extracts the command selection information. Accordingly, the voice output speaker 114 is a list. The command selection information in the form of a voice is output. The voice input microphone 111 receives voice input information from the user. Accordingly, the web browser execution apparatus 112 transmits the selected command corresponding to the voice input information received from the user through the wired / wireless integrated internet 120.

In addition, the web browser execution apparatus 112 may output the web page information including the command selection information in the form of a list to the display device 113 to be displayed as a screen that the user can see. Accordingly, the user, while viewing the screen displayed on the display device 113 through the input key 115 for receiving the input information as a key input, inputs any one command from the list selection command selection information by key input. You can also choose.

In FIG. 1, the web browser execution apparatus 112 includes a speech recognition module 201, an HTTP conversion module 202, an HTTP client 203, and a web page parser 204. ).

The voice recognition module 201 recognizes a user and generates a corresponding digital signal in response to the received voice input information. For example, the voice recognition module 201 may remove noise from a signal corresponding to the received voice input information to improve sound quality and perform user authentication to determine whether the voice is a registered user. As a result, upon successful user authentication, the voice analog signal is converted into a digital signal for subsequent processing. In order to simplify the circuit, the voice recognition module 201 may remove the noise from the voice analog signal corresponding to the received voice input information and convert the voice signal into a corresponding digital signal without user authentication. When the user inputs a command by key input, the input key 115 generates a corresponding digital signal corresponding to the command selected by the user. The HTTP conversion module 202 converts the digital signal into HTTP-based data corresponding to the selected command and outputs the converted digital signal. The HTTP client 203 reads the web page information and transmits HTTP-based data corresponding to the selected command through the wired / wireless integrated internet 120. The web page parser 204 extracts the command selection information for voice output from the web page information.

Hereinafter, the operation of the home appliance control service system 100 according to an embodiment of the present invention will be described in more detail.

2 is a flowchart illustrating an operation of the home appliance control service system 100 of FIG. 1. Referring to FIG. 2, first, a user operates a voice recognition terminal 110 and requests a web page composed of a program including command selection information in the form of a list for controlling the home appliances 140 (S210). . Accordingly, the HTTP client 203 of the web browser execution apparatus 112 retrieves web page information, which is data constituting the requested web page, from the home server 130 and passes through the web page parser 204 to display the display device. Output to 113 to be displayed as a screen that the user can see (S220). In addition, the web page parser 204 searches whether the web page information includes a command for controlling the home appliance 140, and includes a list of command selection information including contents to be selected by the user and information that can be selected. Extract the sound through the voice output speaker 114 to the sound (S230, S240). The command selection information may be displayed on the display apparatus 113 (S240). In this case, if there is no command selection information related to the control of the home appliance 140, the web page is displayed only on the display device 113 without being output as a voice.

The web page uses the same web language as the existing hypertext markup language (HTML), but a part for controlling elements required in the web language is used. That is, a web page written in an element control language is required. The HTTP client 203 of the voice recognition terminal 110 passes the web page information received by requesting a web page to the home server 130 to the web page parser 204. The web page parser 204 reads the web page information to determine whether a specific portion of the web page is spoken or received. In addition, in a method of bringing a web page to the home appliance 140 and related contents, the web page parser 204 uses a property of an element of the web page to receive a voice and receive an input. ) You can distinguish whether it is a command related to control.

The user can select a mode for inputting input information (on / off, washing method setting in a washing machine, temperature setting in a refrigerator, timer setting in a rice cooker, etc.). When the user selects a command by voice through the voice input microphone 111, the voice recognition module 201 recognizes the user and generates a corresponding digital signal in response to the received voice input information (S250). When the user selects a command with the key, the corresponding digital signal is generated from the input key 115 (S260). Accordingly, the HTTP conversion module 202 converts the digital signal into HTTP-based data corresponding to the selected command and outputs it (S270). The HTTP client 203 transmits HTTP-based data corresponding to the selected command to the home server 130 through the wired / wireless integrated Internet 120 (S280). The home server 130 receives a selected command corresponding to the input information selected by the user from the HTTP client 203 and generates a control signal of the home appliance 140 according to the command. Accordingly, the home appliances 140 execute the selected command in response to the control signal of the home appliance 140 (S290). The home server 130 may generate the web page information in the form of HTTP-based data and transmit the result of the control of the home appliance 140 to the user (S300).

For example, when the voice recognition terminal 110 is combined with a TV, a web browser execution apparatus capable of voice recognition and synthesis support is operated through a TV in the home. At this time, the web page information for controlling the home appliance 140 from the home server 130 is displayed on the TV screen. The audio output speaker 114 provided in the TV informs the user of available command selection information. When the user selects a command for controlling the home appliance 140 such as a washing machine or a refrigerator and inputs it by voice, the web browser execution device 112 transmits the command to the home server 130 to transmit the command to the home appliance 140. Control such as turning on / off.

As another example, when the voice recognition terminal 110 is combined with a mobile phone, the user realizes that the gas is not locked in the house while driving the car. The user connects to the home page for controlling the home appliance 140 of the home server 130 using the mobile phone. The user tells the mobile phone to shut off the gas valve. The web browser execution apparatus 112 provided in the mobile phone transmits a user's command to the home server 130 so that the home server 130 may execute the lock control of the gas valve.

As another example, when the voice recognition terminal 110 is a dedicated device such as a web pad, the doorbell rings while the user is washing dishes in the kitchen. The user connects to the homepage associated with the front door lock through the web pad installed in the kitchen, and allows the home server 130 to check the visitor, while controlling the opening of the door lock.

As described above, in the home appliance control service system 100 according to an embodiment of the present invention, the web browser execution device 112 calls a web page for controlling the home appliance 140 from the home server 130. When the user hears the command list, the user selects the necessary command and inputs it into the voice, and the web browser execution apparatus 112 recognizes it and transmits it to the home server 130, so that the home server 130 receives the user's voice. Control various home appliances 140 according to the command.

The functions used in the devices and methods disclosed herein can be embodied as computer readable codes on a computer readable recording medium. The computer-readable recording medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of computer-readable recording media include ROM, RAM, CD-ROM, magnetic tape, floppy disks, optical data storage devices, and the like, which may also be implemented in the form of carrier waves (for example, transmission over the Internet). do. The computer readable recording medium can also be distributed over network coupled computer systems so that the computer readable code is stored and executed in a distributed fashion.

As described above, optimal embodiments have been disclosed in the drawings and the specification. Although specific terms have been used herein, they are used only for the purpose of describing the present invention and are not intended to limit the scope of the invention as defined in the claims or the claims. Therefore, those skilled in the art will understand that various modifications and equivalent other embodiments are possible from this. Therefore, the true technical protection scope of the present invention will be defined by the technical spirit of the appended claims.

The home appliance control service system according to the present invention controls the home appliance using a user interface by voice, so that the user can give a command for controlling the home appliance while doing other work. In addition, since the service through a wired and wireless integrated Internet environment, it is very convenient for the user, there is an effect that can provide a home appliance control service without time and space constraints.

1 is a block diagram showing a home appliance control service system according to an embodiment of the present invention.

FIG. 2 is a flowchart for describing an operation of the home appliance control service system of FIG. 1.

<Description of Major Symbols in Drawing>

110: voice recognition terminal 111: voice input microphone

112: device for executing a web browser 113: display device

114: audio output speaker 120: wired and wireless integrated Internet

130: home server 140: appliances

Claims (11)

Wired and wireless integrated Internet; A voice recognition terminal that extracts command selection information included in web page information and outputs it as voice, and transmits the selected command corresponding to the input information through the wired / wireless integrated Internet; A home server managing the web page information and generating a control signal according to the selected command; And And home appliances for executing the selected command in response to the control signal. The method of claim 1, wherein the voice recognition terminal, And the input information may be received by voice or as a key input through a keyboard, a mouse, or a touch panel. The method of claim 1, wherein the voice recognition terminal, The home page control service system, characterized in that for loading the web page information in the form of HTTP (hypertext transfer protocol) based data, and transmitting the selected command in the form of HTTP-based data. The method of claim 1, wherein the voice recognition terminal, A voice input microphone for receiving the input information by voice; A voice output speaker for outputting the command selection information as voice; And And a web browser executing apparatus which retrieves the web page information through the wired / wireless integrated internet, extracts the command selection information, and transmits the selected command corresponding to the received voice input information through the wired / wireless integrated internet. Home appliance control service system. The method of claim 4, wherein the voice recognition terminal, And a display apparatus for displaying the web page information. The apparatus of claim 4, wherein the web browser execution device is A voice recognition module for recognizing a user and generating a corresponding digital signal in response to the received voice input information; An HTTP conversion module for converting the digital signal into HTTP-based data corresponding to the selected command and outputting the converted data; An HTTP client that reads the web page information and transmits HTTP-based data corresponding to the selected command through the wired / wireless integrated Internet; And And a web page parser for extracting the command selection information from the web page information. The method of claim 6, wherein the voice recognition terminal, And an input key configured to receive the input information as a key input and generate the digital signal. Extracting command selection information included in web page information and outputting the voice; Transmitting the selected command corresponding to the input information via the wired / wireless integrated internet; Generating a control signal according to the selected command; And And controlling the home appliances corresponding to the selected command in response to the control signal. The method of claim 8, wherein the web page information, The home appliance control service method, wherein the home appliance is called in the form of HTTP-based data, and the selected command is transmitted in the form of HTTP-based data. According to claim 8, The home appliance control service method, And displaying the web page information. The method of claim 8, wherein the selected command transmitting step comprises: Recognizing a user and generating a corresponding digital signal in response to the received voice input information; Converting and outputting the digital signal into HTTP-based data corresponding to the selected command; And And transmitting the HTTP-based data corresponding to the selected command through the wired / wireless integrated internet.