KR20030027920A - Method and Apparatus for status checking home automation/home network using by speech recognition in a remote - Google Patents

Abstract

PURPOSE: A device for monitoring home automation/home network states using a remote voice recognition control function is provided to remotely control apparatuses connected through a wire/wireless network, and to remotely receive a state and a situation of a specific apparatus or the entire apparatuses as a voice, thereby receiving all situations of home automation-targeted apparatuses as a voice. CONSTITUTION: A voice recognition remote controller(100) recognizes a command inputted through a voice of a user at home or outside of the home, and wirelessly generates a corresponding signal. A home server(200) automatically controls an entire home automation system by corresponding to control command data transmitted through an Internet control module(190), or an output signal of the voice recognition remote controller(100), or a voice command transmitted from outside, and recognizes a state reporting command of entire controlled apparatuses or a specific apparatus, then generates report data after measuring states of the apparatuses to report the data as a voice. A wire/wireless control module(180) transmits user voice information transmitted through wired phone(181)/cellular phone(182)/information apparatus(183) to the home server(200), and transmits a voice report message transmitted from the home server(200) to the wired phone(181)/cellular phone(182)/information apparatus(183).

Description

Home automation / home network status monitoring device using voice recognition and method thereof remotely {Method and Apparatus for status checking home automation / home network using by speech recognition in a remote}

The present invention provides a remote control, power line, and other control of the general home appliances through the telephone (wired phone, mobile phone) and other information equipment using the voice from outside the home for remote voice recognition control (Remote Control) Remotely control the devices connected through the wireless network network, and also use the remote voice recognition to remotely report the status of a specific device for home automation or the status and status of the entire device by voice. The present invention relates to a method for monitoring and controlling the status of a home automation / home network system.

Generally, television sets, TVs, audio equipment and boilers, air-conditioning systems such as air conditioners, microwave ovens, rice cookers and dish dryers, kitchen appliances such as dishwashers, and household appliances such as washing machines can be operated in a single control manner. It is.

In recent years, there have been attempts to integrate and control home appliances, and also to control door locks to open doors or to control curtains and blenders by controlling door locks remotely through the connection between home appliances and home automation devices. Control has been sought from various angles to adjust the brightness of the lights or to enable on / off control of the lights.

However, the user can easily control many of these home appliances, but a control function is implemented, but when an obstacle such as a wall is blocked between the home appliances or the user wants to control the boiler, air conditioner, etc. from outside the house Inevitably, users are forced to control the devices in close proximity to the devices or operate a key of a control box installed in the device.

In addition, not only have to selectively operate the various keys provided to control the home appliances, but also the problem that the infrared signal scanning radius of the remote control is limited, so that it is impossible to control the household appliances at a distance outside the scanning radius.

Therefore, a home automation system that can remotely control home appliances through a telephone line has been developed to solve many problems that occur during remote control of home appliances. Such a home automation system provides a convenience that a user can make a call from a remote place, select home devices, and control the buttons.

However, such a home automation system also causes inconvenience due to button manipulation, and also has a problem that its structure is very complicated.

In order to solve such problems of home automation, a new home automation system using voice recognition is newly introduced.

Looking at the prior art of home automation systems using voice recognition, Korean Patent Office Publication No. 2002-78726, Korean Patent Office Publication No. 2000-45069, Korean Patent Office Publication No. 2001-44639 And the like.

Looking at the contents of the known prior art, a technique for controlling a home automation system through speech recognition is disclosed.

However, these conventional technologies are also possible to control the remote control of home devices using voice, but at present, the status of all devices managed by the home automation system through voice report or remote automatic meter reading, etc. There was no function to report.

Therefore, the user can not check the status of the current home appliances from outside the home, so if you suspect that you have performed the control yourself (for example, to close the gas valve), do not see the work properly and return home quickly. There was often a case.

Accordingly, the present invention has been proposed to solve various problems occurring in the home automation system using the conventional speech recognition as described above.

The present invention provides a remote control, power line, and other control of the general household devices through the information devices using a telephone (wired telephone, mobile phone) and other voice from outside the home for remote voice recognition control (Remote Control) Remotely controls devices connected via a wireless network, and also provides remote voice recognition for remotely voice recognition of the status of a particular device for home automation or the status and status of all devices. The purpose of the present invention is to provide a method for monitoring and controlling the status of home automation / home network systems.

Another object of the present invention is to remotely report the status of a particular device by voice. The present invention provides an apparatus and method for monitoring and controlling the status of a specific home appliance.

It is still another object of the present invention to provide an apparatus and method for monitoring and controlling the state of an entire home apparatus by remotely reporting a state of the entire apparatus by voice.

The present invention for achieving the above objects,

Equipped with voice recognition module, it facilitates home automation with voice in daily life through control of natural language conversation method, and makes various combinations by configuring system by combination through modular development.

In addition, it implements a system that can control itself without controlling the system one by one, that is, implements an artificial intelligence control system, and implements a fully automatic system that can recognize and determine the surrounding situation according to the season / day / state itself.

In addition, the system is implemented so that the home automation equipment can be operated independently even when the system is down.

"Home automation / home network status monitoring apparatus using voice recognition at a remote location" according to the present invention for achieving the above objects,

In the home automation / home network status monitoring apparatus using voice recognition,

After the user recognizes a command input through voice in the home, the corresponding signal is wirelessly or wired to the facility control module connected to the air conditioner, the power control module, the home theater control module, the light control module connected to the light, the electricity meter / water supply Remote metering module connected to meter / hot water meter / gas meter / heating flow meter, security module connected to human body sensor / proximity sensor / glass damage sensor, safety module connected to heat sensor / gas sensor, CCTV / CATV / camera Connected image processing module, internet control module connected to PC through internet network, infrared generator for generating infrared (IR) signal for controlling each device, television receiver, web-phone / web-pad / personal information terminal (PDA) ) Connected, the output signal of the voice recognition remote control or the voice command transmitted from the outside or the control command data transmitted through the Internet control module It automatically controls the home automation system as a whole, and recognizes when the status report data of a specific device or all the devices to be controlled are transmitted by voice from the outside and measures the status through the automatic status measurement function. A home server for reporting;

And a wired / wireless control module for transmitting the voice report message transmitted from the home server to the landline phone / mobile phone / information device.

In the above, the home server,

A voice recognition unit for recognizing an input voice signal;

A data input unit for receiving data generated in connection with each module;

The data generated by the data input unit is converted into a database and stored in a control database, a control command corresponding to the voice recognized by the voice recognition unit is transmitted, and when a report command is input, the state detected by each module is read out as voice. A control unit controlling to report;

A control command execution unit for transmitting a control command to a corresponding device in response to the control command sent from the control unit;

In response to the voice report control generated by the control unit is characterized in that it comprises a voice transmission unit for transmitting the state of each device to the voice to transmit to the external landline phone / mobile phone / information device.

"Home automation / home network status monitoring apparatus and method using the voice recognition from the remote" according to the present invention for achieving the above objects,

In the home automation / home network status monitoring method using voice recognition,

A first step of transmitting an announcement when the user accesses the home automation system using a wired / wireless telephone and recognizes a voice input by the user;

A second step of storing a voice message input by the user after the announcement for informing the voice message storage if the user selects the voice message storage as a result of the recognition of the first step;

A third step of determining whether or not normal information is input when relevant information is input through a user approval process using a preset secret authentication system when the user selects home automation as a result of the recognition in the first step;

A fourth step of transmitting a warning message when the secret authentication data inputted as a result of the determination of the third step is abnormal (error) and the number of error times is set or more;

If the secret authentication data inputted as the result of the determination of the third step is normal, the command input message is sent. When the voice command is transmitted by the user, the command is recognized and analyzed. And a fifth step of reporting the status of each device by voice.

In the fifth step,

Recognizing a voice input by a user;

When the input voice is recognized, determining whether the recognized voice is a control command;

Requesting execution if the voice recognized as a result of the determination is a control command, performing an operation when the execution command is transmitted, checking whether the processing is normal through the control database, and if the execution is successful, sending a normal processing message; ;

Automatically checking a state of a specific part when the recognized voice is a specific part status confirmation command, and as a result, transmitting a message as a voice;

When the voice recognized as a result of the determination is a report command, it is characterized in that the step of automatically checking the status of the entire home automation system target device, and reporting the check result in a voice corresponding to a predetermined order.

The fifth step may further include ignoring the input voice when the input voice is recognized and the recognized voice is not a control command, a specific part status check command, or a report command. .

1 is a block diagram showing the configuration of a home automation / home network status monitoring apparatus using voice recognition from a remote in accordance with the present invention,

2 is a diagram illustrating an embodiment of a home server of FIG. 1;

3 is a flowchart illustrating a method of monitoring home automation / home network status using voice recognition from a remote place according to the present invention;

4 is a flowchart illustrating an example of a voice processing routine of FIG. 3 in detail.

<Description of the symbols for the main parts of the drawings>

100 ..... Voice recognition remote controller 110 ..... Facility control module

120 ..... Power Control Module 130 ..... Lighting Control Module

140 ..... Remote meter reading module 150 ..... Security module

160 ..... Safety Module 170 ..... Image Processing Module

180 ..... wired / wireless control module 190 ..... Internet control module

200 ..... Home Servers 210 ..... Infrared Generators

220 ..... Web-Phone 230 ..... Web-Pad

240 ..... PDA250 ..... TV

310 ..... speech recognition unit 320 ..... data input unit

330 ..... Control Database 340 ..... Controls

350 ..... Control Command Execution Unit 360 ..... Voice Transmitter

Hereinafter, a preferred embodiment of the present invention according to the technical spirit as described above will be described in detail with reference to the accompanying drawings.

Example 1

1 is a block diagram showing the configuration of a home automation / home network status monitoring apparatus using voice recognition from a remote according to the present invention.

Here, reference numeral 100 denotes a voice recognition remote controller that wirelessly generates a signal corresponding thereto after recognizing a command input by the user through voice in the home, and reference numeral 110 denotes an air conditioner (air conditioner, boiler) 111. The equipment control module connected is indicated, reference numeral 120 denotes a power control module, reference numeral 130 denotes a lighting control module connected to the lights such as the room 131 / living room 132 / 2nd floor 133 / small room 134, etc. Reference numeral 135 denotes a home theater control module, and reference numeral 140 denotes a remote meter connected to a power meter 141 / water meter 142 / hot water meter 143 / gas meter 144 / heating flow meter 145. The module 150 denotes a security module connected to the human body sensor 151 / proximity sensor 152 / glass breakage sensor 153, reference numeral 160 denotes a heat sensor 161 / gas sensor ( 162) refers to the safety module connected, reference numeral 170 denotes an image processing module connected to the CCTV 171 / CATV 172 / camera 173, and reference numeral 190 denotes an Internet control module connected to the PC 191 through the Internet network 192.

In addition, reference numeral 200 controls the infrared generator 210 for generating an infrared (IR) signal for controlling the respective devices, the television receiver 250, the web-phone 220 / web-pad 240 / personal Connected to an information terminal (PDA) 250 or the like, and home automation corresponding to an output signal of the voice recognition remote controller 110 or a voice command transmitted externally or control command data transmitted through the Internet control module 190. Represents a home server that automatically controls the system as a whole and recognizes the status report command of a specific device or all devices under control from the outside, and measures the status using the automatic status measurement function, and then reports the status by voice. , Reference numeral 180 transmits a voice command of a user transmitted from the outside through the wired phone 181 / mobile phone 182 / information device 183 to the home server 200, the home server (2) 00) shows a wired / wireless control module for transmitting the voice report message transmitted from the wired telephone 181 / mobile phone 182.

In the home server 200, as shown in Figure 2,

A voice recognition unit 310 for recognizing an input voice signal; A data input unit 320 for receiving data generated in connection with each module; Data generated by the data input unit 320 is converted into a database and stored in the control database 330, and a control command corresponding to the voice recognized by the voice recognition unit 310 is transmitted, and each report is input when a report command is input. A control unit 340 which controls to report the state detected by the module by voice; A control command execution unit 350 for transmitting a control command to a corresponding device in response to the control command sent from the control unit 340; In response to the voice report control generated by the controller 340, the voice transmitter 360 transmits the state of each device to voice and transmits the state to an external wired telephone 181 / mobile phone 182 / information device 183. It is provided.

In the home automation / home network state monitoring apparatus using the voice recognition in the remote configuration according to the present invention configured as described above, when a user commands a control command by voice using the voice recognition remote controller 110 at home or outside the home, After recognizing this in step 200, the control operation is performed correspondingly.

In addition, when a control command is issued by voice using a wired telephone 181 / mobile phone 182 / information device 183 from the outside, it is received through the wired / wireless control module 180 and then the voice recognition unit 310 is received. When the voice recognition is performed, and the voice recognition is performed, the control command is transmitted to the corresponding device through the control command execution unit 350 or the state of the device is checked through each module.

In the case of the status check, the result of the check is transmitted to the landline phone 181 / mobile phone 182 / information device 183 through the voice transmitter 360, so that the user can conveniently remotely control the status of the home automation target device. To check.

Hereinafter, the entire operation of the home automation / home network state monitoring apparatus using voice recognition in the remote operation according to the present invention operating as described above will be described by dividing each block as follows.

First, the security function, home server 200 in conjunction with the security module 150, to build the first, second, third, fourth monitoring system, in case of emergency to the head of household, police, fire department, management station, special personnel Attempt an emergency call, send text message (SMS) and video information. Looking at the configuration, and equipped with a human body sensor 151, proximity sensor 152, glass break detection sensor 153, and primarily detects the boundary line to determine the intrusion, secondary doors (DOOR) ) OPEN / CLOSE is detected to determine the intrusion, and the third motion is detected to determine the intrusion. Fourthly, the voice is recognized to judge the intrusion.

[Table 1] below is a diagram showing the above-described monitoring system in more detail.

division location H / W process Primary detection Outskirts (wall of house) Infrared and Proximity Sensors 1. Location prohibition voice message, 2. CCTV recording voice message, 3. Outside light (on), 4. Warning message for police report after returning to home after 10 seconds, 5. Door lock Secondary detection Door (door, window) Proximity sensor, glass breakage sensor 1. Intrusion warning and alarm occurrence, 2. CCTV recording and recording warning, 3. Lighting on, 4. Police report message after 5 seconds, 5. Householder's phone and SMS, 6. Door lock 3rd sense Indoor PIR 4th detection Voice ("The Thief") Recording device (stored in memory) 1. Police report message, 2. Turn on and record the lamp after 10 seconds, 3. Police report, 4. Call and SMS to householder, acquaintance, 5. Special language recognition in security mode instead of emergency button, 6. Release door

Next, with reference to the safety function, the home server 200 performs the gas and fire monitoring function in conjunction with the safety module 160. In case of an emergency, emergency calls are made to householders, police, fire departments, detention centers and special persons, text messages (SMS) are maintained, and 24-hour monitoring is maintained. Looking at the configuration, the heat sensor 161, the gas sensor 162 is provided, the control object is a light control, window control, telephone, broadcast, gas valve.

For example, the control flow during gas leakage will be briefly described. For example, gas valve closing, warning broadcast, door release, and lighting control such as spark control prohibition, window opening, and the like.

In addition, the control flow in case of fire briefly, gas valve closing, fire alarm broadcasting, door release, the window open order.

Looking at the operation plan, if an emergency alarm occurs, the release button must be pressed to release it, and the release instruction must be given through the voice recognition remote controller 100, and if the release button is not pressed within 1 minute, the guard room notification and SMS or video data are sent to the head of household. If it is not released within 2 minutes, it will automatically call the fire department.

Next, looking at the facility control function, the home server 200 in conjunction with the facility control module 110, controls the heating and cooling of the household. It is designed to be controlled manually or automatically by the medium pressure intensive control method. Temperature can be set using remote control and terminal. Looking at the configuration, there are PID control (heat source ie heating (boiler) and system action start / stop), air conditioner control (FAN, valves, dampers, ventilation fans).

Looking at the air conditioning control process, it is possible to control the temperature by the room sensor, automatic temperature control by the external temperature, it is possible to control the temperature according to the temperature setting by time zone. In addition, when a fire is detected by the smoke detection sensor, the ventilation window is automatically opened to stop the operation of the intake fan, and the exhaust fan is automatically started due to the fear of spreading the smell of special rooms such as toilets, restaurants, and bathrooms. In addition, it is possible to control according to the sleep mode, wake mode, going out mode, schedule mode.

Looking at the operation plan, the Home Network System (IDC) collects and analyzes data through the Intelligent Digital Controller (IDC) and uses open protocols to interface with other systems. IDC is connected to the home network system via RS-485. Field equipment includes temperature / humidity sensors, transducers, relays, and photo sensors.

Next, referring to the power control function, the home server 200 is connected to the power control module 120, and demand control and electrical leakage of electric power is interrupted in order to cut off the priority of the interruption from low load in order to overload the electricity consumption in the household. It provides a function to monitor the back.

Looking at the operation plan, the demand is automatically controlled by the value set by the automatic operation, and the system is configured to monitor the leakage of the risk of fire. Automatic management is achieved by setting the monthly usage estimate for each household.

Next, looking at the lighting control function, the home server 200 in conjunction with the lighting control module 130, to maintain a suitable lighting brightness to provide a comfortable environment and energy saving effect to the occupants. Control should be possible by control of illuminance sensor, remote control, home server, and stand-alone function.

Looking at the configuration, the configuration using a dedicated line, the configuration using a PLC, the configuration using RF, the configuration using a programmable switch (S / W), the configuration using an illumination sensor, the configuration by the home server 200, by its own schedule Control, curtain control, and the like.

Looking at the operation plan, the lighting control method using the voice recognition remote controller 100, the programmable switch, the terminal of the home server, and the control system, and the control method based on the time schedule should be available, and the illumination and PIR sensor To be controlled.

In addition to the on / off control as well as dimming (Dimming) control is possible, not only the generation can be controlled from the outside, but also records the control.

Next, looking at the remote meter reading function, the home server 200 is stored in the control database (DB) 330 of the home server in conjunction with the remote meter reading module 140, not only the entire data but also generation by generation. Through the cumulative management of data, it is easy to manage and refer to usage information.

Looking at the components, it consists of a power meter 141, a water meter 142, a hot water meter 143, a gas meter 144, a heating flow meter 145.

As an example of the remote meter reading processing, when a remote meter reading request is requested by the remote meter reading or the icon touch on the terminal, the remote meter reading is displayed in the form of a spreadsheet on the terminal, and the voice recognition unit 310 and the meter reading amount of the current month Voice the amount,

Next, look at the Internet control function, the home server 200 is connected to the Internet control module 190, not only control, but also monitor the status of the house. It requires a network configuration that has a fixed IP or can be connected to a specific household from the outside, In addition, a password (authentication system) must be provided for security, and security should be given to the maximum because it can be a security problem.

Looking at the configuration, the system should be configured to access the home server from the outside. Flexible system configuration for various communication methods such as xDSL, TCP / IP, and ISDN should be implemented.

Looking at the control plan, it is possible to control home / lighting / curtain / security / safety functions. When controlling, make sure to check the control and prevent problems caused by wrong control in advance. The control screen is flat and graphicized for direct control.

Looking at the operational plan, you should configure your home server so that it can be easily accessed from anywhere via an Internet browser. If you connect from outside, send a connection message to the household. Leave a record of when accessing from the outside, so that it can be traced later. The record of control is composed of weekly, monthly / yearly units.

As an example of an internet control process, the home server is connected to the home server through the Internet, and the valve is closed after checking the gas valve status through the Internet. Next, turn on the living room lights over the Internet. Before returning home, check the room temperature on the Internet and turn on the air conditioner or heater to set the temperature in advance.

Next, referring to the image processing function, the home server 200 processes analog signals from the CCTV 171, the CATV 172, the camera 173, and the like in connection with the image processing module 170, and processes the respective signals. Select and monitor on a specific terminal.

Looking at the configuration, the analog image input unit showing the image of the various channels in one channel, converts the analog image into digital image data, and used for screen capture (Capture), PDA (240), Web-phone (220), An analog image processor for performing digital image processing such as the web pad 230, an analog image monitoring unit for monitoring with analog images such as the TV 250 HA and the web pad 240, and the like.

Next, referring to the voice recognition function, the voice recognition unit 310 is a voice recognition engine (Engine) is modularized, using a comprehensive database table interworking with the control unit 340. The controller 340 operates in a manner of processing data by processing an instruction for a command instructed by voice in a comprehensive database table and performing flag processing.

Looking at the configuration, the embedded chip (chip) or engine of the home server (200) is mounted on the home server 200 to play the role of the voice recognition, the voice recognition remote control 100 from the wireless (Brutus) ROW data A voice recognition unit 310 for processing is provided.

Looking at the control plan, it is shown in [Table 2] below.

Control target domain action light room Check on / off status curtain Room, living room Check down / up status Home Appliances TV On / off air conditioner On / off window Room / living room Check open / close status gas kitchen Check on / off status HA entrance Video On / Off

Looking at the operation plan, when the voice is instructed through the voice recognition remote control 100, the voice signal is transmitted to the voice recognition unit 310 of the home server 200 via a wireless network. The voice recognition unit 310 analyzes the voice instruction content by the voice recognition processing function. Then, the processed data is generated by the code (CODE) processing function and transferred to the control unit 340. The control unit 340 withdraws the control data corresponding to the generated code from the control database 330, the control group (home appliance control / lighting and curtain control / security function / safety function / door corresponding to the extracted control data) Open), monitoring group (remote reading, self-diagnosis, system status), and conversation group (secretary function, bulletin board data reading). The home appliance control unit in the control group is controlled through the infrared (IR) generator 210.

On the other hand, in addition to the above functions, the home server 200 also implements a personal assistant function.

Automatically delivers information on the anniversary of each year and events according to personal schedules to the heads of households to make plans for the entire schedule. In addition, the date / day / time, etc. interactively for the elderly to serve as a personal assistant.

Looking at the configuration, the home server 200 automatically broadcasts a notification to the family at the time set by the data recorded in the database table (for example, 7:00 am). The broadcast is repeated two or three times so that members of the household can recognize the speaker for PA or Web-Pad / HA. Press the Cancel Key in the middle to stop.

Looking at the operation plan, there is a phone number management feature that dials an automatic phone when you name it with the remote control and automatically connects when you call your name in the phone number finder. In addition, there is an anniversary management function that automatically notifies the voice and terminal on the day when you register an anniversary. What day is it today, what day is it, what time is it? There is an interactive question and answer function. In addition, there is a warning broadcast function using SMS, Voice Call, and message storage and playback. In addition, there is a mode change function for changing modes. Among the mode change functions, the sleep mode optimally controls temperature / humidity, automatically sets data until wake-up, and performs functions such as lighting off, dimming function, security mode on, gas valve closing, and home appliance off. The wake-up mode performs the function of lighting on, security mode off. The outing mode starts after the door is closed and is automatically released when the head of household enters and exits with the card key. Perform lighting off, dimming off, gas valve close function.

Example 2

3 is a flowchart illustrating a home automation / home network state monitoring method using voice recognition from a remote place according to the present invention.

As shown in the figure, when the user accesses the home automation system using a wired / wireless telephone from the outside, the first step (S102 to S112) for transmitting the announcement and recognizing the voice input by the user; A second step (S114 to S118) of storing a voice message input by the user after the announcement indicating the storage of the voice message when the user selects the storage of the voice message as a result of the recognition in the first step (S112); When the user selects the home automation as a result of the recognition in the first step (S112), the third step (S120 ~ S124) to determine whether the password (authentication information) is normal after the password (authentication information) is input by voice )Wow; A fourth step (S126 to S128) for transmitting a warning message when the password (authentication information) inputted as a result of the determination in the third step (S124) is abnormal (error) and the number of error times is set or more; If the password (authentication information) inputted as a result of the determination of the third step (S124) is normal, the command input message is transmitted, and when a voice command is transmitted by the user, the voice command is recognized and analyzed. After checking the state, a fifth step (S130 to S132, S200) of reporting the state of each device by voice is made.

In the home automation / home network status monitoring method using a voice recognition from the remote in accordance with the present invention, a user from the outside using a landline phone or a mobile phone / information equipment to the home automation control device equipped with a home , The ring arrives as in step S102.

In step S104, the number of rings is counted, and in step S106, an off-hook state is detected. Here, the off-hook state refers to a state in which the hook switch is turned off by receiving a call from another person, and the on-hook state refers to a state in which the handset is pressing the hook switch as it is without receiving a call from another person.

If the other person picks up the handset as a result of detecting the off-hook state, the user enters the off-hook state and enters the normal telephone mode as in step S134.

However, when another person is on hook without picking up the handset, the process goes to step S108 to check whether the ring has arrived more than the set number of times. This is to automatically switch to the home automation control device when the ring occurrence is more than the set number of times.

As a result of the above confirmation, if the number of ring incoming calls is more than the set number of times, the message is automatically switched to the home automation control device, and the flow proceeds to step S110. do.

After the announcement, if the user selects 1 or 2 as voice, the process moves to step S112 to recognize the input voice. In step S114, it is checked whether the recognized voice is a voice message storage selection, and if so, moves to step S116 and sends a message saying "Please leave a message after the beep" and the user inputs in step S118. Voice messages are stored in memory.

Next, when the user selects the home automation as in the recognition result step S120 of step S112, the process moves to step S122 to request a password (authentication information), and if the password (authentication information) is input by the user by voice. Go to S124 and check whether the authentication information entered is correct.

If the authentication information inputted as a result of the check is incorrect, the process moves to step S126 to check whether the number of errors is three or more times. If the number of errors is less than three times as a result of the check, go to step S122 and send out a message for inputting authentication information again.If not more than three times, go to step S128 and send out a warning message. Will end.

On the other hand, if the inputted authentication information is normal as a result of confirming the inputted authentication information, go to step S130 to transmit a voice "Instruct", in step S132 receives the input voice message, in step S200 The operation is performed in response to the received voice message.

4 is a flowchart illustrating an embodiment of step S200 in detail.

As shown therein, step S202 of recognizing a voice input by a user; When the input voice is recognized, determining whether the recognized voice is a control command (S204 to S206); Requesting execution when the recognized voice is a control command, executing the operation when the execution command is transmitted, checking whether the processing is normal or not through a control database, and if the execution is normally performed, sending a normal processing message ( S208-S218); Automatically confirming a state of a specific part when the recognized voice is a specific part status check command and transmitting the message as a result of the voice (S220 to S224); If the voice recognized as a result of the determination is a report command, automatically checking the state of all devices targeted for the home automation system, and then reporting the check result as a voice in a predetermined order (S226 to S230); If the recognized voice is not a control command, a specific part status check command, or a report command, the input voice is ignored (S232).

The speech processing routine thus achieved first recognizes the voice input by the user in step S202. In step S204, it is checked whether the input voice is recognized. If the voice is recognized as a result of the check, the process moves to step S206 to determine whether the recognized voice is a control command.

If the voice recognized as a result of the determination is a control command, the process moves to step S208 to send a voice message according to the code, and in step S210, execution is requested, and if the execution command is transmitted in step S212, the operation is performed.

In step S214, the execution state is checked in the database table two seconds after the execution, and in step S216, whether or not normal processing is checked, and if it is processed normally, the process proceeds to step S218 and sends out a normal processing message.

On the other hand, if the voice recognized as a result of the determination is a specific part status check command, the process moves to step S222 to automatically check the state of the specific part, and in step S224, the result message is transmitted as voice.

In addition, when the voice recognized as a result of the determination is a report command, the process proceeds to step S228 and automatically checks the status of all devices of the home automation system, and then, in step S230, the check result is reported in a voice in a predetermined order. You will.

If the recognized voice is not a control command, a specific part status check command, or a report command, the voice is moved to step S232 to ignore the input voice, and the voicement and the approach of each step can be adjusted as necessary. .

According to the present invention as described above, the voice recognition remote control and the power line and other control of the general household devices as a voice signal through a voice recognition remote controller and a telephone (wired telephone, mobile phone) and other information equipment outside the home With respect to the devices controlled by the connection of the wireless network, it is possible to remotely report and receive the status and status of a specific device or the entire device.

Claims (5)

In the home automation / home network status monitoring apparatus using voice recognition, A voice recognition remote controller for wirelessly generating a signal corresponding to a command input by a user through voice in a home / outdoor; Facility control module connected with air conditioner, power control module, lighting control module connected with lighting such as home / living room / 2nd floor / small room, home theater control module, electricity meter / water meter / hot water meter / gas meter / heating flow meter Security module connected to meter reading module, human body sensor / proximity sensor / glass damage sensor, safety module connected to heat sensor / gas sensor, image processing module connected to CCTV / CATV / camera, connected to PC via internet network An Internet control module, an infrared generator for generating infrared (IR) signals for controlling the devices, a television receiver, a web-phone / web-pad / personal information terminal (PDA), and an output signal of the voice recognition remote controller Or automatically control the home automation system as a whole in response to an externally transmitted voice command or control command data transmitted through the Internet control module. When in this state report command for a particular device or a controlled device, the entire transmitted over the phone recognizes it, and then measuring the status by the automatic status report measurements produce the data, the home server and reporting status to the voice; Wired / wireless control module for transmitting the voice information of the user transmitted through the wired phone / mobile phone / information device from the outside to the home server, and transmits the voice report message transmitted from the home server to the wired phone / mobile phone / information device Home automation / home network status monitoring apparatus using voice recognition from a remote, characterized in that configured to include. The method of claim 1, wherein the home server, A voice recognition unit for recognizing an input voice signal; A data input unit for receiving data generated in connection with each module; The data generated by the data input unit is converted into a database and stored in a control database, and a control command corresponding to the voice recognized by the voice recognition unit is extracted from the database and transmitted, and detected by each module when a report command is input. A controller for controlling the status to be reported by voice; A control command execution unit for transmitting a control command to a corresponding device in response to the control command sent from the control unit; In response to the voice report control generated by the control unit, the home automation system using a voice recognition remotely comprises a voice transmission unit for transmitting the state of each device to a voice and transmitting it to an external wired telephone / mobile phone / information device. Home network status monitoring device. In the home automation / home network status monitoring method using voice recognition, A first step of transmitting an announcement when the user accesses the home automation system using a wired / wireless telephone and recognizes a voice input by the user; A second step of storing a voice message input by the user after the announcement for notifying storage of the voice message when the user selects to store the voice message as a result of the recognition of the first step; A third step of determining whether the authentication information is normal when the authentication information is input by voice after requesting input of the authentication information when the user selects home automation as a result of the recognition in the first step; A fourth step of transmitting a warning message when the authentication information inputted as the determination result of the third step is abnormal (error) and the number of error counts is set or more; If the input password is normal, the command input message is sent. If the voice command is transmitted by the user, the command input message is recognized and analyzed. Home automation / home network status monitoring method using a voice recognition from the remote, characterized in that comprises a fifth step of reporting the status of each device. The method of claim 3, wherein the fifth step, Recognizing a voice input by a user; When the input voice is recognized, determining whether the recognized voice is a control command; Requesting execution if the voice recognized as a result of the determination is a control command, performing an operation when the execution command is transmitted, checking whether the processing is normal through the control database, and if the execution is successful, sending a normal processing message; ; Automatically checking a state of a specific part when the recognized voice is a specific part status confirmation command, and as a result, transmitting a message as a voice; When the voice recognized as a result of the determination result is a report command, and automatically checks the status of the entire device for the home automation system, and the report result of the check in a voice corresponding to a predetermined order remotely characterized in that Home Automation / Home Network Status Monitoring Method using Voice Recognition. The method of claim 4, wherein the fifth step further comprises the step of ignoring the input voice when the input voice is recognized and the recognized voice is not a control command, a specific part status check command, or a report command. Home automation / home network status monitoring method using voice recognition from the remote.