KR20030045238A - Internet-Based Home Automation Server and Control Method Thereof - Google Patents

Abstract

PURPOSE: An Internet based home automation server and a control method thereof are provided to control electric devices and facilities in a house through a computer, a cellular phone and a wireless communication terminal supporting the Internet, and to automatically generate alarms upon generation of abnormality through gas, fire and crime prevention sensors installed in security-requiring positions. CONSTITUTION: A central control unit(100) controls input and output signals transceived with a server device, and stores data and programs related to operations of the server device. A user interface(110) receives audio or video signals from the central control unit(100) to display the received signals on a screen, and includes an operation plate for control of the server device. A security controller(120) operates a security function by the signals transmitted from the central control unit(100), if an abnormal state is sensed from a security sensor. A network gateway(130) connects a wide-band Ethernet with a home Ethernet or a Bluetooth wireless network. A home automation unit(140) connected with the central control unit(100) controls operations of electric and electronic devices and facilities. And a sensor(150) senses security states of gas, fire, and crime and disaster prevention, and also senses operation states of the electric and electronic devices and facilities.

Description

Internet-Based Home Automation Server and Control Method Thereof}

The present invention controls various electrical and electronic devices and facilities in the home using a computer, a mobile phone, and a wireless communication terminal supporting the Internet, and detects a dangerous situation such as an intrusion, a fire, a gas leak, and generates an alarm. The present invention relates to an Internet-based home automation server and a control method for implementing functions such as control, crime prevention, and disaster prevention in various ways.

In general, home automation (Home Automation) refers to a technology that makes it possible to automate the control of various electrical and electronic devices and facilities in the home using electronic technology.

A home automation control device currently installed in a home refers to a video door phone that allows a visitor to make a call while watching a video screen, and detects gas leaks, fires, and unauthorized intrusions. It is a common case that a security control function that detects an alarm and generates an alarm sound and automatically contacts the security office is added. Recently, with the development of information and communication technology, the concept of an integrated home automation system in which various devices and facilities in the home, such as lighting devices, air-conditioning devices, meter reading devices, and white appliances, are connected through wired and wireless home networks, and they are monitored and controlled remotely through the Internet It is emerging.

The key technologies in integrated home automation systems are home network technology that minimizes wiring and design and manufacture of home automation control devices that provide Internet services.

Home automation networks that do not require separate wiring include wired communication using power lines or telephone lines, and wireless communication methods using Bluetooth or WLAN. Recently, communication interface technology and cost problems have been greatly improved. Although the difficulty is small, there is no standard of application.

On the other hand, a home automation control device for connecting various devices and facilities in a home through a home network generally uses a server class to be connected to the Internet. The lower cost and improved performance of Personal Computers can make a home personal computer take over its functions, but can be used exclusively to perform integrated control of home appliances, including security, with security turned on for 24 hours each day. It needs to be configured as an (Imbeded) system. As a result, efforts to embed a home automation control device in the form of a set-top box have been sporadically attempted, but a device installed and operated separately from the problems of embedded web server and home network interface technology. Is still a problem.

In order to solve this problem, the present invention proposes a home automation server as a device in which an external internet communication network and an internal wired or wireless home network are connected to a conventional video door phone limited to a visitor video call and a security control function. Comprehensive automation function for remote control or monitoring of devices and facilities through wired and wireless internet and addition of Network Gateway function to enable simultaneous internet access of computers in the home, but secure network access from outside It is an object to present a control method.

To this end, the home automation server apparatus according to the object of the present invention is to receive an audio signal or a video signal from a central control unit, a central control unit for controlling input and output signals to and from the server device or storing programs and data related to the operation of the server device. A user interface unit which has a display panel on the screen and a control panel for controlling a server device, a security control unit that activates a security function by a signal transmitted from a central control unit when an abnormal state is detected by a security sensor, and broadband Ethernet. Network gateway that connects to Ethernet or Bluetooth wireless network, home automation that is connected to the central control unit to control the operation of electric and electronic devices and facilities, and security status such as gas leakage, fire, crime prevention and disaster prevention Operation of electronic devices and equipment It provides an Internet-based home automation server comprising a detection sensor for detecting a state.

On the other hand, according to another object of the present invention, the configuration of the software for controlling the electrical and electronic devices and equipment connected to the home automation server device is based on the sharing of data by multiple processes and threads through a shared memory, Web server process that works with CGI program and Java Applet server program for accessing mobile phone, user interface process that sends and receives data to and from web server process through shared memory, including video display, touch screen and telephone function, sharing Send and receive data to and from web server programs through memory, central control processes including home automation threads, security control threads, detection sensor threads, and Bluetooth threads, send and receive data to and from web server programs, firewalls, intruders, and network Provides an Internet-based home automation server characterized by interworking with a network kernel program having a translation function and a dynamic host configuration protocol server process for transmitting and receiving data with the network kernel program and automatically allocating network addresses of computers and terminals in a home. do.

On the other hand, according to another object of the present invention, the video door phone integrated Internet-based home automation server device to connect various electrical and electronic devices and equipment of the home through a wired or wireless home network, remote control or monitoring video through the Internet and mobile phones In the method of controlling the door-based integrated internet-based home automation server, when the door bell rings, the visitor image is checked through the display window, the door is opened after the call is made, and the security sensor is activated when the security mode is set. Send alert messages to designated mobile phones, administration offices and security firms, and then switch the security mode to secure mode, automatically assign a network address and install a firewall on the computers in your home, Security and authentication process when connecting to the server Operating the web server program; obtaining home automation control commands from the Internet and a mobile phone or touchscreen or Bluetooth terminal; and controlling home automation such as remote meter reading, gas shutoff, lighting control, air conditioning control, home appliance control, and remote video surveillance. It provides a control method of the Internet-based home automation server comprising the step of performing a command.

1 is a schematic block diagram of the entire system of the present invention;

2 is a block diagram showing a configuration of a user interface unit according to the present invention;

3 is a block diagram showing a configuration of a security control unit according to the present invention;

4 is a block diagram showing the configuration of a network gateway unit according to the present invention;

5 is a block diagram showing a configuration of a home automation unit according to the present invention;

6 is a block diagram showing a configuration of a sensing sensor unit according to the present invention;

7 is a block diagram showing the software configuration of a home automation server according to the present invention;

8 is a flowchart illustrating a control process of a sensor attachment device and a security device according to the present invention.

<Explanation of symbols for the main parts of the drawings>

100: central control unit 110: user interface unit

120: security control unit 130: network gateway unit

140: home automation unit 150: detection sensor unit

200: display unit 210: password processing unit

220: dialing unit 230: audio input and output unit

240: video input unit 250: touch screen unit

260: phone 300: video signal transmission unit

310: command signal output unit 400: hub A

420: Bluetooth AP510: power line communication master unit

610: detection signal processing unit

Hereinafter, with reference to the accompanying drawings will be described in detail a preferred embodiment of the present invention.

1 is a schematic block diagram of an entire system according to the present invention.

The integrated home automation server according to the present invention includes a central control unit 100, a user interface unit 110, a security control unit 120, a network gateway unit 130, a home automation unit 140, and a detection sensor unit 150. do.

The central control unit 100 functions to comprehensively process the input / output signal data of the entire home automation server according to the present invention according to a control method. The central control unit 100 may include a central processing unit 102, a flash memory 104 that is a nonvolatile memory for storing programs and data, and an SDRAM for temporarily storing data. Memory) 106, power supply 108, and the like. In the conventional home automation system, various communication technologies supporting the current information network environment have not been sufficiently developed. Recently, however, advanced communication environments such as high-speed information communication networks, wireless Internet, and stable networks, various communication technologies and electrical and electronic engineering technologies supporting them are rapidly developing. Accordingly, it is only possible to implement an integrated home automation server including a central control unit 100 capable of individually or totally controlling devices using such a communication network or devices installed on the network.

The user interface unit 110 is configured as a control panel that provides audio sound or shows a video image to a user, and transmits audio and video data to the central controller 100. The user interface unit 110 will be described in more detail with reference to FIG. 2.

When an abnormal situation occurs in the system, the security controller 120 emits an alarm sound or flashes an alarm lamp by a signal transmitted from the central controller 100. Abnormal conditions on the system are when dangerous situations such as outsider intrusion, fire, gas leak, etc. occur. The security control unit 120 will be described in more detail with reference to FIG. 3.

The network gateway 130 functions to provide automatic network address assignment for computers with Internet access in the home, network access function of the Bluetooth terminal, and security and authentication function when accessing the Internet from the outside. According to the embodiment of the present invention, various network connection means, for example, a computer, a mobile phone, a Bluetooth terminal, etc., provide a user with a simple security and authentication procedure anytime, anywhere to access the home automation server to control indoor devices. . The network gateway 130 will be described in more detail with reference to FIG. 4.

The home automation unit 140 functions to directly control various electric and electronic devices and facilities in the home. The home automation unit 140 will be described in more detail with reference to FIG. 5.

The sensor unit 150 detects an abnormal state on a system such as a door open, a window open, a gas leak, a fire, and the like through sensors installed in various places such as doors and windows of a home, and detects such an abnormal state. It transmits a signal to the central control unit 100. The detection sensor unit 150 will be described in more detail with reference to FIG. 6.

2 is a block diagram showing the configuration of a user interface unit 110 according to the present invention.

The display unit 200 displays a menu table for operating the system on the screen of the home automation server device or shows a visitor image captured by the front door phone. In addition, the user may monitor all situations occurring on the system through the display unit 200 and take appropriate measures accordingly.

When the user cancels the security mode, the password processing unit 210 controls the security mode to be released if the user compares the password set in the past with the current input password.

The dialing unit 220 dials the receiving telephone corresponding to the telephone number stored in advance according to the control signal transmitted from the central control unit 100 and transmits a message through the network gateway unit 130.

The audio input / output unit 230 notifies the user in the home when an outsider visits the home, so that the user makes a phone call with the visitor, or when the user is not in the home, the audio input / output unit 230 is previously displayed in the flash memory 104 of the central control unit 100. This function outputs the stored voice message to the visitor.

The video input unit 240 converts an image of a visitor located in the front door phone 270 or an image photographing a specific area into an image signal and transmits the image signal to the central control unit 100. Therefore, the user may open the front door by checking the visitor's image through the display unit 200, and may monitor the real-time image or the stored image through the Internet or a mobile phone even in a remote place.

The touch screen unit 250 is installed on the display unit 200 to receive a user's command. The coordinate values input by the user by pressing a specific point of the touch screen unit 250 with a finger or the like are temporarily stored first in a buffer (not shown) in the central control unit 100, and the central control unit 100 is touch screen. Through the control command corresponding to the coordinate value input by the user to control the operation of the system.

The phone 260 connects a speaker phone (not shown) and a Bluetooth phone (not shown) using a built-in speaker and a microphone to a public telephone network or an Internet telephone network, and provides the same functions as a general telephone.

3 is a block diagram showing the configuration of the security control unit 120 according to the present invention.

When an abnormal situation occurs in the system, the video signal transmitter 300 receives a video signal photographed by the video inputter 240 from the central control unit 100, and the management office 360, the security company 370, and the dialing unit ( 220) and transmits the alarm message to the mobile phone.

The command signal output unit 310 receives a command signal transmitted by the central control unit 100 according to a signal transmitted from the detection signal processor 610 to be described later, and transmits a command signal to security devices connected to the command signal output unit 310. . Such security devices include an alarm sound output unit 320, an automatic door controller 330, a voice output unit 340, an alarm lamp flasher 350, and the like. The automatic door controller 330 is configured to allow the user to directly control the opening and closing of the door with various control devices to be described with reference to FIG. 4, and to control the opening and closing of the door remotely by accessing a home automation server through a mobile phone or the Internet outdoors. have. When the security sensor operates in the detection sensor unit 150, the management office 360 and the security company 370 transmit an audio or video signal format transmitted from a home automation server connected to their system by wire or wireless. Receive emergency signal with. Thereafter, the management office 360 or the security company 370 remotely controls the home automation server that has transmitted the emergency signal or directs an employee to the site to perform a function corresponding to an abnormal situation.

4 is a block diagram showing the configuration of the network gateway 130 according to the present invention.

The hub A 400 connects a communication device such as a computer, which is accessible to the Internet, with the central control unit 100 when the user is outside the home, so that the user can control the system. In the present invention, when the user accesses the system from outside the house to protect the system by installing a firewall (Firewall) for the security of the system. A firewall is a network component that protects the internal network from external access. It is a general term for hardware and software to protect internal information assets from external intrusion and to prevent the inflow of harmful information from the outside. The firewall is the only window that works with the external network. To protect the internal network from external connections, the firewall is the IP (Internet Protocol) of the system that requested the service for each service, such as FTP (File Transfer Protocol) or Telnet. External access is blocked by using the address, port number, and the contents of the header. The external access is blocked based on user authentication.

The hub B 410 connects the central control unit 100 with a plurality of computers 430 and 440 in the home to automatically receive the network address of the computer from the central control unit 100. The central control unit 100 uses software of a dynamic host configuration protocol (DHCP) and a network address translation (NAT: Network Adderss Translation, hereinafter NAT) function to allow network capacity. Up to 256 computers can be connected. In addition, the central control unit 100 may connect and use a PDA (Personal Digital Assistant) or Web Pad (Wireless LAN) terminal through a WLAN access point (AP) instead of a computer. have.

The Bluetooth AP 420 functions to connect the Bluetooth terminal 450 to the controller 100 to control the system using the Bluetooth terminal 450. Currently, in order to access the Internet using a mobile communication terminal, a terminal having a data communication function, a notebook computer, and a separate cable connecting the two devices are required. However, Bluetooth is a short-range wireless data communication technology that enables data to be transmitted and received at high speed using radio frequencies without the need for a physical cable for communication in various electromagnetic periods. Bluetooth uses the 2.4 GHz Industrial Scientific Medical (ISM) band, which can be used without permission in the world, so that voice and data can be easily transmitted and received even under obstacles. Bluetooth used in the present invention is a class (Class) 1 can be safely transmitted data to a distance of about 100 meters, and has a data transmission rate of about 1 Mbps. Currently, Bluetooth is being developed continuously, and is emerging as one of the standard technologies for next-generation short-range wireless networking.

Meanwhile, the Bluetooth technology applied in the present invention can be applied to a laptop computer or a Bluetooth web pad in addition to the above-described Bluetooth terminal 460. That is, a Bluetooth dongle having a length of about 10 cm inserted into a USB (Universal Serial Port) is currently developed, and using this, it can be connected to the Internet through the Bluetooth AP 420 without a separate LAN card.

5 is a block diagram showing the configuration of the home automation unit 140 according to the present invention.

Automation control of home electric and electronic devices and facilities according to the present invention uses a power line communication (PLC) technology based on CEBus (Consumer Electronics Bus). Power line communication is used to connect data communication devices to electrical outlets in the home to enable data communication. Usually, AC frequency of 50 to 60 Hz is used. CEBus filters these communication lines by using a filter that carries a 100-400 kHz spread spectrum high frequency signal along with an alternating frequency and separates two signals with different frequencies at the termination. Since the band is used at the same time, it has a strong characteristic against noise. The home automation server is connected to the power line communication master unit 510 through a universal asynchronous receiver transmitter (UART) interface 500, and is connected to a 220V AC power through the power line communication interface 520. The remote meter reading unit 530, the gas blocking unit 540, the lighting control unit 550, the air conditioning control unit 560, the white home appliance unit 570, the electric curtain unit 580, etc., which are in direct control of the control target device, may be used. The power line communication interface 520 exchanges data with a home automation server and performs a home automation control command.

6 is a block diagram showing the configuration of the detection sensor unit 150 according to the present invention.

The detection signal processing unit 610 is a signal input unit for detecting signals of the gas leak sensor 630, fire monitoring sensor 640, security zone 1, 2, 3, 4 (650, 660, 670, 680) sensors, such as doors and windows It receives through 620 and transmits to the central control unit 100 through the host interface 600. Various sensors of the sensing sensor unit 150 in the present invention is not limited thereto, and more various sensors may be additionally included.

7 is a block diagram showing the software configuration of a home automation server according to the present invention.

The software configuration of the home automation server according to the present invention is based on a method in which multiple processes and threads share data through the shared memory 740, and has a modified network kernel program for a network gateway function. In order to provide a home automation service through a mobile phone and the Internet, the web server process 700 interworks with a CGI (Common Gateway Interface) program 710 and a Java Applet server program 720. 740 exchanges data. The user interface process 730 receives a coordinate value of the touch screen unit 250 and converts the coordinate value into control data or displays the operation state of the home automation server on the display unit 200. The central control process 750, which performs the most important functions in the home automation server according to the present invention, includes a home automation thread 752 and a security control unit 120 that are in charge of individual control of electric and electronic devices in the home through power line communication. The security control software of the security control thread 754, the detection sensor thread 756 responsible for the input of the detection sensors, the Bluetooth command of the Bluetooth terminal (758) for the control command transfer and image monitoring and phone functions. The network kernel program 760 includes a firewall 762, an intruder prevention 764, and a NAT 768 program for security and expansion of a network. A DHCP server process (for automatic assignment of a network address of a computer in a home) 770).

8 is a flowchart illustrating a control method of a home automation server according to the present invention.

When the visitor rings through the front door phone 270, the visitor's image appears on the display unit 200 or the mobile phone, and the user opens the door after talking to the visitor (S800). When the security mode is set when the security sensor of the sensor 150 to operate the security mode is sent to the security mode after sending an alarm message to the specified mobile phone and management office 360 and security company 370 (S810). . When using computers in the home, the home automation server automatically assigns a network address and operates the firewall 762 and intruder prevention software 764 (S820). When accessing the home automation server through the Internet or a mobile phone from the outside, the web server program is operated through a security and authentication process (S830). When the home automation control command is transmitted from the Internet and a user interface 110 such as a mobile phone or a touch screen or a Bluetooth terminal, the home automation server receives it (S840), remote meter reading, gas blocking, lighting control, air conditioning control, and home appliances. Home automation control commands such as product control and remote video surveillance are performed (S850).

Therefore, the user can check the current state of the electric device or the facility in real time through various control terminals regardless of whether they are indoor or outdoor, and control the home automation as desired.

As described above, according to the present invention, by integrating and providing a device having a function of detecting an outsider's illegal intrusion, a fire, a gas leak, and controlling various electric and electronic devices in the home, It is easy to install and control.

In addition, it is possible to control various devices connected to the home network through the Internet and a mobile phone from the outside as well as direct control through the touch screen and the Bluetooth terminal on the monitor in the home.

On the other hand, the home automation system automatically assigns network addresses to computers with LAN cards or Bluetooth dongle in the home, and also plays a role as a home gateway with security measures such as firewall and intruder prevention.

This way, anytime, anywhere can control electrical devices and facilities, and at the same time, simply and securely connect the home computer with the Internet, enabling more advanced forms of home automation and gateway functions.

Claims (9)

When the visitor rings, the user in the home can check the visitor's image on the video screen to open the door, or detect the gas leak, the fire, and the intrusion of an unauthorized outside person through the sensor and generate an alarm sound. Or a traditional living room video door phone with security controls that automatically contact security companies, Equipped with a power line communication interface that connects and controls various electric and electronic devices and facilities installed in homes through a power line communication network, Equipped with a Bluetooth communication interface for wireless calls and remote control from home wireless terminals and internet access via a portable computer, Network address expansion, automatic address allocation and network security function between the LAN outside the home and the LAN inside the home, Equipped with an automation function that can remotely control or monitor the electrical and electronic devices and facilities in the home through the Internet, a computer, a mobile phone, a wireless communication terminal, or the like through a touch screen or a Bluetooth terminal. And a server device for enabling simultaneous Internet access of the computers in the home and having a network gateway function for security against network access from the outside. The method of claim 1, wherein the server device A central control unit controlling input / output signals transmitted to and received from the server device or storing programs and data related to operation of the server device; A user interface unit receiving an audio signal or a video signal from the central control unit and displaying the same on a screen and having an operation panel for controlling the server device; A security controller for activating a security function by a signal transmitted from the central controller when an abnormal state is detected by a security sensor; A network gateway unit connecting broadband Ethernet to a home Ethernet or a Bluetooth wireless network; A home automation unit connected to the central control unit to control an operation of the electric / electronic device and the facility; And Sensing sensor unit for detecting a security state such as gas leakage, fire, crime prevention, and disaster prevention in the home or operation state of the electric and electronic devices and facilities Internet-based home automation server comprising a. The method of claim 2, wherein the user interface unit, A display unit for displaying image data generated on a menu table or a home automation system for operating the electrical and electronic devices and facilities; A password processing unit for processing passwords input by a user to release various lock devices of a building in which the electric and electronic devices and facilities are installed; A dialing unit for dialing to a predetermined mobile phone by a control signal received from the central control unit; An audio input / output unit for providing a call function with the person who visited the home; A video input unit configured to transmit image data photographing a visitor of the home and a specific area of the building to the central controller; A touch screen unit installed on the display unit to receive a user's command; And Phone that connects speaker phone and Bluetooth phone through built-in speaker and microphone to public telephone network or Internet telephone network Internet-based home automation server comprising a. The method of claim 2, wherein the security control unit, A video signal transmission unit receiving the video signal from the central control unit and transmitting the video signal to a management office or a security company; A command signal output unit configured to receive a command signal transmitted from the central control unit and transmit the command signal to security devices; And The security device is an alarm sound output unit, automatic door control unit, voice output unit, alarm light flashing unit Internet-based home automation server comprising a. The method of claim 2, wherein the network gateway unit, A first hub connecting the computer outside the home to the central control unit and performing a network security function; A second hub for automatically allocating network addresses to the computers in the home; And Bluetooth terminal for communication using Bluetooth technology and Bluetooth access point (AP) for communication between the Bluetooth terminal and the central control unit Internet-based home automation server comprising a. The method of claim 2, wherein the home automation unit, UART interface for receiving control signals corresponding to data input by the user and the electrical and electronic devices and facilities installed in the home from the central control unit and transmitting them to the electrical and electronic devices and facilities through CEBus standard based power line communication An internet-based home automation server comprising a unit, a power line communication master unit, and a power line communication interface. The method of claim 2, wherein the detection sensor unit, Internet-based home automation server comprising a signal input unit, a detection signal processing unit and a host interface to receive the detection signal detected by the gas leak, fire detection, security sensors installed in the home to the central control unit . The method of claim 2, The configuration of the software for controlling the electrical and electronic devices and facilities connected to the server device is based on the fact that multiple processes and threads share data through a shared memory, A web server process interworking with a CGI program and a Java Applet server program for accessing the Internet and a mobile phone; A user interface process that transmits and receives data to and from the web server process through a shared memory and includes a video display, a touch screen, and a telephone function; A central control process for transmitting and receiving data to and from the web server program through the shared memory and including a home automation thread, a security control thread, a sensor sensor thread, and a Bluetooth thread; A network kernel program that transmits and receives data to and from the web server program, and has a firewall, an intruder prevention, and a network address translation function; And Dynamic host configuration protocol server process for transmitting and receiving data with the network kernel program and automatically allocating network addresses of computers and terminals in the home Internet-based home automation server, characterized in that the interlock. Control method of video door phone integrated internet based home automation server that connects various home electric and electronic devices and facilities to wired / wireless home network and remotely controls or monitors via internet and mobile phone To (a) checking the visitor image through the display window when the bell rings at the door phone, opening the door after making a call; (b) changing the security mode to the security mode after sending an alarm message to a designated mobile phone, a management office, and a security company when the security detection sensor operates when the security mode is set; (c) automatically assigning a network address to computers in the home and installing a firewall; (d) operating a web server program through a security and authentication process when accessing the server from the outside through the Internet or a mobile phone; (e) obtaining home automation control commands from the Internet and a mobile phone or touch screen or Bluetooth terminal; And (f) performing home automation control commands such as remote meter reading, gas shutoff, lighting control, air conditioning control, home appliance control, remote video surveillance, etc. The control method of the Internet-based home automation server comprising a.