KR100523907B1 - Intelligent Control and Monitoring System for Home and Building Automation in Network Environment - Google Patents

Abstract

1. TECHNICAL FIELD OF THE INVENTION

The present invention relates to an intelligent control and monitoring system for home and building automation in a network environment that provides a convenient and reliable user through the construction of a home network and a software architecture.

2. The technical problem to be solved by the invention

The present invention utilizes a module-specific design and knowledge-based system to integrate devices based on existing communication environments as well as home and buildings in a network environment that allows the system to diagnose and manage itself based on a policy proposed by a user. To provide intelligent control and monitoring systems for automation.

3. Summary of Solution to Invention

The present invention enables to integrate, control and monitor the monitoring and automation devices that are installed and connected in a designated place for automation processing, and to connect the devices based on PLC (PLC). Automated processing means for performing diagnosis and processing on a given situation based on a policy specified by a user through a knowledge base; And receiving the user's access through the network to perform authentication by overcoming the local limitation of the automated processing means and providing the user with the convenience of remote monitoring and management. Remote control means for performing control and information acquisition.

4. Important uses of the invention

The present invention is used in home automation systems and the like.

Description

Intelligent Control and Monitoring System for Home and Building Automation in Network Environment

The present invention relates to an intelligent control and monitoring system for home and building automation in a network environment. More specifically, the present invention relates to a home and network environment in which a home network and a software architecture are provided for convenience and reliability to a user. An intelligent control and monitoring system for building automation.

In the field of web-based remote monitoring and control of home appliances using high-speed internet communication, the Internet-based communication network has been widely applied to all fields of society in connection with the construction of the high-speed communication network, which is rapidly developing recently. Faced with the social needs to easily monitor and control various information devices at remote locations.

Security and disaster prevention systems and home appliances installed in homes can be monitored and controlled anywhere in the world using the Internet, and the devices that can interact without a telephone are becoming a reality. Local area networks (LANs) and wide area networks (WANs) are used for large intelligent buildings and various industrial facilities to provide images of closed circuit television (CCTV) cameras, various control signals, and alarm signals. Sending and receiving can provide a unified management solution, showing rapid advancement to more advanced systems.

However, most home and building automation systems have not yet provided a convenient user environment, and do not have an efficient integration mechanism. In addition, users want a more automated intelligent system, but there is a problem that is hardly implemented.

In summary, the existing home and building monitoring and automation systems have a problem that they are limited in the use of services due to the low scalability of services and the focus on specific technology directions. Most home and building automation systems have an efficient centralization mechanism. There was a problem that the integration mechanism was not equipped and it was dependent on different vendors, and users wanted a more automated intelligent system, but they were hardly implemented.

The present invention has been made to solve the problems described above, and utilizes a module-specific design and knowledge-based system to integrate devices based on existing communication environments as well as system based on a policy presented by a user. Its purpose is to provide intelligent control and monitoring systems for home and building automation in network environments that allow them to diagnose and manage themselves.

In order to achieve the above object, the present invention provides an intelligent control and monitoring system for home and building automation in a network environment, wherein the monitoring and automation devices are installed and connected at a designated place for automation processing. To enable integration, control and monitoring, this is done by connecting the devices on a PLC basis and performing a diagnosis and handling of a given situation based on a policy specified by the user through the Knowledge Base. Processing means; And receiving the user's access through the network to perform authentication by overcoming the local limitation of the automated processing means and providing the user with the convenience of remote monitoring and management. Remote control means for performing control and information acquisition.

The present invention relates to an intelligent control and monitoring system for home and building automation. The solution is called an Intelligent and Integrated Security System (IS ² ). The implemented system configures the home network environment based on the Xten (X10) protocol in consideration of convenient scalability. It supports ActiveX Control through a web browser for real-time monitoring and control remotely, and provides unmanned surveillance notification and control services through a telephone interface by DTMF (Dual Tone Multi Frequency). to provide. In addition, the intelligent supervisory module of knowledge-based system is implemented for autonomous and intelligent system automation. ISM (Intelligent Supervisory Module) used COM (Component Object Model) -based expert system development tool (CLIPS) to interface between systems. ISM's Knowledge Base represents your policies. To provide the convenience of constructing the Knowledge Base, we present a Configuration Tool that allows users to make policy decisions and configure scenarios based on the capabilities provided by the devices.

The above objects, features and advantages will become more apparent from the following detailed description taken in conjunction with the accompanying drawings. Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a diagram illustrating an embodiment of an intelligent control and monitoring system for home and building automation in a network environment according to the present invention.

That is, Figure 1 shows the overall configuration diagram for each module for the intelligent control and monitoring system for home and building automation according to the present invention.

The entire system according to the present invention is largely a local monitoring and management system (LOMMANS), a remote supervisory customer extension (RESCUE) system 11, a remote customer access (RCA) system 12 It consists of three subsytems of

LOMMANS (10) is a system installed in the home or building of the system user, a key element of the intelligent control and monitoring system for practical home and building automation, and most of the system design goals are implemented here.

LOMMANS (10) integrates connected devices into one and provides an environment to control and monitor. In general, the main purpose of home automation is to provide convenient and efficient integration of home appliances, and to be flexible, scalable and provide independence for the network environment. To this end, it utilizes a suitable Power Line Communication (PLC) -based "X10 protocol" to minimize device integration and cost. This is because interlocked devices in the system are usually made by different manufacturers. This is because the use of X10 devices in each control interface ensures maximum scalability. Even if it is extended to devices based on other network technologies, it is implemented for each module to provide scalability by adding an extension interface of the device input information processing module.

The modules constituting LOMMANS 10 are as follows. That is, the LOMMANS 10 may include a device state information processing module 101, an intelligent supervisory module 102, a policy configuration tool, a network camera multiple access server module 103, and a user graphic interface module. (104), CTI (computer-telephony integration) based dial module 105, FTP (File Transfer Protocol) upload module 106, PLC command module 107, It consists of a floating IP (Internet Protocol) reporting module 108.

The RESCUE system 11 overcomes the local limitations of the LOMMANS 10 and provides the convenience of remote monitoring and management. In addition, the structure allows the user to access the LOMMANS 10 directly from the Internet network, but to be accessed by ActiveX control distributed over the web after authenticating the user in the RESCUE system 10. This solves the vulnerability that security and user's internet environment is mostly floating IP. The RESCUE system 11 includes a Web WWW and File Backup Service module and an IP Report Server Service module.

The RCA system 12 includes a Remote Client ActiveX control access module and allows a user to remotely access the LOMMANS 10 via the RESCUE system 11.

As described above, the modules constituting the system may be configured as a unit process, or may be configured by several threads in one process. Each module's intercommunication model is basically made by IPC (Inter process Communication).

FIG. 2 is a diagram illustrating an embodiment of modules belonging to LOMMANS in an intelligent control and monitoring system for home and building automation according to the present invention.

FIG. 2 shows each module function and component according to the data flow in LOMMANS 10.

First, the device state information processing module 101 corresponds to a data input processing unit of an X10 protocol-based PC bridge (CM11A) interface, and collects and processes state information data from each sensor. Then, the determination of the state information is transmitted to the intelligent management module 102 including the artificial intelligence function.

The intelligent management module 102 constructs a fact list using the state information input from the device state information processing module 101 as input information, and calls an ActiveX Clips module necessary for its inference. Inference is performed and this process is processed in real time. Here, the information necessary for inference is composed of input information data of the device state information processing module 101, a database of device registration information configured in the system, and a knowledge base. In addition, the main program including the artificial intelligence module and the user graphical user interface (GUI) communicates with each other in real time whenever a necessary event occurs. Therefore, the knowledge base means a database required for performing inference in the intelligent management module.

Next, the network camera multiple access server module 103 and the user graphic interface module 104 belonging to the main of the LOMMANS 10 will be described.

The network camera multiple access server module 103 accesses a network camera installed under a home system environment and displays image data on a split screen. In addition, it provides a multi-connection server service that allows remote clients to connect and monitor by MultiViewer ActiveX controls. Then, the device control service on the web by the multi-viewer control is provided.

The user graphic interface module 104 processes the image information display of the camera, which is divided into three parts. The system controller, which is one of them, performs system mode status control, camera split screen selection and pan, tilt control, and device status information display. The other, the camera control unit performs the selection and control of the camera, the image capture and recording, the remaining one system setting unit registers the unattended surveillance notification phone book, password, FTP configuration, camera registration and capture folder, Set the registered device environment.

The CTI-based dial module 105 dials a registered telephone number upon detecting a situation. Up to three phone numbers can be registered, and three attempts are made until each phone number is received. Even if you receive it, it will not go to the next state if it does not match your registered password. And it outputs the message voice according to the situation. You can hear the situation in the building or home through a high-performance microphone, and speak through the speakers installed in the system. It also supports remote device control.

Next, the FTP upload module 106 automatically stores an image of a camera corresponding to a situation when a sensor paired to the camera in a boundary mode detects a situation and stores the image in a RECUE server. In addition, it can save 7 sheets per second as 'JPEG' file once saved.

The PLC command module 107 sends a command for controlling the device to the FireCracker (FireCracker (CM17A)) through a serial to generate a high frequency (RF) signal. Take it and pass it to the device via PLC. Such a PLC command module 107 can basically only send commands.

Finally, the dynamic IP reporting module 108 periodically reports to a RECUE server to link an address for external access when using dynamic IP. Basically, connect to server through socket and update user's database's IP field through ID.

3 is a data flow diagram of an intelligent management module in an intelligent control and monitoring system for home and building automation in accordance with the present invention.

In the intelligent control and monitoring system according to the present invention, an intelligent supervisory module 102 based on knowledge is implemented to configure an autonomous and intelligent system. Intelligent Supervisory module 102 utilizes COM-based expert system development tool CLIPS to interface the systems. The Knowledge Base 31 of the Intelligent Supervisory Module 102 represents the user's policy.

To provide the convenience of constructing the Knowledge Base (31), we have configured a Configuration Tool that allows the user to decide on policies and configure scenarios based on the capabilities provided by the devices. .

In addition, in the present invention, it is assumed that the inference engine of the knowledge-based system uses ActiveX Clips, which is a development tool of the expert system. The traditional C Language Integrated Production System (CLIPS) is a knowledge-based system development tool written in C by the Software Technology Branch (STB) of NASA / Lyndon B. Johnson Space Center.

Existing Clips can be reused when modeling other systems or creating new elements, but it is cumbersome to modify and recompile the module at the source code level. Therefore, the present invention uses a componentized knowledge base system.

The problem solving method in Clips is as follows.

Inference is basically done by the rules that form the knowledge base. In order to solve some problem, input information from devices is input as fact and inference is made based on this. Therefore, the information coming from the device linked to the system is processed into a fact list (Fact List, 311) and passes it to the inference engine (inference engine, 32).

The rule required for reasoning consists of an external file, and the reasoning engine 32 simply loads it when necessary, loads it into the working memory, and executes reasoning. The inferred result returns a buffer in the form of a string. By extracting the information from the returned string data and calling the function of the module based on it, it performs the proper function. Here, the rule of the Knowledge Base (31) necessary for inference is constructed independently of other programs and loaded at the required time. This allows for a scalable and flexible configuration environment without the need for a system recompile.

FIG. 3, shown in the figure, shows the data flow in the intelligent supervisory module as described above.

4 is a diagram illustrating an embodiment of an interface of a user policy configuration tool in an intelligent control and monitoring system for home and building automation according to the present invention.

The main purpose of home automation is to provide convenient and efficient integration of home appliances and requires a convenient user interface for the end user.

Here, we present a user strategy configuration tool that can guarantee the independence of a scalable, flexible, and network environment through an embodiment of the present invention and constitutes a knowledge base. .

More and more, flexible home automation systems must be able to be tailored to the needs of the user and more and more functions must be automated. To integrate the services provided, Home Automation System is a tool that can easily create a knowledge base rule (RULE) that manages the system configuration and policy.

First, allow the user to modify the configuration of the system. The user has the ability to configure policies and scenarios for automated functions.

Second, it has the function to make it effective according to the user's environment and properly performed according to the policy for each case.

Third, it has a function that can be used intuitively even without hardware or software expertise.

Fourth, support for various interfaces for the device state information processing module can be updated at all times so that it can be linked regardless of a network communication environment or a platform of devices.

The devices were configured in the form of graphical window controls, and simply drag and drop to connect each device's functions. The connection means when one of the functions included in the device is triggered to call a function of another device. The configuration of this connection becomes a policy for the automation of the user, which is expressed as rules in the knowledge base.

The intelligent supervisory module 102 of the implemented system uses a forward inference technique. The condition clause of a rule is expressed as AND or OR of conditions to be satisfied. When this condition clause is true, the rule is triggered to execute the conclusion part.

For example, if a user policy is configured for security purposes, for example, this could be the following direction: The user's policy can be defined to sound a siren, capture the screen and make a call when a motion detector detects a motion. Here, the motion detection in the motion detector becomes true of the rule condition, which rule is triggered and performs the conclusion. The implication of the conclusion is that it provides a fact that can trigger rules that perform the functions of siren, screen capture, and telephone notification.

As illustrated in FIG. 4, when a rule RULE generated by the proposed tool is described by a heuristic code, rules as shown in Table 2 below are generated.

Rule 1 IF Mode is Emergency AND Motion Detector is ONTHEN The Activation is Siren, Telephone, Camera-Capture Rule 2 IF Siren is ONTHEN The response is to activate Siren Blow Rule three IF Telephone is ONTHEN The response is Host Dialing Rule 4 IF Camera-Capture is ONTHEN The response is Camera recording

Basically, the functions of each device are represented by the external interface methods of the control that make up the control. Each control's external interface methods are designed to point to the external interface methods of the different controls with the user's drag and drop. Eventually, each control passes the interpreter information about how this works.

The interpreter can then create the rules that make up the knowledge base. These rules are saved as files and the inference engine just loads them when needed.

In this way, users can configure and modify their strategies without any programming knowledge.

The present invention as described above is collectively described as follows.

Unlike intelligent control and monitoring systems for home and building automation in a network environment according to the present invention, existing home automation (HA) systems are tailored to specific network communication technologies. Standards for today's home networks have not yet been determined, but it is expected that several home network communication technologies will be consolidated into one. The present invention is meaningful in that it provides a solution of an intelligent control and monitoring system that can solve these problems and reduce costs.

No manufacturer expects the devices to be integrated into the HA system in any way, nor is it considered. In general, traditional devices are independent units that do not work with other devices.

Therefore, it is more effective at the present time to allow a user to perform a desired function by manual configuration and integration. This is because the module is designed to provide scalability by adding an extension interface of the device input information processing module 101 even if it is extended to devices based on other network technologies.

Home automation systems allow users to make policy decisions and tailor scenarios to the functions provided by devices. The intelligent supervisory module 102 is presented as a knowledge-based system that can provide scalability and make autonomous and intelligent system judgment. The Knowledge Base of the Intelligent Supervisory Module 102 provides the user with the convenience of making policy decisions and configuring scenarios based on the capabilities provided by the devices. In addition, the advanced model direction of the intelligent supervisory module 102 is to improve and update the knowledge base by collecting knowledge on its own, which can be used to determine autonomous and intelligent systems for home automation. This is because it can provide reliable service of the system by acquiring the situation or the behavior of people, accepting it as a form of knowledge, and combining it into one knowledge base.

As described above, the present invention may be implemented as a program and stored in a computer-readable recording medium (CD-ROM, RAM, ROM, floppy disk, hard disk, magneto-optical disk, etc.).

The present invention described above is not limited to the above-described embodiments and the accompanying drawings, and various substitutions, modifications, and changes are possible in the art without departing from the technical spirit of the present invention. It will be clear to those of ordinary knowledge.

The present invention as described above, the insertion and removal of a new device is flexible, can be easily reconfigured according to the user's environment and settings, and not only to provide an Internet-based interface for real-time remote control monitoring, but also to the system It can provide efficient and reliable service by judging the situation of the site or the behavior of people by input information from installed sensors and suggesting the configuration of knowledge-based system that the system can diagnose and manage itself automatically. There is.

In addition, the present invention, through the RESCUE system security and the user's Internet environment has the effect of solving the vulnerability that occurs mostly due to the floating IP.

1 is an embodiment configuration of an intelligent control and monitoring system for home and building automation in a network environment in accordance with the present invention.

FIG. 2 is a diagram illustrating an embodiment of modules belonging to LOMMANS in an intelligent control and monitoring system for home and building automation in accordance with the present invention. FIG.

3 is a data flow diagram of an intelligent management module in an intelligent control and monitoring system for home and building automation in accordance with the present invention.

4 is a diagram illustrating an embodiment of an interface of a user policy configuration tool in an intelligent control and monitoring system for home and building automation in accordance with the present invention.

* Explanation of symbols for the main parts of the drawings

10: Lommans 11: Rescue system

12: RCA system 101: device status information processing module

102: intelligent management module 103: network camera multiple access server module

104: user graphical interface module

105: CTI based dial module 106: FTP upload module

107: PLC command module 108: floating IP reporting module

Claims (11)

In the intelligent control and monitoring system for home and building automation under network environment, The monitoring and automation devices installed in the designated places for home and building automation processing are connected by using PLC-based protocols, and the status and data of the monitoring and automation devices are input to register the monitoring and automation devices. LOMMANS for performing inference according to information and a preconfigured user policy, and transmitting a command to the monitoring and automation devices according to the result of the execution; The Rommans is connected to the Rommans through the network environment, supports the user access using the floating IP information provided from the Rommans, performs the authentication of the user, and obtains the control information for the Rommans according to the user's request. Rescue to perform; And An RCA system that provides an interface to the lease to allow a user to remotely access the lease through the network environment; Intelligent control and surveillance system for home and building automation in a network environment, including. delete The method of claim 1, The Rommans, Device state information processing means for collecting and processing state information data from each sensor included in the monitoring and automation devices; Intelligent management means for constructing a fact list from the state information input from the device state information processing means as input information and performing inference according to registration information of the monitoring and automation devices and a preconfigured user policy; And PLC processing means for receiving a command for device control based on the inference result and delivers the command to the monitoring and automation devices through a PLC method; Intelligent control and surveillance system for home and building automation in a network environment, including. The method of claim 1, wherein the Rommans, Floating IP guidance means for periodically publishing the location information of the floating IP (IP) method for the user to remote access to the Rommans using the floating IP (IP) method Intelligent control and surveillance system for home and building automation in a network environment, including. The method of claim 4, wherein The floating IP guide means, According to the use of dynamic IP, it periodically reports to the lease to link the address for access from the outside, connects to the server through the socket and manages by updating the IP field of the database corresponding to the user through the ID. Intelligent control and surveillance system for home and building automation under network environment. The method of claim 1, wherein the Rommans Home and building automation in a network environment by accessing a network camera installed in the network environment, displaying image data on a split screen, and providing a multi-connection service for remote clients to monitor by multi-viewer active control. Intelligent control and surveillance system. delete The method of claim 1, wherein the Rommans It handles user requests such as system mode status control, camera split screen selection and pan, tilt control, and device status information display, handles user requests such as camera selection and control, image capture and recording, and unattended surveillance notification phonebook. User graphic interface module to handle user requests such as registration, password setting, FTP (File Transfer Protocol) configuration, camera registration and capture folder selection, and registration device configuration Intelligent control and surveillance system for home and building automation in a network environment, including. The method of claim 1, wherein the Rommans When a certain number of phone numbers are registered, a predetermined number of attempts are made until a phone number is received by calling a registered phone number when a situation is detected.If not, the number is attempted. If it is not correct, it does not move to the next state, and outputs a message voice according to the detected situation, enables to listen to the situation of the designated place, to transmit a word through a speaker installed at the designated place, and to control the remote device. Telephone processing means for selectively providing functions such as support Intelligent control and monitoring system for home and building automation in a network environment comprising a. The method of claim 1, wherein the Rommans, Stores the monitoring information obtained according to the occurrence of the situation of the monitoring and automation devices, The sensor paired to the camera in the alert mode, the monitoring information storage means for acquiring the image of the camera according to a given condition and automatically storing it in a designated server when the situation is detected. Intelligent control and surveillance systems for home and building automation under inclusive network environments. The method of claim 1, wherein the Rommans, Receives a command for controlling a device installed in the designated place through serial communication, generates and transmits the signal at a high frequency (RF), acquires the transmitted high frequency (RF) signal, and uses the PLC method using the connected power line to the device. PLC processing means for transmitting the control command to Intelligent control and surveillance systems for home and building automation under inclusive network environments.