KR102308559B1 - System and method for an integrated control of smart home and building using an add on scheme - Google Patents

Abstract

The present invention provides an add-on smart home and building integrated control system, comprising: an artificial intelligence (AI) speaker that receives a voice input and converts it into a digital signal; an AI server that receives a voice input converted into a digital signal transmitted from the AI speaker through a communication network, and analyzes the voice input to generate a FIP control signal for at least one control target device; FIP (floor indicator) installed on each floor of a building, receiving a FIP control signal for at least one control target device installed in each room from the AI server, and converting the received control signal into a control signal for each controller pannel); a main controller installed in each room and receiving a control signal for the controller from the FIP; and at least one extension controller connected in series with the main controller, receiving a control signal from the main controller, and transmitting a control signal for controlling the corresponding control target device to the corresponding control target device. One extended controller includes at least one sensor, and transmits sensing information generated based on a signal sensed through the at least one sensor to the AI server through the main controller.

Description

SYSTEM AND METHOD FOR AN INTEGRATED CONTROL OF SMART HOME AND BUILDING USING AN ADD ON SCHEME

The present invention relates to an add-on type smart home and building integrated control system and method, and more specifically, to an add-on type smart home and building integrated control system and method that can control a building using an expandable controller module. it's about

Various types of subordinates are installed in hotels, condos, resorts, training centers, dormitories, schools, and various business buildings. For example, examples of loads installed in each building include lighting, temperature for heating and cooling, fan speed, curtains, emergency calls, and the like. These loads may be controlled by various switches (eg, push button switches or touch switches).

Also, a hotel or building has a plurality of floors, and each floor includes a plurality of rooms or offices. In many rooms like this, there are many subordinates in each room, and there are quite a number of objects to be controlled.

On the other hand, in order to control various loads arranged inside in each room or office in a hotel or building, it is necessary to control it through various switches installed on each wall of the room.

Recently, although it is designed to be able to control an air conditioner, lighting, etc. through an integrated remote control, it is inconvenient for a user to find a remote control, and there is a limit to the control target.

Therefore, an object of the present invention is to load various loads (lighting, heating and cooling temperature, fan speed, curtain, emergency call, etc.) ), it is an interactive home and building control speaker (voice command type home and building control speaker) based on international standards (KNX, Mod-bus, etc.) (Fan) It is to provide an add-on smart home and building integrated control system and method that can control speed, curtain, emergency call, etc.).

In addition, it is an object of the present invention to search for nearby famous tourist attractions and restaurants in each home and building with an interactive home and building control speaker (voice command type home and building load control speaker) based on international standards (KNX, etc.) It is to provide an add-on smart home and building integrated control system and method that can be usefully used for reservation, order, and payment of tourist attractions and restaurants.

In addition, it is an object of the present invention to use voice through an interactive home and building control speaker (voice command type home and building load control speaker) in a home or building (hotel, condo, resort, training center, dormitory, school, and various business buildings). An object of the present invention is to provide an add-on smart home and building integrated control system and method capable of emergency calls and calls and emergency calls.

In addition, an object of the present invention is to provide various types of communication through interactive home and building load control speakers (voice command type home and building load control speakers) in a home or building (hotel, condo, resort, training center, dormitory, school, and various business buildings). An object of the present invention is to provide an add-on smart home and building integrated control system and method for service ordering.

In addition, an object of the present invention is to install a smart air quality measuring device (air quality sensor) inside an interactive home and building load control speaker (voice command type home and building load control speaker) to install a home or building (hotel, condo, resort, Training institutes, dormitories, schools, and various business buildings) Monitor the living environment in real time anywhere for indoor and outdoor environments, and provide the most useful life care tips for situations and lifestyles by analyzing external air quality/weather information through a voice command speaker It is to provide an add-on smart home and building integrated control system and method.

In addition, an object of the present invention is that an air quality measuring device (air quality sensor) monitors indoor living environments such as homes or buildings (hotels, condos, resorts, training centers, dormitories, schools, and various business buildings) to monitor the living environment of homes or buildings (hotels, condos). , resorts, training institutes, dormitories, schools, and various office buildings), in conjunction with a fan for indoor ventilation An object of the present invention is to provide an add-on smart home and building integrated control system and method that can control and purify indoor air to maintain a comfortable indoor environment.

In addition, an object of the present invention is to conveniently convert large-scale buildings such as homes or groups of buildings (hotels, condos, resorts, training institutes, dormitories, schools and various business buildings) into one unified interactive home and building load control speaker (voice command type). An object of the present invention is to provide an add-on smart home and building integrated control system and method that can be controlled with a home and building load control speaker) and can be more efficiently controlled in terms of cost and management.

In addition, an object of the present invention is an interactive home and building load control speaker (voice command type home and building load control speaker), as well as an add-on that can monitor and control various loads such as a home or a building in connection with and interworking with a smartphone An object of the present invention is to provide a smart home and building integrated control system and method.

In addition, it is an object of the present invention to connect at least one extended controller (eg, infrared temperature sensor module, gas detection sensor module) to the controller installed inside the control panel in an add-on method to detect smoke and gas through the controller and It is to provide an add-on smart home and building integrated control system and method that can be monitored.

In addition, an object of the present invention is to connect at least one extended controller (eg, infrared temperature sensor module, gas detection sensor module) to the controller installed inside the control panel in an add-on method, and detect It is to provide an add-on smart home and building integrated control system and method that can prevent risk in advance in the manager server based on information.

Add-on smart home and building integrated control system of the present invention for achieving the above object, AI (artificial intelligence) speaker for receiving a voice input and converting it into a digital signal; an AI server that receives a voice input converted into a digital signal transmitted from the AI speaker through a communication network, and analyzes the voice input to generate a FIP control signal for at least one control target device; FIP (floor indicator) installed on each floor of a building, receiving a FIP control signal for at least one control target device installed in each room from the AI server, and converting the received control signal into a control signal for each controller pannel); a main controller installed in each room and receiving a control signal for the controller from the FIP; and at least one extension controller connected in series with the main controller, receiving a control signal from the main controller, and transmitting a control signal for controlling the corresponding control target device to the corresponding control target device. One extended controller includes at least one sensor, and transmits sensing information generated based on a signal sensed through the at least one sensor to the AI server through the main controller.

Preferably, the system comprises: a manager server connected to the AI server by communication; and at least one management room device communicatively connected to the manager server, wherein the manager server determines whether a dangerous situation occurs based on sensing information received from the at least one expansion controller, and determines that a dangerous situation has occurred When it is determined, the at least one management office device is controlled based on the first control signal to notify the dangerous situation.

Preferably, the manager server determines whether there is a risk expected situation based on the sensing information received from the at least one expansion controller, and if it is determined that the risk expected situation has occurred, based on a second control signal, the at least one It is characterized in that it informs the dangerous situation by controlling the device of the management room.

Preferably, the management office device includes at least one of a light or a speaker, and the notification of the dangerous situation controls so that the lighting and turning off of the light are repeated a set number of times within a predetermined time, or a notification message through the speaker It is characterized by outputting

Preferably, the manager server drives a timer when the expected risk situation occurs, and warning information corresponding to the expected risk situation if the confirmation information of the manager corresponding to the expected risk situation is not received until the timer expires and transmitting the generated warning information to the main controller through an AI server.

Preferably, the main controller receives the warning information transmitted from the manager server, and controls the at least one control target device in each room in which the main controller is installed, in response to the reception of the warning information, thereby risking a risk. It is characterized by informing the situation.

Preferably, the at least one control target device includes at least one of a light or a speaker, and the notification of the dangerous situation controls so that the lighting and turning off of the light are repeated a set number of times within a predetermined time, or the speaker It is characterized in that the notification message is output through the

Preferably, the control target device includes at least one of a chime, a temperature switch, a light switch, a blind switch, a fan speed control switch, and an emergency call switch.

Preferably, the control signal for controlling the control target device is at least one of an on/off control signal, an opening/closing control signal, an up/down control signal, a temperature control signal, a dimming control signal, a speed control signal, and a call signal. Contains control information.

Preferably, the FIP control signal includes FIP identification information, controller identification information, control target device identification information, and control information.

A smart home and building integrated control method of the present invention for achieving the above object includes the steps of: receiving a voice input from an AI (artificial intelligence) speaker and converting it into a digital signal; receiving a voice input converted into a digital signal transmitted from the AI speaker through a communication network in an AI server; generating, in the AI server, a FIP control signal for at least one control target device by analyzing the received voice input; Receiving a FIP control signal for at least one control target device from the AI server in a floor indicator panel (FIP); converting the received control signal into a control signal for each controller in the FIP; receiving, in the controller, a control signal for the controller from the FIP; and receiving a control signal from the main controller in an extension controller serially connected to the main controller and transmitting a control signal for controlling the corresponding controlling device to a corresponding controlling device.

Preferably, the method further comprises receiving and storing the control signal from the AI server in a property management system (PMS).

Preferably, the control target device includes at least one of a chime, a temperature switch, a light switch, a blind switch, a fan speed control switch, and an emergency call switch.

Preferably, the control signal for controlling the control target device is at least one of an on/off control signal, an opening/closing control signal, an up/down control signal, a temperature control signal, a dimming control signal, a speed control signal, and a call signal. Contains control information.

Preferably, the FIP control signal includes FIP identification information, controller identification information, control target device identification information, and control information.

According to the present invention, various loads (lighting, heating and cooling temperature, fan speed, curtain, emergency call, etc.) When controlling, it is an interactive home and building control speaker (voice command type home and building control speaker) based on international standards (KNX, etc.) , emergency calls, etc.) can be controlled.

In addition, according to the present invention, it is an interactive home and building control speaker (voice command type home and building load control speaker) based on international standards (KNX, etc.) You can usefully use tourist attractions and restaurants for reservation, order, and payment.

In addition, according to the present invention, in a home or building (hotel, condo, resort, training center, dormitory, school, and various business buildings), through an interactive home and building control speaker (voice command type home and building load control speaker) It has the advantage of being able to make emergency calls and calls and make emergency calls.

In addition, according to the present invention, in a home or building (hotel, condo, resort, training center, dormitory, school, and various business buildings), various It has the advantage of being able to order services.

In addition, according to the present invention, a smart air quality measuring device (air quality sensor) is installed inside an interactive home and building load control speaker (voice command type home and building load control speaker) to install a home or building (hotel, condo, resort, Training institutes, dormitories, schools, and various business buildings) Monitor the living environment in real time anywhere for indoor and outdoor environments, and provide the most useful life care tips for situations and lifestyles by analyzing external air quality/weather information through a voice command speaker can do.

In addition, according to the present invention, an air quality measuring device (air quality sensor) monitors indoor living environments such as homes or buildings (hotels, condos, resorts, training centers, dormitories, schools, and various business buildings) to , resorts, training institutes, dormitories, schools, and various office buildings), in conjunction with a fan for indoor ventilation It is possible to maintain a comfortable indoor environment by purifying indoor air by controlling it.

In addition, according to the present invention, a large-scale building such as a home or a building (hotel, condo, resort, training center, dormitory, school, and various business buildings) groups can be conveniently converted into one unified interactive home and building load control speaker (voice command type). home and building load control loudspeakers) for more efficient control in terms of cost and management.

In addition, according to the present invention, it is possible to monitor and control various loads such as a home or a building by linking and interworking with a smart phone as well as an interactive home and building load control speaker (voice command type home and building load control speaker).

1 is a diagram illustrating an interactive smart home and building integrated control system according to the present invention.
2 is a diagram illustrating a connection relationship between an interactive smart home and an integrated building control system according to the present invention.
3 is a diagram illustrating an interactive smart home and building integrated control method according to an embodiment of the present invention.
4 is a diagram illustrating a deep learning dialog model according to an embodiment of the present invention.
5 is a block diagram illustrating a detailed structure of a speech recognition engine according to an embodiment of the present invention.
6 is a block diagram illustrating a detailed structure of an electronic device according to an embodiment of the present invention.
7 is a perspective view of an AI speaker according to an embodiment of the present invention.
8 is a diagram illustrating an add-on type expansion module according to an embodiment of the present invention.
9 is a diagram illustrating an interactive smart home and building integrated control method according to an embodiment of the present invention.

Hereinafter, detailed contents for carrying out the present invention will be described based on the embodiments with reference to the drawings. These embodiments are described in sufficient detail to enable those skilled in the art to practice the present invention. It should be understood that various embodiments of the present invention are different but need not be mutually exclusive. For example, certain shapes, structures, and characteristics described herein may be implemented in other embodiments without departing from the spirit and scope of the invention with respect to one embodiment. In addition, it should be understood that the location or arrangement of individual components within each disclosed embodiment may be changed without departing from the spirit and scope of the present invention. Accordingly, the detailed description set forth below is not intended to be taken in a limiting sense, and the scope of the present invention, if properly described, is limited only by the appended claims, along with all scopes equivalent to those claimed by the claims. Like reference numerals in the drawings refer to the same or similar functions throughout the various aspects.

Unless otherwise defined, all terms (including technical and scientific terms) used herein may be used with the meaning commonly understood by those of ordinary skill in the art to which the present invention belongs. In addition, terms defined in a commonly used dictionary are not to be interpreted ideally or excessively unless specifically defined explicitly.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings in order to enable those of ordinary skill in the art to easily practice the present invention.

1 is a diagram illustrating an interactive smart home and building integrated control system according to the present invention. 1, the system according to the present invention, AI (artificial intelligence) speaker 110, AI server 130, FIP (floor indicator pannel) 150, controller 160, expansion controller (160a), It may include a control target device 170 , a manager server 180 , and at least one management room device 190 . The system of the present invention may further include a property management system (PMS) 140 .

The AI speaker 110 performs a function of receiving a voice input and converting it into a digital signal. The AI speaker 110 may be provided in at least one room or office disposed on each floor in a smart home or building. The user may input a control signal for at least one control target device 170 provided in the room or office through the AI speaker 110 .

The control target device 170 may include a chime, a temperature switch, and at least one switch (eg, a light switch, a blind switch, a fan speed control switch, an emergency call switch, etc.).

A control signal for controlling the control target device 170 may include at least one of an on/off control signal, an opening/closing control signal, an up/down control signal, a temperature control signal, a dimming control signal, a speed control signal, and a call signal. may contain information.

The AI speaker 110 may transmit a voice input converted into a digital signal to the AI server 130 through the communication network 120 .

The communication network 120 may include, for example, at least one of LTE, LTE-A, CDMA, WCDMA, UMTS, WiBro, 5G, or GSM as a cellular communication protocol. In addition, the communication network 120 may be configured regardless of its communication mode, such as wired and wireless, and may include a personal area network (PAN), a local area network (LAN), a metropolitan area network (MAN; Metropolitan Area Network) and wide area network (WAN) may be composed of various communication networks. In addition, the communication network 120 may be a known World Wide Web (WWW), using a wireless transmission technology used for short-range communication such as infrared (Infrared Data Association; IrDA) or Bluetooth (Bluetooth). may be

The AI server 130 receives a voice input converted into a digital signal transmitted from the AI speaker 110 through the communication network 120 , and analyzes the voice input to control FIP for at least one control target device signal can be generated.

The AI server 130 transmits the generated FIP control signal through the communication network 120 to the corresponding FIP 150 (that is, the FIP 150 of the floor where the AI speaker 119 from which the voice input is received is disposed). ) is sent to

The FIP 150 is installed on each floor in a smart home or building, and receives a FIP control signal for at least one control target device from the AI server 130 through the communication network 120 . The FIP 150 converts the received control signal into a control signal for the corresponding controller 160 (that is, the controller 160 of the room or office in which the AI speaker 110 in which the voice input is received is disposed). .

The FIP 150 transmits a control signal for controlling the corresponding control target device to the controller 160 of the corresponding room or office through wired/wireless communication means (eg, RS-485 communication).

The AI speaker 110 may include an air quality measurement sensor therein. The AI speaker 110 may detect VOC or dust for an indoor/outdoor environment through the air quality measurement sensor, and may control a ventilation device in a corresponding room by analyzing information on the detected VOC or dust.

The controller 160 receives a control signal for the controller 160 from the FIP 150 and transmits a control signal for controlling the corresponding control target device 170 to the corresponding control target device 170 .

The corresponding control target device 170 receives a control signal from the controller 160 and is controlled according to the received control signal. For example, the control target device 170 controls a chime, a temperature switch, and at least one switch (eg, a light switch, a blind switch, a fan speed control switch, an emergency call switch, etc.) to control an on/off control signal, opening/closing control, etc. Signal, up/down control signal, temperature control signal, dimming control signal, speed control signal, and call signal control are performed.

The controller 160 may be connected to at least one expansion controller 160a. For example, the controller 160 is connected to the first expansion controller 160a, the first expansion controller 160a is connected to the second expansion controller 160b, and the second expansion controller 160c is connected to the third expansion controller ( 160d).

The AI server 130 may be connected to the manager server 180 installed in the management room through the communication network 120 . At least one management room device 190 may be installed in the management room. The management office device 190 may include at least one light or at least one speaker. The at least one management office device 190 may be controlled by the manager server 180 .

2 is a diagram illustrating a connection relationship between an interactive smart home and an integrated building control system according to the present invention. Referring to FIG. 2 , the AI speaker 110 as a voice recognition speaker recognizes a voice signal and transmits the voice signal to the AI server 130 through a TCP/IP communication network.

The AI server 130 may communicate with a property management system (PMS) 140 through a communication network, and the PMS may be configured by integrating with the AI server 130 . The AI server 130 may analyze the signal with a voice signal processing algorithm and update the control signal to the database of the PMS 140 by the agent software. The load control management system agent software of the AI server 130 sends a signal to the FIP 150 . The load management server GUI of the PMS 140 may display DB update contents on the screen.

The PMS 140 is a home and building asset information management system, and may process various home and building management and human and physical asset management, such as a hotel.

The FIP 150 transmits a control signal to the load control controller 160 (eg, a room control unit (RCU)) of each home and building, and displays the control status of each home and building load (lighting / temperature / occupancy situation / cleaning requests, etc.)

In each floor of each home and building, the FIP 150 becomes a master module according to the communication protocol, and the server on each floor may use a mini PC or an embedded PC. In addition, the FIP 150 and each controller 160 may be connected by an RS-485 communication interface.

The controller 160 is provided with circuit breakers and controllers for home and building control, and can control 6 lighting circuits, 2 electric heat circuits, and 1 temperature circuit, respectively, but embodiments of the present invention are limited to the number of control circuits. no.

The controller 160 may be connected to at least one expansion controller 160a. For example, the controller 160 may be connected to the first expansion controller 160a, and the first expansion controller 160a may be connected to the second expansion controller 160b. In the same way, n expansion controllers 160n may be connected according to an add-on method. A detailed description thereof will be described later with reference to FIG. 8 .

The AI server 130 may be connected to the manager server 180 installed in the management room through the communication network 120 . At least one management room device 190 may be installed in the management room. The management office device 190 may include at least one light or at least one speaker. The at least one management office device 190 may be controlled by the manager server 180 .

The manager server 180 may communicate with the manager terminal 181 through the communication network 120 . The manager server 180 may transmit the corresponding information to the manager terminal 181 when a dangerous situation or a dangerous expected situation occurs. The manager terminal 181 may receive information related to a dangerous situation or a risk expected situation from the manager server 180 , and when confirmation information is input from the manager, the input confirmation information is transmitted to the manager server 180 . can be transmitted. If the manager server 180 does not receive the confirmation information input from the manager within a certain period of time from the occurrence of the dangerous or expected dangerous situation, it can send warning information to the controller of the room in which the dangerous or expected dangerous situation occurs. have. A detailed description thereof will be given later in the description of FIGS. 8 and 9 .

3 is a diagram illustrating an interactive smart home and building integrated control method according to an embodiment of the present invention. Referring to FIG. 3 , the AI speaker 110 receives an input 302 of a voice uttered by a user.

The AI speaker 110 receives the voice input and converts it into a digital signal (304), and transmits the converted digital signal to the AI server 130 (306).

The AI server 130 receives a voice input converted into a digital signal transmitted from the AI speaker through a communication network, analyzes the received voice input, and performs voice recognition processing 308 . A specific method of processing the voice input will be described in detail with reference to FIGS. 4 and 5 .

The AI server 130 generates ( 310 ) a FIP control signal for at least one control target device, and transmits ( 312 ) the generated FIP control signal to the FIP 150 .

The FIP 150 receives a FIP control signal for at least one control target device from the AI server 130, and converts the received control signal into a control signal for each controller (314).

The FIP 150 transmits 316 the generated control signal for each controller to the corresponding controller 160 .

The controller 160 receives a control signal for the controller from the FIP 150 , analyzes 318 the control signal, and sends a control signal for controlling the corresponding control target device to the corresponding control target device 170 . Transmit 320 .

Each control target device 170 receives a control signal from the controller 160 and controls the device ( 322 ).

4 is a diagram illustrating a deep learning dialog model according to an embodiment of the present invention, and FIG. 5 is a block diagram illustrating a detailed structure of a speech recognition engine according to an embodiment of the present invention. Referring to FIG. 4 , the AI server 130 may analyze a voice input through a deep learning dialog model and generate it as a control command.

Referring to FIG. 5 , the voice receiver receives the user's voice. The object separation unit performs a function of tracking and separating a space-time acoustic object for removing background noise. The sound source characteristic generator estimates the reliability for every section of the speech signal, and varies the generation degree of comparison candidates for each section of the signal when decoding the speech recognition according to the reliability information, thereby generating a robust speech recognition characteristic against noise.

The sound source compression transmission unit and noise processing and feature extraction unit perform additive noise, such as stationary noise, non-stationary noise, impulse noise, and room reverberation. It processes noise, such as convolution noise, in which channel characteristics change, such as echo and microphone variation.

The sound source compression transmission unit and noise processing and feature extraction unit perform additive noise, such as stationary noise, non-stationary noise, impulse noise, and room reverberation. It processes noise, such as convolution noise, in which channel characteristics change, such as echo and microphone variation.

The speech decoding unit and the recognition network perform decoding and recognition network functions for searching for a speech recognition domain. The voice recognition recognition unit and the deep learning unit perform the voice recognition function by the pretraining-based DNN model. A voice recognition result is output according to the voice recognition process.

6 is a block diagram illustrating a detailed configuration of an electronic device according to an embodiment of the present invention. Referring to FIG. 6 , each device shown in FIG. 1 (eg, AI speaker 110 , AI server 130 , PMS 140 , FIP 150 , controller 160 , control target device 170 ) ) may be configured as the electronic device 600 illustrated in FIG. 6 . Hereinafter, implementation examples of various deformable electronic devices according to embodiments of the present invention will be described.

Referring to FIG. 6 , the electronic device 600 may include at least one of a processor 610 , a memory 620 , a bus 630 , an input/output interface 640 , a display 650 , and a communication interface 660 . can In some embodiments, the electronic device 600 may omit at least one of the above components or additionally include other components.

The bus 630 may include, for example, a circuit that connects the components 610 to 1260 with each other and transmits communication (eg, a control message and/or data) between the components. .

The processor 610 may include one or more of a central processing unit (CPU), an application processor (AP), and a communication processor (CP). The processor 610 may, for example, execute an operation or data processing related to control and/or communication of at least one other component of the electronic device 600 .

The memory 620 may include volatile and/or non-volatile memory. The memory 620 may store, for example, commands or data related to at least one other component of the electronic device 600 . According to an embodiment, the memory 620 may store software and/or a program. The program includes, for example, a kernel 624 , middleware 623 , an application programming interface (API) 622 , and/or an application program (or “application”) 621 , etc. can do. At least a portion of the kernel 624 , the middleware 623 , or the API 622 may be referred to as an operating system (OS).

The kernel 624 includes, for example, system resources (eg, middleware 623, API 622, or application program 621) that are used to execute operations or functions implemented in other programs. For example, the bus 630 , the processor 610 , or the memory 620 , etc.) may be controlled or managed. In addition, the kernel 624 may control or manage system resources by accessing individual components of the electronic device 600 from the middleware 623 , the API 622 , or the application program 621 . interface can be provided.

The middleware 623 may, for example, perform an intermediary role so that the API 622 or the application program 621 communicates with the kernel 624 to exchange data. In addition, the middleware 623 provides, for example, a system resource ( For example: to perform control (eg, scheduling or load balancing) of work requests using a method such as assigning priorities that can use the bus 630, processor 610, or memory 620 can

The API 622 is, for example, an interface for the application 621 to control functions provided by the kernel 624 or the middleware 623, for example, file control, window control, image It may include at least one interface or function (eg, command) for processing or character control.

The input/output interface 640 may serve as an interface capable of transmitting, for example, a command or data input from a user or other external device to other component(s) of the electronic device 600 . Also, the input/output interface 640 may output a command or data received from other component(s) of the electronic device 600 to a user or other external device.

The display 650 may be, for example, a liquid crystal display (LCD), a light emitting diode (LED) display, an organic light emitting diode (OLED) display, or a microelectromechanical systems (MEMS) display, or an electronic paper ( electronic paper) may include a display. The display 650 may display, for example, various contents (eg, text, image, video, icon, or symbol) to the user. The display 650 may include a touch screen, and may receive, for example, a touch, gesture, proximity, or hovering input using an electronic pen or a part of the user's body.

The communication interface 660 may establish, for example, communication between the electronic device 600 and an external device. For example, the communication interface 660 may be connected to a communication network through wireless communication or wired communication to communicate with the external device.

The wireless communication may use, for example, at least one of LTE, LTE-A, CDMA, WCDMA, UMTS, WiBro, or GSM as a cellular communication protocol. The wired communication may include, for example, at least one of universal serial bus (USB), high definition multimedia interface (HDMI), recommended standard 232 (RS-232), or plain old telephone service (POTS). . The telecommunications network may include, for example, at least one of a computer network (eg, LAN or WAN), the Internet, or a telephone network.

The electronic device 600 according to various embodiments of the present disclosure may include, for example, a smartphone, a tablet personal computer (PC), a mobile phone, a video phone, and an e-book reader (e-book). reader), desktop PC (desktop personal computer), laptop PC (laptop personal computer), netbook computer, workstation, server, PDA (personal digital assistant), PMP (portable multimedia player), MP3 player , mobile medical devices, cameras, or wearable devices (e.g. smart glasses, head-mounted-devices (HMDs)), electronic garments, electronic bracelets, electronic necklaces, electronic accessories. (appcessory), an electronic tattoo, a smart mirror, or a smart watch).

7 is a perspective view of an AI speaker according to an embodiment of the present invention. Referring to FIG. 7 , the AI speaker 110 may include a microphone, a display, a speaker, and the like in a housing. The AI speaker 110 may transmit a voice signal input from the user to the AI server 130 including a wired/wireless communication network function.

8 is a diagram illustrating an add-on type expansion module according to an embodiment of the present invention. Referring to FIG. 8 , the controller 160 may be connected in series with at least one other controller 810 and 820 to provide extended functions. In this case, the controller 160 is referred to as a main controller, and another controller providing the extended function is referred to as an extended controller and may operate as a slave module.

The main controller 160 may be connected in series with the at least one expansion controller 810 , 820 , 830 , and 840 . The expansion controllers 810 , 820 , 830 , and 840 receive power from the main controller 160 .

The main controller 160 may communicate with the expansion controllers 810 and 820 using an RS-485 communication protocol, and communicate with each other using TP twisted-pair 4-wire or 2-wire, and up to 32 modules may be connected.

The expansion controllers 810 , 820 , 830 , and 840 may be connected to home and building temperature controllers or may be connected to a key sensor switch. Examples of the expansion controllers 810, 820, 830, and 840 are as follows.

- Lighting on-off control expansion module: can be expanded to more than 4 switching circuits (4 channels)

- Lighting dimming control expansion module: expandable to more than 2 circuits (2 channels)

- Air-conditioning control expansion module (including fan coil control): Can be expanded to more than 2 circuits (1 channel) of valve control for heating and cooling

- Blind control expansion module: expandable to 2 circuits (2 channels) or more

- 4 contact input control: expandable to more than 4 lighting switches (4 channels)

- Infrared temperature sensor module: sensing equipment overheating

- Gas detection sensor module: 21 singular or plural (C2H4, CH2O, CH3SH, CH4, CL2, CLO2, CO, CO2, ETO, H2, H2S, HCL, HCN, HF, NH3, NO, NO2, O2 depending on the site) , including sensors for detection of O3, PH3, SO2, etc.)

Referring to FIG. 8 , the blind control module 810 may be connected to the main controller 160 in an add-on manner. When the blind control module 810 is connected to the main controller 160 by the add-on method, it may be set to communicate without a user's separate setting. For example, when the blind control module 810 is connected to the main controller 160, the main controller 160 recognizes the blind control module 810, and the main controller 160 operates as the main module, and the blind The control module 810 may operate as a slave module. The blind control signal generated by the blind control module 810 may be transmitted to the main controller 160 . The blind control signal received from the main controller 160 may be transmitted to the AI server 130 through the FIP 150 and the communication network 120 .

In a similar manner, the dimming control module 820 may be connected to the blind control module 810 in an add-on manner. When the dimming control module 820 is connected to the blind control module 810 by the add-on method, it may be set to communicate without a user's separate setting. For example, when the dimming control module 820 is connected to the blind control module 810, the blind control module 810 recognizes the dimming control module 820, and the blind control module 810 operates as a main module. and the dimming control module 820 may operate as a slave module. The dimming control signal generated by the diving control module 820 may be transmitted to the main controller 160 through the blind control module 810 . The dimming control signal received from the main controller 160 may be transmitted to the AI server 130 through the FIP 150 and the communication network 120 .

In a similar manner, the infrared temperature sensor module 830 may be connected to the dimming control module 820 in an add-on manner. When the infrared temperature sensor module 830 is connected to the dimming control module 820 by the add-on method, it may be set to communicate without a separate setting by the user. For example, when the infrared temperature sensor module 830 is connected to the dimming control module 820, the dimming control module 820 recognizes the infrared temperature sensor module 830, and the dimming control module 820 is the main module. and the infrared temperature sensor module 830 may operate as a slave module. The infrared temperature sensor module 830 may sense a temperature through an infrared temperature sensor included therein, and generate sensing information corresponding to the sensed temperature. The sensing information generated by the infrared temperature sensor module 830 may be transmitted to the main controller 160 through the dimming control module 820 and the blind control module 810 . The sensing information received from the main controller 160 may be transmitted to the AI server 130 through the FIP 150 and the communication network 120 .

In a similar manner, the gas detection sensor module 840 may be connected to the infrared temperature sensor module 830 in an add-on manner. When the gas detection sensor module 840 is connected to the infrared temperature sensor module 830 by the add-on method, it may be set to communicate without a separate setting by the user. For example, when the gas detection sensor module 840 is connected to the infrared temperature sensor module 830, the infrared temperature sensor module 830 recognizes the gas detection sensor module 840, and the infrared temperature sensor module 830. This main module may operate and the gas detection sensor module 840 may operate as a slave module. The gas detection sensor module 840 may sense a gas leak through a gas detection sensor included therein, and may generate sensing information corresponding to the sensed gas leak. The sensing information generated by the gas detection sensor module 840 may be transmitted to the main controller 160 through the infrared temperature sensor module 830 , the dimming control module 820 , and the blind control module 810 . The sensing information received from the main controller 160 may be transmitted to the AI server 130 through the FIP 150 and the communication network 120 .

The AI server 130 may determine whether a dangerous situation or a dangerous situation is expected from the sensing information received from the infrared temperature sensor module 830 or the gas detection sensor module 840 . For example, the risk expected situation may be defined as a situation in which a risk is expected before the dangerous situation occurs. For example, if the sensing information exceeds a first reference value, it may be defined as a risk expected situation, and if the sensing information exceeds a second reference value greater than the first reference value, it may be defined as a dangerous situation. For example, if the sensed temperature is 50 degrees or more, it may be determined as a dangerous situation, and if the sensed temperature is 80 degrees or more, it may be determined as a dangerous situation.

The AI server 130 may transmit the dangerous situation occurrence information or the dangerous situation occurrence information to the manager server 180 when it is determined that the dangerous situation or the dangerous expected situation has occurred as a result of the determination. The manager server 180 receives the dangerous situation occurrence information or the dangerous expected situation occurrence information from the AI server 130, and first controls it through at least one management room device 190 (eg, lighting, speaker) installed in the management room. A dangerous situation may be notified based on the signal or an expected danger situation may be notified based on the second control signal. For example, the manager server 180 may control the entire interior of the management room to blink based on the first control signal or the second control signal, or may output an alarm signal or an alarm message through a speaker. For example, the manager server 180 may control the lighting and turning off of all lights inside the management room to be repeated a set number of times within a predetermined time, or control to output a notification message through the speaker.

The manager server 180 may transmit the dangerous situation or the risk expected situation to the manager terminal 181 (eg, a smartphone). When the confirmation information is not input from the manager server 180 or the manager terminal 181 within a predetermined time after the occurrence of the dangerous situation or the risk expected situation, the manager server 180 responds to the dangerous situation or the risk expected situation warning information may be transmitted to the corresponding controller 160 through the AI server 130 . The controller 160 receives the warning information and outputs warning information through at least one control target device (eg, lighting, speaker, TV monitor, AI speaker 110) installed in the corresponding room, or responds to a dangerous situation You can control to take precautionary measures. For example, the controller 160 may repeatedly turn on and off the lighting in the room within a set time. For example, the controller 160 may control the turning on and off of the light to be repeated a set number of times within a predetermined time, or may control to output a notification message through the speaker. The controller 160 may notify a warning situation through a speaker or AI speaker 110 . The controller 160 may output a dangerous situation or a dangerous expected situation through a TV installed in the room.

According to another embodiment, the AI server 130 may transmit the sensing information received from the infrared temperature sensor module 830 or the gas detection sensor module 840 to the manager server 180 . The manager server 180 may determine whether a dangerous situation or a dangerous expected situation is based on the received sensing information. When the manager server 180 determines that the dangerous situation or the risk expected situation has occurred as a result of the determination, a dangerous situation or a risk expected situation through at least one management room device 190 (eg, lighting, speaker) installed in the management room can inform For example, the manager server 180 may control all lights inside the management room to blink, or output an alarm signal or an alarm message through a speaker.

The manager server 180 may transmit the dangerous situation or the risk expected situation to the manager terminal 181 (eg, a smartphone). When the confirmation information is not input from the manager server 180 or the manager terminal 181 within a predetermined time after the occurrence of the dangerous situation or the risk expected situation, the manager server 180 responds to the dangerous situation or the risk expected situation warning information may be transmitted to the corresponding controller 160 through the AI server 130 . The controller 160 receives the warning information and outputs warning information through at least one control target device (eg, lighting, speaker, TV monitor, AI speaker 110) installed in the corresponding room, or responds to a dangerous situation You can control to take precautionary measures. For example, the controller 160 may repeatedly turn on and off the lighting in the room within a set time. The controller 160 may notify a warning situation through a speaker or AI speaker 110 . The controller 160 may output a dangerous situation or a dangerous expected situation through a TV installed in the room.

An add-on smart home and building integrated control system, characterized in that the lighting is repeatedly turned on and off for a set number of times within a predetermined time, or a notification message is output through the speaker.

9 is a diagram illustrating an interactive smart home and building integrated control method according to an embodiment of the present invention. Referring to FIG. 9 , the expansion controller 160a (eg, the infrared temperature sensor module 830 and the gas detection sensor module 840 of FIG. 8 ) may acquire 901 information sensed by an internal sensor. . Information sensed by the expansion controller 160a may be transmitted 902 to the controller 160 . The controller 160 may transmit (903, 904, 905) the sensing information received from the expansion controller 160a to the manager server 180 through the FIP 150 and the AI server 130 . The manager server 180 may determine ( 906 ) a dangerous situation or a risk expected situation based on the sensing information received from the AI server 130 . According to another embodiment, the AI server 130 may determine a dangerous situation or a risk expected situation based on the received sensing information, and transmit the determined result to the manager server 180 .

The manager server 180 may determine a dangerous situation or a risk expected situation, and transmit (907) a notification signal to at least one management room device 190 (eg, a light or a speaker) in the management room. The at least one management room device 190 may notify a dangerous situation or a dangerous expected situation through a light or a speaker according to a control signal of the manager server 180 .

The manager server 180 may drive a timer when the dangerous or expected dangerous situation occurs, and determine ( 909 ) whether confirmation information is received from the manager within the expiration of the timer. As a result of the determination, if confirmation information is received from the manager within a predetermined time (ie, before the timer expires), the normal completion process 910 may be performed. As a result of the determination, if confirmation information is not received from the manager within a predetermined time (that is, before the timer expires), alert information is transmitted to the controller 160 through the AI server 130 and the FIP 160 (911, 912) , 913) can be done. The controller 160 that has received the warning information may control at least one control target device (eg, a lighting, a speaker, an AI speaker, a TV in the corresponding room) to notify 914 of the warning information.

The invention has been described above for the purpose of method steps representing the performance of specific functions and their relationships. The boundaries and order of these functional components and method steps have been arbitrarily defined herein for convenience of description. Alternative boundaries and orders may be defined as long as the specific functions and relationships are properly performed. Any such alternative boundaries and orders are therefore within the scope and spirit of the claimed invention. In addition, the boundaries of these functional components have been arbitrarily defined for convenience of description. Alternative boundaries can be defined as long as any important functions are properly performed. Likewise, flowchart blocks may also be arbitrarily defined herein to represent any significant functionality. For extended use, the flowchart block boundaries and order may have been defined and still perform some important function. Alternative definitions of both functional components and flowchart blocks and sequences are therefore within the scope and spirit of the claimed invention.

The invention may also have been described, at least in part, in terms of one or more embodiments. Embodiments of the present invention are used herein to represent the present invention, aspects thereof, features thereof, concepts thereof, and/or examples thereof. A physical embodiment of an apparatus, article of manufacture, machine, and/or process embodying the present invention may have one or more aspects, features, concepts, examples, etc. described with reference to one or more embodiments described herein. may include Moreover, throughout the drawings, embodiments may incorporate the same or similarly named functions, steps, modules, etc., which may use the same or different reference numbers, and as such, the functions, Steps, modules, etc. may be the same or similar functions, steps, modules, etc. or others.

As described above, the present invention has been described with specific matters such as specific components and limited embodiments and drawings, but these are only provided to help a more general understanding of the present invention, and the present invention is not limited to the above embodiments. , various modifications and variations are possible from these descriptions by those of ordinary skill in the art to which the present invention pertains.

Therefore, the spirit of the present invention should not be limited to the described embodiments, and not only the claims to be described later, but also all those with equivalent or equivalent modifications to the claims will be said to belong to the scope of the spirit of the present invention. .

110: AI speaker 120: communication network
130: AI server 140: PMS
150: FIP 160: controller
170: control target device 180: smartphone

Claims (10)

In the add-on smart home and building integrated control system,
AI (artificial intelligence) speaker that receives a voice input and converts it into a digital signal;
an AI server for receiving a voice input converted into a digital signal transmitted from the AI speaker through a communication network, and analyzing the voice input to generate a floor indicator pannel (FIP) control signal for at least one control target device;
Installed on each floor of the building, receiving a FIP control signal for at least one control target device installed in each room of the corresponding floor from the AI server, and converting the received FIP control signal into a control signal for each controller FIP;
a main controller installed in each room, receiving a control signal for a controller from the FIP, and transmitting a lighting control signal for controlling at least one lighting to at least one lighting switch based on the received control signal;
a first extension controller connected in series with the main controller by a twisted pair (TP) line to receive power from the main controller, receive a control signal from the main controller, and transmit a blind control signal for controlling the blind; and
a second expansion controller connected in series with the first expansion controller by the TP line to receive a control signal from the first expansion controller;
The second extended controller is connected to a temperature sensor and a gas sensor, and transmits sensing information generated based on a signal sensed through the temperature sensor and the gas sensor to the AI server through the first extended controller and the main controller. A smart home and building integrated control system of an add-on method, characterized in that it transmits.
The method of claim 1, wherein the system comprises:
a manager server communicatively connected to the AI server; and
at least one management room device connected to the manager server by communication;
The manager server,
Determining whether a dangerous situation occurs based on the sensing information received from the second expansion controller,
When it is determined that a dangerous situation has occurred, the add-on smart home and building integrated control system, characterized in that the at least one management room device is controlled based on a first control signal to notify the dangerous situation.
The method of claim 2, wherein the manager server,
Based on the sensing information received from the second expansion controller, it is determined whether there is a risk expected situation,
When it is determined that a risk expected situation has occurred, the add-on smart home and building integrated control system, characterized in that the at least one management office device is controlled based on a second control signal to notify the expected risk situation.
The method of claim 3, wherein the management room device,
at least one of a light or a speaker;
The notification of the dangerous situation is,
A smart home and building integrated control system of an add-on method, characterized in that the lighting is controlled to be repeated a set number of times within a predetermined time, or a notification message is output through the speaker.
The method of claim 4, wherein the manager server,
When the expected dangerous situation occurs, a timer is started,
If the confirmation information of the manager corresponding to the expected risk situation is not received until the expiration of the timer, warning information corresponding to the expected risk situation is generated,
An add-on smart home and building integrated control system, characterized in that the generated warning information is transmitted to the main controller through an AI server.
According to claim 5, wherein the main controller,
Receive the warning information sent from the manager server,
In response to the reception of the warning information, the add-on smart home and building integrated control system, characterized in that by controlling the at least one control target device in each room in which the main controller is installed to notify a dangerous situation.
The method of claim 6, wherein the at least one control target device comprises:
at least one of a light or a speaker;
The notification of the dangerous situation is,
A smart home and building integrated control system of an add-on method, characterized in that the lighting is controlled to be repeated a set number of times within a predetermined time, or a notification message is output through the speaker.
According to claim 1, wherein the control target device,
An add-on smart home and building integrated control system comprising at least one of a chime, a temperature switch, a light switch, a blind switch, a fan speed control switch, and an emergency call switch.
The method of claim 1, wherein the control signal for controlling the control target device,
Add-on smart home and building integrated control including control information of at least one of an on/off control signal, an opening/closing control signal, an up/down control signal, a temperature control signal, a dimming control signal, a speed control signal, and a call signal system.
The method of claim 9, wherein the FIP control signal,
Add-on smart home and building integrated control system, including FIP identification information, controller identification information, control target device identification information and control information.

Images