KR20230018295A - Smart Home System Using House Terminals - Google Patents

Abstract

According to an embodiment of the present disclosure, provided is a smart home system. The smart home system constructed in each household of an apartment house comprises: an integrated household detection control module (140) provided inside a household, including a voice recognition part (141) configured to recognize a voice and a motion recognition part (142) configured to recognize a motion, and generating an instruction using the recognized voice and the recognized motion; a household terminal (150) for receiving a control instruction from an individual AI instruction recognition device (201) and a mobile application part (202) installed on a user terminal and receiving an instruction from the integrated household detection control module (140) to convert the instruction into a control instruction using a control module (154); an individual household device (300) receiving a control instruction from the household terminal (150); an apartment house complex server (130) receiving a control instruction from the household terminal (150); and a common facility control module (160) receiving the control instruction from the apartment house complex server (130) and configured to control the operation of a common facility provided in the aggregate building. Therefore, provided is a smart home system capable of controlling smart electric home appliances and general electric home appliances.

Description

Smart Home System Using House Terminals {Smart Home System Using House Terminals}

The present invention relates to the field of architecture and IT technology, and more specifically, to a smart home system that controls various devices in a household as well as various devices in a collective building or checks information using a household terminal such as a wall pad.

The content described in this section simply provides background information for the present disclosure and does not constitute prior art.

Smart home technology, in which various household devices including home appliances are connected to each other through a network function, is expanding worldwide. Telecommunication service providers, home appliance manufacturers, and Internet portal providers are trying to secure customers and expand profits by providing linked services such as application program linkage and content linkage between these connected devices.

In the early days, it started at the level of providing Internet sharing functions, but it is gradually adding functions that directly provide media services and home automation functions or provide these services smoothly.

As technologies for the convenience of residential life increase, residents are eager for smartization of residential life. Future smart home technology is expected to have automatic services that enable life from multiple perspectives. Smart home technology uses home networking and Internet information appliances based on wired and wireless communication and digital information devices to realize a ubiquitous environment in the home where computing can be used anytime, anywhere, and with any device. It means building an intelligent living environment and living space within households that adds 'friendly residential life and quality of life innovation'.

There are many commercial solutions for smart home technology, many of which exploit the potential of cloud computing. However, the smart home implemented so far mainly uses a private cloud when using cloud computing, so mobile devices or external devices that do not belong to the private cloud are difficult to construct a smart home. there is.

Home appliance manufacturers are competitively developing and releasing technologies related to smart devices. Starting with smartphones, various smart devices such as smart TVs, smart refrigerators, and smart air conditioners are appearing one after another.

However, the majority of current generations do not yet use all home appliances applicable to smart homes, so smart home technology is somewhat limited in each household, and even if smart devices are used, smart devices can be operated. In order to do so, the conventional remote control method is still the most used.

In other words, although many households are currently transforming home appliances into smart appliances, smart home technology that can be applied to these general appliances is desperately needed because the proportion of smart appliances is not so large yet.

In addition, although the demand for a smart home system capable of providing health care for each member of the household is increasing, there is a problem in that technology capable of satisfying such demand is insufficient.

In addition, although the characteristics of each owner of a vehicle entering a smart home are diverse, there is a problem that technology related to a parking control system that can provide guidance in consideration of this is insufficient.

In addition, there is a problem in that technology capable of predicting the movement of household members and controlling lighting even if the household members do not directly control lighting inside the household is insufficient.

(Patent Document 1) KR 10-2014-0050836A

(Patent Document 2) KR 10-2008-0096239A

(Patent Document 3) KR 10-1995873B

Accordingly, an object of the present disclosure is to provide a smart home system capable of controlling smart home appliances and general home appliances.

In addition, an object of the present disclosure is to provide a smart home technology capable of healthcare for each member of a household.

In addition, an object of the present disclosure is to provide a smart home technology capable of guiding an appropriate parking location in consideration of the characteristics of a vehicle owner entering a household.

In addition, an object of the present invention is to provide a smart home technology capable of controlling lighting by automatically recognizing and predicting movement without the need for household members to directly control the lighting inside the household.

The problems to be solved by the present invention are not limited to the problems mentioned above, and other problems not mentioned will be clearly understood by those skilled in the art from the description below.

According to an embodiment of the present disclosure, as a smart home system built in each household of a collective building, the voice recognition unit 141 provided inside the household and configured to recognize voice; and a motion recognition unit 142 configured to recognize a motion, and generating a command using the recognized voice and dynamics; a generation integration detection control module 140; A control command is received from the individual AI command recognition device 201 and the mobile application unit 202 installed in the user terminal, and a command is received from the generation integration detection control module 140, and the control command is controlled by the control module 154 Generation terminal 150 that converts to; an individual household device 300 receiving a control command from the household terminal 150; an apartment complex server 130 receiving a control command from the household terminal 150; and a common facility control module 160 configured to receive the control command from the apartment housing complex server 130 and control the operation of common facilities provided in the collective building, and the individual AI command recognition device 201 ) recognizes the user's voice and generates a voice command, transmits the voice command to the external cloud platform 200 to be operated as a control command, and the calculated control command is transmitted through the internal cloud platform 120. It is transmitted to the household terminal 150, and the mobile application unit 202 generates a control command, which is transmitted to the household terminal 150 through the internal cloud platform 120, providing a smart home system.

In addition, preferably, when a control command is input to the mobile application unit 202 of the present disclosure, the mobile application unit 202 transmits an authentication request to the household terminal 150, and The authentication module 152 receives the authentication request and compares it with user information stored in the apartment complex server 130, so that the mobile application unit 202 and the household terminal 150 perform authentication.

In addition, preferably, the individual household device 300 of the present disclosure includes a lighting device 310, a ventilation device 320, a cooling/heating device 330, a smart device 340, a home appliance 350 and It includes a door lock module 360, and the common facility control module 160 performs guidance service robot control, video security control, AI parking control, elevator control, and common entrance access control according to the received control command.

In addition, preferably, the common facility control module 160 of the present disclosure transmits a query request to the apartment housing complex server 130 to inquire information on a vehicle entering the parking lot, and the apartment housing complex server ( 130), upon receiving the inquiry request, inquires about vehicle information and transmits the inquired vehicle information to the household terminal 150 and the common facility control module 160, and the household terminal 150, Displays the information of the inquired vehicle, and the common facility control module 160 uses the parking information of the parking lot stored in advance together with the information of the vehicle received from the apartment complex server 130 to park the vehicle by a preset method. After the notification is calculated, a parking notification is provided to the user of the inquired vehicle.

In addition, preferably, the information of the vehicle of the present disclosure includes whether the vehicle is an electric vehicle, and if the vehicle corresponds to an electric vehicle, the common facility control module 160 checks whether an electric vehicle charging station in the parking lot is used and includes it. The parking notification is calculated.

In addition, preferably, the smart device 340 of the present disclosure includes a gas valve, a scale, an induction and an outlet, and the scale electrically communicates with the mobile application unit 202 and the household terminal 150. and the household terminal 150 determines a control signal transmitted from the common facility control module 160 to the elevator by using the information received from the weight scale.

In addition, preferably, the household terminal 150 of the present disclosure further includes a distance detection module 158 configured to detect a distance to a user, and the household integration detection control module 140 determines the level of illumination and an illuminance and temperature sensor unit 143 that senses the temperature and transmits it to the household terminal 150; an indoor environment detection unit 144 that senses the air quality of the household and transmits it to the household terminal 150; and a window open/close detection unit 145 that senses the opening and closing of windows provided in the household and transmits it to the household terminal 150, wherein the household terminal 150 includes the illuminance and temperature sensor unit 143 A diagnostic module 156 for generating a control command to be transmitted to the individual household device 300 using the sensing information received from the indoor environment sensor 144 and the window open/close sensor 145, The generation integration detection control module 140 generates an IR control signal corresponding to the control command received from the household terminal 150 and controls the individual household device 300 through the IR controller 148 using the IR control signal. do.

In addition, preferably, the diagnosis module 156 of the present disclosure uses the information received from the distance detection module 158, the illuminance and temperature sensor unit 143, and the door lock module 360 to determine the occupancy of the household. The number of people is identified, the diagnosis module 156 determines the movement of the occupant using the distance detection module 158 and the motion recognition unit 142, and the control module 154 detects the movement of the occupant. The lighting device 310 is controlled by using.

In addition, preferably, when a control command for controlling the door lock module 360 is input to the mobile application unit 202 of the present disclosure, the mobile application unit 202 authenticates the internal cloud platform 120. When a one-time security key is requested from the server and the authentication server authenticates the user, the one-time security key is transmitted to the mobile application unit 202, and the one-time security is performed using the security module in which the door lock module 360 is embedded. The smart door lock is opened by confirming the key.

As described above, according to the present embodiment, the smart home system has the effect of controlling both general and smart home appliances.

In addition, the smart home system has an effect of enabling health care for each member of the household using information received through a smart scale.

In addition, the smart home system has an effect of providing an appropriate parking place suitable for the characteristics of the vehicle owner by inquiring information about the vehicle and the vehicle owner entering the vehicle and controlling parking through this.

In addition, the smart home system has an effect of increasing user convenience because the light is automatically turned on even if the user does not directly manipulate the lighting control unit inside the household and goes to the desired traffic line.

1 and 2 are conceptual diagrams showing the configuration of a smart home system according to an embodiment of the present disclosure.
3 is a flowchart of a method for controlling an indoor environment of a smart home system according to an embodiment of the present disclosure.
4 is a flowchart of a parking control method of a smart home system according to an embodiment of the present disclosure.
5 is a flowchart of a flow control method of a smart home system according to an embodiment of the present disclosure.
6 is a flowchart of a door lock control method of a smart home system according to an embodiment of the present disclosure.
7 is an example in which a notification provided by a smart home system according to an embodiment of the present disclosure is displayed on a mobile application.

Hereinafter, some embodiments of the present disclosure will be described in detail through exemplary drawings. In adding reference numerals to components of each drawing, it should be noted that the same components have the same numerals as much as possible, even if they are displayed on different drawings. In addition, in describing the present disclosure, if it is determined that a detailed description of a related known configuration or function may obscure the gist of the present disclosure, the detailed description will be omitted.

In describing the components of the embodiment according to the present disclosure, symbols such as first, second, i), ii), a), and b) may be used. These codes are only for distinguishing the component from other components, and the nature or sequence or order of the corresponding component is not limited by the codes. In the specification, when a part is said to 'include' or 'include' a certain component, it means that it may further include other components, not excluding other components unless explicitly stated otherwise. .

In the present disclosure, a "building complex" means an assembly of multiple households, and may be multiple buildings rather than one building. For example, it is a concept that includes not only one apartment building but also multiple apartment complexes.

In addition, in the present disclosure, "space" means a part constituting a household divided according to function or purpose, for example, in the case of a residential household, room 1, room 2, room 3, bathroom, kitchen, living room, It may be a porch, a veranda, and the like. Since this division will be different for each generation, here, all parts where each generation is divided are referred to as spaces.

Also, in the present disclosure, the term "individual household device" is used to encompass all devices provided in a household. Individual household devices are classified into 'general appliances' and 'smart appliances'. Smart home appliances refer to all devices that can be controlled through a household terminal provided in a household, a user's smartphone, or another smart input device separately provided in a household, or to which IoT technology is applied. As a concept distinct from this, 'general home appliances' refer to devices that are controlled by direct input of user commands into the general home appliances themselves. means a device capable of

In addition, in the present disclosure, "user" refers to a person residing in a collective building equipped with a smart home system.

In addition, in the present disclosure, "occupant" refers to a person who is occupied inside a household among users.

Smart home system configuration

1 is a conceptual diagram showing the configuration of a smart home system according to an embodiment of the present disclosure.

Referring to FIG. 1, the overall configuration of a smart home system according to an embodiment of the present disclosure will be described. The smart home system according to the present disclosure includes command input means 201 and 202, an internal cloud platform 120, an external cloud platform 220, an apartment complex server 130, a household terminal 150, and a common facility control module. (160) and all or part of the generation integration detection control module (140).

First, the configuration provided inside the household will be described first.

A household may include a generation integration detection and control module 140, a household terminal 150, and an individual household device 300.

The generation integration detection and control module 140 is a module provided in a household and may be provided in each space of a household for user convenience. The integrated generation detection control module 140 includes a voice recognition unit 141, a motion recognition unit 142, an illuminance and temperature sensor unit 143, an indoor environment detection unit 144, a window opening/closing detection unit 145, an outdoor environment It includes all or part of the detector 146, the inter-floor noise detector 147, and the IR controller 148.

The voice recognition unit 141 is configured to recognize a user's voice. To this end, the voice recognition unit 141 may preferably include a microphone, an amplifier, and a noise removal unit. The household terminal 150 is configured to recognize the user's intention using the transmitted voice and generate a control command.

The motion recognition unit 142 is configured to recognize a user's motion. To this end, the motion recognition unit 142 may preferably include an image sensor and an image processing unit. At this time, the image sensor is a camera, a Doppler sensor, a PIR sensor (passive infrared sensor), a LiDAR sensor, a radar sensor, a thermal image sensor, an ultrasonic sensor, and an ultra-wide UWB sensor. band sensor) is acceptable.

The generation integration detection control module 140 may generate a command using the voice and motion recognized through the voice recognition unit 141 and the motion recognition unit 142 and transmit it to the household terminal 150 .

In particular, the household terminal 150 receiving the operation command generated by the operation recognition unit 142 determines a situation using the operation command, and generates a notification in a preset manner when the situation is determined to be an emergency situation. can be configured to Notification generation can be configured to automatically provide an alarm to a guardian's mobile phone or to provide an alarm to an administrator who manages a collective building.

In particular, the motion recognition unit 142 can be effectively applied to care for the weak targeting the hearing impaired, the elderly, and the like. When it is difficult to normally generate a voice command or there is a hearing impairment, it is possible to easily control various devices by using only predetermined operation commands. There are various ways to perform care for the weak using the motion recognition unit 142 . By generating an operation command, a crisis situation can be notified to the outside, such as family members and management offices. In this case, it can be applied very effectively for the safety of the weak, such as mobile App notifications, a method of forming compulsory notifications to be displayed on the control screen of the management office, and providing notifications to managers through the management office control system.

In addition, whether or not the user stays in a predetermined space and the user's activity state may be identified by the motion recognition unit 142 . The motion recognition unit 142 may be placed anywhere inside the household. For example, one motion recognition unit 142 may be disposed in each space, or a plurality of motion recognition units 142 may be disposed in each space.

The motion commands sensed by the motion recognition unit 142, whether or not the user is present, and the activity status of the user are transmitted to the household terminal 150. At this time, the household terminal 150 is configured to recognize the user's intention and generate a control command using the transmitted motion.

The illuminance and temperature sensor unit 143 is disposed in each space and configured to sense the illuminance and temperature of the corresponding space. Information sensed by the illuminance and temperature sensor unit 143 is transmitted to the household terminal 150 and a lighting control unit (not shown). Meanwhile, the illuminance and temperature sensor unit 143 may be preferably incorporated in a lighting control unit (not shown) disposed in each space. Here, the lighting control unit means a control device provided on a wall surface of each space and configured to control dimming of each space by having a front surface composed of an LCD.

The indoor environment sensor 144 is configured to sense air quality information inside the household. Here, the air quality information inside the household may be, for example, carbon dioxide concentration and fine dust concentration. Indoor environment information sensed by the indoor environment detector 144 is transmitted to the household terminal 150 .

The window open/close detection unit 145 is configured to detect whether a window is opened or closed. At this time, the window opening/closing detection unit 145 is configured to detect opening and closing of a single window or a double window. To this end, the window opening/closing detection unit 145 may include a magnetic field detection device disposed between the outer window magnet, the inner window magnet, and the outer window magnet and the inner window magnet. The magnetic field detection device may determine whether the window is opened or closed by detecting a change in magnetic flux of the magnetic field generated from the magnets. Information sensed by the window open/close detection unit 145 may be transmitted to the household terminal 150 .

The outdoor environment detection unit 146 is configured to sense environmental information outside the household and is preferably attached to an outside window. Environmental information outside the household may include, for example, temperature, humidity, fine dust concentration, and rainfall information. Information sensed by the outdoor environment sensor 146 may be transmitted to the household terminal 150 .

The inter-floor noise detection unit 147 is configured to sense sound and vibration generated inside the household, and may be disposed below the flooring, inside the wall, and above the ceiling. Information sensed by the inter-floor noise detector 147 may be transmitted to the household terminal 150 .

At this time, when the household terminal 150 determines that the inter-floor noise sensed by the inter-floor noise detection unit 147 is greater than or equal to a predetermined reference value, it may provide a notification to the user terminal through the mobile application unit 202 (FIG. 7). see (c) of).

The IR controller 148 is configured to transfer a control command generated by the household terminal 150 or a control command transmitted through the household terminal 150 to the individual household device 300 . General and smart home appliances have built-in IR modules. Due to this, the household terminal 150 and the individual household device 300 can communicate wirelessly.

The household terminal 150 is referred to as a home network wall pad or simply a wall pad. The household terminal 150 may be disposed anywhere inside the household, but it will be considered that it is preferably disposed in the living room.

The external appearance of the household terminal 150 is not limited, but includes a liquid crystal display (LCD) formed on the front side and a jog dial (not shown). At this time, the LCD is formed to be 5 inches to 15 inches, but preferably has a resolution of 1920 x 720 px, but the generation terminal 150 according to the present disclosure is not necessarily limited thereto.

As the jog dial (not shown) rotates, UI selection output to the LCD can be controlled. Also, as the jog dial rotates, the brightness and color temperature of the lighting in the living room can be controlled. That is, since the household terminal 150 is integrally formed with the living room switch, there is an effect of improving the appearance without damaging the interior of the household.

The household terminal 150 includes all or part of an authentication module 152, a control module 154, a diagnosis module 156, and a distance detection module 158.

The authentication module 152 is connected to the external cloud platform 220, the user terminal, and the door lock module 360, and is configured to transmit and receive authentication requests and security keys. Regarding the authentication method using the authentication module 152, it will be described in detail in FIG.

The control module 154 is configured to receive a voice command or an operation command received from the generation integration detection control module 140, and convert it into a control command. The voice command corresponds to information recognized by the voice recognition unit 141, and the operation command corresponds to information recognized by the motion recognition unit 142.

In the case of a voice command, it may be converted into a control command through natural language processing by the control module 154 . However, the voice recognition method of the smart home system according to the present disclosure is not necessarily limited thereto, and an operation for converting into a control command may be performed using an external cloud platform 220.

For example, the user may input a control command through the individual AI command recognition device 201. Each AI command recognition device 201 electrically communicates with the external cloud platform 220, and the control command is once transmitted to the external cloud platform 220. Then, the control command is transmitted from the external cloud platform 220 to the internal cloud platform 120 and stored, and then transmitted to the household terminal 150 via the apartment complex server 130 again.

The control module 154 controls the individual household devices 300 using any one or more of the voice command recognized through the voice recognition unit 141 or the control command input through the individual AI command recognition device 201. can

The diagnostic module 156 is configured to generate a control command to be transmitted to the general home appliance 352 using information obtained from the illuminance and temperature sensor 143, the indoor environment sensor 144, and the window open/close sensor 145. do. Here, the general home appliance 352 includes electric curtains and window actuators. That is, the diagnosis module 156 determines whether the window is opened or closed using the sensing information received from the illuminance and temperature sensor unit 143, the indoor environment sensor 144, and the window open/close sensor 145, and accordingly Correspondingly, the electric curtain and window actuators are controlled.

In addition, the diagnosis module 156 determines the number of occupants by using information obtained from all or part of the distance detection module 158, the illuminance and temperature sensor unit 143, the motion recognition unit 142, and the door lock module 360. is configured to

For example, when it is determined by the distance detection module 158 and the motion recognition unit 142 disposed in the living room that there is one user in the living room and one user in the living room and one in the kitchen, the diagnosis module 156 determines the total number of users. It is judged that there are three occupants.

In addition, the diagnostic module 156 can determine the number of users in the room by using the opening/closing information of the door lock module 360 . For example, in a household with four registered users, if the door lock module 360 is opened twice from the inside and opened from the outside once, it is determined that two people go out and one person enters the room, and the diagnosis module 156 ) determines that there are three total occupants.

In addition, the diagnosis module 156 may use the distance detection module 158 and the motion recognition unit 142 to predict the user's movement line, and control the lighting device 310 using this. Details of the contents will be described later with reference to FIG. 5 .

The distance detection module 158 is provided inside the household terminal 150 and is configured to sense a distance to an object. To this end, the distance detection module 158 may preferably include a ToF sensor (time of flight). The distance detection module 158 may measure the distance to the object by transmitting an infrared signal and calculating a signal received after being reflected. For this reason, the distance detection module 158 may measure the distance to the user even in an environment where there is little light, for example, when the user draws down the curtains and turns off the lights.

The individual household device 300 includes all or part of the lighting device 310, the ventilation device 320, the cooling/heating device 330, the smart device 340, the home appliance 350, and the door lock module 360.

The lighting device 310 is located in each area within the household, is connected to the household terminal 150 by wire or wirelessly, and is preferably provided with a separate switch for each. On/off and dimming of the lighting device 310 may be controlled through the household terminal 150 . In addition, on/off and dimming of each lighting device 310 may be controlled through a lighting control unit (not shown) provided in each space.

The ventilation device 320 refers to an air purifier and a household ventilator basically provided in a household, and does not mean devices separately provided by a user. In addition, the ventilation device 320 may be formed in a configuration in which a total heat exchanger is coupled.

The cooling/heating device 330 is a concept including a cooling device, for example, an air conditioner and a heating thermostat. These may be controlled in an IR manner, and may be connected to the household terminal 150 and controlled wired or wirelessly through the household terminal 150 .

The smart device 340 is a concept including devices related to electricity and heat provided in a household. Typical examples include gas valves, smart electrical outlets, and induction. In addition, the smart device 340 may further include a smart weight scale. Information related to the user's weight information, body fat percentage information, and musculoskeletal mass collected from the smart scale may be transmitted to the household terminal 150 .

The home appliance 350 includes a general home appliance 352 and a smart home appliance 354 .

The general home appliance 352 includes an IR module and is configured to be capable of IR control from the IR controller 148 . In addition, the smart home appliance 354 has a built-in communication module configured to be connected to the household terminal 150 by wire or wirelessly.

On the other hand, the smart home appliance 354 may also be configured to enable IR control with an IR module built-in, and is divided into general home appliances 352 and smart home appliances 354 depending on whether wired or wireless connection with the household terminal 150 is possible. And, it does not exclude the possibility of IR control of the smart home appliance 354. The smart home appliance 354 is configured to be controllable by the individual AI command recognition device 201, the dedicated mobile application unit 202 installed on the user's smartphone, and the household terminal 150.

Meanwhile, in the present disclosure, the mobile application unit 202 refers to a component that drives an application.

The door lock module 360 is provided at the door of the household and includes a smart door lock and a door phone. The smart door lock can be opened and closed by a user's PIN input, an NFC tag, or control through a user terminal. In this regard, it will be described in detail in FIG. 6 .

The door phone is configured to photograph a common space in the vicinity of the household and to recognize a courier or a visitor. The information sensed by the door phone is delivered to the household terminal 150, which may also be delivered to the user terminal in the form of a notification.

Hereinafter, the configuration provided in the collective building will be described.

The collective building may be equipped with an apartment housing complex server 130, an internal cloud platform 120, and a community facility control module 160.

The multi-unit housing complex server 130 means a local server of the collective building, and uses it to construct a local network within the complex. The apartment complex server 130 is configured to send and receive information on control commands from the household terminal 150, and performs a firewall function. Meanwhile, the apartment complex server 130 may use a cloud middleware framework (CMF) for connection with the internal cloud platform 120. Here, a cloud middleware framework is used as an intermediate system connecting them. The apartment housing complex server 130 electrically communicates with the community facility control module 160 and is configured to control the community facilities in the collective building.

Specifically, the common facility control module 160 receives a control command transmitted from the apartment housing complex server 130, and is configured to control the operation of common facilities provided in the collective building based on this.

The internal cloud platform 120 refers to a cloud platform dedicated to collective buildings, and serves as a window in a relationship with an external cloud platform 220 to be described later. The internal cloud platform 120 is configured to be connected to the apartment complex server 130 to exchange information on control commands. At this time, information on control commands exchanged with and from the apartment housing complex server 130 is configured to be stored as big data in the internal cloud platform 120. Accumulated big data can be used as data for AI control.

The common facility control module 160 performs a function of controlling common facilities in the collective building. The common facility control module 160 is configured to receive weather information from a weather station. The weather station may be a weather information collection device provided inside a collective building or may be a meteorological office.

In addition, the common facility control module 160 is configured to control the guidance service robot. The guide service robot can walk around inside the collective building and give directions to residents and visitors of the collective building.

In addition, the common facility control module 160 includes a video security module, an AI parking control module, and a common entrance control module.

The common facility control module 160 may perform the functions of checking information on entering and exiting vehicles, detecting an emergency situation, and recognizing a user's face by using a video security module.

The AI parking control module is configured to provide an appropriate parking space to the user by using vehicle information recognized from the video security module. In this regard, it will be described in detail in FIG. 4 .

The common facility control module 160 may control the elevator using user information recognized from the video security module. For example, when a resident of room 2104 enters the common entrance, the common facility control module 160 may call the elevator before the user arrives in front of the elevator and select the 21st floor button in advance.

At this time, the common facility control module 160 does not necessarily need to use the video security module in recognizing the user. For example, if the user's access card is tagged with the common entrance control module, the common facility control module 160 can recognize the user's information and appropriately control the elevator.

In addition, the common facility control module 160 may limit the user's use of the elevator by using the information received from the smart scale. For example, if body fat and weight data higher than the target body fat percentage are recorded, the common facility control module 160 may not call the elevator even if the user who has authenticated the elevator enters the common entrance.

Hereinafter, the individual AI command recognition device 201 and the external cloud platform 220 will be described. The individual AI command recognition device 201 means a device dedicated to the external cloud platform 220 or a device configured to be connectable with the external cloud platform 220 . One example is a smart speaker. There are already commercialized smart speakers such as Google Home, Naver Clover, and Kakao mini, which are configured to recognize users' voice commands and give control commands to connected IoT devices.

The external cloud platform 220 may also include, for example, Google Cloud Platform, Naver Cloud Platform, and Kakao Cloud Platform. We refer to these as 'collaborative clouds'. Since each user's preferred or actually used cloud platform is different, it is difficult to unify them. The present invention has an effect of unifying different cloud platforms using the internal cloud platform 120 .

That is, no matter what kind of external cloud platform 220 the user uses, when authenticated and connected to the internal cloud platform 120, all individual generation devices 300 can be controlled regardless of the type of external cloud platform 220. It can be effective. Meanwhile, the internal cloud platform 120 and the external cloud platform 220 may be connected in an application programming interface (API) method.

Control method using smart home system

2 is a conceptual diagram showing the configuration of a smart home system according to an embodiment of the present disclosure. 7 is an example in which a notification provided by a smart home system according to an embodiment of the present disclosure is displayed on a mobile application.

3 is a flowchart of a method for controlling an indoor environment of a smart home system according to an embodiment of the present disclosure.

Referring to FIGS. 2, 3 and 7(a), a method for controlling an indoor environment of a smart home system according to an embodiment of the present disclosure will be described.

The indoor environment information sensed by the indoor environment detector 144, whether or not the windows are open or closed sensed by the window open/closed detector 145, and the illuminance and temperature information of each space sensed by the illuminance and temperature sensor 143 are stored in the household terminal. (150). In addition, the outdoor environment information collected from the weather station is transmitted to the household terminal 150 via the common facility control module 160 .

The diagnosis module 156 of the household terminal 150 compares indoor environment information and outdoor environment information to determine whether a window is opened or closed. Based on whether the window is opened or closed determined by the diagnostic module 156, the household terminal 150 provides a notification to the mobile application unit 202, and according to the user's control signal input through the mobile application unit 202 Individual household devices 300 may be controlled.

For example, when it is determined that the outdoor air quality is poor by the outdoor environment detection unit 146 and the window opening/closing detection unit 145 determines that the window on the home side is open, the diagnostic module 156 determines to close the window. . Accordingly, the diagnosis module 156, as shown in (a) of FIG. 7 , may suggest closing the window to the user along with a notification saying “The concentration of fine dust outside is high. Do you want to close the window in the master bedroom?”

When the user transmits a window closing command through the mobile application unit 202, the diagnostic module 156 may close the open window by activating the window actuator.

Alternatively, when the indoor air quality is determined to be poor by the indoor environment detection unit 144, the outdoor air quality is determined to be good by the weather station, and the window open/closed detection unit 145 determines that the window is closed, The diagnosis module 156 of the household terminal 150 may determine to open a window.

Accordingly, the diagnostic module 156 proposes to the user to open the window through the mobile application unit 202, and when a command to open the window is input by the user, the window actuator is operated to open the closed window. there is.

On the other hand, it should be noted that the above description is merely illustrative for convenience of understanding, and the present disclosure is not limited to the above example.

4 is a flowchart of a parking control method of a smart home system according to an embodiment of the present disclosure.

Referring to Figures 2, 4 and 7 (b), a parking control method of a smart home system according to an embodiment of the present disclosure will be described.

When the vehicle enters the parking lot, the video security module takes a picture of the license plate of the vehicle. The photographed license plate image of the vehicle is transmitted to the common facility control module 160 . The common facility control module 160 may extract the license plate number by processing the license plate image of the vehicle. Of course, the task of extracting the license plate number from the license plate image may also be performed in the apartment complex server 130.

The AI parking control module checks whether the recognized vehicle number corresponds to the user's vehicle number stored in the apartment complex server 130. If it is authenticated as a legitimate user, the apartment complex server 130 allows entry of the vehicle through the AI parking control module.

At the same time, the multi-unit housing complex server 130 transmits information on the entered vehicle to the household terminal 150 . On the household terminal 150, information on the vehicle entered is displayed. For example, the user's entering information may be notified along with a notice saying "The vehicle of user 3 among the registered vehicles has now arrived."

In addition, the AI parking control module requests the multi-unit housing complex server 130 to inquire detailed information of the entered vehicle. Here, the detailed information of the vehicle includes whether the vehicle corresponds to an electric vehicle, whether the driver corresponds to a pregnant woman, whether the driver corresponds to a disabled person, and the building and number where the borrower resides. Hereinafter, an example of a method of operating a smart home system that determines whether an electric car is applicable and calculates and provides a parking notification will be described.

The apartment housing complex server 130 checks whether the entered vehicle corresponds to an electric vehicle. If it is confirmed that the entered vehicle corresponds to an electric vehicle, the internal cloud platform 120 provides a notification confirming the charging intention to the user through the mobile application unit 202 as shown in (b) of FIG. 7 .

When an electric vehicle charging command is input to the mobile application unit 202 by the user, the apartment complex server 130 checks whether there are vacancies among designated electric vehicle charging stations. If it is confirmed that there is a vacancy, the apartment housing complex server 130 may control the lighting of the underground parking lot through the community facility control module 160 . For example, by turning on lights from a current vehicle location to a location where an electric vehicle can be charged, the user may be guided along the way.

Alternatively, the guidance service robot may inform the user of a chargeable area and guide the user's vehicle along the way.

A series of processes of notifying the user of an available parking area is referred to as parking notification.

5 is a flowchart of a flow control method of a smart home system according to an embodiment of the present disclosure.

Referring to FIGS. 2 and 5 , a method for controlling a traffic line of a smart home system according to an embodiment of the present disclosure will be described. The distance information sensed by the distance detection module 158 and the illuminance and temperature information of each space sensed by the illuminance and temperature sensor 143 are transmitted to the diagnosis module 156 .

At this time, the diagnostic module 156 may determine the number of occupants of each space by using the illuminance information of each space and whether or not the user recognized by the motion recognition unit 142 stays in the predetermined space.

In addition, although not shown in the present disclosure, the total number of occupants is estimated by collecting the opening and closing information of the door lock module 360, and the information sensed by the illuminance and temperature sensor unit 143 and the distance detection module 158 and The number of occupants can be determined by comparison.

Information related to the confirmed number of occupants is transmitted to the internal cloud platform 120 . For example, information such as 'User 1 is in the living room and User 2 is in the main room' may be stored in the internal cloud platform 120 .

When movement of user 1 and user 2 is detected by the motion recognition unit 142, the internal cloud platform 120 predicts the movement of each user. The household terminal 150 controls the lighting device 310 according to the predicted movement line.

At this time, the internal cloud platform 120 stores user movement information and lighting control information as big data, enabling AI learning. However, it is not necessarily limited thereto, and it is possible to predict a user's movement and control lighting using a rule-base algorithm.

6 is a flowchart of a door lock control method of a smart home system according to an embodiment of the present disclosure.

A door lock control method of a smart home system according to an embodiment of the present disclosure will be described with reference to FIGS. 2, 6, and 7(d). It may be necessary for the user to remotely control the door lock module 360 to open or close the household door. At this time, the user can control the door lock module 360 through the mobile application unit 202 .

Specifically, when the user requests to open the door lock module 360 through the mobile application unit 202, the mobile application unit 202 requests the external cloud platform 220 for a one-time security key.

The external cloud platform 220 is connected to the user's mobile application unit 202, so that it can check whether the requesting user is a true user. At this time, if it is confirmed that the user is a true user, the external cloud platform 220 generates a one-time security key.

The generated one-time security key is transmitted from the external cloud platform 220 to the door lock module 360 through the internal cloud platform 120, the apartment complex server 130, and the household terminal 150 in order.

The door lock module 360 authenticates the delivered one-time security key and opens the locking device.

The above description is merely an example of the technical idea of the present embodiment, and various modifications and variations can be made to those skilled in the art without departing from the essential characteristics of the present embodiment. Therefore, the present embodiments are not intended to limit the technical idea of the present embodiment, but to explain, and the scope of the technical idea of the present embodiment is not limited by these embodiments. The scope of protection of this embodiment should be construed according to the claims below, and all technical ideas within the scope equivalent thereto should be construed as being included in the scope of rights of this embodiment.

120: internal cloud platform
130: apartment complex server
140: generation integration detection control module
150: household terminal
160: common facility control module
201: Individual AI command recognition device
202: mobile application
220: external cloud platform
300: individual generation device
310: lighting device
320: Ventilation device
330: air conditioner
340: smart device
350: home appliances
360: door lock device

Claims (9)

As a smart home system built in each household of a collective building,
It is provided inside the household,
a voice recognition unit 141 configured to recognize voice; and
A generation integration detection and control module 140 including a motion recognition unit 142 configured to recognize a motion and generating a command using the recognized voice and motion;
A control command is received from the individual AI command recognition device 201 and the mobile application unit 202 installed in the user terminal, a command is received from the generation integration detection control module 140, and the control command is controlled by the control module 154 Generation terminal 150 that converts to;
an individual household device 300 receiving a control command from the household terminal 150;
an apartment complex server 130 receiving a control command from the household terminal 150; and
It includes a common facility control module 160 configured to receive the control command from the apartment housing complex server 130 and control the operation of common facilities provided in the collective building,
The individual AI command recognition device 201 recognizes the user's voice to generate a voice command, transmits the voice command to the external cloud platform 200 to be calculated as a control command, and the calculated control command is internally It is transmitted to the generation terminal 150 through the cloud platform 120,
The mobile application unit 202 generates a control command, which is transmitted to the household terminal 150 through the internal cloud platform 120.
smart home system.
According to claim 1,
When a control command is input to the mobile application unit 202, the mobile application unit 202 transmits an authentication request to the household terminal 150,
The authentication module 152 of the household terminal 150 receives the authentication request and compares it with the user information stored in the apartment complex server 130, so that the mobile application unit 202 and the household terminal 150 performing authentication,
smart home system.
According to claim 2,
The individual household device 300 includes a lighting device 310, a ventilation device 320, a cooling/heating device 330, a smart device 340, a home appliance 350, and a door lock module 360 located in the household, ,
The common facility control module 160 performs guidance service robot control, video security control, AI parking control, elevator control, and common entrance access control according to the received control command.
smart home system.
According to claim 3,
The common facility control module 160 transmits a query request to the apartment housing complex server 130 to inquire information about a vehicle entering the parking lot,
When receiving the inquiry request, the apartment complex server 130 searches for vehicle information and transmits the searched vehicle information to the household terminal 150 and the common facility control module 160,
The generation terminal 150 displays the information of the inquired vehicle,
The common facility control module 160 calculates a parking notification by a preset method using the parking information of a parking lot stored in advance together with the vehicle information received from the apartment complex server 130, and then the inquired vehicle. to provide parking notifications to users of
smart home system.
According to claim 4,
The information of the vehicle includes whether it is an electric vehicle,
If the vehicle corresponds to an electric vehicle, the common facility control module 160 checks whether an electric vehicle charging station in the parking lot is used and calculates the parking notification including this,
smart home system.
According to claim 3,
The smart device 340 includes a gas valve, a weight scale, an induction and an outlet,
The weight scale electrically communicates with the mobile application unit 202 and the household terminal 150,
The household terminal 150 determines a control signal transmitted from the common facility control module 160 to the elevator using the information received from the weight scale.
smart home system.
According to claim 3,
The household terminal 150 further includes a distance detection module 158 configured to detect a distance to a user,
The generation integration detection control module 140,
an illuminance and temperature sensor unit 143 that senses the illuminance and temperature of the household and transmits them to the household terminal 150;
an indoor environment detection unit 144 that senses the air quality of the household and transmits it to the household terminal 150; and
a window opening/closing detection unit 145 that senses the opening and closing of windows provided in the household and transmits it to the household terminal 150;
including,
The household terminal 150 uses the sensing information received from the illuminance and temperature sensor unit 143, the indoor environment sensor 144, and the window opening/closing sensor 145 to detect the individual household device 300. Includes a diagnostic module 156 for generating a control command to be transmitted to,
The generation integration detection control module 140 generates an IR control signal corresponding to the control command received from the household terminal 150 and controls the individual household device 300 through the IR controller 148 using the IR control signal. doing,
smart home system.
According to claim 7,
The diagnosis module 156 uses the information received from the distance detection module 158, the illuminance and temperature sensor unit 143, and the door lock module 360 to determine the number of occupants of the household,
The diagnosis module 156 uses the distance detection module 158 and the motion recognition unit 142 to determine the movement of occupants,
The control module 154 controls the lighting device 310 using the movement of the occupant.
smart home system.
According to claim 2,
When a control command for controlling the door lock module 360 is input to the mobile application unit 202,
The mobile application unit 202 requests a one-time security key from the authentication server of the internal cloud platform 120,
When authenticating the user, the authentication server transmits a one-time security key to the mobile application unit 202;
The smart door lock is opened by checking the one-time security key using the security module in which the door lock module 360 is built.
smart home system.

Images