KR20230018287A - Motion Detecting System Using House Terminals and Method Using Thereof - Google Patents

Abstract

According to an embodiment of the present disclosure, provided is a motion detecting system, comprising: an integrated household detection control module (140) provided inside a household and including a motion recognition part (142) arranged in one or more spaces constituting a household and configured to sense the presence or absence and the activity state of a user, and an illuminance and temperature sensor part (143) arranged in the one or more spaces and configured to sense the illuminance and temperature of each space; a household terminal (150) receiving the presence or absence, the activity state, the illuminance and the temperature, which are information sensed by the detection control module (140), and configured to sense a control instruction for controlling one ore more devices arranged inside the household; an individual household device (300) receiving the control instruction transmitted from the household terminal (150), and arranged in the one or more spaces; an apartment house complex server (130) electrically connected to the household terminal (150); and an inner cloud platform (120) electrically connected to the apartment house complex server (130) and configured to store the information sensed by the integrated household detection control module (140). Therefore, lighting can be controlled automatically without being controlled directly by a user.

Description

Movement Detection System Using House Terminals and Method Using It {Motion Detecting System Using House Terminals and Method Using Thereof}

The present disclosure relates to the field of architecture and IT technology, and more specifically, to a movement detection system for predicting a user's movement within a household using a household terminal such as a wall pad and a method using the same.

The content described in this section simply provides background information for the present disclosure and does not constitute prior art.

In recent years, smart home technology has been expanding. A smart home refers to a residence in which various household electronic products including home appliances are connected to each other through a network function.

Early smart home technology started at the level of providing Internet sharing functions, but is gradually evolving to provide media services and home automation functions directly.

There are many commercial solutions for smart home technology, many of which exploit the potential of cloud computing. However, the smart home implemented so far mainly uses a private cloud when using cloud computing, so mobile devices or external devices that do not belong to the private cloud are difficult to construct a smart home. there is.

In addition, despite the development of these smart home technologies, there are still parts where users lead their lives in the old way. For example, when a user wakes up in the dark at dawn and goes to drink water, in a dim state where there is no light or even in a familiar house, there is a risk of safety accidents due to bumping into walls or furniture because the user cannot properly navigate.

In addition, when the user approaches the household terminal, the technology of brightening or turning on/off the household terminal has been widely used in the prior art. However, only the approach of the user to the household terminal is sensed. Accordingly, even if the user does not approach the household terminal for the purpose of using the household terminal but passes by the household terminal, if the user is detected within a certain distance sensed by the proximity sensor of the household terminal, the display of the household terminal is illuminated. Due to this, there is a problem that power is wasted regardless of the user's intention.

(Patent Document 1) KR 10-2014-0050836A

(Patent Document 2) KR 10-2008-0096239A

(Patent Document 3) KR 10-1995873B

(Patent Document 4) KR 10-2225708 B1

(Patent Document 5) US 2020-0091617

(Patent Document 6) JP 2007-208991 A

Accordingly, an object of the present disclosure is to provide a movement detection system and a method using the same that can detect and predict a user's movement and automatically control lighting even if the user does not directly control the lighting.

In addition, an object of the present disclosure is to determine whether a user is approaching a household terminal, to predict the user's intention to use the household terminal, and to control the household terminal accordingly.

The problems to be solved by the present invention are not limited to the problems mentioned above, and other problems not mentioned will be clearly understood by those skilled in the art from the description below.

According to an embodiment of the present disclosure, a motion recognition unit 142 provided inside a household, disposed in one or more spaces constituting the household, and configured to sense a user's presence and activity state; and a generation integration detection and control module 140 including an illuminance and temperature sensor unit 143 disposed in the at least one space and configured to sense the illuminance and temperature of each space; a household terminal 150 configured to receive occupancy, activity status, illuminance, and temperature, which are information sensed by the detection control module 140, and to generate a control command for controlling one or more devices disposed inside the household; an individual household device 300 disposed in the one or more spaces to receive a control command transmitted from the household terminal 150; an apartment complex server 130 electrically connected to the household terminal 150; Provided is a movement detection system including an internal cloud platform 120 electrically connected to the apartment complex server 130 and configured to store the information sensed by the household integration detection control module 140.

Also, preferably, the household terminal 150 of the present disclosure includes a distance detection module 158 configured to sense distance information from a user, and the individual household device 300 includes a door lock module 360, , The door lock module 360 senses door lock information including indoor and outdoor open conditions and the number of opening and closing times, and the household terminal 150, the motion recognition unit 142 and the illuminance and temperature sensor unit 143 Control to be transmitted to the individual household device 300 using the information sensed by ), the distance to the user sensed by the distance detection module 158, and the door lock information sensed by the door lock module 360. and a diagnosis module 156 for generating a command, and the generation integration detection control module 140 receives the control command from the generation terminal 150 and generates an IR control signal corresponding to the received control command. and an IR control unit 148 configured to control the individual household device 300 using this.

In addition, preferably, the diagnosis module 156 of the present disclosure uses the door lock information sensed by the door lock module 360 and the GPS information generated by the mobile application unit 202 provided by the user to determine the current generation Assess the number of occupants within

In addition, preferably, the diagnosis module 156 of the present disclosure includes information on the number of occupants identified by the diagnosis module 156; and using the information sensed by the illuminance and temperature sensor unit 143 and the motion recognition unit 142 disposed in the one or more spaces to determine occupant information, and the diagnosis module 156 detects the distance The distance information sensed by the module 158 and the occupant information identified are transmitted to the internal cloud platform 120, and the internal cloud platform 120, using this, determines the movement of the user by a preset method. predict

Also, preferably, the individual household device 300 of the present disclosure further includes a lighting device 310, and the internal cloud platform 120 transmits the predicted movement of the user to the diagnosis module 156. The household terminal 150 generates a control command for controlling the lighting device 310 using the user's predicted movement line, and transmits the command to the lighting device 310, thereby controlling the lighting device 310. Control.

In addition, in the method of estimating the user's movement line and controlling the individual household device 300 using the household terminal 150 of the present disclosure, (a1) the door lock opening/closing information sensed by the door lock module 360 is transmitting to the diagnosis module 156 included in the household terminal 150; (a2) transmitting the GPS information generated by the mobile application unit 202 to the diagnosis module 156; (a3) calculating, by the diagnostic module 156, the total number of occupants using the door lock open/close information and the GPS information; (b1) transmitting the user's presence and activity state information sensed by the motion recognition unit 142 to the diagnosis module 156; (b2) transmitting the illumination intensity and temperature information of each space sensed by the illumination intensity and temperature sensor unit 143 to the diagnosis module 156; (b3) calculating, by the diagnosis module 156, occupant information using occupancy and activity state information, illumination intensity and temperature information; (c1) transmitting, by the diagnosis module 156, the occupant information calculated in step (b3) to the internal cloud platform 120; (c2) predicting, by the internal cloud platform 120, the occupant's movement using the occupant information; and (d) controlling the lighting device 310 so that the diagnosis module 156 corresponds to the movement line of the occupant.

In addition, preferably, in the method of predicting the movement of a user using the household terminal 150 and controlling the individual household device 300 using the household terminal 150 of the present disclosure, (A) the distance detection module 158 of the household terminal 150 measuring the distance between the user and the household terminal 150 by; (B) determining, by the household terminal 150, whether a user moves toward the household terminal 150; (B1) turning off the display of the household terminal 150 when it is determined that the user is not approaching the household terminal 150; (C) comparing, by the household terminal 150, a distance between the user and the household terminal 150 with a first distance when it is determined that the user is approaching the household terminal 150; (C1) turning off the display of the household terminal 150 when it is determined that the distance between the user and the household terminal 150 is greater than the first distance; (D) if it is determined that the distance between the user and the household terminal 150 is not greater than the first distance, comparing the household terminal 150 with the second distance smaller than the first distance; (D1) displaying a first screen on the display of the household terminal 150 when it is determined that the distance between the user and the household terminal 150 is equal to or greater than the second distance and less than the first distance; and (E) displaying the second screen on the display of the household terminal 150 when it is determined that the distance between the user and the household terminal 150 is less than the second distance.

Also, preferably, the first screen according to the present disclosure is a screen for outputting weather, time, and current location information, and the second screen outputs a UI including an elevator call, smart distribution board, and individual household device 300 controller. It is a screen that

As described above, according to the present embodiment, the smart home system including the household terminal predicts the user's movement using the distance sensing module built in the household terminal and the motion recognition unit outside the household terminal, and through this, lights. By controlling, there is an effect of increasing user convenience.

In addition, according to the present embodiment, the household terminal detects the distance from the user and whether or not the user is approaching, thereby controlling the displayed screen, thereby preventing waste of power.

1 is a conceptual diagram of a household terminal and a smart home system including the same according to an embodiment of the present disclosure.
2 illustrates an operation sequence of a movement detection system including household terminals according to an embodiment of the present disclosure.
3 and 4 show a method for detecting the movement of occupants in a movement detection system including a household terminal according to an embodiment of the present disclosure.
5 is a flow chart of a movement detection system including household terminals and a method using the same according to an embodiment of the present disclosure.
6 is a flow chart of a movement detection system including household terminals and a method using the same according to an embodiment of the present disclosure.

Hereinafter, some embodiments of the present disclosure will be described in detail through exemplary drawings. In adding reference numerals to components of each drawing, it should be noted that the same components have the same numerals as much as possible, even if they are displayed on different drawings. In addition, in describing the present disclosure, if it is determined that a detailed description of a related known configuration or function may obscure the gist of the present disclosure, the detailed description will be omitted.

In describing the components of the embodiment according to the present disclosure, symbols such as first, second, i), ii), a), and b) may be used. These codes are only for distinguishing the component from other components, and the nature or sequence or order of the corresponding component is not limited by the codes. In the specification, when a part is said to 'include' or 'include' a certain component, it means that it may further include other components, not excluding other components unless explicitly stated otherwise. .

In the present disclosure, "apartment housing complex" means an aggregate of multiple households.

In addition, in the present disclosure, "space" means a part constituting a household divided according to function or purpose, for example, in the case of a residential household, room 1, room 2, room 3, bathroom, kitchen, living room, It may be a porch, a veranda, and the like. Since this division will be different for each generation, here, all parts where each generation is divided are referred to as spaces.

Also, in the present disclosure, the term "individual household device" is used to encompass all devices provided in a household. Individual household devices are classified into 'general appliances' and 'smart appliances'. Smart home appliances refer to all devices that can be controlled through a household terminal provided in a household, a user's smartphone, or another smart input device separately provided in a household, or to which IoT technology is applied. As a concept distinct from this, 'general home appliances' refer to devices that are controlled by direct input of user commands into the general home appliances themselves. means a device capable of

In addition, in the present disclosure, "user" refers to a person residing in an apartment complex equipped with a smart home system.

In addition, in the present disclosure, a “occupant” refers to a user who is in a household, among users.

Configuration of smart home system including household terminal

1 is a conceptual diagram of a household terminal and a smart home system including the same according to an embodiment of the present disclosure.

1 is a conceptual diagram showing the configuration of a smart home system according to an embodiment of the present disclosure.

Referring to FIG. 1, the overall configuration of a smart home system according to an embodiment of the present disclosure will be described. The smart home system according to the present disclosure includes command input means 201 and 202, an internal cloud platform 120, an external cloud platform 220, an apartment complex server 130, a household terminal 150, and a common facility control module. (154) and all or part of the generation integration detection control module 140.

First, the configuration provided inside the household will be described first.

A household may include a generation integration detection and control module 140, a household terminal 150, and an individual household device 300.

The generation integration detection and control module 140 is a module provided in a household and may be provided in each space of a household for user convenience. The integrated generation detection control module 140 includes a voice recognition unit 141, a motion recognition unit 142, an illuminance and temperature sensor unit 143, an indoor environment detection unit 144, a window opening/closing detection unit 145, an outdoor environment It includes all or part of the detector 146, the inter-floor noise detector 147, and the IR controller 148.

The voice recognition unit 141 is configured to recognize a user's voice. To this end, the voice recognition unit 141 may preferably include a microphone, an amplifier, and a noise removal unit. The user's voice is transmitted to the household terminal 150 through the voice recognition unit 141 . The household terminal 150 is configured to recognize the user's intention using the transmitted voice and generate a control command. Here, the control command means an electrical signal for controlling all or part of the individual household device 300 .

The motion recognition unit 142 is disposed in one or more spaces and is configured to recognize a user's motion. To this end, the motion recognition unit 142 may preferably include an image sensor and an image processing unit. At this time, the image sensor is a camera, a Doppler sensor, a PIR sensor (passive infrared sensor), a LiDAR sensor, a radar sensor, a thermal image sensor, an ultrasonic sensor, and an ultra-wide UWB sensor. band sensor) is acceptable.

In addition, whether or not the user stays in a predetermined space, that is, whether or not the user is present and the user's activity state may be sensed by the motion recognition unit 142 . The motion recognition unit 142 may be placed anywhere inside the household. For example, one motion recognition unit 142 may be disposed in each space, or a plurality of motion recognition units 142 may be disposed in each space.

The motion command sensed by the motion recognition unit 142, whether the user is present, and the activity status of the user are transmitted to the household terminal 150. At this time, the household terminal 150 is configured to recognize the user's intention and generate a control command using the transmitted motion. Here, the control command means an electrical signal for controlling all or part of the individual household device 300 .

The illuminance and temperature sensor unit 143 is disposed in one or more spaces and is configured to sense the illuminance and temperature of the corresponding space. The illuminance and temperature information sensed by the illuminance and temperature sensor unit 143 is transmitted to the household terminal 150 and a lighting control unit (not shown). Meanwhile, the illuminance and temperature sensor unit 143 may be preferably incorporated in a lighting control unit (not shown) disposed in each space. Here, the lighting control unit means a control device provided on a wall surface of each space and configured to control dimming of each space by having a front surface composed of an LCD.

The indoor environment sensor 144 is configured to sense air quality information inside the household. Here, the air quality information inside the household may be, for example, carbon dioxide concentration and fine dust concentration. Indoor environment information sensed by the indoor environment detector 144 is transmitted to the household terminal 150 .

The window open/close detection unit 145 is configured to detect whether a window is opened or closed. At this time, the window opening/closing detection unit 145 is configured to detect opening and closing of a single window or a double window.

The outdoor environment detection unit 146 is configured to sense environmental information outside the household and is preferably attached to an outside window. Environmental information outside the household may include, for example, temperature, humidity, fine dust concentration, and rainfall information. Information sensed by the outdoor environment sensor 146 may be transmitted to the household terminal 150 .

The inter-floor noise detection unit 147 is configured to sense sound and vibration generated inside the household, and may be disposed below the flooring, inside the wall, and above the ceiling. Information sensed by the inter-floor noise detector 147 may be transmitted to the household terminal 150 .

The IR controller 148 is configured to transmit a control command generated by the household terminal 150 or a control command transmitted through the household terminal 150 to the individual household device 300 . General and smart home appliances have built-in IR modules. Due to this, the household terminal 150 and the individual household device 300 can communicate wirelessly.

The household terminal 150 is referred to as a home network wall pad or simply a wall pad. The household terminal 150 may be disposed anywhere inside the household, but it will be considered that it is preferably disposed in the living room.

The external appearance of the household terminal 150 is not limited, but includes a liquid crystal display (LCD) formed on the front side and a jog dial (not shown). At this time, the LCD is formed to be 5 inches to 15 inches, but preferably has a resolution of 1920 x 720 px, but the generation terminal 150 according to the present disclosure is not necessarily limited thereto.

As the jog dial (not shown) rotates, UI selection output to the LCD can be controlled. Also, as the jog dial rotates, the brightness and color temperature of the lighting in the living room can be controlled. That is, since the household terminal 150 is integrally formed with the living room switch, there is an effect of improving the appearance without damaging the interior of the household.

In addition, the jog dial is configured to enable infinite rotation. As a result, when the user controls the individual household device 300 using the household terminal 150, the user can continuously control from the minimum value to the maximum value, thereby increasing user convenience. Also, when the user wants to decrease the set value from the maximum value to the minimum value again, the value can be changed from the maximum value to the minimum value even if the user rotates the set value a little in the forward direction without needing to rotate it in the reverse direction. As a result, there is an effect of increasing user convenience.

The household terminal 150 includes all or part of an authentication module 152, a control module 154, a diagnosis module 156, and a distance detection module 158.

The authentication module 152 is connected to the external cloud platform 220, the user terminal, and the door lock module 360, and is configured to transmit and receive authentication requests and security keys.

The control module 154 is configured to calculate a voice command or an operation command received from the generation integration detection control module 140 as a control command. The voice command corresponds to information recognized by the voice recognition unit 141, and the motion command corresponds to information recognized by the motion recognition unit 142.

In the case of a voice command, it may be converted into a control command through natural language processing by the control module 154 . However, the voice recognition method of the smart home system according to the present disclosure is not necessarily limited thereto, and an operation for switching to a control command may be performed using the external cloud platform 220.

For example, the user may input a control command through the individual AI command recognition device 201. The individual AI command recognition device 201 is connected to the external cloud platform 220, and the control command is once transmitted to the external cloud platform 220. Then, the control command is transmitted from the external cloud platform 220 to the internal cloud platform 120 and stored, and is then transmitted to the household terminal 150 via the apartment complex server 130 again.

The control module 154 controls the individual household devices 300 using any one or more of the voice command recognized through the voice recognition unit 141 or the control command input through the individual AI command recognition device 201. can

The diagnostic module 156 is configured to generate a control command to be transmitted to the general home appliance 352 using information obtained from the illuminance and temperature sensor 143, the indoor environment sensor 144, and the window open/close sensor 145. do. Here, the general home appliance 352 includes electric curtains and window actuators. That is, the diagnosis module 156 determines whether the window is opened or closed using the sensing information received from the illuminance and temperature sensor unit 143, the indoor environment sensor 144, and the window open/close sensor 145, and accordingly Correspondingly, the electric curtain and window actuators are controlled.

In addition, the diagnosis module 156 determines the number of occupants by using information obtained from all or part of the distance detection module 158, the illuminance and temperature sensor unit 143, the motion recognition unit 142, and the door lock module 360. is configured to

In addition, the diagnosis module 156 may use the distance detection module 158 and the motion recognition unit 142 to predict the user's movement line, and control the lighting device 310 using this. Details of the contents will be described later with reference to FIGS. 2 to 5 .

The distance detection module 158 is provided inside the household terminal 150 and is configured to sense the distance between the household terminal 150 and the user. To this end, the distance detection module 158 may preferably include a ToF sensor (time of flight). The distance detection module 158 may measure the distance to the object by transmitting an infrared signal and calculating a signal received after being reflected. For this reason, the distance detection module 158 may measure the distance to the user even in an environment where there is little light, for example, when the user draws down the curtains and turns off the lights.

The individual household device 300 is provided inside the household and is configured to receive a control command transmitted from the household terminal 150 .

The individual household device 300 includes all or part of the lighting device 310, the ventilation device 320, the cooling/heating device 330, the smart device 340, the home appliance 350, and the door lock module 360.

The lighting device 310 is located in each area within the household, is connected to the household terminal 150 by wire or wirelessly, and is preferably provided with a separate switch for each. On/off and dimming of the lighting device 310 may be controlled through the household terminal 150 . In addition, on/off and dimming of each lighting device 310 may be controlled through a lighting control unit (not shown) provided in each space.

The ventilation device 320 refers to an air purifier and a household ventilator basically provided in a household, and does not mean devices separately provided by a user. In addition, the ventilation device 320 may be formed in a configuration in which a total heat exchanger is coupled.

The cooling/heating device 330 is a concept including a cooling device, for example, an air conditioner and a heating thermostat. These may be controlled in an IR manner, and may be connected to the household terminal 150 and controlled wired or wirelessly through the household terminal 150 .

The smart device 340 is a concept including devices related to electricity and heat provided in a household. Typical examples include gas valves, smart electrical outlets, and induction. In addition, the smart device 340 may further include a smart weight scale. Information related to the user's weight information, body fat percentage information, and musculoskeletal mass collected from the smart scale may be transmitted to the household terminal 150 .

The home appliance 350 includes a general home appliance 352 and a smart home appliance 354 .

The general home appliance 352 includes an IR module and is configured to be capable of IR control from the IR controller 148 . In addition, the smart home appliance 354 has a built-in communication module configured to be connected to the household terminal 150 by wire or wirelessly.

On the other hand, the smart home appliance 354 may also be configured to enable IR control with an IR module built-in, and is divided into general home appliances 352 and smart home appliances 354 depending on whether wired or wireless connection with the household terminal 150 is possible. And, it does not exclude the possibility of IR control of the smart home appliance 354. The smart home appliance 354 is configured to be controllable by the individual AI command recognition device 201, the dedicated mobile application unit 202 installed on the user's smartphone, and the household terminal 150.

The door lock module 360 is provided at the door of the household. The door lock module 360 is configured to sense door lock information. Here, the door lock information means whether or not the door is open indoors, whether or not the door is open outdoors, and the number of opening and closing times. Indoor open means a case where the door lock is opened inside the household, and outdoor open means a case where the door lock is opened outside the household. Also, the number of opening/closing means the number of times the number of indoor opening times and the number of outdoor opening times are added.

Includes smart door lock and door phone. The smart door lock can be opened and closed by a user's PIN input, an NFC tag, or control through a user terminal.

The door phone is configured to photograph a common space in the vicinity of the household and to recognize a courier or a visitor. The information sensed by the door phone is delivered to the household terminal 150, which may also be delivered to the user terminal in the form of a notification.

Hereinafter, a configuration provided in an apartment complex will be described.

An apartment housing complex server 130, an internal cloud platform 120, and a communal facility control module 154 may be provided in the apartment housing complex.

The multi-housing complex server 130 means a local server of the multi-housing complex, and a local network within the complex is configured using this. The apartment complex server 130 is configured to send and receive information on control commands from the household terminal 150, and performs a firewall function. Meanwhile, the apartment complex server 130 may use a cloud middleware framework (CMF) for connection with the internal cloud platform 120. Here, a cloud middleware framework is used as an intermediate system connecting them. The apartment housing complex server 130 is connected to the community facility control module 160 and is configured to control community facilities in the apartment complex.

The internal cloud platform 120 refers to a cloud platform dedicated to an apartment complex and serves as a window in a relationship with an external cloud platform 220 to be described later. The internal cloud platform 120 is configured to be connected to the apartment complex server 130 to exchange information on control commands. At this time, information on control commands exchanged with and from the apartment housing complex server 130 is configured to be stored as big data in the internal cloud platform 120. Accumulated big data can be used as data for AI control.

The communal facility control module 154 performs a function of controlling communal facilities in an apartment complex. The common facility control module 154 is configured to receive weather information from a weather station. The weather station may be a weather information collection device provided inside an apartment complex or may be a meteorological office.

In addition, the common facility control module 154 is configured to control the guidance service robot. The guide service robot can walk around inside the apartment complex and give directions to residents and visitors of the apartment complex.

In addition, the common facility control module 154 includes a video security module, an AI parking control module, and a common entrance control module.

The common facility control module 154 may perform the functions of checking information on entering and exiting vehicles, detecting an emergency situation, and recognizing a user's face by using a video security module.

The AI parking control module is configured to provide an appropriate parking space to the user by using vehicle information recognized from the video security module.

The common facility control module 154 may control the elevator using user information recognized from the video security module. For example, when a resident of room 2104 enters the common entrance, the common facility control module 154 may call the elevator before the user arrives in front of the elevator and select the 21st floor button in advance.

At this time, in recognizing the user, the common facility control module 154 does not necessarily need to use the video security module. For example, if the user's access card is tagged with the common entrance control module, the common facility control module 154 can recognize the user's information and appropriately control the elevator.

In addition, the common facility control module 154 may limit the user's use of the elevator by using the information received from the smart scale. For example, if body fat and weight data higher than the target body fat percentage are recorded, the common facility control module 160 may not call the elevator even if the user who has authenticated the elevator enters the common entrance.

Hereinafter, the individual AI command recognition device 201 and the external cloud platform 220 will be described. The individual AI command recognition device 201 means a device dedicated to the external cloud platform 220 or a device configured to be connectable with the external cloud platform 220 . One example is a smart speaker. There are already commercialized smart speakers such as Google Home, Naver Clover, and Kakao mini, which are configured to recognize users' voice commands and give control commands to connected IoT devices.

The external cloud platform 220 may also include, for example, Google Cloud Platform, Naver Cloud Platform, and Kakao Cloud Platform. We refer to these as 'collaborative clouds'. Since each user's preferred or actually used cloud platform is different, it is difficult to unify them. The present invention has an effect of unifying different cloud platforms using the internal cloud platform 120 .

That is, no matter what kind of external cloud platform 220 the user uses, when authenticated and connected to the internal cloud platform 120, all individual generation devices 300 can be controlled regardless of the type of external cloud platform 220. It can be effective. Meanwhile, the internal cloud platform 120 and the external cloud platform 220 may be connected in an application programming interface (API) method.

Lighting control method of movement detection system using household terminal

2 illustrates an operation sequence of a movement detection system including household terminals according to an embodiment of the present disclosure. 3 and 4 show a method for detecting the movement of occupants in a movement detection system including a household terminal according to an embodiment of the present disclosure.

Referring to FIG. 2 , the diagnosis module 156 transmits information from the door lock module 360 and the mobile application unit 202 .

Specifically, open/close information sensed by the door lock module 360 is transmitted to the diagnosis module 156 . The diagnosis module 156 may determine the number of occupants of the user by using the opening/closing information of the door lock module 360 . For example, in a household with four registered users, if the door lock module 360 is opened twice from the inside and once from the outside, it is determined that two people go out and one person enters the room, and the diagnosis module 156 ) determines that there are three total occupants.

In addition, GPS information of the user terminal is transmitted from the mobile application unit 202 to the diagnosis module 156 . If it is determined that the total number of users whose GPS information is inside the household is three, the diagnosis module 156 determines that the number of occupants is three.

If the number of occupants determined using the door lock module 360 and the number of occupants determined using the mobile application unit 202 are different, the diagnosis module 156 operates the motion recognition unit 142 and the distance detection module 158 ) can be used to identify and determine the number of occupants.

When the number of occupants, that is, the number of occupants is determined, the household terminal 150 receives information sensed by the illuminance and temperature sensor unit 143 and the motion recognition unit 142 .

Specifically, the household terminal 150 receives illumination and temperature information of one or more spaces from the illumination and temperature sensor units 143a to 143e (see FIG. 3). If at least one of the illuminance or color temperature of lighting in the living room among one or more spaces is changed by the user, it may be determined that the user is present in the corresponding room.

In addition, the household terminal 150 receives, from the motion recognition unit 142, whether a user is in one or more spaces and information about the user's activity state. Here, the user's activity state includes whether the user is sleeping, moving, movement direction, and movement speed. In particular, whether or not the user sleeps is preferably determined by a learning module (not shown) provided in the internal cloud platform 120 or the apartment complex server 130.

The diagnostic module 156 may determine occupant information using information received from the motion recognition unit 142 and the illuminance and temperature sensor unit 143 . Hereinafter, referring to FIG. 3 , a method for the diagnosis module 156 to determine occupant information will be described.

The plurality of motion recognition units 142a, 142b, 142c, 142d, and 142e may be respectively disposed in one or more spaces, for example, a bedroom 1, a bedroom 2, a bedroom 3, a kitchen, and a living room.

The motion recognition unit 142a disposed in the bedroom 1 determines that the user A1 is occupied on the bed. At this time, based on the GPS information of the user terminal 200a, it may be determined that the user A3 is in the household. The motion recognition unit 142a recognizes that the user A1 is lying down and monitors the activity state of the user, so that the diagnosis module 156 can determine that the user is 'sleeping'.

In addition, the motion recognition unit 142b disposed in the bedroom 2 determines that the user A2 is occupied on the bed. At this time, based on the GPS information of the user terminal 200b, it may be recognized that the user A2 is in the household. The motion recognition unit 142b may determine that the user A2 is walking, and the diagnosis module 156 may determine the activity state of the user as being 'active'.

In addition, the motion recognition unit 142c disposed in the living room determines that the user A3 is in the living room. At this time, the user A3 moves, and the diagnosis module 156 can control the lighting device 310 by recognizing and predicting the user's movement line. User A3 moves from the living room towards bedroom 3. At this time, the one or more motion recognition units 142c and 142d and the distance detection module 158 that are closest to the user A3 continuously sense the user A3 and transmit the sensed information to the household terminal 150. convey

The household terminal 150 determines that the user A3 crosses the living room by using the received information. When the user goes to the third bedroom, the diagnosis module 156 of the household terminal 150 can turn on a lighting device (not shown) disposed in the third bedroom.

In the present disclosure, the motion recognition unit 142 is described as being built into the ceiling lighting unit, but is not necessarily limited thereto.

Meanwhile, with reference to FIG. 4 , the movement and lighting control of the user A will be described in more detail.

Figure 4 (a) is an exemplary view of the user A's movement and lighting control method, and is a view viewed from above. Figure 4 (b) is an exemplary view of the user A's movement and lighting control method, and is a view viewed from the front.

Referring to FIG. 4 , the distance between the user A and the household terminal 150 is measured by the distance detection module 158 built in the household terminal 150 . At this time, since the distance to the user A is periodically measured by the distance detection module 158, when the distance between the user A and the household terminal 150 increases, the household terminal 150 determines that the user is a household terminal. It is determined that the user A is moving away from (150).

At this time, the activity state of the user A is sensed by one or more motion recognition units 142 .

One or more motion recognition units 142 sense the moving direction of the user A, that is, moving from the left side to the right side in FIG.

The household terminal 150 can accurately determine the user's movement direction based on information sensed by the distance detection module 158 and one or more motion recognition units 142 . At this time, the user's moving direction, moving speed and moving distance can be determined in the diagnosis module 156 . However, the present disclosure is not necessarily limited thereto, and the diagnostic module 156 transmits the collected information to the internal cloud platform 120, and the movement of the user A may be calculated in the internal cloud platform 120, Note that the location where the user A's movement line is actually calculated may be appropriately changed.

The household terminal 150 controls the lighting device 310 in consideration of the user's moving direction, moving speed, and moving distance. Specifically, in FIG. 4(b), the lighting device 310 disposed on the left side is turned off, and the lighting device 310 disposed on the right side is turned on before the user passes under the corresponding lighting device 310.

Meanwhile, it should be noted that the examples with reference to FIGS. 3 and 4 are mere examples, and the specific structure of the household and the current state of user presence and activity status determined by the diagnostic module 156 may vary depending on the case.

5 is a flow chart of a movement detection system including household terminals and a method using the same according to an embodiment of the present disclosure.

Referring to FIG. 5 , the method of the present disclosure includes the following steps.

(a) The diagnostic module 156 determines the total number of occupants by using the open/close information of the smart door lock acquired by the door lock module 360 and the GPS information of the mobile application unit 202 (S500).

Specifically, step (a) may include steps (a1) to (a3).

(a1) Door lock opening/closing information sensed by the door lock module 360 is transmitted to the diagnosis module 156 included in the household terminal 150.

(a2) GPS information generated by the mobile application unit 202 is transmitted to the diagnosis module 156.

(a3) The diagnostic module 156 calculates and processes the total number of occupants using the door lock open/close information and GPS information.

Thereafter, (b) the diagnostic module 156 detects occupant information by using the motion detection information by the motion recognition unit 142 and the illumination and temperature information of each space acquired by the illuminance and temperature sensor 143. Find out (S510).

Specifically, step (b) may include steps (b1) to (b3).

(b1) Whether the user is present and activity state information sensed by the motion recognition unit 142 is transmitted to the diagnosis module 156.

(b2) The illuminance and temperature information of each space sensed by the illuminance and temperature sensor unit 143 is transmitted to the diagnosis module 156.

(b3) The diagnostic module 156 calculates occupant information by using occupancy and activity state information, illuminance and temperature information.

Thereafter, (c) the diagnosis module 156 uses the internal cloud platform 120 to detect the movement of occupants through the information sensed by the distance detection module 158 and the motion recognition unit 142 using a preset method. predict

At this time, the preset method may be any type of user movement prediction program widely used in the field of architecture and IT.

Specifically, step (c) may include steps (c1) to (c2).

(c1) The diagnosis module 156 transmits the occupant information calculated in step (b3) to the internal cloud platform 120.

(c2) The internal cloud platform 120 predicts the movement of occupants using occupant information.

Meanwhile, as described above, it should be noted that the household terminal 150 may have a calculation unit that predicts the movement of occupants and calculates the movement direction, movement speed, and distance of the user.

(d) The diagnostic module 156 controls the lighting device 310 to correspond to the predicted movement of occupants.

Display control method of movement detection system using household terminal

6 is a flow chart of a movement detection system including household terminals and a method using the same according to an embodiment of the present disclosure.

Referring to FIG. 6, a method of determining the user's intention to use the household terminal 150 and controlling the display of the household terminal 150 through this will be described.

Referring to FIG. 6 , the distance between the user and the household terminal 150 is measured by the distance detection module 158 (S600).

Using the information measured by the distance detection module 158, it is determined whether the user is approaching the household terminal 150 (S610). Specifically, if the distance between the user and the household terminal 150 decreases, the diagnosis module 156 determines that the user is approaching the household terminal, and if the distance between the user and the household terminal 150 increases, It is determined that the user is moving away from the household terminal 150 .

At this time, since the movement of the user is continuously sensed by the motion recognition unit 142 in addition to the distance detection module 158, if it is determined that the user simply passes by the household terminal, the user does not approach the household terminal 150. It is judged not

On the other hand, if it is determined that the user moves away from the household terminal 150 or simply passes the household terminal 150, that is, does not approach the household terminal 150, the display of the household terminal 150 is turned off. ) (S611).

If it is determined that the user is approaching the household terminal 150, the diagnosis module 156 compares the distance between the current user and the household terminal 150 and the size of the first distance (S620). Here, the first distance corresponds to a value previously input by the user or the manufacturer of the household terminal 150 .

When it is determined that the distance between the user and the household terminal 150 is greater than the first distance, the display of the household terminal 150 is turned off (S611).

If it is determined that the distance between the user and the household terminal 150 is smaller than the first distance, the diagnostic module 156 compares the distance between the current user and the household terminal 150 with the size of the second distance (S630). . Here, the second distance is a value smaller than the first distance, and similarly corresponds to a value pre-input by the user or the manufacturer of the household terminal 150 . Also, preferably, the second distance may be a value corresponding to an adult's arm length. For this reason, when the user approaches the household terminal 150 closer than the second distance, it can be determined that there is a will to operate the household terminal 150 .

If it is determined that the distance between the user and the household terminal 150 is equal to or greater than the second distance and smaller than the first distance, the household terminal 150 displays the first screen on the display liquid crystal (S631).

At this time, the first screen is sufficient if the user can acquire the information without control. For example, the first screen may include weather, time, and current location information.

If it is determined that the distance between the user and the household terminal 150 is equal to or greater than the second distance and smaller than the first distance, the distance between the user and the household terminal 150 is compared again with the second distance (S640).

If it is determined that the distance between the user and the household terminal 150 is smaller than the second distance, the household terminal 150 displays a second screen on the display liquid crystal (S641).

At this time, the second screen may be a screen for the user to directly manipulate the household terminal 150 . For example, the second screen may be a screen on which a UI including an elevator call, a smart distribution board, and a controller of the individual household device 300 is output.

The above description is merely an example of the technical idea of the present embodiment, and various modifications and variations can be made to those skilled in the art without departing from the essential characteristics of the present embodiment. Therefore, the present embodiments are not intended to limit the technical idea of the present embodiment, but to explain, and the scope of the technical idea of the present embodiment is not limited by these embodiments. The scope of protection of this embodiment should be construed according to the claims below, and all technical ideas within the scope equivalent thereto should be construed as being included in the scope of rights of this embodiment.

120: internal cloud platform
130: apartment complex server
140: generation integration detection control module
150: household terminal
160: common facility control module
201: Individual AI command recognition device
202: mobile application
220: external cloud platform:
300: individual generation device
310: lighting device
320: Ventilation device
330: air conditioner
340: smart device
350: home appliances
360: door lock device

Claims (8)

It is provided inside the household,
a motion recognition unit 142 disposed in one or more spaces constituting a household and configured to sense a user's occupancy and activity state; and
An illuminance and temperature sensor unit 143 disposed in the one or more spaces and configured to sense the illuminance and temperature of each space.
A generation integration detection control module 140 including a;
a household terminal 150 configured to receive the information sensed by the detection control module 140, such as occupancy, activity status, illuminance, and temperature, and generate a control command for controlling one or more devices disposed inside the household;
an individual household device 300 disposed in the one or more spaces to receive a control command transmitted from the household terminal 150;
an apartment complex server 130 electrically connected to the household terminal 150;
An internal cloud platform 120 electrically connected to the apartment complex server 130 and configured to store the information sensed by the household integration detection control module 140
including,
movement detection system.
According to claim 1,
The household terminal 150 includes a distance detection module 158 configured to sense distance information from a user,
The individual household device 300 includes a door lock module 360, and the door lock module 360 senses door lock information including whether or not it is indoors and outdoors and the number of times of opening and closing,
The household terminal 150 includes the information sensed by the motion recognition unit 142 and the illuminance and temperature sensor 143, the distance to the user sensed by the distance detection module 158, and the door lock. A diagnostic module 156 for generating a control command to be transmitted to the individual household device 300 using door lock information sensed by the module 360,
The generation integration detection control module 140 receives the control command from the household terminal 150, generates an IR control signal corresponding to the received control command, and uses it to control the individual household device 300. Including an IR control unit 148 configured to control,
movement detection system.
According to claim 3,
The diagnostic module 156,
Door lock information sensed by the door lock module 360,
Using the GPS information generated by the mobile application unit 202 provided by the user to determine the number of occupants in the current household,
movement detection system.
According to claim 3,
The diagnostic module 156,
occupancy information identified by the diagnosis module 156; and
Using the information sensed by the illuminance and temperature sensor unit 143 and the motion recognition unit 142 disposed in the one or more spaces, occupant information is grasped,
The diagnostic module 156,
The distance information sensed by the distance detection module 158 and
Transmitting the identified occupant information to the internal cloud platform 120,
The internal cloud platform 120 predicts the user's movement by a preset method using this,
movement detection system.
According to claim 4,
The individual household device 300 further includes a lighting device 310,
The internal cloud platform 120 transmits the predicted movement of the user to the diagnosis module 156,
The household terminal 150 controls the lighting device 310 by generating a control command for controlling the lighting device 310 using the user's predicted movement and transmitting the command to the lighting device 310. ,
movement detection system.
A method for predicting a user's movement line using a household terminal (150) and controlling an individual household device (300), the method comprising:
(a1) transmitting the opening/closing information of the door lock sensed by the door lock module 360 to the diagnosis module 156 included in the household terminal 150;
(a2) transmitting the GPS information generated by the mobile application unit 202 to the diagnosis module 156;
(a3) calculating, by the diagnostic module 156, the total number of occupants using the door lock open/close information and the GPS information;
(b1) transmitting the user's presence and activity state information sensed by the motion recognition unit 142 to the diagnosis module 156;
(b2) transmitting the illumination intensity and temperature information of each space sensed by the illumination intensity and temperature sensor unit 143 to the diagnosis module 156;
(b3) calculating, by the diagnosis module 156, occupant information using occupancy and activity state information, illumination intensity and temperature information;
(c1) transmitting, by the diagnosis module 156, the occupant information calculated in step (b3) to the internal cloud platform 120;
(c2) predicting, by the internal cloud platform 120, the occupant's movement using the occupant information; and
(d) controlling the lighting device 310 so that the diagnosis module 156 corresponds to the predicted movement of the occupant,
method.
A method for predicting a user's movement line using a household terminal (150) and controlling an individual household device (300), the method comprising:
(A) measuring the distance between the user and the household terminal 150 by the distance detection module 158 of the household terminal 150;
(B) determining, by the household terminal 150, whether a user moves toward the household terminal 150;
(B1) if it is determined that the user is not approaching the household terminal 150, turning off the display of the household terminal 150;
(C) comparing, by the household terminal 150, a distance between the user and the household terminal 150 with a first distance when it is determined that the user is approaching the household terminal 150;
(C1) turning off the display of the household terminal 150 when it is determined that the distance between the user and the household terminal 150 is greater than the first distance;
(D) if it is determined that the distance between the user and the household terminal 150 is not greater than the first distance, comparing the household terminal 150 with the second distance smaller than the first distance;
(D1) displaying a first screen on the display of the household terminal 150 when it is determined that the distance between the user and the household terminal 150 is equal to or greater than the second distance and less than the first distance; and
(E) displaying the second screen on the display of the household terminal 150 when it is determined that the distance between the user and the household terminal 150 is less than the second distance
including,
method.
According to claim 7,
The first screen is a screen for outputting weather, time, and current location information,
The second screen is a screen for outputting a UI including an elevator call, a smart distribution board, and an individual household device 300 controller,
method.

Images