KR101984940B1 - Smart home system and method for controlling thereof - Google Patents

Abstract

Smart home system for controlling a device in the home through self-learning according to the present invention is a communication module for transmitting and receiving data with the device in the home, a memory for storing the program for controlling the device and a processor for executing the program stored in the memory Including, but as the processor executes the program stored in the memory, and automatically collects a control signal for controlling the device through the communication module, and identify the collected control signal for each event, Extracting a control signal that satisfies a previously stored learning condition from the identified control signals and storing the control signal in the memory, and reading the control signal from the memory to control the device when an event corresponding to the extracted control signal occurs, The communication module is the The first communication module that directly transmits and receives a control signal with one or more first devices capable of directly transmitting and receiving control signals among data spaces, and the space where direct transmission and reception of control signals between the first communication module and the device is impossible. And at least one second communication module disposed in the at least one second device and directly transmitting and receiving a control signal through an IR sensor, and transmitting the control signal to the second device through the first communication module. The learning condition includes one or more of type information, generation time information, and occurrence frequency information of the control signal.

Description

Smart home system and its control method {SMART HOME SYSTEM AND METHOD FOR CONTROLLING THEREOF}

The present invention relates to a smart home system and a control method thereof that can control a device in a home by self-learning or product registration.

Recently, with the development of IT technology and the Internet of Things (IoT) technology, so-called smart homes that provide home networks in homes, offices, and the like have become commonplace.

These smart homes are becoming more and more common to maximize the convenience of use while minimizing the movement and intervention of users for the manipulation of various digital-based devices.

On the other hand, in the early days of the smart home, in general, in order to control devices, most of the cases in which it is necessary to directly control a TV, an air conditioner, a fan, and the like by using a control remote controller.

As a result, remote controllers such as TVs are easy to find because they are always placed on a bed or sofa, while remote controls such as air conditioners and fans are not used every day. Was present.

In order to solve this problem, the smart home system has recently provided a technology that allows a user to control TV, refrigerator, air conditioner and the like through an application pre-installed in a single smartphone.

However, even in such a smart home system, there is a problem that a user must select a device to be controlled directly, and then control items by directly selecting and learning an item for controlling the device.

For example, when the temperature of the air conditioner is lowered, the user may execute a first step of executing an application of a smartphone, a second step of selecting an air conditioner among various devices displayed on the UI of the application, and setting a temperature among various functions of the air conditioner The setting temperature of the air conditioner is lowered only after the third step of selecting the function and the fourth step of pressing the button for lowering the temperature of the temperature setting function.

If the user later wants to control the air conditioner under the same condition again, if the above-described steps 1 to 4 are stored as one, the user can click and control the air conditioner. Or, if there is a limit to the items that can be stored there is a hassle to repeat the above steps to perform.

In this regard, Korean Patent Laid-Open Publication No. 10-2015-0144360 (name of the invention: a smart home system capable of providing a customized service based on an application package, a method of providing a customized service using the same, and a recording medium for performing the method) An application package that enables the home device to be variously customized according to the environment inside the home or various situations of the user by forming a user-oriented network with home devices, which are various home appliances installed in the smart home. Disclosed is a technology for providing a customized service based on.

An embodiment of the present invention is to provide a smart home system and a control method thereof that can control devices in the home by minimizing user intervention through self-learning.

However, the technical problem to be achieved by the present embodiment is not limited to the technical problem as described above, and other technical problems may exist.

As a technical means for achieving the above technical problem, a smart home system for controlling a device in the home through the self-learning according to the first aspect of the present invention is a communication module for transmitting and receiving data with the device in the home, to control the device And a processor configured to execute a program stored in the memory, wherein the processor automatically executes a program stored in the memory, and automatically collects a control signal for controlling the device through the communication module. And classify and identify the collected control signals for each event, extract a control signal satisfying a pre-stored learning condition among the identified control signals, store the control signal in the memory, and generate an event corresponding to the extracted control signal. If the control from the memory It reads out the call and controls the device. In this case, the communication module is a first communication module for directly transmitting and receiving a control signal with at least one first device capable of directly transmitting and receiving a control signal of the device and the control signal between the first communication module and the device in the room space At least one second communication module disposed in a space where direct transmission and reception of a signal is impossible and directly transmitting and receiving a control signal through at least one second device and an IR sensor, and transmitting a control signal to the second device through the first communication module. Wherein the pre-stored learning condition includes one or more of type information, occurrence time information, and occurrence frequency information of the control signal.

The communication module may include one or more of an IR sensor, an RF sensor, a power line communication device, and a magnetic field change detection sensor.

A plurality of communication modules may be provided in the home, and the communication modules may be grouped and arranged by the range in which the control signals of the device can be collected.

When the communication module includes at least one of the IR sensor and the RF sensor, the processor detects and collects IR or RF based control signals simultaneously for the user to control the device with a control remote controller through the communication module. Can be.

When the communication module includes at least one of the power line communication device and the magnetic field change detection sensor, the processor may transmit a control signal through on / off of a switch of a device which is not controlled by a control remote controller among the devices, the power line communication device. Through the sensing of the instantaneous power change of the power line, or through the magnetic field change detection sensor can be detected by collecting the instantaneous change of the magnetic field when the switch on / off.

When the number of times that the control signal of the device is collected or the number of times that the control signal that satisfies the learning condition is extracted is one or more times, the processor provides the control instruction set information of the device corresponding to the collected or extracted control signal to the device. Received from the managing server can be stored in the memory.

The processor acquires control pattern information of the device of a plurality of in-home users through the communication module, provides recommended event information to the user based on the control pattern information, and receives the recommended event information from the user. When receiving input information to be used, the device may be controlled by reading a control signal corresponding to recommended event information based on the control command set information.

When there are a plurality of events for the device, the processor may combine the plurality of events to generate scenario control information, and control the device based on the generated scenario control information.

When there are a plurality of devices, the processor may generate scenario control information by combining a plurality of events for each of the plurality of devices, and control the plurality of devices based on the generated scenario control information.

The processor acquires weather information from a meteorological office server through the communication module, provides a notification message to a user based on the weather information, or matches an event corresponding to weather information corresponding to a preset time range and a control signal corresponding thereto. May be read from the memory to provide a notification message to the user to control the device for the preset time range.

The communication module includes a wireless communication module for transmitting and receiving data with a mobile communication terminal, and the processor is configured to control a control signal for manually controlling the device through an application pre-installed in the mobile communication terminal through the communication module. When the event occurs or when the event occurs, it may be transmitted as a notification message that control of the device is performed or performed according to the control signal.

The processor may include IP path information including general IP path information to the content providing server and bypass IP path information, and the content may be obtained through the general IP path information based on the bypass IP path information included in the IP path information. Receiving content from the domestic and overseas content providing server that can not be received can be output directly or output through the device.

In addition, an embodiment of the present invention may be implemented as a vehicle control module for autonomous driving including the above-described smart home system, and configured to include a battery for charging and storing power and a vehicle charging module.

In addition, a method of controlling a device in a premises through a smart home system according to a second aspect of the present invention includes: collecting a control signal for controlling the device; Identifying and separating the collected control signals for each event; Extracting and storing a control signal satisfying a pre-stored learning condition including one or more of type information, occurrence time information, and occurrence frequency information of a control signal among the identified control signals; And when the event corresponding to the extracted control signal occurs, reading the stored control signal and controlling the device based on the read control signal, wherein the communication module is configured to control the control signal of the device. One or more first communication modules for directly transmitting and receiving control signals to and from one or more first devices capable of directly transmitting and receiving and one or more spaces disposed in a space where direct transmission and reception of control signals between the first communication module and the device are not possible. And at least one second communication module for directly transmitting and receiving a control signal through a second device and an IR sensor, and transmitting the control signal to the second device through the first communication module.

According to any one of the above problem solving means of the present invention, self-learning, manual learning, image recognition of the existing home appliances or through the list of existing home appliances stored in the server can control the devices in the house by themselves, the user Minimize intervention.

In addition, even if a user has not directly controlled the device or is not familiar with the function of the device, the device may be automatically controlled by providing recommended event information.

In addition, since the device can be controlled based on the scenario control information, the user has an advantage of the integrated management of the control of the individual or a plurality of devices.

1 is a diagram schematically illustrating a smart home system according to an embodiment of the present invention.
2 is a block diagram of a smart home system according to an embodiment of the present invention.
3A and 3B are exemplary views illustrating an implementation of a smart home system according to an embodiment of the present invention.
4 is a flowchart of a device control method according to an embodiment of the present invention.

DETAILED DESCRIPTION Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art may easily implement the present invention. As those skilled in the art would realize, the described embodiments may be modified in various different ways, all without departing from the spirit or scope of the present invention. In the drawings, parts irrelevant to the description are omitted in order to clearly describe the present invention.

When a part of the specification is to "include" any component, which means that it may further include other components, except to exclude other components unless otherwise stated.

Hereinafter, a smart home system 100 and a control method thereof according to an embodiment of the present invention will be described with reference to the accompanying drawings.

1 is a view for schematically illustrating a smart home system 100 according to an embodiment of the present invention.

At this time, each component shown in FIG. 1 may be connected through a network. The network refers to a connection structure capable of exchanging information between respective nodes such as terminals and servers. Examples of such a network include a 3rd generation partnership project (3GPP) network and a long term evolution (LTE) network. , World Interoperability for Microwave Access (WIMAX) network, Internet, Local Area Network (LAN), Wireless Local Area Network (WLAN), Wide Area Network (WAN), Personal Area Network (PAN), Bluetooth (Bluetooth) Networks, satellite broadcasting networks, analog broadcasting networks, DMB (Digital Multimedia Broadcasting) networks, WiFi, etc. include but are not limited to these.

As shown in FIG. 1, the smart home system 100 according to an embodiment of the present invention controls devices 200 disposed in a home such as an air conditioner, a light switch, a TV, a door lock, an electric curtain, and the like. In this case, the smart home system 100 may control the devices 200 in the home by minimizing the user's intervention through self-learning. On the other hand, the smart home system 100, as well as self-learning, manual learning that the user directly inputs a control signal is also possible.

The devices 200 disposed in the home are connected to a wired / wireless network to transmit and receive data, as well as devices 200 controlled by IR signals such as TVs and air conditioners, touch switches, and digital doors. The device 200 includes a device 200 controlled by receiving an RF signal such as a lock and a device 200 controlled through on / off of a switch.

On the other hand, the smart home system 100 may be implemented in the form of a mobile communication terminal 300, when implemented as a separate device separate from the mobile communication terminal 300 through the mobile communication terminal 300 and a wired or wireless network Data may be transmitted and received, and thus the user may check and control the smart home system 100 using the mobile communication terminal 300.

At this time, the mobile communication terminal 300 is a wireless communication device that guarantees portability and mobility, that is, a PCS (Personal Communication System), GSM (Global System for Mobile communications), PDC (Personal Digital Cellular), PHS (Personal Handyphone System), All types of personal digital assistants (PDAs), International Mobile Telecommunication (IMT) -2000, Code Division Multiple Access (CDMA) -2000, W-Code Division Multiple Access (W-CDMA), Wireless Broadband Internet (WBRO) terminals, etc. It may include a handheld based wireless communication device.

In particular, the mobile communication terminal 300 is an intelligent terminal that adds computer support functions such as Internet communication and information retrieval to a portable terminal, and is a mobile phone or smart phone that can install and execute a plurality of applications (ie, applications) desired by a user. A smart phone, a pad, a smart watch, a wearable terminal, another mobile communication terminal 300, and the like.

In addition, not only the mobile communication terminal 300 but also the smart home system 100 may transmit and receive data in cooperation with smart devices in the home, such as a smart TV and a wall pad.

Hereinafter, the smart home system 100 according to an embodiment of the present invention will be described in more detail with reference to FIG. 2.

2 is a block diagram of a smart home system 100 according to an embodiment of the present invention.

Specifically, as shown in FIG. 2, the smart home system 100 according to an embodiment of the present invention includes a communication module 110, a memory 120, and a processor 130.

The communication module 110 transmits and receives data with the devices 200 in the home. The communication module 110 may include one or more of an IR sensor, an RF sensor, a power line communication device, and a magnetic field change detection sensor.

In addition, the communication module 110 may include both a wired communication module and a wireless communication module. The wired communication module may be implemented as a telephone line communication device, a cable home (MoCA), an Ethernet, an IEEE 1294, an integrated wired home network, and an RS-485 control device. In addition, the wireless communication module may be implemented with a wireless LAN (WLAN), Bluetooth, HDR WPAN, UWB, ZigBee, Impulse Radio, 60GHz WPAN, Binary-CDMA, wireless USB technology, and wireless HDMI technology.

The memory 120 stores a program for controlling the devices 200 in the home. Here, the memory 120 collectively refers to a nonvolatile storage device and a volatile storage device that maintain stored information even when power is not supplied.

For example, the memory 120 may include a compact flash (CF) card, a secure digital (SD) card, a memory stick, a solid-state drive (SSD), and a micro SD. Magnetic computer storage devices such as NAND flash memory such as cards, hard disk drives (HDDs), and optical disc drives such as CD-ROMs, DVD-ROMs, and the like. Can be.

The processor 130 executes a program stored in the memory 120. In more detail, the processor 130 automatically collects control signals for controlling the device 200 through the communication module 110, and identifies the collected control signals by events.

For example, when the user controls the TV through a button input for turning on the TV through a control remote controller based on an IR signal, a numeric button input for selecting a specific channel of the TV, the processor 130 may communicate with the communication module 110. Automatically collects control signals to control the TV.

When the collected control signals are collected, how many times, and what type of control signals are classified for each event, the control signals are identified by matching the product ID of the device 200 corresponding to the control signal. .

For example, a control signal for turning on the TV at 10 AM, a control signal for selecting channel 9 within 1 minute from the ON state, a control signal for turning the OFF state at 12 o'clock, and 21 o'clock for the TV. Assume that a control signal, etc., has been collected to turn on again. In this case, the processor 130 collects a total of two control signals for the on state at 10 o'clock and 21 o'clock, and a total of one control signal for selecting channel 9 between 10 o'clock and 10: 1. Can be identified based on the type information, time information, and frequency information.

Next, the processor 130 extracts a control signal satisfying a pre-stored learning condition among the identified control signals, stores the control signal in the memory 120, and, when an event corresponding to the extracted control signal occurs, the control signal from the memory 120. Read to control the device 200.

In this case, the prestored learning condition may include one or more of type information, generation time information, and occurrence frequency information of the control signal.

For example, when extracting a control signal that occurs repeatedly at the same time every day as a learning condition stored in advance for the TV, the processor 130 may select 10 pm every day from the plurality of identified control signals stored in the memory 120. The control signal for turning on the TV at the time, the control signal for switching to the channel 9, and the control signal for turning off the TV at 11 pm can be extracted based on the learning condition.

After 10 pm as an event corresponding to the extracted control signal, the TV is turned on and switched to channel 9, and when the next event is 11 pm, a control signal for turning off the TV is read out from the memory 120 to control the TV. have.

According to one embodiment of the present invention, unlike the prior art in which a user simply collects and stores a control signal for controlling the device 200 through a remote controller or the like and repeatedly drives the control signal, the control signal is automatically collected. And by extracting a control signal that satisfies a certain learning condition among them to control the device 200 by itself, while minimizing the user's intervention, and more actively than the prior art user habits, intentions, tendencies, etc. By reflecting, the device 200 may be controlled.

Meanwhile, in one embodiment of the present invention, the communication module 110 may include first and second communication modules 110-1 and 110-2.

The first communication module 110-1 directly transmits and receives a control signal with one or more first devices 200-1 capable of directly transmitting and receiving control signals among the devices 200.

The second communication module 110-2 is disposed in a space where direct transmission and reception of a control signal is not possible among the devices 200. The second communication module 110-2 directly transmits and receives a control signal through one or more second devices 200-2 and an IR sensor, and establishes a wireless network such as Bluetooth or Wi-Fi with the first communication module 110-1. The control signal may be received by the second device 200-2, and the collected control signal may be transmitted.

In this case, a plurality of second communication modules 110-2 may be provided in the home, and thus, the second communication module 110-2 may be grouped with the second devices 200-2 by the range in which the control signals of the second device 200-2 can be collected. Can be arranged.

For example, there may be a case where the air conditioner and the TV based on the IR signal are located in different zones, so that collection of each IR signal is impossible through one first communication module 110-1. 2 The communication module 110-2 may be grouped and disposed within a range capable of collecting control signals for the air conditioner and the TV, respectively.

Accordingly, one embodiment of the present invention is the second communication even in the case of the second device (200-2) that must be disposed only in a specific position, or the second device (200-2) that the control signal is transmitted and received only in a specific direction The modules 110-2 are grouped and arranged to collect control signals.

In this case, when the smart home system 100 is implemented in a form in which the communication module 110 is accommodated by the external housing as shown in FIG. 3A to be described later, a plurality of final components implemented as the external housing may be provided in the home. have.

In addition, when a dongle type that is integrally formed with or coupled to the mobile communication terminal 300 is implemented as shown in FIG. 3b, a plurality of gateway type communication modules 110 are separately grouped and arranged in the home to collect control signals. It may be transmitted to the mobile communication terminal 300.

Meanwhile, when the communication module 110 includes an IR sensor and an RF sensor, a control signal for controlling the device 200 may be transmitted and received through the IR sensor and the RF sensor.

In this case, when receiving a control signal, when the user outputs an IR or RF based control signal for controlling the device 200 through a button of the control remote control, the control signal output by the control remote control device 200 Is transmitted to the control unit 200, and at the same time the communication module 110 receives and collects the control signal output by the control remote control.

In the case of transmitting a control signal, when a control signal satisfying a learning condition is extracted from the control signals received and collected as described above, when a corresponding event occurs, the control signal stored in the memory 120 is read and transmitted. The device 200 is controlled according to the transmitted control signal.

In addition, when the communication module 110 includes a power line communication device, the processor 130 may turn on or off the switch of the device 200 which is not controlled by the IR or RF-based control remote control. The control signal can be collected by sensing the instantaneous power change amount of the power line through the power line communication device.

For example, when the device 200 is an on / off switch of a lamp installed on a wall, the processor 130 detects an instantaneous power change amount when the switch is turned on / off through the communication module 110 and switches it on. Can be collected by the control signal corresponding to / off.

Then, the type information (on / off), the occurrence time information, and the occurrence frequency information among the control signals for controlling the light are extracted and stored in the memory 120 based on the learning condition. Can read and control the light.

In addition, when the communication module 110 includes a magnetic field change detection sensor, the processor 130, like the power line communication device, the on / off of the switch of the device 200 that is not controlled by the IR or RF-based control remote control Control signals can be collected by detecting the instantaneous amount of change in the magnetic field.

For example, when a switching operation for turning on a light is generated, the communication module 110 may detect and collect a corresponding control signal by detecting a change such as an instantaneous count of the intensity of the surrounding magnetic field of the switch.

In this case, when the control signal is collected through the power line communication device or the magnetic field change detection sensor, the device 200 may be controlled through power line communication or a method of allowing the switch to be toggled through a wireless network or an actuator.

Meanwhile, when the number of times the control signal of the device 200 is collected or the number of times the control signal that satisfies the learning condition is extracted is one or more times, the processor 130 controls the control command of the device 200 corresponding to the collected or extracted control signal. The set information may be received from a server managing the device 200 and stored in the memory 120.

The processor 130 obtains device 200 control pattern information of a plurality of users who reside in a plurality of homes from the smart home server through the communication module 110, and recommends event information to the user based on the obtained control pattern information. Can provide.

Accordingly, when receiving input information of using recommended event information from the user, the processor 130 may control the device 200 by reading a control signal corresponding to the recommended event information based on the control command set information. .

For example, when the device 200 is a TV, when a control signal for turning on the TV through the control remote controller is collected one or more times, the processor 130 manages the manufacturer or management of the TV corresponding to the collected control signal. It is possible to obtain a control command set of the TV by connecting to a server for the. The control command set refers to a command set for all control of the device 200, such as on / off of TV power supply, volume control, and automatic screen adjustment.

In this way, when the control command set is acquired, the processor 130 may obtain control pattern information of the TVs of the users in other homes through the communication module 110, and further obtain the TV to the user based on the control pattern information. It can provide recommended event information to make it well available.

That is, the control pattern information using the alarm function included in the TV at 7 am from the user's home, collect the control pattern information to turn on the TV at 10 pm and then off at 11 pm, and collected various control patterns As the information is analyzed in consideration of the user's preference, usage pattern, and the like, it may be generated as recommended event information that the alarm function of the TV can be activated and provided to the user.

When the user provided with the recommended event information selects the desired event information, the processor 130 may control the control command even if the user has never collected a control signal for selecting and controlling the alarm function of the TV through the control remote controller. The alarm function of the TV may be controlled by reading a control signal corresponding to the recommended event information based on the set information.

Accordingly, in one embodiment of the present invention, even when the user has not directly controlled the device 200 or the user does not know all about the various functions of the device 200, the control pattern information of the users in other homes By providing the recommended event information based on the advantage that the user can use the good features that the device 200 has.

Meanwhile, the smart home system 100 according to an embodiment of the present invention may control the device 200 based on scenario control information through acquiring a life log of a user and analyzing big data, together with recommendation event information. . In this case, the scenario control information to be described later may be generated considering each or all of the above-mentioned recommended event information as well as the event information in the home.

In detail, the processor 130 generates a combination of a plurality of events as scenario control information when the control signal satisfying the learning condition and a plurality of events corresponding to the device 200 are generated, and is generated in the generated scenario control information. The device 200 may be controlled based on this.

For example, as scenario control information for controlling a TV, an event and control signal for turning on the TV at 10 pm, an event and control signal for switching to channel 9, which is a drama channel, and remain on for 1 hour. When 30 minutes have elapsed since the event, the TV is turned on, an event and control signal for lowering the volume by 2 levels and an event and control signal for turning off the TV after 1 hour can be generated as scenario control information. .

In addition, according to an embodiment of the present invention, scenario control information may be generated for a single device 200 as described above, and scenario control information may be combined by combining single or multiple events for each of the plurality of devices 200. The plurality of devices 200 may be controlled based on the generated scenario control information.

For example, with respect to the scenario control information for controlling the TV described above, an event and a control signal for controlling the lamp are further included, so that the amount of light of the lamp is reduced by 10% after the TV is turned on at 10 pm. Event and control signal, when the TV is turned off after 1 hour, the lights are also turned off, including the event and control signal for turning on the sleep light may be generated as scenario control information.

As such, in one embodiment of the present invention, the user may check, modify, delete, and execute an event and a control signal for each device 200 provided by the processor 130, but such an event and a control signal may be used. If there are too many, there is an advantage that the modification, deletion, and execution of whether the device 200 or the integrated control of the plurality of devices 200 are possible through the scenario control information, respectively.

In addition, an embodiment of the present invention continuously collects the user's event information and control signals corresponding thereto, and when the data of the threshold value or more is accumulated, the user's convenience by analyzing the user's usage pattern more accurately through a big data analysis technique. Can be maximized.

Meanwhile, the smart home system 100 according to an embodiment of the present invention obtains weather information or traffic information from a server of a public office such as a server of a meteorological office or a server of a traffic management corporation, and informs a user of information matching the corresponding information. Can be provided through

For example, the processor 130 obtains weather information from the Meteorological Agency server through the communication module 110, and based on the obtained weather information, there is currently no rain at 10 am but there is a 70% chance of raining after 1 hour. You can give them a reminder to take your umbrella and go out.

In addition, the processor 130 reads an event corresponding to weather information corresponding to a preset time range and a control signal corresponding thereto from the memory 120 to control the device 200 for a preset time range. Can be provided as a notification message.

In other words, a dehumidifier is operated from 11 am to 12 pm with a notification message indicating that it will be cloudy at 10 am or it will rain from 11 pm to 3 pm, and additional drying after washing the washing machine scheduled at 1 pm Event and control signals for activating the function can be read out and provided as a notification message to the user.

As another example, when a control signal for manually controlling the electric curtain is collected at 11 pm every night, the processor 130 stores the control signal in the memory 120 and reads it by matching the event information with the event information. Although the curtain can be controlled, when the weather information is taken into consideration, when the weather information includes special event information such as the full moon shines brightest at 11 pm or the meteor shower is predicted, the electric curtain control is performed at 12:00. Can be provided as a notification to the user.

As described above, the exemplary embodiment of the present invention may acquire the surrounding situation information such as weather information or traffic information and control the device 200 based on the situation information, which is different from simply executing the event information that has occurred previously.

That is, in the above-described example, even if the rain event and the control signal corresponding to the rain event from 11 pm to 3 pm has never been collected, when the rain is rained from 1 pm to 2 pm When the control signal has been collected, the processor 130 may control the devices 200 by matching the control signal to a new event as a result of self-learning using the previously learned event and the control signal.

In this case, since the user has not previously collected a control signal for directly controlling the device 200, the user provides a separate notification message to the user, and the user may use the UI or mobile communication of the smart home system 100. When interworking with the terminal 300, it may be determined whether to execute through the UI control of the application.

On the other hand, an embodiment of the present invention may include a wireless communication module for the communication module 110 to transmit and receive data with the mobile communication terminal (300).

In addition, the processor 130 may receive a control signal for manually controlling the device 200 in the home through an application pre-installed in the mobile communication terminal 300 through the communication module 110. When an event occurs, a control message of the device 200 may be performed or transmitted as a notification message according to a control signal.

Accordingly, the user may directly determine whether to execute the notification message to directly control each individual function of the device 200 or output a control signal corresponding to the event through the UI of the mobile communication terminal 300. The wireless communication module based on LTE, 5G, and the like can control the device 200 in the home as well as outside.

In addition, the user may also be provided with the above-mentioned recommendation event information, scenario control information through the mobile communication terminal 300, and whether or not to execute them can be directly determined through the mobile communication terminal (300).

In addition, when the smart home system 100 according to an embodiment of the present invention receives an image / video captured by a camera or a general camera of the mobile communication terminal 300, the smart home system 100 is included in the image / video through an image recognition technique. The recognized device 200 may be recognized, and the control command set information may be obtained from a server managing the device 200 based on the recognition result to generate a control signal.

For example, when a newly purchased TV (or a remote control for controlling the TV) is photographed through a camera, and the captured image / video is received by the smart home system 100 through the communication module 110, the smart home system ( 100 may recognize that there is a TV through an image recognition technique, connect to a server for a manufacturer or management of the TV, acquire a control command set of the TV, and generate a control signal. As described above, the acquisition of the control signal may be acquired by various methods such as when an event occurs, when a recommended event occurs, and when generating scenario control information.

At this time, in an embodiment of the present invention, when there are a plurality of devices included in the captured image / video, each of the plurality of devices is recognized as a separate device 200, and a control signal for each of them is obtained and stored in the memory 120. Can be.

In addition, according to an embodiment of the present invention, when the device 200 is recognized through a camera, individual control signals, event information, recommended event information, scenario information, etc. for the recognized device 200 are output to control individual devices. May be enabled.

As such, the embodiment of the present invention not only recognizes the corresponding device 200 when a control signal occurs, but also automatically recognizes the corresponding device 200 by analyzing an image / video and controls the recognized device. Automatically collect signals or generate recommended event information. Alternatively, a list of in-house devices 200 or a list of commercially available, on-going, or discontinued devices 200 and corresponding control instruction sets may be stored in memory 120 of the smart home system 100. It may be stored in advance, it is stored in advance in a separate management server to work with the smart home system 100 can be obtained through the communication module 110 is a matter of course.

In addition, when the smart home system 100 according to an embodiment of the present invention receives an image / video captured by a camera or a general camera of the mobile communication terminal 300, the smart home system 100 is included in the image / video through an image recognition technique. The recognized object may be recognized, and a control signal for the devices 200 in the home may be generated based on the recognition result.

For example, when a user photographs a plant such as a flower or a tree through a camera and transmits it to the smart home system 200, the smart home system 200 uses the image recognition technique to display the plant included in the image / video. In addition, the information about the plant may be searched and stored on the Internet through a search engine. Accordingly, the smart home system 200 to automatically control the watering, sunlight control, ventilation control according to the retrieved information, the control signal for controlling devices such as sprinklers, windows, LED lights, event information, Recommended event information and scenario information can be generated.

That is, if there is a plant that grows well once watered once a month and ventilated with sunlight for 2 hours a day, it generates event information according to the watering cycle to control devices such as sprinklers. You can generate control signals, adjust the lighting time of LED lamps, the amount of light, etc., or generate event information such as automatically opening or closing a window. You can generate them as scenario information or receive them as recommended event information. have.

In the above-described example, the device 200 or the plant in the home has been described as an example, but the management of animals (water / feed or temperature, humidity control, etc.), the management of furniture (humidity of the house, temperature control, etc.), household goods Management (bowl washing, etc.) can be controlled through control signals, event information, recommended event information, scenario information according to the method described above.

On the other hand, the smart home system 100 according to an embodiment of the present invention may be controlled to receive the content from the content providing server 400 and output it directly or through the device 200 in the home.

In this case, the content may be, for example, content including one or more of video, audio, and text, and may correspond to radio, broadcast, document, and the like.

When the smart home system 100 directly outputs the content, the smart home system 100 may output the content received from the content providing server 400 through the output unit 140 including a display unit or a voice output unit to be described later.

In addition, when the content is output through the device 200 in the home, the content may be directly provided to the device 200 capable of outputting the content through a wireless communication module such as Bluetooth, Wi-Fi, or the like. The content may be provided to the device 200 via 300. Alternatively, content may be directly provided to the mobile communication terminal 300 to be output on the mobile communication terminal 300.

To this end, the processor 130 may include IP path information up to the content providing server 400, and may receive content such as broadcast or radio through the corresponding IP path information.

At this time, the IP route information is not only a general IP route address which is allowed to access content in Korea and abroad, but also a route address that is blocked when access to a specific region is blocked in Korea or abroad. Includes bypass IP route information that can be accessed by bypass.

Accordingly, an embodiment of the present invention may receive the content directly from the domestic and overseas content providing server 400, which cannot receive the content through general IP path information, or directly output the content or output the same through the device 400.

For example, a radio broadcast of a specific overseas region cannot be accessed and provided through general IP path information, but the processor 130 receives and outputs radio broadcast content that cannot be accessed and provided through bypass IP path information. Through one embodiment of the present invention, it is possible to easily receive broadcast content from all over the world.

Meanwhile, general IP path information or bypass IP path information may be initially stored in the memory 120 of the smart home system 100. The acquisition of the IP path information may be performed when an event occurs or a recommended event occurs as described above. Of course, it can be obtained by various methods, such as when generating scenario control information.

Hereinafter, an exemplary embodiment of the smart home system 100 according to an embodiment of the present invention will be described with reference to FIGS. 3A to 3B.

3A to 3B are exemplary views of implementation of the smart home system 100 according to an embodiment of the present invention.

First, referring to FIG. 3A, the smart home system 100 according to an embodiment of the present invention may be implemented in a form in which the communication module 110, the memory 120, and the processor 130 are accommodated by an external housing. . In this case, the smart home system 100 may be arranged in a stand shape on the floor, a table in the home, or installed on a wall.

In this case, the smart home system 100 may provide a notification message for notifying the user of events, recommended event information, control signals, and scenario control information through an application of the mobile communication terminal 300, or the display unit provided in the device itself. And a notification message through an output unit 140 such as a voice output unit.

Alternatively, the smart home system 100 may include a battery and a charging module, and may be formed to include the above-described communication module 110, the memory 120, the processor 130, and the like in a charger-type external housing. .

In addition, as shown in FIG. 3B, one embodiment of the present invention may be formed as a dongle type that can be combined with the mobile communication terminal 300. In this case, the dongle type smart home system 100 may be combined with the mobile communication terminal 300 by being formed as a USB type as shown in FIG. 3B, or may be integrated into the mobile communication terminal 300 in a module chip form. have.

In addition, when an embodiment of the present invention is formed in a dongle type as shown in Figure 3b, the smart home system 100 is coupled to a central control terminal such as a PC, tablet PC, smart phone, smart TV, etc. placed in the home It can be implemented as. In this case, the smart home system 100 may transmit and receive data with the mobile communication terminal 300 through an application installed in a separate mobile communication terminal 300.

In addition, an embodiment of the present invention includes the battery and the charging module described above, the charging module may be a vehicle charging module.

Accordingly, an embodiment of the present invention is coupled to the vehicle through a cigar jack or a USB terminal for example, and can be charged, when the power is supplied through the cigar jack or USB terminal and the ECU of the vehicle through the communication module 110 Data can be transmitted and received to collect and transmit control signals for controlling various functions (window on / off, headlight, excel, brake, etc.) in the vehicle.

When the embodiment of the present invention is applied to a general vehicle, the processor 130 obtains a control signal for controlling various functions of the vehicle and controls each occurrence of the event. The control signal is obtained as described above. As such, when an event occurs, when a recommendation event occurs, and when generating scenario control information, the present invention can be obtained by various methods. Accordingly, an embodiment of the present invention has an advantage of being able to operate as a smart car for autonomous driving.

And the user can check the control signal, event information, scenario information, etc. for controlling the device 200 in the home through the application of the mobile communication terminal 300, and can directly control the device 200 from the outside as well as the home Can be.

In this case, the smart home system 200 coupled to the mobile communication terminal 300 and the central control terminal preferably transmits and receives data to each other via Wi-Fi, but is not necessarily limited thereto. Of course, it can also transmit and receive.

In this embodiment, there is an advantage that the production cost can be reduced as much as possible compared to the form accommodated in the outer housing described above. In addition, when the smart home system 100 implemented in a dongle form is combined with the mobile communication terminal 300, power consumption may be faster because the mobile communication terminal 300 needs to directly transmit and receive an RF signal and an IR signal. When combined with the central control terminal has the advantage that the power consumption of the mobile communication terminal 300 can be minimized. In addition, the smart home system 100 according to the present invention through the user interface through the voice recognition device 200 In addition to the manual control of), the control according to the above-described recommended event information and the control according to the scenario may be executed.

For example, if the smart home system 100 recognizes an IPTV and automatically or manually collects a control command set or a list of hundreds of channels in the case of an IPTV, the user may receive a list of channels collected through voice recognition. Control, volume control, scenario information control, and the like can be performed. In this case, the smart home system 100 may update the channel list by reflecting the changed channel information in the channel list of the IPTV.

At this time, an embodiment of the present invention is a 'Personal Voice AI' provided by 'Bixby' of 'Samsung', 'Google' of 'Google' or 'Amazon Eco', 'Google Assistant' or 'Amazon Alexa', etc. It can be interlocked. That is, the smart home system 100 according to an embodiment of the present invention is configured to include a voice artificial intelligence device in itself, or provides a corresponding function through an application for voice artificial intelligence function of the mobile communication terminal 300. I can receive it.

Accordingly, an embodiment of the present invention controls the device 200 together with voice recognition and guidance through the voice artificial intelligence apparatus when the above-mentioned event, recommendation event occurs, and scenario information is generated, as well as the basic situation awareness guide described above. You may.

For reference, the components shown in FIG. 2 according to an embodiment of the present invention may be implemented in software or hardware form such as a field programmable gate array (FPGA) or an application specific integrated circuit (ASIC), and perform predetermined roles. can do.

However, 'components' are not meant to be limited to software or hardware, and each component may be configured to be in an addressable storage medium or may be configured to reproduce one or more processors.

Thus, as an example, a component may include components such as software components, object-oriented software components, class components, and task components, and processes, functions, properties, procedures, and subs. Routines, segments of program code, drivers, firmware, microcode, circuits, data, databases, data structures, tables, arrays, and variables.

Components and the functionality provided within those components may be combined into a smaller number of components or further separated into additional components.

Hereinafter, a device control method in the smart home system 100 according to an embodiment of the present invention will be described with reference to FIG. 4.

4 is a flowchart of a device control method according to an embodiment of the present invention.

In a device control method according to an embodiment of the present invention, first, a control signal for controlling a device 200 in a home is collected (S410), and the collected control signal is classified and identified for each event (S420).

Next, a control signal that satisfies a pre-stored learning condition including one or more of control signal type information, occurrence time information, and occurrence frequency information among the identified control signals is extracted and stored (S430).

Next, when an event corresponding to the extracted control signal occurs, the stored control signal is read (S440), and the device 200 is controlled based on the read control signal (S450).

In the above description, steps S410 to S450 may be further divided into additional steps or combined into fewer steps, according to an embodiment of the invention. In addition, some steps may be omitted as necessary, and the order between the steps may be changed. In addition, even if omitted, contents already described with respect to the smart home system 100 in FIGS. 1 to 3B are also applied to the device control method of FIG. 4.

One embodiment of the present invention may also be embodied in the form of a computer program stored in a medium executed by a computer or a recording medium including instructions executable by the computer. Computer readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media. In addition, computer readable media may include both computer storage media and communication media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Communication media typically includes computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave, or other transmission mechanism, and includes any information delivery media.

Although the methods and systems of the present invention have been described in connection with specific embodiments, some or all of their components or operations may be implemented using a computer system having a general purpose hardware architecture.

The foregoing description of the present invention is intended for illustration, and it will be understood by those skilled in the art that the present invention may be easily modified in other specific forms without changing the technical spirit or essential features of the present invention. will be. Therefore, it should be understood that the embodiments described above are exemplary in all respects and not restrictive. For example, each component described as a single type may be implemented in a distributed manner, and similarly, components described as distributed may be implemented in a combined form.

The scope of the present invention is shown by the following claims rather than the above description, and all changes or modifications derived from the meaning and scope of the claims and their equivalents should be construed as being included in the scope of the present invention. do.

100: smart home system
110: communication module
110-1: First communication module
110-2: second communication module
120: memory
130: processor
140: output unit
200: device
200-1: first device
200-2: second device
300: mobile communication terminal
400: content delivery server

Claims (14)

In the smart home system to control the device in the home through self-learning,
Communication module for transmitting and receiving data with the device in the room, including IR sensor, RF sensor, power line communication device and magnetic field change detection sensor,
A memory in which a program for controlling the device is stored;
Including a processor for executing a program stored in the memory,
As the processor executes a program stored in the memory, the processor automatically collects a control signal for controlling the device through the communication module, classifies the collected control signal for each event, and identifies the identified control. Extracting a control signal satisfying a pre-stored learning condition from the signal and storing it in the memory, and when the event corresponding to the extracted control signal occurs, the control signal is read from the memory to control the device,
The communication module is a first communication module for directly transmitting and receiving a control signal with at least one first device capable of directly transmitting and receiving a control signal among the devices, and a direct communication of a control signal between the first communication module and the device in a space of the home At least one second communication module is disposed in a space where transmission and reception is impossible and directly transmits and receives a control signal through at least one second device and an IR sensor, and transmits a control signal to the second device through the first communication module. ,
The prestored learning condition includes one or more of type information, occurrence time information, and occurrence frequency information of the control signal,
The processor detects and collects an IR signal based control signal and an RF based control signal simultaneously for a user to control the device with a control remote controller through the communication module,
The processor detects an instantaneous power change amount of the power line when the switch is turned on / off through the power line communication device through a control signal of a switch of a device which is not controlled by the control remote controller among the devices, Collect as a control signal corresponding to the on / off of the switch, and detects the instantaneous change in the magnetic field when the switch on / off through the magnetic field change detection sensor and collects it as a control signal corresponding to the on / off of the switch And extracting occurrence time information and occurrence frequency information of the collected control signal based on a learning condition and storing the generated information in the memory. delete The method of claim 1,
The second communication module is provided with a plurality in the premises, smart home system that is arranged grouped with the second device for each of the range capable of collecting the control signal of the second device. delete delete The method of claim 1,
When the number of times that the control signal of the device is collected or the number of times that the control signal that satisfies the learning condition is extracted is one or more times, the processor provides the control instruction set information of the device corresponding to the collected or extracted control signal to the device. Smart home system to receive from the server to manage and store in the memory. The method of claim 6,
The processor acquires the control pattern information of the device of the users living in a plurality of homes through the communication module, and provides the recommended event information to the user based on the control pattern information,
And receiving the input information of using the recommendation event information from the user, and controlling the device by reading a control signal corresponding to the recommendation event information based on the control instruction set information. The method of claim 1,
And the processor generates the scenario control information by combining the plurality of events when there are a plurality of events for the device, and controls the device based on the generated scenario control information. The method of claim 8,
When the plurality of devices is present, the processor generates a scenario control information by combining a plurality of events for each of the plurality of devices, and controls the plurality of devices based on the generated scenario control information. system. The method of claim 1,
The processor obtains weather information from the meteorological office server through the communication module, and provides a notification message to the user based on the weather information,
The smart home system to read the event corresponding to the weather information corresponding to a predetermined time range and a control signal corresponding thereto from the memory to provide a notification message to the user to control the device during the predetermined time range. The method of claim 1,
The communication module includes a wireless communication module for transmitting and receiving data with the mobile communication terminal,
The processor receives a control signal for manually controlling the device through an application pre-installed in the mobile communication terminal through the communication module, or controls the device according to the control signal when or when the event occurs. A smart home system that sends a notification message that is or will be performed. The method of claim 1,
The processor may include IP path information including general IP path information to the content providing server and bypass IP path information, and the content may be obtained through the general IP path information based on the bypass IP path information included in the IP path information. Smart home system to receive the content from the domestic and overseas content providing server that can not be received directly or output through the device. 13. The vehicle control for autonomous driving, comprising the smart home system according to any one of claims 1, 3 and 6 to 12, and comprising a battery for charging and storing power and a vehicle charging module. module. In the method of controlling a device in the home via a smart home system,
Collecting a control signal for controlling the device through a communication module through a communication module including an IR sensor, an RF sensor, a power line communication device, and a magnetic field change detection sensor;
Identifying and separating the collected control signals for each event;
Extracting and storing a control signal satisfying a pre-stored learning condition including one or more of type information, occurrence time information, and occurrence frequency information of a control signal among the identified control signals;
Reading the stored control signal when an event corresponding to the extracted control signal occurs;
Controlling the device based on the read control signal,
The communication module is a first communication module for directly transmitting and receiving a control signal with at least one first device capable of directly transmitting and receiving a control signal among the devices, and a direct communication of a control signal between the first communication module and the device in a space in the home. At least one second communication module is disposed in a space where transmission and reception is impossible and directly transmits and receives a control signal through at least one second device and an IR sensor, and transmits a control signal to the second device through the first communication module. and,
Collecting the control signal,
Through the communication module, the user simultaneously detects and collects an IR signal based control signal and an RF based control signal for controlling the device with a control remote controller,
The control signal through the on / off of the switch of the device of the device that is not controlled by the control remote control of the device, through the power line communication device detects the instantaneous power change amount of the power line when the switch on / off and turn it on Collecting a control signal corresponding to the on / off, and detecting the instantaneous change in the magnetic field at the time of on / off of the switch through the magnetic field change detection sensor, and collecting it as a control signal corresponding to the on / off of the switch,
The storing of the control signal may include:
In the case of the control signal collected by the power line communication device and the magnetic field change detection sensor, the generation time information and the occurrence frequency information are extracted based on a learning condition and stored in a memory.

Images