KR20190074909A - Smart home and car system and method for controlling thereof - Google Patents

Abstract

According to the present invention, a smart home system controlling a home device through a self-learning comprises: a communication module for transmitting and receiving data to and from a home device; a memory for storing a program to control the device; and a processor for executing the program stored in the memory. As the program stored in the memory is executed, the processor automatically collects a control signal for controlling the device through the communication module, classifies and identifies the collected control signal by event, extracts a control signal satisfying a pre-stored learning condition among the identified control signals, stores the extracted control signal in the memory, and controls the device by reading the control signal from the memory when an event corresponding to the extracted control signal is generated. The communication module comprises: a first communication module for directly transmitting and receiving a control signal to and from at least one first device capable of directly transmitting and receiving a control signal among the devices; and one or more second communication modules disposed in a space where direct transmission and reception of a control signal between the first communication module and the device are impossible among the spaces in home, directly transmitting and receiving a control signal through one or more second devices and an IR sensor, and transmitting the control signal to the second device through the first communication module. The pre-stored learning condition includes at least one of type information of the control signal, occurrence time information, and occurrence frequency information. Therefore, the present invention self-controls the devices in home and vehicle while minimizing user intervention.

Description

TECHNICAL FIELD [0001] The present invention relates to a smart home and smart car system,

[01] The present invention relates to a smart home, a smart car system, and a control method thereof, capable of self-learning or product registration to self-control devices in a premises and a vehicle.

[02] With the recent development of IT technology and Internet of Things (IoT) technology, so-called smart home and smart car systems, which provide smart functions in homes, offices and vehicles, are becoming popular.

[03] These smart homes and smart cars are becoming increasingly common to maximize the convenience of use while minimizing the movement and intervention of users for manipulation of various digital based devices.

[04] On the other hand, in the early days of smart home and smart car, in many cases, it was necessary to directly control TV, air conditioner, fan, and air purifier by using control remote controller and Bluetooth in order to control devices.

[05] As a result, remote controls such as TVs are always placed on bed or couch, so that it is easy to find. However, since the remote controller such as an air conditioner or a fan is not used every day, it is troublesome to lose the remote controller or search for the position where the remote controller is placed each time .

[06] In order to solve this problem, a smart home system recently provides a technology in which a user can integrally control a TV, a refrigerator, and an air conditioner through an application installed in a single smartphone.

[07] However, even in the case of such a smart home system, there is a problem that a user must directly select a device to be controlled, and then control an item for controlling the device through direct selection and learning.

[08] For example, the user may select the first step of executing the application of the smartphone, the second step of selecting the air conditioner among the various devices displayed on the UI of the application, The set temperature of the air conditioner must be lowered in the third step in which the function is selected and in the fourth step in which the temperature lowering button among the temperature setting functions is pressed.

[09] If the user wishes to control the air conditioner again under the same condition, the user can control the air conditioner by clicking the first through fourth steps when the process is stored as one, Or if the items that can be stored are limited, there is a need to perform the above steps again and again.

[10] In this regard, Korean Patent Laid-Open Publication No. 10-2015-0144360 (entitled " smart home system capable of providing a customized service based on an application package, customized service providing method using the application package, and recording medium for performing the method) A user can set up a user-oriented network with home devices, which are various home appliances installed in a smart home, thereby providing an application package capable of variously customizing the operation of the home device according to the environment inside the home or various situations of the user Based customized service.

[11] An embodiment of the present invention is to provide a smart home and smart car system and a control method thereof that can self-control devices in home and in a vehicle while minimizing user intervention through self-learning.

[12] It should be understood, however, that the technical scope of the present invention is not limited to the above-described technical problems, and other technical problems may exist.

[13] As a technical means for achieving the above technical object, a smart home or smart car system for controlling a device in a home and a vehicle through self-learning according to the first aspect of the present invention is a smart home or a smart car system, A memory for storing a program for controlling the device and a processor for executing a program stored in the memory, wherein the processor executes a program stored in the memory to control the device through the communication module, And a controller for extracting a control signal that satisfies predetermined learning conditions among the identified control signals and storing the extracted control signals in the memory, When an event corresponding to a signal is generated The control signal is read out from the memory to control the device. In this case, the communication module may include a first communication module that directly transmits / receives a control signal with at least one first device capable of directly transmitting / receiving a control signal among the devices, and a second communication module that transmits / receives a control signal For transmitting / receiving a control signal to / from the at least one second device via the IR sensor, and for transmitting a control signal to the second device through the first communication module, And the pre-stored learning condition includes at least one of type information of the control signal, occurrence time information, and occurrence frequency information.

[14] The communication module may include one or more of an IR sensor, an RF sensor, a Z-Wave, a ZigBee, a power line communication device, and a magnetic field change detection sensor.

[15] The plurality of communication modules are provided in the home and the vehicle, and the communication modules can be grouped with the devices by the range in which the control signals of the devices can be collected.

[16] When the communication module includes at least one of the IR sensor and the RF sensor, the processor simultaneously detects and collects an IR or RF-based control signal for controlling the device by a control remote controller through the communication module .

[17] When the communication module includes at least one of the power line communication device and the magnetic field change detection sensor, the processor transmits a control signal through on / off of a switch of a device not controlled by a control remote control among the devices, The instantaneous power change amount of the power line can be sensed through the sensor, or the momentary change amount of the magnetic field when the switch is on / off can be sensed and collected through the sensor.

[18] Wherein the processor acquires control command set information of the device corresponding to the collected or extracted control signal from the device when the number of times of collecting the control signal of the device or the number of times of extracting the control signal satisfying the learning condition is one or more times And can receive the data from the managing server and store the data in the memory.

[19] Wherein the processor acquires control pattern information of the devices of users residing in a plurality of houses through the communication module, provides recommendation event information to the user based on the control pattern information, When receiving the input information to be used, it is possible to control the device by reading the control signal corresponding to the recommended event information based on the control instruction set information.

[20] The processor may combine the plurality of events into scenario control information and control the device on the basis of the generated scenario control information when there are a plurality of events for the device.

[21] The processor may combine a plurality of events for each of the plurality of devices to generate scenario control information and control the plurality of devices based on the generated scenario control information.

[22] The processor acquires weather information from the meteorological service server through the communication module, provides a notification message to the user based on the weather information, or generates an event matched with weather information corresponding to a predetermined time range and a corresponding control signal From the memory and provide the user with a notification message to control the device for the predetermined time range.

[23] Wherein the communication module includes a wireless communication module for transmitting and receiving data to and from the mobile communication terminal, and the processor transmits a control signal for manually controlling the device through an application preinstalled in the mobile communication terminal through the communication module Or when the event occurs or occurs, control may be performed or performed according to the control signal in a notification message.

[24] Wherein the processor includes IP route information including general IP route information and bypass IP route information to the content providing server, wherein the processor is configured to transmit the content through the general IP route information based on the bypass IP route information included in the IP route information It is possible to receive the content from a content providing server, which can not be received, from domestic and foreign content providing servers, and output the content directly through the device.

[25] In addition, an embodiment of the present invention can be embodied as a vehicle control module for an autonomous vehicle that includes the above-described smart home and smart car system, and is configured to include a battery for supplying and storing power and a car charging module.

[26] In addition, a method for controlling a device in a home and a vehicle through a smart home and a smart car system according to a second aspect of the present invention includes collecting a control signal for controlling the device; Identifying and collecting the collected control signals according to an event; Extracting and storing a control signal satisfying a pre-stored learning condition including at least one of type information, occurrence time information, and occurrence frequency information of the control signal among the identified control signals; Reading the stored control signal when an event corresponding to the extracted control signal is generated and controlling the device based on the read control signal, A first communication module that directly transmits / receives a control signal to / from one or more first devices capable of direct transmission / reception, and a second communication module that is disposed in a space in the premises and a space in the vehicle where control signals between the first communication module and the device can not be directly transmitted / And one or more second communication modules for directly transmitting and receiving a control signal through one or more second devices and an IR sensor and transmitting a control signal to the second device through the first communication module.

[27] In addition, the present invention can control a device in a vehicle by interfacing with a smartphone artificial intelligence program or an artificial intelligent speaker by mounting an array microphone type system in which a communication module is mounted in a vehicle to a sunvisor or the like.

[28] The array microphone type system is equipped with noise and echo cancellation and beamforming algorithms to maximize speech recognition even in the vehicle environment

[29] Using the mobile communication network, it is possible to control the device in the home by remotely interfacing with the artificial intelligent speaker in the home

[30] The array microphone system is linked to the smartphone and the voice command is linked to the server through the smartphone. The intelligent speaker program installed on the smartphone is linked with the infotainment system in the vehicle and Bluetooth. .

[31] The array microphone type system is equipped with an IR communication module, an RF communication module, a Z-wave communication module, and a ZigBee communication module, which are equipped with communication modules such as Bluetooth, Wi-Fi and NFC and can control devices in the vehicle.

[32] An array microphone system can be interfaced with the artificial intelligence software of the smart phone or with the artificial intelligent speaker through the smartphone.

[33] A system in the form of an array microphone can be interfaced with an intelligent speaker in the vehicle to control the device in the vehicle.

[34] According to any one of the above-mentioned objects of the present invention, self-learning, manual learning, recognition of images of existing home appliances, or control of devices in a home and a vehicle can be performed through a list of existing home appliances stored in a server , The user's intervention can be minimized.

[35] In addition, even if the user has not directly controlled the device or does not know the function of the device, the device can be automatically controlled by providing the recommended event information.

[36] Further, the device can be controlled based on the scenario control information, and the user has an advantage that the integrated management can be performed for the control of individual devices or a plurality of devices.

FIG. 1 schematically illustrates a smart home and a smart car control system according to an embodiment of the present invention. Referring to FIG.
FIG. 2 is a block diagram of a smart home and smart car control system according to an embodiment of the present invention.
FIGS. 3A, 3B, and 3C are views illustrating an embodiment of a smart home and smart car control system according to an embodiment of the present invention.
4 is a flowchart of a device control method according to an embodiment of the present invention.

[41] Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, which will be readily apparent to those skilled in the art. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In order to clearly explain the present invention in the drawings, parts not related to the description are omitted.

[42] Whenever a component is referred to as "including" an element throughout the specification, it is to be understood that the element may include other elements, not the exclusion of any other element, unless the context clearly dictates otherwise.

[43] Hereinafter, a smart home system 100 and a control method thereof according to an embodiment of the present invention will be described with reference to the accompanying drawings.

[44] FIG. 1 schematically illustrates a smart home and smart car system 100 according to an embodiment of the present invention. Referring to FIG.

[45] At this time, the respective components shown in FIG. 1 may be connected through a network. The network refers to a connection structure in which information can be exchanged between each node such as terminals and servers. One example of such a network is a 3rd Generation Partnership Project (3GPP) network, a Long Term Evolution (LTE) , A WAN (Wide Area Network), a PAN (Personal Area Network), a Bluetooth (Bluetooth), a wireless LAN (Local Area Network) Network, satellite broadcast network, analog broadcast network, Digital Multimedia Broadcasting (DMB) network, WiFi, and the like.

[46] 1, a smart home and smart car system 100 according to an exemplary embodiment of the present invention includes a home and a vehicle disposed in a vehicle such as an air conditioner, a light switch, a TV, a door lock, an electric curtain, Lt; / RTI > At this time, the smart home and smart car system 100 are characterized by self-learning and controlling the devices 200 in the premises and the vehicle themselves while minimizing the user's intervention. In addition, the smart home and smart car system 100 can perform not only self learning but also manual learning in which a user directly inputs control signals.

[47] The devices 200 disposed in the home are connected to devices 200 controlled by IR signals such as TVs and air conditioners as well as devices 200 connected to the devices through a wired or wireless network to transmit and receive data, A device 200 controlled by receiving an RF signal such as a lock, and devices 200 controlled through on / off of a switch.

[48] The smart home and smart car system 100 may be implemented in the form of a mobile communication terminal 300 or may be implemented as a separate device separate from the mobile communication terminal 300, The user can send and receive data through the network and thus the user can check and control the smart home system 100 using the mobile communication terminal 300. [

[49] In this case, the mobile communication terminal 300 may be a wireless communication device, such as a PCS (Personal Communication System), a GSM (Global System for Mobile communications), a PDC (Personal Digital Cellular), a PHS Such as PDA (Personal Digital Assistant), IMT (International Mobile Telecommunication) -2000, CDMA (Code Division Multiple Access) -2000, W-CDMA (W-CDMA) And may include a handheld based wireless communication device.

[50] In particular, the mobile communication terminal 300 is an intelligent terminal that adds a computer support function such as internet communication and information search to a portable terminal. The intelligent terminal includes a mobile phone, a smart phone a smart phone, a pad, a smart watch, a wearable terminal, other mobile communication terminal 300, and the like.

[51] In addition, the smart home and smart car system 100 can transmit and receive data in cooperation with smart devices in the home, such as a smart TV and a wall pad, as well as the mobile communication terminal 300.

[52] Hereinafter, a smart home and smart car system 100 according to an embodiment of the present invention will be described in more detail with reference to FIG.

[53] 2 is a block diagram of a smart home and smart car system 100 in accordance with an embodiment of the present invention.

[54] 2, a smart home and smart car system 100 according to an embodiment of the present invention includes a communication module 110, a memory 120, and a processor 130. [

[55] The communication module 110 transmits and receives data to and from the devices 200 in the premises and the vehicle. The communication module 110 may include at least one of an IR sensor, an RF sensor, a power line communication device, and a magnetic field change detection sensor.

[56] In addition, the communication module 110 may include both a wired communication module and a wireless communication module. The wired communication module may be implemented by a telephone line communication device, a cable home (MoCA), an Ethernet, an IEEE1294, an integrated wired home network, and an RS-485 control device. In addition, the wireless communication module can be implemented with a wireless LAN (WLAN), Bluetooth, HDR WPAN, UWB, ZigBee, Impulse Radio, 60 GHz WPAN, Binary-CDMA, wireless USB technology and wireless HDMI technology.

[57] The memory 120 stores a program for controlling the devices 200 in the home. Herein, the memory 120 is collectively referred to as a nonvolatile storage device and a volatile storage device which keep the stored information even when power is not supplied.

[58] For example, the memory 120 may be a compact flash (CF) card, a secure digital (SD) card, a memory stick, a solid-state drive (SSD) A magnetic computer storage device such as a NAND flash memory, a hard disk drive (HDD) and the like, and an optical disc drive such as a CD-ROM, a DVD-ROM, etc. .

[59] The processor 130 executes the program stored in the memory 120. [ Specifically, the processor 130 automatically collects control signals for controlling the device 200 through the communication module 110, and identifies the collected control signals by events.

[60] For example, when the user controls the TV through a button input for turning on the TV through a control remote control based on an IR signal, a numeric button input for selecting a specific channel of the TV, And automatically collects a control signal for controlling the TV through the network.

[61] Then, the collected control signals are classified according to events, such as when the collected control signals are collected, how many times they are collected, and what type of control signals, etc., and the control signals are identified by matching the product IDs of the devices 200 corresponding to the control signals .

[62] For example, a control signal for switching to the On state at 10 am, a control signal for selecting the channel 9 within one minute from the On state, a control signal for switching to the Off state at 12 o'clock, And a control signal for switching back to the On state. In this case, the control signal for the On state is collected twice at 10 o'clock and 21 o'clock in the processor 130, and the control signal for selecting the channel 9 is collected once at 10 o'clock to 10 o'clock 1 Can be identified based on type information, time information, and frequency information.

[63] The processor 130 then extracts a control signal that satisfies a pre-stored learning condition among the identified control signals and stores the extracted control signal in the memory 120. When an event corresponding to the extracted control signal occurs, And controls the device 200.

[64] At this time, the pre-stored learning condition may include at least one of the type information of the control signal, the generation time information, and the occurrence frequency information.

[65] For example, if it is to extract control signals that occur repeatedly at the same time each day with pre-stored learning conditions for the TV, the processor 130 may generate a plurality of identified control signals stored in the memory 120, A control signal for turning on the TV at channel 11, a control signal for switching to channel 9, and a control signal for turning off the TV at 11 pm can be extracted based on the learning condition.

[66] Then, when the event corresponding to the extracted control signal is received at 10:00 pm, the TV is turned on and the TV is switched to the channel 9, and the control signal for turning off the TV is read out from the memory 120 have.

[67] According to the embodiment of the present invention, unlike the prior art in which a user collects and stores control signals for controlling the device 200 through a remote controller or the like, and repeatedly drives the control signals, The device 200 can be controlled by itself by extracting a control signal satisfying a predetermined learning condition, thereby minimizing the user's intervention, and at the same time, it is possible to minimize the user's habit, intention and tendency more positively So that the device 200 can be controlled.

[68] Meanwhile, in an embodiment of the present invention, the communication module 110 may include the first and second communication modules 110-1 and 110-2.

[69] The first communication module 110-1 directly transmits and receives a control signal to one or more first devices 200-1 capable of directly transmitting and receiving control signals among the devices 200. [

[70] The second communication module 110-2 is disposed in a space in which the control signal among the devices 200 can not be directly transmitted and received. The second communication module 110-2 directly transmits and receives a control signal through one or more second devices 200-2 and the IR sensor and transmits the control signal to the first communication module 110-1 and a wireless network such as Bluetooth or Wi- The second device 200-2 can receive the control signal and transmit the collected control signal to the second device 200-2.

[71] At this time, a plurality of second communication modules 110-2 may be provided in the house, and thus the control signals of the second device 200-2 may be grouped with the second devices 200-2 .

[72] For example, there may be a case where it is impossible to collect each IR signal through one first communication module 110-1 because the air conditioner based on the IR signal and the TV are located in different areas, respectively. In this case, 2 communication module 110-2 can be grouped within a range in which control signals can be collected for the air conditioner and the TV, respectively.

[73] Accordingly, in an embodiment of the present invention, even in the case of the second devices 200-2, which must be located only at a specific position, or the second devices 200-2, in which a control signal is transmitted and received only in a specific direction, The modules 110-2 are grouped and arranged so that the control signals can be collected without fail.

[74] In this case, when the smart home system 100 is implemented in such a manner that the communication module 110 is received by the external housing, as shown in FIG. 3A, which will be described later, a plurality of final components implemented in the external housing may be disposed in the house have.

[75] 3B, when the mobile communication terminal 300 is implemented as a dongle type which is integrally formed or coupled with the mobile communication terminal 300, a plurality of gateway-type communication modules 110 are separately grouped in the house to collect control signals, To the mobile communication terminal 300 side.

[76] Meanwhile, when the communication module 110 includes an IR sensor and an RF sensor, a control signal for controlling the device 200 can be transmitted and received through the IR sensor and the RF sensor.

[77] In this case, when the control signal is received and the user outputs an IR or RF-based control signal for controlling the device 200 through the button of the control remote control, the control signal output by the control remote control is transmitted to the device 200 To control the device 200. At the same time, the communication module 110 receives and collects the control signal output by the control remote controller.

[78] When a control signal satisfying a learning condition among the control signals received and collected as described above is extracted, a control signal stored in the memory 120 is read and transmitted when a corresponding event occurs, The device 200 is controlled according to the transmitted control signal.

[79] In addition, when the communication module 110 includes a power line communication device, the processor 130 may switch on / off a switch of the device 200 that is not controlled by IR or RF-based remote control of the device 200 The control signal can be collected by sensing the instantaneous power variation of the power line through the power line communication device.

[80] For example, when the device 200 is an on / off switch of a lamp installed on a wall, the processor 130 detects an instantaneous power change amount when the switch is turned on / off via the communication module 110, / Off < / RTI >

[81] Then, type information (on / off), occurrence time information and occurrence frequency information among the control signals for controlling the lamp are extracted based on the learning condition and stored in the memory 120. Then, You can control the light by reading it.

[82] If the communication module 110 includes a magnetic field change detection sensor, the processor 130 may turn on / off the switch of the device 200 that is not controlled by the IR or RF-based control remote control, such as the power line communication device Can be collected through the sensing of the instantaneous variation of the magnetic field.

[83] For example, when a switching operation is performed to turn on the lamp, the communication module 110 may detect a change in the intensity of the peripheral magnetic field of the switch, for example, and may detect and collect the corresponding control signal.

[84] In this case, when the control signal is collected through the power line communication device or the magnetic field change sensor, the device 200 can be controlled through a power line communication, a method of switching the switch through a wireless network or an actuator, or the like.

[85] Meanwhile, when the number of times of collecting the control signal of the device 200 or the number of times of extracting the control signal satisfying the learning condition is one or more times, the processor 130 determines whether the control command of the device 200 corresponding to the collected or extracted control signal The set information can be received from the server managing the device 200 and stored in the memory 120. [

[86] The processor 130 obtains the control pattern information of the devices 200 residing in the plurality of users through the communication module 110 from the smart home server and provides the user with the recommended event information based on the obtained control pattern information .

[87] Accordingly, when receiving the input information for using the recommended event information from the user, the processor 130 can control the device 200 by reading the control signal corresponding to the recommended event information based on the control instruction set information .

[88] For example, when the device 200 is a TV, when a control signal for turning on the TV through the control remote controller is collected one or more times, the processor 130 performs the manufacturer or management of the TV corresponding to the collected control signal To obtain a control command set of the TV. This control instruction set refers to a command set for all control of the device 200 such as On / Off of the TV power, volume control, automatic screen adjustment, and the like.

[89] When the control command set is acquired in this way, the processor 130 can acquire control pattern information of the TVs of users in other premises through the communication module 110, You can provide recommended event information to make it available.

[90] That is, control pattern information using the alarm function included in the TV at 7:00 am from the home of another user, control pattern information for turning off the TV at 10:00 pm and off at 11:00 pm are collected, By analyzing the information in consideration of the user's preference, usage patterns, etc., it is possible to generate and provide to the user that the alarm function of the TV can be activated and provided at 7:00 am as recommended event information.

[91] If the user who has received the recommendation event information selects the desired recommendation event information, the processor 130 determines whether or not the control command It is possible to control the alarm function of the TV by reading out the control signal corresponding to the recommended event information based on the set information.

[92] Accordingly, even when the user has not directly controlled the device 200 or the user does not know all the various functions of the device 200, the control pattern information of users in other premises It is possible to allow the user to use the good functions possessed by the device 200 by providing the recommended event information based on the recommended event information.

[93] Meanwhile, the smart home system 100 according to an embodiment of the present invention can control the device 200 based on scenario control information through acquisition of a user's life log and analysis of big data, in addition to recommendation event information . At this time, it goes without saying that scenario control information, which will be described later, may be generated by considering all or all of the above-mentioned recommended event information as well as event information in the home.

[94] Specifically, when the device 200 has a control signal satisfying the learning condition and a plurality of events corresponding to the control signal, the processor 130 combines a plurality of events into the scenario control information, generates the scenario control information It is possible to control the device 200 based on the received signal.

[95] For example, scenario control information for controlling the TV includes an event and control signal for turning on the TV at 10:00 PM, an event and control signal for switching to the channel No. 9 for the drama channel, and an ON state for 1 hour Event and control signals for lowering the volume by two steps and events and control signals for turning off the TV after one hour are all generated as scenario control information when 30 minutes have elapsed since the TV is turned on .

[96] In addition, scenario control information may be generated for a single device 200 as described above, and scenario control information may be generated by combining a single event or a plurality of events for each of the plurality of devices 200 And the plurality of devices 200 can be controlled based on the generated scenario control information.

[97] For example, the scenario control information for controlling the above-described TV further includes an event and a control signal for controlling the electric lamp so that the light amount of the electric lamp is lowered by 10% after the TV is turned on at 10:00 pm An event and a control signal, and an event and a control signal for turning off the sleeping light when the TV is off after one hour has elapsed, and can be generated as the scenario control information.

[98] As such, an embodiment of the present invention allows a user to individually identify and modify, delete, and execute event and control signals for each device 200 provided by the processor 130, It is possible to modify, delete, and execute the integrated control of the device 200 or the plurality of devices 200 through the scenario control information, respectively.

[99] According to an embodiment of the present invention, the event information of the user and the control signal corresponding thereto are continuously collected. When the data exceeding the threshold value is accumulated, the usage pattern of the user is more accurately analyzed through the big data analysis technique, Can be maximized.

[100] Meanwhile, the smart home system 100 according to an embodiment of the present invention acquires weather information and traffic information from a server of a government office such as a server of a meteorological agency or a server of a traffic management corporation, Lt; / RTI >

[101] For example, the processor 130 obtains weather information from the weather service server through the communication module 110, and based on the acquired weather information, the probability of coming rain after 1 hour is 70% although it does not rain at 10 am You can provide an umbrella and a reminder to go out.

[102] In addition, the processor 130 may be configured to read from the memory 120 an event matching the weather information corresponding to the predetermined time range and a corresponding control signal, and to control the device 200 for a predetermined time range It can be provided as a notification message.

[103] That is, at 10:00 am, the dehumidifier is operated from 11:00 am to 12:00 pm, along with a message informing that it is going to rain from 11:00 am to 3:00 pm, and the dehumidifier is operated after 1:00 pm, An event and a control signal for activating the function may be read out and provided to the user as a notification message.

[104] As another example, if the controller 130 has collected the control signal manually controlled at 11 o'clock every night, the processor 130 stores the control signal in the memory 120 in correspondence with the event information, reads the control signal, If the weather information includes special event information, such as when the full moon lights up at 11 o'clock at night or the meteor shower is predicted when the weather information is considered together, the electric curtain control is performed at 12 o'clock The user can be provided with a notification message.

[105] As described above, an embodiment of the present invention can acquire peripheral information such as weather information and traffic information, and control the device 200 based on the acquired information, which is different from simply executing the event information that has occurred in the past.

[106] That is, in the above-described example, even though the unevent event and the corresponding control signal have not been collected from 11 o'clock to 3 o'clock in the above example, the event that the drying function of the dehumidifier and the washing machine is executed When the control signal has been collected, the processor 130 may control the devices 200 by matching a control signal to a new event as a result of performing self-learning using previously learned events and control signals.

[107] In this case, since the control signal for controlling the device 200 has not been collected by the user, a separate notification message is provided to the user, and the user can use the UI of the smart home system 100, When the terminal 300 is interlocked with the terminal 300, the terminal 300 can determine whether to execute the application through the UI control of the application.

[108] Meanwhile, one embodiment of the present invention may include a wireless communication module for transmitting / receiving data to / from the mobile communication terminal 300 by the communication module 110.

[109] The processor 130 may receive a control signal for manually controlling the home device 200 through an application installed in advance in the mobile communication terminal 300 through the communication module 110, When the event occurs, it is possible to transmit the notification that the control of the device 200 is performed or performed according to the control signal.

[110] Accordingly, the user can directly determine whether to execute the notification message to directly control each individual function of the device 200 through the UI of the mobile communication terminal 300, or to output a control signal corresponding to the event. Also, it is possible to control the device 200 in the home as well as outside through the wireless communication module based on LTE, 5G, and the like.

[111] In addition, it is needless to say that the user can receive the above-mentioned recommended event information and scenario control information through the mobile communication terminal 300, and can directly determine whether or not to execute them through the mobile communication terminal 300 as well.

[112] In addition, the smart home system 100 according to an embodiment of the present invention receives an image / moving image captured through a camera of a mobile communication terminal 300 or a general camera, And acquires the control command set information from the server managing the device 200 based on the recognition result to generate the control signal.

[113] For example, when a newly purchased TV (or a remote controller for controlling the TV) is photographed through a camera and the photographed image / video is received by the smart home system 100 through the communication module 110, 100 recognizes the presence of the TV through the image recognition technique and can acquire the control command set of the TV by connecting to the server for the maker or management of the TV to generate the control signal. Obviously, the acquisition of the control signal can be achieved by a variety of methods, such as when an event occurs, when a recommended event occurs, when scenario control information is generated, and the like.

[114] In this case, in an embodiment of the present invention, when there are a plurality of devices included in the photographed image / moving image, a plurality of devices are recognized as separate devices 200, and a control signal for each device is acquired and stored in the memory 120 .

[115] In addition, in the embodiment of the present invention, when the device 200 is recognized through the camera, individual control signals, event information, recommendation event information, scenario information, and the like for the recognized device 200 are output, It is possible to make it possible.

[116] As described above, one embodiment of the present invention not only recognizes the device 200 when a control signal is generated but also automatically recognizes the device 200 by analyzing the image / moving image, A signal can be automatically collected, or a recommended event information can be generated. Or a list of the devices 200 in the home or a list of the devices 200 that are on sale, scheduled to be sold or discontinued and the corresponding set of control commands are stored in the memory 120 of the smart home system 100 Or may be stored in advance in a separate management server linked to the smart home system 100 and acquired through the communication module 110. [

[117] In addition, the smart home system 100 according to an embodiment of the present invention receives an image / moving image captured through a camera of a mobile communication terminal 300 or a general camera, And generate a control signal for the devices 200 in the home based on the recognition result.

[118] For example, when a user photographs a plant such as a flower or a tree through a camera and transmits the captured image to a smart home system 200, the smart home system 200 transmits the plant included in the image / And information about the plant can be searched and stored on the Internet through a search engine or the like. Accordingly, the smart home system 200 can control a device such as a sprinkler, a control signal for controlling a window, an LED lamp, event information, and the like to automatically adjust the water cycle, the sunshine, and the ventilation according to the retrieved information. Recommended event information, and scenario information.

[119] In other words, if there is a plant that grows healthy by giving water once a month and ventilating with sunshine for 2 hours a day, it will generate event information according to this water giving cycle to control the device such as sprinkler Generates control signals, and generates event information such as adjusting the lighting time and light amount of the LED lights or automatically opening and closing the windows, and can generate the event information as scenario information, or can be provided as recommended event information have.

[120] Although the device 200 or the plant is described as an example in the above-described example, it is also possible to use the management of the animal (water / feed, temperature and humidity control), the management of the furniture (the humidity of the house, Management (bowl cleaning, etc.) can be controlled through control signals, event information, recommended event information, and scenario information according to the method described above.

[121] Meanwhile, the smart home system 100 according to an embodiment of the present invention can receive content from the content providing server 400 and directly output the content, or control the content to be output through the in-house device 200.

[122] At this time, the content may be, for example, content including at least one of video, audio, and text, such as radio, broadcast, document, and the like.

[123] When the smart home system 100 outputs content directly, it can output the content received from the content providing server 400 via the output unit 140 including the display unit and the audio output unit, which will be described later.

[124] In addition, when the content is output through the home-use device 200, the content may be directly provided to the device 200 capable of outputting the content through a wireless communication module such as Bluetooth or Wi-Fi, 300 to provide the corresponding content to the device 200. Alternatively, the content may be directly provided to the mobile communication terminal 300 and output on the mobile communication terminal 300.

[125] To this end, the processor 130 includes IP route information to the content providing server 400, and can receive contents such as broadcasting, radio, etc. through the IP route information.

[126] At this time, the IP route information is not only a general IP route address, which is allowed to access from outside the country or from outside the country, and is a path for receiving contents, Bypass IP route information that can be detourned and connected.

[127] Accordingly, an embodiment of the present invention can receive contents from domestic and foreign contents providing server 400 which can not receive contents through general IP route information, and output the contents directly or output through device 400.

[128] For example, it is impossible to access and provide radio broadcasts of specific overseas regions through the general IP route information, but the processor 130 receives and outputs the radio broadcast contents that can not be accessed and provided through the bypass IP route information, Through the embodiment of the present invention, broadcast contents from all over the world can be easily provided at home.

[129] The general IP route information and the bypass IP route information may be initially stored on the memory 120 of the smart home system 100. The acquisition of the IP route information may be performed when an event occurs, And generating scenario control information.

[130] Hereinafter, an embodiment of a smart home system 100 according to an embodiment of the present invention will be described with reference to FIGS. 3A to 3B.

[131] FIGS. 3A and 3B are views illustrating an embodiment of a smart home system 100 according to an embodiment of the present invention.

[132] 3A, a smart home system 100 according to an exemplary embodiment of the present invention may be implemented in such a manner that a communication module 110, a memory 120, and a processor 130 are received by an external housing . In this case, the smart home system 100 may be placed on the floor of the house, on the table in a stand, or on the wall.

[133] In this case, the smart home system 100 may provide a notification message informing the user of the event, the recommended event information, the control signal, and the scenario control information through the application of the mobile communication terminal 300, And an output unit 140 such as a voice output unit.

[134] Alternatively, the smart home system 100 may include a battery and a charging module, and may be configured to include a configuration such as the communication module 110, the memory 120, and the processor 130 described above in an external housing in the form of a charger .

[135] In addition, as shown in FIG. 3B, an embodiment of the present invention may be formed as a dongle type that can be coupled with the mobile communication terminal 300. [ 3B, the dongle-type smart home system 100 may be formed as a USB type and coupled to the mobile communication terminal 300 or may be embedded in the form of a module chip in the mobile communication terminal 300 have.

[136] 3B, the smart home system 100 may be connected to a central control terminal such as a PC, a tablet PC, a smart phone, a smart TV, . ≪ / RTI > In this case, the smart home system 100 can transmit / receive data to / from the mobile communication terminal 300 through an application installed in a separate mobile communication terminal 300.

[137] In addition, an embodiment of the present invention includes the above-described battery and a charging module, wherein the charging module may be a charging module for a vehicle.

[138] For example, when an electric power is supplied through a cigar jack or a USB terminal, the ECU 110 may be connected to the ECU of the vehicle through the communication module 110. In this case, It is possible to collect and transmit control signals for controlling various functions (window on / off, headlight, excel, brake, etc.) in the vehicle by transmitting and receiving data.

[139] When the embodiment of the present invention is applied to a general vehicle, a control signal for controlling various functions of the vehicle is acquired by the processor 130 and control is possible whenever an event occurs. At this time, The present invention can be obtained by various methods such as when an event occurs, when a recommended event occurs, when scenario control information is generated, and the like. Accordingly, an embodiment of the present invention has an advantage that it can operate as a smart car for autonomous driving.

[140] The user can confirm control signals, event information, scenario information, and the like for controlling the home-use device 200 through the application of the mobile communication terminal 300, and can directly control the devices 200 in the home as well as outside .

[141] In this case, the smart home system 200 coupled to the mobile communication terminal 300 and the central control terminal preferably transmits and receives data via Wi-Fi, but is not limited thereto. Of course.

[142] In this embodiment, it is advantageous in that the production cost can be reduced as much as possible, compared to a case housed in the above-described external housing. In addition, when the smart home system 100 implemented in the form of a dongle is combined with the mobile communication terminal 300, the mobile communication terminal 300 directly transmits and receives the RF signal and the IR signal, The smart home system 100 according to the present invention is capable of minimizing the power consumption of the mobile communication terminal 300 when coupled to the central control terminal. ) As well as the control according to the above-mentioned recommended event information and the control according to the scenario can be executed.

[143] For example, if the smart home system 100 recognizes IPTV and automatically or manually collects hundreds of channel lists in the case of the control instruction set or IPTV, Control, volume control, or scenario information control. In this case, the smart home system 100 can update the channel list by reflecting the changed channel information in the channel list of the IPTV.

[144] One embodiment of the present invention is an embodiment of the present invention, such as 'Google Assistant' or 'Amazon Alexa', which is a personal artificial intelligence device provided by 'Bixbee' of 'Samsung', 'Google Home' of 'Samsung' or 'Amazon Eco' Can be interlocked. That is, the smart home system 100 according to an exemplary embodiment of the present invention may include a voice artificial intelligence device itself or may provide a corresponding function through an application for the voice artificial intelligence function of the mobile communication terminal 300 Can receive.

[145] Accordingly, in an embodiment of the present invention, when the event, the recommendation event, and the scenario information are generated as well as the basic situation-awareness guidance described above, the device 200 is controlled with voice recognition and guidance through the voice artificial intelligence device You may.

[146] 2 may be implemented in hardware such as software or an FPGA (Field Programmable Gate Array) or ASIC (Application Specific Integrated Circuit), and may perform predetermined roles can do.

[147] However, 'components' are not meant to be limited to software or hardware, and each component may be configured to reside on an addressable storage medium and configured to play one or more processors.

[148] Thus, by way of example, an element may comprise components such as software components, object-oriented software components, class components and task components, processes, functions, attributes, procedures, Routines, segments of program code, drivers, firmware, microcode, circuitry, data, databases, data structures, tables, arrays, and variables.

[149] The components and functions provided within those components may be combined into a smaller number of components or further separated into additional components.

[150] Hereinafter, a device control method in the smart home system 100 according to an embodiment of the present invention will be described with reference to FIG.

[151] 4 is a flowchart of a device control method according to an embodiment of the present invention.

[152] The device control method according to an embodiment of the present invention first collects control signals for controlling the devices 200 in the home (S410), and identifies the collected control signals by events (S420).

[153] Next, a control signal that satisfies a pre-stored learning condition including at least one of the type information, the generation time information, and the frequency information of the control signal among the identified control signals is extracted and stored (S430).

[154] Next, when an event corresponding to the extracted control signal is generated, the stored control signal is read (S440), and the device 200 is controlled based on the read control signal (S450).

[155] In the above description, steps S410 through S450 may be further divided into additional steps or combined into fewer steps, according to an embodiment of the present invention. Also, some of the steps may be omitted as necessary, and the order between the steps may be changed. In addition, the contents already described with respect to the smart home system 100 (100) in Figs. 1 to 3B apply to the device control method of Fig. 4 even if other contents are omitted.

[156] One embodiment of the present invention may also be embodied in the form of a computer program stored on a medium executed by a computer or a recording medium including instructions executable by the computer. Computer readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media. In addition, the computer-readable medium may include both computer storage media and communication media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Communication media typically includes any information delivery media, including computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave, or other transport mechanism.

[157] While the methods and systems of the present invention have been described in connection with specific embodiments, some or all of those elements or operations may be implemented using a computer system having a general purpose hardware architecture.

[158] It will be understood by those skilled in the art that the foregoing description of the present invention is for illustrative purposes only and that those of ordinary skill in the art can readily understand that various changes and modifications may be made without departing from the spirit or essential characteristics of the present invention. will be. It is therefore to be understood that the above-described embodiments are illustrative in all aspects and not restrictive. For example, each component described as a single entity may be distributed and implemented, and components described as being distributed may also be implemented in a combined form.

[159] The scope of the present invention is defined by the appended claims rather than the detailed description and all changes or modifications derived from the meaning and scope of the claims and their equivalents are to be construed as being included within the scope of the present invention do.

100: Smart Home System
110: communication module
110-1: first communication module
110-2: second communication module
120: Memory
130: Processor
140:
200: device
200-1: first device
200-2: second device
300: mobile communication terminal
400: Content providing server

Claims (21)

1. A smart home system for controlling a home device through self-learning,
A communication module for transmitting and receiving data to and from a home device,
A memory for storing a program for controlling the device;
And a processor for executing a program stored in the memory,
The processor automatically collects a control signal for controlling the device through the communication module as the program stored in the memory is executed, identifies the collected control signal by event, identifies the control signal, And a controller for controlling the device by reading out the control signal from the memory when an event corresponding to the extracted control signal is generated,
Wherein the communication module comprises: a first communication module for directly transmitting / receiving a control signal to / from at least one first device capable of directly transmitting / receiving a control signal among the devices; and a second communication module for directly transmitting / receiving control signals between the first communication module and the device A second communication module disposed in a space in which transmission / reception is impossible and directly transmitting / receiving a control signal through one or more second devices and an IR sensor, and transmitting a control signal to the second device through the first communication module In addition,
Wherein the pre-stored learning condition includes at least one of type information, occurrence time information, and occurrence frequency information of the control signal.
The method according to claim 1,
Wherein the communication module includes at least one of an IR sensor, an RF sensor, a power line communication device, and a magnetic field change sensor.
3. The method of claim 2,
Wherein the second communication module is disposed in a plurality of locations in the home, and is arranged in a grouping manner with the second devices by a range in which control signals of the second device can be collected.
3. The method of claim 2,
If the communication module includes one or more of the IR sensor and the RF sensor,
Wherein the processor simultaneously detects and collects an IR or RF-based control signal for controlling the device with a control remote control by the user through the communication module.
3. The method of claim 2,
When the communication module includes at least one of the power line communication device and the magnetic field change detection sensor,
Wherein the processor controls a control signal through on / off of a switch of a device not controlled by a control remote controller among the devices by detecting an instantaneous power change amount of the power line through the power line communication device, And detects and collects instantaneous variations in the magnetic field at on / off.
Obtain control command set information
The method according to claim 1,
Wherein the processor acquires control command set information of the device corresponding to the collected or extracted control signal from the device when the number of times of collecting the control signal of the device or the number of times of extracting the control signal satisfying the learning condition is one or more times From a server to be managed, and stores the received data in the memory.
Provide recommended event information
The method according to claim 6,
Wherein the processor acquires control pattern information of the devices of users residing in a plurality of houses through the communication module and provides recommendation event information to the user based on the control pattern information,
And reads the control signal corresponding to the recommended event information based on the control instruction set information to control the device when receiving input information for using the recommended event information from the user.
Scenario Control Functions 1
The method according to claim 1,
Wherein the processor generates scenario control information by combining the plurality of events when there are a plurality of events for the device, and controls the device based on the generated scenario control information.
Scenario control function 2
9. The method of claim 8,
Wherein the processor is operable to combine a plurality of events for each of the plurality of devices to generate scenario control information and to control the plurality of devices based on the generated scenario control information, system.
Weather information interlocking (situation awareness)
The method according to claim 1,
Wherein the processor acquires weather information from a weather station server through the communication module, and provides a notification message to the user based on the weather information,
Reads out an event matched with weather information corresponding to a predetermined time range and a corresponding control signal from the memory, and provides the user with a notification message to control the device for the predetermined time range.
External control / interlocking possible
The method according to claim 1,
Wherein the communication module includes a wireless communication module for transmitting and receiving data to and from the mobile communication terminal,
The processor receives a control signal for manually controlling the device through an application installed in advance in the mobile communication terminal through the communication module or controls the device in accordance with the control signal when the event occurs or occurs To be performed or to be performed.
The method according to claim 1,
Wherein the processor includes IP route information including general IP route information and bypass IP route information to the content providing server, wherein the processor is configured to transmit the content through the general IP route information based on the bypass IP route information included in the IP route information Wherein the content is received from a content providing server, which can not receive the content, and is directly output or outputted through the device. A control module for a vehicle for autonomous navigation, comprising a smart home system according to any one of claims 1 to 12 and configured to include a battery and a charging module for a vehicle for receiving and storing power.
A method for controlling a home device through a smart home system,
Collecting a control signal for controlling the device through a communication module;
Identifying and collecting the collected control signals according to an event;
Extracting and storing a control signal satisfying a pre-stored learning condition including at least one of type information, occurrence time information, and occurrence frequency information of the control signal among the identified control signals;
Reading the stored control signal when an event corresponding to the extracted control signal occurs, and
And controlling the device based on the read control signal,
Wherein the communication module comprises: a first communication module for directly transmitting / receiving a control signal to / from at least one first device capable of directly transmitting / receiving a control signal among the devices; and a second communication module for directly transmitting / receiving control signals between the first communication module and the device A second communication module disposed in a space in which transmission / reception is impossible and directly transmitting / receiving a control signal through one or more second devices and an IR sensor, and transmitting a control signal to the second device through the first communication module / RTI >
In addition, the present invention can control an in-vehicle device by interfacing with a smartphone artificial intelligence program or an artificial intelligent speaker by mounting a system in the form of an array microphone on which a communication module is mounted in a vehicle to an in-vehicle sun visor or the like. The array microphone type system is equipped with noise and echo cancellation and beamforming algorithms to maximize speech recognition even in the vehicle environment Using the mobile communication network, it is possible to control the device in the home by remotely interfacing with the artificial intelligent speaker in the home The array microphone system is linked to the smartphone and the voice command is linked to the server through the smartphone. The intelligent speaker program installed on the smartphone is linked with the infotainment system in the vehicle and Bluetooth. . The array microphone type system is equipped with an IR communication module, an RF communication module, a Z-wave communication module, and a ZigBee communication module, which are equipped with communication modules such as Bluetooth, Wi-Fi and NFC and can control devices in the vehicle. An array microphone system can be interfaced with the artificial intelligence software of the smart phone or with the artificial intelligent speaker through the smartphone. A system in the form of an array microphone can be interfaced with an intelligent speaker in the vehicle to control the device in the vehicle.

Images