KR101618859B1 - Home device information mining-processing system using IOT in cloud network and providing home services corresponding to user behavior pattern through resource-virtualization based remote control - Google Patents

Abstract

The present invention relates to a home device information collection and processing system using the cloud-based IoT, which collects and analyzes comprehensive information about a home device and information about home activities using an assist gateway generally constructed based on a cloud, constructs home device virtualization software in the assist gateway and controls the home device. In the home device information collection and processing system, the assist gateway installed in a home and the cloud installed in a remote place are provided, and thus the comprehensive information about a home device and the information about home activities collected by the assist gateway are separated in a dual manner. For this purpose, the assist gateway collects product information of the home device and information about a pattern of use of the device, and derives point-of-purchase information.

Description

Field of the Invention [0001] The present invention relates to a home device information collecting and processing system that provides a home service based on a user behavior pattern using a cloud-based object Internet and remote control based on resource virtualization to user behavior pattern through resource-virtualization based remote control}

The present invention relates to a method and system for collecting and analyzing general information and home activity information of a home home device using an assist gateway built on a cloud basis and building a virtualization software of a home device in an assist gateway, To a home device information collection processing system using the Internet.

More specifically, the present invention separates the comprehensive information of the home devices collected at the assist gateway and the home activity information in a dual manner by constructing the assistant gateway installed in the home and the cloud installed at the remote location. To this end, the assist gateway collects product information and device usage information of the home device and derives purchase point information.

The cloud performs integrated application information processing for a plurality of homes to collect lifecycle information for each home device, calculate expected replacement timing information, analyze comprehensive information received from the assist gateway, and generate targeted advertisement data.

In addition, the cloud provides link management, health care service, home security management service, user and home device monitoring service, home device remote control service, user scheduling and alarm service of portal search server, To provide targeted advertising content services by time zone, region, and device.

Recently, digital video compression, digital modulation and demodulation, wired / wireless network communication and the like have rapidly developed, and various digital image processing devices such as digital TV, digital set-top box, IPTV, smart TV and media box have been used at home. Such a digital image processing device can retrieve and search various contents-related additional data by simply moving away from a conventional passive method of simply viewing an image provided by a broadcasting station in a living room.

In addition, the use of smart phones and smart pads such as the personal portable terminal devices such as the iPhone, Android phone, iPad, and Galaxy Tab has been exploding in recent years. Now, even in the household, It has become common to search for and process information through it. Nowadays, smart dongles have been introduced, making it possible to use ordinary digital TVs like smart devices like smart pads.

Furthermore, with the opening of the Android platform by the US, many household appliances that have traditionally been used at home, such as refrigerators, washing machines, ovens and wall pads, are becoming smart devices. Recently, it has been attempted to apply Android technology to the house of a flower pot or a pet animal.

Accordingly, various communication technologies and terminal devices exist in the home while performing their respective functions. In the past, the home devices were only faithful to their own functions, and the users were satisfied with such services. However, all of these home devices are configured in a digital manner and can realize a network connection function, so that it is expected that synergy effect can be sufficiently achieved by carrying out an analysis of an upper concept while exchanging information with each other.

Accordingly, there is a need for a technology capable of connecting a plurality of home devices existing in a home to a cloud system, comprehensively analyzing data generated individually, and providing a high-level meaningful service to the user through the comprehensive analysis.
[Prior Art Literature]
1. Korean Patent Application No. 10-2010-0016375 "Resource providing method and resource distributing device for providing cloud resource in combination with a plurality of device resources"
2. Korean Patent Application No. 10-2009-0097949 "Cloud Server, Client Terminal, Device, Cloud Server Operation Method and Client Terminal Operation Method"
3. Korean Patent Application No. 10-2013-0051877 "Big Data Extraction System and Method"
4. Korean Patent Application No. 10-2013-0048016 entitled " Apparatus and method for providing advertisement based on user location utilizing Big Data "
5. Korean Patent Application No. 10-2002-7017574 entitled "Distributed Computing Service Platform"
6. Korean Patent Application No. 10-2011-0112106 entitled " Service System and Method for Providing Service in Digital Receiver "
7. Korean Patent Application No. 10-2012-0072742 "Application Providing Apparatus and Method for Big Data Processing"
8. Korean Patent Application No. 10-2012-0134786 "Big data service method for drivers using cloud service and system therefor"
9. Korean Patent Application No. 10-2012-7024424 entitled "Information Integrated Control System and Information Processing Program, Social Infrastructure Operation System, Operation Method, Local Device, Server Device and Program"
10. Korean Patent Application No. 10-2012-7017462 entitled "Scalable Local IP Access to Integrated Gateway in Hybrid Network"
11. Korean Patent Application No. 10-2012-7021659 "Personalized Vocabulary for Digital Assistant"
12. Korean Patent Application No. 10-2013-0113253 "Keyword cloud providing server and keyword cloud providing method using the same"

delete

SUMMARY OF THE INVENTION The present invention has been made in view of the above-mentioned problems, and an object of the present invention is to provide a home gateway that collects and analyzes general information and home activity information about a home home device using an assist gateway built on a cloud basis, The present invention provides a home device information collecting and processing system using a cloud based object Internet that controls a home device by building virtualization software of a home device.

In order to achieve the above object, a system for collecting and processing home-device information using the Internet based on the cloud according to the present invention communicates with one or more home devices existing in a home, An assisting gateway for collecting information and collecting product information and device use mode information to continuously generate comprehensive information about one or more home devices existing in the home; A cloud server operating a cloud providing integrated application information processing services connected to a plurality of assist gateways. The cloud server continuously generates and analyzes the comprehensive information from the assist gateway to generate target advertisement data for the home device, And providing the advertisement data to an external advertisement server so that the advertisement server provides target advertisement contents based on the target advertisement data to the home device.

At this time, the assist gateway is configured to derive purchase point information about the home device by communicating with one or more home devices and to include it in the comprehensive information, and the cloud server collects the average lifecycle information of the home device, It is preferable that the first replacement prediction timing information of the home device is calculated based on the cycle information, and the life cycle information and the first replacement prediction timing information are included in the comprehensive information.

Also, the assist gateway may be configured to communicate with one or more home devices to collect repair information about a failure of the home device and to further include the repair information in the comprehensive information, and the cloud server may further include a second replacement prediction It is preferable that the time information is calculated and the second replacement prediction timing information is further included in the comprehensive information.

A method for collecting and processing a home device information using the Internet based on the cloud according to the present invention comprises the steps of: (a) collecting product information provided by a home device by communicating with one or more home devices in the home network; (b) the assist gateway collecting device usage information of the home device; (c) continuously generating comprehensive information about one or more home devices existing in the home by assisting gateway collecting product information and device usage mode information; (d) a cloud server operating a cloud connected to a plurality of assist gateways to provide an integrated application information processing service, continuously receiving comprehensive information from an assist gateway; (e) analyzing comprehensive information by the cloud server to generate target advertisement data for the home device; (f) providing the advertisement server with the target advertisement data so that the external advertisement server can provide the target advertisement contents to the home device.

The step of collecting the product information in step (a) includes the step of communicating with the home device to the assist gateway to derive the purchasing time information on the home device to include in the comprehensive information, Wherein the step of generating target advertisement data comprises the steps of: the cloud server collecting average lifecycle information of the home device; The cloud server calculating first replacement prediction timing information of the corresponding home device based on the purchase time point information and the life cycle information; And the cloud server includes the life cycle information and the first replacement prediction time information in the comprehensive information.

The step of collecting the product information in the step (a) further comprises the step of communicating with the home gateway to the assist gateway to collect repair information on the failure of the home device and to incorporate the repair information into the comprehensive information, e) the step of generating the target advertisement data further comprises the step of the cloud server calculating the second replacement predictive timing information of the home device based on the repair information and incorporating it into the comprehensive information.

According to the present invention, assist gateways installed in the home collect behavior patterns, interests, and preferences of broadcast contents naturally exposed at home, and deliver them to the cloud system. The cloud server analyzes information in individual homes and provides services The cloud server collects the information gathered from many assisting gateways first, collects information statistically by analyzing the information of all users, and provides meaningful information to the related service providers, thereby making it possible to configure the service that best suits the user's interests and preferences .

FIG. 1 is a diagram illustrating an overall configuration of a home device information collection and processing system using a cloud-based object Internet according to the present invention.
FIG. 2 is a flowchart illustrating a data processing process of a home device information collection and processing system using a cloud-based object Internet according to the present invention;
FIG. 3 is a flowchart illustrating a process in which an assist gateway collects home device rotor information and generates comprehensive information in a home device information collection system using the Internet based on the cloud according to the present invention. FIG.
FIG. 4 is a flowchart illustrating a method for collecting information on a home device according to an embodiment of the present invention. FIG. FIG. 6 is a flowchart showing a process of generating advertisement data;
FIG. 5 is a flowchart illustrating a process of providing target advertisement contents to a home-use home device based on target advertisement data generated in a home-device information collection processing system using the Internet based on the cloud according to the present invention.
FIG. 6 is a flowchart illustrating a process of grasping a behavior pattern of a user in a home device information collecting and processing system using the Internet based on the cloud according to the present invention, and remotely controlling the home device accordingly;
[7] FIG. 7 is a flowchart illustrating a process of establishing and managing a link with an external portal search server in a cloud server in the home device information collection system using the cloud-based object Internet according to the present invention.

Hereinafter, the present invention will be described in detail with reference to the drawings.

1 is a diagram illustrating an overall configuration of a home device information collecting and processing system using the Internet based on the cloud according to the present invention. Referring to FIG. 1, the system for collecting and processing home device information using the Internet based on the cloud according to the present invention includes an assist gateway 100 and a cloud server 200, and includes an external advertisement server 300, And a portal search server (not shown).

First, the assist gateway 100 is installed in the home and plays a role of collecting information (product information, device usage mode information, purchase time information, repair information) from various home devices of the home device group 400.

For this purpose, the assist gateway 100 communicates with one or more home devices existing in the home through a wireless network (e.g., short range wireless; wifi, zigbee, bluetooth) Mode information, point-of-purchase information) and device function. Then, these pieces of information are collected to continuously generate comprehensive information about the home-use home device and provided to the cloud server 200 to be described later.

Herein, the product information for the home device includes, for example, 'when the model of the refrigerator is a model, what is the name of the model, and the specification of the refrigerator.' Also, when a component of the refrigerator is repaired, Stored information '. That is, knowing the product information for the home device can also know the repair information for the home device.

Here, the 'device usage mode information' for the home device corresponds to, for example, 'the number of times that the refrigerator door is opened for one day is 100 times' or the 'individual time is taken every time the refrigerator door is opened'.

In addition, the assist gateway 100 internally implements a virtualization middleware layer (software stack) for realizing resource virtualization for various home devices existing in the home, and responds to remote control commands of the cloud server 200 The home device can be controlled.

The cloud server 200 is preferably an apparatus for operating a cloud connected to a plurality of syst gateways 100 through a wireless wide area network (WWAN) to provide an integrated application information processing service.

The cloud server 200 is continuously provided with comprehensive information about the home device from the assist gateway 100. The cloud server 200 classifies and analyzes the collected comprehensive information to extract device-specific characteristics, . When the generated target advertisement data is provided to the external advertisement server 300, the advertisement server 300 can provide target advertisement contents based on the targeted advertisement data to the home device.

Specifically, the cloud server 200 collects the average lifecycle information of the home device and calculates the first replacement prediction timing information of the corresponding home device based on the life cycle information and the purchase timing information received from the assist gateway 100 do. Further, the analysis capability of the cloud server 200 is improved by including the life cycle information and the first replacement prediction timing information in the comprehensive information.

In addition, the cloud server 200 calculates the second expected replacement timing information of the corresponding home device based on the repair information received from the assist gateway 100. The second replacement prediction timing information is further included in the comprehensive information to improve the analysis capability of the cloud server 200. [

On the other hand, the cloud server 200 analyzes a function utilization pattern regarding how the user uses the function for the home device from the collected usage history for each home device.

Also, a behavior pattern of a user for a plurality of home devices can be derived by performing a combination analysis through a functional utilization pattern for a plurality of home devices, for example, a pivot analysis tool.

On the other hand, the cloud server 200 receives a search history of an upper ranking and a search history by a home device from the assist gateway 100 in association with the individual home, accumulates the information, analyzes the information, Know your taste.

For example, according to the result of analyzing home appliances residing in a certain apartment complex in a certain area, a home device that can be exposed to a corresponding consumer segment for a consumer group purchasing the household appliances, And generates information that assists the advertisement server 300 in providing the set advertisement content, that is, target advertisement data.

Accordingly, the cloud server 200 individually generates target advertisement data for a certain target (e.g., home, apartment complex, administrative district, etc.) and provides the target advertisement data to the external advertisement server 300, And assists the target advertisement service through the data communication between the assist gateway 100 and the home device.

In addition, the cloud server 200 may generate a remote control command according to a health behavior management service, a home security management service, a user scheduling and an alarm service, and provide the remote control command to the assist gateway 100 based on a behavior pattern of the user. Since the assisted gateway 100 implements a virtualization middleware layer for resource virtualization, the home device can be controlled in response to a remote control command provided by the cloud server 200. [

Also, the cloud server 200 links an external portal search server (not shown) so as to utilize an external search engine, and receives an associated search word for the search history of the higher ranking from the portal search server. This is useful for extracting star search characteristics.

FIG. 2 is a flowchart illustrating a data processing process of a home device information collection system using a cloud-based object Internet according to the present invention.

Step S100: Cloud A plurality of assist gateways 100 are connected to collectively process data. Therefore, the cloud server 200 operating the cloud is preferably installed remotely via a wireless wide area network (WWAN) or wired / wireless Internet . (See Fig. 1)

Step S110: The assist gateway 100 establishes a wireless network (e.g., short range wireless; wifi, zigbee, bluetooth) data communication with a plurality of home devices existing in the home. The home device targeted by the present invention may be a smart TV, a wall pad, a media box, a wearable health care device, a smart pad, a smart phone, a smart watch, a Google glass (smart glass), a smart refrigerator, Cleaners, smart air conditioners, smart boilers, and smart electric cookers. These devices have a network connection function to establish a communication channel with the assist gateway 100 according to the present invention (refer to FIG. 1)

Step S120: The assist gateway 100 communicates with one or more home devices existing in the home, collects product information provided by the home device, and collects device usage information of the home device.

Then, the assist gateway 100 collects the product information and the device usage mode information, continuously generates comprehensive information about one or more home devices existing in the home, and provides the generated comprehensive information to the cloud server 200.

Steps S130 and S140: The cloud server 200 is a server operating a cloud connected to a plurality of assist gateways 100 to provide an integrated application information processing service, and is continuously provided with comprehensive information from the assist gateway 100 .

The cloud server 200 analyzes the comprehensive information provided from the assist gateway 100 to generate target advertisement data for the home device and provides the target advertisement data to the external advertisement server 300.

Step S150: The assist gateway 100 receives the targeted advertisement content from the advertisement server 300 and provides the targeted advertisement content to the home home device.

3 is a flowchart illustrating a process in which an assist gateway collects home device rotor information and generates comprehensive information in a home device information collection system using the Internet based on the cloud according to the present invention.

Steps S121 and S122: The assist gateway 100 communicates with at least one home device in the home to collect product information provided by the home device, and collects device usage mode information provided by the home device. For example, 'the number of times the refrigerator door is opened for 100 days' or 'the time when the refrigerator door is opened' corresponds to the usage information of the appliance.

Step S123: Subsequently, based on the product information provided by the assist gateway 100, the home device is analyzed from when the factory was shipped and when it was used to derive the purchase time information.

Step S124: Then, the assist gateway 100 collects repair information as to when the corresponding home device has been repaired by communication with the home device.

Step S125: Then, the assist gateway 100 continuously collects the product information, the device use mode information, the purchase time information, and the repair information for the home device to collect comprehensive information about the one or more home devices. And provides the generated comprehensive information to the cloud server 200 continuously.

FIG. 4 is a flowchart illustrating a method for collecting information on a home device according to an embodiment of the present invention. FIG. FIG. 5 is a flowchart illustrating a process of generating advertisement data. FIG.

Steps S131 and S132: The cloud server 200 continuously receives and analyzes the comprehensive information including the product information, the device usage mode information, the purchase time information, and the repair information from the assist gateway 100. [

Specifically, the cloud server 200 collects average lifecycle information for individual home devices from an external server based on product information received from the assist gateway 100. [ Then, based on the collected lifecycle information and the purchase point information received from the assist gateway 100, the first replacement prediction timing information for the corresponding home device is calculated.

Then, the cloud server 200 analyzes the comprehensive information by including the lifecycle information and the first replacement prediction timing information in the comprehensive information received from the assist gateway 100. [

Step S133: Furthermore, the cloud server 200 calculates the second replacement predictive timing information of the home device based on the repair information received from the assist gateway 100, and analyzes the comprehensive information by initially including it in the comprehensive information.

Step S134: The cloud server 200 generates the target advertisement data by including the life cycle information, the first and second replacement prediction time information and the comprehensive information continuously received from the assist gateway 100, Can be improved.

FIG. 5 is a flowchart illustrating a process of providing target advertisement contents to a home-use home device based on target advertisement data generated in a home-device information collection processing system using the Internet based on the cloud according to the present invention.

Steps S151 and S152: The advertisement server 300 generates target advertisement contents based on the target advertisement data received from the cloud server 200. [ Then, the advertisement server 300 generates target advertisement contents corresponding to the target region, device, and time zone, and transmits the target advertisement contents to the assist gateway 100 corresponding to the target region, device, and time zone.

Steps S153 and S154: The individual assist gateway 100 receives the target advertisement content from the advertisement server 300 and provides the target advertisement content to the corresponding home home device, in particular, a device having a display or audio function.

FIG. 6 is a flowchart illustrating a process of recognizing a behavior pattern of a user in a home device information collecting and processing system using the Internet based on the cloud according to the present invention and remotely controlling the home device accordingly.

Steps S200 and S210: First, the assist gateway 100 performs short-range wireless data communication with various home devices in the home, thereby collecting usage details of the device functions by the user.

The assistant gateway 100 collects information on when the user utilizes the function of the home device (i. E., Usage details), while the home device implements various functions according to its own use. At this time, the assist gateway 100 includes the collected usage history in the home activity information. Accordingly, the home activity information generated by the assist gateway 100 includes the search history and the usage history.

Step S220: The home activity information is transmitted to the cloud as described above. The cloud server 200 analyzes the 'function utilization pattern' for each home device from the usage history. For example, "Every Saturday from 6 pm to 7 pm, the smart TV channel is set to 11" is a function utilization pattern.

Step S230: Further, the cloud server 200 derives a behavior pattern of the user by combining the function utilization patterns for the plurality of home devices. For example, a behavior pattern of the user 'that the running signal is detected in the healthcare device and the video recording function is operated in the Google glass is performed after 10 minutes after playing the movie stored in the media box'.

 Step S240: The process of analyzing the function utilization pattern for each home device and deriving the behavior pattern of the user is cumulatively performed, and then the cloud server 200 verifies the behavior pattern of the user. Then, based on the verified behavior pattern, the cloud server 200 generates a remote control command for controlling the home device according to the health management service, the home security management service, the user scheduling, and the alarm service.

Steps S250 and S260: As described above, the assist gateway 100 internally implements a virtualization middleware layer for realizing resource virtualization for various home devices existing in the home. Accordingly, when the cloud server 200 provides the remote control command to the assist gateway 100, the assist gateway 100 remotely controls the home device in response to the remote control command through the internally implemented virtualization middleware layer.

FIG. 7 is a flowchart illustrating a process of establishing and managing a link with an external portal search server in a cloud device-based information gathering and processing system using the Internet based on the cloud according to the present invention.

Step S300: First, the cloud server 200 establishes a link capable of transmitting and receiving data with an external portal search server. The assist gateway 100 does not have sufficient information on the portal search server because the cloud server 200 is in charge of the external interface.

Steps S310 and S320: When the cloud server 200 receives the search history of the upper ranking generated by the assist gateway 100, the cloud server 200 transmits the search history of the corresponding upper ranking to the portal search server.

Step S330: The portal search server can inquire the database held therein to correspond to the search history of the upper ranking received in this way, and extract the associated search term. Then, the portal search server provides the extracted related search word to the cloud server 200.

Step S340: Accordingly, the cloud server 200 reflects the association query received from the portal search server in the extraction of search characteristics for each device. By reflecting the associated search term, the device-specific search characteristics extracted by the cloud server 200 can be configured more abundantly.

The present invention can also be embodied in the form of computer readable code on a computer readable recording medium. At this time, the computer-readable recording medium includes all kinds of recording apparatuses in which data that can be read by a computer system is stored.

Examples of the computer-readable recording medium include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage, and the like, and may be implemented in the form of a carrier wave . The computer-readable recording medium can also be stored and executed by a computer-readable code in a distributed manner on a networked computer system. And functional programs, codes, and code segments for implementing the present invention can be easily deduced by programmers skilled in the art to which the present invention belongs.

As described above, the embodiments of the present invention have been disclosed in the present specification and drawings, and although specific terms have been used, they have been used only in a general sense to easily describe the technical contents of the present invention and to facilitate understanding of the invention. And is not intended to limit the scope of the invention. It will be apparent to those skilled in the art that other modifications based on the technical idea of the present invention are possible in addition to the embodiments disclosed herein.

100: assist gateway
200: Cloud server
300: Ad server
400: home device group

Claims (7)

An assistant gateway 100 disposed in an individual home and collecting information on home devices in the home and providing resource virtualization for remote control and a plurality of assist gateways to analyze information gathered by the assist gateways, A home device information collection and processing system for providing a home service based on a user behavior pattern, comprising a cloud server (200) for operating a cloud providing an application information processing service,
The home device comprehensive information on the home is obtained by collecting and collecting the product information, the search history, the usage history, and the device usage mode information of the home devices through communication with a plurality of home devices located in the home, And a virtualization middleware for providing virtualization of resources of the home device, so as to control the home device through the virtual middleware in response to a remote control command provided from an external cloud server, A gateway 100;
Wherein the advertisement server provides target advertisement contents to the home device by generating target advertisement data for the home device by analyzing the home device comprehensive information provided from the assist gateway and providing the targeted advertisement data to an external advertisement server, Acquiring a function utilization pattern for each home device from use histories provided from an assist gateway, deriving a behavior pattern of a user for a home device by combining function utilization patterns for a plurality of home devices, Generating a remote control command for controlling the home device in accordance with at least one service among a health management service, a home security management service, and a user scheduling service, and providing the remote control command to the assist gateway, Virtualization middleware that way is provided with a cloud server 200 so as to correspond to perform a home device control to the remote control instruction;
And a home service based on a user behavior pattern through remote control based on a resource virtualization.
The method according to claim 1,
The assist gateway 100 derives the purchase time information for the home device by communicating with the plurality of home devices and further includes the information in the home device comprehensive information,
The cloud server 200 collects average life cycle information of the home device and calculates first replacement prediction timing information of the corresponding home device based on the purchase timing information and the life cycle information, Wherein the home device integrated information further includes first expected replacement time information of the home device based on the user behavior pattern using the cloud based object Internet and resource virtualization based remote control, Processing system.
The method of claim 2,
The assist gateway 100 communicates with the at least one home device to collect repair information about the failure of the home device and further include the repair information in the home device comprehensive information,
Wherein the cloud server (200) calculates the second replacement expected time information of the home device based on the repair information and further includes the second replacement expected time information in the home device comprehensive information A home device information collecting and processing system that provides a home service based on a user behavior pattern using the Internet and remote control based on resource virtualization. delete delete delete delete

Images