KR20180036068A - A system of controlling internet of things devices and a method for the same - Google Patents

Abstract

The present invention provides a system of controlling an internet of things (IoT) device. The system includes a cloud management server for collecting user health information and generating a control command for controlling an IoT device based on the collected user health information; a central controller for collecting user voice information, obtaining the user health information from a cloud management server based on the collected user voice information and providing it to the user, or generating a control command for controlling the IoT device; and a device controller for controlling the operation of the IoT device based on at least one of the control command generated by the cloud management server and the control command generated by the central controller. It is possible to control the IoT device using the user health information or user voice information.

Description

TECHNICAL FIELD [0001] The present invention relates to a control system for an Internet appliance,

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a control system and a control method of an object Internet appliance using user health information or user voice information.

2. Description of the Related Art In recent years, technologies for collecting user information using a wearable device such as a smart watch or a health band have been commercialized. Accordingly, the user can check the collected heart rate, body temperature, exercise amount, and emotion state using the device connected to the wearable device. However, until now, only the user confirms the collected user information (for example, heart rate, body temperature, exercise amount, etc.), but does not utilize the collected user information.

Therefore, it is required to develop various service plans and service providing technologies using the collected user information.

The present invention provides a control system and a control method of a stuff Internet device, specifically, a control system and a control method of a stuff internet device using user health information or user voice information.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are not restrictive of the invention, unless further departing from the spirit and scope of the invention as defined by the appended claims. It will be possible.

According to an aspect of the present invention, there is provided a system for collecting user health information, the system comprising: a cloud management server for collecting user health information and generating a control command for controlling the object internet appliance based on the collected user health information; A central controller for obtaining user health information from the cloud management server and providing the user health information to the user or generating a control command for controlling the object Internet appliance based on the user voice information and the control command generated by the cloud management server and the central controller And a device controller for controlling the operation of the object internet appliance based on at least one of the generated control commands.

Further, the present invention provides a control system for a stuff Internet apparatus, further comprising a sound device for recognizing user voice information and delivering the user health information to the central controller and the user health information received from the central controller to the user as voice information.

Also, the cloud management server provides at least one virtual machine for distributing collected health health information through a map deuce and then parallel processing the object health appliance.

Also, the user health information provides at least one of the heart rate, body temperature, the number of steps, blood glucose and blood pressure received from the wearable device.

According to another aspect of the present invention, a cloud management server collects user health information and generates a control command for controlling the object Internet appliance based on the collected user health information A step of collecting user voice information by the central controller, acquiring user health information from the cloud management server based on the collected user voice information and providing it to the user or generating a control command for controlling the object Internet appliance, and And controlling the operation of the object Internet appliance based on at least one of a control command generated by the cloud management server and a control command generated by the central controller by the device controller.

According to the control system and control method of the Internet appliance for objects according to the embodiment of the present invention, it is possible to determine whether or not the user is present in the vicinity of the user based on the health state or voice of the user through the collected user information, It is possible to increase the convenience of the user by controlling the Internet device.

The effects obtained by the present invention are not limited to the above-mentioned effects, and other effects not mentioned can be clearly understood by those skilled in the art from the following description will be.

1 is a block diagram illustrating a configuration of a control system for an Internet appliance according to an embodiment of the present invention.
FIG. 2 is a flowchart illustrating a control procedure of a control system of the Internet appliance according to an embodiment of the present invention. Referring to FIG.

Hereinafter, preferred embodiments according to the present invention will be described in detail with reference to the accompanying drawings. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The following detailed description, together with the accompanying drawings, is intended to illustrate exemplary embodiments of the invention and is not intended to represent the only embodiments in which the invention may be practiced. In order to clearly illustrate the present invention in the drawings, parts not related to the description may be omitted, and the same reference numerals may be used for the same or similar components throughout the specification.

In one embodiment of the present invention, the expressions " or ", " at least one ", etc. may denote one of the words listed together or may represent a combination of two or more. For example, " A or B ", " at least one of A and B " may include only one of A or B, and may include both A and B.

1 is a block diagram illustrating a configuration of a control system 200 for an Internet appliance according to an embodiment of the present invention.

1, a control system 200 of an Internet appliance according to the present invention includes a wearable device 10, an information collection agent 20, a cloud management server 30, a device controller 40, 50, a sound device 60, a central controller 70, a conversation server 80, an STT server 90, and a TTS server 100.

The wearable device 10 is worn by a user to collect user health information. The user health information may include heart rate, body temperature, number of steps, blood sugar, blood pressure, electrocardiogram, EMG, and oxygen saturation.

The wearable device 10 may transmit the collected user health information to the information collection agent 20.

The information collection agent 20 corresponds to a device connectable to a network, such as a smart phone, a router, and a router. The information collecting agent 20 may be connected to the wearable device 10 by wire or wirelessly to receive user health information. The information collecting agent 20 controls the listener (not shown) that receives the user health information from the wearable device 10 and the condition of the user health information measured by the wearable device 10 And a user information input unit (not shown). User health information can be divided into periodically measured information and information measured under certain conditions. For example, information that is periodically measured may include sleep start time, sleep end time, and total sleep time, and information measured under certain conditions may include heart rate, total steps, total exercise distance, total exercise calorie, This may be the average speed per minute, exercise time and altitude. The user can input a certain condition by using the user information input unit. For example, it is possible to control the heart rate, the number of steps, and the like to be measured at specific intervals and at specific times.

On the other hand, the function of the information collection agent 20 may be included in the wearable device 10. In this case, the wearable device 10 can directly transmit the collected user health information to the cloud management server 30.

The cloud management server 30 stores and manages user health information collected from the wearable device 10 or the information collection agent 20. [

Further, based on the collected user health information, a control command of the object Internet appliance can be generated. There are various internet devices such as smart TV, wall pad, media box, smart pad, smart refrigerator, smart washing machine, smart microwave, smart vacuum cleaner, smart air conditioner, smart boiler, smart electric cooker and lighting. And refers to a device in which a function, a drive, or the like can be controlled through a network.

For example, when the heart rate, the body temperature, the number of steps, and the like included in the collected user health information exceed a certain range, the cloud management server 30 may generate a control command for driving the smart fan or smart air conditioner.

In addition, the cloud management server 30 can recognize the user through a control command for driving the object Internet appliance including the surrounding speaker when the water level or the body temperature suddenly changes during the water surface or during the exercise.

The user can be entered through the user information input unit (not shown) of the wearable device 10 or the information collection agent 20 directly. Further, it is possible to designate that the user health information satisfies a certain condition as a state of being in the sleep or in the exercise.

Meanwhile, the cloud management server 30 needs to efficiently process collected user health information in relation to storing and managing a plurality of user health information measured by at least one wearable device 10. For this reason, the cloud management server 30 has a distributed parallel processing structure based on cloud virtual resources in order to manage long-term large-scale user health information.

The cloud virtual resource means a virtual machine provided by an infrastructure as a service (IaaS), and in this embodiment, the open stack is used, but the present invention is not limited thereto.

It utilizes Hadoop for MapReduce framework and Mahout, a machine learning library, for distributed parallel processing in virtual machines. The machine learning library of Mahau can be used to reprocess large-scale data and create additional services. For example, when data clustering is required, it is possible to provide a recommended service that provides the necessary algorithms to provide the application development necessary for data analysis, and recommends user information with good life pattern to other users by providing necessary algorithms .

The virtual machine can distribute stored user health information through MapReduce and then parallelize it. In particular, Hadoop is an Apache open source project that provides a distributed processing platform, providing a reliable and scalable environment. One of the key components of Hadoop, MapReduce provides a simple and intuitive interface for handling large amounts of data in a distributed environment.

For example, the number of times the abnormality such as blood pressure, blood sugar and heart rate among collected user health information can be accumulated and managed. In this case, in managing the cumulative number of times, the amount of information processing increases rapidly when the period is set differently on a daily basis or on a monthly basis, or when a large number of user health information is received. At this time, the cloud management server 30 can solve the load problem by processing the information on the cumulative number based on the MapReduce. In addition, it is possible to analyze the life pattern of many chronic disease patients, to check whether the health improvement is possible, and to analyze the data generated from the large-scale clinical trial subjects based on the MapReduce basis. In addition, the insurer can increase or decrease the insurance premium by analyzing the health management of the insured for the insured.

Specifically, the user health information accumulated in real time such as [heart rate 80], [body temperature 36], [heart rate 70], and [heart rate 75] can be classified using the map deuce. The MapReduce consists of a pair of keys and values, where the key corresponds to a measurement such as heart rate and body temperature, and the value can be specified by a measurement value. While performing the map operation, values having the same key are classified as [heart rate 80, 70, 75] [body temperature 36], and user health information can be integrated for each user through the redox operation.

The device controller 40 is connected to a plurality of object Internet devices by wire or wireless, and directly controls the device. That is, the control command generated by the cloud management server 30 is received, and the operation of the object Internet device is controlled according to the received control command.

The device controller 40 may manage each of the object internet devices individually or may integrate and manage the units through the object internet device hub 50. [

On the other hand, the device controller 40 or the object Internet appliance hub 50 includes the information collection agent 20 to receive the user health information directly from the wearable device 10 and to transmit the user health information to the cloud management server 30, So that the object Internet apparatus can be controlled without any control command.

The audio device 60 may include a microphone and a speaker to recognize voice information from the user or to provide voice information to the user. The audio equipment 60 may include an information collection agent 20 to receive user health information directly from the wearable device 10. [

The central controller 70 generates a control command for controlling the object Internet appliance and transmits the control command to the appliance controller 40 based on the user's voice information recognized by the audio appliance 60, Health information can be obtained and provided to the user.

When the user provides the user's voice information of " a little cold, but his body temperature is now " to the audio equipment 60, the central controller 70 collects body temperature information of the user stored in the cloud management server 30, The user can provide user health information such as " the body temperature is 36 degrees " through the sound device 60. Also, the central controller 70 can generate a control command for stopping the operation of the surrounding fan or the air conditioner, and transmit the control command to the device controller 40. The control command for increasing the set temperature of the surrounding boiler And transmit it to the device controller 40.

Specifically, when the user audio information is recognized by the audio device 60, the STT server 90 converts the user audio information into user text information. The converted user text information is transmitted to the central controller 70 and the central controller 70 transmits the user text information to the conversation server 80. [

The conversation server 80 extracts corresponding user text reply information in the user text information. Specifically, a response text suitable for the user text is searched for and provided. For example, when the user text information of " What is my body temperature is now " is received, the conversation server 80 reads text information corresponding to " And transfers it to the central controller 70 as user text reply information. The central controller 70 completes the "body temperature is 36 degrees" by combining the user's body temperature information "36" received from the cloud management server 30 and the user text reply information received from the conversation server 80, The TTS server 100 converts the user text reply information into user voice reply information and informs the user through the sound device 60 that the body temperature is 36 degrees.

FIG. 2 illustrates a control procedure of the control system 200 of the Internet appliance according to an embodiment of the present invention.

Referring to FIG. 2, the wearable device 10 connects wirelessly (e.g., WiFi, zigbee, Bluetooth) or wired to the information collecting agent 20 (S100). When the wearable device 10 and the information collection agent 20 are integrated, this can be omitted.

The user health information collected from the wearable device 10 is transmitted to the cloud management server 30 in real time via the information collection agent 20 in real time (S110).

When the user inquires about the health state by voice, the sound device 60 recognizes the user voice information (S120). The recognized user voice information is converted into user text information via the STT server 90 in step S130 and the converted user text information is transmitted to the conversation server 80 by the central controller 70. The conversation server 80 Retrieves and extracts the user text reply information corresponding to the user text information, and transmits the extracted user text reply information to the central controller 70 (S140).

The central controller 70 may receive the user health information requested from the converted user text information from the cloud management server 30 (S150). In addition, the central controller 70 may generate a control command to control the object Internet device according to the user text information and transmit the control command to the device controller 40 (S160).

The device controller 40 may directly control the object Internet appliance according to the control command received by the central controller 70 or may control the object internet appliance through the Internet appliance hub 50 in operation S170.

The central controller 70 combines the user text reply information received from the conversation server 80 with the user health information received from the cloud management server in step S180 and transmits the user text reply information to the TTS server 100, (S190), and the converted user voice reply information can be provided to the user through the audio device 60 as a voice.

The embodiments of the present invention disclosed in the present specification and drawings are merely illustrative examples of the present invention and are not intended to limit the scope of the present invention in order to facilitate understanding of the present invention. Accordingly, the scope of the present invention should be construed as being included in the scope of the present invention, all changes or modifications derived from the technical idea of the present invention.

10: wearable device 20: information collecting agent
30: cloud management server 40: device controller
50: Things Internet Device Hub 60: Sound Device
70: central controller 80: conversation server
90: STT server 100: TTS server
200: Control system of Internet devices

Claims (5)

A cloud management server for collecting user health information and generating a control command for controlling the object Internet appliance based on the collected user health information;
A central controller for collecting user voice information, acquiring user health information from the cloud management server based on the collected user voice information and providing the user health information to the user or generating a control command for controlling the destination Internet appliance; And
And a device controller for controlling the operation of the destination Internet device based on at least one of a control command generated by the cloud management server and a control command generated by the central controller. The method according to claim 1,
Further comprising a sound device for recognizing the user voice information and transmitting the user health information to the central controller, and for providing the user health information received from the central controller to the user as voice information. The method according to claim 1,
Wherein the cloud management server includes at least one virtual machine for distributing and collectively processing the collected user health information through MapReduce. The method according to claim 1,
Wherein the user health information includes at least one of heart rate, body temperature, number of steps, blood glucose and blood pressure received from the wearable device. Collecting user health information by the cloud management server and generating a control command for controlling the object Internet appliance based on the collected user health information;
Collecting user voice information by a central controller, acquiring user health information from the cloud management server based on the collected user voice information and providing the user health information to the user or generating a control command for controlling the destination Internet appliance ; And
And controlling, by the device controller, the operation of the object Internet appliance based on at least one of a control command generated in the cloud management server and a control command generated in the central controller.

Images