KR20200018989A - multi device system, AND CONTROL METHOD FOR THE SAME - Google Patents

Abstract

According to an embodiment of the present invention, disclosed is a multidevice system comprising: a user terminal which acquires emotion information of a user in order to easily transmit the emotion information of the user to a plurality of devices; a token which grants access to the emotion information of the user; a first device connected to the token to receive access to the emotion information of the user, receive the emotion information of the user, execute a function corresponding to the emotion information of the user, and generate and transmit a temporary virtual token; and a second device for receiving the temporary virtual token from the first device and receiving the emotion information of the user to execute the function corresponding to the user emotion information.

Description

Multi device system and its control method {multi device system, AND CONTROL METHOD FOR THE SAME}

The present invention relates to a multi-device system and a method of controlling the same, wherein a right to access emotion information of a user is transferred between a plurality of devices connected to each other.

Recently, devices equipped with artificial intelligence and responding to and acting on a user's emotion have emerged, and technologies for sharing and interacting with information among various devices have emerged. For example, there is an attempt to reflect the emotion of the user in the Internet of Things (IoT).

However, in a situation where various devices share data by sharing a network, a security vulnerability may occur, and a situation may arise in which user emotion information may be used differently from a user's intention. In addition, the user may feel anxiety and negative emotions if the user cannot control the object provided with the emotional information.

Therefore, even when operating a variety of devices based on the user's emotions, there is a need for a technology that allows users to have a choice in providing their own emotion information, and the user's emotion information among a plurality of devices connected to each other There is a need for techniques that are properly delivered.

One aspect is to provide a multi-device system and a control method thereof by selecting a device that the user can access his or her emotion information to prevent the user's emotion information from being used in a plurality of devices without the user's permission do.

Another aspect is a multi-device system that facilitates interaction between a user and a plurality of devices by transferring the emotion information of the user through an intermediary without having to add a separate device for recognizing the emotion of the user to each of the plurality of devices. And a control method thereof.

As a technical means for achieving the above technical problem, a multi-device system according to an embodiment, a user terminal for obtaining the user's emotion information, a token for granting access to the user's emotion information, the token and A first device connected to receive access to the emotion information of the user, receive the emotion information of the user, execute a function corresponding to the emotion information of the user, and generate and transmit a temporary virtual token; And a second device that receives the temporary virtual token from the first device, receives the user emotion information, and executes a function corresponding to the user emotion information.

In addition, the first device and the second device may be linked to form a group according to a preset criterion.

The first device may destroy the temporary virtual token held by the first device after transmitting the temporary virtual token to the second device.

In addition, the first device may transmit the temporary virtual token to the second device as the specific medium moves.

In addition, at least one of the user terminal, the first device, or the second device may include a camera, and the movement of the specific medium may be tracked using the camera.

The first device may transmit the temporary virtual token to the second device after the execution of the function of the first device is terminated and destroy the temporary virtual token held by the first device.

The second device may destroy the temporary virtual token held by the second device after the execution of the function of the second device ends.

The user terminal may control execution of functions of the first device and the second device corresponding to the emotion information of the user.

In addition, the multi-device system according to another embodiment, the user terminal for obtaining the user's emotion information, and generates a temporary virtual token for granting access to the user's emotion information in response to a user's request, from the user terminal Receiving the temporary virtual token and the emotion information of the user to execute a function corresponding to the emotion information of the user, receiving the temporary virtual token from the first device and the first device transmitting the temporary virtual token, And a second device that receives the user emotion information and executes a function corresponding to the user emotion information.

According to an embodiment of the present disclosure, a method of controlling a multi-device system includes: obtaining, by a user terminal, emotion information of a user, a token and a first device are connected, and granting the first device access to the emotion information of the user; And the first device receiving the emotion information of the user to execute a function corresponding to the emotion information of the user, generating and transmitting a temporary virtual token, and the second device to the temporary virtual token and the user. Receiving emotion information and executing a function corresponding to the user emotion information.

In addition, the first device and the second device may be linked to form a group according to a preset criterion.

The generating and transmitting of the temporary virtual token may further include erasing the temporary virtual token held by the first device after transmitting the temporary virtual token to the second device.

The generating and transmitting of the temporary virtual token may include transmitting the temporary virtual token to the second device according to the movement of a specific medium.

In the generating and transmitting of the temporary virtual token, after the execution of the function of the first device is terminated, the temporary virtual token is transmitted to the second device, and the temporary virtual token held by the first device is destroyed. It may further comprise the step of.

The control method of the multi-device system may further include erasing the temporary virtual token held by the second device after the execution of the function of the second device ends.

In another embodiment, a method of controlling a multi-device system includes: acquiring, by a user terminal, emotion information of a user and generating a temporary virtual token for granting access to the emotion information of the user according to a request of the user; Transmitting a temporary virtual token to a first device to give the first device access to the emotion information of the user, wherein the first device receives the emotion information of the user and corresponds to the emotion information of the user Executing a function, transmitting the temporary virtual token, and receiving, by the second device, the temporary virtual token and the user emotion information, and executing a function corresponding to the user emotion information.

In addition, the first device and the second device may be linked to form a group according to a preset criterion.

The transmitting of the temporary virtual token may further include transmitting the temporary virtual token to the second device, and then destroying the temporary virtual token held by the first device.

In addition, the transmitting of the temporary virtual token may include transmitting the temporary virtual token to the second device according to the movement of a specific medium.

The control method of the multi-device system may further include erasing the temporary virtual token held by the second device after execution of the function of the second device.

According to one aspect of a multi-device system and a control method thereof, by selecting a device that allows a user to access his or her emotion information, it is possible to prevent the user's emotion information from being used in a plurality of devices without the user's permission. have.

In addition, according to another aspect of the multi-device system and a control method thereof, a user and a plurality of devices may be transmitted by transmitting the user's emotion information through a medium without adding a separate device for recognizing the user's emotion in each of the plurality of devices. It has the effect of making the interaction easier.

1 to 4 are diagrams showing the configuration of a multi-device system according to each embodiment.
5 is a diagram illustrating an example of an implementation of a multi-device system according to an embodiment.
6 and 7 are flowcharts illustrating a control method of a multi-device system according to each embodiment.

Like reference numerals refer to like elements throughout. This specification does not describe all elements of the embodiments, and overlaps between the general contents or the embodiments in the technical field to which the present invention belongs. As used herein, the term 'part, module, member, block' may be implemented in software or hardware. According to embodiments, a plurality of 'part, module, member, block' may be embodied as one component. It is also possible that one 'part, module, member, block' includes a plurality of components.

Throughout the specification, when a part is said to be "connected" with another part, it includes not only a case where the part is directly connected, but also an indirect connection, and the indirect connection includes connecting through a wireless communication network. do.

In addition, when a part is said to "include" a certain component, which means that it may further include other components, except to exclude other components unless otherwise stated.

The terms first, second, etc. are used to distinguish one component from another component, and the component is not limited by the terms described above.

Also, the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting and / or limiting the disclosed invention. Singular expressions include plural expressions unless the context clearly indicates an exception.

In each step, the identification code is used for convenience of explanation, and the identification code does not describe the order of each step, and each step may be performed differently from the stated order unless the context clearly indicates a specific order. have.

Hereinafter, with reference to the accompanying drawings will be described the working principle and embodiments of the present invention.

1 to 4 are diagrams illustrating a configuration of a multi-device system according to each embodiment.

Referring to FIG. 1, the multi-device system 10 includes a token 100, a user terminal 200, and a plurality of devices 300.

The token 100 is for granting the electronic device 300 access to the emotion information of the user. Token 100 may be implemented in hardware or software. Hereinafter, the token implemented in software is defined as a temporary virtual token.

When the token 100 is implemented in hardware, the token 100 is connected to the first device 310 of the plurality of devices 300 to grant access to the emotion information of the user to the first device 310. Can be. Herein, 'connected' includes both a wired connection and a wireless connection, and may be understood as being paired between specific devices. That is, the token 100 may be connected to the electronic device 300 using near field communication. Short-range communication is a concept including all methods that can transmit and receive data between devices in a very close distance, such as Near Field Communication (NFC), Radio-Frequency Identification (RFID).

When the token 100 is connected to the first device 310, the token 100 may also be connected to the user terminal 200 to transmit a connection completion signal between the token 100 and the first device 300 to the user terminal 200. The token 100 may use various communication methods when connected to the user terminal 200. For example, in addition to NFC and RFID, Wi-Fi, Bluetooth, Zigbee, and Ultra-Wide Band (UWB) communication may be used.

When the token 100 is implemented in software, a temporary virtual token may be generated by the user terminal 200. That is, when the user requests, the user terminal 200 may generate a temporary virtual token and transmit the generated temporary virtual token to the first device 310. The first device 310 receives the token 100 to have access to the emotion information of the user. Generation and transmission of such a temporary virtual token may be performed by a specific application installed in the user terminal 200.

The user terminal 200 may be a device including a biosignal sensor, a camera, a communication unit, a storage unit, an output unit, and a controller. For example, the user terminal 200 may be implemented as a mobile terminal such as a smartphone, or may be implemented as a wearable device having a form of a watch, a hat, glasses, etc. worn on a part of the user's body.

The user terminal 200 obtains emotion information of the user. That is, when the user grants the first device 310 access to his emotion information using the token 100, the user terminal 200 sends the emotion of the user from the data collected by the biosignal sensor and the camera. Information can be obtained. In addition, the user terminal 200 transmits the acquired emotion information of the user to the first device 310.

The plurality of devices 300 are devices capable of performing various functions according to the emotion information of the user. The plurality of devices 300 refer to devices that form a group in association with each other according to a preset criterion. That is, the plurality of devices 300 may refer to devices that are functionally linked to each other or devices that are linked by a user's selection. In addition, the plurality of devices 300 may be devices connected according to the movement of a specific medium 311.

For example, a washing machine and a dryer are functionally linked devices, and the laundry needs to be washed in the washing machine and then dried in the dryer. Therefore, the washing machine and the dryer may be formed as a group for transmitting emotion information of the user. In addition, it can be seen that the laundry is linked to the laundry as a medium.

As another example, refrigerators, dishwashers, and cooking utensils may also be formed as a group. The carrots from the refrigerator are washed in a dishwasher and transferred to cooking utensils for cooking. That is, the refrigerator, the dishwasher, and the cooking utensils can be regarded as being functionally linked or linked according to the movement of food through the food.

As another example, an AI speaker, an image device, and an audio device may also be formed as a group. When a user requests execution of specific content using an AI speaker, an image device and an audio device for executing the content may be required. Therefore, the AI speaker, the video device, and the audio device can be regarded as being linked with a function of executing content or as the content moves through the medium.

As such, various devices may be linked together to form a group. The user may select a plurality of devices to be connected using the user terminal 200.

The first device 310 of the plurality of linked devices 300 is connected to the token 100 to receive access to the emotion information of the user, and is connected to the user terminal 200 to receive the emotion information of the user. . When the first device 310 receives the emotion information of the user, the first device 310 may execute a function corresponding to the emotion information of the user.

The first device 310 may generate a temporary virtual token and transmit it to the second device 320. The temporary virtual token is used to grant the second device 320 access to the emotion information of the user. That is, when the first device 310 transmits the temporary virtual token to the second device 320, the second device 320 may receive the emotion information of the user. After transmitting the temporary virtual token to the second device 320, the first device 310 deletes the temporary virtual token held by the first device 310. Even in a plurality of devices formed as a group, the user may feel anxious about holding the emotion information of the user in all the connected devices. Therefore, the device that has completed the function can solve the user's anxiety by making the user's emotion information inaccessible.

On the other hand, since the first device 310 is still connected with the token 100, the first device 310 retains access to the emotion information of the user until the connection with the token 100 is blocked.

When the second device 320 receives the temporary virtual token and the emotion information of the user, similarly to the first device 310, the second device 320 may perform a function corresponding to the emotion information of the user. When the function of the second device 320 ends, the temporary virtual token held by the second device 320 is also destroyed.

In FIG. 1, a plurality of devices 300 are shown to include a first device 310, a second device 320, and a third device 330, which may be connected to form a group. It is to show that there is. Similar to the second device 320, the third device 330 receives the temporary virtual token and the user emotion information, performs a function, and then deletes the temporary virtual token held.

Functions of the respective devices that may be performed corresponding to the emotion information of the user may be provided to the user as feedback information. That is, the user terminal 200 may output function information executable by each device in correspondence with the emotion information of the user.

In detail, when the emotion information of the user is a negative emotion such as an angry feeling or a sad emotion, the user terminal 200 provides feedback information on the function information of the plurality of devices 300 that can be executed to improve the user's emotion into a positive emotion. Can be generated and printed. For example, when the user's emotion is a depressive emotion and the plurality of connected devices 300 are a refrigerator, an IPTV, and a cooking utensil, the material, IPTV, which can be selected in the refrigerator to change the user's emotion into a pleasant emotion, is provided. Cooking broadcasts that can be reproduced and cooking methods available in the cooking utensils may be provided as feedback information.

When the user selects a specific function from among the function information executable by each device using the user terminal 200, the user terminal 200 may generate a control signal for performing the selected specific function and transmit it to each device. Each of the plurality of devices 300 receives a control signal and performs a corresponding function.

The temporary virtual token may be transmitted from the first device 310 to the second device 320 according to the movement of the specific medium 311. In other words, the medium 311 serves as a bearer of the temporary virtual token. In this case, the movement of the medium 311 may be tracked by a camera included in at least one of the user terminal 200, the first device 310, or the second device 320. The plurality of devices 300 formed as a group may share location information of the medium 311 by communicating with each other.

Referring to FIG. 2, the multi-device system 10 according to another embodiment includes a user terminal 200 and a plurality of devices 300. That is, the multi-device system 10 may not include the physical token 100.

In this case, a temporary virtual token may be generated by the user terminal 200. That is, when the user requests, the user terminal 200 may generate a temporary virtual token and transmit the generated temporary virtual token to the first device 310. The first device 310 receives the token 100 to have access to the emotion information of the user. Generation and transmission of such a temporary virtual token may be performed by a specific application installed in the user terminal 200.

In the case of FIG. 2, since the first device 310 is also granted access to the emotion information of the user through the temporary virtual token, when the temporary virtual token is transmitted to the second device 320, the first device 310 is provided. The temporary virtual token held by is destroyed.

Since the user terminal 200 generates a temporary virtual token and transmits the temporary virtual token to the first device 310, there is no difference from the configuration of FIG. 1, and thus redundant description will be omitted.

3 and 4, the multi-device system 10 according to another embodiment further includes a central controller 400 in addition to the token 100, the user terminal 200, and the plurality of devices 300.

1 and 2 illustrate that feedback information including function information of each device corresponding to emotion information of the user terminal 200 is generated and control signals for controlling the plurality of devices 300 are generated. .

3 and 4, however, the central controller 400 receives the emotion information of the user from the user terminal 200 to generate feedback information including the function information of each device corresponding to the emotion information of the user. The control signal for controlling the plurality of devices 300 may be generated to control the plurality of devices 300. The central control unit 400 may be a server provided separately for transmitting and receiving data with the plurality of devices 300.

3 and 4, when the central control unit 400 is separately provided, the development cost of the user terminal 200 may be reduced. Since there is no difference from the configuration of FIGS. 1 and 2 except for the central control unit 400, redundant description will be omitted.

5 is a diagram illustrating an example of an implementation of a multi-device system according to an embodiment.

Referring to FIG. 5, the first device 310 is a washing machine, the second device 320 is a dryer, and the medium 311 delivering a temporary virtual token is laundry.

The user connects the token 100 with the washing machine which is the first device 310 to grant access to the emotion information of the user to the washing machine, or generates a temporary virtual token using the user terminal 200 and then the first device. It can be transmitted to the washing machine (310).

The washing machine may receive the emotion information of the user and execute a function corresponding to the emotion information of the user. For example, if the user's emotion is a hasty feeling, the washing machine can operate in a fast washing mode. Alternatively, a function selected by the user from the feedback information provided by the user terminal 200 may be executed.

When the operation of the washing machine, which is the first device 310, is completed and the laundry, which is the medium 311, is transferred to the dryer, a temporary virtual token generated by the first device 310 or the user terminal 200 is transferred along the laundry. Is sent to the dryer, which is the device 320. When the laundry is put into the dryer, all the temporary virtual tokens held by the washing machine as the first device 310 and the laundry as the medium 311 are destroyed.

The dryer, which is the second device 320, may receive a temporary virtual token and emotion information of the user and execute a function corresponding to the emotion information of the user. For example, the user's emotion is a hasty feeling, so the dryer can operate in a quick drying mode.

When the operation of the dryer, which is the second device 320, is completed, the laundry is moved out of the dryer, and the temporary virtual token held by the dryer is destroyed.

6 and 7 are flowcharts illustrating a control method of a multi-device system according to each embodiment.

FIG. 6 is a flowchart illustrating a control method when the multi-device system 10 includes a token 100, a user terminal 200, and a plurality of devices 300.

Referring to FIG. 6, the token 100 and the first device 310 are connected (510). The token 100 grants the first device 310 access to the emotion information of the user. In addition, the user terminal 200 obtains the emotion information of the user and transmits it to the first device 310 (520). The first device 310 executes a function of the first device 310 corresponding to the emotion information of the user (530). Thereafter, the first device 310 generates a temporary virtual token and transmits it to the second device 320 (540). The second device 320 receives the temporary virtual token and the emotion information of the user, and executes a function corresponding to the emotion information of the user (550). When the execution of the function of the second device 320 is completed, the temporary virtual token held by the second device 320 is destroyed (560).

FIG. 7 is a flowchart illustrating a control method when the multi-device system 10 includes a user terminal 200 and a plurality of devices 300.

Referring to FIG. 7, the user terminal 200 obtains emotion information of the user, generates a temporary virtual token, and transmits the temporary virtual token to the first device 310 (610). The first device 310 receives a temporary virtual token and emotion information of the user and executes a function of the first device 310 corresponding to the emotion information of the user (620). When the function execution of the first device 310 is completed, the first device 310 transmits the temporary virtual token and the user's emotion information to the second device 320 (630). At this time, the temporary virtual token of the first device 310 is destroyed. The second device 320 receives the temporary virtual token and the emotion information of the user to execute a function of the second device 320 corresponding to the emotion information of the user (640). Thereafter, when the execution of the function of the second device 320 is completed, the temporary virtual token held by the second device 320 is destroyed (650).

As described above, according to the multi-device system and a method of controlling the same, an effect of preventing the user's emotion information from being used in a plurality of devices without the user's permission by selecting a device that allows the user to access his / her emotion information has an effect. have.

In addition, it is possible to facilitate interaction between the user and the plurality of devices by transmitting the emotion information of the user through a medium without adding a separate device for recognizing the emotion of the user to each of the plurality of devices.

On the other hand, the disclosed embodiments may be implemented in the form of a recording medium for storing instructions executable by a computer. Instructions may be stored in the form of program code, and when executed by a processor, may generate a program module to perform the operations of the disclosed embodiments. The recording medium may be embodied as a computer-readable recording medium.

Computer-readable recording media include all kinds of recording media having stored thereon instructions which can be read by a computer. For example, there may be a read only memory (ROM), a random access memory (RAM), a magnetic tape, a magnetic disk, a flash memory, an optical data storage device, and the like.

As described above, the disclosed embodiments have been described with reference to the accompanying drawings. Those skilled in the art will understand that the present invention can be implemented in a form different from the disclosed embodiments without changing the technical spirit or essential features of the present invention. The disclosed embodiments are exemplary and should not be construed as limiting.

10: Multi-Device System
100: Token
200: user terminal
300: multiple devices
310: first device
311: Media
320: second device
330: third device

Claims (20)

A user terminal for obtaining emotion information of a user;
A token for granting access to the emotion information of the user;
A first device connected to the token to receive access to the emotion information of the user, receive the emotion information of the user, execute a function corresponding to the emotion information of the user, and generate and transmit a temporary virtual token ; And
And a second device that receives the temporary virtual token from the first device, receives the user emotion information, and executes a function corresponding to the user emotion information. The method of claim 1,
The first device and the second device,
A multi-device system that forms a group in association with a preset criterion. The method of claim 1,
The first device,
And transmitting the temporary virtual token to the second device, and then destroying the temporary virtual token held by the first device. The method of claim 1,
The first device,
And transmitting the temporary virtual token to the second device as the specific medium moves. The method of claim 4, wherein
At least one of the user terminal, the first device or the second device includes a camera,
Multi-device system for tracking the movement of the specific medium using the camera. The method of claim 1,
The first device,
And after the execution of the function of the first device ends, transmitting the temporary virtual token to the second device, and extinguishing the temporary virtual token held by the first device. The method of claim 1,
The second device,
And after the execution of the function of the second device ends, destroying the temporary virtual token held by the second device. The method of claim 1,
The user terminal,
And controlling the execution of functions of the first device and the second device corresponding to the emotion information of the user. A user terminal for acquiring user's emotion information and generating a temporary virtual token for granting access to the user's emotion information according to a user's request;
A first device that receives the temporary virtual token and the emotion information of the user from the user terminal, executes a function corresponding to the emotion information of the user, and transmits the temporary virtual token; And
And a second device that receives the temporary virtual token from the first device, receives the user emotion information, and executes a function corresponding to the user emotion information. Obtaining, by the user terminal, emotion information of the user;
Connecting a token to a first device and granting access to the emotion information of the user to the first device;
Receiving, by the first device, the emotion information of the user, executing a function corresponding to the emotion information of the user, and generating and transmitting a temporary virtual token; And
And receiving, by the second device, the temporary virtual token and the user emotion information, and executing a function corresponding to the user emotion information. The method of claim 10,
The first device and the second device,
Control method of a multi-device system to form a group in association according to a predetermined criterion. The method of claim 10,
Creating and transmitting the temporary virtual token,
Transmitting the temporary virtual token to the second device, and then destroying the temporary virtual token held by the first device. The method of claim 10,
Creating and transmitting the temporary virtual token,
And transmitting the temporary virtual token to the second device according to a movement of a specific medium. The method of claim 10,
Creating and transmitting the temporary virtual token,
Transmitting the temporary virtual token to the second device after the execution of the function of the first device, and extinguishing the temporary virtual token held by the first device. The method of claim 10,
And after the execution of the function of the second device is terminated, destroying the temporary virtual token held by the second device. Obtaining, by the user terminal, the emotion information of the user, and generating a temporary virtual token for granting access to the emotion information of the user according to a request of the user;
Transmitting the temporary virtual token to a first device to give the first device access to the emotion information of the user;
Receiving, by the first device, the emotion information of the user, executing a function corresponding to the emotion information of the user, and transmitting the temporary virtual token;
And receiving, by the second device, the temporary virtual token and the user emotion information, and executing a function corresponding to the user emotion information. The method of claim 16,
The first device and the second device,
Control method of a multi-device system to form a group in association according to a predetermined criterion. The method of claim 16,
The step of transmitting the temporary virtual token,
Transmitting the temporary virtual token to the second device, and then destroying the temporary virtual token held by the first device. The method of claim 16,
The step of transmitting the temporary virtual token,
And transmitting the temporary virtual token to the second device according to a movement of a specific medium. The method of claim 16,
And after the execution of the function of the second device is terminated, destroying the temporary virtual token held by the second device.

Images