KR20180013570A - A method and system of Robot Service for controlling things in the home and communicating with a family - Google Patents

Abstract

The present invention provides a system and a method for providing a robot service. The system is connected to a plurality of user terminals, a plurality of IoT devices installed in home of a user, a robot installed in the home of the user, and a service server through a network so as to collect information of the IoT device through the robot, and to transmit the collected information to the service server. Therefore, the user terminal can check the collected information by accessing the service server, and can request a control message of the IoT device and image information in the home to the robot through the service server based on displayed information.

Description

Technical Field [0001] The present invention relates to a robot service system and a method for controlling a robot,

The present invention relates to a service system and method for communicating with a family using a nearby Internet (Things) device.

In recent years, there have been various Internet appliances capable of data communication by attaching Internet functions to objects such as sensors, appliances, and switches for measuring temperature, humidity, and illuminance. This device can provide measurement information or control information through internet communication and has a function to reflect the control signal based on the information.

Therefore, these days, it is possible to provide living convenience services such as a living space management service, a power consumption management service, and a crime prevention service by using the Internet device in the house.

And, as the function of objects is expanded on the basis of Internet communication, it is possible to communicate intelligently between people and objects, objects and objects. For example, the SNS service, which is mainly used to build relationships among people, can exchange information between objects and objects, and can provide and process services as objects as well as people.

In addition, the number of members who are becoming family members is gradually decreasing. Nowadays, it is demanding the technology that considers the feeling of being able to give a feeling of being friendly with the convenience of living, and the emotional service that enables the robot to feel as a member of the family, It is time to look for ways to combine life convenience services.

Patent Application No. 10-2014-0011073 (Service System using Internet of Things) Patent Application No. 10-2014-0029517 (Smart Home Solution)

The present invention reflects the above-mentioned demands. It reflects the lifestyle of the family that is always living in the house, so that the robot can replace the work that the person can do, or inform the information of the house, The present invention also provides a robot service system and method that can provide convenience of living and communication between a family member who lacks a robot even if there is no person at home.

Here, the service provided by the robot system is a service for controlling the power of objects based on the information collected from the Internet of Things devices, a service for informing the family using the collected information on the SNS, A service for recognizing a member by checking the registration number of a beacon, a service for playing voice mail to a recognized family member, and a service for monitoring the home using a camera installed in the robot.

In order to achieve this object,

According to an aspect of the present invention, there is provided a system for connecting a plurality of user terminals, a plurality of IoT devices installed in the user's home, a robot installed in the user's home, and a service server through a network, IoT device, and transmits the collected information to the service server. The user terminal can confirm the collected information by connecting to the service server, and based on the posted information, And requests the robot to transmit the control message and the image information in the groove through the service server.

The IoT device may further include a smart switch connected to a power plug of various home appliances in the groove, a smart sensor capable of measuring indoor environmental information such as temperature, humidity, and illumination in the groove, And a beacon module capable of detecting family members.

The robot includes a robot communication unit for transmitting / receiving data through network communication with IoT devices and service servers in respective homes, and a robot communication unit for transmitting information collected from each IoT device according to the format of the data according to the IoT device (Storing / modifying / deleting / inquiring) the unique identifier of the IoT device installed in each home, or controlling the IoT device according to a request of the service server, or collecting it through the object information collector An IoT controller for transmitting the information to the service server via the robot communication unit, and a camera controller for turning on / off or zooming the mounted camera, the camera, or rotating or adjusting the angle of the camera. And a robot management unit for providing image information photographed while moving indoors to the service server .

Also, the object information collecting unit may include a smart sensor collecting unit for storing indoor environmental information such as room temperature, humidity, and illuminance collected through the smart sensor, and on / off information of the smart switch collected through the smart switch. And a beacon collecting unit for confirming the family member information currently sensed in the house through the beacon module.

The IoT control unit may include a smart switch control unit for receiving the smart switch control request requested by the user terminal through the service server and controlling on / off of the smart switch, A smart switch control unit which is provided through the service server and controls the cold / hot room apparatus, the humidity apparatus, and the illuminance apparatus interlocked with the smart sensor on / off, or by a predetermined temperature, humidity or illumination; And a beacon control unit for receiving the beacon information from the beacon collecting unit through the service server and identifying a family member of the home based on the information of the beacon collecting unit and providing a voice or text message to the corresponding member terminal.

In addition, the service server may include: a web server including a server communication unit for transmitting and receiving data with the user terminal and the robot, and a service management unit for providing a user authentication procedure and a smart home based robot service; A session relay server for registering robots in each household having one or more households and managing sessions for the robots; A database for receiving and storing IoT device collection information from the robot received through the server communication unit; And a streaming server for processing image information received through the server communication unit.

According to another aspect of the present invention, there is provided a robot service method in a system in which a plurality of user terminals, a plurality of IoT devices installed in the user's home, a robot installed in the user's home, and a service server are connected via a network, Collecting the information of the IoT device through the robot and transmitting the collected information to the service server; checking whether the user terminal is connected to the service server and collecting the collected information; And the user terminal requests the control message of the IoT device and the image information in the groove through the service server to the robot.

If the IoT device is operating, the robot starts to receive the information. Then, the robot classifies the type of the IoT device of the collected information and transmits the processed information to the service server Processing the information of the smart switch if the IoT device of the collected information is a smart switch, processing information of the smart sensor if the smart sensor, and processing beacon information if the IoT device is the beacon module.

Also, the beacon information processing may collect the beacon's unique number from the beacon module recognized in the home based on the beacon number registered in advance by the family member, compare it with the registered beacon number of the family, Determining whether a person is present in the house through the camera, determining whether the beacon is not recognized, recognizing the beacon number, and determining whether the beacon is not a family member.

The method may further include accessing a web server through the user terminal, confirming the information of the IoT device already collected and posted by the robot through the SNS, selecting an IoT device requiring control, Controlling the smart switch if the requested control message is a smart switch, controlling the smart sensor if the smart sensor is a smart sensor, and controlling beacon information if the requested control message is a smart switch, and controlling the beacon information, Recording the voice in the user terminal to the family member identified through the unique number, storing the voice in the database through the service server, and receiving and reproducing the voice mail through the web server and the session relay server through the session relay server .

According to the present invention, even if a person is not at home, it is possible to communicate with the robot through the user's terminal, thereby controlling the power of the home appliance as well as the change in temperature, humidity and illumination. Service can be provided.

Through this, it is possible to provide a service that approaches people more positively in a time when the size of the family is getting smaller through convenient service of life and emotional service which is needed more when being alone at home.

1 is a diagram showing a configuration of a service system in which a robot in a house controls an IoT device and communicates with a user terminal,
FIG. 2 is a view showing a configuration corresponding to each function of the robot in FIG. 1;
FIG. 3 is a diagram illustrating a configuration corresponding to a robot service server in FIG. 1;
FIG. 4 is a flowchart showing a process of collecting and processing information about the IoT device in the house through the system of FIG. 1; FIG.
FIG. 5 is a flowchart showing a process of confirming and controlling information about a user's IoT device through the system of FIG. 1;
FIG. 6 is a flowchart illustrating a process of transmitting an image of a home using a camera equipped with a robot at the request of a user through the system of FIG. 1;
FIG. 7 is a flowchart showing a process of requesting a robot to a home by a user through the system of FIG. 1;
FIG. 8 is a flowchart illustrating a process in which a session relay server communicates with a user and a robot through the system of FIG. 1. FIG.

BRIEF DESCRIPTION OF THE DRAWINGS The advantages and features of the present invention, and how to accomplish it, will be described with reference to the embodiments described in detail below with reference to the accompanying drawings. However, the present invention is not limited to the embodiments described herein but may be embodied in other forms. The embodiments are provided so that those skilled in the art can easily carry out the technical idea of the present invention to those skilled in the art.

In the drawings, embodiments of the present invention are not limited to the specific forms shown and are exaggerated for clarity. In addition, like reference numerals designate like elements throughout the specification.

The singular forms herein include plural forms unless the context clearly dictates otherwise. Also, components, steps, operations and elements referred to in the specification as " comprises "or" comprising " refer to the presence or addition of one or more other components, steps, operations, elements, and / or devices.

Hereinafter, a robot system and a service procedure for a smart home service according to a preferred embodiment of the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram of a smart home based robot service system according to a preferred embodiment of the present invention.

1, a robot service system according to the present invention includes at least one user terminal 400, a plurality of Internet (IoT) devices 300 in a home (home), a robot 100, and a robot service server 200 ). The system collects the information of a plurality of IoT devices 300 in the home via the robot 100 and transmits the collected information to the robot service server 200. The user terminal 400 transmits the collected information to the robot service server 200, (200) to confirm the collected information. Based on the posted information, the user terminal 400 is configured to be able to request control of the home IoT device 300 and the home image information from the robot 100 through the robot service server 200.

Here, the Internet (IoT) device 300 is installed in a home (home) of a smart home based robot service subscriber (hereinafter referred to as a user) according to the present invention, and attaches a small communication module and a computer , And devices capable of communication and data processing. Through the Internet device 300, the indoor environment can be managed, the power control can be managed, or the family members in the house can be checked by detecting changes in temperature, humidity, illumination and the like in the user's home. The smart Internet device 300 includes a smart switch 310 connected to a power plug of various home appliances in a home, a smart sensor 320 capable of measuring indoor environment information such as temperature, humidity, A beacon module 330 that can detect a family member in the house based on Bluetooth, and the like.

In addition, the object Internet device 300 and the robot 100 may be connected to each other through a short-range wireless communication network. For example, when a short distance wireless communication module such as an NFC chip or a Bluetooth module is embedded in the object Internet device 300 and a wireless communication module (or an application program) that implements an NFC function or a Bluetooth function is installed, The unique identification number is recognized.

The robot 100 and the user terminal 400 and the robot service server 200 are connected to each other through a network communication network to perform a smart home based robot service function. Here, the communication network includes a wired / wireless communication network. Examples of the wireless communication network include a wireless LAN (WLAN), a Bluetooth, a Radio Frequency Identification (RFID), a ZigBee, , A wireless mobile broadband service (WMBS), and the like. The wired communication network may include a power line communication (PLC), a USB communication, an Ethernet, a serial communication, and an optical / coaxial cable.

 In addition, the user terminal 400 includes all devices capable of web browsing, such as a mobile terminal, a smart phone, and the like, as well as a computer, a notebook, and a personal portable terminal.

In addition, the server providing the robot service according to the present invention may be provided in the form of a web server. In general, the web server is a system in which, in a communication environment using a network such as the Internet, The operation and operation of the server are not so different from those of a conventional web server, so a detailed description of the web server will be omitted. At this time, a user ID, a password, a public certificate, and the like may correspond to the user account information for logging into the web page through the user terminal 400. [ In addition, the server 200 may further include a database (DB) for storing the data of the object Internet device provided from the robot 100 and the multimedia data photographed in the home provided by the robot.

Accordingly, the user provides the control command or the intra-home indoor information request message to the server 200 through the user terminal 400 to remotely control the robot in the home, and then, from the server 200, Internal video information, indoor information, and the like. At this time, multimedia data such as moving pictures can be provided as a streaming service through a streaming server.

2 is a functional block diagram showing the configuration of the robot 100 in the system of FIG.

Referring to FIG. 2, the robot 100 may be installed in each home, and may be configured to be fixed or movable. The robot 100 includes a robot communication unit 110 for transmitting / receiving data to / from the home IoT devices 300 and the robot service server 200 via network communication, An object information collecting unit 120 for receiving and storing information collected from each object Internet apparatus in accordance with the format of data, a unique identifier management (storage / modification / deletion / inquiry) of the IoT apparatus 300 installed in each home The robot I / F 120 transmits information collected through the object information collecting unit 120 to the robot service server 200 through the robot communication unit 110, And a camera controller 142 for turning on / off or zooming the camera unit 141, or rotating or adjusting the angle of the camera unit 141, if And a robot managing unit 140 that provides the photographed image information to the robot service server 200.

The object information collecting unit 120 includes a smart sensor collecting unit 121 that stores indoor environmental information such as room temperature, humidity, and illumination collected through the smart sensor 320, A smart switch collecting unit 122 for storing on / off information of the collected smart switch, and a beacon collecting unit 123 for confirming the family member information currently sensed in the house through the beacon module 330.

The IOT control unit 130 includes a smart switch control unit 132 for controlling the on / off operation of the smart switch by receiving the smart switch control request requested by the user terminal 400 through the robot service server 200, A humidity sensor or an illuminance device interlocked with the smart sensor, which is received through the robot service server 200 and is controlled by the temperature, the humidity or the illuminance, The switch control unit 132 and the user terminal 400 through the robot service server 200 and confirms the family members of the home based on the information of the beacon collection unit 122, And a beacon control unit (not shown) for providing voice or text messages to the terminal.

At this time, the control structure of the robot management unit 140 or the IOT control unit 130 may be implemented by a hardware circuit (for example, a CMOS-based logic circuit), firmware, software, or a combination thereof. For example, it can be implemented utilizing transistors, logic gates, and electronic circuits in the form of various electrical structures. It can also be implemented by software such as application programs (apps), application software, and computer programs.

3 is a functional block diagram of the robot service server 200 in the robot service system of FIG.

3, when the server 200 receives a request message from one of the plurality of user terminals 400, the server 200 receives the collection information of the IoT device 300 in the smart home from the robot 100, And provides collection information using the robot 100 corresponding to the user request information to the user terminal 400. [ At this time, the server 200 listens to the user terminals 400 as a web server 220, provides a user authentication procedure and a service page according to the connection of the user terminals 400, ) To perform the procedure for account registration.

For example, the robot service server 200 includes a server communication unit 221 for transmitting and receiving data to and from the user terminal 400 and the robot 100, and a service management unit 222 for providing a user authentication procedure and a smart home- A session relay server 210 for registering robots 100 in each household or more than one household and managing a session for each robot 100; A database 230 for receiving and storing the IoT device collection information from the robot 100, and a streaming server 240 for processing image information received through the server communication unit.

The server communication unit 210 transmits and receives data to and from the user terminal 400 or the robot 100. The server communication unit 210 receives request data from the user terminal 400 and transmits the request data to the robot 100 Thereby enabling remote control.

Also, it is possible to provide a service for transmitting an image to the user terminal 400 through the streaming server 240 by capturing an image through a camera mounted on the robot.

In addition, the service management unit 222 manages user authentication, user information storage / modification / deletion, login information management, management and registration using the unique identification number of the robot, etc. at the request of the user terminal 400 Can be performed.

The service management unit 222 collects information of a plurality of IoT devices 300 in the home through the robot 100 according to a request of the user terminal 400 and receives the collected information to connect to the server 200 And provides the collected information to the requested user terminal 400 so that it can be confirmed. In response to the request of the user terminal 400, based on the posted information, the control of the home IoT device 300 and the home image information can be requested to the robot 100 to enable remote control.

Hereinafter, a smart home-based robot service process according to the present invention will be described in detail with reference to FIGS. 4 to 8 using the robot service system of FIGS. 1 to 3. FIG.

FIG. 4 is a flowchart illustrating a process in which the robot 100 collects and transmits information of the IoT device 300 in the smart home-based robot service process according to the present invention.

4, when the IoT device 300 is operating (S410), the robot 100 starts to receive (S420), and when the collected Information on the IoT device 300, and transmits the processed information to the robot service server 200 (S430).

If the IoT device 300 of the collected information is a smart switch, information of the smart switch is processed (S440). If the collected information is a smart sensor, information of the smart sensor is processed (S450) ).

At this time, the beacon information processing (S460) collects the beacon unique number from the beacon module recognized in the home based on the beacon number registered in advance by the family member, and compares the beacon unique number of the registered family with the beacon unique number of the registered family, , And can be identified as a family member. Then, it is possible to check whether there is a person in the house through the camera, whether the beacon is not recognized, or the beacon number is recognized and the family is not recognized.

5 is a flowchart illustrating a process in which a user terminal 400 accesses a robot service server 200 and requests control of the IoT device 300 in a smart home based robot service process according to the present invention.

The user accesses the web server through the user terminal 400 in step S510 and confirms the information of the IoT device 300 already collected and posted by the robot 100 through the SNS in step S520. The device 300 may be selected and a necessary control message may be requested through the web server 220 or the session relay server 210 in operation S530.

If the requested control message is a smart switch, the smart switch is controlled (S540). If the requested control message is a smart switch, the smart sensor is controlled (S550).

At this time, the beacon information control (S560) records the voice from the user terminal (400) to the family member identified through the beacon number, stores the voice in the database (230) through the robot service server (200) The robot 100 is able to receive and reproduce the information through the web server 200 and the session relay server 210. [

6 and 7 are diagrams for explaining a case where the user terminal 400 accesses the robot service server 200 and requests the robot 100 for the house image data in the smart home based robot service process, And a process of processing the video data request.

Here, the robot 100 captures an image through a camera and encodes the image through a moving image compression module (S610). The compressed image is uploaded to a predetermined storage of the robot service server in response to a user-provided request (S620) S630). When the URL of the corresponding image is transmitted to the server, the server posts the URL to the SNS (S640).

Then, the user terminal 400 can select a URL and confirm the image received through the streaming server 240 through the player of the user terminal (S710 to S730).

8 is a flowchart illustrating a process of providing a smart home based robot service according to the present invention when the robot service server 200 receives control or request information from the user terminal 400 and transmits the control or request information to the robot 100, Collecting or processing information, and transmitting the collected or processed information to the user terminal 400. FIG.

Here, the server 200 stores the information coming from the robot 100 in the database 230, and posts the corresponding information through the SNS service through the web server 220 (S810). The robot service server 200 checks the SNS confirmation request or control request information from the user terminal 400 in step S820 and transmits a control command to the robot 100 in the user's home through the session relay server 210 .

Accordingly, if there is an SNS confirmation request, the robot service server 200 confirms the SNS publication if there is the collected information of the IoT device 300, and the user terminal 400 confirming the SNS publication confirms the control information of the IoT device, (S830 to S840).

In step S850, the robot service server 200 transmits control information of the received IoT device to the robot 100 to remotely control the robot.

The present invention has been described above with reference to the embodiments. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. Therefore, the disclosed embodiments should be considered in an illustrative rather than a restrictive sense. Therefore, the scope of the present invention is not limited to the above-described embodiments, but should be construed to include various embodiments within the scope of the claims and equivalents thereof.

100: Robot
200: Robot service server
300: IoT device
400: User terminal
110: robot communication section
120: Object information collecting section
130: IoT control section
140: Robot management part
210: Session Relay Server
220: Web server
230: Database
240: Streaming server
310: Smart Switch
320: Smart sensor
330: Beacon module

Claims (10)

A system comprising: a plurality of user terminals; a plurality of IoT devices installed in the user's home; a robot installed in the user's home; and a system in which a service server is connected via a network,
Collecting information of the IoT device through the robot, transmitting the collected information to the service server,
The user terminal can confirm the collected information by connecting to the service server, and based on the posted information, the user terminal sends the control message of the IoT device and the image information in the home to the robot via the service server Wherein the robot service system comprises:
The method according to claim 1,
The IoT device includes a smart switch connected to a power plug of various home appliances in the groove,
A smart sensor capable of measuring indoor environmental information such as temperature, humidity, and illumination in the groove,
And a beacon module capable of detecting a family member in the home based on Bluetooth.
The method according to claim 1,
The robot includes:
A robot communication unit for transmitting / receiving data through network communication with IoT devices and service servers in each home,
An object information collecting unit for receiving and storing the information collected by each IoT device in accordance with the format of data according to the IoT device,
(Storing / modifying / deleting / inquiring) the IoT devices installed in each home, or controlling the IoT device according to the request of the service server or transmitting the information collected through the object information collecting unit to the service server An IoT control unit,
And a camera controller for turning on / off or zooming in the camera, rotating the camera, or adjusting the angle of the camera, wherein the robot management unit provides image information photographed while moving indoors at a predetermined cycle to the service server The robot service system comprising:
3. The method according to claim 2 or 3,
The object information collecting unit may include a smart sensor collecting unit that stores indoor environmental information such as room temperature, humidity, and illuminance collected through the smart sensor,
A smart switch collecting unit for storing on / off information of the smart switch collected through the smart switch,
And a beacon collecting unit for confirming the family member information currently sensed in the house through the beacon module.
The method according to claim 2 or 3,
The IoT control unit
A smart switch control unit for receiving the smart switch control request requested by the user terminal through the service server and controlling on / off of the smart switch;
A smart switch control unit which receives the smart sensor control request requested by the user terminal through the service server and turns on / off a cold / hot room apparatus, a humidity apparatus, and a lighting apparatus interlocked with the smart sensor or controls the temperature / humidity / Wow,
A beacon controller for receiving a member confirmation request requested by the user terminal through the service server, identifying a family member of the home based on the information of the beacon collecting unit, and providing a voice or text message to the member terminal, Robot service system. The method according to claim 1,
The service server,
A web server including a server communication unit for transmitting and receiving data with the user terminal and the robot, and a service management unit for providing a user authentication procedure and a smart home based robot service;
A session relay server for registering robots in each household having one or more households and managing sessions for the robots;
A database for receiving and storing IoT device collection information from the robot received through the server communication unit; And
And a streaming server for processing image information received through the server communication unit. 1. A robot service method in a system in which a plurality of user terminals, a plurality of IoT devices installed in a user's home, a robot installed in a user's home, and a service server are connected via a network,
Collecting information of the IoT device through the robot and transmitting the collected information to the service server;
The user terminal can confirm the collected information by connecting to the service server, and based on the posted information, the user terminal sends the control message of the IoT device and the image information in the home to the robot via the service server The method comprising the steps of:
8. The method of claim 7,
The robot includes information of an IoT device that can be recognized by the robot. When the IoT device is in operation, the robot starts receiving, classifying the type of IoT device of the collected information, transmitting the processed information to the service server,
Processing the information of the smart switch if the IoT device of the collected information is a smart switch, processing the information of the smart sensor if it is a smart sensor, and processing beacon information if the IoT device is a beacon module.
9. The method of claim 8,
The beacon information processing may collect the unique number of the beacon from the beacon module recognized in the home on the basis of the beacon number registered in advance by the family member, and compare the beacon unique number with the registered beacon number of the family, Determining whether or not it is a non-
Determining whether a person is present in the house through the camera, determining whether the beacon is not recognized, or recognizing the beacon number and not being a family member. 8. The method of claim 7,
Accessing a web server through the user terminal and confirming information of the IoT device already collected and posted by the robot through the SNS;
Selecting an IoT device requiring control and requesting a necessary control message through a web server or a session relay server;
Controlling the smart switch if the requested control message is a smart switch, controlling the smart sensor if the smart sensor is a beacon module,
The beacon information control unit records the voice from the user terminal to a family member identified through the beacon number, stores the voice in the database through the service server, and informs the member that the voice mail exists through the web server and the session relay server. And receiving and reproducing the robot service information.

Images