WO2017126768A1

WO2017126768A1 - Remote control apparatus and system for remotely controlling mobile robot and method for executing system

Info

Publication number: WO2017126768A1
Application number: PCT/KR2016/010214
Authority: WO
Inventors: 신경철; 박성주; 최영일; 문병권; 정명교
Original assignee: (주)유진로봇
Priority date: 2016-01-20
Filing date: 2016-09-09
Publication date: 2017-07-27

Abstract

The present invention relates to a control apparatus for remotely controlling a mobile robot, the control apparatus, which remotely controls a mobile robot moving in accordance with user requests, comprising: a transceiver for transmitting a user message associated with the mobile robot and for receiving a response message from the mobile robot in response to the user message; a connection manager for determining whether the current network connection state allows real-time communication on the basis of time for transmitting a user message or for receiving a response message; and a processor for generating, in accordance with the determination of the connection manager, a first control signal for providing first item of data, previously stored, in response to a user request, and a second control signal for providing second item of data, received from the mobile robot, in response to the user request.

Description

Remote control device and system for remotely controlling mobile robot and method of performing the same

The present invention relates to a remote control device for remotely controlling a mobile robot, and more particularly, to a remote control device and a method for remotely controlling a mobile robot in consideration of a network connection state, and a remote control system.

The cleaning robot refers to a device that automatically cleans an area to be cleaned by inhaling foreign substances such as dust from the floor while driving itself in the area to be cleaned without a user's operation.

The cleaning robot is configured to perform a cleaning operation while driving a predetermined cleaning path according to a built-in program. In order to perform the cleaning operation while automatically driving the preset cleaning path, the position of the cleaning robot, its mileage, and obstacles A large number of sensors are used to detect the back.

Recently, the user's device is connected through the cleaning robot and the network to check the progress and results of the cleaning robot's autonomous driving and cleaning operation, and according to the situation, the user can remotely control the operation with the cleaning robot. Techniques for remote control systems have been developed that can be implemented.

However, in the exchange of data between the user device and the cleaning robot by using a network, it is difficult for the user to remotely control the cleaning robot in case of a failure in real time communication according to the network environment.

The present invention is to solve the above problems in the prior art, by using a control device for controlling a mobile robot, using a pre-stored data or temporarily storing the request and response according to the determination condition according to the network environment In order to control the mobile robot, the user is subjected to as little as possible the influence of the communication performance according to the network environment.

In the control device for remotely controlling a mobile robot operating according to a user's command according to an embodiment of the present invention for achieving the above object, in the control device for remotely controlling a mobile robot operating according to the user's command, A remote control apparatus for remotely controlling a mobile robot that operates according to a request of a user, the remote control apparatus comprising: a transceiver configured to transmit a user message related to the mobile robot or to receive a response message from the mobile robot according to the user message; Based on the time at which the user message is transmitted or the response message is received, the connection manager and the connection manager determine whether the current network connection state is in real time. First control for providing first data responsive to the And a processor configured to generate a second control signal for providing a signal and second data received from the mobile robot in response to the user's request.

In the present invention, the mobile robot is a cleaning robot, the operation may be cleaning and running.

In the present invention, the connection manager is based on the current time of receiving or transmitting the user message and the response message based on whether the current network connection state is a state capable of communication in real time, the current network connection state is real-time It is determined whether the communication mode is the first communication mode or the second communication mode in which communication is not possible in real time, and the first data is received from the mobile robot when the first communication mode is stored in advance. The response message, and the second data may be a response message received from the mobile robot when the first communication mode.

The apparatus may further include a storage configured to store data including a user message related to the operation of the mobile robot and a response message from the mobile robot according to the user message. The storage may further include a cache.

The cache may further include a first cache for sorting and storing the user message according to the network connection state and a second cache for storing a response message responded by the mobile robot according to the user message.

In the present invention, the connection manager presets the control signal generated by the processor when receiving a disconnect event from the socket (socket) when the socket (socket) for network communication of the mobile robot is not connected to the network When not transmitting and receiving with the mobile robot more than the number of times, at least one of the case may be set to the second communication mode.

In the present invention, when the current network connection state can be communicated in real time, the processor may receive a response message from the mobile robot according to the user message from the transmission and reception unit and store it in the second cache.

In the present invention, the processor, when the current network connection state is not possible to communicate in real time, sorts and stores the user message in the first cache, when the current network connection state can communicate in real time The response message prestored in the second cache may be called.

In addition, if it is determined that the first communication mode from the connection manager, the data can be transmitted and received in real time with the mobile robot.

The apparatus may further include a user interface for receiving the user message and an output unit for outputting the response message to the user interface.

In the present invention, the user message and the response message includes a timestamp including a time when the user message and the response message are generated, a first identifier for distinguishing according to a user's command type, and a generation order of the user message and the response message. It may include a sequence number indicating, a second identifier for distinguishing the user message and the response message, and at least one of parameters according to the first identifier and the second identifier.

In a remote control system for remotely controlling a cleaning robot according to an embodiment of the present invention, a remote control device for remotely controlling a mobile robot and a mobile robot operating at the request of a user, the user associated with the mobile robot Transmitting and receiving unit for transmitting a message, receiving a response message from the mobile robot according to the user message, the current network connection state based on the time to send the user message or the response message communication in real time The connection manager for determining whether or not it is possible and the first control signal for providing the first data stored in advance and in response to the user's request and received from the mobile robot in response to the user's request A second control scene for providing a responsive second data And a control device for remotely controlling the mobile robot including a control device for remotely controlling the mobile robot including a processor for generating a call.

In the present invention, the mobile robot is a cleaning robot, further comprising a first cache for sorting and storing the user message according to the network connection state and a second cache for storing a response message responded by the cleaning robot according to the user message. The processor may include, when the current network connection state is capable of communication in real time, depending on whether the current network connection state is capable of communication in real time based on the current time of receiving or transmitting the data. Receiving a response message from the cleaning robot according to the user message from the transmitting and receiving unit and storing the response message in the second cache, and when the communication is not possible in real time according to the network connection state, the user message is transmitted to the first cache. Arranged and stored in the cache, the point in time to communicate in real time According may further include wherein loading the stored response messages in advance to the second cache.

In the present invention, the cleaning robot, when the network connection state can be communicated in real time receives the control signal generated from the control device, and cleaning and driving in accordance with the control signal, according to the user message A response signal including a response message responsive to cleaning and driving may be transmitted.

A remote control method for communicating with a mobile robot operating according to a user's command according to an embodiment of the present invention, the remote communication method for communicating with a mobile robot operating according to a user's command, Transmitting a related user message or receiving a response message from the mobile robot according to the user message; communicating the current network connection status in real time based on a time when the user message is transmitted or the response message is received; The first control signal and the first control signal for providing the first data stored in advance in response to a user's request in accordance with the step of determining whether or not the possible state and the network state can communicate in real time. Received and responding to the user's request Generating a second control signal for providing the second data.

In the present invention, the mobile robot is a cleaning robot, the operation may further comprise the cleaning and running.

Further, depending on whether the current network connection state is a state capable of communication in real time based on a current time of receiving or transmitting the data, the current network connection state is a first communication mode capable of communication in real time, or The method may further include determining whether the communication mode is a second communication mode in which communication is not possible, and determining whether the communication mode is the second communication mode comprises: a socket for network communication of the mobile robot; When not connected to the network, when receiving the disconnect event from the socket (socket), the second communication mode is a case in which at least one of the case that the control signal generated by the processor can not be transmitted and received with the mobile robot more than a predetermined number of times. Can be set to

The method may further include arranging and storing the user message according to the network connection state and storing a response message responded by the mobile robot according to the user message.

The method may further include transmitting and receiving the data in real time with the mobile robot in the first communication mode, and storing the response message may be stored when the first communication mode is used. Sorting and storing the message may be stored in the second communication mode, and the response message stored in advance in the first communication mode may be called.

In addition, in order to achieve another object of the present invention, there is provided a storage medium in which a computer readable program is recorded for performing on a computer by the telecommunication method of the present invention.

Therefore, the control device uses the previously stored data or temporarily stores the request and response, thereby enabling seamless remote control to the user even when communication is not possible in real time.

1 is a diagram illustrating a remote communication system for remotely controlling a mobile robot according to an embodiment of the present invention.

2 is a diagram illustrating a case of a first communication mode according to an embodiment of the present invention.

3 is a diagram illustrating a case of a second communication mode according to an embodiment of the present invention.

4 is a diagram illustrating a case where a mode is converted to a first communication mode after a second communication mode according to an embodiment of the present invention.

5 is a flowchart illustrating a remote communication method according to a network connection state according to an embodiment of the present invention.

The remote control apparatus of the present invention is a remote control apparatus for remotely controlling a mobile robot that operates according to a request of a user, and transmits a user message related to the mobile robot or a response message from the mobile robot according to the user message. A transmission / reception unit for receiving a message, a connection manager for determining whether a current network connection state is in a state capable of communication in real time based on a time for transmitting the user message or receiving the response message, according to the determination of the connection manager. And a processor configured to generate a first control signal stored in advance to provide first data in response to a user's request and a second control signal received from the mobile robot to provide second data in response to the user's request. It may include.

The remote control system of the present invention transmits and receives a mobile robot and a user message related to the mobile robot, a transceiver for receiving a response message from the mobile robot according to the user message, and transmits the user message or sends the response message. The connection manager determines whether the current network connection state is in a state capable of real-time communication on the basis of the received time, and in order to provide first data that is stored in advance and responds to a user's request according to the determination of the connection manager. And a processor configured to generate a first control signal and a second control signal for providing second data received from the mobile robot in response to the user's request.

In a remote communication method for communicating with a mobile robot operating according to a user's command, the remote control method of the present invention transmits a user message related to the mobile robot or sends a response message from the mobile robot according to the user message. Receiving, determining whether the current network connection state is a state capable of real-time communication on the basis of the time to send the user message or the response message and the state that the network state can communicate in real time In response to the determination, the first control signal is stored in advance to provide first data in response to the user's request, and the second control signal for providing second data received from the mobile robot in response to the user's request. It may include the step of generating.

In addition, the remote communication method of the present invention may provide a storage medium having a computer-readable program recorded thereon for execution by a computer.

The present invention will be described in detail with reference to the accompanying drawings in accordance with one embodiment.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings and the contents described in the accompanying drawings, but the present invention is not limited or limited to the embodiments.

The terminology used in the specification of the present invention is a general term that is widely used as possible while considering the functions of the present invention, but may vary according to the intention or custom of the person skilled in the art or the emergence of new technology. . In addition, in certain cases, there is a term arbitrarily selected by the applicant, and in this case, the meaning of the term will be described in the corresponding description of the invention. Therefore, it is to be understood that the terminology used herein is to be interpreted based on the actual meaning of the term and the contents throughout the specification, rather than simply on the name of the term. For example, certain shapes, structures, and characteristics described herein may be embodied in other embodiments without departing from the spirit and scope of the invention with respect to one embodiment.

Furthermore, it should be noted that reference numerals and like elements among the drawings are denoted by the same reference numerals and symbols as much as possible even though they are displayed on different drawings. In the following description of the present invention, if it is determined that a detailed description of a related known function or configuration may unnecessarily obscure the subject matter of the present invention, the detailed description thereof will be omitted.

The following detailed description is, therefore, not to be taken in a limiting sense, and the scope of the present invention is defined only by the appended claims, along with the full scope of equivalents to which such claims are entitled. Like reference numerals in the drawings refer to the same or similar functions throughout the several aspects. Like reference numerals in the drawings denote like elements.

Hereinafter, a remote control apparatus, a remote communication system, and a remote communication method for remotely controlling a mobile robot will be described in detail with reference to the accompanying drawings. For example, the mobile robot may be a robot implemented as a cleaning robot that moves and operates itself according to a user's command, and performs an operation related to cleaning and driving. In addition, the control device is a terminal device that can be used by a user as a user terminal receiving user commands related to remote cleaning or remote driving through a remote service system, and includes a mobile communication module, a mobile phone, a smartphone, and a laptop computer. , Digital broadcasting terminal, PDA (Personal Digital Assistants), PMP (Portable Multimedia Player), navigation, netbooks, tablets, etc., can be provided in various forms, in the present embodiment mixed with "user terminal" do.

The mobile robot 2 may be exemplified as, for example, a cleaning robot, a hospital service robot, a logistics service robot, a military robot, or an industrial robot, and there is no limitation on the type of robot. However, in the following embodiments, the cleaning robot, which is a representative mobile robot, will be described.

The mobile robot 2 is equipped with a sensor unit for detecting a surrounding situation, a driving unit for moving, and an embedded processor to grasp the surrounding situation of the mobile robot 2 and determine an appropriate operation according to the autonomous operation. . That is, the user's voice or other command may be recognized to determine the user's request, and the corresponding operation may be performed.

In addition, the mobile robot 2 is connected to the control device 1 via a network, and may receive a remote control from the control device 1 to perform a specific operation. At this time, the mobile robot 2 transmits the situation information detected through the sensor unit to the control device 1 and receives a remote control command signal for the determined operation based on the situation information monitored by the control device 1. This can be done.

That is, the mobile robot 2 may switch the control mode from the automatic control mode using its own processor to the networked control mode that can be remotely controlled according to the user's request.

The mobile robot 2 is interconnected with the control device 1 through wired / wireless networks including the Internet, and secures or authenticates a space such as a home or office by using a gateway or an access point providing high-speed Internet access. Can be provided.

Here, according to an embodiment of the present invention, in order for the control device 1 and the mobile robot 2 to interconnect with each other, a router and an external server may be used.

The router is a network device that connects to an Internet line coming into the house and transmits it as a wireless signal, thereby allowing a plurality of software devices to share one Internet line and to simultaneously access the Internet. The router is an access point (AP), and performs wireless communication in a wireless communication enabled area of a certain distance, thereby connecting the service robot 2 to the network.

The server according to an embodiment of the present invention is located between the control device 1 for providing the information and the mobile robot 2 is located in place of the information requested by the user and delivers it to the user, and also provided by the user A relay server or proxy server that delivers the information to the mobile robot 2 and temporarily stores the information so that when the user requests the information again, the information is quickly delivered to the user without re-connection. It can be prepared as.

In another embodiment, the server is operated by a company providing a mobile robot 2, and is connected to a plurality of mobile robots 2 through a network, and the mobile robot 2 includes a plurality of mobile robots ( 2) You can save IP address, serial number, ID and password. Therefore, when the user inputs the ID and password through the control device 1, the mobile robot 2 can find the IP address of the mobile robot 2 corresponding to the ID and password, and can connect with the robot having the address. have.

In addition, a program for remotely controlling the mobile robot 2 may be installed in each of the mobile robot and the remote control device. The control device 1 connects to the mobile robot 2 via a network in accordance with an operation defined by an installed program, and displays a screen for controlling the mobile robot 2 in the user interface unit 100 of the control device 1. After outputting), the mobile robot can be controlled by receiving a user's instruction and transmitting the user's instruction to the mobile robot.

For example, the mobile robot 2 and the control device 1 may be initially connected to a server to obtain identification information of the other party and location information on the other party's network, and then form a mutual connection separately from the server.

More specifically, in order for the mobile robot 2 to be connected to the control device 1 on the network, a relay server having a fixed network address on the network is required. The control device 1 connects to the relay server device to obtain necessary information about itself. The mobile robot 2 and the control device 1 exchange a large amount of information such as real time video and audio information. If the mobile robot 2 and the control device 1 are plural, high performance server devices and large network bandwidths are required if all the information is exchanged through the relay server device, which leads to an increase in cost.

Therefore, the mobile robot 2 and the control device 1 are initially connected to the relay server device to obtain the partner's identification information and the information on the partner's network, and then form an interconnection layer separately from the relay server device. Two devices, a Session Traversal Utilities for NAT (STUN) server, a signal processing device (1) and a service robot (2), for peer to peer connection to obtain location information on its own network separately from the relay server device. An ICE frame network that performs communication and coordination through an ICE (Interactive Connectivity Establishment) protocol can be used to find a network connection path.

Referring to FIG. 1, a telecommunications system includes a control device 1 and a cleaning robot 2 for remotely controlling a mobile robot (hereinafter referred to as a “cleaning robot”). In more detail, the control device 1 according to the present invention includes a user interface unit 100, a processor 200, a storage unit (not shown), a transceiver unit 400, an output unit 500, and a connection manager ( 600).

The user interface unit 100 receives a user message. For example, the user interface unit 100 displays a map related to the driving area of the cleaning robot 2 and receives a user message related to the operation of the cleaning robot 2, thereby receiving the input unit 110 and the display. The apparatus may further include a unit 120, and receive a message for a user command for controlling the cleaning robot 2, and display various information of the cleaning robot 2.

The input unit 110 is for receiving a command of a user such as a touch, and may be illustrated as, for example, a graphical user interface (GUI) for touch input, or a touch panel including software for touch input. The touch panel may be implemented in a form of a layer structure with the display unit 120. The input unit 110 may not only form a touch panel but also various buttons, switches, pedals, keyboards, mice, track-balls, various levers, handles, or sticks for user input. It can be implemented in the form of a hardware device such as a stick).

The display unit 120 provides the map received from the cleaning robot 2 to the user through a visual screen. In addition, the display 120 may provide the user with the information in an auditory form through the speaker. In particular, the display unit 120 may generally include a liquid crystal touch panel and a driving unit for driving the touch panel, but is not limited thereto. The display 120 may display a map or information according to a signal from the processor 200 on the screen.

The storage unit (not shown) stores data including a user message, which is a user command related to the operation of the cleaning robot 2, and a response message responded by the cleaning robot 2 according to the user message. A storage unit (not shown) according to an embodiment of the present invention is a cache, and the storage unit further includes a first cache 310 and a second cache 320.

The first cache 310 is a storage unit for sorting and storing user messages, and the second cache 320 is a storage unit for storing a response message responded by the cleaning robot 2 according to the user message. More specifically, the first cache 310 and the second cache 320 is provided with a space for storing each message. For example, the first cache 310 and the second cache 320 are provided with spaces divided into robot status information, cleaning schedule information, map information, cleaning concentration area information, cleaning avoidance area information, location information, and the like.

For example, a message may include a version indicating a change history of a message format, a size value of a message, a timestamp containing a time when a message is generated, a first identifier for distinguishing a user's command type, and a sequence of generating a message. sequence), a second identifier for distinguishing a request and a response message, and a structure including parameters according to the first identifier and the second identifier.

When the user message is input when the network connection status is not possible in real time, the first cache 310 stores the input user message in a sorted form according to at least one of the structures described above. .

The second cache 320 is a storage unit that stores data that can be retrieved by the processor 200 when the network connection state is not possible in real time, and stores a response message when communication is possible in real time. .

The processor 200 is received from the cleaning robot 2 and a first control signal for providing first data that is stored in advance according to a network connection state used for communicating with the cleaning robot 2 and responds to a user's request. Generate a second control signal for providing second data in response to the request. Here, the first data is a response message received from the cleaning robot 2 and stored in advance when the current network state is the second communication mode capable of communicating in real time, and the second data is the cleaning robot when the first data is in the first communication mode. This is a response message received in real time from (2). The first control signal is a signal generated in the second communication mode when communication is not possible in real time, and the second control signal is a signal generated in the first communication mode when communication is possible in real time. For example, the second data may include a cleaning schedule list, map information generated from the cleaning robot 2, and area information on which the cleaning robot 2 has completed its operation.

In addition, when storing the data in the storage unit (not shown), the processor 200 sorts and stores the data according to the structure included in the message as described above.

The connection manager 600 determines whether the current network connection state can communicate in real time according to whether the current network connection state can communicate in real time based on a time for transmitting a user message or receiving a response message. It is determined whether the communication mode or the second communication mode in which communication is not possible in real time.

The connection manager 600 determines the first communication mode if the current network connection state is possible in real time, and determines the second communication mode if the current network connection state is not possible in real time.

For example, the connection manager 600 is generated when the socket for network communication of the cleaning robot 20 is not connected to the network, when receiving a disconnect event from the socket, and from the processor 200. In the case where at least one of the control signals cannot be transmitted to or received from the cleaning robot 2 more than a predetermined number of times, it is determined that the current network connection state is a second communication mode in which communication is not possible in real time. The predetermined number of times refers to a case in which a message cannot be transmitted or received more than a predetermined number set by a user.

When the network connection state is determined as the first communication mode from the connection manager 600, the transceiver 400 transmits a control signal including a user message generated from the processor 200 to the cleaning robot 2 through the network. , Receives a signal including a response message from the cleaning robot (2).

To this end, the transceiver 400 may include various communication modules, such as a wireless Internet module, a short-range communication module, a mobile communication module.

The wireless Internet module can be connected externally according to communication protocols such as Wireless LAN (WLAN), Wi-Fi, Wireless broadband, Wimax (World Interoperability for Microwave Access), and High Speed Downlink Packet Access (HSDPA). The module is connected to the network and performs communication.

The short-range communication module is connected to external devices located in close proximity according to near field communication schemes such as Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, etc. It means a module for performing communication.

The mobile communication module refers to a module that performs communication by accessing a mobile communication network according to various mobile communication standards such as 3rd generation (3G), 3rd generation partnership project (3GPP), long term evolution (LTE), and the like.

However, the present invention is not limited thereto. If communication with the cleaning robot 2 is possible, the transceiver 400 may employ a communication module of another type in addition to the above.

The output unit 500 outputs the response message that the cleaning robot 2 received from the transceiver 400 to the user interface unit 100.

The cleaning robot 2 according to an embodiment of the present invention receives a control signal generated from the control device 1 when the network connection state is a first communication mode capable of communicating in real time, and cleans according to the control signal. The vehicle generates a response signal including a response message responsive to cleaning and driving according to a user message, and transmits the response signal to the controller 1. As another example, the cleaning robot 2 responds to a remote control signal from the control device 1, performs an operation according to the above, and generates a map for the space in which the robot is running, through an external router, to control the control. To the device 1. More specifically, the cleaning robot 2 may include a network adapter for connecting to a wired or wireless router. In general, the network adapter operates in a client mode that connects to an existing wireless router. However, the network adapter may have a soft AP or an infrastructure mode, which is a role of the wireless router. Therefore, when a specific button is pressed on the cleaning robot 2, the cleaning robot 2 performs a role of a router, and the control device 1 connects to a router of the cleaning robot 2 to perform communication. At this time, the control device 1 transmits the existing router information to which the cleaning robot 2 should be connected, that is, SSID, security protocol, security algorithm, and key information to the cleaning robot 2, and the cleaning robot 2 After receiving the information, you can stop the role of the router and connect to the existing router based on the received information.

When a user message is input from the user interface unit 100, the input unit 110 transmits the user message to the processor 200. At the same time, the connection manager 600 transmits a result of determining whether the current network connection state is in a state capable of real time communication or a state in which communication is not possible to the processor 200.

The processor 200 transmits / receives data including a user message and a response message to the cleaning robot 2 in real time when the result received from the connection manager 600 is a first communication mode in which communication is possible. At this time, when the response message is received from the cleaning robot 2 in the first communication mode, the processor 200 stores the received response message in the second cache 320. More specifically, the second cache 320 classifies the second identifier included in the response message, and stores at least one parameter included in the message in an information space corresponding to the response message in the second cache 320. Save it in consideration.

The processor 200 receiving the response message from the transceiver 400 and completing the storage in the second cache 320 transmits the response message to the output unit 500. The output unit 500 outputs the received response message to the display unit 120, so that the user checks the response information from the cleaning robot 2 through the screen of the display unit 120.

When the result received from the connection manager 600 is a second communication mode in which communication is not possible, the processor 200 aligns and stores the user message in the first cache 310 and stores the first message that occurred earlier from the present time. When in the communication mode, the response message prestored in the second cache 320 is called. In more detail, when the processor 200 calls a response message according to a user message stored in the first cache 310, the processor 200 calls a response message including a first identifier and a second identifier corresponding to the user message. come. The retrieved response message may be output to the display unit 120 through the output unit 500 to confirm data to be acquired by the user.

In addition, as an embodiment, the processor 200 may not store a user message regarding an action of requesting real-time processing among user messages according to a user's request in the first cache. For example, the message related to the forward, backward, and rotational motions of the cleaning robot 2 may be stored in the first cache by excluding a user's manual manipulation.

When the connection manager 600 determines that the current network connection state is in a first communication mode in which communication is possible in real time due to a good network connection state again in the second communication mode in which communication is impossible in real time, the first cache ( The user message stored in the 310 is transmitted to the cleaning robot 2 through the transceiver 400. The transceiver 400 receives the response message according to the user message from the cleaning robot 2 and returns the reply message to the information space corresponding to the inside of the second cache 320 in the reply message. By considering and storing at least one parameter, data previously stored in the second cache 320 is updated. In addition, the processor 200 transmits the returned response message to the user interface unit 100 to the output unit 500.

For example, the second cache 320 is provided with separate information spaces according to a first identifier for distinguishing an instruction type among the components constituting the data. At this time, when the user inputs a user message requesting a "cleaning schedule list" through the input unit 110, the input user message is transferred from the user interface unit 100 to the processor 200. When the processor 200 is in the first communication mode, the processor 200 transmits a user message to the transceiver 400, and the transceiver 400 transmits the user message to the cleaning robot 2 through a network. The cleaning robot 2 generates a response message according to the user message and transmits the response message to the control device 1 again, and when the processor 200 of the control device 1 receives the response message through the

transceiver

400, 2 The cache 320 retrieves a second identifier called "Cleaning Schedule List" and stores the "Cleaning Schedule List" included in the response message in the corresponding space. In addition, in the second communication mode, when a user inputs a user message requesting a "cleaning schedule list" to the control device 1, the processor 200 accordingly inputs the input user message to the first cache 310. Save the user message of the "Cleaning Schedule List", retrieve the second identifier "Cleaning Schedule List" from the second cache 320, and read the "Cleaning Schedule List" from the corresponding location where the cleaning robot 2 is located. , And generates a response message corresponding to the "Cleaning Schedule List" request to the output unit 500 again, and the output unit 500 outputs the response message to the user interface unit 100. That is, when switching from the second communication mode to the first communication mode, when the processor 200 is in the second communication mode, the processor 200 reads user messages previously stored in the first cache 310, and the transmission / reception unit 400 determines the user. Request messages to the cleaning robot (2). When the processor 200 receives a response message for the requested user messages from the cleaning robot 2, the processor 200 deletes the user message stored in the first cache.

The processor 200 stores the input user message in the first cache 310, retrieves data corresponding to the user message from the second cache 320, and outputs a corresponding response message through the display 120. Displayed on the screen, the user confirms the displayed response message.

5 is a flowchart illustrating a remote communication method according to a network connection state according to an embodiment of the present invention. The remote communication method described later describes in detail a method of controlling from a system for remotely controlling the cleaning robot 2.

First, the user inputs a user message to the user interface unit 100 to request data related to driving and cleaning operations of the cleaning robot 2 to be acquired (S100).

When a user message is input, the connection manager 600 determines whether or not the current network connection state is available for communication in real time based on a current time of receiving or transmitting a user message or response message. It is determined whether the state is a first communication mode capable of communicating in real time or a second communication mode in which communication is not possible in real time (S200). At this time, the connection manager 600 determines that the current network connection state is the first communication mode if communication is possible in real time, and the socket for network communication of the cleaning robot 20 is not connected to the network. , At least one of receiving a disconnect event from the socket and failing to transmit / receive a control signal generated from the processor 200 with the cleaning robot 2 more than a predetermined number of times. It determines with the 2nd communication mode which communication is not possible. The predetermined number of times refers to a case in which a message cannot be transmitted or received more than a predetermined number set by a user.

When the network connection state is determined by the connection manager 600 to be the first communication mode instead of the second communication mode, the transceiver 400 cleans a control signal including a user message generated from the processor 200 through the network. It transmits to the robot 2 (S201). The transmission / reception unit 4000 receives a signal including a response message from the cleaning robot 2 (S202).

Next, the processor 200 stores the received response message in the second cache (S203). More specifically, the second cache 320 classifies the second identifier included in the response message, and stores at least one parameter included in the message in an information space corresponding to the response message in the second cache 320. Save it in consideration.

The processor 200 receiving the response message from the transceiver 400 and completing the storage in the second cache 320 transmits the response message to the output unit 500.

The output unit 500 outputs the received response message to the display unit 120, and the user checks the information responded from the cleaning robot 2 through the screen of the display unit 120 (S300).

In addition, if the result of determining the current network state from the connection manager 600 is a second communication mode in which communication is possible, the user message may be aligned and stored in the first cache 310 (S210), and the second message may be generated at a previous time from the current time. In the first communication mode, a response message prestored in the second cache 320 is called. In more detail, when the processor 200 calls a response message according to a user message stored in the first cache 310, the processor 200 searches for a response message including a first identifier and a second identifier corresponding to the user message. To be called (S220)

The imported response message is output to the display unit 120 through the output unit 500, and the user confirms the response message.

At this time, when the user message stored in the first cache 310 is switched to the first communication mode, the processor 200 transmits to the cleaning robot 2 through the transceiver 400 to request a response message. In addition, when the response message for the requested user messages is received from the cleaning robot 2, the processor 200 deletes the user message stored in the first cache. In addition, the processor 200 stores the response message in an information space corresponding to the inside of the second cache 320 in consideration of at least one parameter included in the returned response message, thereby allowing the second cache 320 to be stored. Update the data previously stored in.

In the present embodiment, the map displayed on the screen of the remote control device is preferably a map based on map data generated by the cleaning robot. The cleaning robot may store map data for the corresponding area, which is already stored, or may generate map data generated in real time by recognizing the moving path while the mobile robot starts driving regardless of the stored map data. At this time, the user message related to cleaning the user-designated area stored in the first cache 310 is converted from the second communication mode to the first communication mode, and transmitted from the mobile robot 2 as it is transmitted to the mobile robot 2. The processor 200 may analyze the received response message. For example, the processor 200 may analyze whether the cleaning area performed by the mobile robot 2 according to the user command is correct for the designated area selected by the user. In more detail, when the user compares the designated area selected by the control device with the cleaning area performed by the mobile robot 2, and if it is determined that the comparison is similar, the response message received from the mobile robot 2 is determined by the user. The display unit may be controlled to display on the screen. Here, the processor 200 may determine the similarity by using a positional relationship between the outline line or the feature points forming the outline recognized in each map representing the designated area and the cleaning area.

More specifically, the processor 200 matches at least some of the feature points extracted from each map, adjusts some of the matched feature points to the same size by adjusting the scale, and then compares similarities between the corresponding feature points. The distance may be used to determine similarity between maps. For example, the similarity distance may be obtained by using a method such as Euclidean distance, Cosine distance, Mahalanobis's distance, Manhattan distance, and the like. Can be determined. When the similarity between the maps is calculated to be lower than a predetermined level, the notification message may be displayed on the display unit so that the user can designate the designated area together with the cleaning area cleaned by the mobile robot 2.

Although all components constituting the embodiments of the present invention described above are described as being combined or operating in combination, the present invention is not necessarily limited to these embodiments. In other words, within the scope of the present invention, all of the components may be selectively operated in combination with one or more. In addition, although all of the components may be implemented in one independent hardware, each or some of the components of the components are selectively combined to perform some or all of the functions combined in one or a plurality of hardware It may be implemented as a computer program having a. In addition, such a computer program is stored in a computer readable medium such as a USB memory, a CD disk, a flash memory, and the like, and is read and executed by a computer, thereby implementing embodiments of the present invention. The recording medium of the computer program may include a magnetic recording medium, an optical recording medium, a carrier wave medium, and the like.

In addition, all terms including technical or scientific terms have the same meaning as commonly understood by a person of ordinary skill in the art unless otherwise defined in the detailed description. Terms used generally, such as terms defined in a dictionary, should be interpreted to coincide with the contextual meaning of the related art, and shall not be interpreted in an ideal or excessively formal sense unless explicitly defined in the present invention.

The above description is merely illustrative of the technical idea of the present invention, and various modifications, changes, and substitutions may be made by those skilled in the art without departing from the essential characteristics of the present invention. will be. Accordingly, the embodiments disclosed in the present invention and the accompanying drawings are not intended to limit the technical spirit of the present invention but to describe the present invention, and the scope of the technical idea of the present invention is not limited by the embodiments and the accompanying drawings. . The scope of protection of the present invention should be interpreted by the following claims, and all technical ideas within the scope equivalent thereto should be construed as being included in the scope of the present invention.

Claims

In the remote control device for remotely controlling a mobile robot operating at the request of a user,

A transmitter / receiver for transmitting a user message related to the mobile robot or receiving a response message from the mobile robot according to the user message;

A connection manager configured to determine whether a current network connection state is in a state capable of communicating in real time based on a time for transmitting the user message or receiving the response message; And

A first control signal for providing first data stored in advance and in response to a user's request and second data received from the mobile robot in response to the user's request according to the connection manager's decision; 2 A remote control device comprising a processor for generating a control signal.
The method of claim 1,

The mobile robot is a cleaning robot, the control device for remotely controlling the mobile robot further comprises the cleaning and running.
The method of claim 1, wherein the connection manager

Whether the current network connection state is a first communication mode capable of communicating in real time according to whether a current network connection state is in a state capable of real-time communication based on a current time of receiving or transmitting the user message and response message. Or determine whether the communication mode is a second communication mode in which communication is not possible in real time;

The first data is a response message received from the mobile robot and stored in advance in the first communication mode, and the second data is a response message received from the mobile robot in the first communication mode. A control device for remotely controlling the mobile robot further comprising.
The method of claim 1,

And a storage unit configured to store data including a user message related to the operation of the mobile robot and a response message from the mobile robot according to the user message.

The storage unit further controls the mobile robot, characterized in that it further comprises a cache.
The method of claim 4, wherein the cache,

According to the network connection status

A first cache for sorting and storing the user message; And

A second cache for storing a response message responded by the mobile robot according to the user message;

Control device for remotely controlling the mobile robot, characterized in that it further comprises.
The method of claim 3, wherein the connection manager

When a socket for network communication of the mobile robot is not connected to a network;

Receiving a disconnect event from the socket;

When the control signal generated by the processor cannot be transmitted or received with the mobile robot more than a preset number of times;

The control device for remotely controlling the mobile robot, characterized in that for setting at least one of the case to the second communication mode.
The method of claim 5, wherein the processor,

If the current network connection status can communicate in real time,

And receiving a response message from the mobile robot according to the user message from the transceiving unit and storing the response message in the second cache.
The method of claim 5, wherein the processor,

If the current network connection status is not available in real time,

Sort and store the user message in the first cache,

And a response message pre-stored in the second cache when the current network connection state is available for communication in real time.
The method of claim 1,

A user interface unit for receiving the user message; And

An output unit which outputs the response message to the user interface unit;

Control device for remotely controlling the mobile robot, characterized in that it further comprises.
The method of claim 1, wherein the user message and the response message

A timestamp including a time when the user message and the response message are generated, a first identifier for distinguishing according to a user's command type, a sequence number indicating a generation order of the user message and the response message, and a representation of the user message and the response message And a second identifier for distinguishing and at least one of parameters according to the first identifier and the second identifier.
Mobile robot; And

Transmitting and receiving unit for transmitting a user message associated with the mobile robot, or receiving a response message from the mobile robot according to the user message,

A connection manager for determining whether a current network connection state is available for communication in real time based on a time for transmitting the user message or receiving the response message;

A first control signal for providing first data stored in advance and in response to a user's request and second data received from the mobile robot in response to the user's request according to the connection manager's decision; A control device for remotely controlling a mobile robot including a processor for generating a control signal;

Remote control system for remotely controlling a mobile robot comprising a.
The method of claim 11,

The mobile robot is a cleaning robot,

According to the network connection status

A first cache for sorting and storing the user message and a second cache for storing a response message responded by the cleaning robot according to the user message,

The processor may be further configured to determine whether a current network connection state is available for communication in real time based on a current time for receiving or transmitting the data.

When the current network connection state can be communicated in real time, the response message from the cleaning robot according to the user message is received from the transceiver and stored in the second cache,

When the communication is not possible in real time according to the network connection state, the user message is arranged in the first cache and stored, and the response message pre-stored in the second cache is loaded in accordance with the point of time in which the communication is possible in real time. A remote control system for remotely controlling the cleaning robot further comprising.
The method of claim 12, wherein the cleaning robot,

When the network connection state can be communicated in real time

Receiving a control signal generated from the control device, performing cleaning and driving according to the control signal, and transmitting a response signal including a response message responsive to the cleaning and driving according to the user message; Remote control system for remotely controlling the cleaning robot.
In the remote communication method for communicating with a mobile robot that operates according to a user's command,

Transmitting a user message related to the mobile robot or receiving a response message from the mobile robot according to the user message;

Determining whether a current network connection state is available for communication in real time based on a time for transmitting the user message or receiving the response message; And

In response to determining whether the network state is in a state capable of communication in real time, a first control signal for providing first data stored in advance and in response to a user request, and a second control signal received from the mobile robot and responding to the user request Generating a second control signal for providing data;
The method of claim 14,

The mobile robot is a cleaning robot, the operation is a remote control method according to the network connection further comprising the cleaning and running.
The method of claim 14,

The current network connection state is a first communication mode that can communicate in real time or the real time according to whether a current network connection state is in a state capable of real time communication based on a current time of receiving or transmitting the data. Determining whether the communication mode is a second communication mode in which communication is not possible;

Determining whether or not the second communication mode is

When a socket for network communication of the mobile robot is not connected to a network;

Receiving a disconnect event from the socket;

When the control signal generated by the processor cannot be transmitted or received with the mobile robot more than a preset number of times;

Remote control method according to the network connection state, characterized in that for setting at least one of the case to the second communication mode.
The method of claim 14,

According to the network connection status

Sorting and storing the user message; And

Storing a response message responded by the mobile robot according to the user message;

Remote control method according to the network connection state characterized in that it further comprises.
The method of claim 17,

In the first communication mode, transmitting and receiving the data in real time with the mobile robot,

The storing of the response message may include storing in the first communication mode,

Sorting and storing the user message may be stored in the second communication mode;

And in response to the network connection state, the response message stored in advance in the first communication mode.
19. A storage medium having recorded thereon a computer readable program for performing a remote control method according to any one of claims 14 and 18 on a computer.