KR20110124652A - Robot cleaner and remote control system of the same - Google Patents

Abstract

PURPOSE: A robot cleaner and remote control system is provided to perform remote control and information supply by using a local area communication network and telecommunication network. CONSTITUTION: A robot cleaner and remote control system comprises a communications unit(110), a voice conversion unit(120), a voice output unit(130), and a control unit(140). The communications unit is connected to an external device and receives information data. The voice conversion unit changes information data into audio data. The voice output unit outputs audio data to voice sound. The control unit extracts a remote control command from information data and implements remote control command or control algorithm.

Description

Robot Cleaner and Remote Control System {ROBOT CLEANER AND REMOTE CONTROL SYSTEM OF THE SAME}

The present invention relates to a robot cleaner for performing cleaning, requesting information data according to a user's voice command to an external device, and receiving and outputting the information data as a voice and a remote control system for controlling the same.

In general, robots have been developed for industrial use and have been a part of factory automation. Recently, the application of robots has been further expanded, medical robots, aerospace robots, and the like have been developed, and home robots that can be used in general homes have also been made.

A representative example of the home robot is a robot cleaner, which is a kind of home appliance that cleans by suctioning dust or foreign matter while driving around a certain area by itself. Such a robot cleaner generally includes a rechargeable battery, and includes an obstacle sensor that can avoid obstacles while driving, so that the robot cleaner can run and clean itself.

The robot cleaner according to the related art cleans the cleaning area using a cleaning pattern set in advance according to an externally provided input button, a control command by a remote controller, or a built-in control algorithm. Recently, application technology using the robot cleaner has been developed, and one of them is a remote monitoring technology using the robot cleaner. The remote monitoring technology provides an image acquired through a camera in the robot cleaner to an external user and the like to monitor the room.

However, the application system using a robot cleaner and an external network device according to the prior art has a problem in that information cannot be easily shared or easily provided by mutually transmitting or receiving information.

An object of the present invention is to provide a robot cleaner that receives an information data from an external device and converts the information into voice data by embedding a device that communicates with the external device.

The present invention provides a robot cleaner that converts information data received through an embedded communication unit into voice data and provides the same to a user, and recognizes a voice command such as a user, and requests the external device for the information data accordingly. Another purpose is to provide a cleaner.

Another object of the present invention is to provide a remote control system including a wireless terminal device which accesses a robot cleaner through a wireless communication network, transmits a control command through text input, and receives necessary information from the robot cleaner.

According to an aspect of the present invention, a robot cleaner includes: a communication unit connected to an external device to receive information data; a voice conversion unit to convert the information data into voice data; and a voice to output the voice data. It is configured to include an output unit. The robot cleaner further comprises a control unit which extracts a remote control command from the information data and executes the remote control command or an embedded control algorithm.

The robot cleaner according to the present invention further includes a voice recognition unit that extracts and recognizes a voice command from voice signals generated in the vicinity. Here, the control unit generates a request signal for requesting the external device for the information data corresponding to the voice command, and the communication unit transmits the request signal to the external device.

The robot cleaner according to the present invention further includes one or more surveillance cameras for photographing a surrounding to generate a surveillance image, and the communication unit transmits the surveillance image to the external device according to a request of the external device.

In the robot cleaner according to the present invention, the control unit searches the surroundings to generate a cleaning map, and the communication unit transmits the cleaning map to the external device at the request of the external device.

The robot cleaner according to the present invention further includes an authentication unit which permits or blocks the connection of the external device.

The remote control system according to the present invention for achieving the above object comprises a robot cleaner for converting the information data received from the outside into voice data, and a wireless terminal device for transmitting the information data to the robot cleaner. do.

In the remote control system according to the present invention, the robot cleaner is connected to the wireless terminal device to receive the information data and to transmit a request signal for requesting the information data, and the information data to the voice. A voice conversion unit for converting data into a data, a voice output unit for voice outputting the voice data, and a control unit for extracting a remote control command from the information data and executing the remote control command or a built-in control algorithm. do.

In the remote control system according to the present invention, the robot cleaner further comprises a voice recognition unit that extracts and recognizes a voice command from voice signals generated in the vicinity. Here, the control unit generates the request signal for requesting the information data corresponding to the voice command, and the communication unit transmits the request signal to the wireless terminal device.

In the remote control system according to the present invention, the robot cleaner further comprises an authentication unit which permits or blocks the connection of the wireless terminal device.

In the remote control system according to the present invention, the wireless terminal device, a user interface module for receiving a command for generating the information data, and a communication module for transmitting the information data to the robot cleaner, and receives the request signal It is configured to include.

The remote control system according to the present invention further includes a wireless connection device connected between the robot cleaner and the wireless terminal device or connected to the robot cleaner and an external network.

According to another embodiment of the present invention, a remote control system includes a robot cleaner for converting and outputting information data received from the outside into voice data and transmitting a request signal for requesting the information data to the outside; And an information providing server for transmitting the corresponding information data to the robot cleaner.

In the remote control system according to another embodiment of the present invention, the robot cleaner, a voice recognition unit for extracting and recognizing a voice command from the voice signals generated in the surroundings, and the information providing server connected to receive the information data And a communication unit for transmitting the request signal, a voice conversion unit for converting the information data into the voice data, and a voice output unit for voice outputting the voice data.

The robot cleaner according to the present invention has a built-in communication unit that communicates with an external device to receive information data from an external device, and converts the data into voice data to improve user convenience.

According to the present invention, by accessing a robot cleaner through a wireless terminal device at a remote location, providing information data through text input, etc., remotely controlling the robot cleaner, and providing a wireless access device, thereby providing not only a short distance communication network but also a long distance communication. The network can be used to provide information and to perform remote control.

According to the present invention, it is possible to control the robot cleaner through a wireless terminal device at a remote location, to check the status of the robot cleaner and to collect information, and to provide a user with a convenience service other than cleaning.

1 is a perspective view showing the appearance of a robot cleaner according to the present invention;
2 is a diagram schematically showing the configuration of a remote control system according to an example of the present invention;
3 is a block diagram showing a detailed configuration of a robot cleaner according to an embodiment of the present invention;
4 is a block diagram showing a detailed configuration of a wireless terminal device according to the present invention;
5 is a view for explaining a remote control system connected to the robot cleaner and the information providing server according to the present invention;
6 is a block diagram showing a detailed configuration of a robot cleaner according to another embodiment of the present invention;
7 is a block diagram showing a detailed configuration of a robot cleaner according to another embodiment of the present invention;
8 is a configuration of a remote control system according to another embodiment of the present invention, showing a form connected through a local area network;
9 is a configuration of a remote control system according to another embodiment of the present invention, showing a form connected through a telecommunication network;
10 to 13 are views showing a user interface screen for explaining the remote control operation via the wireless terminal device in the remote control system according to the present invention;
14 to 16 are diagrams illustrating a remote control method using a robot cleaner according to embodiments of the present invention.

Hereinafter, a robot cleaner and a remote control system for remotely controlling a robot cleaner according to the present invention will be described in detail with reference to the accompanying drawings.

Referring to FIG. 3, a robot cleaner according to an embodiment of the present invention may include a communication unit 110 connected to an external device to receive information data, and a voice conversion unit 120 to convert the information data into voice data. And a voice output unit 130 for outputting voice data.

The robot cleaner further includes a control unit 140 for extracting a remote control command from the information data and executing the remote control command or an embedded control algorithm.

The communication unit 110 transmits information about the robot cleaner to the connected external device. In addition, the communication unit 110 transmits a request signal for transmitting information data desired by a user or the like to the external device. In addition, the communication unit 110 receives information data including a control command from the external device, transmits the received control command to the control unit 140, or transmits the information data to the voice conversion unit 120. To pass on. Here, the control command is a control command for driving the robot cleaner or a command for controlling each unit in the robot cleaner. The control command includes, for example, a command for confirming state information of the robot cleaner and various kinds of information stored or detected. The communication unit 110 may include a wireless terminal module 111 to be described later, or a wireless access module 111 connected to a wireless access device such as an access point (AP), for example, a Wi-Fi module.

The voice conversion unit 120 converts the information data received through the communication unit 110 into voice data and outputs the voice data to the voice output unit 130. The voice conversion unit 120 is, for example, a device such as text to speech (TTS), and when a user or the like inputs a text through a wireless terminal device such as a mobile phone, which will be described later, it is received and converted into voice. The voice output unit 130 is a device such as a speaker for outputting voice data converted through the voice conversion unit 130.

The control unit 140 controls the operation of the robot cleaner based on a built-in algorithm, a program stored in a storage unit to be described later, and a user command input through an input unit. The control unit 140 drives the built-in units, and is involved in an operation of transmitting various information, a cleaning map, a surveillance image, and the like to an external device through the communication unit 110. In addition, the control unit 140 extracts a remote control command from the information data transmitted from the external device, and drives each of the built-in units based on the remote control command. In addition, the control unit 140 searches for the cleaning area to create a cleaning map, and the communication unit 110 transmits the cleaning map created by the control unit 140 to the connected external device. In addition, the communication server 120 transmits information such as an air cleaning area, an uncleaned area, a cleaning pattern, an uncleanable area, and a cleaning state to an external device.

Referring to FIG. 6, a robot cleaner according to another embodiment of the present invention may include a communication unit 110 connected to an external device to receive information data, and a voice conversion unit 120 to convert the information data into voice data. A voice output unit 130 for voice outputting the voice data, a control unit 140 for extracting a remote control command from the information data, and executing the remote control command or a built-in control algorithm; And a voice recognition unit 160 which extracts and recognizes a voice command from the signals.

The voice recognition unit 160 receives all voice signals around the robot cleaner, extracts a voice command such as a user from the voice signals, and outputs the voice command to the control unit 140. The control unit 140 drives each unit according to the voice command, or generates a request signal for requesting the external device for the information data corresponding to the voice command, and the communication unit 110, Send the request signal to the external device. The voice recognition unit 160 may further include a microphone for receiving the voice command and means for sampling the voice command output from the microphone. The voice command may include a term for distinguishing the robot cleaner. For example, when a user or the like calls “Cleaning Robot!” And then gives a voice command to the robot cleaner, “What is the weather today?”, The voice recognition unit 160 recognizes the voice command and controls the control. Output to unit 140. The control unit 140 generates a request signal for requesting today's weather corresponding to the voice command and transmits the request signal to the information providing server that manages the weather. When the information providing server transmits the information data about the weather today to the robot cleaner, the voice conversion unit 120 converts the information data into voice data, and the voice output unit 130 reads, "Today's weather is sunny and sunny. And at least 5 degrees, and at most 19 degrees. "

The robot cleaner according to the embodiments of the present invention further includes an authentication unit 150 that permits or blocks the connection of the external device. The authentication unit 150 may be provided in the form of an authentication server, and may store authentication information about the external device, for example, a phone number, a user ID, a password address, and other information for identifying the external device. have. As another example, when the robot cleaner includes a storage unit 180 as described below, authentication information about an external device may be stored in the storage unit 180. In this case, when the external device requests authentication or access, the authentication unit 150 reads information about the external device from the storage unit 180 and then permits authentication and connection of the external device. Since a description of the authentication method is common, a detailed description thereof will be omitted.

Referring to FIG. 7, the robot cleaner according to the embodiments of the present invention further includes one or more surveillance cameras 170 for photographing a surrounding to generate a surveillance image, and the communication unit 110 includes the external device. The surveillance image is transmitted to the external device according to a request of the user. As illustrated in FIG. 1, the surveillance camera 170 is generally installed at the front or side of the robot cleaner, and photographs the surroundings during driving or cleaning. Of course, if necessary, it can be installed on top of the robot cleaner. When provided with a plurality of cameras may be formed on the side of the robot cleaner at a predetermined distance or at an angle. The robot cleaner is connected to the surveillance camera 170 to focus a subject (not shown), an adjusting unit (not shown) for adjusting the camera, and a lens adjusting unit (not shown) for adjusting the lens. ) May be further included. The communication unit 110 streams and transmits the surveillance video to a connected external device. In this case, the communication unit 110 transmits the surveillance image at the request of the external device. That is, the communication unit 110 confirms that the external device is connected to the robot cleaner and then transmits the surveillance image. As another example, the communication unit 110 may always be in a standby state so that the surrounding image captured by the surveillance camera 170 is transferred to an external device.

The robot cleaner further includes an image processing unit 171 for compressing the surveillance image. The image processing unit 171 compresses the surveillance image output from the surveillance camera 170 using a compression technique such as AVI (Audio Video Interleaved), ASF (Advanced Streaming Format). In particular, the image processing unit 171 is an MPEG encoder.

In the robot cleaner according to the embodiments of the present invention, the control unit 140 searches for the surroundings to generate a cleaning map, and the communication unit 110 generates the cleaning map at the request of the external device. Send to the external device. There are various ways in which the control unit 140 creates a cleaning map. In particular, the control unit 140 extracts a feature point from an upper image photographed using the built-in upper camera 172a, and generates a cleaning map. Write. For example, the control unit 140 extracts a feature point by using a natural mark such as a fluorescent lamp or an interior structure existing in an upper region including a ceiling, and extracts or moves the feature point after photographing the upper side once. The feature point is extracted by taking two or more shots.

Referring to FIG. 7, a robot cleaner according to embodiments of the present disclosure may include an obstacle detecting unit 173 that detects an obstacle around it, and a position recognition unit that includes one or more sensors and recognizes a position of the robot cleaner. 172 is further included. In this case, the control unit 140 may create a cleaning map or modify the created map based on the obstacle and the magnetic location.

The obstacle detecting unit 173 detects an obstacle around the robot cleaner while moving or cleaning, and outputs obstacle information such as the presence or absence of the obstacle, or position and size, to the control unit 140. As the obstacle detection unit 173, an infrared sensor, an ultrasonic sensor, an RF sensor, a bumper, or the like may be used. The control unit 140 can primarily create a cleaning map based on the obstacle information output from the obstacle detection unit 173.

The position recognition unit 172 includes one or more distance sensors to recognize the position of the robot cleaner in the cleaning area. Here, the position recognition unit 172 is connected to the acceleration sensor (not shown) for recognizing the speed and position, the wheel motor for driving the wheel of the robot cleaner to detect the speed (not shown), the rotation of the robot cleaner One or more of the gyro sensors (not shown) for detecting the velocity may be used. In addition, the position recognition unit 172 may use an upper camera 172a that is provided on the upper part of the robot cleaner and photographs the upper side to output the upper image. The control unit 140 may modify the cleaning map created by using the obstacle information through the magnetic location recognized by the location recognizing unit 172.

Referring to FIG. 7, the robot cleaner further includes a storage unit 180 that stores information about the information data and voice data, that is, matching information between the data and shape information of each data. The storage unit 180 further stores information such as the type or frequency of the voice command so as to remove noise from voice signals input from the outside and extract the voice command. In addition, the storage unit 180 stores information about a request signal for requesting information data corresponding to the voice signals in order to request information data corresponding to the voice signals.

The storage unit 180 further stores at least one of the surveillance image or the compressed surveillance image, authentication information on the external device, information on the obstacle, information on the location of the robot cleaner, and the cleaning map. Can be. The storage unit 180 may include a surveillance image detected through the surveillance camera 170, information about a surveillance image compressed through the image processing unit 171, the external device, that is, a wireless terminal device or a wireless connection. Stores authentication information about the device. In addition, the storage unit 180 may include at least one of obstacle information such as the position of the obstacle detected by the obstacle detection unit 173 when moving or cleaning, and at least one of the cleaning maps created by the control unit 140. Remember The storage unit 180 mainly uses a nonvolatile memory. Here, the non-volatile memory (NVM, NVRAM) is a storage device that maintains stored information even when power is not supplied, and includes a ROM, a flash memory, and a magnetic computer memory device (eg For example, it includes a hard disk, a diskette drive, a magnetic tape), an optical disk drive, and the like, and includes not only a punch card and a paper tape, but also a magnetic RAM, a PRAM, and the like.

Referring to FIG. 7, the robot cleaner according to the present invention includes a power supply unit 197 having a rechargeable power supply unit for supplying power into the robot cleaner, and a driving unit 195 for driving a wheel to move the robot cleaner. And an input unit 191 which receives one or more buttons and directly receives a control command, the received information data, a control command, the surveillance image or the compressed surveillance image, authentication information about the external device, and the obstacle. And a display unit 193 for outputting one or more pieces of information about the information about the robot cleaner, the location of the robot cleaner, and the cleaning map.

The power supply unit 197 supplies the operating power for the robot cleaner to move and perform the cleaning. If the remaining power supply is insufficient, the power supply unit 197 is charged with the charging current from the charging stand.

The driving unit 195 is connected to a plurality of wheels including a plurality of main wheels and one or more auxiliary wheels, and includes a predetermined wheel motor for rotating the wheels to drive the wheel motor, thereby cleaning the robot cleaner. Move it.

The user may input a control command directly to the robot cleaner through the input unit 191, or input a command to output one or more of the information stored in the storage unit 180. The input unit 191 checks the position information such as the information data, the control command, the information on the surveillance image, the authentication information on the external device, the position of the obstacle, the position of the robot cleaner, or a command to confirm a cleaning area or a cleaning map. It may be provided with one or more input buttons of a confirmation button for inputting, a setting button for inputting a setting command, a reset button for inputting a reset command, a delete button, a cleaning start button, and a stop button.

The display unit 193 may include information data stored in the storage unit 180, voice data, voice command, information on a voice signal, information on a surveillance image, information on an external device, information on an obstacle, or a cleaning area. The controller detects the information detected or recognized through the obstacle detecting unit 173 or the location recognizing unit 172, and a cleaning map generated through the control unit 140. The display unit 193 may further display state information of each unit constituting the robot cleaner and state information such as a current cleaning state. The display unit 193 may include any one of a light emitting diode (LED), a liquid crystal display (LCD), a plasma display panel, and an organic light emitting diode (OLED). It can be formed of one element. In this case, the input unit 191 and the display unit 193 may have a form of a touch screen capable of both input or output.

The robot cleaner may further include a cleaning unit (not shown), wherein the cleaning unit includes a predetermined suction motor that sucks air and means for agglomerating dust, and sucks dust or foreign matter around it.

2, the remote control system according to an embodiment of the present invention, the robot cleaner 100 for converting the information data received from the outside into voice data and outputting, and transmitting the information data to the robot cleaner It is configured to include a wireless terminal device 200.

In the remote control system according to an embodiment of the present invention, the robot cleaner 100 is connected to the wireless terminal device to receive the information data, the communication unit for transmitting the request signal for requesting the information data ( 110, a voice conversion unit 120 for converting the information data into the voice data, a voice output unit 130 for voice outputting the voice data, and extracting a remote control command from the information data, And a control unit 140 for executing a control command or an embedded control algorithm. In addition, the robot cleaner 100 further includes a voice recognition unit 160 that extracts and recognizes a voice command from voice signals generated in the vicinity. Here, the control unit 140 generates the request signal for requesting the information data corresponding to the voice command, and the communication unit 110 transmits the request signal to the wireless terminal device. The robot cleaner further includes an authentication unit 150 that permits or blocks the connection of the wireless terminal device. The authentication unit 150 may be provided in the form of an authentication server, and may store authentication information about the external device, for example, a phone number, a user ID, a password address, and other information for identifying the external device. have. Here, the detailed description of the robot cleaner replaces the description of the robot cleaner according to the embodiments of the present invention and will be omitted below.

The wireless terminal device 200 includes a user interface module 220 that receives a command for generating the information data, a communication module 210 that transmits the information data to the robot cleaner, and receives the request signal. It is configured to include. The wireless terminal device 200 further includes a control module 230 for generating the information data by executing a command input by a user or the like and transmitting the information data through the communication module 210. The wireless terminal device 200 may further include a storage module 240 for storing a remote control program, and the control module 230 performs the data transmission and reception by executing the remote control program.

In FIG. 2, the wireless terminal device 200 is directly connected to the communication device 110 in the robot cleaner in the form of Wi-Fi Direct to transmit and receive data. The communication module 210 is connected to the communication unit 110 to receive various information, a request signal, a cleaning map or a surveillance image from the communication unit 110, the information data generated by the control module 230, Send a control command to the communication unit 110. First, the wireless terminal device 200 accesses the robot cleaner 100, and then requests the cleaning map or the surveillance image from the robot cleaner 100 and receives it. In FIG. 2, the wireless terminal device 200 and the robot cleaner 100 are connected through ad-hoc networking, and the wireless terminal device 200 is provided with a cleaning map or the surveillance image transmitted by the robot cleaner. Each piece of information is provided to a user through the user interface module 220. When the robot cleaner has the authentication unit 150, first, the communication module 210 requests the authentication unit 150 to connect and authenticate the robot cleaner, and the authentication unit 150 requests the authentication unit 150. Access to the wireless terminal device 200 is compared and determined. If the connection is allowed (authenticated), the wireless terminal device 200 requests the robot cleaner 100 to transmit various types of information such as status information and cleaning information about the robot cleaner. A user or the like inputs a command through the user interface module 220 or a command to generate the information data by selecting a button or menu, and the control module 230 according to the user command Create The communication module 210 transmits the information data to the robot cleaner through the communication unit 110. Here, the information data includes a control command for controlling the robot cleaner and the units constituting the robot cleaner.

In addition, when the connection is permitted (if authenticated), the wireless terminal device 200 requests the robot cleaner 100 to transmit a cleaning map. When the communication module 210 receives the cleaning map, the user interface module 220 displays the cleaning map. The user or the like checks the cleaning area, the non-cleaning area, etc. through the cleaning map displayed on the user interface module 220, moves the robot cleaner to a desired location or area, or cleans the location or area. A command is input through the user interface module 220. When the user or the like selects a specific location or area on the cleaning map, the wireless terminal device displays a corresponding surveillance image. In addition, when the user or the like selects a specific location or area, the wireless terminal device generates a command for requesting a surveillance image for the location or area. The control module 230 receives the user command and generates a control command such as a control command, a status check command, a surveillance camera control command, and the like for the robot cleaner. The communication module 210 transmits the control command to the communication unit 110. The control command is one or more of a control command for the surveillance camera such as zoom in / zoom out, tilting, a control command for the robot cleaner, and a control command for the robot cleaner. The control command may be a command for confirming state information of the robot cleaner, various information stored or detected, or a command for driving each unit. In addition, the wireless terminal device 200 displays a cleaning map received from the robot cleaner 100 to check a cleaning area, an uncleaned area, and the like, and selects a desired location or area on the cleaning map to clean the robot cleaner. In order to move to a corresponding location or a corresponding area, or generate a control command for requesting a surveillance image of the corresponding location or the corresponding area and transmit the generated control command to the robot cleaner.

Referring to FIG. 8, a remote control system according to another embodiment of the present invention includes a robot cleaner 100 for converting and outputting information data received from the outside into voice data, and a wireless transmitter for transmitting the information data to the robot cleaner. It is configured to include a terminal device 200, the wireless terminal device 200 is connected to the robot cleaner 100 through a wireless access device 400. Here, the wireless terminal device 200 includes one or more devices capable of wireless communication such as a computer, a smart television, a smart phone, and a mobile phone, and the wireless access device 400 is connected to the robot cleaner 100. A device such as an access point (AP) connecting the wireless terminal device 200.

8 is a diagram in which the wireless terminal device 200 and the robot cleaner 100 are connected through a local area network. That is, the wireless terminal device 200 is equipped with a wireless communication module, for example a Wi-Fi module, the communication unit 110 of the robot cleaner 100 without a separate server for data transmission through the wireless access device Or the authentication unit 150. The wireless terminal device 200 is connected to the robot cleaner 100 through the wireless access device 400 to receive an information data request signal, a surveillance image or a cleaning map, and transmit information data and a control command. In the remote monitoring system according to another embodiment of the present invention, the description of the detailed configuration of the wireless terminal device and an example of the operation are replaced with the description of the remote monitoring system according to the above example, and will be omitted below.

9, a remote monitoring system according to another embodiment of the present invention includes a robot cleaner 100 for converting and outputting information data received from the outside into voice data, and transmitting the information data to the robot cleaner. It is configured to include a wireless terminal device 200, the wireless terminal device 200 is connected to the robot cleaner 100 through a network provided by a communication company. In this case, the wireless access device 400 may be further included as necessary. Here, the wireless terminal device 200 includes one or more devices capable of wireless communication such as a computer, a smart television, a smart phone, and a mobile phone, and the wireless access device 400 is connected to the robot cleaner 100. A device such as an access point (AP) connecting the wireless terminal device 200.

9 illustrates a form in which the wireless terminal device 200 and the robot cleaner 100 are connected in a wide area network environment. The wireless terminal device 200 includes a mobile communication module, a wireless communication module, It has a channel accessible to a public network such as a modem. That is, the wireless terminal device 200 is connected through a channel provided by a communication company or a wireless access device to a network network, and is connected to the robot cleaner through the network network. Through this, the wireless terminal device 200 may perform a remote monitoring operation such as providing a surveillance image through a user interface, display a cleaning map, perform character input, information data generation and transmission, or a desired location or area. The robot cleaner is controlled by transmitting a control command to the robot cleaner to perform the movement or cleaning. In the remote monitoring system according to another embodiment of the present invention, the description of the detailed configuration of the wireless terminal device and an example of the operation are replaced with the description of the remote monitoring system according to the above example, and will be omitted below.

10 to 13 illustrate examples of a user interface screen for the wireless terminal device to control the robot cleaner.

Referring to FIG. 10, an example in which a user or the like performs cleaning by a robot cleaner through a wireless terminal device is illustrated. When a user or the like inputs a text message such as "small room cleaning" through the user interface screen on the wireless terminal device 200, the wireless terminal device 200 controls the information data corresponding to the command of the user or the like. A command is generated and transmitted to the robot cleaner, and the robot cleaner moves to a small room according to the control command to perform cleaning.

Referring to FIG. 11, when a user or the like inputs a text message through a wireless terminal device, the robot cleaner converts the text message into a voice and transmits the text message to other users in the room where the robot cleaner is located. When an external user or the like inputs a text message of “9 am out of office because of a meeting” through the user interface module 220 on the wireless terminal device 200, the wireless terminal device 200 converts the information data into information data. Send to the robot cleaner. The robot cleaner 100 receiving the information data converts the voice data into the voice data through the voice conversion unit 120 and outputs the voice data through the voice output unit 130. For example, the robot cleaner outputs a phone number or name of the user who sent the text message, outputs the time when the text message is sent, and then outputs the text message contents in the form of voice data.

12 or 13, when the robot cleaner is to be monitored on the wireless terminal device 200 to monitor the room in which the robot cleaner is placed or to perform cleaning, the remote control program stored in the storage module 240 is first applied. Run it. 12 and 13 show a screen in which a remote control program having a security mode and a cleaning mode and having an information confirmation mode capable of confirming information is executed. Referring to FIG. 12, the wireless terminal device displays a cleaning map received from the robot cleaner in a cleaning mode on a user interface module 220, and the user interface module 220 starts, ends, charges, and cleans a pattern. It is provided with a plurality of buttons, such as a setting to receive a command for controlling the robot cleaner from a user. When a user or the like wants to see a surveillance image of a specific location or a specific area on the displayed cleaning map, the wireless terminal device 200 is switched to a security mode as shown in FIG. 13. When the user or the like selects a specific location or area on the cleaning map, the wireless terminal device displays a corresponding surveillance image. In addition, when the user or the like selects a specific location or area, the wireless terminal device generates a command for requesting a surveillance image for the location or area. When the wireless terminal device 200 requests the robot cleaner 100 for a surveillance image of a specific location or a specific area desired by a user, the robot cleaner sends the surveillance image of the location or region to the wireless terminal device. send. In this case, if the robot cleaner is not at the location, the robot cleaner moves to the location and generates and transmits a surveillance image of the location. As illustrated in FIG. 13, the wireless terminal device may receive a command for controlling the surveillance camera through the user interface module 220.

Referring to FIG. 5, the remote control system according to another exemplary embodiment of the present invention converts and outputs information data received from the outside into voice data and transmits the request signal for requesting the information data to the outside. And an information providing server 300 for transmitting the information data corresponding to the request signal to the robot cleaner.

Referring to FIG. 6 or 7, the robot cleaner 100 may be connected to the information providing server and the voice recognition unit 160 which extracts and recognizes a voice command from voice signals generated in the vicinity. A communication unit 110 for receiving and transmitting the request signal, a voice conversion unit 120 for converting the information data into the voice data, and a voice output unit 130 for voice outputting the voice data; It is composed.

5 to 7, the voice recognition unit 160 receives the surrounding voice signals, extracts a voice command such as a user from the voice signals, and the control unit 140 extracts the extracted voice command. A request signal for generating information data according to the voice command is generated. The communication unit 110 transmits the request signal to a corresponding information providing server connected in a wired or wireless communication scheme. The information providing server 300 transmits information data corresponding to the request signal to the communication unit 110. The voice conversion unit 120 converts the received information data into voice data, and the voice output unit 130 outputs the voice data to a user or the like. For example, when a user or the like gives a voice command to the robot cleaner, "What is the weather today?", The robot cleaner generates a request signal for requesting the weather today and transmits the request signal to the information providing server that manages the weather. . When the information providing server transmits the information data about the weather today to the robot cleaner, the robot cleaner converts the information data into voice data, such as "the weather is sunny and sunny, at least 5 degrees, at most 19 degrees". To the user.

14 to 16, embodiments of a remote control method of a remote control system according to the present invention will be described.

Referring to FIG. 14, in the remote control method of the remote control system, the wireless terminal device 200 receives a text (S120) and the wireless terminal device generates information data corresponding to the text. (S130), transmitting the information data to the robot cleaner by the wireless terminal device (S140), converting the information data into voice data by the robot cleaner (S150), and by the robot cleaner And outputting voice data (S160). In addition, the remote control method of the remote control system, the wireless terminal device further comprises the step of requesting authentication to the robot cleaner (S111), the robot cleaner further comprises the step of allowing the connection of the wireless terminal device (S112). can do. The remote control method may further include generating, by the robot cleaner, a confirmation signal for receiving the information data (S170), and transmitting, by the robot cleaner, the confirmation signal to the wireless terminal device (S180). It may include.

When an external user or the like inputs a text message, for example, "9 o'clock for work because of a meeting," through the user interface module 220 on the wireless terminal device 200 (S120), the control module 230 may Generate the information data corresponding to the text (S130), the communication module 210 transmits the information data to the communication unit 110 in the robot cleaner (S140). In the robot cleaner 100 that has received the information data, the voice conversion unit 120 converts the information data into voice data (S150), and the voice output unit 130 converts the voice data into another user in the room. Output to them (S160). For example, the robot cleaner outputs a phone number or name of the user who sent the text message, outputs the time when the text message is sent, and then outputs the text message contents in the form of voice data.

Referring to FIG. 15, in the remote control method of the remote control system, the robot cleaner photographs a cleaning area through the surveillance camera to generate a surveillance image (S210), and the robot cleaner searches for and cleans the cleaning area. Creating a map (S220), connecting the wireless terminal device to the robot cleaner (S241), and when the wireless terminal device is connected to the robot cleaner, the robot cleaner performs the monitoring image and the cleaning map. And transmitting to the wireless terminal device (S244). Here, in the step of connecting the wireless terminal device to the robot cleaner, the step of the wireless terminal device to request the authentication to the robot cleaner (S241), the robot cleaner to determine whether the authentication of the wireless terminal device; (Not shown), and as a result of the determination, the robot cleaner permits connection of the wireless terminal device (S242). The remote monitoring method may further include the step of the robot cleaner compressing the surveillance image (S211) and storing the surveillance image, the compressed surveillance image, or the cleaning map (S230).

The remote monitoring method may include displaying, by the wireless terminal device, the cleaning map (S250), and when a specific location or region is selected, displaying, by the wireless terminal device, a surveillance image for the corresponding location or region (S251). More). The remote monitoring method may include: receiving, by the wireless terminal device, a text (S260); generating, by the wireless terminal device, information data corresponding to the text (S270); The method may further include transmitting information data to the robot cleaner (S280).

The robot cleaner 100 acquires a surveillance image by photographing the surroundings through the surveillance camera 170 (S210). The image processing unit 171 compresses the surveillance image using a compression technique (S211), and the storage unit 180 stores the surveillance image or the compressed surveillance image (S230). In addition, the robot cleaner 100 creates a cleaning map by searching for a cleaning area (S220). When the wireless terminal device 200 executes the remote control program stored in the storage module 240, and then requests the authentication of the wireless terminal device through the communication unit 110 or directly to the authentication unit 150 ( In step S241, the authentication unit 150 permits authentication using information stored in a database stored in itself or in an external device, that is, a wireless terminal device, stored in the storage unit 180 (S242). The wireless terminal device connected to the robot cleaner separately requests a cleaning map and a surveillance image, or transmits a request for transmission at the same time as the connection and receives the cleaning map and the surveillance image from the robot cleaner (S244). The wireless terminal device 200 displays the cleaning map received through the user interface module 220 (S250), and displays a surveillance image for a specific location or a specific area desired by the user (S251). A control command such as controlling the robot cleaner or manipulating the surveillance video screen is received from the user of the wireless terminal device through text input or the like (S260). The wireless terminal device 200 generates the information data corresponding to the content of the text received from the user, etc. (S270), and the communication unit (210) via the communication module 210 to the information data or a control command generated by itself 110) (S280). The control unit 140 controls the robot cleaner based on the control command, or controls the operation of each unit (S290). Here, the control command is a control command for the surveillance camera such as zoom in / zoom out, tilting, a command for confirming the status information of the robot cleaner, various information stored or detected, or a command for driving the respective units. One or more of control commands for the robot cleaner. The control command may mean a control command that selects a desired location or area on the cleaning map and moves the robot cleaner to the location or area, or requests a surveillance image for the location or area. When a user or the like inputs a text message such as "small room cleaning" through the user interface screen on the wireless terminal device 200, the wireless terminal device 200 transmits information data corresponding to a cleaning command to the robot cleaner. The robot cleaner moves to a small room according to the information data to perform cleaning.

Referring to FIG. 16, in the remote control method of the remote control system, the robot cleaner receives a surrounding voice signal (S310), and the robot cleaner extracts a voice command from the voice signal (S320). And generating, by the robot cleaner, a request signal for requesting information data corresponding to the voice command (S330), transmitting, by the robot cleaner, the request signal to an information providing server (S340), and the robot. And a cleaner (S360) for receiving the information data from the information providing server. The remote control method may further include converting the information data into voice data by the robot cleaner (S370), and outputting the voice data by the robot cleaner (S380). The remote control method may further include extracting or generating the information data corresponding to the request signal by the information providing server (S350).

The voice recognition unit 160 receives the surrounding voice signals to remove noise and the like, extracts a voice command such as a user from the voice signals (S310 and S320), and the control unit 140 A request signal for generating information data according to the extracted voice command is generated (S330). The communication unit 110 transmits the request signal to a corresponding information providing server connected in a wired or wireless communication manner (S340). The information providing server 300 transmits the information data corresponding to the request signal to the communication unit 110 (S360). The voice conversion unit 120 converts the received information data into voice data (S370), and the voice output unit 130 outputs the voice data to a user (S380). For example, when a user or the like gives a voice command to the robot cleaner, "What is the weather today?", The robot cleaner generates a request signal for requesting the weather today and transmits the request signal to the information providing server that manages the weather. . When the information providing server transmits the information data about the weather today to the robot cleaner, the robot cleaner converts the information data into voice data, such as "the weather is sunny and sunny, at least 5 degrees, at most 19 degrees". To the user.

As described above, the robot cleaner includes a communication unit for communicating with an external device to receive information data from an information providing server or a wireless terminal device, and a voice conversion unit to convert the information data into voice data. To print. In addition, the remote control system according to the present invention connects to the robot cleaner through a wireless terminal device at a remote location, provides information data through text input, etc., and remotely controls the robot cleaner.

100: robot cleaner 200: wireless terminal device
300: information providing server 400: wireless access device
110: communication unit 120: voice conversion unit
130: audio output unit 140: control unit
150: authentication unit 160: voice recognition unit
210: communication module 220: user interface module
230: control module 240: storage module
111: wireless communication module

Claims (16)

A communication unit connected with an external device to receive information data;
A voice conversion unit for converting the information data into voice data; And
And a voice output unit configured to output the voice data as voice. The method according to claim 1,
And a control unit for extracting a remote control command from the information data and executing the remote control command or an embedded control algorithm. The method of claim 2,
And a voice recognition unit extracting and recognizing a voice command from voice signals generated around the robot cleaner. The method of claim 3,
The control unit generates a request signal for requesting the external device for the information data corresponding to the voice command,
And the communication unit transmits the request signal to the external device. 5. The method according to any one of claims 1 to 4,
And one or more surveillance cameras for photographing the surroundings to generate a surveillance image.
And the communication unit transmits the surveillance image to the external device in response to a request of the external device. 5. The method according to any one of claims 1 to 4,
The control unit searches the surroundings to generate a cleaning map,
And the communication unit transmits the cleaning map to the external device in response to a request of the external device. 5. The method according to any one of claims 1 to 4,
And an authentication unit configured to permit or block the connection of the external device. A robot cleaner for converting and outputting information data received from the outside into voice data; And
And a wireless terminal device for transmitting the information data to the robot cleaner. The method of claim 8, wherein the robot cleaner,
A communication unit connected to the wireless terminal device to receive the information data and to transmit a request signal for requesting the information data;
A voice conversion unit for converting the information data into the voice data;
An audio output unit for audio outputting the audio data; And
And a control unit for extracting a remote control command from the information data and executing the remote control command or an embedded control algorithm. The robot cleaner of claim 9, wherein
And a voice recognition unit extracting and recognizing a voice command from voice signals generated in the vicinity. The method of claim 10,
The control unit generates the request signal for requesting the information data corresponding to the voice command,
And the communication unit transmits the request signal to the wireless terminal device. The robot cleaner of any one of claims 9 to 11, wherein
And an authentication unit that permits or blocks the access of the wireless terminal device. The method of claim 8, wherein the wireless terminal device,
A user interface module to receive a command for generating the information data; And
And a communication module to transmit the information data to the robot cleaner and to receive the request signal. The method of claim 8,
And a wireless connection device connected between the robot cleaner and the wireless terminal device or connected to the robot cleaner and an external network. A robot cleaner which converts and outputs information data received from the outside into voice data and transmits a request signal for requesting the information data to the outside; And
And an information providing server configured to transmit the information data corresponding to the request signal to the robot cleaner. The method of claim 15, wherein the robot cleaner,
A voice recognition unit which extracts and recognizes a voice command from voice signals generated in the vicinity;
A communication unit connected to the information providing server to receive the information data and to transmit the request signal;
A voice conversion unit for converting the information data into the voice data; And
And a voice output unit for voice outputting the voice data.

Images