WO2017097190A1

WO2017097190A1 - Cloud robotics system, implementation method, robot, and robot cloud platform

Info

Publication number: WO2017097190A1
Application number: PCT/CN2016/108798
Authority: WO
Inventors: 王斌; 郭松; 杨光华
Original assignee: 深圳前海达闼云端智能科技有限公司
Priority date: 2015-12-08
Filing date: 2016-12-07
Publication date: 2017-06-15
Also published as: CN105563484A; CN105563484B

Abstract

A cloud robotics system, an implementation method, a robot, and a robot cloud platform. A robot body (101) comprises an acquisition module (401) and a sending module (402). The robot cloud platform (102) comprises a determining module (502), a cloud robotics module (503), and a manual position module (504). The acquisition module (401) is used for acquiring environment information; the sending module (402) is used for sending the environment information to the robot cloud platform (102). The determining module (502) is used for determining the cloud robotics module (503) or the manual position module (504) to process the environment information; and the determined cloud robotics module (503) or manual position module (504) is used for processing the environment information and sending an instruction to the robot body (101). Because the manual position module (504) is added, after the robot body (101) sends acquired environment information to the robot cloud platform (102), the robot cloud platform (102) can perform remote control in two manners to ensure the user service quality, thereby improving the user experience.

Description

Cloud robot system, implementation method, robot and robot cloud platform

Technical field

The invention relates to the field of intelligent robot technology, in particular to a cloud robot system, an implementation method, a robot and a robot cloud platform.

Background technique

At present, automated devices using robotic devices have become more and more popular, and these automated devices operate or control automatically according to prescribed procedures or instructions without human intervention. The use of automated equipment not only frees people from heavy physical labor, part of mental work, and harsh, dangerous work environments, but also expands human organ function and greatly increases labor productivity.

However, at present, almost all the automation devices using robotic devices independently handle specific tasks. The robots and robots of the automation devices lack the ability of mutual assistance or emergency assistance, and cannot guarantee the quality of service to the users, resulting in a reduced user experience.

Summary of the invention

The embodiment of the present invention provides a cloud robot system, an implementation method, a robot, and a robot cloud platform, so as to solve the technical problem that the user experience cannot be guaranteed in the prior art, and the user experience is reduced.

In one aspect, an embodiment of the present invention provides a cloud robot system, including a robot body and a robot cloud platform, where the robot body includes an acquisition module and a sending module, and the robot cloud platform includes a determining module, a cloud robot module, and a manual seat. Module, where

The collecting module is configured to collect environmental information;

The sending module is configured to send the environment information to the robot cloud platform;

The determining module is configured to determine the cloud robot module or the manual agent module to process the environment information;

The determined cloud robot module or manual agent module is configured to process the environment information and send an instruction to the robot body.

The benefits are as follows:

Due to the cloud robot system provided by the embodiment of the present invention, the intervention of the third-party artificial seat module is added to the existing artificial intelligence robot implementation solution, and the terminal-side robot body transmits the collected environmental information to the robot cloud platform, and the robot The cloud platform may first determine whether the environment information is processed by the cloud robot module, or the environment information is processed by the manual agent module, and finally the environment information is processed by the determined cloud robot module or the artificial agent module. And sending an instruction to the robot body on the terminal side, and remotely controlling in two ways to ensure the quality of service to the user and improving the user experience.

In another aspect, an embodiment of the present invention provides a robot, including:

An acquisition module for collecting environmental information;

a sending module, configured to send the environmental information to a robot cloud platform;

And a receiving module, configured to receive the determined instruction sent by the cloud robot module or the artificial seat module of the robot cloud platform.

The benefits are as follows:

After the collected environment information is sent to the robot cloud platform, the cloud robot module of the robot cloud platform or the instruction sent by the manual agent module may be received, ie, It can be controlled by the cloud robot module and the artificial seat module, which solves the technical problem that the cloud robot module is unable to provide services or provide poor service quality if the cloud robot module is busy or faulty in the prior art, and ensures better user satisfaction. Service that enhances the user experience.

In another aspect, an embodiment of the present invention provides a robot cloud platform, including information connection. Receiving module, determining module, cloud robot module and manual seat module, wherein

The information receiving module is configured to receive environment information sent by the robot body;

The benefits are as follows:

The robot cloud platform provided by the embodiment of the present invention may determine whether the environment information is processed by the cloud robot module or is processed by the manual agent module after receiving the environment information sent by the terminal side robot body. The environment information is then processed by the determined cloud robot module or the artificial seat module to process the environment information and send an instruction to the robot body on the terminal side, and the terminal side robot is remotely manipulated in two ways by introducing a manual seat. The ontology ensures the quality of service of the terminal-side robot body to the user, thereby improving the user experience.

In another aspect, an embodiment of the present invention provides a cloud robot system implementation method, including: acquiring, by a robot body, environment information, and transmitting the environment information to the robot cloud platform;

The robot cloud platform receives the environment information sent by the robot body, and the robot cloud platform includes a cloud robot module or a manual agent module, and determines that the environment information is processed by the cloud robot module or the manual agent module;

The determined cloud robot module or manual agent module processes the environmental information and sends an instruction to the robot body.

The benefits are as follows:

Due to the implementation method of the cloud robot system provided by the embodiment of the present invention, the intervention of the third-party artificial seat module is added to the existing artificial intelligence robot implementation solution, and the terminal-side robot body sends the collected environmental information to the robot cloud platform. , the robot cloud platform can be confirmed first Whether the environment information is processed by the cloud robot module, or the environment information is processed by the manual agent module, and finally the environment information is processed by the determined cloud robot module or the manual agent module and an instruction is sent to The robot body on the terminal side is remotely controlled in two ways to ensure the quality of service to the user and improve the user experience.

DRAWINGS

Specific embodiments of the present invention will be described below with reference to the accompanying drawings, in which:

1 is a schematic structural view of a cloud robot system in an embodiment of the present invention;

2 is a schematic diagram showing a selection process of a cloud robot system in an embodiment of the present invention;

3 is a schematic structural diagram of a cloud robot system according to an embodiment of the present invention; FIG. 4 is a schematic structural view of a robot in an embodiment of the present invention;

FIG. 5 is a schematic structural diagram of a robot cloud platform according to an embodiment of the present invention;

6 is a schematic flow chart showing a method for implementing a cloud robot system according to an embodiment of the present invention;

7 is a schematic structural view of a blind guiding helmet in an embodiment of the present invention;

FIG. 8 is a block diagram showing the structure of a housekeeping service robot in an embodiment of the present invention.

detailed description

The embodiments of the present invention are further described in detail with reference to the accompanying drawings, in which FIG. An exhaustive example. And in the case of no conflict, the features in the embodiments and the embodiments in the description can be combined with each other.

In view of the deficiencies of the prior art, embodiments of the present invention provide a cloud robot system, a robot, and a robot cloud platform, which are described below.

FIG. 1 is a schematic structural diagram of a cloud robot system according to an embodiment of the present invention. As shown, the cloud robot system may include a robot body 101 and a robot cloud platform 102, where the robot body includes an acquisition module and a transmission module. Robot cloud platform includes determining module, cloud Robot module and manual seat module, wherein

The collecting module is configured to collect environmental information;

In a specific implementation, the robot body may be a mobile robot structure (such as a housekeeping service robot, a medical robot, a blind robot, etc.), or may be a guide blind helmet, a guide cane, or the like.

The collection module in the robot body may be used to collect environment information, and the environment information may be information such as a sound of a surrounding environment, a voice input by a user, an image or a video of a surrounding environment. The sending module in the robot body can transmit information collected by the collecting module (such as voice, voice, image or video, etc.) to the robot cloud platform via a network in a wireless or wired manner, and is processed by the robot cloud platform.

The cloud platform may include a cloud robot module and a manual seat module. In a specific implementation, the cloud robot module and the artificial seat module both analyze and process environmental information collected by the terminal side robot body, and generate instruction feedback. The ability of the terminal side robot body. Specifically, it is processed by the cloud robot module or processed by the manual agent module, and can be determined by the determining module. Finally, the module determined by the determining module (the cloud robot module or the manual agent module) processes the environment information and sends an instruction to the robot body.

In the embodiment of the present invention, a third-party artificial seat module may be introduced in an existing cloud robot implementation solution, and the robot cloud platform determines whether the cloud robot module remotely controls the robot body, or is the manual seat module Remotely control the robot body, using two methods Remote control to ensure quality of service to users.

In an implementation, the environment information may include the user's selection information, and the determining module may be specifically configured to determine, according to the user's selection information, the cloud information module or the artificial agent that sends the environment information to the robot cloud platform. Module.

In a specific implementation, the user may select, according to his own needs, the robot body to be manipulated by the cloud robot module or the robot body to be operated by the manual seat module. The selection information of the user may be that the robot body is controlled by the cloud robot module, or the robot body may be operated by the artificial seat module.

In the embodiment of the present invention, the user's selection information may be transmitted to the robot cloud platform together with other sound, voice, image or video information, and the determination module of the robot cloud platform may determine the environmental information according to the user's selection. The cloud robot module sent to the robot cloud platform is also a manual seat module.

In the embodiment of the present invention, the user can actively select who controls the robot. Some users may think that the computer processing method is more accustomed and convenient than the manual method, and then the artificial agent mode interaction may be selected, and some other users may feel that the manual method is not as good as the computer processing mode. Faster and more concise, you can choose Cloud Robot mode interaction. In summary, the embodiment of the present invention can allow a user to have an active selection right to satisfy the user's usage habits, and further improve the user experience.

In an implementation, the collecting module may be specifically configured to collect a selection letter of the user by using a switch button. interest.

During the specific implementation, the acquisition module of the robot body can collect the selection information of the user by switching the button, and the user can perform button switching and the like according to his own needs.

The switch button may be a one-piece structure, which is determined by pressing/bounced at both ends, or may be a separate structure. For example, a guide helmet may be provided with a button set on the left ear portion of the helmet and another button set on the helmet. The right ear area. In addition, the switching button may be a method in which one end is pressed, the other end is automatically bounced, or a button is pressed or bounced. The present invention does not limit the specific structure and specific implementation manner of the switching button, as long as the cloud robot module or the artificial seat module can be determined.

The embodiment of the invention collects the user's selection information by switching the button, which is simpler and easier to implement than the voice mode, and can quickly determine the user's selection without performing voice recognition and the like, and improves the processing speed to a certain extent. Save costs.

In implementation, the robot cloud platform may further include:

a determining module, configured to determine whether the complexity of the environment information exceeds a processing range of the cloud robot module, or whether the cloud robot module is faulty;

The determining module may be specifically configured to: when the complexity of the environment information exceeds a processing range of the cloud robot module, or when the cloud robot module fails, determine the manual agent module to process the environment information.

In a specific implementation, the robot cloud platform may further include a determining module, where the determining module determines whether the complexity of the environment information exceeds a processing range of the cloud robot module, and the determining module receives the determining module After the determination result, the cloud robot module or the manual agent module may be determined according to the determination result of the determining module to process the environment information.

In the embodiment of the present invention, after receiving the environment information sent by the robot body, the robot cloud platform may determine whether the cloud robot module can be processed according to the cloud machine. Whether the person can process to determine whether to send the environmental information to the cloud robot module or the manual agent module, the selected right may be on the robot cloud platform side.

In a specific implementation, the environment information may include the user's selection information or the user's selection information, and the environment information includes the user's selection information and the user's selection information is determined by the robot cloud platform. When the results are inconsistent, the robot body (which can be understood as the terminal side or the user) can send a prompt message to inform the user that the selected module cannot provide the service or is not optimal.

The embodiment of the present invention determines whether the environment information is processed by the cloud robot module or the manual agent module by determining the complexity of the environment information, and can intelligently determine whether the cloud robot module can be processed, so that the most A module adapted to process the environmental information to process the environmental information.

In an implementation, the determining module may be specifically configured to: when the complexity of the environment information exceeds a processing range of the cloud robot module, determine the manual agent module to process the environment information.

In a specific implementation, if the complexity of the environment information exceeds the processing range of the cloud robot module, the human agent module may be determined to process the environment information for a better service user.

If the environment information is currently processed for the manual agent module, the manual agent module may continue to be processed; if the cloud robot module is currently processed, the complexity of the environment information is determined to exceed the cloud robot. When the processing range of the module is reached, it can be switched to the manual agent module processing.

In an implementation, the determining module may be specifically configured to: when the complexity of the environment information is within a processing range of the cloud robot module, determine the cloud robot module to process the environment information.

In the embodiment of the present invention, if the complexity of the environmental information is in the cloud robot module Within the scope of processing, in order to reduce labor costs, the environment information may be preferentially processed by the cloud robot module.

In an implementation, the determining module may be further configured to determine whether the cloud robot module is faulty;

The determining module is specifically configured to determine, according to the determination result of the determining module, the cloud robot module or the manual agent module to process the environment information.

In a specific implementation, the determining module of the robot cloud platform may be further configured to determine whether the cloud robot module is faulty, and the determining module of the robot cloud platform may determine the cloud robot module according to the detection result of the detecting module. Or the manual agent module processes the environmental information.

In an implementation, the determining module may be specifically configured to determine, when the cloud robot module fails, the manual agent module to process the environment information.

In the embodiment of the present invention, it is considered that even if the complexity of the environment information is within the processing range of the cloud robot module, if the cloud robot module has a system failure, the user cannot be provided with a service. The determining module can directly determine that the environmental information is processed by the manual agent module to ensure the quality of service to the user.

In an implementation, the determining module may be specifically configured to determine, when the cloud bot module is in normal operation, the cloud bot module to process the environment information.

In a specific implementation, if the detecting module detects that the cloud robot module is all normal, the cloud robot module may be determined to process the environment information. If the complexity of the environment information exceeds the processing range of the cloud robot, it may be determined that the manual agent module is processed; when the cloud robot module is operating normally and the complexity of the environment information is in the cloud When the processing range of the robot module is within the range, the cloud robot module may be determined to process the environment information, and the specific implementation may be set as needed.

FIG. 2 is a schematic diagram showing a selection process of a cloud robot system according to an embodiment of the present invention. The indication may include the following steps:

Step 201: The terminal collects data and sends the data to the cloud platform.

Step 202: Determine whether the user specifies a human agent to intervene;

If the manual agent intervention is specified, step 206 is performed;

If not specified, step 203 is performed;

Step 203: The cloud platform performs intelligent analysis on the data.

Step 204: Determine whether the cloud robot can process;

If it can be processed, step 205 is performed;

If it cannot be processed, go to step 206;

Step 205: The cloud robot module generates a feedback instruction.

Step 206: Manually generate a feedback instruction.

In the embodiment of the present invention, when the complexity of the environment information exceeds the range that the cloud robot module can handle, or when the cloud robot module has a system failure, the manual agent module is automatically switched, and the terminal side may also be based on the user. The personal willingness to manually switch to the manual agent module.

In an implementation, the determining module may specifically include:

a calculating unit, configured to calculate a confidence level for performing speech recognition, face recognition, object recognition, and/or depth calculation on the environmental information;

a comparing unit, configured to compare the confidence level with a preset threshold;

And a determining unit, configured to determine, according to the comparison result, whether the complexity of the environment information exceeds a processing range of the cloud robot module.

In the embodiment of the present invention, when determining whether the complexity of the environment information is within the processing range of the cloud robot, the identifier may be determined by using the index of confidence, and it is assumed that the environment information needs to be recognized by voice, face recognition, object recognition, or depth calculation. Operation, the preset threshold is 95%, then the specific judgment process can be:

1) speech recognition, when the confidence level of the speech recognition is ≥95%, the judgment complexity is within the treatable range, and the cloud robot is determined to process the environmental information;

2) Face recognition, when the confidence level of the face recognition is ≥95%, the judgment complexity is within the treatable range, and the cloud robot is determined to process the environment information;

3) object recognition, when the confidence level of the object recognition is ≥95%, the judgment complexity is within the treatable range, and the cloud robot is determined to process the environmental information;

4) Depth calculation, when the confidence of the depth calculation is ≥95%, the judgment complexity is within the treatable range, and the cloud robot is determined to process the environmental information.

In a specific implementation, the confidence preset thresholds of different operations may be different. The operations of the speech recognition, the face recognition, the object recognition, the depth calculation, and the like may all adopt existing implementation manners, and the calculation of the confidence of these operations may also adopt the existing confidence calculation formula, and the corresponding development and design by those skilled in the art. This can be achieved, and the present invention will not be described herein.

The embodiment of the present invention can use the confidence concept in statistics as a reference to determine whether the complexity of the environmental information is within the machine processable range.

In implementation, the robot body and the robot cloud platform can perform data transmission through a dedicated communication network.

For traditional Internet services, the network transmits messages as pipes. The quality and speed of transmission mostly depend on the network quality and transmission speed of the telecom operators. In the existing cloud robot implementation scheme, the message transmission cannot guarantee the real-time performance of message transmission when the network is busy and the transmission quality is poor, and it is easy to be attacked and invaded by the hacker during the transmission process, and the accuracy and real-time of the message are satisfied. Aspects seriously affect the service to users.

3 is a schematic structural diagram of a cloud robot system according to an embodiment of the present invention. As shown, the cloud robot system may include a terminal side and a cloud platform. The terminal side includes a robot body, and the robot cloud platform includes a cloud robot module. And manual seating modules, where:

The robot body on the terminal side and the cloud robot module or the artificial seat model of the robot cloud platform Blocks can interact through a dedicated communication network.

The embodiment of the present invention supports real-time interaction through a high-speed dedicated transmission network, and the terminal-side robot body can interact with the robot cloud platform via a secure high-speed communication network by means of wireless or wired, and securely protects and accelerates transmission of the transmitted message. It ensures the real-time and accuracy of the message and improves the quality of service to the user.

The embodiment of the invention also provides a robot, which will be described below.

FIG. 4 is a schematic structural diagram of a robot in an embodiment of the present invention. As shown in the figure, the robot may include:

The collecting module 401 is configured to collect environment information.

The sending module 402 is configured to send the environment information to the cloud platform of the robot;

The receiving module 403 is configured to receive the determined instruction sent by the cloud robot module or the artificial seat module of the robot cloud platform.

The robot in the embodiment of the present invention may be a navigation robot, a blind guide robot, or a housekeeping service robot. The shape/structure of the robot may be a movable independent structure (eg, a clean disk shape, a "human" shape, etc.) It can also be a structure such as a guide cane or a blind guide helmet.

The environment information collected by the collection module may be information such as sound, image, video, etc. of the surrounding environment, or voice information sent by the user. The sending module sends the collected environmental information to the robot cloud platform, and the robot cloud platform performs the next processing.

The receiving module may receive an instruction sent by the cloud robot module of the robot cloud platform, or receive an instruction sent by the artificial seat module of the robot cloud platform, which compensates for the prior art that only the cloud robot module can be received. Directives, so that when the cloud robot module is busy or faulty, it can not receive instructions, and thus can not provide users with better service defects.

The robot provided by the embodiment of the present invention can be remotely controlled by the cloud robot module of the robot cloud platform or remotely controlled by the artificial seat module of the robot cloud platform, thereby ensuring the service quality to the user.

In an implementation, the collection module may be configured to collect environment information including selection information of the user, where the selection information may be a cloud computing robot module or a manual agent module to process the environment information.

In a specific implementation, the collected environment information may include selection information of the user, and the selection information of the user may be used to select the cloud robot module to process the environment information, or select a manual agent module to process the environment information.

In the embodiment of the present invention, the user may select to determine which module of the cloud platform processes the environment information, so that the user selects a service manner that conforms to his own usage habit, thereby further improving the user experience.

In implementation, the robot may further include:

The switch button 404 is configured to collect user selection information.

In the embodiment of the present invention, the switching button can be set on the robot, and the user selects the manner in which the user wants to receive the service through the button. In the specific implementation, the user can also select through the voice mode, and the switching button mode is simpler and easier to implement than the voice mode. .

In an implementation, the sending module may be configured to send the environment information to a robot cloud platform via a dedicated communication network; the receiving module may be specifically configured to receive, by using the dedicated communication network, the determined cloud platform of the robot An instruction sent by a Cloud Robot module or a human agent module.

In a specific implementation, the sending module of the robot may use the dedicated communication network to connect the ring The environment information is sent to the robot cloud platform, and the receiving module of the robot can receive the instruction sent by the cloud robot module or the artificial seat module of the robot cloud platform through the dedicated communication network. That is, the robot can perform data interaction with the robot cloud platform through the dedicated communication network.

Since the dedicated communication network can be used for the communication link of the robot and the robot cloud platform, the information transmission speed and security are higher than the existing mobile communication network, and the information security of the user can be ensured, and the information transmission speed is improved. The corresponding user waiting time is greatly reduced, thereby improving the quality of service.

The embodiment of the invention also provides a robot cloud platform, which will be described below.

FIG. 5 is a schematic structural diagram of a robot cloud platform according to an embodiment of the present invention. As shown, the robot cloud platform may include: an information receiving module 501, a determining module 502, a cloud robot module 503, and a manual seating module 504, wherein ,

The information receiving module 501 is configured to receive environment information sent by the robot body;

The determining module 502 is configured to determine the cloud robot module 503 or the manual agent module 504 to process the environment information;

The determined cloud robot module 503 or the artificial seat module 504 is configured to process the environment information and send an instruction to the robot body.

In a specific implementation, the cloud robot module and the artificial seat module may each have the capability of analyzing and processing environmental information collected by the terminal side robot body, and generating an instruction feedback to the terminal side robot body. Specifically, it is processed by the cloud robot module or processed by the manual agent module, and can be determined by the determining module. Finally, the module determined by the determining module (the cloud robot module or the manual agent module) processes the environment information and sends an instruction to the robot body.

In the embodiment of the present invention, a third-party artificial seat module may be introduced in an existing cloud robot implementation solution, and the robot cloud platform determines that the cloud robot module is used to remotely control the machine. The human body is still remotely operated by the manual agent module to manipulate the robot body in two ways to ensure remote service to the user.

In an implementation, the environment information may include the user's selection information, and the determining module may be specifically configured to determine, according to the user's selection information, the cloud robot module or the manual agent module to process the environment information.

In the embodiment of the present invention, the robot cloud platform may receive the user's selection information and other sound, voice, image, or video information, and the determining module of the robot cloud platform may determine to send the environmental information according to the user's selection information. The cloud robot module to the robot cloud platform is also a manual seat module.

The embodiment of the present invention can receive the user's selection information, and the user actively selects who controls the robot. By allowing the user to have the active selection right, the user's usage habit can be satisfied, and the user experience is further improved.

In implementation, the robot cloud platform may further include:

The determining module 505 is configured to determine whether the complexity of the environment information exceeds the cloud machine The processing range of the human module, or whether the cloud robot module is faulty;

The determining module is specifically configured to: when the complexity of the environment information exceeds a processing range of the cloud robot module, or when the cloud robot module fails, determine the manual agent module to process the environment information.

In the embodiment of the present invention, after receiving the environment information sent by the robot body, the robot cloud platform may determine whether the cloud robot module can be processed, and determine whether to send the environment information according to whether the cloud robot can process The cloud robot module is also the manual seat module, and the selected right may be on the robot cloud platform side.

In a specific implementation, the environment information may include the user's selection information or the user's selection information, and the environment information includes the user's selection information and the user's selection information is determined by the robot cloud platform. When the results are inconsistent, the robot body (which can be understood as the terminal side or the user) can be sent a prompt message.

If the environment information is currently processed for the manual agent module, the manual agent module may continue to be processed; if the cloud robot module is currently processed, the complexity of the environment information is determined to exceed the cloud robot. When the module's processing range is available, you can switch to The manual agent module processes.

In the embodiment of the present invention, if the complexity of the environment information is within the processing range of the cloud robot module, in order to reduce labor costs, the environment information may be preferentially processed by the cloud robot module.

In a specific implementation, if the detecting module detects that the cloud robot module is all normal, the cloud robot module may be determined to process the environment information. If the complexity of the environment information exceeds the processing range of the cloud robot, it may be determined that the manual agent module is used for processing, and the specific implementation may be set as needed. When the cloud robot module is operating normally and the complexity of the environment information is within the processing range of the cloud robot module, the cloud robot module may be determined to process the environment information.

In an implementation, the determining module may specifically include:

In an implementation, the information receiving module may be specifically configured to receive environment information sent by the robot body through a dedicated communication network; the determined cloud robot module or the artificial agent module may be specifically configured to process the environment information and pass through a dedicated communication network. Sending an instruction to the robot body.

The embodiment of the invention provides a method for implementing a cloud robot system, which is described below:

FIG. 6 is a schematic flowchart diagram of a method for implementing a cloud robot system according to an embodiment of the present invention. As shown in the figure, the specific steps include:

Step 601: The robot body collects environment information, and sends the environment information to the robot cloud platform.

Step 602: The robot cloud platform receives the environment information sent by the robot body, where the robot cloud platform includes a cloud robot module or a manual seat module.

Step 603: The robot cloud platform determines that the environment information is processed by the cloud robot module or the manual agent module.

Step 604: The determined cloud robot module or manual agent module processes the environment information and sends an instruction to the robot body.

In the embodiment of the present invention, a third-party artificial seat module may be introduced in an existing cloud robot implementation solution, and the robot cloud platform determines whether the cloud robot module remotely controls the robot body, or is the manual seat module Remotely maneuver the robot body and use two methods to remotely control to ensure the quality of service to the user.

And determining, according to the selection information of the user, the environment information to be sent to the cloud robot module or the artificial seat module of the robot cloud platform.

The robot body collects the user's selection information through the switch button. The robot cloud platform determines whether the complexity of the environment information exceeds a processing range of the cloud robot module, or whether the cloud robot module is faulty.

In the embodiment of the present invention, after receiving the environment information sent by the terminal-side robot body, the robot cloud platform may first determine whether the environment information is processed by the cloud robot module or the manual agent module processes the The environment information is then processed by the determined cloud robot module or the artificial seat module to process the environment information and send an instruction to the robot body on the terminal side, and the terminal side robot body is remotely manipulated in two ways by introducing a manual seat. The quality of service provided by the terminal-side robot body to the user is ensured, thereby improving the user experience.

In the embodiment of the present invention, the user can actively select who controls the robot. Some users think that the computer processing method is more accustomed and convenient than the manual method, and then the artificial agent mode interaction can be selected, and some other users may feel that the manual method is not as good as the computer processing method. For faster and more responsive, you can choose Cloud Robot mode interaction. In summary, the embodiment of the present invention can allow a user to have an active selection right to satisfy the user's usage habits, and further improve the user experience.

When the complexity of the environment information exceeds the processing range of the cloud robot module, or the cloud robot module fails, it is determined that the environment information is processed by the manual agent module.

In the embodiment of the present invention, when determining whether the complexity of the environment information is within the processing range of the cloud robot, the identifier may be determined by using the indicator of confidence, and the robot cloud platform determines whether the complexity of the environment information exceeds the cloud robot module. The scope of treatment, including:

Calculating a confidence level for speech recognition, face recognition, object recognition, and/or depth calculation of the environmental information;

And comparing the confidence with a preset threshold;

Whether the complexity of the environmental information exceeds the processing range of the cloud robot module is determined according to the comparison result.

The confidence preset thresholds for different operations may be different. The operations of the speech recognition, the face recognition, the object recognition, the depth calculation, and the like may all adopt existing implementation manners, and the calculation of the confidence of these operations may also adopt the existing confidence calculation formula, and the corresponding development and design by those skilled in the art. This can be achieved, and the present invention will not be described herein.

Since the dedicated communication network can be used for the communication link of the robot and the robot cloud platform, the information transmission speed and security are higher than the existing mobile communication network, and the information security of the user can be ensured.

In order to facilitate the implementation of the present invention, the following description will be made by way of examples.

Embodiment 1

In the embodiment of the present invention, the guide robot is taken as an example. It is assumed that the structure of the guide robot is a helmet structure, and the blind person can wear the guide helmet to the head.

FIG. 7 is a schematic structural view of a guide blind helmet according to an embodiment of the present invention. As shown in the figure, a camera 1 may be directly in front of the guide blind helmet for collecting images, videos and the like of the surrounding environment; The right ear portion of the blind helmet is provided with a switch button 2, and the switch button 2 may include two ends (one end presses to represent the selected cloud robot module, and the other end presses to represent the selected artificial seat module), one end is pressed, and the other end is automatically bounced. Start. By default, the guide helmet can select the cloud robot module by default.

When the blind person wears the guide blind helmet to walk on the road, the guide blind helmet can collect the front image or video information, the current position information of the blind person, and the like in real time, and the image or video information, the position information of the blind person, and the like. Transferred to the robot cloud platform via a dedicated communication network.

The robot cloud platform may first determine whether the blind person has selected a manual seat intervention. If the blind person does not select a manual seat intervention, the robot cloud platform may determine whether the cloud robot module is operating normally:

If the cloud robot failure is detected, the collected information is sent to the manual agent module for processing;

If the cloud robot is running normally, and further determining whether the cloud robot can process the collected information, if the cloud robot is busy, or the collected information has a high complexity, the The collected information is sent to the manual agent module for processing; otherwise, it can be processed by the cloud robot module.

The cloud robot module can perform image recognition, plan a next instruction for the blind according to the current position of the blind person and the preset target position, and the instruction can be a voice instruction such as “continue to advance” and “turn left”.

Because the cloud robot module in the embodiment of the present invention sends the voice command to the guide helmet through a dedicated communication network, the transmission speed is fast, and the prior art transmission through the mobile communication network can be avoided. Affect the situation of guiding the blind.

If the collected information is highly complex (for example, complicated scene pictures), or if the cloud robot is busy, resulting in low processing efficiency or even failure, the robot cloud platform can immediately switch to manual seat processing to ensure blindness. User's guidance.

In addition, during the walking process, the blind person can also manually switch the switching button 2 according to his or her own will, and switch to the manual seat intervention. The robot cloud platform can also immediately switch to the artificial seat mode after receiving the switching instruction. To meet the needs of blind users.

The manual agent module can receive a third party service provider (for example, a customer service staff member) The guide command input by the keyboard, the microphone, and the like is input, and the guide command is sent to the guide helmet to guide the blind user.

The guide blind helmet may further include a microphone/microphone device, so that the blind user can directly issue a voice to issue an instruction. For example, the blind person can directly say "I want to go to the Wangjing subway station, how to go?".

After receiving the voice information, the cloud robot module performs voice recognition, semantic understanding, image recognition, and the like, and may generate a voice command according to the current position of the blind person, and send the voice command to the guide helmet, and the guide blind is used. The helmet plays the voice command to guide the blind person;

When the cloud robot module is unable to process, the human service may be provided, and after receiving the voice information, the service personnel may quickly respond to the blind person's current location. In a specific implementation, the service personnel can input a response instruction through a keyboard/touch screen, or can directly input a voice and input a response instruction by voice.

Embodiment 2

In the embodiment of the present invention, taking the housekeeping service robot as an example, it is assumed that the shape of the housekeeping service robot is similar to the shape of a person, and the housekeeping service robot can move.

Fig. 8 is a view showing the structure of a housekeeping service robot in the embodiment of the present invention, as shown in the figure, which will be described below.

When the user is at home, the user can be voiced to the home service robot. For example, the user speaks "Please help me!".

After receiving the voice information sent by the user, the home service robot may send the voice information and the currently collected image to the computing robot module, and the cloud robot module performs voice recognition on the voice information. Processing, semantic understanding, etc., and then issuing an action instruction to the housekeeping service robot, the action instruction may include a direction command, a walking instruction, a control instruction indicating that the housekeeping service robot picks up the mop, or instructing the housekeeping service robot to perform Mopping the floor and other instructions.

The housekeeping service robot can search according to an instruction sent by the cloud robot module. Go to the mop and carry out the mopping service.

Because the home service robot and the cloud robot module transmit data through a dedicated communication network in the embodiment of the present invention, the speed of the transmission instruction is fast, and the user can quickly provide the mopping service, so that the user feels better.

Assuming that the user wants to cook, the domestic service robot can be voiced. For example, the user's content is "Please help the rice cooker to make two meals for two people."

At this time, after receiving the voice instruction of the user, the housekeeping service robot sends the voice command to the robot cloud platform through a dedicated communication network, and the robot cloud platform determines that the voice command of the user is too complicated. If the cloud robot module is unable to process, the manual agent module may be involved.

In a specific implementation, it is assumed that the robot cloud platform determines that the cloud robot module can process the voice instruction of the user, but the user thinks that the service efficiency of the housekeeping service robot is poor, and the user may also request to switch to Manual mode. Specifically, the switching may be indicated by a button or a voice, and the selection information of the user may be sent to the robot cloud platform, and the robot cloud platform may perform corresponding switching according to the user's selection information.

The manual agent module may select an idle service personnel to send the user's voice command to the service personnel. The service personnel may find the placement position of the rice and the millet in the user's kitchen according to the image or video information collected by the housekeeping service robot, and instruct the robot to perform corresponding operation steps.

In a specific implementation, if the service personnel cannot determine the placement position of the rice and the millet, the voice command may be sent to the user for help, for example, "Where is the rice placed?", etc., after receiving the feedback from the user. Follow up.

Embodiment 3

The embodiment of the present invention takes the guide robot as an example, and assumes that the shape of the guide robot is still similar to the shape of a person and can be moved.

A plurality of the guide robots may be set in the tourist scenic spot, and the manager may perform different settings on the tour guide robot in advance, which may be set according to the tour route of the visitor.

After the tour guide robot is started, it can first determine and collect the tourist information it leads and send it to the cloud. Then, the tourists are instructed in order according to the preset order of attractions.

For example, after the navigation robot is turned on, a simple self-introduction can be first performed according to the set program, and the location of the navigation robot is sent to the cloud, and the cloud robot module instructs the navigation robot according to the preset tour route. Traveling to the first attraction, the tour guide robot can issue a voice such as "Please come with me/please walk here" during the tour to indicate the traveler.

After reaching the first attraction, the tour guide acquires image information and sends the image information to the cloud robot module, and the cloud robot module determines, according to the pre-collected visitor information, whether the visitor has correctly followed the first attraction, and determines the visitor. After the first attraction has been reached, the cloud robot module may send the pre-recorded scenic spot description information to the tour guide robot, and the guide robot may play and introduce the first attraction to the visitor.

Since the tour guide robot and the cloud are transmitted through a dedicated communication network in the embodiment of the present invention, it is ensured that the introduction of the sights that the visitor hears does not appear to be stuck.

When the visitor feels that the cloud robot module performs poorly performing services such as attraction introduction, or wants to perform an interaction such as asking questions, the user can switch to the manual seat mode according to the individual's will, and the robot cloud platform can be switched according to the selection of the visitor. To the artificial seating module, the introduction of attractions or answering questions from tourists, etc., thus increasing the satisfaction of tourists.

For convenience of description, the various parts of the above described devices are described in terms of functions divided into various modules or units. Of course, the functions of the various modules or units may be implemented in one or more software or hardware in the practice of the invention.

Those skilled in the art will appreciate that embodiments of the present invention can be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment, or a combination of software and hardware. Moreover, the invention can be employed in one Or in the form of a computer program product embodied on a computer usable storage medium (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer usable program code.

The present invention has been described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (system), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or FIG. These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing device to produce a machine for the execution of instructions for execution by a processor of a computer or other programmable data processing device. Means for implementing the functions specified in one or more of the flow or in a block or blocks of the flow chart.

The computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device. The apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.

These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device. The instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.

While the preferred embodiment of the invention has been described, it will be understood that Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and the modifications and

Claims

A cloud robot system, comprising: a robot body and a robot cloud platform, the robot body comprising an acquisition module and a sending module, wherein the robot cloud platform comprises a determining module, a cloud robot module and a manual seat module, wherein

The collecting module is configured to collect environmental information;

The sending module is configured to send the environment information to the robot cloud platform;

The determining module is configured to determine the cloud robot module or the manual agent module to process the environment information;

The determined cloud robot module or manual agent module is configured to process the environment information and send an instruction to the robot body.
The cloud robot system according to claim 1, wherein the environment information includes selection information of the user, and the determining module is specifically configured to determine, according to the selection information of the user, to send the environmental information to the Cloud robot module or manual seat module of the robot cloud platform.
The cloud robot system according to claim 2, wherein the acquisition module is specifically configured to collect user selection information by using a switch button.
The cloud robot system according to claim 1, wherein the robot cloud platform further comprises: a determining module, configured to determine whether the complexity of the environment information exceeds a processing range of the cloud robot module, or Whether the cloud robot module is faulty;

The determining module is specifically configured to: when the complexity of the environment information exceeds a processing range of the cloud robot module, or when the cloud robot module fails, determine the manual agent module to process the environment information.
The cloud robot system according to claim 4, wherein the determining module comprises:

a calculating unit, configured to perform voice recognition, face recognition, and object on the environmental information Confidence in identification and/or depth calculation;

a comparing unit, configured to compare the confidence level with a preset threshold;

And a determining unit, configured to determine, according to the comparison result, whether the complexity of the environment information exceeds a processing range of the cloud robot module.
The cloud robot system according to claim 1, wherein the robot body and the robot cloud platform perform data transmission via a dedicated communication network.
A robot characterized by comprising:

An acquisition module for collecting environmental information;

a sending module, configured to send the environmental information to a robot cloud platform;

And a receiving module, configured to receive the determined instruction sent by the cloud robot module or the artificial seat module of the robot cloud platform.
The robot according to claim 7, wherein the collection module is specifically configured to collect environment information including selection information of the user, and the selection information is to select a cloud robot module or a manual agent module to process the environment information.
The robot of claim 8 further comprising:

A toggle button for collecting user selection information.
The robot terminal according to claim 7, wherein the transmitting module is specifically configured to send the environmental information to a robot cloud platform via a dedicated communication network; and the receiving module is specifically configured to receive by the dedicated communication network The determined instructions sent by the cloud robot module or the artificial seat module of the robot cloud platform.
A robot cloud platform, comprising: an information receiving module, a determining module, a cloud robot module and a manual seat module, wherein

The information receiving module is configured to receive environment information sent by the robot body;

The determining module is configured to determine the cloud robot module or the manual agent module to process the environment information;

The determined cloud robot module or manual agent module is configured to process the environment information and send an instruction to the robot body.
The robot cloud platform according to claim 11, wherein the environment information includes selection information of the user, and the determining module is specifically configured to determine the cloud robot module or the artificial according to the selection information of the user. The agent module processes the environmental information.
The robot cloud platform according to claim 11, further comprising: a determining module, configured to determine whether the complexity of the environment information exceeds a processing range of the cloud robot module, or whether the cloud robot module appears malfunction;

The determining module is specifically configured to: when the complexity of the environment information exceeds a processing range of the cloud robot module, or when the cloud robot module fails, determine the manual agent module to process the environment information.
The robot cloud platform according to claim 13, wherein the determining module specifically comprises:

a calculating unit, configured to calculate a confidence level for performing speech recognition, face recognition, object recognition, and/or depth calculation on the environmental information;

a comparing unit, configured to compare the confidence level with a preset threshold;

And a determining unit, configured to determine, according to the comparison result, whether the complexity of the environment information exceeds a processing range of the cloud robot module.
The robot cloud platform according to claim 11, wherein the information receiving module is specifically configured to receive environment information sent by the robot body through a dedicated communication network; the determined cloud robot module or the artificial seat module is specifically used for Processing the environmental information and transmitting instructions to the robot body via a dedicated communication network.
A method for implementing a cloud robot system, comprising:

At the robot body, collecting environmental information, and transmitting the environmental information to the robot cloud platform;

Receiving, by the robot cloud platform, the environment information sent by the robot body, where the robot cloud platform includes a cloud robot module or a manual seat module;

Determining, by the cloud cloud platform or the manual agent module, the environment information; calling the determined cloud robot module or the artificial agent module, processing the environment information, and sending an instruction to the The robot body.
The method according to claim 16, wherein the environment information includes selection information of the user, including:

And determining, according to the selection information of the user, the environment information to be sent to the cloud robot module or the artificial seat module of the robot cloud platform.
The method of claim 17 wherein at the robot body, the toggle button collects selection information for the user.
The method according to claim 16, wherein at the robot cloud platform, it is determined whether the complexity of the environment information exceeds a processing range of the cloud robot module, or whether the cloud robot module fails;

When the complexity of the environment information exceeds the processing range of the cloud robot module, or the cloud robot module fails, it is determined that the environment information is processed by the manual agent module.
The method of claim 19, wherein, at the robot cloud platform, determining whether the complexity of the environment information exceeds a processing range of the cloud robot module comprises:

Calculating a confidence level for speech recognition, face recognition, object recognition, and/or depth calculation of the environmental information;

And comparing the confidence with a preset threshold;

Whether the complexity of the environmental information exceeds the processing range of the cloud robot module is determined according to the comparison result.
The method of claim 16 wherein said robotic body and said robotic cloud platform communicate data over a dedicated communication network.
A cloud robot apparatus, comprising: a robot apparatus and a server; the robot apparatus and the server each comprise: a processor, a memory, and a communication component; the memory and communication component are coupled to the processor, the processor configured to perform storage in the memory Instruction code; the instruction code stored in the memory of the robot for causing the processor to perform the steps performed at the robot body in any one of claims 16-21: the instruction code stored in the memory of the server is used to cause the processor to execute accordingly The steps performed at the robot cloud platform.