CN114239884A - Robot operation and maintenance method and system - Google Patents

Robot operation and maintenance method and system Download PDF

Info

Publication number
CN114239884A
CN114239884A CN202111654431.6A CN202111654431A CN114239884A CN 114239884 A CN114239884 A CN 114239884A CN 202111654431 A CN202111654431 A CN 202111654431A CN 114239884 A CN114239884 A CN 114239884A
Authority
CN
China
Prior art keywords
robot
maintenance
page
display page
instruction
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111654431.6A
Other languages
Chinese (zh)
Inventor
周俊杰
方玲
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Suzhou Youzhida Robot Co ltd
Original Assignee
Suzhou Youzhida Robot Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Suzhou Youzhida Robot Co ltd filed Critical Suzhou Youzhida Robot Co ltd
Publication of CN114239884A publication Critical patent/CN114239884A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/20Administration of product repair or maintenance
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04842Selection of displayed objects or displayed text elements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/0486Drag-and-drop
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L17/00Speaker identification or verification techniques
    • G10L17/22Interactive procedures; Man-machine interfaces
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/695Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/181Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Business, Economics & Management (AREA)
  • Signal Processing (AREA)
  • Human Resources & Organizations (AREA)
  • Acoustics & Sound (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Health & Medical Sciences (AREA)
  • Economics (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Marketing (AREA)
  • Operations Research (AREA)
  • Quality & Reliability (AREA)
  • Strategic Management (AREA)
  • Tourism & Hospitality (AREA)
  • General Business, Economics & Management (AREA)
  • Manipulator (AREA)

Abstract

The invention relates to a robot operation and maintenance method and system, wherein the method comprises the following steps: displaying operation and maintenance information of the robot in an operation and maintenance display page, wherein the operation and maintenance information comprises a map of a working area of the robot and a video acquired by the robot; and receiving an operation instruction generated through the operation and maintenance display page, and sending the operation instruction to the robot, wherein the operation instruction is used for controlling the robot to execute a corresponding action. By the robot operation and maintenance method, a map and a field video of a robot working area can be conveniently checked in an operation and maintenance display page, and an operation instruction is sent to the robot through the operation and maintenance display page to control the robot to execute corresponding actions. The whole process does not need to switch equipment, is visual and clear, can finish remote monitoring and control on the robot on one equipment, and improves the working efficiency of the robot.

Description

Robot operation and maintenance method and system
Cross Reference to Related Applications
The present application claims priority of chinese patent application having application number 202110014794.7 and entitled "robot operation and maintenance method and system" filed in the chinese patent office on 06/01/2021, the entire contents of which are incorporated herein by reference.
Technical Field
The invention relates to the field of robot control, in particular to a robot operation and maintenance method and system.
Background
With the development of the robot technology, the remote monitoring, control and exception handling of the robot become more and more important, and the efficient remote operation and maintenance system can greatly improve the working efficiency and reliability of the robot.
In the conventional technology, remote operation and maintenance of a robot often need to operate a plurality of devices simultaneously, and operation and maintenance personnel cannot complete tasks such as monitoring, controlling and exception handling of the robot on one device. The operation speed can be reduced by switching among different devices, the abnormity of the robot cannot be timely and accurately processed, and the working efficiency of the robot is reduced.
Disclosure of Invention
Therefore, it is necessary to provide a robot operation and maintenance method and system for solving the problem of reduced working efficiency of the robot due to inconvenient operation of the conventional operation and maintenance system.
A robot operation and maintenance method comprises the following steps: displaying operation and maintenance information of the robot in an operation and maintenance display page, wherein the operation and maintenance information comprises a map of a working area of the robot and a video acquired by the robot; and receiving an operation instruction generated through the operation and maintenance display page, and sending the operation instruction to the robot, wherein the operation instruction is used for controlling the robot to execute corresponding actions.
According to the robot operation and maintenance method, the map and the field video of the working area of the robot can be checked through the operation and maintenance display page, and the operation instruction is sent to the robot through the operation and maintenance display page to control the robot to execute the corresponding action. The whole process does not need to switch equipment, is visual and clear, can finish remote monitoring and control on the robot on one equipment, and improves the working efficiency of the robot.
In one embodiment, the video and the map are in the same operation and maintenance display page and can be switched with each other. Through the switching of videos and maps, operation and maintenance personnel can conveniently switch and watch the key points according to actual conditions, and the practicability of the robot operation and maintenance method in the application is improved.
In one embodiment, the operation instructions include: instructions for controlling the robot to move forward, backward, leftward, rightward and/or rotate; and/or switching the instructions of the cameras on different directions of the robot; and/or instructions to control the rotation of the camera. Through the operation instruction, operation and maintenance personnel can send out a control instruction while checking the position and the field information of the robot, equipment switching is not needed, the unification of monitoring and controlling is realized, and the overall working efficiency is improved.
In one embodiment, the operation and maintenance method for the robot further includes: displaying prompt information of the abnormal robot; the prompt message comprises a mark displayed in a first color, the first color is different from a second color, and the second color is the color of the mark displayed when the robot is in a normal state. The abnormal robot is displayed in a color different from that in a normal state, so that operation and maintenance personnel can find the abnormal robot in time and maintain the abnormal robot.
In one embodiment, the operation and maintenance method for the robot further includes: and responding to the page switching instruction, and switching the operation and maintenance display page to a corresponding operation and maintenance display page. By responding to the page switching instruction, the operation and maintenance display page with other functional items can be switched, operation and maintenance personnel can conveniently carry out more specific operation and maintenance operation, and the operation and maintenance method of the robot in the application is enriched and refined.
In one embodiment, the page switching instruction is an instruction generated by triggering a target robot in the operation and maintenance page, wherein the target robot is one of a plurality of robots; responding to the page switching instruction, and switching the operation and maintenance display page to a corresponding operation and maintenance display page, wherein the operation and maintenance display page comprises the following steps: and responding to the page switching instruction, and switching the operation and maintenance page to an operation and maintenance display page corresponding to the target robot. The operation and maintenance display page of the target robot can be switched to by responding to the page switching instruction generated by triggering the target robot in the operation and maintenance page, so that the target robot is controlled in a targeted manner and the operation and maintenance information of the target robot is checked, remote monitoring, control and exception handling of a plurality of robots can be realized on the same equipment, and the efficiency of the operation and maintenance system is greatly improved.
In one embodiment, the operation and maintenance display page further comprises an associated equipment page associated with the task executed by the robot, and the state information of the associated equipment associated with the robot and/or the live video shot by the associated equipment are displayed in the associated equipment page. By associating the equipment page, the information or video of the equipment associated with the task executed by the robot can be checked, so that the functions of the operation and maintenance system can be flexibly expanded, and the application scene of the operation and maintenance system is expanded.
In one embodiment, an association operation instruction is sent to the association device through an association device page, and the association operation instruction is used for controlling the association device to execute a corresponding action. By sending the associated operation instruction to the associated equipment, other equipment can be called to cooperate with the robot to execute the task, and the efficiency of the robot to execute the task is improved.
In one embodiment, the operation and maintenance display page includes: the voice interaction page is used for acquiring voice playing contents through the voice interaction page and playing the voice playing contents by the robot; the method for acquiring the voice playing content comprises the following steps: text input and/or voice input. Through the voice interaction page, the voice to be played can be conveniently transmitted to the robot, communication between operation and maintenance personnel and field personnel is facilitated, third-party equipment is not needed, and cost is saved.
In one embodiment, the operation and maintenance display page further includes: and the scene selection page is used for switching the sound type when the voice is played. Through the sound type when switching the robot and playing pronunciation, can adapt to different scene demands, improve the intelligent degree of robot, be favorable to using widely of robot.
A robot operation and maintenance system executes the steps of the method of any one of the embodiments. The robot operation and maintenance system can assist operation and maintenance personnel to complete tasks such as monitoring, controlling and exception handling of the robot on the same equipment, and greatly improves the working efficiency of the robot. For the fault of the robot, the operation and maintenance personnel can carry out remote maintenance through the robot operation and maintenance system, or control the robot to a maintenance site of an accessory to be maintained by field workers, or inform the field maintenance personnel of the accurate position of the robot, so that the field maintenance personnel can quickly and accurately find the robot.
Drawings
FIG. 1 is a flowchart illustrating a method for operation and maintenance of a robot according to an embodiment;
FIGS. 2-1 and 2-2 are schematic diagrams of two ways of presenting a map and video, respectively, in the embodiment of FIG. 1;
FIG. 3 is a diagram illustrating an operation and maintenance display page for generating operation instructions according to an embodiment;
FIG. 4 is a flowchart illustrating a method for maintaining a robot in another embodiment;
FIG. 5 is a flowchart illustrating a method for maintaining a robot in accordance with another embodiment;
FIG. 6 is a flowchart of a method of an embodiment of the operation and maintenance method of the robot in the embodiment shown in FIG. 5;
FIG. 7 is a flowchart illustrating a method for using a page of associated equipment in the operation and maintenance method of the robot according to an embodiment;
fig. 8-1 and 8-2 are schematic diagrams illustrating two display manners of a video of an associated device, a live video and a map in the operation and maintenance method of the robot in an embodiment, respectively;
fig. 9 is a schematic diagram illustrating state information and/or control identifiers of associated devices in the robot operation and maintenance method according to an embodiment;
fig. 10 is a schematic diagram illustrating order information in the robot operation and maintenance method according to an embodiment.
Detailed Description
To facilitate an understanding of the invention, the invention will now be described more fully with reference to the accompanying drawings. Preferred embodiments of the present invention are shown in the drawings. This invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete.
Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. The terminology used in the description of the invention herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used herein, the term "and/or" includes any and all combinations of one or more of the associated listed items.
In the description of the present application, it is to be understood that the terms "center", "lateral", "upper", "lower", "left", "right", "vertical", "horizontal", "top", "bottom", "inner" and "outer" etc. indicate orientations or positional relationships based on those shown in the drawings, and are only for convenience in describing the present application and simplifying the description, but do not indicate or imply that the referred device or element must have a particular orientation, be constructed in a particular orientation, and be operated, and thus should not be construed as limiting the present application. Further, when an element is referred to as being "formed on" another element, it can be directly connected to the other element or intervening elements may also be present. When an element is referred to as being "connected" to another element, it can be directly connected to the other element or intervening elements may also be present. In contrast, when an element is referred to as being "directly on" another element, there are no intervening elements present.
Where the terms "comprising," "having," and "including" are used herein, another element may be added unless an explicit limitation is used, such as "only," "consisting of … …," etc. Unless mentioned to the contrary, terms in the singular may include the plural and are not to be construed as being one in number.
As shown in fig. 1, an embodiment of the present application provides a robot operation and maintenance method, including:
s1: and displaying the operation and maintenance information of the robot in an operation and maintenance display page, wherein the operation and maintenance information comprises a map of a working area of the robot and a video acquired by the robot.
S2: and receiving an operation instruction generated through the operation and maintenance display page, and sending the operation instruction to the robot, wherein the operation instruction is used for controlling the robot to execute corresponding actions.
The operation and maintenance display page can be an operation page displayed on the touch screen, and can display a map, a video and operation buttons, so that operation and maintenance personnel can conveniently obtain operation and maintenance information of the robot. And sending an operation instruction to the robot through the operation and maintenance display page.
In step S1, the operation and maintenance information of the robot is displayed through the operation and maintenance display page, and the operation and maintenance information includes: the map of the working area of the robot and the live video shot by the camera arranged on the robot body. The position of the robot and the orientation of the robot can be clearly marked in the map, and the surrounding environment can also be displayed in a common display mode in an electronic map, such as floor layout, or display of roads and buildings, so that operation and maintenance personnel can conveniently and intuitively obtain the position information and the working environment information of the robot from the map. In other embodiments of the disclosure, the transmitted field video can be shot by the camera mounted on the robot body, so that the operation and maintenance personnel can visually check the field situation at the visual angle of the robot and more directly know the field situation. By integrating the map information and the on-site video information, an operator can more comprehensively master the on-site situation and make more accurate operation instructions according to the situation.
In step S2, the operation command generated through the operation and maintenance display page is transmitted to the robot located on the site, and the robot performs a corresponding action according to the operation command. Corresponding operation instructions can be generated by clicking or touching virtual buttons on the operation and maintenance display page, and the operation instructions are transmitted to a technician on site in a wireless or wired mode to control the robot to execute corresponding actions. Optionally, the operation instruction generated through the operation and maintenance display page includes controlling the robot to move towards the target direction. Optionally, the operation instruction further includes: shutdown, restart, fault self-check, etc. The operation and maintenance personnel can determine the next operation instruction according to the state of the robot after executing the command and by combining the field situation. For example, when the robot malfunctions and cannot be solved by remote operation, the robot is controlled to a nearby manual maintenance station; or when the robot sends a low-power reminder, the robot is timely controlled to charge to the charging point of the accessory.
In the operation and maintenance method for the robot in the embodiment, the map and the live video of the working area of the robot can be checked through the operation and maintenance display page, and the operation instruction is sent to the robot through the operation and maintenance display page to control the robot to execute the corresponding action. The whole process does not need to switch equipment, is visual and clear, can finish remote monitoring and control on the robot on one equipment, and improves the working efficiency of the robot.
In one example, as shown in fig. 2-1 and 2-2, the video and the map in the above embodiment are in the same operation and maintenance display page and can be switched with each other. The video and the map information are displayed on the same page, and the two kinds of information are mastered at the same time, so that the method is visual and clear. On the basis of displaying on the same page, the video and the map can be flexibly switched between a large image and a small image. Specifically, when the operation and maintenance personnel need to mainly view map information, the map can be switched to be displayed as a large map, and a video is displayed by using a small map; when the operation and maintenance personnel need to intensively view the live video, the video can be cut into a large image for display, and the map can be displayed in a small image. The position of the small picture can be fixed at the lower left corner, or can be set to be dragged at will, so that operation and maintenance personnel can drag the small picture to a position which does not influence the display information of the large picture. Specifically, the switching manner between the video and the map may be a single click of the thumbnail display. Through the mode of big-small picture switching, the operation and maintenance personnel can select to watch the key point in a flexible way, convenient and fast.
In one example, the operational instructions include: instructions for controlling the robot to move forward, backward, leftward, rightward and/or rotate; and/or switching the instructions of the cameras on different directions of the robot; and/or instructions to control the rotation of the camera. Specifically, as shown in fig. 3, a control button for controlling the movement of the robot is provided on the operation and maintenance display page, and includes four directional arrows, front, back, left, and right, and a sensing dot located in the center. When the operation and maintenance personnel drag the induction dots to the corresponding direction arrows, a control instruction for moving towards the direction can be sent out, and the robot makes an action for moving towards the direction according to the control instruction. For example, when the sensing circle point is dragged to the position of the right arrow, a control instruction for moving right is sent out, and the robot located on the work site moves right.
A plurality of cameras can be installed on the robot body, and each camera is distributed in different directions on the robot body. The operation instructions also comprise instructions for switching the cameras in different directions of the robot. Through switching different cameras, the watching visual angle of the robot can be changed more quickly, the rotation of the robot is reduced, and the energy consumption is reduced. In addition, the operation instruction also comprises an instruction for controlling the camera to rotate, and the operation and maintenance personnel can adjust the shooting angle of the robot camera according to the requirement, so that the shooting range is expanded.
In an example, as shown in fig. 4, there is provided a robot operation and maintenance method, which on the basis of the embodiment shown in fig. 1, further includes:
s3: and displaying prompt information of the abnormal robot.
The prompt message comprises a mark displayed in a first color, the first color is different from a second color, and the second color is the color of the mark displayed when the robot is in a normal state. Alternatively, the first color may be a conspicuous color, or a color commonly used to identify faults, such as red or yellow. The second color may be a color commonly used to identify a normal state, such as green or white. The marking may be a simplified robot pattern or use dots directly as a marking. Usually, the identification is used in conjunction with a number indicating the serial number of the robot to unambiguously indicate which robot is in a fault state and which robot is in a normal working state.
In one embodiment, the operation and maintenance display page can also display the date, the time and the electric quantity information of the robot, and according to the displayed electric quantity information, the operation and maintenance personnel can know whether the robot is in a charging state and whether the current electric quantity is enough to support the robot to complete the next task. When the robot is low in power, the power information displayed in the screen changes to prompt the operation and maintenance personnel, for example, the mark displaying the remaining power changes color (e.g., becomes red).
In an example, as shown in fig. 5, there is provided a robot operation and maintenance method, which on the basis of the embodiment shown in fig. 1, further includes:
s4: and responding to the page switching instruction, and switching the operation and maintenance display page to a corresponding operation and maintenance display page. The page switching instruction is an instruction generated by triggering a target robot in the operation and maintenance display page, and the target robot is one of the robots.
Optionally, as shown in fig. 6, the method for switching the operation and maintenance display page includes:
s41: and responding to the page switching instruction, and switching the operation and maintenance display page to an operation and maintenance display page corresponding to the target robot.
Specifically, the (identifier of the) target robot in the operation and maintenance display page may be triggered to generate a corresponding page switching instruction. If a plurality of robots exist, the operation and maintenance display page lists the robot identifiers corresponding to the robots, and when the operation and maintenance information of a certain robot needs to be checked, the operation and maintenance display page corresponding to the robot (target robot) can be switched to by triggering (clicking or touching) the identifier corresponding to the robot. Then, the corresponding operation instruction can be selected according to the actual state of the robot, such as: and opening debugging, restarting the upper computer, controlling movement and the like. Illustratively, when a certain robot identifier turns red, indicating that the robot has a fault, by clicking the robot identifier, the operation and maintenance display page corresponding to the robot can be switched to, and the video and map information of the robot is displayed.
In one example, as shown in fig. 7, the operation and maintenance display page further includes an associated device page associated with a task performed by the robot, and the state information of the associated device associated with the robot and/or the live video captured by the associated device are displayed in the associated device page. Optionally, the associated apparatus comprises a container and/or an elevator. Taking a container as an example, the state information of the associated device may include: whether the container is networked online and whether the container door is in an open state. Optionally, a camera can be further installed in the container to shoot the video picture inside the container in real time.
As shown in fig. 8-1 and 8-2, the video provided by the associated device and the live video can be displayed on the same page and switched with each other. For example, when the video frame inside the container is displayed in the small frame at the upper left corner, the main video frame can be switched to the video frame inside the container by clicking the small frame, so that the operation and maintenance personnel can observe the state inside the container when the container is shipped, and know information such as whether the number of shipped commodities is accurate and the types of the shipped commodities are consistent. When the associated device is an elevator, the state information of the associated device may include: whether the elevators are networked online and whether an elevator has failed. Optionally, when the elevator is internally provided with the camera, the video shot by the camera can be displayed through the operation and maintenance display page.
In one example, with continuing reference to fig. 7, the robot operation and maintenance method further includes:
s5: and sending a correlation operation instruction to the correlation equipment through the correlation equipment page, wherein the correlation operation instruction is used for controlling the correlation equipment to execute corresponding actions.
Specifically, taking an elevator as an example, as shown in fig. 9, the operation and maintenance display page displays status information of all associated elevators in a form of a list (i.e., whether the elevators are networked online and can receive an operation command). Through clicking the identifier of the corresponding elevator, a call instruction can be sent to the elevator, and remote call operation is realized. In addition, the numbers corresponding to the target floors can be selected on the operation and maintenance display page, and the target floor instructions are sent to the elevators.
Optionally, as shown in fig. 10, information of multiple associated devices may be integrated and displayed on the same page to obtain more comprehensive information. For example, for a delivery robot, the task completion status of each robot and detailed order information, such as order number, cell phone number, room number, container number, and elevator number, may be displayed in an operation and maintenance display page. Therefore, the operation and maintenance personnel can quickly and intuitively know the task completion condition of the robot.
In one example, the operation and maintenance display page may further include: the voice interaction page is used for acquiring voice playing contents through the voice interaction page and playing the voice playing contents by the robot; the method for acquiring the voice playing content comprises the following steps: text input and/or voice input. Specifically, when the operation and maintenance personnel need to perform voice communication with the field personnel through the robot, the operation and maintenance personnel can use the voice interaction page in the operation and maintenance display page to perform operation. For example, the operation and maintenance personnel can input the text content to be expressed in the voice interaction page, and after clicking 'confirm', the robot plays the text content in a voice mode. Optionally, the operation and maintenance personnel can also input the content to be expressed in a voice mode on the voice interaction page, and after the confirmation is clicked, the robot plays the voice on the working site.
In one example, the operation and maintenance display page further comprises a scene selection page, and the sound type of the voice is switched to play through the scene selection page. In order to increase the interest of the robot voice playing and make the robot voice playing less cool and boring, the operation and maintenance personnel can set the voice type of the voice playing on the scene selection page. Optionally, the sound types include: acoustic, children, fun, uncle, rale, heavy metals, etc. For example, if the service object of the robot is primarily a child, the sound type may be selected as "child" to improve the child's sense of identity with the robot. For example, if the robot is in a serious occasion, such as performing fault maintenance, an "original sound" may be selected to reduce the distraction of the attention of workers and improve the working efficiency. The operation and maintenance method for the robot in the embodiment can adapt to different scene requirements by switching the sound types, can improve the intelligence degree of the robot to a certain extent, and is convenient for popularization and use of the robot.
Another aspect of the present application further provides a robot operation and maintenance system, which may perform the steps of the method in any of the above embodiments. The robot operation and maintenance system can be communicated and interconnected with the robot to receive video information and map information of the robot. The video information is shot and acquired through a camera installed on the robot. In addition, the robot body is also provided with a laser radar, the laser radar scans the surrounding environment to obtain point cloud data, surrounding map information is identified according to the point cloud data and is transmitted back to the robot operation and maintenance system, and the map information of the robot is displayed on an operation and maintenance display page.
The utility model discloses a plurality of robots can be connected simultaneously to the robot fortune dimension system, through clicking the sign of different robots, can switch to the fortune dimension show page that this robot corresponds, realizes using same equipment to the remote monitoring, control and the exception handling of a plurality of robots, greatly improves the work efficiency of fortune dimension personnel and robot. Specifically, when the robot has a fault, the operation and maintenance personnel can implement remote maintenance through the robot operation and maintenance system, or control the robot to a maintenance station of an accessory to be maintained by field workers, or inform the field maintenance personnel of the accurate position of the robot, so that the field maintenance personnel can quickly and accurately find the robot.
Through the robot operation and maintenance system disclosed by the application, operation and maintenance personnel can also check equipment information associated with the execution of tasks by the robot, or send an operation instruction through the robot operation and maintenance system to control associated equipment to cooperate with the robot to execute the tasks, so that the efficiency of the robot to execute the tasks is further improved. For example, when the robot needs to take the elevator, the elevator in an idle state is called in advance by the robot operation and maintenance system to reach the floor where the robot is located, and the time for the robot to wait for the elevator is reduced.
The technical features of the embodiments described above may be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the embodiments described above are not described, but should be considered as being within the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above-mentioned embodiments only express several embodiments of the present invention, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the inventive concept, which falls within the scope of the present invention. Therefore, the protection scope of the present patent shall be subject to the appended claims.

Claims (10)

1. A robot operation and maintenance method is characterized by comprising the following steps:
displaying operation and maintenance information of the robot in an operation and maintenance display page, wherein the operation and maintenance information comprises a map of a working area of the robot and a video acquired by the robot;
and receiving an operation instruction generated through the operation and maintenance display page, and sending the operation instruction to the robot, wherein the operation instruction is used for controlling the robot to execute a corresponding action.
2. The robotic operation and maintenance method according to claim 1, wherein the video and the map are in the same operation and maintenance display page and are switchable with each other.
3. The operation and maintenance method for the robot according to claim 1, wherein the operation instruction comprises:
instructions for controlling the robot to move forward, backward, leftward, rightward and/or rotate;
and/or the presence of a gas in the gas,
switching the instructions of the cameras on different directions of the robot;
and/or the presence of a gas in the gas,
and controlling the camera to rotate.
4. The operation and maintenance method for the robot according to claim 1, further comprising:
displaying prompt information of the abnormal robot;
the prompt message comprises a mark displayed in a first color, the first color is different from a second color, and the second color is the color of the mark displayed when the robot is in a normal state.
5. The robotic operation and maintenance method according to claim 1, further comprising:
and responding to a page switching instruction, and switching the operation and maintenance display page to a corresponding operation and maintenance display page.
6. The operation and maintenance method of robot according to claim 5,
the page switching instruction is an instruction generated by triggering a target robot in the operation and maintenance display page, wherein the target robot is one of a plurality of robots;
the responding a page switching instruction, and switching the operation and maintenance display page to a corresponding operation and maintenance display page, includes:
and responding to the page switching instruction, and switching the operation and maintenance page to an operation and maintenance display page corresponding to the target robot.
7. The robot operation and maintenance method according to claim 2, wherein the operation and maintenance display page further comprises an associated equipment page associated with a task executed by the robot, and the state information of the associated equipment associated with the robot and/or a live video captured by the associated equipment is displayed in the associated equipment page.
8. The operation and maintenance method for robot according to claim 7, further comprising:
and sending a correlation operation instruction to the correlation equipment through the correlation equipment page, wherein the correlation operation instruction is used for controlling the correlation equipment to execute corresponding actions.
9. The robot operation and maintenance method according to claim 1, wherein the operation and maintenance display page further comprises: the voice interaction page is used for acquiring voice playing contents through the voice interaction page and playing the contents by the robot; the method for acquiring the voice playing content comprises the following steps: text input and/or voice input.
10. A robotic operation and maintenance system, characterized in that the steps of the method according to any of claims 1-9 are performed.
CN202111654431.6A 2021-01-06 2021-12-30 Robot operation and maintenance method and system Pending CN114239884A (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN2021100147947 2021-01-06
CN202110014794 2021-01-06

Publications (1)

Publication Number Publication Date
CN114239884A true CN114239884A (en) 2022-03-25

Family

ID=80744827

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111654431.6A Pending CN114239884A (en) 2021-01-06 2021-12-30 Robot operation and maintenance method and system

Country Status (1)

Country Link
CN (1) CN114239884A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116385664A (en) * 2023-05-31 2023-07-04 广东电网有限责任公司 Visual management method and device for electric power metering equipment

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116385664A (en) * 2023-05-31 2023-07-04 广东电网有限责任公司 Visual management method and device for electric power metering equipment
CN116385664B (en) * 2023-05-31 2023-09-19 广东电网有限责任公司 Visual management method and device for electric power metering equipment

Similar Documents

Publication Publication Date Title
US9829873B2 (en) Method and data presenting device for assisting a remote user to provide instructions
US9628772B2 (en) Method and video communication device for transmitting video to a remote user
EP0884664B1 (en) Remote control measuring system
DE112018004395T5 (en) VIRTUAL ACCESS TO AN ACCESS-LIMITED OBJECT
US10600253B2 (en) Information processing apparatus, information processing method, and program
US20190317490A1 (en) Control method, device, and remote control for vr apparatus
DE102005061211A1 (en) Man-machine-user interface e.g. mobile telephone, generating method for e.g. controlling industrial robot, involves providing virtual monitoring and/or controlling multi-media object-unit to user for monitoring and/or controlling device
CN107452119A (en) virtual reality real-time navigation method and system
KR20220063205A (en) Augmented reality for setting up an internet connection
US20230409027A1 (en) Ruggedized remote control display management system for harsh and safety-critical environments
CN114239884A (en) Robot operation and maintenance method and system
CN103150086B (en) One householder interface and control method, Apparatus and system
Hoang et al. Arviz: An augmented reality-enabled visualization platform for ros applications
KR101658469B1 (en) Apparatus operating a plural of drones and its operating method
CN211319464U (en) Simulation aircraft based on virtual reality
US20230023778A1 (en) Work assisting server and work assisting system
CN103475705B (en) System and method for elevator self-study and smart phone
KR101028130B1 (en) Remote real-time picture-transmitting system
CN105974898A (en) Alarm information display and management method of industrial monitoring software of mobile terminal
CN114274345B (en) Tubular pile distribution control method and system
CN114742675A (en) Universal multi-screen real-time interactive teaching laboratory comprehensive management platform
CN110502292B (en) Display control method and terminal
JPH09297672A (en) Monitor screen display system
CN113093753A (en) Method, device, terminal and storage medium for remotely controlling multiple robots on same screen
US20210172638A1 (en) Air conditioner management device, and air conditioner management screen generation method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination