CN114239884A - Robot operation and maintenance method and system - Google Patents
Robot operation and maintenance method and system Download PDFInfo
- Publication number
- CN114239884A CN114239884A CN202111654431.6A CN202111654431A CN114239884A CN 114239884 A CN114239884 A CN 114239884A CN 202111654431 A CN202111654431 A CN 202111654431A CN 114239884 A CN114239884 A CN 114239884A
- Authority
- CN
- China
- Prior art keywords
- robot
- maintenance
- page
- display page
- instruction
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012423 maintenance Methods 0.000 title claims abstract description 172
- 238000000034 method Methods 0.000 title claims abstract description 50
- 230000000875 corresponding effect Effects 0.000 claims abstract description 30
- 230000001276 controlling effect Effects 0.000 claims abstract description 18
- 230000003993 interaction Effects 0.000 claims description 10
- 230000002159 abnormal effect Effects 0.000 claims description 6
- 238000012544 monitoring process Methods 0.000 abstract description 9
- 230000000007 visual effect Effects 0.000 abstract description 6
- 230000008569 process Effects 0.000 abstract description 3
- 238000010586 diagram Methods 0.000 description 5
- 238000004891 communication Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 208000037656 Respiratory Sounds Diseases 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000005265 energy consumption Methods 0.000 description 1
- 230000002349 favourable effect Effects 0.000 description 1
- 229910001385 heavy metal Inorganic materials 0.000 description 1
- 230000006698 induction Effects 0.000 description 1
- 230000007257 malfunction Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 206010037833 rales Diseases 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/20—Administration of product repair or maintenance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04842—Selection of displayed objects or displayed text elements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/0486—Drag-and-drop
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L17/00—Speaker identification or verification techniques
- G10L17/22—Interactive procedures; Man-machine interfaces
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/695—Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Business, Economics & Management (AREA)
- Signal Processing (AREA)
- Human Resources & Organizations (AREA)
- Acoustics & Sound (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Health & Medical Sciences (AREA)
- Economics (AREA)
- Entrepreneurship & Innovation (AREA)
- Marketing (AREA)
- Operations Research (AREA)
- Quality & Reliability (AREA)
- Strategic Management (AREA)
- Tourism & Hospitality (AREA)
- General Business, Economics & Management (AREA)
- Manipulator (AREA)
Abstract
The invention relates to a robot operation and maintenance method and system, wherein the method comprises the following steps: displaying operation and maintenance information of the robot in an operation and maintenance display page, wherein the operation and maintenance information comprises a map of a working area of the robot and a video acquired by the robot; and receiving an operation instruction generated through the operation and maintenance display page, and sending the operation instruction to the robot, wherein the operation instruction is used for controlling the robot to execute a corresponding action. By the robot operation and maintenance method, a map and a field video of a robot working area can be conveniently checked in an operation and maintenance display page, and an operation instruction is sent to the robot through the operation and maintenance display page to control the robot to execute corresponding actions. The whole process does not need to switch equipment, is visual and clear, can finish remote monitoring and control on the robot on one equipment, and improves the working efficiency of the robot.
Description
Cross Reference to Related Applications
The present application claims priority of chinese patent application having application number 202110014794.7 and entitled "robot operation and maintenance method and system" filed in the chinese patent office on 06/01/2021, the entire contents of which are incorporated herein by reference.
Technical Field
The invention relates to the field of robot control, in particular to a robot operation and maintenance method and system.
Background
With the development of the robot technology, the remote monitoring, control and exception handling of the robot become more and more important, and the efficient remote operation and maintenance system can greatly improve the working efficiency and reliability of the robot.
In the conventional technology, remote operation and maintenance of a robot often need to operate a plurality of devices simultaneously, and operation and maintenance personnel cannot complete tasks such as monitoring, controlling and exception handling of the robot on one device. The operation speed can be reduced by switching among different devices, the abnormity of the robot cannot be timely and accurately processed, and the working efficiency of the robot is reduced.
Disclosure of Invention
Therefore, it is necessary to provide a robot operation and maintenance method and system for solving the problem of reduced working efficiency of the robot due to inconvenient operation of the conventional operation and maintenance system.
A robot operation and maintenance method comprises the following steps: displaying operation and maintenance information of the robot in an operation and maintenance display page, wherein the operation and maintenance information comprises a map of a working area of the robot and a video acquired by the robot; and receiving an operation instruction generated through the operation and maintenance display page, and sending the operation instruction to the robot, wherein the operation instruction is used for controlling the robot to execute corresponding actions.
According to the robot operation and maintenance method, the map and the field video of the working area of the robot can be checked through the operation and maintenance display page, and the operation instruction is sent to the robot through the operation and maintenance display page to control the robot to execute the corresponding action. The whole process does not need to switch equipment, is visual and clear, can finish remote monitoring and control on the robot on one equipment, and improves the working efficiency of the robot.
In one embodiment, the video and the map are in the same operation and maintenance display page and can be switched with each other. Through the switching of videos and maps, operation and maintenance personnel can conveniently switch and watch the key points according to actual conditions, and the practicability of the robot operation and maintenance method in the application is improved.
In one embodiment, the operation instructions include: instructions for controlling the robot to move forward, backward, leftward, rightward and/or rotate; and/or switching the instructions of the cameras on different directions of the robot; and/or instructions to control the rotation of the camera. Through the operation instruction, operation and maintenance personnel can send out a control instruction while checking the position and the field information of the robot, equipment switching is not needed, the unification of monitoring and controlling is realized, and the overall working efficiency is improved.
In one embodiment, the operation and maintenance method for the robot further includes: displaying prompt information of the abnormal robot; the prompt message comprises a mark displayed in a first color, the first color is different from a second color, and the second color is the color of the mark displayed when the robot is in a normal state. The abnormal robot is displayed in a color different from that in a normal state, so that operation and maintenance personnel can find the abnormal robot in time and maintain the abnormal robot.
In one embodiment, the operation and maintenance method for the robot further includes: and responding to the page switching instruction, and switching the operation and maintenance display page to a corresponding operation and maintenance display page. By responding to the page switching instruction, the operation and maintenance display page with other functional items can be switched, operation and maintenance personnel can conveniently carry out more specific operation and maintenance operation, and the operation and maintenance method of the robot in the application is enriched and refined.
In one embodiment, the page switching instruction is an instruction generated by triggering a target robot in the operation and maintenance page, wherein the target robot is one of a plurality of robots; responding to the page switching instruction, and switching the operation and maintenance display page to a corresponding operation and maintenance display page, wherein the operation and maintenance display page comprises the following steps: and responding to the page switching instruction, and switching the operation and maintenance page to an operation and maintenance display page corresponding to the target robot. The operation and maintenance display page of the target robot can be switched to by responding to the page switching instruction generated by triggering the target robot in the operation and maintenance page, so that the target robot is controlled in a targeted manner and the operation and maintenance information of the target robot is checked, remote monitoring, control and exception handling of a plurality of robots can be realized on the same equipment, and the efficiency of the operation and maintenance system is greatly improved.
In one embodiment, the operation and maintenance display page further comprises an associated equipment page associated with the task executed by the robot, and the state information of the associated equipment associated with the robot and/or the live video shot by the associated equipment are displayed in the associated equipment page. By associating the equipment page, the information or video of the equipment associated with the task executed by the robot can be checked, so that the functions of the operation and maintenance system can be flexibly expanded, and the application scene of the operation and maintenance system is expanded.
In one embodiment, an association operation instruction is sent to the association device through an association device page, and the association operation instruction is used for controlling the association device to execute a corresponding action. By sending the associated operation instruction to the associated equipment, other equipment can be called to cooperate with the robot to execute the task, and the efficiency of the robot to execute the task is improved.
In one embodiment, the operation and maintenance display page includes: the voice interaction page is used for acquiring voice playing contents through the voice interaction page and playing the voice playing contents by the robot; the method for acquiring the voice playing content comprises the following steps: text input and/or voice input. Through the voice interaction page, the voice to be played can be conveniently transmitted to the robot, communication between operation and maintenance personnel and field personnel is facilitated, third-party equipment is not needed, and cost is saved.
In one embodiment, the operation and maintenance display page further includes: and the scene selection page is used for switching the sound type when the voice is played. Through the sound type when switching the robot and playing pronunciation, can adapt to different scene demands, improve the intelligent degree of robot, be favorable to using widely of robot.
A robot operation and maintenance system executes the steps of the method of any one of the embodiments. The robot operation and maintenance system can assist operation and maintenance personnel to complete tasks such as monitoring, controlling and exception handling of the robot on the same equipment, and greatly improves the working efficiency of the robot. For the fault of the robot, the operation and maintenance personnel can carry out remote maintenance through the robot operation and maintenance system, or control the robot to a maintenance site of an accessory to be maintained by field workers, or inform the field maintenance personnel of the accurate position of the robot, so that the field maintenance personnel can quickly and accurately find the robot.
Drawings
FIG. 1 is a flowchart illustrating a method for operation and maintenance of a robot according to an embodiment;
FIGS. 2-1 and 2-2 are schematic diagrams of two ways of presenting a map and video, respectively, in the embodiment of FIG. 1;
FIG. 3 is a diagram illustrating an operation and maintenance display page for generating operation instructions according to an embodiment;
FIG. 4 is a flowchart illustrating a method for maintaining a robot in another embodiment;
FIG. 5 is a flowchart illustrating a method for maintaining a robot in accordance with another embodiment;
FIG. 6 is a flowchart of a method of an embodiment of the operation and maintenance method of the robot in the embodiment shown in FIG. 5;
FIG. 7 is a flowchart illustrating a method for using a page of associated equipment in the operation and maintenance method of the robot according to an embodiment;
fig. 8-1 and 8-2 are schematic diagrams illustrating two display manners of a video of an associated device, a live video and a map in the operation and maintenance method of the robot in an embodiment, respectively;
fig. 9 is a schematic diagram illustrating state information and/or control identifiers of associated devices in the robot operation and maintenance method according to an embodiment;
fig. 10 is a schematic diagram illustrating order information in the robot operation and maintenance method according to an embodiment.
Detailed Description
To facilitate an understanding of the invention, the invention will now be described more fully with reference to the accompanying drawings. Preferred embodiments of the present invention are shown in the drawings. This invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete.
Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. The terminology used in the description of the invention herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used herein, the term "and/or" includes any and all combinations of one or more of the associated listed items.
In the description of the present application, it is to be understood that the terms "center", "lateral", "upper", "lower", "left", "right", "vertical", "horizontal", "top", "bottom", "inner" and "outer" etc. indicate orientations or positional relationships based on those shown in the drawings, and are only for convenience in describing the present application and simplifying the description, but do not indicate or imply that the referred device or element must have a particular orientation, be constructed in a particular orientation, and be operated, and thus should not be construed as limiting the present application. Further, when an element is referred to as being "formed on" another element, it can be directly connected to the other element or intervening elements may also be present. When an element is referred to as being "connected" to another element, it can be directly connected to the other element or intervening elements may also be present. In contrast, when an element is referred to as being "directly on" another element, there are no intervening elements present.
Where the terms "comprising," "having," and "including" are used herein, another element may be added unless an explicit limitation is used, such as "only," "consisting of … …," etc. Unless mentioned to the contrary, terms in the singular may include the plural and are not to be construed as being one in number.
As shown in fig. 1, an embodiment of the present application provides a robot operation and maintenance method, including:
s1: and displaying the operation and maintenance information of the robot in an operation and maintenance display page, wherein the operation and maintenance information comprises a map of a working area of the robot and a video acquired by the robot.
S2: and receiving an operation instruction generated through the operation and maintenance display page, and sending the operation instruction to the robot, wherein the operation instruction is used for controlling the robot to execute corresponding actions.
The operation and maintenance display page can be an operation page displayed on the touch screen, and can display a map, a video and operation buttons, so that operation and maintenance personnel can conveniently obtain operation and maintenance information of the robot. And sending an operation instruction to the robot through the operation and maintenance display page.
In step S1, the operation and maintenance information of the robot is displayed through the operation and maintenance display page, and the operation and maintenance information includes: the map of the working area of the robot and the live video shot by the camera arranged on the robot body. The position of the robot and the orientation of the robot can be clearly marked in the map, and the surrounding environment can also be displayed in a common display mode in an electronic map, such as floor layout, or display of roads and buildings, so that operation and maintenance personnel can conveniently and intuitively obtain the position information and the working environment information of the robot from the map. In other embodiments of the disclosure, the transmitted field video can be shot by the camera mounted on the robot body, so that the operation and maintenance personnel can visually check the field situation at the visual angle of the robot and more directly know the field situation. By integrating the map information and the on-site video information, an operator can more comprehensively master the on-site situation and make more accurate operation instructions according to the situation.
In step S2, the operation command generated through the operation and maintenance display page is transmitted to the robot located on the site, and the robot performs a corresponding action according to the operation command. Corresponding operation instructions can be generated by clicking or touching virtual buttons on the operation and maintenance display page, and the operation instructions are transmitted to a technician on site in a wireless or wired mode to control the robot to execute corresponding actions. Optionally, the operation instruction generated through the operation and maintenance display page includes controlling the robot to move towards the target direction. Optionally, the operation instruction further includes: shutdown, restart, fault self-check, etc. The operation and maintenance personnel can determine the next operation instruction according to the state of the robot after executing the command and by combining the field situation. For example, when the robot malfunctions and cannot be solved by remote operation, the robot is controlled to a nearby manual maintenance station; or when the robot sends a low-power reminder, the robot is timely controlled to charge to the charging point of the accessory.
In the operation and maintenance method for the robot in the embodiment, the map and the live video of the working area of the robot can be checked through the operation and maintenance display page, and the operation instruction is sent to the robot through the operation and maintenance display page to control the robot to execute the corresponding action. The whole process does not need to switch equipment, is visual and clear, can finish remote monitoring and control on the robot on one equipment, and improves the working efficiency of the robot.
In one example, as shown in fig. 2-1 and 2-2, the video and the map in the above embodiment are in the same operation and maintenance display page and can be switched with each other. The video and the map information are displayed on the same page, and the two kinds of information are mastered at the same time, so that the method is visual and clear. On the basis of displaying on the same page, the video and the map can be flexibly switched between a large image and a small image. Specifically, when the operation and maintenance personnel need to mainly view map information, the map can be switched to be displayed as a large map, and a video is displayed by using a small map; when the operation and maintenance personnel need to intensively view the live video, the video can be cut into a large image for display, and the map can be displayed in a small image. The position of the small picture can be fixed at the lower left corner, or can be set to be dragged at will, so that operation and maintenance personnel can drag the small picture to a position which does not influence the display information of the large picture. Specifically, the switching manner between the video and the map may be a single click of the thumbnail display. Through the mode of big-small picture switching, the operation and maintenance personnel can select to watch the key point in a flexible way, convenient and fast.
In one example, the operational instructions include: instructions for controlling the robot to move forward, backward, leftward, rightward and/or rotate; and/or switching the instructions of the cameras on different directions of the robot; and/or instructions to control the rotation of the camera. Specifically, as shown in fig. 3, a control button for controlling the movement of the robot is provided on the operation and maintenance display page, and includes four directional arrows, front, back, left, and right, and a sensing dot located in the center. When the operation and maintenance personnel drag the induction dots to the corresponding direction arrows, a control instruction for moving towards the direction can be sent out, and the robot makes an action for moving towards the direction according to the control instruction. For example, when the sensing circle point is dragged to the position of the right arrow, a control instruction for moving right is sent out, and the robot located on the work site moves right.
A plurality of cameras can be installed on the robot body, and each camera is distributed in different directions on the robot body. The operation instructions also comprise instructions for switching the cameras in different directions of the robot. Through switching different cameras, the watching visual angle of the robot can be changed more quickly, the rotation of the robot is reduced, and the energy consumption is reduced. In addition, the operation instruction also comprises an instruction for controlling the camera to rotate, and the operation and maintenance personnel can adjust the shooting angle of the robot camera according to the requirement, so that the shooting range is expanded.
In an example, as shown in fig. 4, there is provided a robot operation and maintenance method, which on the basis of the embodiment shown in fig. 1, further includes:
s3: and displaying prompt information of the abnormal robot.
The prompt message comprises a mark displayed in a first color, the first color is different from a second color, and the second color is the color of the mark displayed when the robot is in a normal state. Alternatively, the first color may be a conspicuous color, or a color commonly used to identify faults, such as red or yellow. The second color may be a color commonly used to identify a normal state, such as green or white. The marking may be a simplified robot pattern or use dots directly as a marking. Usually, the identification is used in conjunction with a number indicating the serial number of the robot to unambiguously indicate which robot is in a fault state and which robot is in a normal working state.
In one embodiment, the operation and maintenance display page can also display the date, the time and the electric quantity information of the robot, and according to the displayed electric quantity information, the operation and maintenance personnel can know whether the robot is in a charging state and whether the current electric quantity is enough to support the robot to complete the next task. When the robot is low in power, the power information displayed in the screen changes to prompt the operation and maintenance personnel, for example, the mark displaying the remaining power changes color (e.g., becomes red).
In an example, as shown in fig. 5, there is provided a robot operation and maintenance method, which on the basis of the embodiment shown in fig. 1, further includes:
s4: and responding to the page switching instruction, and switching the operation and maintenance display page to a corresponding operation and maintenance display page. The page switching instruction is an instruction generated by triggering a target robot in the operation and maintenance display page, and the target robot is one of the robots.
Optionally, as shown in fig. 6, the method for switching the operation and maintenance display page includes:
s41: and responding to the page switching instruction, and switching the operation and maintenance display page to an operation and maintenance display page corresponding to the target robot.
Specifically, the (identifier of the) target robot in the operation and maintenance display page may be triggered to generate a corresponding page switching instruction. If a plurality of robots exist, the operation and maintenance display page lists the robot identifiers corresponding to the robots, and when the operation and maintenance information of a certain robot needs to be checked, the operation and maintenance display page corresponding to the robot (target robot) can be switched to by triggering (clicking or touching) the identifier corresponding to the robot. Then, the corresponding operation instruction can be selected according to the actual state of the robot, such as: and opening debugging, restarting the upper computer, controlling movement and the like. Illustratively, when a certain robot identifier turns red, indicating that the robot has a fault, by clicking the robot identifier, the operation and maintenance display page corresponding to the robot can be switched to, and the video and map information of the robot is displayed.
In one example, as shown in fig. 7, the operation and maintenance display page further includes an associated device page associated with a task performed by the robot, and the state information of the associated device associated with the robot and/or the live video captured by the associated device are displayed in the associated device page. Optionally, the associated apparatus comprises a container and/or an elevator. Taking a container as an example, the state information of the associated device may include: whether the container is networked online and whether the container door is in an open state. Optionally, a camera can be further installed in the container to shoot the video picture inside the container in real time.
As shown in fig. 8-1 and 8-2, the video provided by the associated device and the live video can be displayed on the same page and switched with each other. For example, when the video frame inside the container is displayed in the small frame at the upper left corner, the main video frame can be switched to the video frame inside the container by clicking the small frame, so that the operation and maintenance personnel can observe the state inside the container when the container is shipped, and know information such as whether the number of shipped commodities is accurate and the types of the shipped commodities are consistent. When the associated device is an elevator, the state information of the associated device may include: whether the elevators are networked online and whether an elevator has failed. Optionally, when the elevator is internally provided with the camera, the video shot by the camera can be displayed through the operation and maintenance display page.
In one example, with continuing reference to fig. 7, the robot operation and maintenance method further includes:
s5: and sending a correlation operation instruction to the correlation equipment through the correlation equipment page, wherein the correlation operation instruction is used for controlling the correlation equipment to execute corresponding actions.
Specifically, taking an elevator as an example, as shown in fig. 9, the operation and maintenance display page displays status information of all associated elevators in a form of a list (i.e., whether the elevators are networked online and can receive an operation command). Through clicking the identifier of the corresponding elevator, a call instruction can be sent to the elevator, and remote call operation is realized. In addition, the numbers corresponding to the target floors can be selected on the operation and maintenance display page, and the target floor instructions are sent to the elevators.
Optionally, as shown in fig. 10, information of multiple associated devices may be integrated and displayed on the same page to obtain more comprehensive information. For example, for a delivery robot, the task completion status of each robot and detailed order information, such as order number, cell phone number, room number, container number, and elevator number, may be displayed in an operation and maintenance display page. Therefore, the operation and maintenance personnel can quickly and intuitively know the task completion condition of the robot.
In one example, the operation and maintenance display page may further include: the voice interaction page is used for acquiring voice playing contents through the voice interaction page and playing the voice playing contents by the robot; the method for acquiring the voice playing content comprises the following steps: text input and/or voice input. Specifically, when the operation and maintenance personnel need to perform voice communication with the field personnel through the robot, the operation and maintenance personnel can use the voice interaction page in the operation and maintenance display page to perform operation. For example, the operation and maintenance personnel can input the text content to be expressed in the voice interaction page, and after clicking 'confirm', the robot plays the text content in a voice mode. Optionally, the operation and maintenance personnel can also input the content to be expressed in a voice mode on the voice interaction page, and after the confirmation is clicked, the robot plays the voice on the working site.
In one example, the operation and maintenance display page further comprises a scene selection page, and the sound type of the voice is switched to play through the scene selection page. In order to increase the interest of the robot voice playing and make the robot voice playing less cool and boring, the operation and maintenance personnel can set the voice type of the voice playing on the scene selection page. Optionally, the sound types include: acoustic, children, fun, uncle, rale, heavy metals, etc. For example, if the service object of the robot is primarily a child, the sound type may be selected as "child" to improve the child's sense of identity with the robot. For example, if the robot is in a serious occasion, such as performing fault maintenance, an "original sound" may be selected to reduce the distraction of the attention of workers and improve the working efficiency. The operation and maintenance method for the robot in the embodiment can adapt to different scene requirements by switching the sound types, can improve the intelligence degree of the robot to a certain extent, and is convenient for popularization and use of the robot.
Another aspect of the present application further provides a robot operation and maintenance system, which may perform the steps of the method in any of the above embodiments. The robot operation and maintenance system can be communicated and interconnected with the robot to receive video information and map information of the robot. The video information is shot and acquired through a camera installed on the robot. In addition, the robot body is also provided with a laser radar, the laser radar scans the surrounding environment to obtain point cloud data, surrounding map information is identified according to the point cloud data and is transmitted back to the robot operation and maintenance system, and the map information of the robot is displayed on an operation and maintenance display page.
The utility model discloses a plurality of robots can be connected simultaneously to the robot fortune dimension system, through clicking the sign of different robots, can switch to the fortune dimension show page that this robot corresponds, realizes using same equipment to the remote monitoring, control and the exception handling of a plurality of robots, greatly improves the work efficiency of fortune dimension personnel and robot. Specifically, when the robot has a fault, the operation and maintenance personnel can implement remote maintenance through the robot operation and maintenance system, or control the robot to a maintenance station of an accessory to be maintained by field workers, or inform the field maintenance personnel of the accurate position of the robot, so that the field maintenance personnel can quickly and accurately find the robot.
Through the robot operation and maintenance system disclosed by the application, operation and maintenance personnel can also check equipment information associated with the execution of tasks by the robot, or send an operation instruction through the robot operation and maintenance system to control associated equipment to cooperate with the robot to execute the tasks, so that the efficiency of the robot to execute the tasks is further improved. For example, when the robot needs to take the elevator, the elevator in an idle state is called in advance by the robot operation and maintenance system to reach the floor where the robot is located, and the time for the robot to wait for the elevator is reduced.
The technical features of the embodiments described above may be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the embodiments described above are not described, but should be considered as being within the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above-mentioned embodiments only express several embodiments of the present invention, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the inventive concept, which falls within the scope of the present invention. Therefore, the protection scope of the present patent shall be subject to the appended claims.
Claims (10)
1. A robot operation and maintenance method is characterized by comprising the following steps:
displaying operation and maintenance information of the robot in an operation and maintenance display page, wherein the operation and maintenance information comprises a map of a working area of the robot and a video acquired by the robot;
and receiving an operation instruction generated through the operation and maintenance display page, and sending the operation instruction to the robot, wherein the operation instruction is used for controlling the robot to execute a corresponding action.
2. The robotic operation and maintenance method according to claim 1, wherein the video and the map are in the same operation and maintenance display page and are switchable with each other.
3. The operation and maintenance method for the robot according to claim 1, wherein the operation instruction comprises:
instructions for controlling the robot to move forward, backward, leftward, rightward and/or rotate;
and/or the presence of a gas in the gas,
switching the instructions of the cameras on different directions of the robot;
and/or the presence of a gas in the gas,
and controlling the camera to rotate.
4. The operation and maintenance method for the robot according to claim 1, further comprising:
displaying prompt information of the abnormal robot;
the prompt message comprises a mark displayed in a first color, the first color is different from a second color, and the second color is the color of the mark displayed when the robot is in a normal state.
5. The robotic operation and maintenance method according to claim 1, further comprising:
and responding to a page switching instruction, and switching the operation and maintenance display page to a corresponding operation and maintenance display page.
6. The operation and maintenance method of robot according to claim 5,
the page switching instruction is an instruction generated by triggering a target robot in the operation and maintenance display page, wherein the target robot is one of a plurality of robots;
the responding a page switching instruction, and switching the operation and maintenance display page to a corresponding operation and maintenance display page, includes:
and responding to the page switching instruction, and switching the operation and maintenance page to an operation and maintenance display page corresponding to the target robot.
7. The robot operation and maintenance method according to claim 2, wherein the operation and maintenance display page further comprises an associated equipment page associated with a task executed by the robot, and the state information of the associated equipment associated with the robot and/or a live video captured by the associated equipment is displayed in the associated equipment page.
8. The operation and maintenance method for robot according to claim 7, further comprising:
and sending a correlation operation instruction to the correlation equipment through the correlation equipment page, wherein the correlation operation instruction is used for controlling the correlation equipment to execute corresponding actions.
9. The robot operation and maintenance method according to claim 1, wherein the operation and maintenance display page further comprises: the voice interaction page is used for acquiring voice playing contents through the voice interaction page and playing the contents by the robot; the method for acquiring the voice playing content comprises the following steps: text input and/or voice input.
10. A robotic operation and maintenance system, characterized in that the steps of the method according to any of claims 1-9 are performed.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2021100147947 | 2021-01-06 | ||
| CN202110014794 | 2021-01-06 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114239884A true CN114239884A (en) | 2022-03-25 |
Family
ID=80744827
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111654431.6A Pending CN114239884A (en) | 2021-01-06 | 2021-12-30 | Robot operation and maintenance method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114239884A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116385664A (en) * | 2023-05-31 | 2023-07-04 | 广东电网有限责任公司 | Visual management method and device for electric power metering equipment |
-
2021
- 2021-12-30 CN CN202111654431.6A patent/CN114239884A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116385664A (en) * | 2023-05-31 | 2023-07-04 | 广东电网有限责任公司 | Visual management method and device for electric power metering equipment |
| CN116385664B (en) * | 2023-05-31 | 2023-09-19 | 广东电网有限责任公司 | Visual management method and device for electric power metering equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9829873B2 (en) | Method and data presenting device for assisting a remote user to provide instructions | |
| US9628772B2 (en) | Method and video communication device for transmitting video to a remote user | |
| EP0884664B1 (en) | Remote control measuring system | |
| DE112018004395T5 (en) | VIRTUAL ACCESS TO AN ACCESS-LIMITED OBJECT | |
| US10600253B2 (en) | Information processing apparatus, information processing method, and program | |
| US20190317490A1 (en) | Control method, device, and remote control for vr apparatus | |
| DE102005061211A1 (en) | Man-machine-user interface e.g. mobile telephone, generating method for e.g. controlling industrial robot, involves providing virtual monitoring and/or controlling multi-media object-unit to user for monitoring and/or controlling device | |
| CN107452119A (en) | virtual reality real-time navigation method and system | |
| KR20220063205A (en) | Augmented reality for setting up an internet connection | |
| US20230409027A1 (en) | Ruggedized remote control display management system for harsh and safety-critical environments | |
| CN114239884A (en) | Robot operation and maintenance method and system | |
| CN103150086B (en) | One householder interface and control method, Apparatus and system | |
| Hoang et al. | Arviz: An augmented reality-enabled visualization platform for ros applications | |
| KR101658469B1 (en) | Apparatus operating a plural of drones and its operating method | |
| CN211319464U (en) | Simulation aircraft based on virtual reality | |
| US20230023778A1 (en) | Work assisting server and work assisting system | |
| CN103475705B (en) | System and method for elevator self-study and smart phone | |
| KR101028130B1 (en) | Remote real-time picture-transmitting system | |
| CN105974898A (en) | Alarm information display and management method of industrial monitoring software of mobile terminal | |
| CN114274345B (en) | Tubular pile distribution control method and system | |
| CN114742675A (en) | Universal multi-screen real-time interactive teaching laboratory comprehensive management platform | |
| CN110502292B (en) | Display control method and terminal | |
| JPH09297672A (en) | Monitor screen display system | |
| CN113093753A (en) | Method, device, terminal and storage medium for remotely controlling multiple robots on same screen | |
| US20210172638A1 (en) | Air conditioner management device, and air conditioner management screen generation method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |