CN109079789B - Method and system for remotely acquiring operation video of industrial robot - Google Patents
Method and system for remotely acquiring operation video of industrial robot Download PDFInfo
- Publication number
- CN109079789B CN109079789B CN201810969228.XA CN201810969228A CN109079789B CN 109079789 B CN109079789 B CN 109079789B CN 201810969228 A CN201810969228 A CN 201810969228A CN 109079789 B CN109079789 B CN 109079789B
- Authority
- CN
- China
- Prior art keywords
- industrial robot
- industrial
- video
- camera
- robot
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 37
- 238000005516 engineering process Methods 0.000 claims description 17
- 230000002159 abnormal effect Effects 0.000 claims description 4
- 230000033001 locomotion Effects 0.000 claims description 4
- 230000006399 behavior Effects 0.000 description 8
- 230000001960 triggered effect Effects 0.000 description 8
- 230000005540 biological transmission Effects 0.000 description 5
- 238000003860 storage Methods 0.000 description 5
- 238000013473 artificial intelligence Methods 0.000 description 3
- 238000004519 manufacturing process Methods 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 206010000117 Abnormal behaviour Diseases 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000010354 integration Effects 0.000 description 2
- 238000004377 microelectronic Methods 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 238000007781 pre-processing Methods 0.000 description 2
- 238000003825 pressing Methods 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 241000282472 Canis lupus familiaris Species 0.000 description 1
- 241000282326 Felis catus Species 0.000 description 1
- 241000282412 Homo Species 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 238000013135 deep learning Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 235000001968 nicotinic acid Nutrition 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 210000000707 wrist Anatomy 0.000 description 1
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J9/00—Programme-controlled manipulators
- B25J9/16—Programme controls
- B25J9/1694—Programme controls characterised by use of sensors other than normal servo-feedback from position, speed or acceleration sensors, perception control, multi-sensor controlled systems, sensor fusion
- B25J9/1697—Vision controlled systems
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J9/00—Programme-controlled manipulators
- B25J9/16—Programme controls
- B25J9/1602—Programme controls characterised by the control system, structure, architecture
Abstract
The invention discloses a method and a system for remotely acquiring an industrial robot operation video, wherein the method comprises the following steps: detecting a pressure value acted on a deformation sensor by a user on the basis of the deformation sensor on the main control equipment; acquiring a physical address of the corresponding industrial robot based on the signal value range, wherein each industrial robot in the plurality of industrial robots is provided with the corresponding signal value range; triggering and pre-recording a camera on the industrial robot based on the physical address of the industrial robot; judging whether the industrial robot is in an operating state or not based on scene action recognition in the pre-recorded video; and triggering a camera on the industrial robot to carry out video recording on the operation content of the industrial robot when the industrial robot is judged to be in the operation state. The embodiment of the invention triggers the corresponding camera on the industrial robot based on the pressure control mode to realize video acquisition, thereby avoiding misoperation and facilitating the operation behavior of users.
Description
Technical Field
The invention relates to the technical field of robots, in particular to a method and a system for remotely controlling a robot server.
Background
With the continuous development of robotics, more and more robots are beginning to perform various tasks instead of humans. Robots are the common name for automatic control machines (Robot) that include all machines that simulate human behavior or thought and other creatures (e.g., machine dogs, machine cats, etc.). There are many taxonomies and controversy to define robots in a narrow sense, and some computer programs are even referred to as robots. In the modern industry, robots refer to artificial machines that automatically perform tasks to replace or assist human work. The ideal high-simulation robot is a product of advanced integrated control theory, mechano-electronics, computer and artificial intelligence, materials science and bionics, and is researched and developed in the current scientific community in the direction, but the robot is still imperfectly controlled remotely, the application of big data is not popularized yet, the data acquisition of the robot is still in an off-line state, and the deep learning of the robot is also from the storage of local data.
Industrial robots are multi-joint manipulators or multi-degree-of-freedom machine devices oriented to the industrial field, can automatically execute work, and are machines which realize various functions by means of self power and control capacity. The robot can accept human command and operate according to a preset program, and modern industrial robots can also perform actions according to a principle formulated by artificial intelligence technology.
The entire control of the 6-axis industrial robot is performed by a microcomputer. The other is distributed control, that is, a plurality of microcomputers are adopted to share the control of the robot, for example, when the upper and lower two-stage microcomputers are adopted to jointly complete the control of the robot, the host is usually used for being responsible for the management, communication, kinematics and dynamics calculation of a system and sending instruction information to the lower microcomputer; each joint is corresponding to a CPU as a subordinate slave, and interpolation operation and servo control processing are performed to realize given movement and feed back information to the master. According to different requirements of work tasks, the control modes of the robot can be divided into point position control, continuous track control and force control.
The 6-axis industrial robot is characterized by mainly comprising the following aspects: 1) programming: the 6-axis industrial robot is characterized by flexible starting and an important component in a flexible manufacturing system. The industrial robot can be reprogrammed along with the change of the working environment and the change of a machined part, and is suitable for the application of small-batch and multi-variety flexible manufacturing production lines with balanced efficiency. 2) Personification: 6 characteristics that 6 axle industrial robot combines robot and people. The 6-axis industrial robot has the structure similar to that of a human walking robot, a waist turning robot, a big arm robot, a small arm robot, a wrist robot, a paw robot and the like, and a computer is arranged on the control. The sensor improves the self-adaptive capacity of the industrial robot to the surrounding environment. 3) Universality: generally, 6-axis industrial robots have better universality in executing different work tasks. There are of course also special industrial robots. 4) Electromechanical integration: a 6-axis industrial robot is a combined mechanical and electrical integration technology of mechanics and microelectronics. The industrial robot has various sensors which can acquire external environment information, and also has artificial intelligence such as memory capacity, language understanding capacity, image recognition capacity, reasoning and judging capacity and the like, which are all applications of microelectronic technology, particularly application of computer technology.
The industrial robot under the existing distributed control mode needs to know the operation behavior of the industrial robot in real time, and needs to know and analyze an object under the operation of the industrial robot in a combined manner, but the existing industrial robot can monitor the object under a factory building based on an open mode, but can better monitor the video object and better distinguish misjudgment behaviors under multiple devices, and a feasible technical thought is not given in the prior art.
Disclosure of Invention
The invention provides a method for remotely acquiring an operation video of an industrial robot, which realizes the video recording under the operation realized by rapidly scheduling a camera on the industrial robot in a pressure control mode.
The invention provides a method for remotely acquiring an operation video of an industrial robot, wherein a main control device is connected with a plurality of industrial robots, each industrial robot platform in the plurality of industrial robots is provided with a corresponding camera, and the corresponding camera is used for carrying out video recording on the operation content of the industrial robot, and the method comprises the following steps:
detecting a pressure value acted on a deformation sensor by a user on the basis of the deformation sensor on the main control equipment;
converting the pressure value into a corresponding pressure signal value;
judging a signal value range in which the pressure signal value is located based on the pressure signal value;
acquiring a physical address of the corresponding industrial robot based on the signal value range, wherein each industrial robot in the plurality of industrial robots is provided with the corresponding signal value range;
triggering and pre-recording a camera on the industrial robot based on the physical address of the industrial robot;
judging whether the industrial robot is in an operating state or not based on scene action recognition in the pre-recorded video;
and triggering a camera on the industrial robot to carry out video recording on the operation content of the industrial robot when the industrial robot is judged to be in the operation state.
The method is characterized in that the pre-recording of the camera on the industrial robot is specifically carried out based on the triggering of the physical address of the industrial robot:
and the camera on the industrial robot carries out pre-video recording based on a pre-video recording time threshold value.
The method for judging whether the industrial robot is in the operating state or not based on scene action recognition in the pre-recorded video specifically comprises the following steps:
extracting a plurality of video frame images in a pre-recorded video;
judging whether the robot arm of the industrial robot has an operation action or not from a plurality of video frame images based on a machine vision technology;
and if the robot arm of the industrial robot is judged to have the operation action, judging that the industrial robot is in an operation state.
After the step of judging whether the industrial robot is in the operating state or not based on scene action recognition in the pre-recorded video, the method further comprises the following steps:
and when the industrial robot is judged not to be in the operating state, prompting an operator to perform an operating action based on the state of the industrial robot identified by the main control equipment.
Based on the main control equipment sign industrial robot state suggestion operating personnel carries out the operation action and includes:
when the master control equipment marks that the state of the industrial robot is not in an operating state, prompting an operator that the industrial robot is not in the operating state;
when the master control equipment marks that the state of the industrial robot is in an entering operation state, an operator is prompted that the state of the industrial robot is abnormal.
The main control equipment is communicated with each industrial robot in the plurality of industrial robots in a data bus mode, and the main control equipment is communicated with each camera in a DiiVA technology.
The triggering of the pre-recording of the camera on the industrial robot based on the physical address of the industrial robot comprises:
the main control equipment sends a pre-video recording instruction to the industrial robot based on the physical address of the industrial robot;
the industrial robot triggers a camera on the industrial robot to pre-record images based on the pre-recording instruction.
Correspondingly, the invention also provides an industrial robot control system, the main control equipment is connected with a plurality of industrial robots, each industrial robot platform in the plurality of industrial robots is provided with a corresponding camera, the corresponding camera is used for carrying out video recording on the operation content of the industrial robot, and the industrial robot control system executes the method.
In the invention, the deformation sensor can sense the change of the external pressure, so that the pressure signal value is obtained by detecting the pressure change, the industrial robot can be triggered in time to trigger the corresponding camera to realize monitoring based on the relation between the pressure signal value and the address of the industrial robot, the corresponding camera on the industrial robot is triggered based on a pressure control mode to realize video acquisition, misoperation is avoided, and the operation behavior of a user is facilitated. In whole implementation process, draw earlier the content in the pre-recorded video and judge whether industrial robot has the operation action, be in under operating condition at industrial robot promptly, just start the video recording process, the guarantee is effective to the industrial robot institute's video content of gathering, and avoids gathering industrial robot's static state and consuming resources. The whole pre-recording is subject to a time threshold setting condition, wherein the time threshold condition is subject to the matching of the working cycle of the industrial robot or the initial setting condition. The operating state of the industrial robot is identified and judged from the plurality of video frame images by adopting a machine vision technology, and the robot can be considered to be in an operating body when the robot arm of the industrial robot displayed by the plurality of key frame images is changed or the acquisition area is dynamically changed, so that the whole identification efficiency is improved. When the whole industrial robot is not in an operating state, an abnormal behavior is triggered to a user, so that the user can realize corresponding operation, and the user can conveniently respond to the event or investigate whether the equipment is in failure or whether the behavior is legal.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a schematic structural diagram of an industrial robot control system in an embodiment of the present invention;
fig. 2 is a flowchart of a method for remotely obtaining an operation video of an industrial robot in an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The invention discloses a method for remotely acquiring an operation video of an industrial robot in a real-time example, wherein a main control device is connected with a plurality of industrial robots, a corresponding camera is arranged on each industrial robot platform in the plurality of industrial robots, and the corresponding camera is used for carrying out video recording on the operation content of the industrial robot, and the method comprises the following steps: detecting a pressure value acted on a deformation sensor by a user on the basis of the deformation sensor on the main control equipment; converting the pressure value into a corresponding pressure signal value; judging a signal value range in which the pressure signal value is located based on the pressure signal value; acquiring a physical address of the corresponding industrial robot based on the signal value range, wherein each industrial robot in the plurality of industrial robots is provided with the corresponding signal value range; triggering and pre-recording a camera on the industrial robot based on the physical address of the industrial robot; judging whether the industrial robot is in an operating state or not based on scene action recognition in the pre-recorded video; and triggering a camera on the industrial robot to carry out video recording on the operation content of the industrial robot when the industrial robot is judged to be in the operation state.
Specifically, fig. 1 shows a schematic structural diagram of an industrial robot control system in an embodiment of the present invention, where the system includes a main control device, N industrial robots and cameras located on the industrial robots, where N is a natural number greater than 1, that is, the system relates to a first industrial robot, a first camera located on the first industrial robot, a second camera located on the second industrial robot, … …, an nth industrial robot, and an nth camera located on the nth industrial robot. The main control device and each industrial robot in the N industrial robots are communicated in a data bus mode, and the main control device and each camera are communicated by a DiiVA technology. The industrial robot adopts the data control line to connect together between the camera, establishes the control signal of equipment to the camera at the owner, and master control equipment sends and triggers the camera through industrial robot's data control line and carries out video recording work on industrial robot, and the video data that the camera was gathered adopts the DiiVA technique directly to pass to master control equipment.
The main control equipment detects the pressure value of the user acting on the deformation sensor based on the deformation sensor on the main control equipment; converting the pressure value into a corresponding pressure signal value; judging a signal value range in which the pressure signal value is positioned based on the pressure signal value; acquiring a physical address of the corresponding industrial robot based on the signal value range, wherein each industrial robot in the plurality of industrial robots is provided with the corresponding signal value range; triggering a camera on the industrial robot to pre-record based on the physical address of the industrial robot; judging whether the industrial robot is in an operating state or not based on scene action recognition in the pre-recorded video; and triggering a camera on the industrial robot to carry out video recording on the operation content of the industrial robot when the industrial robot is judged to be in the operation state.
It should be noted that the camera on the industrial robot performs pre-recording based on the pre-recording time threshold. The method comprises the steps that a main control device extracts a plurality of video frame images in a pre-recorded video; judging whether the robot arm of the industrial robot has an operation action or not from a plurality of video frame images based on a machine vision technology; and if the robot arm of the industrial robot is judged to have the operation action, judging that the industrial robot is in an operation state. And when the industrial robot is judged not to be in the operating state, prompting an operator to perform an operating action based on the state of the industrial robot identified by the main control equipment. When the master control equipment marks that the state of the industrial robot is not in an operating state, prompting an operator that the industrial robot is not in the operating state; when the master control equipment marks that the state of the industrial robot is in an entering operation state, an operator is prompted that the state of the industrial robot is abnormal.
The main control equipment sends a pre-video recording instruction to the industrial robot based on the physical address of the industrial robot; the industrial robot triggers the camera on the industrial robot to pre-record based on the pre-recording instruction.
The main control equipment comprises a deformation sensor, a control processing module, a preprocessing module, a video storage module, a display module and the like, wherein:
the deformation sensor detects the pressure value acted on the deformation sensor by the user, converts the pressure value into a corresponding pressure signal value, the pressure signal value range corresponds to the physical addresses of different industrial robots, for example, the pressure signal value range triggered by pressing is 0-100, and assuming that N is 4, it is possible to assign a pressure signal value range of 0 to 100 evenly to the physical addresses of 4 industrial robots, for example a range of 0 to 20 corresponds to the physical address of a first industrial robot, a range of 20 to 50 corresponds to the physical address of a second industrial robot, a range of 50 to 80 corresponds to the physical address of a third industrial robot, a range of 80 to 100 corresponds to the physical address of a fourth industrial robot, the relation between the industrial robot and the pressure signal value can be obtained through the matching relation, and therefore the pressure range of the deformation force detected by the deformation sensor is guaranteed to belong to the range.
The control processing module judges a signal value range in which the pressure signal value is positioned based on the pressure signal value; acquiring a physical address of the corresponding industrial robot based on the signal value range, wherein each industrial robot in the plurality of industrial robots is provided with the corresponding signal value range; triggering a camera on the industrial robot to pre-record based on the physical address of the industrial robot; and triggering a camera on the industrial robot to carry out video recording on the operation content of the industrial robot when the industrial robot is judged to be in the operation state. The control module is used for sending various control instructions to the industrial robot and triggering the industrial robot to complete corresponding controlled actions.
The preprocessing module is used for identifying and judging whether the industrial robot is in an operating state or not based on scene actions in the pre-recorded video and extracting a plurality of video frame images in the pre-recorded video; judging whether the robot arm of the industrial robot has an operation action or not from a plurality of video frame images based on a machine vision technology; and if the robot arm of the industrial robot is judged to have the operation action, judging that the industrial robot is in an operation state.
The video storage module is used for storing video records of parameters of a camera on the industrial robot, MPEG transport stream coding conforming to a DiiVA transmission mode is adopted between the main control equipment and the camera, fine scalable coding FGSH or progressive fine scalable coding PFGSH technology is adopted in an MPEG-4 standard, and H.264 technology is combined with a network transmission protocol; and carrying out real-time transmission error control on the data by adopting a real-time transmission protocol or a transmission control protocol.
The display module is used for displaying various operation states, displaying video contents and the like, providing a corresponding user operation interface, a corresponding state display interface and the like for a user, and facilitating the user to operate and view related contents.
Based on the hardware structure principle illustrated in fig. 1, fig. 2 shows a flowchart of a method for remotely obtaining an operation video of an industrial robot in an embodiment of the present invention, where the main control device is connected to a plurality of industrial robots, each industrial robot platform in the plurality of industrial robots is provided with a corresponding camera, and the corresponding camera is used for video-recording operation contents of the industrial robot, and the specific method includes the following steps:
s201, detecting a pressure value acted on a deformation sensor by a user based on the deformation sensor on the main control equipment;
s202, converting the pressure value into a corresponding pressure signal value;
based on the independent trigger signal that realizes of deformation sensor, can simplify the operation of various user interface, under a plurality of industrial robot modes, it only needs touch and press the deformation sensor and just can realize the work that the corresponding video recording of perhaps a plurality of robots that aim at, has satisfied a key operation demand.
S203, judging a signal value range in which the pressure signal value is located based on the pressure signal value;
s204, acquiring a physical address of the corresponding industrial robot based on the signal value range;
each industrial robot in the plurality of industrial robots is provided with a corresponding signal value range, a pressure value is converted into a corresponding pressure signal value, the pressure signal value range corresponds to physical addresses of different industrial robots, for example, the pressure signal value range triggered by pressing is 0-100, when N is assumed to be 4, the pressure signal value range from 0 to 100 can be uniformly distributed to the physical addresses of 4 industrial robots, for example, the range from 0 to 20 corresponds to the physical address of a first industrial robot, the range from 20 to 50 corresponds to the physical address of a second industrial robot, the range from 50 to 80 corresponds to the physical address of a third industrial robot, the range from 80 to 100 corresponds to the physical address of a fourth industrial robot, and the relation between the industrial robots and the pressure signal values can be obtained through the matching relation, thereby ensuring that the pressure range of the deformation force detected by the deformation sensor belongs to the range.
S205, sending a pre-video recording instruction to the industrial robot by the main control equipment based on the physical address of the industrial robot;
s206, triggering a camera on the industrial robot to pre-record based on a pre-recording instruction by the industrial robot;
the camera on the industrial robot is pre-recorded on the basis of a pre-recording time threshold, which may be, for example, time in seconds, milliseconds to, for example, 1s, 2s, 5000ms, 6000ms, 10s, etc.
Steps S205 to S206 enable pre-recording of a camera on the industrial robot based on the physical address trigger of the industrial robot.
S207, extracting a plurality of video frame images in the pre-recorded video;
s208, judging whether the robot arm of the industrial robot has operation actions or not from the plurality of video frame images based on the machine vision technology;
s209, judging that the industrial robot is in an operating state when the robot arm of the industrial robot has an operating action
Step S207 to step S209 realize the determination of whether the industrial robot is in an operating state based on the scene motion recognition in the pre-video.
S210, triggering a camera on the industrial robot to carry out video recording on the operation content of the industrial robot;
s211, when the industrial robot is judged not to be in the operating state, prompting an operator to perform an operating behavior based on the state of the industrial robot identified by the main control equipment.
Specifically, when the master control equipment identifies that the state of the industrial robot is a non-operation state, an operator is prompted that the industrial robot is not in the operation state; when the master control equipment marks that the state of the industrial robot is in an entering operation state, an operator is prompted that the state of the industrial robot is abnormal.
The main control equipment is communicated with each industrial robot in the plurality of industrial robots in a data bus mode, and the main control equipment is communicated with each camera in a DiiVA technology.
Through the method, the change of the external pressure can be sensed through the deformation sensor in an independent mode, so that a pressure signal value is obtained through detection of the pressure change, the industrial robot can be triggered in time to trigger the corresponding camera to realize monitoring based on the relation between the pressure signal value and the address of the industrial robot, the corresponding camera on the industrial robot is triggered based on a pressure control mode to realize video acquisition, misoperation is avoided, and the operation behavior of a user is facilitated. In whole implementation process, draw earlier the content in the pre-recorded video and judge whether industrial robot has the operation action, be in under operating condition at industrial robot promptly, just start the video recording process, the guarantee is effective to the industrial robot institute's video content of gathering, and avoids gathering industrial robot's static state and consuming resources. The whole pre-recording is subject to a time threshold setting condition, wherein the time threshold condition is subject to the matching of the working cycle of the industrial robot or the initial setting condition. The operating state of the industrial robot is identified and judged from the plurality of video frame images by adopting a machine vision technology, and the robot can be considered to be in an operating body when the robot arm of the industrial robot displayed by the plurality of key frame images is changed or the acquisition area is dynamically changed, so that the whole identification efficiency is improved. When the whole industrial robot is not in an operating state, an abnormal behavior is triggered to a user, so that the user can realize corresponding operation, and the user can conveniently respond to the event or investigate whether the equipment is in failure or whether the behavior is legal.
Those skilled in the art will appreciate that all or part of the steps in the methods of the above embodiments may be implemented by instructions associated with hardware via a program, which may be stored in a computer-readable storage medium, and the storage medium may include: a Read Only Memory (ROM), a Random Access Memory (RAM), a magnetic or optical disk, or the like.
The method and the system for remotely acquiring the operation video of the industrial robot provided by the embodiment of the invention are described in detail, a specific example is applied in the method to explain the principle and the embodiment of the invention, and the description of the embodiment is only used for helping to understand the method and the core idea of the invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.
Claims (8)
1. A method for remotely acquiring operation videos of industrial robots is characterized in that a main control device is connected with a plurality of industrial robots, a corresponding camera is arranged on each industrial robot platform in the plurality of industrial robots, and the corresponding cameras are used for video recording of operation contents of the industrial robots, and the method comprises the following steps:
detecting a pressure value acted on a deformation sensor by a user on the basis of the deformation sensor on the main control equipment;
converting the pressure value into a corresponding pressure signal value;
judging a signal value range in which the pressure signal value is located based on the pressure signal value;
acquiring a physical address of the corresponding industrial robot based on the signal value range, wherein each industrial robot in the plurality of industrial robots is provided with the corresponding signal value range;
triggering and pre-recording a camera on the industrial robot based on the physical address of the industrial robot;
judging whether the industrial robot is in an operating state or not based on scene action recognition in the pre-recorded video;
and triggering a camera on the industrial robot to carry out video recording on the operation content of the industrial robot when the industrial robot is judged to be in the operation state.
2. The method for remotely obtaining the operation video of the industrial robot according to claim 1, wherein the triggering of the pre-recording of the camera on the industrial robot based on the physical address of the industrial robot is specifically:
and the camera on the industrial robot carries out pre-video recording based on a pre-video recording time threshold value.
3. The method for remotely acquiring the operation video of the industrial robot according to claim 1, wherein the determining whether the industrial robot is in the operation state based on the scene motion recognition in the pre-video is specifically as follows:
extracting a plurality of video frame images in a pre-recorded video;
judging whether the robot arm of the industrial robot has an operation action or not from a plurality of video frame images based on a machine vision technology;
and if the robot arm of the industrial robot is judged to have the operation action, judging that the industrial robot is in an operation state.
4. The method for remotely obtaining the operation video of the industrial robot according to claim 1, wherein the determining whether the industrial robot is in the operation state based on the scene motion recognition in the pre-video further comprises:
and when the industrial robot is judged not to be in the operating state, prompting an operator to perform an operating action based on the state of the industrial robot identified by the main control equipment.
5. The method of remotely obtaining video of industrial robot operations as defined in claim 4 wherein prompting an operator for operational action based on the industrial robot status identified by the master device comprises:
when the master control equipment marks that the state of the industrial robot is not in an operating state, prompting an operator that the industrial robot is not in the operating state;
when the master control equipment marks that the state of the industrial robot is in an entering operation state, an operator is prompted that the state of the industrial robot is abnormal.
6. The method for remotely obtaining the operation video of the industrial robot according to any one of the claims 1 to 5, characterized in that the master control device communicates with each industrial robot in the plurality of industrial robots by means of a data bus, and the master control device communicates with each camera by means of a DiiVA technology.
7. The method of remotely obtaining video of the operation of an industrial robot according to claim 6 wherein said triggering the pre-recording of a camera on said industrial robot based on the physical address of said industrial robot comprises:
the main control equipment sends a pre-video recording instruction to the industrial robot based on the physical address of the industrial robot;
the industrial robot triggers a camera on the industrial robot to pre-record images based on the pre-recording instruction.
8. An industrial robot control system, characterized in that a master control device is connected to a plurality of industrial robots, each industrial robot platform of the plurality of industrial robots is provided with a corresponding camera for video recording of the operational content of the industrial robot, and the industrial robot control system performs the method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810969228.XA CN109079789B (en) | 2018-08-23 | 2018-08-23 | Method and system for remotely acquiring operation video of industrial robot |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810969228.XA CN109079789B (en) | 2018-08-23 | 2018-08-23 | Method and system for remotely acquiring operation video of industrial robot |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109079789A CN109079789A (en) | 2018-12-25 |
| CN109079789B true CN109079789B (en) | 2020-09-25 |
Family
ID=64794446
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810969228.XA Active CN109079789B (en) | 2018-08-23 | 2018-08-23 | Method and system for remotely acquiring operation video of industrial robot |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109079789B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111416958A (en) * | 2020-03-17 | 2020-07-14 | 安徽智训机器人技术有限公司 | Industrial robot operation video acquisition method and system |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE8322699U1 (en) * | 1983-08-06 | 1983-11-10 | Hermann Behr & Sohn Gmbh & Co, 7121 Ingersheim | AUTOMATICALLY CONTROLLED HANDLING DEVICE |
| CN101509839A (en) * | 2009-03-12 | 2009-08-19 | 上海交通大学 | Cluster industrial robot failure diagnosis method based on outlier excavation |
| CN102135776B (en) * | 2011-01-25 | 2012-06-13 | 解则晓 | Industrial robot control method based on visual positioning |
| CN106468917B (en) * | 2015-09-14 | 2019-06-14 | 北京理工大学 | A kind of long-range presentation exchange method and system of tangible live real-time video image |
| CN206883639U (en) * | 2017-04-10 | 2018-01-16 | 浙江谱麦科技有限公司 | A kind of vision positioning system of industrial robot |
-
2018
- 2018-08-23 CN CN201810969228.XA patent/CN109079789B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN109079789A (en) | 2018-12-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Wang et al. | Overview of human-robot collaboration in manufacturing | |
| CN109040688B (en) | Method and system for storing acquired industrial robot operation video | |
| CN116841262A (en) | Intelligent factory production on-line monitoring analysis system based on machine vision | |
| CN109048932A (en) | A kind of intellect service robot system | |
| DelPreto et al. | Helping robots learn: a human-robot master-apprentice model using demonstrations via virtual reality teleoperation | |
| JP6544044B2 (en) | Image processing apparatus, image processing system and image processing method | |
| US20220063091A1 (en) | Robot control device, robot system and robot control method | |
| Lázaro et al. | An approach for adapting a cobot workstation to human operator within a deep learning camera | |
| CN109079789B (en) | Method and system for remotely acquiring operation video of industrial robot | |
| CN114730407A (en) | Modeling human behavior in a work environment using neural networks | |
| CN112123338A (en) | Transformer substation intelligent inspection robot system supporting deep learning acceleration | |
| Joseph et al. | An aggregated digital twin solution for human-robot collaboration in industry 4.0 environments | |
| KR20140022654A (en) | Cleaning robot for having gesture recignition function, and the contol method | |
| Atienza et al. | Intuitive human-robot interaction through active 3d gaze tracking | |
| Csokmai et al. | A comprehensive approach to off-line advanced error troubleshooting in intelligent manufacturing systems | |
| WO2022196214A1 (en) | Monitoring system | |
| CN109213101A (en) | Pretreated method and system under a kind of robot system | |
| Moutsis et al. | Fall detection paradigm for embedded devices based on YOLOv8 | |
| CN212623733U (en) | Intelligent production system | |
| Tenguria et al. | Design framework for general purpose object recognition on a robotic platform | |
| Kang et al. | Safety monitoring for human robot collaborative workspaces | |
| Hashimoto | Intelligent interactive spaces-integration of IT and robotics | |
| Kang et al. | Motion Recognition System for Worker Safety in Manufacturing Work Cell | |
| CN214705428U (en) | Work robot based on thing networking | |
| CN112384337A (en) | Method and system for analyzing and/or configuring industrial equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20240129 Address after: 518100 Port Building 0701K506, Shipping Center, No.59 Linhai Avenue, Nanshan Street, Qianhai Shenzhen Hong Kong Cooperation Zone, Shenzhen, Guangdong Province Patentee after: Museum Factory (Shenzhen) Technology Co.,Ltd. Country or region after: China Address before: 528300 Shunde Vocational and technical college, Desheng East Road, Daliang street, Foshan City, Guangdong Province Patentee before: SHUNDE POLYTECHNIC Country or region before: China |
|
| TR01 | Transfer of patent right |