CN102323822A - Method for preventing industrial robot from colliding with worker - Google Patents

Method for preventing industrial robot from colliding with worker Download PDF

Info

Publication number
CN102323822A
CN102323822A CN201110118163A CN201110118163A CN102323822A CN 102323822 A CN102323822 A CN 102323822A CN 201110118163 A CN201110118163 A CN 201110118163A CN 201110118163 A CN201110118163 A CN 201110118163A CN 102323822 A CN102323822 A CN 102323822A
Authority
CN
China
Prior art keywords
workman
industrial robot
zone
perform region
joint
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201110118163A
Other languages
Chinese (zh)
Other versions
CN102323822B (en
Inventor
乔红
苏建华
郑碎武
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Jiangsu Sanli Hydraulic Machinery Co ltd
Original Assignee
WUXI YINYU INTELLIGENT ROBOT CO Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by WUXI YINYU INTELLIGENT ROBOT CO Ltd filed Critical WUXI YINYU INTELLIGENT ROBOT CO Ltd
Priority to CN201110118163.6A priority Critical patent/CN102323822B/en
Publication of CN102323822A publication Critical patent/CN102323822A/en
Application granted granted Critical
Publication of CN102323822B publication Critical patent/CN102323822B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00Programme-controlled manipulators
    • B25J9/16Programme controls
    • B25J9/1674Programme controls characterised by safety, monitoring, diagnostic
    • B25J9/1676Avoiding collision or forbidden zones
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00Program-control systems
    • G05B2219/30Nc systems
    • G05B2219/39Robotics, robotics to robotics hand
    • G05B2219/39091Avoid collision with moving obstacles
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00Program-control systems
    • G05B2219/30Nc systems
    • G05B2219/40Robotics, robotics mapping to robotics vision
    • G05B2219/40201Detect contact, collision with human

Landscapes

  • Engineering & Computer Science (AREA)
  • Robotics (AREA)
  • Mechanical Engineering (AREA)
  • Manipulator (AREA)

Abstract

The invention discloses a method for preventing an industrial robot from colliding with a worker, which comprises the following steps that: a monitoring computer inputs a working area image that a visual unit acquires into a worker movement feature identifying unit for scene modeling, regional analysis and worker movement state prediction; then the worker movement feature identifying unit inputs worker movement feature parameters which are generated accordingly into a safe protective area computing unit; the safe protective area computing unit detects the current movement features of an industrial robot according to the worker movement feature parameters, computes the safe protective area of the worker, and inputs the current movement features of the industrial robot into an industrial robot target position and speed adjusting unit; and the industrial robot target position and speed adjusting unit computes the safe movement scope of the industrial robot according to the safe protective area, judges whether the movement of every joint of the industrial robot enters the safe protective area or not, adjusts the target position and the speed of the industrial robot on line, so that the industrial robot is prevented from colliding with the worker.

Description

A kind of method of avoiding industrial robot collision workman
Technical field
The present invention relates to the method that a kind of workman of avoiding and industrial robot bump in the perform region, particularly a kind of through differentiating workman's movement tendency, avoid industrial robot collision workman's method.
Background technology
A problem that exists during industrial robot is used is: industrial robot need be operated in a perform region sealing, that isolate, suffers the injury of industrial robot for fear of workman's accident, and the workman need be away from this perform region of industrial robot.How letting industrial robot can differentiate workman's movement tendency, avoid colliding the workman, is the key issue that makes industrial robot and workman in same perform region, cooperate and to finish the work.
At present, proposed the many technology and methods of colliding of preventing, bumped to avoid industrial robot and the mobile object or the stationary object that belong to a perform region together based on different principle.Existing method mainly is through the estimation to the collision time and the distance of industrial robot and object, confirms the stand-by time of industrial robot.
For example, the patent No. is US 6,212, and 444 United States Patent (USP) discloses and a kind ofly prevented the method for colliding through the public domain is set, and in this public domain, the operating area of industrial robot overlaps each other with the operating area of other industrial robot or device.When the predetermined reference point on this industrial robot is in the public domain, can get into inhibit signal to other industrial robot or device output first, get into this public domain to forbid other industrial robot or device; When the moveable part of other industrial robot or device is in the public domain, can get into inhibit signal to this industrial robot or device output second again, get into this public domain with the predetermined reference point of forbidding this industrial robot or device.
Publication number is that the one Chinese patent application of CN 101512453A discloses a kind of method of colliding of preventing; It is through estimating the stand-by time of confirming industrial robot excess time before bumping between industrial robot and the object; With estimate bump before excess time and the stand-by time of industrial robot compare; And excess time before estimated bumping during near the stand-by time of industrial robot, stop industrial robot or object.The weak point of this kind method is: movement locus or the movement tendency of workman in the perform region is unforeseen; Thereby be difficult to estimate the excess time before bumping between industrial robot and the workman, also just can't be through estimating the stand-by time of confirming industrial robot excess time before bumping between industrial robot and the object.
Because existing method is not considered workman's kinetic characteristic, like uncertainty factors such as speed and directions, thereby still there is the risk that bumps with industrial robot in the workman.
Summary of the invention
In order to address the above problem, the present invention is a target with security that guarantees the workman and the freedom that strengthens labour movement, and a kind of method of avoiding industrial robot collision workman through the motion state of differentiating the workman is provided.
The technical scheme that the present invention adopts is: a kind of method of industrial robot collision workman of avoiding is after the workman normally gets into the perform region, to accomplish following steps:
Step a2: supervisory control comuter is monitored workman's motion state in real time through visual unit; And the working region image that visual unit collects inputed in the labour movement characteristic recognition unit calculate the labour movement characterisitic parameter; And it is regional based on the security protection that said labour movement characterisitic parameter calculates the workman by security protection zone computing module; Said security protection zone computing module inputs to the security protection zone that obtains in industrial robot target location and the speed adjustment unit; Wherein, said security protection zone is that the workman guarantees its safe Minimum Area in motion state or inactive state;
Step a3: security protection zone computing module is based on the predetermined movement locus of industrial robot; Calculate its zone of protection; And it is inputed in industrial robot target location and the speed adjustment unit; Wherein, said zone of protection representes that each joint of industrial robot all can not collide the area of space of other object;
Step a4: when security protection zone and zone of protection have lap; There is collision workman's danger in the joint of expression industrial robot; The target location and the speed in then said industrial robot target location and each joint of the online adjustment industrial robot of speed adjustment unit avoid any one joint of industrial robot to collide the workman in the perform region.
Preferably, before said step a2, accomplish following steps:
Step a1: supervisory control comuter judges through the border in the real-time monitoring of visual unit zone whether the workman normally gets into the perform region;
Step a11: if the workman does not get into the perform region, then supervisory control comuter is controlled industrial robot according to the preset program complete operation, and returns step a1;
Step a12: if the workman normally gets into the perform region, then supervisory control comuter converts the cooperative work pattern that workman and industrial robot are worked jointly in the perform region, and entering step a2;
Step a13: if the improper entering of workman perform region, then supervisory control comuter provides and the corresponding warning message of degree of protection through alarm unit, and returns step a1 according to the degree of protection of the perform region that the workman got into.
Preferably; Said visual unit comprises the sensor array on the periphery that is installed on the perform region, forms through sensor array to be positioned at the perform region outside and to be positioned at first surveyed area of perform region periphery and to be positioned at the perform region and to be positioned at the second peripheral surveyed area of perform region; Supervisory control comuter through the method on the border in the real-time monitoring of visual unit zone is among the step a1:
Step b1: supervisory control comuter judges through sensor array whether the workman gets into first surveyed area; If being positioned at first detection signal of the sensor on first surveyed area is obstructed; The warning device that then is controlled by first detection signal provides voice suggestion to the workman; And the information that the workman has got into first surveyed area conveyed to supervisory control comuter through bus, and continue to get into step b2;
Step b2: supervisory control comuter judges through sensor array whether the workman gets into second surveyed area; If being positioned at second detection signal of the sensor on second surveyed area is obstructed; The warning device that then is controlled by second detection signal provides the alarm prompting to the workman; And the information that the workman has got into second surveyed area conveyed to supervisory control comuter through bus, and continue to get into step b3;
Step b3: supervisory control comuter judges according to the task situation of industrial robot whether the workman normally gets into the perform region according to demand; If not normal entering, the stop motion of control industrial robot, and completing steps a13; If normal entering the, then completing steps a12.
Preferably, the step of described labour movement characteristic recognition unit computes labour movement characterisitic parameter is:
Step c1: the perform region image to input is set up the perform region background modeling, obtains the perform region background model;
Step c2: the labour movement in the testing regional background model changes, and obtains the workman zone;
Step c3: input workman zone, according to the workman's of hypothesis predicted position distribution in advance, the current location of analyzing the workman distributes, prediction workman's movement tendency;
Step c4: the workman's of input prediction movement tendency, through the workman towards checking, confirm workman's movement tendency, and to the next position of workman with next towards predicting.
Preferably; Definite method in workman's security protection zone is: for being the center with the current location; Is radius with the next position to the distance of current location, with current towards and next towards between angle be that the formed height in fan-shaped bottom surface of central angle is the cylindricality zone of workman's height.
Preferably, definite method of industrial robot ground zone of protection is:
The zone of protection S in the j joint of industrial robot jBe with r jSpheric region for radius;
S j = { s j | ( s j - R j ( i ) ) 2 < r j 2 }
Wherein, r j=| R j(i+1)-R j(i) |, s jRepresent the position that the j joint can arrive in the space, R j(i) current location in expression j joint, R j(i+1) the next position in expression j joint;
The set of the zone of protection in all joints that said zone of protection A2 is an industrial robot:
A2=S 1∪S 2∪...S n
Wherein, n is the quantity in the joint of industrial robot, and n is a natural number, 1≤j≤n.
Preferably, the target location and the method for velocity of said industrial robot target location and the online adjustment industrial robot motion of speed adjustment unit track are:
Steps d 1: the zone of protection S that judges the j joint jWith the security protection zone whether overlapping part is arranged,, then adjust the next position R in j joint if having j(i+1) with at current location R j(i) the joint velocity V that locates j(i);
Steps d 2: the current location R that calculates the j joint j(i) and the interregional bee-line d of security protection j(i):
d j(i)=min|R j(i)-p k|
Wherein, p kThe regional lip-deep point of cylindricality for the security protection zone;
Steps d 3: the present speed V in the j joint of adjustment industrial robot j(i), new present speed is V ' j(i):
V j &prime; ( i ) = d j ( i ) T
Wherein, T is the workman's that obtains at step c4 the next position and the time interval of current location on time shaft;
Steps d 4: the next position R in the j joint of adjustment industrial robot j(i+1), new the next position is R ' j(i+1):
R′ j(i+1)=R j(i)+d j(i)。
Usefulness of the present invention is: from guarantee workman's the freedom to work degree and the angle of personal safety, be core with workman, adjust the motion of industrial robot in real time, avoid industrial robot harm workman.The present invention can increase industrial robot and the workman cooperation possibility of finishing the work.
Description of drawings
Fig. 1 shows a kind of embodiment of avoiding industrial robot collision workman's method of the present invention;
Fig. 2 shows the process flow diagram of avoiding industrial robot collision workman's method of the present invention;
Fig. 3 shows the workflow diagram on the border in supervisory control comuter monitoring zone;
Fig. 4 shows the workflow diagram of labour movement characteristic identification module;
Fig. 5 shows workman's security protection zone;
Fig. 6 shows the zone of protection of industrial robot;
Fig. 7 shows the workflow diagram of industrial robot motion track target location and speed adjusting module.
Embodiment
Carry out detailed explanation below in conjunction with the accompanying drawing specific embodiments of the invention.
Industrial robot collision workman's the method for avoiding of the present invention has mainly been used four unit; Be respectively visual unit, labour movement characteristic recognition unit, security protection zone computing unit and industrial robot target location and speed adjustment unit, this visual unit comprises internal control camera 3, outer monitoring camera 5 and the sensor array 4 among Fig. 1.The place scope of setting when certain task is accomplished for industrial robot 2 in the perform region 1 among Fig. 1; Industrial robot 2 forms its zone of protection 21 in perform region 1; This zone of protection 21 expression workmans may be by the area of space of the joint of industrial robot collision, and promptly each joint of industrial robot all can not collide the area of space of other object; Internal control camera 3 is separately positioned on the inside and outside of perform region 1 with outer monitoring camera 5; Sensor array 4 is installed on the periphery of perform region 1, forms through sensor array 4 that to be located substantially on perform region 1 outer and be positioned at first surveyed area 41 of perform region 1 periphery and be located substantially on perform region 1 and be positioned at the second peripheral surveyed area 42 of perform region 1.Workman 6 forms the security protection zone 61 of oneself in perform region 1, this security protection zone 61 expression workmans guarantee its safe Minimum Area in motion state or stationary state.
The tandem type industrial robot that this industrial robot 2 can be a six degree of freedom can certainly be the industrial robot of other type; Internal control camera 3 can be the CCD camera with outer monitoring camera 5, also can be the camera of other type, as long as can satisfy the requirement of IMAQ; Sensor array 4 can be made up of a plurality of infrared light curtain formula sensors, also can by other type pass through judge that whether signal is blocked the sensor that whether gets into the appointed area with inspected object by object and constitute.
Annexation between four unit is:
The perform region image that supervisory control comuter collects visual unit (being mainly internal control camera 3 wherein) inputs to and carries out scene modeling, regional analysis and workman in the labour movement characteristic recognition unit and transport state gesture prediction; Afterwards, the labour movement characterisitic parameter that labour movement characteristic recognition unit will generate in view of the above (workman's current location, current movement velocity and current direction of motion) inputs in the computing unit of security protection zone.Security protection zone computing unit calculates workman's security protection zone 61 according to the current kinetic characteristic of labour movement characterisitic parameter detection industrial robot, and it is inputed in industrial robot target location and the speed adjustment unit.Industrial robot target location and speed adjustment unit calculate the safety movement scope of industrial robot according to security protection zone 61; Whether the motion of judging each joint of industrial robot gets into this security protection zone, the target location of online adjustment industrial robot and speed.
Supervisory control comuter can industrial computer also can be other system that image, signal Processing and computing function are arranged.At this; This labour movement characteristic recognition unit, security protection zone computing unit and industrial robot target location and speed adjustment unit all can be the processing unit of realizing through supervisory control comuter, can certainly realize through the processor that is independent of supervisory control comuter and is connected with the supervisory control comuter communication.
Fig. 2 shows the process flow diagram of avoiding industrial robot collision workman's method of the present invention, is specially:
Step a1: supervisory control comuter judges through the border of outer monitoring camera 5 with sensor array 4 real-time monitoring zones 1 whether the workman normally gets into perform region 1;
Step a11: if the workman does not get into perform region 1, then supervisory control comuter is controlled industrial robot according to the preset program complete operation, and returns step a1;
Step a12: if the workman normally gets into perform region 1, then supervisory control comuter converts the cooperative work pattern that workman and industrial robot are worked jointly in the perform region, and entering step a2;
Step a13: if the improper entering of workman perform region, then supervisory control comuter provides and the corresponding warning message of degree of protection through alarm unit, and returns step a1 according to the degree of protection of the perform region that the workman got into;
Step a2: supervisory control comuter is through internal control camera 3 monitoring workmans' motion states in real time, and the perform region image that internal control camera 3 collects inputed to calculates the labour movement characterisitic parameter in the labour movement characteristic recognition unit; Security protection zone computing module calculates workman's security protection zone 61 again according to this labour movement characterisitic parameter, and it is inputed in industrial robot target location and the speed adjustment unit;
Step a3: security protection zone computing module calculates its zone of protection 21, and it is inputed in industrial robot target location and the speed adjustment unit according to the predetermined movement locus of industrial robot;
Step a4: when there is lap in security protection zone 61 with zone of protection 21; There is collision workman's danger in the joint of expression industrial robot; Then the target location and the speed in this industrial robot target location and each joint of the online adjustment industrial robot of speed adjustment unit avoid any one joint of industrial robot to collide the workman in the perform region.
Fig. 3 shows supervisory control comuter among the step a1 through the method for work process flow diagram of outer monitoring camera 5 with the border of sensor array 4 real-time monitorings regional 1, is specially:
Step b1: supervisory control comuter judges through sensor array 4 whether the workman gets into first surveyed area 41; If being positioned at first detection signal of the sensor on first surveyed area is obstructed; The warning device that then is controlled by first detection signal provides voice suggestion to the workman; And the information that the workman has got into first surveyed area conveyed to supervisory control comuter through bus, and continue to get into step b2;
Step b2: supervisory control comuter judges through sensor array 4 whether the workman gets into second surveyed area; If being positioned at second detection signal of the sensor on second surveyed area is obstructed; The warning device that then is controlled by second detection signal provides the alarm prompting to the workman; And the information that the workman has got into second surveyed area conveyed to supervisory control comuter through bus, and continue to get into step b3;
Step b3: supervisory control comuter judges according to the task situation of industrial robot whether the workman normally gets into the perform region according to demand; If not normal entering, the stop motion of control industrial robot, and completing steps a13; If normal entering the, then completing steps a12.
The above-mentioned warning device that is controlled by first detection signal can be same warning device with the warning device that is controlled by second detection signal; This warning device produces different responses to first and second detection signals; Certainly, the two also can be different warning devices.In addition, this warning device can belong to above-mentioned alarm unit, and the alerting signal among the step a13 can be carried out by this warning device, is preferably through other warning device that belongs to alarm unit and carries out.
Fig. 4 shows the workflow diagram of labour movement characteristic recognition unit, is specially:
Step c1: the background modeling of perform region
Labour movement characteristic recognition unit is set up the gaussian statistics model based on time coordinate system according to the perform region image (being preferably video image) of input; Then the gaussian statistics model is carried out denoising with level and smooth; Obtain the initial back-ground model of perform region; Adopt bayes method that the sample point in the initial back-ground model is calculated renewal in real time then,, obtain the background model of perform region to eliminate the influence that complicated background that changes and illumination variation are brought.
Step c2: evaluating objects (workman) zone
Background model to the perform region is carried out motion detection and background subtraction, obtains to include workman's zone; Noise rejecting, zone fusion and level and smooth and morphology processing are carried out in the zone that includes the workman, finally obtain the workman zone.
Step c3: evaluating objects (workman)
Labour movement characteristic recognition unit distributes according to workman zone that obtains and the predicted position that is stored in workman wherein in advance; The current location of analyzing the workman distributes; Utilize the tree structure sorter judge the workman towards (front or side towards robot, promptly whether with industrial robot over against).
Step c4: the movement tendency of target of prediction (workman)
Each image constantly to the workman carries out Kalman filtering; Simultaneously through the workman towards checking, confirm workman's movement tendency, and to the next position of workman with towards predicting; Wherein, target workman's the next position and the current location time interval on time shaft is T.
In step c4, mainly set up labour movement trajectory predictions model with the method that particle filter combines through the Kalman, and the next position and next of judging the workman through this forecast model towards, be specially:
At first; The initial motion model of setting up the workman based on workman's task and state (being that predicted position distributes); At the labour movement initial stage, based on this initial motion model adopt the graceful Forecasting Methodology of OK a karaoke club to the next position of workman with next towards predicting and judging;
Then; Through study and modeling to workman's position in the successive frame that has obtained; Draw track and the kinematic parameter (current location of promptly analyzing the workman distributes) of labour movement, revise the model parameter of Kalman's prediction, and the next position of judging the workman in view of the above with next towards;
At last; Uncertainty and nonlinear problem for the processing target labour movement; Introduce particle filter algorithm the workman's of Kalman's prediction position distribution is carried out the sampling of importance probability; Through video measuring function and target weight mean value computation, obtain most probable zone of next frame target and direction of motion.
As shown in Figure 5; Workman's security protection zone 61 is to be the center with current location P (i); Is radius with the next position P (i+1) to the distance R of current location P (i), with current be that the formed height in fan-shaped bottom surface of central angle is the cylindricality zone of workman's height H towards O (i) and next angle theta between O (i+1).
Fig. 6 shows the zone of protection 21 of industrial robot, wherein,
The zone of protection S in the j joint of industrial robot jBe to think radius r jSpheric region:
S j = { s j | ( s j - R j ( i ) ) 2 < r j 2 }
Wherein, r j=| R j(i+1)-R j(i) |, s jRepresent the position that the j joint can arrive in the space, R j(i) current location in expression j joint, R j(i+1) the next position in expression j joint, i.e. next position constantly.
Zone of protection A2 (21) is the set (union) of zone of protection in all joints of industrial robot, that is:
A2=S 1∪S 2∪...S n
Wherein, S 1Be the zone of protection in first joint, S 2Be the zone of protection of second joint, S nBe the zone of protection in n joint, wherein, n is a natural number, the quantity of expression industrial robot joint, 1≤j≤n.Industrial robot as shown in Figure 6 has three joints, and promptly n equals 3, and zone of protection separately is respectively S 1, S 2And S 3
Fig. 7 is industrial robot target location and the target location of the online adjustment industrial robot motion of speed adjustment unit track and the method for work process flow diagram of speed, is specially:
Steps d 1: the zone of protection S that judges the j joint jWith security protection zone 61 whether overlapping part is arranged,, then adjust the next position R in j joint if having j(i+1) with at current location R j(i) the joint velocity V that locates j(i).
Steps d 2: the current location R that calculates the j joint j(i) and the bee-line d in 61 in security protection zone j(i):
d j(i)=min|R j(i)-p k|
Wherein, p kThe regional lip-deep point of cylindricality for the security protection zone.
Steps d 3: the present speed V in the j joint of adjustment industrial robot j(i), new present speed is V ' j(i):
V j &prime; ( i ) = d j ( i ) T
Steps d 4: the next position R in the j joint of adjustment industrial robot j(i+1), new the next position is R ' j(i+1):
R′ j(i+1)=R j(i)+d j(i)
Supervisory control comuter is responsible for new target location (being new the next position) and new present speed are sent to the controller of industrial robot, and controls industrial robot by controller and accomplish new action.
Being merely preferred embodiment of the present invention in sum, is not to be used for limiting practical range of the present invention.Be that all equivalences of doing according to the content of claim of the present invention change and modification, all should belong to technological category of the present invention.

Claims (9)

1. a method of avoiding industrial robot collision workman is characterized in that, after the workman normally gets into the perform region, accomplishes following steps:
Step a2: supervisory control comuter is monitored workman's motion state in real time through visual unit; And the working region image that visual unit collects inputed in the labour movement characteristic recognition unit calculate the labour movement characterisitic parameter; And it is regional based on the security protection that said labour movement characterisitic parameter calculates the workman by security protection zone computing module; Said security protection zone computing module inputs to the security protection zone that obtains in industrial robot target location and the speed adjustment unit; Wherein, said security protection zone is that the workman guarantees its safe Minimum Area in motion state or inactive state;
Step a3: security protection zone computing module is based on the predetermined movement locus of industrial robot; Calculate its zone of protection; And it is inputed in industrial robot target location and the speed adjustment unit; Wherein, said zone of protection representes that each joint of industrial robot all can not collide the area of space of other object;
Step a4: when security protection zone and zone of protection have lap; There is collision workman's danger in the joint of expression industrial robot; The target location and the speed in then said industrial robot target location and each joint of the online adjustment industrial robot of speed adjustment unit avoid any one joint of industrial robot to collide the workman in the perform region.
2. the method for avoiding industrial robot collision workman according to claim 1 is characterized in that, before said step a2, accomplishes following steps:
Step a1: supervisory control comuter judges through the border in the real-time monitoring of visual unit zone whether the workman normally gets into the perform region;
Step all: if the workman does not get into the perform region, then supervisory control comuter is controlled industrial robot according to the preset program complete operation, and returns step a1;
Step a12: if the workman normally gets into the perform region, then supervisory control comuter converts the cooperative work pattern that workman and industrial robot are worked jointly in the perform region, and entering step a2;
Step a13: if the improper entering of workman perform region, then supervisory control comuter provides and the corresponding warning message of degree of protection through alarm unit, and returns step a1 according to the degree of protection of the perform region that the workman got into.
3. the method for avoiding industrial robot collision workman according to claim 2; It is characterized in that; Said visual unit comprises the sensor array on the periphery that is installed on the perform region, forms through sensor array to be positioned at the perform region outside and to be positioned at first surveyed area of perform region periphery and to be positioned at the perform region and to be positioned at the second peripheral surveyed area of perform region; Supervisory control comuter through the method on the border in the real-time monitoring of visual unit zone is among the step a1:
Step b1: supervisory control comuter judges through sensor array whether the workman gets into first surveyed area; If being positioned at first detection signal of the sensor on first surveyed area is obstructed; The warning device that then is controlled by first detection signal provides voice suggestion to the workman; And the information that the workman has got into first surveyed area conveyed to supervisory control comuter through bus, and continue to get into step b2;
Step b2: supervisory control comuter judges through sensor array whether the workman gets into second surveyed area; If being positioned at second detection signal of the sensor on second surveyed area is obstructed; The warning device that then is controlled by second detection signal provides the alarm prompting to the workman; And the information that the workman has got into second surveyed area conveyed to supervisory control comuter through bus, and continue to get into step b3;
Step b3: supervisory control comuter judges according to the task situation of industrial robot whether the workman normally gets into the perform region according to demand; If not normal entering, the stop motion of control industrial robot, and completing steps a13; If normal entering the, then completing steps a12.
4. the method for avoiding industrial robot collision workman according to claim 3; It is characterized in that; Said visual unit also comprises the external monitoring camera that is installed on outside the perform region; In step a1, supervisory control comuter is monitored the border of perform region in real time through said external monitoring camera and sensor array.
5. the method for avoiding industrial robot collision workman according to claim 1; It is characterized in that; Said visual unit comprises the internal monitoring camera that is installed in the perform region, and in step a2, supervisory control comuter is monitored workman's motion state in real time through said internal monitoring camera.
6. according to each described method of avoiding industrial robot collision workman in the claim 1 to 5, it is characterized in that the step of described labour movement characteristic recognition unit computes labour movement characterisitic parameter is:
Step c1: the perform region image to input is set up the perform region background modeling, obtains the perform region background model;
Step c2: the labour movement in the testing regional background model changes, and obtains the workman zone;
Step c3: input workman zone, according to the workman's of hypothesis predicted position distribution in advance, the current location of analyzing the workman distributes, prediction workman's movement tendency;
Step c4: the workman's of input prediction movement tendency, through the workman towards checking, confirm workman's movement tendency, and to the next position of workman with next towards predicting.
7. a kind of motion state through the differentiation workman according to claim 6 is collided workman's method to avoid industrial robot; It is characterized in that; Definite method in workman's security protection zone is: for being the center with the current location; Is radius with the next position to the distance of current location, with current towards and next towards between angle be that the formed height in fan-shaped bottom surface of central angle is the cylindricality zone of workman's height.
8. a kind of method of avoiding industrial robot collision workman according to claim 7 is characterized in that definite method of industrial robot ground zone of protection is:
The zone of protection S in the j joint of industrial robot jBe with r jSpheric region for radius;
S j = { s j | ( s j - R j ( i ) ) 2 < r j 2 }
Wherein, r j=| R j(i+1)-R j(i) |, s jRepresent the position that the j joint can arrive in the space, R j(i) current location in expression j joint, R j(i+1) the next position in expression j joint;
The set of the zone of protection in all joints that said zone of protection A2 is an industrial robot:
A2=S 1∪S 2∪...S n
Wherein, n is the quantity in the joint of industrial robot, and n is a natural number, 1≤j≤n.
9. a kind of method of avoiding industrial robot collision workman according to claim 8 is characterized in that the target location and the method for velocity of said industrial robot target location and the online adjustment industrial robot motion of speed adjustment unit track are:
Steps d 1: the zone of protection S that judges the j joint jWith the security protection zone whether overlapping part is arranged,, then adjust the next position R in j joint if having j(i+1) with at current location R j(i) the joint velocity V that locates j(i);
Steps d 2: the current location R that calculates the j joint j(i) and the interregional bee-line d of security protection j(i):
d j(i)=min|R j(i)-p k|
Wherein, p kThe regional lip-deep point of cylindricality for the security protection zone;
Steps d 3: the present speed V in the j joint of adjustment industrial robot j(i), new present speed is V ' j(i):
V j &prime; ( i ) = d j ( i ) T
Wherein, T is the workman's that obtains at step c4 the next position and the time interval of current location on time shaft;
Steps d 4: the next position R in the j joint of adjustment industrial robot j(i+1), new the next position is R ' j(i+1):
R′ j(i+1)=R j(i)+d j(i)。
CN201110118163.6A 2011-05-09 2011-05-09 Method for preventing industrial robot from colliding with worker Expired - Fee Related CN102323822B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201110118163.6A CN102323822B (en) 2011-05-09 2011-05-09 Method for preventing industrial robot from colliding with worker

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201110118163.6A CN102323822B (en) 2011-05-09 2011-05-09 Method for preventing industrial robot from colliding with worker

Publications (2)

Publication Number Publication Date
CN102323822A true CN102323822A (en) 2012-01-18
CN102323822B CN102323822B (en) 2013-07-03

Family

ID=45451572

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201110118163.6A Expired - Fee Related CN102323822B (en) 2011-05-09 2011-05-09 Method for preventing industrial robot from colliding with worker

Country Status (1)

Country Link
CN (1) CN102323822B (en)

Cited By (46)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2014008929A1 (en) * 2012-07-10 2014-01-16 Siemens Aktiengesellschaft Robot arrangement and method for controlling a robot
CN103776813A (en) * 2014-01-27 2014-05-07 公安部第一研究所 Dangerous cargo long distance detecting device based on Raman spectrum analysis technology
CN104143040A (en) * 2013-05-06 2014-11-12 Abb技术有限公司 Human safety provision in mobile automation environments
CN104423381A (en) * 2013-08-30 2015-03-18 联想(北京)有限公司 Electronic equipment and protection method thereof
CN104416581A (en) * 2013-08-27 2015-03-18 富泰华工业(深圳)有限公司 Mechanical arm with warning function
CN104718055A (en) * 2012-10-25 2015-06-17 松下知识产权经营株式会社 Robot malfunction indication method
CN104723350A (en) * 2015-03-16 2015-06-24 珠海格力电器股份有限公司 Intelligent control method and system for industrial robot safety protection
CN105637441A (en) * 2013-08-30 2016-06-01 乔伊·姆·特拉华公司 Proximity detection systems and methods
CN106181963A (en) * 2014-12-19 2016-12-07 库卡罗伯特有限公司 Robot system
CN106217407A (en) * 2016-07-21 2016-12-14 青岛欧开智能系统有限公司 A kind of mechanical arm possessing dual safety
CN106945074A (en) * 2015-12-29 2017-07-14 上银科技股份有限公司 Robot security's protector
CN106959696A (en) * 2017-05-10 2017-07-18 北京京东尚科信息技术有限公司 The control method and device of moving target
CN107016850A (en) * 2016-01-28 2017-08-04 福特环球技术公司 Avoid the method and system of Workplace Safety risk
CN107186711A (en) * 2017-05-12 2017-09-22 广州视源电子科技股份有限公司 Limiting protection method and device for mechanical arm and robot
CN107463168A (en) * 2016-06-06 2017-12-12 苏州宝时得电动工具有限公司 Localization method and system, map constructing method and system, automatic running device
CN107877547A (en) * 2016-09-30 2018-04-06 西门子(中国)有限公司 Impact protection apparatus and robot device
CN108536142A (en) * 2018-03-18 2018-09-14 上海交通大学 Industrial robot anti-collision early warning system based on digital fringe projection and method
CN108972539A (en) * 2017-05-31 2018-12-11 西克股份公司 The determination of the movement of machine to be protected
CN109015644A (en) * 2018-08-17 2018-12-18 徐润秋 A kind of robot security's operation control method
CN109129578A (en) * 2017-06-28 2019-01-04 得利捷Ip 科技有限公司 security system
CN109397289A (en) * 2018-11-13 2019-03-01 华东师范大学 A kind of safety control and control method of industrial robot
CN109416886A (en) * 2016-06-22 2019-03-01 库卡德国有限公司 Check method, Unpiloted carrier vehicle and the system with multiple Unpiloted carrier vehicles of the collision between two Unpiloted carrier vehicles
CN109460076A (en) * 2018-11-09 2019-03-12 北京理工大学 A kind of unattended control system and its control method applied to frontier defense
CN110026977A (en) * 2018-01-12 2019-07-19 株式会社日立制作所 Robot controller and automatic package system
CN110570687A (en) * 2018-06-06 2019-12-13 杭州海康机器人技术有限公司 AGV control method and device and storage medium
CN110900601A (en) * 2019-11-15 2020-03-24 武汉理工大学 Robot operation autonomous control method for human-robot cooperation safety guarantee
CN111178257A (en) * 2019-12-28 2020-05-19 深圳奥比中光科技有限公司 Regional safety protection system and method based on depth camera
CN111203875A (en) * 2020-01-07 2020-05-29 重庆邮电大学 Mechanical arm collision safety level detection system
CN111300491A (en) * 2019-11-20 2020-06-19 深圳市烨嘉为技术有限公司 Human-computer cooperation safety system based on cooperative driving and controlling integrated robot
CN111823273A (en) * 2019-08-29 2020-10-27 浙江大学宁波理工学院 Operation monitoring system and monitoring method for industrial robot online track prediction
CN112140102A (en) * 2020-06-08 2020-12-29 深圳市越疆科技有限公司 Obstacle avoidance method, device and system of industrial robot
CN112256019A (en) * 2020-09-07 2021-01-22 北京京东乾石科技有限公司 Automatic guided vehicle control method and device, warehousing system, electronic equipment and medium
CN112783171A (en) * 2020-12-31 2021-05-11 上海擎朗智能科技有限公司 Robot operation control method and device, electronic equipment and storage medium
CN112817302A (en) * 2019-11-18 2021-05-18 中冶赛迪工程技术股份有限公司 Safety control method, system, equipment and readable medium for industrial robot
CN112967336A (en) * 2021-01-25 2021-06-15 广东技术师范大学 Human-computer security cooperation method and device based on video target motion tracking
CN113016038A (en) * 2018-10-12 2021-06-22 索尼集团公司 Haptic obstruction to avoid collisions with robotic surgical equipment
CN113239802A (en) * 2021-05-13 2021-08-10 上海汇焰智能科技有限公司 Safety monitoring method, device, medium and electronic equipment
CN113984105A (en) * 2020-07-27 2022-01-28 丰田自动车株式会社 Control system, control method, and computer-readable recording medium
CN114281024A (en) * 2021-12-23 2022-04-05 大族激光科技产业集团股份有限公司 Anti-collision detection method, numerical control system, machining equipment and storage medium
CN114565852A (en) * 2022-03-04 2022-05-31 上海应用技术大学 Industrial robot safety protection system and method based on machine vision
CN114880888A (en) * 2022-07-08 2022-08-09 四川大学 Multi-rotary-joint robot end effector pose correlation dynamics prediction method
US11407111B2 (en) 2018-06-27 2022-08-09 Abb Schweiz Ag Method and system to generate a 3D model for a robot scene
US11453127B2 (en) 2020-03-03 2022-09-27 Shenzhen Fugui Precision Ind. Co., Ltd. Method for providing power-off command to an automatic apparatus within proximity of a human and control apparatus employing the method
US20220362934A1 (en) * 2019-09-30 2022-11-17 Johnan Corporation Control device, control method, and program
CN117207202A (en) * 2023-11-09 2023-12-12 国网山东省电力公司东营供电公司 Anti-collision constraint control method, system, terminal and medium for live working robot
WO2024011518A1 (en) * 2022-07-14 2024-01-18 Abb Schweiz Ag Method for controlling industrial robot and industrial robot

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0845723A1 (en) * 1996-06-18 1998-06-03 Fanuc Ltd Method of avoiding interference of industrial robot
JP2000190262A (en) * 1998-12-22 2000-07-11 Denso Corp Control device for robot
CN1461693A (en) * 2002-05-30 2003-12-17 库卡-罗伯特有限公司 Method for preventing and device for controlling colliding between cooperated manipulators
CN101352854A (en) * 2008-07-17 2009-01-28 上海交通大学 Remote operation planar redundant manipulator automated guided intelligent element, system and method
CN101512452A (en) * 2006-07-31 2009-08-19 皮尔茨公司 Camera-based monitoring of machines with moving machine elements for the purpose of collision prevention
CN101512453A (en) * 2006-09-14 2009-08-19 Abb研究有限公司 A method and device for avoiding collisions between an industrial robot and an object
CN101984750A (en) * 2007-10-01 2011-03-09 Abb科技公司 A method for controlling a plurality of axes in an industrial robot system and an industrial robot system

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0845723A1 (en) * 1996-06-18 1998-06-03 Fanuc Ltd Method of avoiding interference of industrial robot
US6212444B1 (en) * 1996-06-18 2001-04-03 Fanuc Limited Method of avoiding interference of industrial robot
JP2000190262A (en) * 1998-12-22 2000-07-11 Denso Corp Control device for robot
CN1461693A (en) * 2002-05-30 2003-12-17 库卡-罗伯特有限公司 Method for preventing and device for controlling colliding between cooperated manipulators
CN101512452A (en) * 2006-07-31 2009-08-19 皮尔茨公司 Camera-based monitoring of machines with moving machine elements for the purpose of collision prevention
CN101512453A (en) * 2006-09-14 2009-08-19 Abb研究有限公司 A method and device for avoiding collisions between an industrial robot and an object
CN101984750A (en) * 2007-10-01 2011-03-09 Abb科技公司 A method for controlling a plurality of axes in an industrial robot system and an industrial robot system
CN101352854A (en) * 2008-07-17 2009-01-28 上海交通大学 Remote operation planar redundant manipulator automated guided intelligent element, system and method

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
孟正大等: "机器人无碰撞路径规划方法研究及实现", 《华中科技大学学报(自然科学版)》 *

Cited By (64)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104428107B (en) * 2012-07-10 2016-06-29 西门子公司 The method that robot arranges and is used for controlling robot
WO2014008929A1 (en) * 2012-07-10 2014-01-16 Siemens Aktiengesellschaft Robot arrangement and method for controlling a robot
CN104428107A (en) * 2012-07-10 2015-03-18 西门子公司 Robot arrangement and method for controlling a robot
EP2838698B1 (en) 2012-07-10 2016-05-04 Siemens Aktiengesellschaft Robot arrangement and method for controlling a robot
US9694497B2 (en) 2012-07-10 2017-07-04 Siemens Aktiengesellschaft Robot arrangement and method for controlling a robot
CN104718055A (en) * 2012-10-25 2015-06-17 松下知识产权经营株式会社 Robot malfunction indication method
US9701022B2 (en) 2012-10-25 2017-07-11 Panasonic Intellectual Property Management Co., Ltd. Robot malfunction indication method
CN104143040A (en) * 2013-05-06 2014-11-12 Abb技术有限公司 Human safety provision in mobile automation environments
CN104143040B (en) * 2013-05-06 2019-02-12 Abb瑞士股份有限公司 Personnel safety measure in movement automation environment
CN104416581A (en) * 2013-08-27 2015-03-18 富泰华工业(深圳)有限公司 Mechanical arm with warning function
CN105637441B (en) * 2013-08-30 2018-04-13 乔伊·姆·特拉华公司 proximity detection system and method
CN105637441A (en) * 2013-08-30 2016-06-01 乔伊·姆·特拉华公司 Proximity detection systems and methods
CN104423381A (en) * 2013-08-30 2015-03-18 联想(北京)有限公司 Electronic equipment and protection method thereof
CN103776813A (en) * 2014-01-27 2014-05-07 公安部第一研究所 Dangerous cargo long distance detecting device based on Raman spectrum analysis technology
CN106181963A (en) * 2014-12-19 2016-12-07 库卡罗伯特有限公司 Robot system
CN104723350A (en) * 2015-03-16 2015-06-24 珠海格力电器股份有限公司 Intelligent control method and system for industrial robot safety protection
CN106945074A (en) * 2015-12-29 2017-07-14 上银科技股份有限公司 Robot security's protector
CN107016850A (en) * 2016-01-28 2017-08-04 福特环球技术公司 Avoid the method and system of Workplace Safety risk
CN107463168A (en) * 2016-06-06 2017-12-12 苏州宝时得电动工具有限公司 Localization method and system, map constructing method and system, automatic running device
CN109416886A (en) * 2016-06-22 2019-03-01 库卡德国有限公司 Check method, Unpiloted carrier vehicle and the system with multiple Unpiloted carrier vehicles of the collision between two Unpiloted carrier vehicles
CN109416886B (en) * 2016-06-22 2022-01-04 库卡德国有限公司 Method for checking a collision between two driverless transport vehicles, driverless transport vehicle and system having a plurality of driverless transport vehicles
CN106217407B (en) * 2016-07-21 2018-12-11 青岛欧开智能系统有限公司 A kind of mechanical arm having dual safety
CN106217407A (en) * 2016-07-21 2016-12-14 青岛欧开智能系统有限公司 A kind of mechanical arm possessing dual safety
CN107877547A (en) * 2016-09-30 2018-04-06 西门子(中国)有限公司 Impact protection apparatus and robot device
CN106959696B (en) * 2017-05-10 2020-03-03 北京京东尚科信息技术有限公司 Control method and device for moving target
CN106959696A (en) * 2017-05-10 2017-07-18 北京京东尚科信息技术有限公司 The control method and device of moving target
CN107186711A (en) * 2017-05-12 2017-09-22 广州视源电子科技股份有限公司 Limiting protection method and device for mechanical arm and robot
CN108972539A (en) * 2017-05-31 2018-12-11 西克股份公司 The determination of the movement of machine to be protected
CN109129578A (en) * 2017-06-28 2019-01-04 得利捷Ip 科技有限公司 security system
CN110026977A (en) * 2018-01-12 2019-07-19 株式会社日立制作所 Robot controller and automatic package system
CN110026977B (en) * 2018-01-12 2022-03-29 株式会社日立制作所 Robot control device and automatic assembly system
CN108536142A (en) * 2018-03-18 2018-09-14 上海交通大学 Industrial robot anti-collision early warning system based on digital fringe projection and method
CN108536142B (en) * 2018-03-18 2020-06-12 上海交通大学 Industrial robot anti-collision early warning system and method based on digital grating projection
CN110570687A (en) * 2018-06-06 2019-12-13 杭州海康机器人技术有限公司 AGV control method and device and storage medium
US11407111B2 (en) 2018-06-27 2022-08-09 Abb Schweiz Ag Method and system to generate a 3D model for a robot scene
CN109015644A (en) * 2018-08-17 2018-12-18 徐润秋 A kind of robot security's operation control method
US11980436B2 (en) 2018-10-12 2024-05-14 Sony Corporation Medical system, method and computer program
CN113016038A (en) * 2018-10-12 2021-06-22 索尼集团公司 Haptic obstruction to avoid collisions with robotic surgical equipment
CN109460076A (en) * 2018-11-09 2019-03-12 北京理工大学 A kind of unattended control system and its control method applied to frontier defense
CN109397289A (en) * 2018-11-13 2019-03-01 华东师范大学 A kind of safety control and control method of industrial robot
CN111823273A (en) * 2019-08-29 2020-10-27 浙江大学宁波理工学院 Operation monitoring system and monitoring method for industrial robot online track prediction
CN111823273B (en) * 2019-08-29 2022-07-19 浙江大学宁波理工学院 Operation monitoring system and monitoring method for industrial robot online track prediction
US20220362934A1 (en) * 2019-09-30 2022-11-17 Johnan Corporation Control device, control method, and program
CN110900601A (en) * 2019-11-15 2020-03-24 武汉理工大学 Robot operation autonomous control method for human-robot cooperation safety guarantee
CN110900601B (en) * 2019-11-15 2022-06-03 武汉理工大学 Robot operation autonomous control method for human-robot cooperation safety guarantee
CN112817302A (en) * 2019-11-18 2021-05-18 中冶赛迪工程技术股份有限公司 Safety control method, system, equipment and readable medium for industrial robot
CN111300491A (en) * 2019-11-20 2020-06-19 深圳市烨嘉为技术有限公司 Human-computer cooperation safety system based on cooperative driving and controlling integrated robot
CN111178257A (en) * 2019-12-28 2020-05-19 深圳奥比中光科技有限公司 Regional safety protection system and method based on depth camera
CN111203875B (en) * 2020-01-07 2022-08-09 重庆邮电大学 Mechanical arm collision safety level detection system
CN111203875A (en) * 2020-01-07 2020-05-29 重庆邮电大学 Mechanical arm collision safety level detection system
US11453127B2 (en) 2020-03-03 2022-09-27 Shenzhen Fugui Precision Ind. Co., Ltd. Method for providing power-off command to an automatic apparatus within proximity of a human and control apparatus employing the method
CN112140102A (en) * 2020-06-08 2020-12-29 深圳市越疆科技有限公司 Obstacle avoidance method, device and system of industrial robot
CN113984105A (en) * 2020-07-27 2022-01-28 丰田自动车株式会社 Control system, control method, and computer-readable recording medium
CN112256019A (en) * 2020-09-07 2021-01-22 北京京东乾石科技有限公司 Automatic guided vehicle control method and device, warehousing system, electronic equipment and medium
CN112783171A (en) * 2020-12-31 2021-05-11 上海擎朗智能科技有限公司 Robot operation control method and device, electronic equipment and storage medium
CN112967336A (en) * 2021-01-25 2021-06-15 广东技术师范大学 Human-computer security cooperation method and device based on video target motion tracking
CN113239802A (en) * 2021-05-13 2021-08-10 上海汇焰智能科技有限公司 Safety monitoring method, device, medium and electronic equipment
CN114281024A (en) * 2021-12-23 2022-04-05 大族激光科技产业集团股份有限公司 Anti-collision detection method, numerical control system, machining equipment and storage medium
CN114565852A (en) * 2022-03-04 2022-05-31 上海应用技术大学 Industrial robot safety protection system and method based on machine vision
CN114880888B (en) * 2022-07-08 2022-09-09 四川大学 Multi-rotary-joint robot end effector pose correlation dynamics prediction method
CN114880888A (en) * 2022-07-08 2022-08-09 四川大学 Multi-rotary-joint robot end effector pose correlation dynamics prediction method
WO2024011518A1 (en) * 2022-07-14 2024-01-18 Abb Schweiz Ag Method for controlling industrial robot and industrial robot
CN117207202A (en) * 2023-11-09 2023-12-12 国网山东省电力公司东营供电公司 Anti-collision constraint control method, system, terminal and medium for live working robot
CN117207202B (en) * 2023-11-09 2024-04-02 国网山东省电力公司东营供电公司 Anti-collision constraint control method, system, terminal and medium for live working robot

Also Published As

Publication number Publication date
CN102323822B (en) 2013-07-03

Similar Documents

Publication Publication Date Title
CN102323822B (en) Method for preventing industrial robot from colliding with worker
Kim et al. Image-based construction hazard avoidance system using augmented reality in wearable device
KR101723283B1 (en) Worker Behavior Based Safety Management System and Method
EP2300949B1 (en) Video-based system and method of elevator door detection
JP4753320B2 (en) Escalator monitoring system
KR102065975B1 (en) Safety Management System Using a Lidar for Heavy Machine
CN102099614A (en) System for safety protection of human beings against hazardous incidents with robots
JP5877135B2 (en) Image recognition apparatus and elevator apparatus
CN110733983B (en) Tower crane safety control system and control method thereof
CN107662867B (en) Step roller monitoring and maintenance operator monitoring for passenger conveyors
KR101283965B1 (en) Adaptive Accident Detecting System And Method thereof
EP2546807B1 (en) Traffic monitoring device
CN108068140A (en) For being applied to the device and method on object
JP3888055B2 (en) Train forward anomaly detection device using optical flow
KR20230103002A (en) System for managing safety in industrial site
CN116038684A (en) Robot collision early warning method based on vision
KR101238788B1 (en) Elevator crime prvent system and method of controlling the same
KR102113489B1 (en) Action Detection System and Method Using Deep Learning with Camera Input Image
CN114187676A (en) Inspection method, device, equipment, system and storage medium
JP2015147481A (en) Movable body management device
KR20110105566A (en) Escalator monitoring system using image processing technology
CN105761423B (en) Detect the device and method of the behavior of the user of hand-held electronic equipment
JP2012056535A (en) Platform accident detection system
CN103974028A (en) Method for detecting fierce behavior of personnel
KR20160025224A (en) Device And System For Elevator Abnormal Operation Detection

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
TR01 Transfer of patent right

Effective date of registration: 20210309

Address after: 214500 Wuliqiao, east suburb, Jingjiang City, Taizhou City, Jiangsu Province

Patentee after: JIANGSU SANLI HYDRAULIC MACHINERY Co.,Ltd.

Address before: 214028 1st floor, building a, cancer, Wuxi (National) software park, No.18 Zhenze Road, Wuxi New District, Jiangsu Province

Patentee before: WUXI YINYU INTELLIGENT ROBOT Co.,Ltd.

TR01 Transfer of patent right
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20130703

CF01 Termination of patent right due to non-payment of annual fee