WO2011089885A1 - 危険提示装置、危険提示システム、危険提示方法およびプログラム - Google Patents
危険提示装置、危険提示システム、危険提示方法およびプログラム Download PDFInfo
- Publication number
- WO2011089885A1 WO2011089885A1 PCT/JP2011/000237 JP2011000237W WO2011089885A1 WO 2011089885 A1 WO2011089885 A1 WO 2011089885A1 JP 2011000237 W JP2011000237 W JP 2011000237W WO 2011089885 A1 WO2011089885 A1 WO 2011089885A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- person
- robot
- time
- orientation
- danger
- Prior art date
Links
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J19/00—Accessories fitted to manipulators, e.g. for monitoring, for viewing; Safety devices combined with or specially adapted for use in connection with manipulators
- B25J19/06—Safety devices
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J9/00—Programme-controlled manipulators
- B25J9/16—Programme controls
- B25J9/1674—Programme controls characterised by safety, monitoring, diagnostic
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F16—ENGINEERING ELEMENTS AND UNITS; GENERAL MEASURES FOR PRODUCING AND MAINTAINING EFFECTIVE FUNCTIONING OF MACHINES OR INSTALLATIONS; THERMAL INSULATION IN GENERAL
- F16P—SAFETY DEVICES IN GENERAL; SAFETY DEVICES FOR PRESSES
- F16P3/00—Safety devices acting in conjunction with the control or operation of a machine; Control arrangements requiring the simultaneous use of two or more parts of the body
- F16P3/12—Safety devices acting in conjunction with the control or operation of a machine; Control arrangements requiring the simultaneous use of two or more parts of the body with means, e.g. feelers, which in case of the presence of a body part of a person in or near the danger zone influence the control or operation of the machine
- F16P3/14—Safety devices acting in conjunction with the control or operation of a machine; Control arrangements requiring the simultaneous use of two or more parts of the body with means, e.g. feelers, which in case of the presence of a body part of a person in or near the danger zone influence the control or operation of the machine the means being photocells or other devices sensitive without mechanical contact
- F16P3/142—Safety devices acting in conjunction with the control or operation of a machine; Control arrangements requiring the simultaneous use of two or more parts of the body with means, e.g. feelers, which in case of the presence of a body part of a person in or near the danger zone influence the control or operation of the machine the means being photocells or other devices sensitive without mechanical contact using image capturing devices
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B2219/00—Program-control systems
- G05B2219/30—Nc systems
- G05B2219/40—Robotics, robotics mapping to robotics vision
- G05B2219/40196—Projecting light on floor to delimit danger zone around robot
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B2219/00—Program-control systems
- G05B2219/30—Nc systems
- G05B2219/40—Robotics, robotics mapping to robotics vision
- G05B2219/40203—Detect position of operator, create non material barrier to protect operator
Definitions
- the present invention relates to a danger presentation device that generates data for presenting the danger of a robot that operates according to an action plan.
- robots are used in production sites.
- people may come into contact with the robot and be injured. Therefore, safety measures are taken to surround the robot with a safety fence.
- safety fence between the robot and the person, there are some operations that are difficult to realize.
- Patent Document 1 discloses a mobile robot that visually displays a danger range generated around the mobile robot.
- the danger range generated around the mobile robot described in Patent Document 1 changes from time to time depending on in which direction the mobile robot is moving and at what speed. Then, the mobile robot determines the danger range based on a movement plan such as a movement speed when moving.
- FIG. 38 is a diagram showing a danger range when the mobile robot is stopped.
- a mobile robot 9001 shown in FIG. 38 includes a projector 9101 in front of the mobile robot 9001, a projector 9102 in the rear, a projector 9103 on the right side, and a projector 9104 on the left side.
- a danger range 9060 shown in FIG. 38 is a danger range when the mobile robot 9001 is stopped. The danger range 9060 is projected by the four projectors 9101, 9102, 9103 and 9104 and presented to the person.
- FIG. 39 is a diagram showing a danger range 9060 when the mobile robot 9001 shown in FIG. 38 is moving.
- a danger range 9060 shown in FIG. 39 is a danger range when the mobile robot 9001 moves to the left at the speed V1.
- the danger range 9060 is larger in the area on the left side of the mobile robot 9001 in the traveling direction than when the robot is stopped.
- FIG. 40 is a diagram showing a danger range 9060 when the mobile robot 9001 shown in FIG. 38 moves faster than the speed V1.
- the danger range 9060 becomes even larger than when moving at the speed V1.
- FIG. 41 is a diagram showing a danger range 9060 when the mobile robot 9001 shown in FIG. 38 is operating the left arm 9012.
- the danger range 9060 increases in the area near the left arm 9012.
- the robot Even if the robot presents a danger range around it, it may not be able to properly inform the person of the danger. For example, even if a robot presents a danger range in a place where a person cannot see, the robot cannot properly notify the person of the danger. Then, when the robot and the person collide, the smooth operation of the robot is hindered.
- FIG. 42 is a diagram showing a problem in the prior art.
- the person 9061 in the danger range 9060 cannot directly see the right arm part 9011 and the left arm part 9012 of the mobile robot 9001 from the position of the person 9061 shown in FIG. Therefore, even if the person 9061 knows that he / she is inside the danger range 9060, it cannot predict which of the right arm 9011 and the left arm 9012 will move. Accordingly, the person 9061 cannot predict from which direction the arm of the mobile robot 9001 moves, and cannot determine in which direction the danger can be avoided.
- an object of the present invention is to provide a danger presentation device that generates data for appropriately presenting a danger situation associated with the operation of a robot.
- the danger presentation device depends on the person position acquisition unit that acquires a person position that is a person position, and the person position acquired by the person position acquisition unit, A human visual range determination unit for determining a human visual range, a position of the robot at a specific time at which at least a part of a robot operating according to an operation plan is included in the visual range, and an attitude of the robot at the specific time A position and orientation determination unit that determines a position and orientation including at least one of them, and an image generation unit that generates image data for indicating the position and orientation determined by the position and orientation determination unit.
- the danger presentation device can generate data for presenting the robot mode at the time when the robot is included in the human field of view. Therefore, the danger presentation device can generate data for appropriately presenting the danger situation accompanying the operation of the robot.
- the danger presentation device further includes a danger area generation unit that generates an area in which the robot operates as a danger area according to the action plan, and the position and orientation determination part is configured based on the person position and the action plan. Determining the position and orientation at the specific time within a period including a time at which a collision between the person and the robot is expected, and the image generation unit includes the position and orientation determined by the position and orientation determination unit; The image data for indicating a dangerous area may be generated.
- the danger presentation device can generate data for indicating the position or posture of the robot near the time when the collision is expected. That is, the danger presentation device can generate data for appropriately presenting the dangerous situation around the robot.
- the position / orientation determination unit may determine the position / orientation at the specific time, which is a time before the time when the collision is expected.
- the danger presentation device can generate data for indicating the position or posture of the robot at the time before the time when the collision is expected.
- the position and orientation determination unit is a time when the distance between the human position and the position where the robot is operating is equal to or greater than a predetermined distance, and the time when the collision is expected Alternatively, the position and orientation at the specific time that is the previous time and the time closest to the time when the collision is expected may be determined.
- the danger presentation device can generate data for more appropriately presenting the position and orientation of the robot.
- the position and orientation determination unit predicts the position of the person after a predetermined time from the person position acquired by the person position acquisition unit as the person position, and from the predicted person position and the operation plan
- the collision between the person and the robot may be predicted, and the position and orientation at the specific time within a period including the time when the collision is expected may be determined.
- the position and orientation determination unit may determine the position and orientation at the specific time, which is a time when the collision is expected.
- the position and orientation determination unit is a time at which the motion area in which the robot moves within a predetermined time according to the motion plan and the visibility range overlap each other with a predetermined size or more, and Determining the position and orientation at the specific time which is a time after the time when the first collision between the person and the robot is expected and the time closest to the time when the first collision is expected Also good.
- the danger presentation device can generate more appropriate data.
- the position / orientation determination unit may cause the warning output device to output a warning when a collision between the person and the robot is expected and there is no time corresponding to the specific time.
- the position and orientation determination unit outputs a warning to a warning output device when the specific time is the same time as or after the time when the robot passes the human position acquired by the human position acquisition unit. You may let them.
- the danger presentation device can notify the person of the danger by a warning such as a warning sound or a warning display.
- the image generation unit may generate the image data when the specific time is a time before the time when the robot passes the human position acquired by the human position acquisition unit. .
- the danger presentation device when there is a possibility that the person may misunderstand the danger situation depending on the timing when the robot enters the field of view, the danger presentation device notifies the person of the danger by a warning such as a warning sound or a warning display. When the possibility that a person mistakes a dangerous situation is low, the danger presentation device generates data for indicating the position and posture.
- the danger presentation device further includes a person orientation acquisition unit that acquires a person orientation that is the orientation of the person, and a failure information acquisition unit that acquires failure information that is information on a failure that blocks the view range
- the human field of view range determination unit includes the person position acquired by the person position acquisition unit, the person direction acquired by the person direction acquisition unit, and the obstacle information acquired by the obstacle information acquisition unit.
- the field of view may be determined in dependence.
- the view range is determined in more detail based on the position of the person, the direction of the person, and the information that obstructs the view range. Therefore, more appropriate data is generated.
- the image generation unit may generate the image data for indicating an arrival time from the present to the specific time and the position and orientation.
- the danger presentation device can generate data indicating when the robot is approaching. That is, the danger presentation device can generate data indicating the degree of danger.
- the image generation unit determines the display format of the position and orientation depending on the arrival time from the present to the specific time, and generates the image data for indicating the position and orientation in the determined display format May be.
- the danger presentation device can generate data corresponding to the degree of danger.
- the image generation unit is configured so that when the arrival time is the first time, the brightness is higher than when the arrival time is a second time longer than the first time.
- a display format may be determined, and the image data for indicating the position and orientation in the determined display format may be generated.
- the danger presentation device generates data indicating the robot with high brightness when the degree of danger is high. Therefore, the danger presentation device can indicate the degree of danger.
- the danger presentation system may be a danger presentation system provided with the danger presentation device.
- the danger presentation device is realized as a danger presentation system including the danger presentation device.
- danger presentation system may further include the robot that operates according to the operation plan.
- the danger presentation system can generate data for appropriately presenting the danger situation accompanying the operation of the robot.
- the danger presentation system may further include a display device that presents the image data generated by the image generation unit as an image.
- the danger presentation system may further include a warning sound output device that outputs a warning sound.
- the danger presentation system can output a warning sound for notifying the person of the danger when the position or posture of the robot cannot be presented in the human field of view.
- the danger presentation method determines a person's view range depending on a person position acquisition step of acquiring a person position which is a person position and the person position acquired in the person position acquisition step.
- a position that includes at least one of the position of the robot at a specific time at which at least a part of the robot that operates according to the motion plan is included in the visual field range, and the posture of the robot at the specific time
- the danger presentation method may include a position / posture determination step for determining a posture and an image generation step for generating image data for indicating the position / posture determined in the position / posture determination step.
- the danger presentation device is realized as a danger presentation method.
- the program according to the present invention includes a person position acquisition step for acquiring a person position, which is a person position, and a person who determines the person's view range depending on the person position acquired in the person position acquisition step.
- a view range determination step, and a position and orientation including at least one of the position of the robot at a specific time when at least a part of the robot operating according to the motion plan is included in the view range, and the posture of the robot at the specific time A program for causing a computer to execute a position and orientation determination step to be determined and an image generation step to generate image data for indicating the position and orientation determined in the position and orientation determination step.
- the danger presentation method is realized as a program.
- FIG. 1 is a conceptual diagram of a danger presentation system in the first embodiment.
- FIG. 2 is an overall view of the danger presentation system in the first embodiment.
- FIG. 3 is an external view of the robot in the first embodiment.
- FIG. 4 is a diagram showing a rotation angle in the first embodiment.
- FIG. 5 is a diagram showing the relationship between the time and the rotation angle in the first embodiment.
- FIG. 6 is a flowchart illustrating processing in which the position and orientation determination unit according to Embodiment 1 determines the collision presentation position.
- FIG. 7 is a diagram showing the characteristic posture in the first embodiment.
- FIG. 8 is a diagram showing an image displayed by the danger presentation system in the first embodiment.
- FIG. 9 is an overall view of the danger presentation system in the second embodiment.
- FIG. 1 is a conceptual diagram of a danger presentation system in the first embodiment.
- FIG. 2 is an overall view of the danger presentation system in the first embodiment.
- FIG. 3 is an external view of the robot in the first embodiment.
- FIG. 10 is a flowchart illustrating processing in which the position / orientation determination unit according to the second embodiment determines the collision presentation position.
- FIG. 11 is a diagram illustrating the relationship between the moving region of the movable part and the predicted person position in the second embodiment.
- FIG. 12 is an overall view of the danger presentation system in the third embodiment.
- FIG. 13 is a diagram showing a human field of view in the third embodiment.
- FIG. 14 is a diagram showing a field of view range of a person facing in the opposite direction with respect to the robot in the third embodiment.
- FIG. 15 is a diagram showing a field of view range of a person facing in the same direction with respect to the moving direction of the movable part in the third embodiment.
- FIG. 11 is a diagram illustrating the relationship between the moving region of the movable part and the predicted person position in the second embodiment.
- FIG. 12 is an overall view of the danger presentation system in the third embodiment.
- FIG. 13 is a diagram showing a human field of view in the third
- FIG. 16 is a flowchart illustrating processing in which the position and orientation determination unit according to Embodiment 3 determines the collision presentation position.
- FIG. 17 is a diagram showing the relationship among the moving area of the movable part, the predicted person position, and the field-of-view range in the third embodiment.
- FIG. 18 is a diagram illustrating a feature posture and a feature position presented in the human field of view in the third embodiment.
- FIG. 19 is a conceptual diagram of the danger presentation system in the fourth embodiment.
- FIG. 20 is an overall view of the danger presentation system in the fourth embodiment.
- FIG. 21 is a diagram showing a human visual field range in the fourth embodiment.
- FIG. 22 is a diagram illustrating a state where there is no wall at time zero.
- FIG. 23 is a diagram illustrating a state without a wall at time 4.
- FIG. 24 is a diagram illustrating a state without a wall at time 6.
- FIG. 25 is a diagram showing a state without a wall at time 8.
- FIG. 26 is a diagram illustrating a state where there is a wall at time 0.
- FIG. 27 is a diagram illustrating a state where there is a wall at time 4.
- FIG. 28 is a diagram illustrating a state where there is a wall at time 6.
- FIG. 29 is a diagram illustrating a state where there is a wall at time 8.
- FIG. 30 is a flowchart showing processing of the danger presentation system in the fourth embodiment.
- FIG. 31 is a flowchart showing a modification of the process of the danger presentation system in the fourth embodiment.
- FIG. 32 is a flowchart showing display format determination processing in the fourth embodiment.
- FIG. 33 is a diagram showing an improved state at time zero.
- FIG. 34 is a diagram showing an improved state at time 4.
- FIG. 35 is a diagram showing an improved state at time 6.
- FIG. 36 is a diagram showing an improved state at time 8.
- FIG. 37 is a conceptual diagram showing an operation in the reverse direction according to the fourth embodiment.
- FIG. 38 is a diagram illustrating a danger range presented when the mobile robot in the related art is stopped.
- FIG. 39 is a diagram illustrating a danger range presented when a mobile robot in the related art is moving.
- FIG. 40 is a diagram illustrating a danger range presented when a mobile robot according to the related art moves fast.
- FIG. 41 is a diagram illustrating a danger range that is presented when a mobile robot in the related art moves an arm.
- FIG. 42 is a diagram illustrating a problem in the related art.
- the danger presentation system according to Embodiment 1 presents a danger area or the like so that a person in the danger area can know from which direction the robot approaches.
- the danger presentation system in the first embodiment is a danger presentation system for a rotary robot with one degree of freedom.
- a one-degree-of-freedom rotary robot is an example of a robot that is a subject of the present invention.
- the robot targeted by the present invention may be a robot with multiple degrees of freedom, a linear motion type, a mobile type, or a combination thereof.
- FIG. 1 is a conceptual diagram of the danger presentation system in the first embodiment.
- the danger presentation system 1000 shown in FIG. 1 includes a danger presentation device 1100, a robot 1200, and a display device 1300.
- the danger presentation system 1000 projects the danger area 31 around the robot 1200.
- the danger presentation system 1000 projects the posture of the robot 1200 at a specific time.
- the danger presentation system 1000 may project a point or the like for indicating the position of the robot 1200 at a specific time.
- the danger presentation system 1000 presents to the person 51 from which the robot 1200 is approaching. Below, the danger presentation system 1000 which implement
- FIG. 2 is an overall view of the danger presentation system 1000 shown in FIG.
- the danger presentation device 1100 includes a dangerous area generation unit 1101, a human position acquisition unit 1102, a position / posture determination unit 1103, and an image generation unit 1104.
- the robot 1200 includes an operation planning unit 1201, an operation control unit 1202, and a movable unit 1203.
- each component will be described.
- the movable part 1203 is a part that can be physically moved in the robot 1200. Then, the movable part 1203 moves to a space that may come into contact with a person. For example, when the robot 1200 has an arm for moving an object, the arm is the movable unit 1203. When the main body of the robot 1200 moves, the main body of the robot 1200 is the movable unit 1203.
- FIG. 3 is an external view of the robot 1200 shown in FIG.
- the robot 1200 includes a movable part 1203 and a base part 2001 that does not physically move.
- the movable unit 1203 moves when the object 2002 is transported.
- the motion planning unit 1201 and the motion control unit 1202 not shown in FIG. 3 are physically included in the movable unit 1203 or the base unit 2001.
- the motion planning unit 1201 and the motion control unit 1202 may be included in either the movable unit 1203 or the base unit 2001.
- the operation plan unit 1201 outputs an operation plan indicating how the movable unit 1203 moves.
- the motion plan is a set of angles indicating how many times the movable unit 1203 is rotated or a set of ordered rotation angles.
- the operation plan is set to a set of rotation angles ⁇ R_0, R_1, R_2,... At time 0, time 1, time 2,. R_n ⁇ .
- FIG. 4 is a diagram showing the rotation angle.
- the XY plane shown in FIG. 4 is a horizontal plane including the robot 1200 placed on the horizontal plane.
- Point A (AX, AY) indicates the center position of rotation of the movable portion 1203.
- Point B (X_0, Y_0) indicates the position of the end of the movable portion 1203 in the initial state.
- the position of the end of the movable part 1203 is the position of the end on the side that is not the center position of the rotation of the movable part 1203.
- Point C (X_n, Y_n) indicates a position when the end of the movable portion 1203 is rotated 270 degrees.
- the rotation angle starts from the point A (AX, AY), the first directed line segment AB starting from the point B (X_0, Y_0), and the point A (AX, AY), It is an angle formed by the second directed line segment AC whose end point is the point C (X_n, Y_n). Further, the first directed line segment AB passes through the danger area 31 when the first directed line segment AB moves to the position of the second directed line segment AC based on the operation plan of the robot 1200. It is an area. When the person 51 exists in the dangerous area 31, there is a risk that the person 51 and the robot 1200 collide.
- a rotation angle having a positive value indicates an operation plan for rotating the movable unit 1203 counterclockwise.
- a rotation angle having a negative value indicates an operation plan for rotating the movable unit 1203 clockwise.
- FIG. 5 is a diagram showing an example of the relationship between time and rotation angle.
- the rotation angle at time 1 is the rotation angle R_1 illustrated in FIG. 5 and is 10 degrees from the initial position of the robot 1200.
- the rotation angle at time 2 is the rotation angle R_2 illustrated in FIG. 5 and is 20 degrees from the initial position of the robot 1200.
- the rotation angle at time 27 is the rotation angle R_27 shown in FIG. 5 and is 270 degrees from the initial position of the robot 1200.
- the rotation angles included in the ordered set of rotation angles are, in order from the first, the 0th rotation angle, the 1st rotation angle, the 2nd rotation angle,. Called the rotation angle.
- the number starts from 0 instead of starting from 1. Since the time starts from 0, the rotation angle also starts from 0. Thereby, the rotation angle when the time is 0 is R_0, and the subscript numbers are aligned.
- time 1,..., Time 27 are 1 second and the movable unit 1203 rotates 270 degrees counterclockwise at a speed of 10 degrees per second
- the set ⁇ 0, 10, 20,..., 270 ⁇ is an operation plan.
- the set of rotation angles is stored in advance in the motion planning unit 1201.
- the motion planning unit 1201 outputs a rotation angle at a specified time based on a request from the outside. That is, when time 0, time 1, time 2,..., Time 27 is designated, the motion planning unit 1201 outputs 0, 10, 20,. Alternatively, when 0th, 1st, 2nd,..., 27th is designated, the motion planning unit 1201 outputs 0, 10, 20,.
- the motion plan is indicated by an angle for each predetermined time interval, but a set of combinations of time and rotation angle ⁇ (t0, ⁇ 0), (t1, ⁇ 1), (t2, ⁇ 2), ..., (tn, ⁇ n) ⁇ .
- the motion planning unit 1201 may plan the movement of the robot 1200 based on environmental map information held in advance or external world information acquired by a visual sensor. Further, the motion planning unit 1201 may plan the target moving speed, the target acceleration, the target angle trajectory of the joint of the movable unit 1203, and the like instead of directly planning the position of the moving unit 1203.
- the operation control unit 1202 moves the movable unit 1203 based on the operation plan determined by the operation planning unit 1201.
- the dangerous area generation unit 1101 forms the dangerous area 31 based on the operation plan determined by the operation planning unit 1201. Specifically, the dangerous region generation unit 1101 generates the dangerous region 31 by calculating a region through which the movable unit 1203 passes when the movable unit 1203 is moved according to the operation plan of the operation planning unit 1201.
- the dangerous area generation unit 1101 holds a point A (AX, AY) that is the position of the axis of the movable unit 1203 and a point B (X_0, Y_0) that is the position of the movable unit 1203 at time 0 in advance.
- the dangerous area generation unit 1101 acquires the last rotation angle “270” held by the motion planning unit 1201.
- the dangerous area generation unit 1101 sets a set of points satisfying the following two conditions among the points (X, Y) on the XY plane as the dangerous area 31.
- the first condition is that the distance between the point (X, Y) and the point A (AX, AY) is shorter than the distance between the point B (X_0, Y_0) and the point A (AX, AY).
- the second condition is that the first vector starting from the point A (AX, AY) and ending at the point B (X_0, Y_0) and the point (X, Y) starting from the point A (AX, AY) are used.
- the angle formed by the second vector as the end point is not less than 0 and not more than the last rotation angle “270” of the motion plan.
- the dangerous area 31 determined in this way is displayed by the display device 1300 shown in FIG.
- the display device 1300 is a projector installed on the ceiling of the room where the robot 1200 is installed, and projects the dangerous region 31 and a characteristic posture described later toward the side where the person 51 is present, that is, the ground side.
- the person position acquisition unit 1102 acquires the position of the person 51.
- an imaging unit (not shown) installed on the ceiling captures the person 51, and the person position acquisition unit 1102 acquires the position of the person 51 using an image processing technique.
- the person position acquisition unit 1102 may acquire the position of the person 51 by using a position sensor (not shown) possessed by the person 51 in advance.
- the position / orientation determination unit 1103 is configured to display at least one of the position of the robot 1200 (hereinafter also referred to as a feature position) to be presented to the person 51 and one of the postures of the robot 1200 (hereinafter also referred to as a feature position). (Also called posture). At this time, the position / orientation determination unit 1103 determines the position / orientation so that the person 51 can properly perceive the dangerous situation around the robot 1200. The characteristic position or characteristic attitude determined by the position / orientation determination unit 1103 is presented to the person 51 in a dangerous situation by the display device 1300 described later.
- the characteristic posture is the posture of the movable portion 1203 at a predetermined time before the time when the person 51 and the movable portion 1203 are expected to collide.
- the characteristic position is a point closest to the person among the points included in the movable unit 1203.
- the target time of the characteristic posture is not the time of the collision, but the time before the collision.
- the danger presentation system 1000 accurately informs the person 51 which of the movable parts 1203 is approaching by presenting a position at a time before the collision.
- the characteristic position may be a position indicating the center of the robot 1200 or the movable unit 1203 at the target time. For example, when the entire robot 1200 moves, the danger presentation system 1000 indicates the center position as the feature position, so that the person 51 can perceive from which the robot 1200 is approaching.
- FIG. 6 is a flowchart showing the flow of processing of the position / orientation determination unit 1103 shown in FIG.
- k is a variable and is held by a storage area such as a CPU register, ROM, RAM, or HDD.
- FIG. 7 is a diagram showing the characteristic posture 61 determined by the position / posture determination unit 1103.
- points (X_0, Y_0), points (X_1, Y_1),..., And points (X_27, Y_27) are movable parts at time 0, time 1, time 2,.
- the position of the end of 1203 is shown.
- a point (PX, PY) indicates a person position that is the position of the person 51 acquired by the person position acquisition unit 1102.
- the position / posture determination unit 1103 acquires the position of the person 51 by the person position acquisition unit 1102 (S101). In the case of the example illustrated in FIG. 7, the position / orientation determination unit 1103 acquires a person position (PX, PY).
- the position / orientation determination unit 1103 acquires an operation plan at time (k ⁇ 1) from the operation plan unit 1201 (S103).
- the position and orientation determination unit 1103 acquires the 0th rotation angle “0”.
- the position / orientation determination unit 1103 acquires an operation plan at time k from the operation plan unit 1201 (S104).
- the position / orientation determination unit 1103 continues to acquire the motion plan as long as the motion planning unit 1201 has the motion plan. However, in order to reduce the processing amount, when the value of k becomes a certain value or more, it is desirable that the position / orientation determination unit 1103 end the processing even if the motion planning unit 1201 has a motion plan.
- the position / orientation determination unit 1103 passes the region (movement region or motion) through which the movable unit 1203 passes when moving from time (k-1) to time k. (Also referred to as a region) is generated (S105).
- the position / orientation determination unit 1103 generates a sector including the following three points.
- the first point that is the center of the sector is the center point A (AX, AY) of the rotation of the movable portion 1203.
- the second point is a point (X_k-1, Y_k-1) that is the position of the end of the movable part 1203 at time (k-1). That is, the second point is the position of the end of the movable unit 1203 at the (k ⁇ 1) th rotation angle of the motion planning unit 1201.
- the third point is a point (X_k, Y_k) that is the position of the end of the movable unit 1203 at time k. That is, the third point is the position of the end of the movable unit 1203 at the k-th rotation angle of the motion planning unit 1201.
- the position / posture determination unit 1103 determines whether or not the position of the person 51 acquired from the person position acquisition unit 1102 is included in the movement region of the movable unit 1203 (S106).
- the position / orientation determination unit 1103 stores a value obtained by adding 1 to k in k (S108). Then, the position / orientation determination unit 1103 acquires the motion plan at time k from the motion planning unit 1201 (S104), and repeats the subsequent processing.
- the target time for determining the feature posture is not the time of the collision, but the time before the collision.
- the danger presentation system 1000 can present the position at the time prior to the collision, and can inform the person 51 from which the movable unit 1203 is approaching.
- k-1 is an example, and the determined time may be an earlier time.
- the target time is measured by the position and orientation determination unit 1103 measuring the distance between the feature posture line segment and the position of the person 51 at the times k-1, k-2,. It may be a time at which the determined distance first exceeds a predetermined distance. The person 51 can more easily perceive the dangerous situation by the characteristic posture away from the person 51 by a predetermined distance or more.
- the position / orientation determination unit 1103 determines a feature position (S109). That is, the point closest to the human position (PX, PY) among the points on the line segment connecting the point A (AX, AY) and the point (X_17, Y_17) is determined as the feature position.
- the image generation unit 1104 generates an image indicating the dangerous region 31 generated by the dangerous region generation unit 1101 and the feature determined by the position and orientation determination unit 1103. That is, an image is generated in which the characteristic posture and the characteristic position determined by the position and orientation determination unit 1103 are superimposed on the dangerous region 31 generated by the dangerous region generation unit 1101.
- the display device 1300 is a device that displays an image generated by the image generation unit 1104.
- FIG. 8 is a diagram illustrating a state in which the display device 1300 displays an image generated by the image generation unit 1104.
- the display device 1300 installed at the upper part of the room where the robot 1200 is placed presents the dangerous area 31 around the robot 1200. Further, the display device 1300 presents images of the characteristic posture 71 and the characteristic position 72.
- the danger presentation system 1000 presents the dangerous area 31 around the robot 1200. Further, the danger presentation system 1000 presents an image of the characteristic posture 71.
- the person 51 can know the dangerous area 31 in which the movable part 1203 of the robot 1200 operates by the former. However, it is impossible to know where the robot is approaching from this alone. Therefore, when the person 51 moves to escape from the dangerous area 31, the person 51 may be closer to the movable part 1203.
- the person 51 can know from which the movable part 1203 approaches from the latter. However, it cannot be known to which side the movable part 1203 moves after approaching. Therefore, the person 51 may escape indefinitely within the movable area of the movable part 1203.
- the person 51 can determine in which direction it is safe to move.
- the danger presentation system in the first embodiment presents a danger area or the like to a person inside the danger area.
- the danger presentation system according to the second embodiment further presents a dangerous area or the like to a person who may move to the dangerous area later even if the person is not inside the dangerous area.
- FIG. 9 is an overall view of the danger presentation system in the second embodiment.
- the danger presentation system 1010 according to the second embodiment includes a danger presentation device 1110, a robot 1200, and a display device 1300.
- the danger presentation device 1110 includes a position and orientation determination unit 1113 that operates differently from the position and orientation determination unit 1103 in the first embodiment.
- Other components are the same as those in the first embodiment, and the description thereof is omitted.
- FIG. 10 is a flowchart showing processing in which the position / orientation determination unit 1113 shown in FIG. 9 determines the collision presentation position.
- FIG. 11 is a diagram illustrating the relationship between the moving region of the movable unit 1203 and the predicted person position.
- the flow of processing performed by the position / orientation determination unit 1113 will be described with reference to FIGS. 10 and 11.
- the position / orientation determination unit 1113 acquires a person's position (S101). Next, the position / orientation determination unit 1113 sets the variable k to 1 (S102). Next, the position / orientation determination unit 1113 acquires the k ⁇ 1th motion plan (S103). Next, the position / orientation determination unit 1113 acquires the k-th motion plan and determines whether or not it has been acquired (S104).
- the position / orientation determination unit 1113 ends the process when the motion plan cannot be acquired, and generates the movement region of the movable unit 1203 when the motion plan can be acquired (S105). Up to this point, the position / orientation determination unit 1113 performs the same processing as in the first embodiment shown in FIG.
- the position / orientation determination unit 1113 generates a moving region of the movable unit 1203 (S105), and then predicts a position where a person is present at the kth time (S201). For example, the position / orientation determination unit 1113 holds an average moving speed V of a person in advance, and predicts that the distance from the initial position is in a range of k ⁇ V or less at time k.
- P_1, P_2,..., P_k indicate the predicted positions of people from time 0 to time 1, time 2,.
- Each circle indicating the predicted position is a circle having a radius of 1 ⁇ V, 2 ⁇ V,..., K ⁇ V, centered on the person position (PX, PY).
- the position / orientation determination unit 1113 calculates whether a part of the predicted position of the person is included in the movement region of the movable unit 1203. Specifically, the position / orientation determination unit 1113 determines whether there is a point included in the sector indicating the moving region of the movable unit 1203 and included in a circle indicating the predicted position of the person (S202). ).
- the position / orientation determination unit 1113 stores a value obtained by adding 1 to k, as in the first embodiment shown in FIG. (S108).
- the position / orientation determination unit 1103 determines the feature / orientation using a time before the time at which the collision is expected when determining the characteristic / orientation, but the position / orientation determination unit 1113 according to the second embodiment
- the feature posture may be determined using the time when the collision is expected. Even when the time at which a collision is expected is used, by predicting the position where the person moves, it is possible to present which position the person should contact with the movable unit 1203.
- the position / orientation determination unit 1113 may determine the feature / orientation based on the time before the time when the collision is expected, as in the first embodiment. Thereby, the danger presentation system 1010 can present from which the movable unit 1203 moves more reliably.
- the position / orientation determination unit 1113 determines a position where a collision is expected at the time k as a feature position (S204). For example, the position / orientation determination unit 1113 determines an intersection of a line segment indicating the characteristic posture and a circle indicating the predicted position of the person as the characteristic position. In the example shown in FIG. 11, there are two feature positions 73. The position / posture determination unit 1113 may determine both of the two feature positions 73 as the feature positions, or may set one of them as the feature position.
- the position and orientation determination unit 1113 may determine the center of the two feature positions 73 as the feature position.
- the center of the two feature positions 73 is the position closest to the person's position (PX, PY) and has a high possibility of collision.
- the characteristic posture and characteristic position determined in this way are presented by the danger presentation system 1010.
- the danger presentation system 1010 presents the dangerous area 31 around the robot 1200. Further, the danger presentation system 1010 presents an image of the movable part in the characteristic posture 71. By knowing the danger area and the characteristic posture displayed by the danger presentation system 1010, the person 51 can determine in which direction it is safe to move.
- the danger presentation system 1010 can present to the person 51 whether the person 51 is in danger of colliding with the robot 1200 by predicting the movement of the person 51.
- the danger-presenting system displays a place that may collide first in time as a feature position, or Then, present the posture of the robot as a characteristic posture. However, depending on the direction in which the person is facing, the person may not be able to see the presented feature position or feature posture.
- the danger presentation system in the third embodiment presents a feature position or a feature posture in a region that can be seen by a person in consideration of the direction in which the person is facing.
- FIG. 12 is an overall view of the danger presentation system 1020 in the third embodiment.
- the danger presentation system 1020 in the third embodiment includes a danger presentation device 1120, a robot 1200, a display device 1300, and a warning sound output device 1400.
- the danger presentation device 1120 includes a position and orientation determination unit 1123 that operates differently from the position and orientation determination unit 1103 in the first embodiment.
- the danger presentation device 1120 further includes a human view range determination unit 1125.
- Other components are the same as those in the first embodiment, and a description thereof will be omitted.
- the human visual field range determination unit 1125 determines a visual field range (also referred to as a visual field, a visual field region, or a human visual field range) that the person is viewing based on the posture in which the person is facing at that time. For example, it is assumed that a person wears a helmet equipped with position sensors in front and rear in advance, and the human field range determination unit 1125 assumes that the person is looking at the direction of a straight line connecting the positions acquired from the two sensors. Determine the human field of view.
- a visual field range also referred to as a visual field, a visual field region, or a human visual field range
- FIG. 13 is a diagram showing a field-of-view area determined from values acquired from a position sensor.
- the person front position (FX, FY) indicates the position of the position sensor installed in front of the helmet
- the person rear position (BX, BY) indicates the position of the position sensor installed in the rear of the helmet.
- the human field of view range determination unit 1125 is a part of a circle centered on the human front position (FX, FY) and having a radius D, the human rear position (BX, BY) and the human front position (FX, FY).
- the range of the fan shape (the field of view 74 shown in FIG. 13) formed by rotating clockwise and counterclockwise by the rotation angle ⁇ is determined as the field of view range.
- the human field of view range determination unit 1125 may determine the radius D based on the concept of personal space.
- a personal space is an area around the body of a person or animal that would normally cause a negative reaction if a person or similar creature invades (Psychological Dictionary, Tadashi Fujinaga, Naka Mariko, Maruzen, 2004).
- the danger presentation system 1020 can make the person feel free to escape from the area by presenting the characteristic posture and characteristic position of the robot within the range of the personal space.
- the human visual field range determination unit 1125 may narrow the personal space and narrow the visual field 74 based on the number of times the robot is used, the number of times of contact, and the observation time.
- the danger presentation system 1020 includes means for acquiring the number of times of use of the robot, the number of times of contact, and the observation time, and the human field range determination unit 1125 sets the radius D as the number of times of use of the robot, the number of times of contact, and the observation time increase. It may be small. For example, the radius D is set to 45 cm for a person who is intimate with the robot, and the radius D is set to 120 cm or 350 cm for a person who is not intimate.
- the danger presentation system 1020 includes means for acquiring the race and the personality of the target person, and the human field range determination unit 1125 determines the personal space based on the race and the personality of the target person. May be.
- the human visual field range determination unit 1125 may determine the visual field region by estimating the camera position based on an image obtained from a camera installed in front of the helmet.
- the camera may be installed not on a helmet but on glasses, a bag carried by a person, and a wheelchair when a person is on a wheelchair.
- the human visual field range determination unit 1125 may estimate the human eye direction based on the position of the human eye by photographing the human face with a camera installed indoors.
- the danger presentation system 1020 presents the feature position or feature posture to the field of view 74, but cannot present the feature position or feature posture to the field of view 74, or presents the feature position or feature posture to the field of view 74. Sometimes it is better not to. This will be specifically described below.
- FIG. 14 is a diagram showing a field of view range of a person facing in the opposite direction with respect to the robot in the third embodiment.
- Person 51 is outside the dangerous area 31.
- the field of view 74 of the person 51 does not overlap with the dangerous area 31. Further, a collision is expected at time k due to the movement of the person 51.
- the danger presentation system 1020 causes the warning sound output device 1400 to output a warning sound to notify the person 51 of the danger.
- a message such as “the robot approaches from the rear side” is within the range of the field of view of the person 51. May be configured to present.
- the structure which notifies the robot approach from the back side to the person 51 by blinking the output of the display apparatus 1300 may be sufficient.
- FIG. 15 is a diagram showing the field of view of the person 51 facing the same direction with respect to the moving direction of the movable part 1203 in the third embodiment.
- the person 51 is inside the dangerous area 31. Then, at time k ⁇ 1, a collision between the person 51 and the movable unit 1203 is expected due to the movement of the person 51. However, the movable part 1203 does not appear in the field of view 74 at time k ⁇ 1. Since the danger presentation system 1020 according to the third embodiment presents the feature position or the feature posture in the region that the person 51 can see, the posture of the robot 1200 at time k ⁇ 1 is not determined as the feature posture.
- the danger presentation system 1020 does not present the feature position and feature posture at the same time as or later than the time when the robot 1200 passes the position of the person 51 to the person 51.
- the danger presentation system 1020 causes the warning sound output device 1400 to output a warning sound to notify the person 51 of the danger.
- the danger presentation system 1020 causes the display device 1300 to output a warning.
- the display device 1300 and the warning sound output device 1400 may function as a warning device that outputs a warning.
- the display device 1300 and the warning sound output device 1400 are examples of warning devices, and the danger presentation system 1020 may include another warning device.
- the danger presentation device 1120 may include a warning device that outputs a warning.
- FIG. 16 is a flowchart showing a process in which the position / orientation determination unit 1123 shown in FIG. 12 determines the collision presentation position.
- FIG. 17 is a diagram illustrating a relationship among the moving area of the movable unit 1203, the predicted human position, and the field of view range in the third embodiment.
- the flow of processing performed by the position / orientation determination unit 1123 will be described with reference to FIGS. 16 and 17.
- the process (S104), the process of generating the moving area of the movable unit 1203 (S105), and the process of adding 1 to k (S108) are the same processes as those of the first embodiment shown in FIG. Description is omitted because there are.
- the process of predicting the human position at the k-th time shown in FIG. 16 (S201), the process of determining whether or not the predicted human position is included in the movement area (S202), and the feature position are determined.
- the process (S203) is the same as the process of the second embodiment shown in FIG.
- the position / orientation determination unit 1123 acquires the human position (S101), and then determines the visual field range using the human visual field range determination unit 1125 (S301).
- the position / orientation determination unit 1123 determines whether a part of the visual field area is included in a part of the movement area (S302). Specifically, the position / orientation determination unit 1123 determines whether or not a predetermined number of points satisfying the following two conditions among the points (X, Y) on the XY plane are included.
- the first condition is that the point (X, Y) is the point of the moving area acquired by the process (S105) for generating the moving area of the movable unit 1203.
- the second condition is that the point (X, Y) is a point of the visual field area acquired by the process (S301) of acquiring the visual field area.
- the position / orientation determination unit 1123 stores a value obtained by adding 1 to k in k (S108).
- the position / orientation determining unit 1123 determines whether or not the initial position of the person is included in the moving area (S305).
- the position / orientation determination unit 1123 causes the warning sound output device 1400 to output a warning sound (S304).
- the position / orientation determination unit 1123 may cause the display device 1300 to output a warning via the image generation unit 1104.
- the position / orientation determination unit 1123 may cause the display device 1300 to output a warning directly without using the image generation unit 1104.
- the position / posture determination unit 1123 determines the characteristic posture (S203) as in the second embodiment.
- the position / orientation determination unit 1123 determines the feature position (S306).
- the position and orientation determination unit 1123 may determine the feature position as in the second embodiment. Or you may determine the part close
- the position / orientation determination unit 1123 determines whether or not there is a state in which the predicted position of the person is included in the movement area when the k-th motion plan cannot be acquired by the process of acquiring the k-th motion plan (S104). Determination is made (S303). In other words, the position / orientation determination unit 1123 determines whether or not it has been determined that the predicted human position is included in the moving area in the determination of whether or not the predicted human position is included in the moving area (S202).
- the position / orientation determination unit 1123 prepares a variable with an initial value of 0, and if the movement area includes a predicted human position (YES in S202), substitutes 1 for the variable. When the value of the variable is 1, the position / orientation determination unit 1123 determines that the predicted human position is included in the movement area (YES in S303), and the value of the variable is 0. Then, it is determined that there is no case where the predicted position is included in the movement area (NO in S303).
- the position / orientation determination unit 1123 ends the process.
- the position / orientation determination unit 1123 causes the warning sound output device 1400 to output a warning sound (S304).
- the position / orientation determination unit 1123 causes the display device 1300 to output a warning.
- the position / orientation determination unit 1123 determines in the view area when the number of points satisfying the two conditions is equal to or greater than a predetermined number in the process of determining whether or not the moving position is included in the view area (S302). It is determined that the moving position is included. However, the position / orientation determining unit 1123 may determine that the movement position is included in the view field area when the ratio of the points satisfying the above two conditions to the points satisfying only the second condition is equal to or greater than a predetermined ratio. Good.
- the danger presentation system 1020 has the feature position or feature orientation. Can be presented.
- the predetermined number used for the determination may be determined based on the size (area) of the person.
- the predetermined number may be determined based on whether the size (area) of the robot presented in the field of view is larger than the size of the person.
- the size of a person may be determined by extracting a person from an image acquired by a camera or the like. The size of the person may be given in advance. People also tend to have a greater fear of larger creatures, such as twice or three times as many people. Therefore, the predetermined number may be determined not by directly comparing with the size of the person but by comparing with a constant multiple of the size of the person.
- the predetermined number of values may be 1.
- FIG. 18 is a diagram showing a characteristic posture and a characteristic position presented in the human field of view in the third embodiment.
- Robot 1200 is in view 74. For this reason, the person 51 can perceive the presence of the robot 1200. However, the person 51 cannot perceive from which direction to approach. In the case of the example shown in FIG. 18, the robot 1200 rotates counterclockwise based on the operation plan and approaches the person 51 from the left of the person 51.
- the danger presentation system 1020 presents images of the characteristic posture 81 and the characteristic position 82 that do not sufficiently enter the field of view 74, the person 51 cannot accurately perceive the danger. Therefore, the danger presentation system 1020 presents an image of the feature posture 71 and the feature position 72 that are sufficiently within the field of view 74.
- the dangerous region generation unit 1101 determines the range of the dangerous region 31 using all the plans held by the motion planning unit 1201, the robot 1200 reaches the characteristic posture 71 (or the characteristic position 72). It is desirable that the dangerous area 31 is generated based on the operation plan in the range up to.
- the dangerous area 31 is an area that moves when the robot 1200 rotates once. Therefore, even when the characteristic posture 71 is presented, it is difficult to understand whether the robot 1200 is approaching clockwise or counterclockwise. However, when the area in which the robot 1200 moves before reaching the characteristic posture 71 is the danger area 31, it becomes clearer from which the robot 1200 approaches.
- the danger presentation system 1020 may be configured to dynamically display as an animation by switching a plurality of feature postures instead of continuing to present the feature posture 71.
- the danger presentation system 1020 uses the feature posture 81, which is the first posture in which the feature posture becomes visible in the field of view, as the first display of the animation, and the feature posture 71 in which the feature posture becomes sufficiently visible in the field of view. May be the last display of the animation.
- the danger presentation system 1020 may present an animation including the posture between the first display and the last display described above. Such a configuration makes it easier to understand that the robot 1200 is approaching counterclockwise.
- the danger presentation system 1020 may continue to present the characteristic posture 71 after the animation ends, or may return to the beginning of the animation and display it repeatedly.
- the danger presentation system 1020 presents the danger area 31 around the robot 1200. Further, the danger presentation system 1020 presents an image of the movable part in the characteristic posture 71. By knowing the danger area and the characteristic posture displayed by the danger presentation system 1020, the person 51 can determine in which direction to move safely.
- the danger presentation system 1020 estimates the position of the movable unit 1203 in order of time based on the operation plan. Then, the danger presentation system 1020 presents to the person 51 the position or posture of the movable unit 1203 at the time when the movable unit 1203 is included in the separately estimated view area of the person 51 as the feature position or feature posture. Thus, the presented feature position or feature posture is presented at a position where the person 51 can be seen. Therefore, it can be avoided that the person 51 overlooks them.
- the danger presentation system 1020 estimates the position of the movable unit 1203 in order of time until the feature position or the feature orientation satisfies a predetermined condition. Then, the danger presentation system 1020 determines a presentation position that satisfies the condition. Thereby, the danger presentation system 1020 can avoid or reduce the feature position or the feature posture being presented in the corner of the field of view. Therefore, oversight of the presented feature position or feature posture is suppressed.
- the danger presentation system 1020 emits a warning sound when a feature position or a feature posture cannot be found in the view field area despite the danger that the person 51 and the movable part 1203 collide. Thereby, the danger presentation system 1020 can warn the person 51 of the collision with the movable part 1203 outside the field of view.
- the danger presentation system targets a mobile robot.
- presenting the future posture of a mobile robot as a danger depending on the position of the robot, the image of the robot to be displayed is hidden behind the wall. In such a case, the person cannot perceive the danger.
- a danger presentation system capable of presenting danger even in such a case will be described.
- FIG. 19 is a diagram for explaining a work space 2701 according to the fourth embodiment.
- the danger presentation system 1030 is a device that makes a presentation for notifying the person 51 of the danger.
- the danger presentation system 1030 includes a robot 1200, a danger presentation device 1130, and a display device 1300.
- the display device 1300 is a display unit such as a projector that performs a display for notifying the person 51 of danger.
- the danger presentation device 1130 generates data for displaying the danger as an image or the like.
- the work space 2701 includes a person 51, a robot 1200, and a wall 2802.
- the positional relationship among the person 51, the robot 1200, and the wall 2802 is an example. Depending on these positional relationships, the person 51 cannot directly see the robot 1200.
- the danger presentation system 1030 in the fourth embodiment presents a danger by visually showing the person 51 from which the robot 1200 appears.
- FIG. 20 shows a danger presentation system 1030 according to the fourth embodiment.
- the danger presentation system 1030 includes a robot 1200, a danger presentation device 1130, and a display device 1300.
- a robot 1200 according to the fourth embodiment is a mobile robot and includes an operation planning unit 1201, an operation control unit 1202, and a movable unit 1203.
- the movable part 1203 is a part that physically moves in the robot 1200. Typically, the movable part 1203 is a wheel or a leg part.
- the operation control unit 1202 controls the movable unit 1203. Then, the motion control unit 1202 moves the robot 1200 based on the motion plan held by the motion planning unit 1201. Specifically, the operation control unit 1202 controls the movable unit 1203 so that the position of the robot 1200 at time T becomes the position P_T.
- the danger presentation device 1130 includes a human position acquisition unit 1102, a human orientation acquisition unit 1141, a human field of view range determination unit 1125, a position / posture determination unit 1133, an image generation unit 1104, and a failure information acquisition unit 1142.
- the person position acquisition unit 1102 is a means for acquiring the position of the person 51.
- the person 51 is equipped with a position sensor in advance, and the person position acquisition unit 1102 acquires the position from the equipped position sensor.
- the person orientation acquisition unit 1141 acquires which direction the person 51 is facing in the space in which the robot 1200 moves. For example, when the person 51 wears a helmet in which position sensors are provided in front and rear in advance, and the person orientation acquiring unit 1141 is looking at the direction of a straight line connecting the positions acquired from the two sensors. Assuming the direction of the person 51 is determined.
- the obstacle information acquisition unit 1142 is means for acquiring position information of an obstacle that blocks the field of view of the person 51. Specifically, the failure information acquisition unit 1142 acquires position information such as the wall 2802.
- the human view range determination unit 1125 determines the view range of the person 51.
- FIG. 21 is a diagram for explaining the field of view of the person 51.
- the human view range determination unit 1125 acquires the position of the person 51 using the human position acquisition unit 1102.
- the human field of view range determination unit 1125 uses the human orientation acquisition unit 1141 to acquire the direction in which the person 51 is facing.
- a person orientation vector 4201 is a vector indicating the direction (person orientation) in which the person 51 is facing.
- the human field of view range determination unit 1125 acquires obstacle information in the work space 2701 from the obstacle information acquisition unit 1142. For example, the position of the wall 2802 in FIG. Next, the human view range determination unit 1125 determines, as the human view range 74, a set of points X that satisfy the following first to third conditions among the points in the work space 2701.
- the first condition is that the angle formed by the vector connecting the position of the person 51 and the point X and the person orientation vector 4201 is 55 degrees or less.
- the second condition is that there is no obstacle such as the wall 2802 on the line segment connecting the position of the person 51 and the point X.
- the third condition is that the distance between the position of the person 51 and the point X is 25 cm or more.
- the 21 is an example of a human view range that satisfies the above.
- the first condition indicates that the human view range 74 includes a range of 55 degrees to the left and right with the front of the person 51 as the center. Further, the second condition indicates that the point blocked by the wall 2802 is not included in the human view range 74.
- the third condition indicates that a portion that is too close to the person 51 such as the foot of the person 51 is not included in the human field of view range 74.
- the human field of view range 74 is a range of 55 degrees left and right with the front of the person 51 as the center, but this is an example, and may be a range of another angle. If the human field of view range 74 becomes a narrower range, it becomes a range where the person 51 can easily find it. Further, this angle may be changed according to the speed at which the person 51 is moving.
- the range of the human view range 74 is 55 degrees, and when the person 51 is moving faster than the predetermined speed, The range may be a range of 30 degrees.
- the human field of view range 74 a portion that is 25 cm or more away from the person 51 is regarded as the human field of view range 74.
- this distance is an example and may be another distance.
- the human field of view range 74 becomes a range that the person 51 can easily find. Further, this distance may be changed according to the speed at which the person 51 is moving.
- the human field of view range 74 is 25 cm from the person 51 and when the person 51 is moving faster than the predetermined speed, The distance from the person 51 may be 50 cm. With such a configuration, even when the person 51 is moving fast and attention is reduced, the person 51 is unlikely to overlook the target. On the contrary, when the person 51 is moving slowly, the object is presented at an unobstructed position.
- the human view range determination unit 1125 determines the human view range 74 based on the position of the person, the direction of the person, and information on the obstacle. However, the human view range determination unit 1125 may estimate the human view range 74 from any of these.
- the position / orientation determination unit 1133 determines the position of the image of the robot 1200 displayed in the work space 2701 in order to notify the person 51 that the robot 1200 is approaching. Details will be described later.
- the image generation unit 1104 generates an image of the robot 1200 displayed in the work space 2701 in order to notify the person 51 that the robot 1200 is approaching. Further, the image generation unit 1104 determines the display format of the robot 1200 that is displayed in order to notify the person 51 of the approach of the robot 1200. The process of determining the display format may be executed by a display format determining unit (not shown). Details of the display format determination processing by the image generation unit 1104 will be described later.
- the display device 1300 presents the robot 1200 at the position determined by the position / orientation determination unit 1133 in the display format determined by the image generation unit 1104.
- the display device 1300 is a means such as a projector.
- FIG. 22 is a diagram illustrating a positional relationship among the robot 1200, the person 51, and the image 2902 of the robot 1200 at time 0.
- An image 2902 of the robot 1200 is an image of the position of the robot 1200 after a predetermined time from time 0. Here, the predetermined time is 2.
- An image 2902 of the robot 1200 is an image indicating the position of the robot 1200 at time 2.
- the arrows in the figure indicate the movement path of the robot 1200 after time 0. In practice, such a line is not shown in the workspace.
- the moving route includes a place where the person 51 is present. Therefore, if the person 51 does not avoid, the person 51 and the robot 1200 will contact. Alternatively, the robot 1200 must make a detour or stop in order to avoid a collision. However, when the robot 1200 is detoured or stopped, the working efficiency of the robot 1200 decreases. In order to share the work space 2701 between the person 51 and the robot 1200 and perform the work efficiently, it is desirable that the person 51 grasps the plan of the robot 1200 and determines whether or not he / she can get away. .
- the human view range 74 is the view range of the person 51 at time 0.
- the human field of view 74 includes neither the robot 1200 nor the image 2902 of the robot 1200. Therefore, the person 51 cannot predict the approach of the robot 1200.
- FIG. 23 is a diagram illustrating a positional relationship among the robot 1200, the person 51, and the image 2902 of the robot 1200 at time 4.
- the image 2902 of the robot 1200 is an image showing the position of the robot 1200 after a predetermined time from the time 4 (that is, at the time 6).
- the human view range 74 is a view range of the person 51 at time 4.
- the human field of view range 74 includes an image 2902 of the robot 1200. Therefore, the person 51 can predict the approach of the robot 1200. That is, the person 51 can start preparation for avoidance actions such as avoiding behind.
- FIG. 24 is a diagram illustrating a positional relationship among the robot 1200, the person 51, and the image 2902 of the robot 1200 at time 6.
- An image 2902 of the robot 1200 is an image showing the position of the robot 1200 after a predetermined time from the time 6 (that is, at time 8).
- the human view range 74 is a view range of the person 51 at time 6.
- the human view range 74 includes a robot 1200 and an image 2902 of the robot 1200.
- the person 51 has already begun preparations for avoidance at the time of FIG. Accordingly, the person 51 can start actual movement at this time. Therefore, at this time, the person 51 starts moving.
- FIG. 25 is a diagram illustrating a positional relationship among the robot 1200, the person 51, and the image 2902 of the robot 1200 at time 8.
- An image 2902 of the robot 1200 is an image showing the position of the robot 1200 after a predetermined time from the time 8 (that is, at the time 10).
- the human view range 74 is a view range of the person 51 at time 6.
- the human view range 74 includes a robot 1200 and an image 2902 of the robot 1200.
- the position of the robot 1200 at time 8 is substantially the same as the position where the person 51 was present at time 0. However, since the person 51 has already performed an avoidance action, a collision can be avoided.
- the person 51 can avoid a collision with the robot 1200. However, if there is a wall 2802, the person 51 may not be able to avoid a collision. This will be described with reference to FIGS.
- FIG. 26 is a diagram illustrating a positional relationship among the robot 1200, the person 51, and the image 2902 of the robot 1200 at time 0.
- the human view range 74 at time 0 does not include the robot 1200 and the image 2902 of the robot 1200. Therefore, the person 51 cannot predict the approach of the robot 1200.
- FIG. 27 is a diagram showing a positional relationship among the robot 1200, the person 51, and the image 2902 of the robot 1200 at time 4.
- the image 2902 of the robot 1200 is an image showing the position of the robot 1200 after a predetermined time from the time 4 (that is, at the time 6).
- the human view range 74 is a view range of the person 51 at time 4.
- the human view range 74 does not include the image 2902 of the robot 1200. Therefore, the person 51 cannot predict the approach of the robot 1200. Therefore, unlike the case of FIG. 23, the person 51 cannot start preparation for avoidance action.
- FIG. 28 is a diagram illustrating a positional relationship among the robot 1200, the person 51, and the image 2902 of the robot 1200 at time 6.
- FIG. An image 2902 of the robot 1200 is an image showing the position of the robot 1200 after a predetermined time from the time 6 (that is, at time 8). At this time, an image 2902 of the robot 1200 is finally included in the human view range 74. At this point, the person 51 starts preparing for avoidance action.
- FIG. 25 is a diagram illustrating a positional relationship among the robot 1200, the person 51, and the image 2902 of the robot 1200 at time 8. As a result of the delay in avoidance, the person 51 collides with the robot 1200.
- the danger presentation system 1030 determines the position of the image 2902 of the robot 1200 in consideration of the human field of view range 74 of the person 51.
- the process which the danger presentation system 1030 performs is demonstrated using FIG.
- the position / orientation determination unit 1133 issues an instruction (command) for acquiring the human view range 74 to the human view range determination unit 1125.
- the human field of view range determination unit 1125 acquires the position of the person 51 from the human position acquisition unit 1102 (S2501).
- the human field of view range determination unit 1125 acquires the direction of the person 51 from the human direction acquisition unit 1141 (S2502).
- the human visual field range determination unit 1125 acquires the position of the human 51 acquired from the human position acquisition unit 1102 and the direction of the human 51 acquired from the human direction acquisition unit 1141, and determines the human visual field range 74 (S2503). . Details are the same as in the third embodiment.
- the human visual field range determination unit 1125 notifies the position / posture determination unit 1133 of the acquired human visual field range 74.
- the position / orientation determination unit 1133 substitutes T0 for the variable T (S2504).
- the variable T is a variable that holds a temporary value indicating how much later the robot position is to be presented. For example, when the value of the variable T is 2, an image 2902 showing the robot 1200 is presented at the expected position of the robot 1200 after 2 seconds.
- the position and orientation determination unit 1133 determines the final value of the variable T while changing the value of the variable T.
- the initial value T0 assigned to the variable T is “2”.
- the position / orientation determination unit 1133 acquires the position of the robot 1200 after the time T from the current operation planning unit 1201 (S2505).
- the position / orientation determination unit 1133 determines whether or not the position of the robot 1200 after the time T is included in the human view range 74 (S2506).
- the determination method is the same as in the third embodiment.
- the position / orientation determination unit 1133 adds 1 to the variable T (S2507). Then, the position / orientation determination unit 1133 again acquires the position of the robot 1200 after the time T from the motion planning unit 1201 (S2505). That is, when the position of the robot 1200 at the time T is not included in the human view range 74, the position / orientation determination unit 1133 advances the time by one unit until the position is included in the human view range 74.
- the position / posture determination unit 1133 determines the position of the robot 1200 after the time T as a feature position (hereinafter referred to as a display position). Call). Then, the image generation unit 1104 determines the display format such as the color for displaying the image 2902 of the robot 1200 and the thickness of the outline (S2508). Then, the image generation unit 1104 generates image data for displaying the image 2902 at the display position.
- the image generation unit 1104 changes the display format of the image 2902 indicating the robot 1200, the person 51 can easily grasp how much time is left until the collision. Details will be described later.
- the display device 1300 displays the image 2902 of the robot 1200 at the position determined by the position / orientation determination unit 1133 in the display format determined by the image generation unit 1104 (S2509).
- FIG. 31 is a flowchart showing a modification of the process shown in FIG.
- the position / orientation determination unit 1133 adds 1 to the variable T (S2507), and then determines whether the variable T is smaller than the maximum value T_MAX (S2510). If the variable T is smaller than the maximum value T_MAX (Yes in S2510), the position / orientation determination unit 1133 again returns the robot 1200 after the time T from the motion planning unit 1201, as in the process illustrated in FIG. The position is acquired (S2505).
- the danger presentation system 1030 ends the process. Thereby, the image 2902 of the robot 1200 in the far future is not displayed. That is, the image 2902 is not displayed when the danger is small.
- the danger presentation system 1030 performs the danger presentation once, but the danger presentation system 1030 may actually perform the danger presentation a plurality of times at regular time intervals.
- the image 2902 of the robot 1200 presented in the work space 2701 may be presented at the position of the robot 1200 after the time T0, or may be presented at the time T0 + 1, T0 + 2,. It may be presented in a position. Therefore, the person 51 cannot know when the robot 1200 is approaching from the image 2902 of the robot 1200 that he / she has seen.
- the image generation unit 1104 determines the display format so that the image 2902 of the robot 1200 is displayed in a more prominent display format. . Conversely, when the time until the robot 1200 reaches the determined display position is long, the image generation unit 1104 changes the display format so that the image 2902 of the robot 1200 is displayed in a less noticeable display format. decide.
- the image generation unit 1104 sets the brightness of the image 2902 indicating the robot 1200 to a high value. That is, the image generation unit 1104 makes the image 2902 bright. Conversely, when the time until the robot 1200 reaches the display position is long, the image generation unit 1104 sets the image 2902 indicating the robot 1200 to low brightness.
- the image generation unit 1104 makes the image 2902 brighter than when the time until the robot 1200 reaches a predetermined time or more. Display to make the image 2902 stand out. However, if the room is brightened by illumination, the image generation unit 1104 darkens the image 2902 so that the image 2902 is not illuminated so much that the image 2902 stands out. May be.
- the image generation unit 1104 thickens the outline of the image 2902 indicating the robot 1200.
- the image generation unit 1104 thins the outline of the image 2902 indicating the robot 1200.
- the image generation unit 1104 makes the outline thicker than when the time until the robot 1200 reaches a predetermined time or more. And make the statue stand out.
- the image generation unit 1104 generates image data for presenting a value indicating the time until the robot 1200 reaches the display position around the image 2902 of the robot 1200.
- the image generation unit 1104 determines the robot display color (S2601). For example, the image generation unit 1104 calculates a value by “(maximum value of brightness) ⁇ T0 / (value of variable T)” (Equation 1), and assigns the calculated value to the display color of the robot 1200.
- the maximum value of brightness is, for example, when the brightness of white is “255” and the brightness of black is “0”, “255” (white brightness) is the maximum value of brightness.
- T0 / (value of variable T)” (expression 2) is “1” when the value of variable T is “T0”, and “1” when the value of variable T is “T0 ⁇ 2”. / 2 ". That is, when the time until the robot 1200 reaches the display position is short, the value of Expression 2 is “1”, and the value of Expression 2 becomes smaller as the time is longer. Therefore, the image generation unit 1104 sets the brightness of the image 2902 of the robot 1200 to a high value when the time until the robot 1200 reaches the display position is short, and sets the brightness to a low value when the time is long.
- the image generation unit 1104 determines the thickness of the contour line when displaying the image 2902 of the robot 1200 (S2602).
- the image generation unit 1104 determines the thickness of the contour line by “5 ⁇ T0 / (value of variable T)” (Formula 3).
- the value of Expression 3 is “5” when the value of the variable T is “T0”, and is “2.5” when the value of the variable T is “T0 ⁇ 2”. That is, when the time until the robot 1200 reaches the display position is short, the value of Expression 3 is “5”, and the value of Expression 3 becomes smaller as the time is longer.
- the image generation unit 1104 thickens the contour line of the image 2902 of the robot 1200 when the time until the robot 1200 reaches the display position is short, and narrows the contour line when the time is long.
- the image generation unit 1104 determines the value of the time until the robot 1200 reaches the display position (S2603).
- the determined value is presented around the image 2902 of the robot 1200 by the display device 1300.
- this value is a value of the variable T, and is a value indicating the time until the robot 1200 reaches the display position.
- the image generation unit 1104 performs conversion processing such as truncation after the decimal point or conversion to seconds as necessary.
- FIG. 33 is a diagram illustrating a positional relationship among the robot 1200, the person 51, and the image 2902 of the robot 1200 at time 0.
- An image 2902 of the robot 1200 is an image of the position of the robot 1200 after time 0 from time 0.
- “8” is a time during which the image 2902 of the robot 1200 is included in the human view range 74 after “2” of the predetermined time.
- an arrival time 3702 to the position is displayed around the robot 1200.
- the brightness of the image 2902 of the robot 1200 is “255 ⁇ 2/8” (Formula 1). That is, the brightness is “63.75”.
- the thickness of the contour is “5 ⁇ 2/8” from Equation 3. That is, the thickness of the contour is “1.25”.
- the person 51 shown in FIG. 33 can know that the robot 1200 is approaching from behind the wall.
- the position where the image 2902 of the robot 1200 is presented is close to the person 51, but the brightness of the image 2902 is thin and the contour is relatively thin. Therefore, the person 51 can still determine that he / she has enough time before the collision and can continue the current work.
- FIG. 34 is a diagram illustrating a positional relationship among the robot 1200, the person 51, and the image 2902 of the robot 1200 at time 4.
- An image 2902 of the robot 1200 is an image of the position of the robot 1200 after time 4 from time 4.
- the human view range 74 is a view range of the person 51 at time 4. At this time, since the human view range 74 includes the image 2902 of the robot 1200, the person 51 can predict the approach of the robot 1200.
- the brightness of the image 2902 of the robot 1200 is “255 ⁇ 2/4” (Formula 1). That is, the brightness is “127.5”.
- the thickness of the contour is “5 ⁇ 2/4” from Equation 3. That is, the outline thickness is “2.5”.
- the person 51 can know that the approach of the robot 1200 is closer because the brightness of the image 2902 of the robot 1200 is brighter and the outline is thicker than in the case of FIG. Then, the person 51 can start preparation for avoidance.
- FIG. 35 is a diagram illustrating a positional relationship among the robot 1200, the person 51, and the image 2902 of the robot 1200 at time 6.
- FIG. An image 2902 of the robot 1200 is an image of the position of the robot 1200 after time 2 from time 6.
- the human view range 74 is a view range of the person 51 at time 6. At this time, the human view range 74 includes an image 2902 of the robot 1200.
- the brightness of the image 2902 of the robot 1200 is “255 ⁇ 2/2” (Formula 1). That is, the brightness is “255”.
- the thickness of the contour is “5 ⁇ 2/2” from Equation 3. That is, the thickness of the contour is “5”.
- the person 51 can know that the approach of the robot 1200 is finally closer because the brightness of the image 2902 of the robot 1200 is brighter and the outline is thicker than in the case of FIG. Further, since the person 51 has started preparation for avoidance at the time of FIG. 34, the avoidance action can be started at the time of FIG.
- FIG. 36 is a diagram showing a positional relationship among the robot 1200, the person 51, and the image 2902 of the robot 1200 at time 8.
- An image 2902 of the robot 1200 is an image showing the position of the robot 1200 after time 2 from time 8 (that is, time 10).
- the human view range 74 is the view range of the person 51 at time 8, and the human view range 74 includes a robot 1200 and an image 2902 of the robot 1200.
- the position of the robot 1200 at time 8 is substantially the same as the position where the person 51 was at time 0. However, since the person 51 has already performed an avoidance action, a collision can be avoided.
- FIG. 37 is a diagram illustrating a state in which the person 51 is facing in a direction opposite to the direction in which the robot 1200 is directed toward the person 51.
- an image 2902 of the robot 1200 is presented at the place of the person 51.
- the person 51 is illuminated for displaying the image 2902. And when the person 51 knows that the state which receives illumination is dangerous, the person 51 can recognize danger.
- the danger presentation system 1030 can notify the person 51 of the danger regardless of the warning sound or the like.
- the danger presentation system 1030 presents the image 2902 of the robot 1200 at a future time point in the human view range 74. Therefore, the danger presentation system 1030 can appropriately present the danger situation.
- the feature position of the mobile robot is presented, but the feature posture of the rotary robot may be presented.
- the danger presentation system appropriately presents the dangerous situation around the robot.
- the danger presentation apparatus by this invention can produce
- the generated data is displayed as an image of a robot or the like by the display device. Thereby, the person can perceive the dangerous situation around the robot accurately.
- the present invention can be realized not only as a danger presentation device, but also as a method having steps as processing means constituting the danger presentation device.
- the steps involved in these methods are typically performed by a computer.
- this invention is realizable as a program which makes a computer perform the step contained in those methods.
- the present invention can be realized as a computer-readable storage medium such as a CD-ROM storing the program.
- the danger presentation device can generate data for appropriately presenting a danger situation associated with the operation of the robot, and can be used particularly in a production site where a person works near the robot.
Landscapes
- Engineering & Computer Science (AREA)
- Mechanical Engineering (AREA)
- Robotics (AREA)
- General Engineering & Computer Science (AREA)
- Manipulator (AREA)
Abstract
Description
実施の形態1における危険提示システムは、危険領域にいる人に、どの方向からロボットが接近してくるかを分かるように危険領域等を提示する。そして、実施の形態1における危険提示システムは、1自由度の回転型ロボットを対象にした危険提示システムである。なお、1自由度の回転型ロボットは、本発明の対象とされるロボットの一例である。本発明の対象とされるロボットは、多自由度、直動型、移動型、および、それらの組合せ等のロボットでもよい。
実施の形態1における危険提示システムは、危険領域の内部にいる人に、危険領域等を提示する。実施の形態2における危険提示システムは、さらに、危険領域の内部にいない人であっても、後で、危険領域に移動してくる恐れのある人に、危険領域等を提示する。
実施の形態1および実施の形態2における危険提示システムは、人とロボットが衝突する可能性がある場合に、時間的に最も先に衝突する可能性のある場所を特徴位置として表示するか、または、その時のロボットの姿勢を特徴姿勢として提示する。しかし、人が向いている方向によっては、人は、提示された特徴位置または特徴姿勢を見ることができない可能性がある。実施の形態3における危険提示システムは、人が向いている方向を考慮して、人が見ることができる領域に特徴位置または特徴姿勢を提示する。
実施の形態1から3において、回転型ロボットを対象とした危険提示システムが示された。そこでは、回転型ロボットの将来の姿勢を危険として提示する際、その姿勢によっては、人が危険を知覚できない場合があることが示された。そして、それに関して改良された危険提示システムが示された。
51、9061 人
61、71、81 特徴姿勢
72、73、82 特徴位置
74 視界(人視界範囲)
1000、1010、1020、1030 危険提示システム
1100、1110、1120、1130 危険提示装置
1101 危険領域生成部
1102 人位置取得部
1103、1113、1123、1133 位置姿勢決定部
1104 画像生成部
1125 人視界範囲決定部
1141 人向き取得部
1142 障害情報取得部
1200 ロボット
1201 動作計画部
1202 動作制御部
1203 可動部
1300 表示装置
1400 警告音出力装置
2001 ベース部
2002 物体
2701 作業空間
2802 壁
2902 像
3702 到達時間
4201 ベクトル
9001 移動ロボット
9011、9012 腕部
9060 危険範囲
9101、9102、9103、9104 プロジェクタ
Claims (20)
- 人の位置である人位置を取得する人位置取得部と、
前記人位置取得部で取得された前記人位置に依存させて、前記人の視界範囲を決定する人視界範囲決定部と、
動作計画に従って動作するロボットの少なくとも一部が前記視界範囲に含まれる特定時刻における前記ロボットの位置、および、前記特定時刻における前記ロボットの姿勢のうち少なくとも一方を含む位置姿勢を決定する位置姿勢決定部と、
前記位置姿勢決定部で決定された前記位置姿勢を示すための画像データを生成する画像生成部とを備える
危険提示装置。 - 前記危険提示装置は、さらに、前記ロボットが動作する領域を危険領域として、前記動作計画に従って生成する危険領域生成部を備え、
前記位置姿勢決定部は、前記人位置および前記動作計画から、前記人と前記ロボットとの衝突が予想される時刻を含む期間内の前記特定時刻における前記位置姿勢を決定し、
前記画像生成部は、前記位置姿勢決定部で決定された前記位置姿勢と、前記危険領域とを示すための前記画像データを生成する
請求項1に記載の危険提示装置。 - 前記位置姿勢決定部は、前記衝突が予想される時刻よりも前の時刻である前記特定時刻における前記位置姿勢を決定する
請求項2に記載の危険提示装置。 - 前記位置姿勢決定部は、前記人位置と前記ロボットが動作している位置との距離が予め定められた距離以上となっている時刻であって、かつ、前記衝突が予想される時刻よりも前の時刻であって、かつ、前記衝突が予想される時刻に最も近い時刻である前記特定時刻における前記位置姿勢を決定する
請求項2に記載の危険提示装置。 - 前記位置姿勢決定部は、前記人位置取得部で取得された前記人位置から、所定時間経過後の前記人の位置を前記人位置として予想し、予想した前記人位置および前記動作計画から前記人と前記ロボットとの前記衝突を予想し、前記衝突が予想される時刻を含む期間内の前記特定時刻における前記位置姿勢を決定する
請求項2に記載の危険提示装置。 - 前記位置姿勢決定部は、前記衝突が予想される時刻である前記特定時刻における前記位置姿勢を決定する
請求項5に記載の危険提示装置。 - 前記位置姿勢決定部は、前記ロボットが前記動作計画に従って所定時間内に動作する領域である動作領域と、前記視界範囲とが予め定められた大きさ以上で重なる時刻であって、かつ、前記人と前記ロボットとの最初の衝突が予想される時刻以降の時刻であって、かつ、前記最初の衝突が予想される時刻に最も近い時刻である前記特定時刻における前記位置姿勢を決定する
請求項1または2に記載の危険提示装置。 - 前記位置姿勢決定部は、前記人と前記ロボットとの衝突が予想される場合、かつ、前記特定時刻に該当する時刻が存在しない場合、警告出力装置に警告を出力させる
請求項1~7のいずれか1項に記載の危険提示装置。 - 前記位置姿勢決定部は、前記特定時刻が、前記人位置取得部で取得された前記人位置を前記ロボットが通過する時刻と同じまたは後の時刻である場合、警告出力装置に警告を出力させる
請求項1~8のいずれか1項に記載の危険提示装置。 - 前記画像生成部は、前記特定時刻が、前記人位置取得部で取得された前記人位置を前記ロボットが通過する時刻よりも前の時刻である場合、前記画像データを生成する
請求項9に記載の危険提示装置。 - 前記危険提示装置は、さらに、
前記人の向きである人向きを取得する人向き取得部と、
前記視界範囲を遮る障害の情報である障害情報を取得する障害情報取得部とを備え、
前記人視界範囲決定部は、前記人位置取得部で取得された前記人位置と、前記人向き取得部で取得された前記人向きと、前記障害情報取得部で取得された前記障害情報とに依存させて、前記視界範囲を決定する
請求項1~10のいずれか1項に記載の危険提示装置。 - 前記画像生成部は、現在から前記特定時刻までの到達時間と、前記位置姿勢とを示すための前記画像データを生成する
請求項1~11のいずれか1項に記載の危険提示装置。 - 前記画像生成部は、現在から前記特定時刻までの到達時間に依存させて、前記位置姿勢の表示形式を決定し、決定した前記表示形式で前記位置姿勢を示すための前記画像データを生成する
請求項1~12のいずれか1項に記載の危険提示装置。 - 前記画像生成部は、前記到達時間が第1の時間である場合に、前記到達時間が前記第1の時間よりも長い第2の時間である場合よりも明度が高くなるように、前記表示形式を決定し、決定した前記表示形式で前記位置姿勢を示すための前記画像データを生成する
請求項13に記載の危険提示装置。 - 請求項1~14のいずれか1項に記載の危険提示装置を備える
危険提示システム。 - 前記危険提示システムは、さらに、前記動作計画に従って動作する前記ロボットを備える
請求項15に記載の危険提示システム。 - 前記危険提示システムは、さらに、前記画像生成部で生成された前記画像データを画像として提示する表示装置を備える
請求項15または16に記載の危険提示システム。 - 前記危険提示システムは、さらに、警告音を出力する警告音出力装置を備える
請求項15~17のいずれか1項に記載の危険提示システム。 - 人の位置である人位置を取得する人位置取得ステップと、
前記人位置取得ステップで取得された前記人位置に依存させて、前記人の視界範囲を決定する人視界範囲決定ステップと、
動作計画に従って動作するロボットの少なくとも一部が前記視界範囲に含まれる特定時刻における前記ロボットの位置、および、前記特定時刻における前記ロボットの姿勢のうち少なくとも一方を含む位置姿勢を決定する位置姿勢決定ステップと、
前記位置姿勢決定ステップで決定された前記位置姿勢を示すための画像データを生成する画像生成ステップとを含む
危険提示方法。 - 人の位置である人位置を取得する人位置取得ステップと、
前記人位置取得ステップで取得された前記人位置に依存させて、前記人の視界範囲を決定する人視界範囲決定ステップと、
動作計画に従って動作するロボットの少なくとも一部が前記視界範囲に含まれる特定時刻における前記ロボットの位置、および、前記特定時刻における前記ロボットの姿勢のうち少なくとも一方を含む位置姿勢を決定する位置姿勢決定ステップと、
前記位置姿勢決定ステップで決定された前記位置姿勢を示すための画像データを生成する画像生成ステップとを
コンピュータに実行させるためのプログラム。
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201180005161.4A CN102686371B (zh) | 2010-01-25 | 2011-01-19 | 危险提示装置、危险提示系统以及危险提示方法 |
JP2011550844A JP5059978B2 (ja) | 2010-01-25 | 2011-01-19 | 危険提示装置、危険提示システム、危険提示方法およびプログラム |
US13/430,853 US8816874B2 (en) | 2010-01-25 | 2012-03-27 | Danger presentation device, danger presentation system, danger presentation method and program |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2010-013658 | 2010-01-25 | ||
JP2010013658 | 2010-01-25 |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/430,853 Continuation US8816874B2 (en) | 2010-01-25 | 2012-03-27 | Danger presentation device, danger presentation system, danger presentation method and program |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2011089885A1 true WO2011089885A1 (ja) | 2011-07-28 |
Family
ID=44306687
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2011/000237 WO2011089885A1 (ja) | 2010-01-25 | 2011-01-19 | 危険提示装置、危険提示システム、危険提示方法およびプログラム |
Country Status (4)
Country | Link |
---|---|
US (1) | US8816874B2 (ja) |
JP (1) | JP5059978B2 (ja) |
CN (1) | CN102686371B (ja) |
WO (1) | WO2011089885A1 (ja) |
Cited By (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2012223831A (ja) * | 2011-04-15 | 2012-11-15 | Mitsubishi Electric Corp | 衝突回避装置 |
ITRN20120036A1 (it) * | 2012-07-09 | 2014-01-10 | Wide Automation S R L | Sistema e procedimento di supervisione |
JP2014008562A (ja) * | 2012-06-28 | 2014-01-20 | Honda Motor Co Ltd | 移動ロボットの制御装置 |
JP2014180723A (ja) * | 2013-03-19 | 2014-09-29 | Yaskawa Electric Corp | ロボットシステム及び被加工物の製造方法 |
CN104428107A (zh) * | 2012-07-10 | 2015-03-18 | 西门子公司 | 机器人布置和用于控制机器人的方法 |
JP2016209991A (ja) * | 2015-05-01 | 2016-12-15 | キヤノン株式会社 | ロボットの制御装置、制御方法およびシステム |
JP2017100204A (ja) * | 2015-11-30 | 2017-06-08 | 株式会社デンソーウェーブ | ロボット操作システム |
JP2017520419A (ja) * | 2014-07-02 | 2017-07-27 | シーメンス アクチエンゲゼルシヤフトSiemens Aktiengesellschaft | 警報方法およびロボットシステム |
JP2017148905A (ja) * | 2016-02-25 | 2017-08-31 | ファナック株式会社 | ロボットシステムおよびロボット制御装置 |
EP3422053A1 (en) * | 2017-06-28 | 2019-01-02 | Datalogic IP Tech S.r.l. | Safety system |
US10434666B2 (en) | 2015-07-03 | 2019-10-08 | Denso Wave Incorporated | Industrial robot system optically indicating motion area of robot |
JP2019176423A (ja) * | 2018-03-29 | 2019-10-10 | キヤノン株式会社 | 情報処理装置および方法およびコンピュータプログラム、並びに監視システム |
WO2020213346A1 (ja) * | 2019-04-16 | 2020-10-22 | 清水建設株式会社 | 情報表示システムおよび情報表示方法 |
Families Citing this family (37)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR101560516B1 (ko) * | 2012-01-13 | 2015-10-14 | 미쓰비시덴키 가부시키가이샤 | 리스크 측정 시스템 |
US9393695B2 (en) | 2013-02-27 | 2016-07-19 | Rockwell Automation Technologies, Inc. | Recognition-based industrial automation control with person and object discrimination |
US9804576B2 (en) * | 2013-02-27 | 2017-10-31 | Rockwell Automation Technologies, Inc. | Recognition-based industrial automation control with position and derivative decision reference |
US9498885B2 (en) | 2013-02-27 | 2016-11-22 | Rockwell Automation Technologies, Inc. | Recognition-based industrial automation control with confidence-based decision support |
US9798302B2 (en) * | 2013-02-27 | 2017-10-24 | Rockwell Automation Technologies, Inc. | Recognition-based industrial automation control with redundant system input support |
JP5673717B2 (ja) * | 2013-03-19 | 2015-02-18 | 株式会社安川電機 | ロボットシステム及び被加工物の製造方法 |
US9427871B2 (en) * | 2013-05-06 | 2016-08-30 | Abb Technology Ag | Human safety provision in mobile automation environments |
JP5850003B2 (ja) * | 2013-07-26 | 2016-02-03 | 株式会社安川電機 | ロボットシステム、ロボットシステムのロボット管理コンピュータ及びロボットシステムの管理方法 |
JP6397226B2 (ja) * | 2014-06-05 | 2018-09-26 | キヤノン株式会社 | 装置、装置の制御方法およびプログラム |
US9283678B2 (en) * | 2014-07-16 | 2016-03-15 | Google Inc. | Virtual safety cages for robotic devices |
US9373257B2 (en) * | 2014-09-29 | 2016-06-21 | Lytx, Inc. | Proactive driver warning |
CN104750249B (zh) * | 2015-03-02 | 2020-02-21 | 联想(北京)有限公司 | 一种信息处理方法及电子设备 |
WO2016173609A1 (en) * | 2015-04-27 | 2016-11-03 | Abb Technology Ltd | A movement indicator for a robot |
WO2016196512A1 (en) * | 2015-05-29 | 2016-12-08 | Abb Technology Ag | Method and system for robotic adaptive production |
JP6464945B2 (ja) * | 2015-07-03 | 2019-02-06 | 株式会社デンソーウェーブ | ロボットシステム |
JP6554946B2 (ja) | 2015-07-03 | 2019-08-07 | 株式会社デンソーウェーブ | ロボットシステム |
JP6088605B1 (ja) * | 2015-08-31 | 2017-03-01 | ファナック株式会社 | 視覚センサを用いたロボットシステム |
US9855664B2 (en) * | 2015-11-25 | 2018-01-02 | Denso Wave Incorporated | Robot safety system |
DE102015224309A1 (de) * | 2015-12-04 | 2017-06-08 | Kuka Roboter Gmbh | Darstellung variabler Schutzfelder |
JP6504072B2 (ja) * | 2016-02-15 | 2019-04-24 | オムロン株式会社 | 作業領域推定装置、制御装置、制御システム、作業領域推定方法およびプログラム |
US10924881B2 (en) * | 2016-03-03 | 2021-02-16 | Husqvarna Ab | Device for determining construction device and worker position |
DK201700203A1 (en) * | 2017-03-23 | 2018-11-27 | Mrr | Safety system for collaborative robot |
JP2018176397A (ja) * | 2017-04-21 | 2018-11-15 | オムロン株式会社 | ロボットシステム |
CN108010271B (zh) * | 2017-06-15 | 2019-06-28 | 深圳市远弗科技有限公司 | 一种看护机器人、报警系统和方法 |
JP2019010704A (ja) * | 2017-06-30 | 2019-01-24 | Idec株式会社 | 照光表示装置 |
DE102017009641A1 (de) | 2017-10-17 | 2019-04-18 | Kuka Deutschland Gmbh | Verfahren und System zum Betreiben eines Roboterarms |
US20200394405A1 (en) * | 2017-12-12 | 2020-12-17 | Sony Corporation | Information processing apparatus and information processing method |
US10676022B2 (en) | 2017-12-27 | 2020-06-09 | X Development Llc | Visually indicating vehicle caution regions |
KR102499576B1 (ko) | 2018-01-08 | 2023-02-15 | 삼성전자주식회사 | 전자 장치 및 그 제어 방법 |
EP3584039A1 (en) * | 2018-06-19 | 2019-12-25 | BAE SYSTEMS plc | Workbench system |
WO2019243797A1 (en) * | 2018-06-19 | 2019-12-26 | Bae Systems Plc | Workbench system |
CN108972551B (zh) * | 2018-07-12 | 2021-10-26 | 上海常仁信息科技有限公司 | 基于机器人危险动作识别和预判的智能控制系统 |
IT201800007934A1 (it) * | 2018-08-07 | 2020-02-07 | Universita' Degli Studi Di Siena | Metodo per generare un segnale di consapevolezza di un robot collaborativo e relativo sistema hardware |
WO2020137176A1 (ja) * | 2018-12-28 | 2020-07-02 | 京セラドキュメントソリューションズ株式会社 | 制御装置 |
US11295541B2 (en) * | 2019-02-13 | 2022-04-05 | Tencent America LLC | Method and apparatus of 360 degree camera video processing with targeted view |
US10940796B2 (en) * | 2019-04-05 | 2021-03-09 | Ford Global Technologies, Llc | Intent communication for automated guided vehicles |
JP7137609B2 (ja) * | 2020-12-11 | 2022-09-14 | Idec株式会社 | 照光表示装置 |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2001001284A (ja) * | 1999-06-17 | 2001-01-09 | Nippon Telegr & Teleph Corp <Ntt> | オペレータの視野情報を用いたロボット制御装置 |
JP2005066766A (ja) * | 2003-08-25 | 2005-03-17 | Saichiro Yamashita | 全面モニタ付きロボット |
JP2005288573A (ja) * | 2004-03-31 | 2005-10-20 | Honda Motor Co Ltd | 移動ロボット |
JP2008018529A (ja) * | 2007-08-30 | 2008-01-31 | Advanced Telecommunication Research Institute International | コミュニケーションロボット |
JP2009123045A (ja) * | 2007-11-16 | 2009-06-04 | Toyota Motor Corp | 移動ロボット及び移動ロボットの危険範囲の表示方法 |
Family Cites Families (19)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPS59205298A (ja) | 1983-05-06 | 1984-11-20 | 株式会社日立製作所 | ロボツトの安全領域監視方法 |
JP3174218B2 (ja) | 1994-04-21 | 2001-06-11 | キヤノン株式会社 | 工業用ロボットの制御方法 |
JP4161584B2 (ja) * | 2002-02-07 | 2008-10-08 | トヨタ自動車株式会社 | 移動体用安全装置 |
JP2004171269A (ja) | 2002-11-20 | 2004-06-17 | Enii Kk | 移動体衝突予測装置および移動体衝突予測方法 |
JP2004243427A (ja) | 2003-02-12 | 2004-09-02 | Yaskawa Electric Corp | ロボット制御装置およびロボット制御方法 |
WO2005015466A1 (ja) * | 2003-08-07 | 2005-02-17 | Matsushita Electric Industrial Co., Ltd. | 生活支援システム及びその制御用プログラム |
US7317388B2 (en) | 2004-03-31 | 2008-01-08 | Honda Motor Co., Ltd. | Position detection system for mobile object |
DE102004043514A1 (de) * | 2004-09-08 | 2006-03-09 | Sick Ag | Verfahren und Vorrichtung zum Steuern einer sicherheitsrelevanten Funktion einer Maschine |
JP3927994B2 (ja) * | 2004-10-19 | 2007-06-13 | 松下電器産業株式会社 | ロボット装置 |
JP4830438B2 (ja) | 2005-10-04 | 2011-12-07 | トヨタ自動車株式会社 | 自律移動装置 |
JP4811128B2 (ja) | 2006-05-25 | 2011-11-09 | トヨタ自動車株式会社 | 自律移動装置 |
CN101432103B (zh) * | 2006-07-04 | 2012-05-23 | 松下电器产业株式会社 | 机器人手臂的控制装置 |
JP2008117197A (ja) | 2006-11-06 | 2008-05-22 | Denso Corp | 自動運転装置の安全装置及び自動運転装置の制御方法 |
JP4371153B2 (ja) | 2007-06-15 | 2009-11-25 | トヨタ自動車株式会社 | 自律移動装置 |
CN102229147B (zh) * | 2007-06-27 | 2014-01-29 | 松下电器产业株式会社 | 机器手控制装置及控制方法、机器人 |
JP4983458B2 (ja) | 2007-07-23 | 2012-07-25 | トヨタ自動車株式会社 | 自律移動装置 |
JP2009113190A (ja) | 2007-11-09 | 2009-05-28 | Toyota Motor Corp | 自律動作型ロボットおよび自律動作型ロボットの動作制御方法 |
WO2010063319A1 (en) * | 2008-12-03 | 2010-06-10 | Abb Research Ltd. | A robot safety system and a method |
WO2010079564A1 (ja) * | 2009-01-09 | 2010-07-15 | パナソニック株式会社 | ロボットアームの制御装置及び制御方法、ロボット、ロボットアームの制御プログラム、並びに、集積電子回路 |
-
2011
- 2011-01-19 CN CN201180005161.4A patent/CN102686371B/zh active Active
- 2011-01-19 JP JP2011550844A patent/JP5059978B2/ja active Active
- 2011-01-19 WO PCT/JP2011/000237 patent/WO2011089885A1/ja active Application Filing
-
2012
- 2012-03-27 US US13/430,853 patent/US8816874B2/en active Active
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2001001284A (ja) * | 1999-06-17 | 2001-01-09 | Nippon Telegr & Teleph Corp <Ntt> | オペレータの視野情報を用いたロボット制御装置 |
JP2005066766A (ja) * | 2003-08-25 | 2005-03-17 | Saichiro Yamashita | 全面モニタ付きロボット |
JP2005288573A (ja) * | 2004-03-31 | 2005-10-20 | Honda Motor Co Ltd | 移動ロボット |
JP2008018529A (ja) * | 2007-08-30 | 2008-01-31 | Advanced Telecommunication Research Institute International | コミュニケーションロボット |
JP2009123045A (ja) * | 2007-11-16 | 2009-06-04 | Toyota Motor Corp | 移動ロボット及び移動ロボットの危険範囲の表示方法 |
Cited By (21)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2012223831A (ja) * | 2011-04-15 | 2012-11-15 | Mitsubishi Electric Corp | 衝突回避装置 |
JP2014008562A (ja) * | 2012-06-28 | 2014-01-20 | Honda Motor Co Ltd | 移動ロボットの制御装置 |
ITRN20120036A1 (it) * | 2012-07-09 | 2014-01-10 | Wide Automation S R L | Sistema e procedimento di supervisione |
EP2685150A1 (en) * | 2012-07-09 | 2014-01-15 | Wide Automation S.r.l. | Monitoring system and method |
EP2685150B1 (en) | 2012-07-09 | 2015-07-08 | Wide Automation S.r.l. | Monitoring system and method |
US9694497B2 (en) | 2012-07-10 | 2017-07-04 | Siemens Aktiengesellschaft | Robot arrangement and method for controlling a robot |
CN104428107A (zh) * | 2012-07-10 | 2015-03-18 | 西门子公司 | 机器人布置和用于控制机器人的方法 |
JP2014180723A (ja) * | 2013-03-19 | 2014-09-29 | Yaskawa Electric Corp | ロボットシステム及び被加工物の製造方法 |
JP2017520419A (ja) * | 2014-07-02 | 2017-07-27 | シーメンス アクチエンゲゼルシヤフトSiemens Aktiengesellschaft | 警報方法およびロボットシステム |
JP2016209991A (ja) * | 2015-05-01 | 2016-12-15 | キヤノン株式会社 | ロボットの制御装置、制御方法およびシステム |
US10434666B2 (en) | 2015-07-03 | 2019-10-08 | Denso Wave Incorporated | Industrial robot system optically indicating motion area of robot |
JP2017100204A (ja) * | 2015-11-30 | 2017-06-08 | 株式会社デンソーウェーブ | ロボット操作システム |
JP2017148905A (ja) * | 2016-02-25 | 2017-08-31 | ファナック株式会社 | ロボットシステムおよびロボット制御装置 |
EP3422053A1 (en) * | 2017-06-28 | 2019-01-02 | Datalogic IP Tech S.r.l. | Safety system |
JP2019005899A (ja) * | 2017-06-28 | 2019-01-17 | データロジック、アイピー、テック、ソシエタ、ア、レスポンサビリタ、リミタータDatalogic Ip Tech S.R.L. | 安全システム |
JP7246144B2 (ja) | 2017-06-28 | 2023-03-27 | データロジック、アイピー、テック、ソシエタ、ア、レスポンサビリタ、リミタータ | 安全システム |
JP2019176423A (ja) * | 2018-03-29 | 2019-10-10 | キヤノン株式会社 | 情報処理装置および方法およびコンピュータプログラム、並びに監視システム |
JP7170411B2 (ja) | 2018-03-29 | 2022-11-14 | キヤノン株式会社 | 情報処理装置および方法およびコンピュータプログラム、並びに監視システム |
WO2020213346A1 (ja) * | 2019-04-16 | 2020-10-22 | 清水建設株式会社 | 情報表示システムおよび情報表示方法 |
JP2020177328A (ja) * | 2019-04-16 | 2020-10-29 | 清水建設株式会社 | 情報表示システムおよび情報表示方法 |
JP7162564B2 (ja) | 2019-04-16 | 2022-10-28 | 清水建設株式会社 | 情報表示システムおよび情報表示方法 |
Also Published As
Publication number | Publication date |
---|---|
JPWO2011089885A1 (ja) | 2013-05-23 |
JP5059978B2 (ja) | 2012-10-31 |
CN102686371A (zh) | 2012-09-19 |
US20120182155A1 (en) | 2012-07-19 |
US8816874B2 (en) | 2014-08-26 |
CN102686371B (zh) | 2015-01-14 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP5059978B2 (ja) | 危険提示装置、危険提示システム、危険提示方法およびプログラム | |
US11420330B2 (en) | Robot control device, robot, and simulation device | |
EP3410246B1 (en) | Robot obstacle avoidance control system and method, robot, and storage medium | |
JP6392972B2 (ja) | 演算システムによって実施される方法、持続性コンピュータ可読媒体及びシステム | |
US8731276B2 (en) | Motion space presentation device and motion space presentation method | |
JP6051307B2 (ja) | 運転支援装置 | |
US10956739B2 (en) | Augmented reality robotic system visualization | |
US11148299B2 (en) | Teaching apparatus and teaching method for robots | |
CN107539887B (zh) | 建筑施工塔吊机群防碰撞预警辅助系统 | |
JP2012218120A (ja) | マニピュレーター動作予告装置、ロボットシステム及びマニピュレーター動作予告方法 | |
EP4214677A1 (en) | Training multi-object tracking models using simulation | |
JP6743453B2 (ja) | ロボット制御装置、ロボットおよびシミュレーション装置 | |
JP6746902B2 (ja) | 作業者用頭部装着型ディスプレイの情報表示システム | |
KR102029943B1 (ko) | 유사 힘 디바이스 | |
WO2023127096A1 (ja) | シミュレーションシステム、シミュレーション方法及びシミュレーションプログラム | |
WO2022190537A1 (ja) | 情報処理装置および情報処理方法、並びにプログラム | |
JP4811805B2 (ja) | 動的衝突予測方法 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WWE | Wipo information: entry into national phase |
Ref document number: 201180005161.4 Country of ref document: CN |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 11734492 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2011550844 Country of ref document: JP |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 11734492 Country of ref document: EP Kind code of ref document: A1 |