WO2022234752A1 - ピッキングシステム - Google Patents
ピッキングシステム Download PDFInfo
- Publication number
- WO2022234752A1 WO2022234752A1 PCT/JP2022/016572 JP2022016572W WO2022234752A1 WO 2022234752 A1 WO2022234752 A1 WO 2022234752A1 JP 2022016572 W JP2022016572 W JP 2022016572W WO 2022234752 A1 WO2022234752 A1 WO 2022234752A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- workpiece
- posture
- robot
- work
- picking system
- Prior art date
Links
- 238000004364 calculation method Methods 0.000 claims abstract description 35
- 238000003384 imaging method Methods 0.000 claims description 59
- 230000008859 change Effects 0.000 abstract description 43
- 230000036544 posture Effects 0.000 description 218
- 238000010586 diagram Methods 0.000 description 18
- 210000000078 claw Anatomy 0.000 description 16
- 238000012986 modification Methods 0.000 description 14
- 230000004048 modification Effects 0.000 description 14
- 238000000034 method Methods 0.000 description 13
- 238000012545 processing Methods 0.000 description 9
- 230000006870 function Effects 0.000 description 8
- 238000005259 measurement Methods 0.000 description 8
- 238000004519 manufacturing process Methods 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 238000013459 approach Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- 206010034719 Personality change Diseases 0.000 description 1
- 238000007792 addition Methods 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000010485 coping Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000010348 incorporation Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 239000002184 metal Substances 0.000 description 1
- 230000004044 response Effects 0.000 description 1
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J9/00—Programme-controlled manipulators
- B25J9/16—Programme controls
- B25J9/1694—Programme controls characterised by use of sensors other than normal servo-feedback from position, speed or acceleration sensors, perception control, multi-sensor controlled systems, sensor fusion
- B25J9/1697—Vision controlled systems
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J13/00—Controls for manipulators
- B25J13/08—Controls for manipulators by means of sensing devices, e.g. viewing or touching devices
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J9/00—Programme-controlled manipulators
- B25J9/16—Programme controls
- B25J9/1612—Programme controls characterised by the hand, wrist, grip control
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J9/00—Programme-controlled manipulators
- B25J9/16—Programme controls
- B25J9/1628—Programme controls characterised by the control loop
- B25J9/163—Programme controls characterised by the control loop learning, adaptive, model based, rule based expert control
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J9/00—Programme-controlled manipulators
- B25J9/16—Programme controls
- B25J9/1628—Programme controls characterised by the control loop
- B25J9/1653—Programme controls characterised by the control loop parameters identification, estimation, stiffness, accuracy, error analysis
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B2219/00—Program-control systems
- G05B2219/30—Nc systems
- G05B2219/37—Measurements
- G05B2219/37555—Camera detects orientation, position workpiece, points of workpiece
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B2219/00—Program-control systems
- G05B2219/30—Nc systems
- G05B2219/40—Robotics, robotics mapping to robotics vision
- G05B2219/40053—Pick 3-D object from pile of objects
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B2219/00—Program-control systems
- G05B2219/30—Nc systems
- G05B2219/45—Nc applications
- G05B2219/45063—Pick and place manipulator
Definitions
- This application relates to a picking system.
- a vision sensor attached to the upper part of the work bulk storage and to the tip of the robot, the posture and orientation of the bulk work are detected, and a pick-up device (such as , see Patent Document 1).
- a temporary placement device has been disclosed that has a deformable placement surface formed of a sheet and uniformizes the orientation of the work (for example, see Patent Document 2).
- the present application discloses a technique for solving the above-mentioned problems, and aims to obtain a picking system that can reliably hold a workpiece in an appropriate posture.
- the picking system disclosed in the present application has an imaging unit that captures images of workpieces piled in bulk, calculates the orientation of each workpiece from the imaging data acquired from the imaging unit, selects a workpiece to be picked, and grips the workpiece.
- a work posture calculation unit that determines a position and an angle; a robot that grips and takes out the selected work based on the determination by the work posture calculation unit; a chuck; a posture changing device for changing the posture of a member gripped by the robot, and when the determined gripping position and angle deviate from the set gripping position and angle, the robot shifts the gripped workpiece to the posture changing device. and, after rotating the workpiece, causing the robot to grip the workpiece again so as to match the set gripping position and angle.
- the picking system disclosed in the present application since the workpiece supplied in an uneven posture is changed to a desired angle and changed to be held, the workpiece can be reliably gripped in an appropriate posture. .
- FIG. 1 is a schematic diagram for explaining the configuration of a picking system according to a first embodiment
- FIG. 2A and 2B are side views for explaining the configuration of gripping claws having different shapes, which are attached to the tip of the robot arm of the picking system according to the first embodiment
- 3A to 3C are side views for explaining the configurations of works having different shapes, which are objects to be picked by the picking system according to the first embodiment.
- FIGS. 4A, 4B, and 4C show an assumed gripping posture for a rod-shaped work in the picking system according to the first embodiment, a state in which the work is stacked in an unexpected posture, and a state in which the work is stacked in an unexpected posture. is a side view for explaining a state in which the .
- 5A, 5B, 5C, and 5D show the gripping posture assumed for a stepped workpiece in the picking system according to the first embodiment, and the state of the workpiece stacked in a first unexpected posture.
- 10A and 10B are side views for explaining the states of the robot hand holding a workpiece in a first unexpected posture, and the state of a robot hand with respect to a workpiece stacked in a second unexpected posture.
- FIG. 6A, 6B, and 6C show an assumed gripping posture for an L-shaped workpiece in the picking system according to the first embodiment, a state of the workpieces stacked in the assumed posture, and an unexpected posture.
- FIG. 4 is a side view showing the state of stacked works.
- FIGS. 7A and 7B are schematic diagrams for explaining states in which two types of works among works to be picked by the picking system according to the first embodiment are randomly stacked on the work placement device. It is a side view.
- FIGS. 11A and 11B are schematic diagrams for explaining movements of the robot arm and the posture changing device for changing the posture of the workpiece in the picking system according to the first embodiment and the picking system according to the third modification, respectively.
- FIGS. 12A to 12C are side views for explaining areas set to determine grip positions for workpieces having different shapes, which are objects to be picked by the picking system according to the first embodiment.
- FIG. 7 is a schematic diagram for explaining the configuration of the picking system according to the first modification of the first embodiment;
- FIG. FIG. 7 is a schematic diagram for explaining the configuration of a picking system according to a second modification of the first embodiment;
- FIG. FIG. 10 is a schematic diagram for explaining the configuration of a picking system according to a third modified example of the first embodiment;
- FIG. 2 is a block diagram showing a configuration example of a part that executes arithmetic processing of the picking system according to the first embodiment
- FIG. FIG. 7 is a schematic diagram for explaining the configuration of a picking system according to a second embodiment
- FIG. 9 is a flowchart for explaining the operation of the picking system according to the second embodiment
- FIG. 11 is a schematic diagram for explaining the configuration of a picking system according to a third embodiment
- FIG. 10 is a flow chart for explaining the operation of the picking system according to the third embodiment
- Embodiment 1. 1 to 12 are for explaining the configuration and operation of the picking system according to the first embodiment.
- FIG. 1 is a schematic diagram for explaining the overall configuration of the picking system
- FIGS. 2A and 2B. 3A, 3B, and 3C are side views for explaining the configuration of gripping claws having different shapes, which are exchanged according to the shape of the workpiece and attached to the tip of the robot arm.
- FIG. 10 is a side view for explaining the configuration of a work to be picked that is different in shape from an L-shape;
- FIGS. 4A, 4B, and 4C show an assumed gripping posture for gripping a rod-shaped work corresponding to FIG. 3A in the vertical direction, and the state and sideways posture of the work stacked in an unexpected sideways posture.
- FIG. 10 is a side view for explaining a state in which a workpiece is gripped as it is.
- 5A, 5B, 5C, and 5D show a gripping posture assumed for gripping the head of a stepped workpiece corresponding to FIG.
- FIG. 4 is a side view for explaining each state of the hand;
- FIG. 10 is a schematic side view showing a state of a loaded work and a state of the work stacked in an unexpected posture with the short side facing downward, together with a robot hand.
- FIG. 7A and 7B show a state in which, of the works to be picked, a stepped work corresponding to FIG. 3B and an L-shaped work corresponding to FIG. 3C are bulk-stacked on the work placement device.
- FIG. 4 is a schematic side view shown together with a robot hand for explanation;
- FIGS. 8A to 8F are schematic diagrams for explaining general responses when the workpiece having the shape shown in FIG. 3C is placed in an attitude other than the assumed attitude.
- 8B is a side view and a perspective view showing the state of the workpiece in a certain posture.
- 8C and 8D are a side view and a perspective view showing a state in which a workpiece in a certain posture is taken out in that posture, and
- FIGS. 8E and 8F are perspective views showing the state in which the posture is changed.
- FIG. 9 is a flow chart for explaining the operation of the picking system
- FIGS. 10A to 10D show four stages of the posture change operation for changing the posture of a workpiece gripped in an unexpected posture to an assumed posture.
- FIG. 4 is a perspective view showing position and attitude movements as movements of the robot arm and the attitude changing device;
- FIG. 11A is a schematic side view for explaining the movement of the positions and postures of the robot arm and the posture changing device explained in FIGS. 10A to 10D
- FIG. 11B is a schematic side view for explaining the position and attitude movements of the robot arm and the attitude changing device corresponding to FIG. 11A in the system;
- FIG. 11A is a schematic side view for explaining the position and attitude movements of the robot arm and the attitude changing device corresponding to FIG. 11A in the system;
- FIGS. 12A to 12C are side views for explaining areas set for determining gripping positions for workpieces having different shapes corresponding to FIGS. 3A to 3C, respectively.
- Embodiment 1 will be described in detail with reference to the drawings.
- the same or corresponding parts are denoted by the same reference numerals, and the description thereof will not be repeated.
- the picking system 1 uses a robot to pick bulky workpieces for incorporation into products. Therefore, as shown in FIG. 1, the picking system 1 includes a robot 2 that selects and takes out one work 90 from a work placing device 6 such as a pallet on which a plurality of works 90 are arranged, and a posture of the gripped work 90. is provided with a posture changing device 3 for changing the Furthermore, it has an imaging unit 41 capable of acquiring a three-dimensional image of the workpiece 90 in an arbitrary area, identifies the workpiece 90 individually based on the imaging data of the workpiece 90, and calculates the attitude of the identified workpiece 90. A part 4 is provided.
- the robot 2 is a horizontal articulated robot with 5 degrees of freedom, a vertical articulated robot with 6 degrees of freedom, or a collaborative robot.
- a joint part, a base, etc. are provided.
- a flange 21 f is provided at the tip of each robot arm 21 for attaching a robot hand 22 for gripping a workpiece 90 .
- a robot control unit 23 is provided for controlling the motion of each part based on the information indicating the posture of the work 90 from the work posture calculation unit 4 .
- the robot hand 22 is connected to the flange 21f of the robot arm 21 and used as a tool for picking the workpiece 90 and the like.
- the position and motion of the robot hand 22 are controlled by the robot controller 23 .
- the robot hand 22 grips the workpiece 90 based on the control command from the robot controller 23 .
- a gripping claw 22c corresponding to the shape of the workpiece 90 is detachably attached.
- the shape of the gripping claws 22c can be freely designed, such as a dedicated shape that matches the shape of the workpieces 90 to be taken out from the bulk state, or a shape that can handle multiple types of workpieces 90. 1 is drawn assuming a rectangular parallelepiped workpiece 90, FIG. The gripping claws 22c used to grip the parts are shown, respectively.
- the imaging unit 41 three-dimensionally measures a plurality of works 90 placed in the work mounting device 6 and acquires data (imaging data) regarding the positions and orientations of the works 90 in the work mounting device 6 .
- the imaging unit 41 is, for example, a three-dimensional vision sensor, and is composed of a device capable of acquiring a three-dimensional image of the workpiece 90 in an arbitrary area.
- the work posture calculation unit 4 performs image processing on the three-dimensional image data acquired by the imaging unit 41, and transmits information to the robot control unit 23 as work position measurement data.
- the work posture calculation unit 4 may be arranged near or inside the imaging unit 41 , or may be arranged inside or inside the housing of the robot control unit 23 .
- the imaging unit 41 and the work posture calculation unit 4 must have the function of specifying the gripping position using the three-dimensional model information of the work 90 . That is, the shape of the workpiece 90 to be picked is input in advance as a three-dimensional model to the workpiece attitude calculation unit 4, and the workpiece that can be picked out from the bulk state is accurately identified and gripped from the image captured by the imaging unit 41. Any device may be used as long as it has a function of specifying a position.
- a plurality of works 90 are loaded on the work placement device 6 .
- the state in which the works 90 are loaded is roughly classified into a state in which they are aligned inside the work placement device 6 and a state in which they are stacked in bulk.
- bulk loading is defined as a state in which a plurality of workpieces 90 are not positioned, or a workpiece 90 is in contact with at least one other workpiece 90 or the inner wall 6w of the workpiece placement device 6. indicates that
- the workpiece mounting device 6 is, for example, a pallet for loading workpieces or a returnable box.
- the feature of the picking system 1 of the present application is correcting the posture of the workpiece 90 using the posture changing device 3, but before describing the features, the problem in the picking system for bulk loading will be explained.
- workpieces 90 to be picked are assumed to have various shapes.
- flat brackets, plate materials, and the like are classified as workpieces 90 such as rectangular parallelepipeds and bar-shaped workpieces 90 as shown in FIG. 3A.
- it is a screw, a hexagon socket bolt, or the like, it is classified as a workpiece 90 having a stepped portion 90s as shown in FIG. 3B.
- a sheet metal part having a bent portion, a bent wire rod, an L-shaped bracket, or the like is classified as an L-shaped workpiece 90 having a bent portion 90b as shown in FIG. 3C.
- the robot hand 22 may come into contact with the work placement device 6 when the work 90 is in an unexpected posture in which the longitudinal direction is horizontal and is in contact with the floor surface 6f of the work placement device 6. become.
- the workpiece 90 cannot be taken out in an assumed posture, and can only be taken out in an unexpected posture as shown in FIG. 4C.
- the workpiece 90 having the stepped portion 90s described with reference to FIG. 3B is to be taken out by holding the head 90t in a posture (assumed posture) in which the head 90t faces upward as shown in FIG. 5A.
- the posture of the workpiece 90 is the first unexpected one in which the head 90t is directed downward as shown in FIG. 5B, it can only be taken out in the unexpected posture as shown in FIG. 5C.
- the robot hand 22 may come into contact with the floor 6f or the inner wall 6w when picking up the work 90. Therefore, the workpiece 90 cannot be taken out in the assumed posture shown in FIG. 5A.
- the L-shaped workpiece 90 having the bent portion 90b described with reference to FIG. Suppose you want to take it out.
- the posture of the work 90 is an assumed posture in which the tip of the short arm 90g is directed upward as shown in FIG. 6B, the work 90 can be grasped at a desired position and taken out.
- the robot hand 22 is placed with the short side 90g facing the floor surface 6f as shown in FIG. The workpiece 90 cannot be taken out in the assumed posture as shown in FIG. 6A.
- the robot can pick up the workpieces 90 in the desired posture without special adjustment. It can be put into the product without changing the posture.
- it is difficult to take out the work 90 in the desired posture for the work 90 in a bulk state or the work 90 not in the desired posture. is often difficult.
- the worker has to manually align the workpieces 90 on the pallet before placing the workpieces 90 into the work area of the robot 2, which increases the cycle time of product manufacturing.
- FIGS. 8A to 8F illustrate how the L-shaped workpiece shown in FIG. 3C is changed in posture by the above method.
- the workpiece 90 taken out in the postures shown in FIGS. 8C and 8D is temporarily placed on the temporary placement table 60 in the state shown in FIGS. 8A and 8B.
- the work 90 falls due to its own weight, or if the temporary placement table 60 has a function to vibrate, the posture is changed by falling due to vibration or falling due to the operation of the robot such as bringing the robot hand 22 into contact with the work 90. It is modified as shown in FIG. 8E.
- the posture of the workpiece 90 is changed to the state shown in FIG. 8F. can do.
- the work 90 in the posture shown in FIG. 8F can be taken out in the posture shown in FIG. 6A, and it can be said that the posture of the work 90 has been changed.
- the above-described method involves repeating the picking and placing operations of the workpiece 90 by the robot multiple times, and the problem is that the cycle time required to change the attitude of the workpiece becomes longer.
- the worker manually aligns the workpieces 90 on the pallet, the attitude change is completed in one operation without switching the workpiece, so it can be said that the work is inefficient compared to manual work.
- the work 90 picked up in an unexpected posture is changed from the robot 2 to the posture changing device 3, and the work 90 is rotated so that it can be gripped in a desired posture.
- the robot 2 is made to grasp it again.
- the posture changing device 3 includes a gripping chuck 31, a gripping claw 31c attached to the tip of the gripping chuck 31, and a rotating unit 32 that rotates the gripping chuck 31. configured to work.
- a calculation unit (not shown) that calculates the posture and angle of the workpiece 90 before the posture change and a desired posture based on information from the workpiece posture calculation unit 4 .
- the grip change chuck 31 receives the workpiece 90 gripped by the robot hand 22 in an unexpected posture, changes the posture of the received workpiece 90 to a desired posture, and transfers it to the robot hand 22 .
- the rotating part 32 rotates based on the information from the work attitude calculation part 4 when the grip change chuck 31 attached to the tip thereof receives the work 90 from the robot 2, and changes the orientation of the gripped work 90 to a desired attitude. have a function.
- the rotating part 32 is, for example, a servomotor, and controls the amount of rotation of the motor based on the calculation result of the calculating part to change the orientation (angle) of the workpiece 90 . Since the robot hand 22 picks the workpieces 90 that are bulk-stacked, the workpieces 90 are often picked up in a posture other than the desired posture. On the other hand, in the picking system 1 of the present application, by changing the angle of the holding chuck 31 that receives the work 90 from the robot hand 22, the direction of the work 90 is changed, and by transferring it to the robot 2, the work 90 can be picked up in a desired posture. It becomes possible to pick the workpiece 90 .
- the rotating part 32 may receive a command from the robot control part 23 or the work posture calculating part 4, control the amount of rotation of the work 90, and have a device capable of accurately guiding the rotation. good. Furthermore, any device that includes an encoder capable of measuring the amount of rotation by the rotating portion 32 may be used.
- the work posture calculation unit 4 or the robot control unit 23 may have the function of a control unit that cooperatively controls the robot 2 and the posture changing device 3, but it is not shown as a separate system.
- a control unit may be provided.
- the image pickup unit 41 picks up an image of the work 90 bulk-loaded on the work placement device 6 (step S100).
- the work posture calculation unit 4 generates work position and posture data from the photographed image, selects the work 90 to be picked, and determines the gripping position (step S110).
- the robot control unit 23 causes the robot hand 22 to approach the workpiece 90 determined by the workpiece posture calculation unit 4 , grips the specified portion of the target workpiece 90 with the robot hand 22 , and removes the workpiece from the workpiece placement device 6 .
- Take out step S120).
- the robot 2 moves the taken workpiece 90 toward the posture changing device 3 (direction Df) (step S130).
- the gripping chuck 31 closes the gripping claws 31c and grips the workpiece 90
- the robot 2 opens the gripping claws 22c of the robot hand 22, and as shown in FIG. 31 (step S200).
- step S300 it is determined whether or not it is necessary to change the angle of the changed work 90 (step S300).
- Information output from the workpiece posture calculation unit 4 or the robot control unit 23 is used to determine whether or not the angle needs to be changed. If it is necessary to change the angle ("Yes" in step S300), as shown in FIG. 10C, rotate the rotating part 32 in the rotation direction Dr3 to change the angle (step S310), and then check whether the angle needs to be changed again. determination (step S300) is performed.
- step S400 it is determined whether or not the gripping position needs to be changed.
- Information output from the workpiece posture calculation unit 4 or the robot control unit 23 is also used to determine whether or not the gripping position needs to be changed. If the gripping position needs to be changed ("Yes” in step S400), the robot 2 rotates in the axial inclination Da2 and the rotational direction Dr22 about the axis to move the gripping claws 22c to the desired gripping position of the workpiece 90. to change the gripping position (step S410). Then, it is determined again whether or not it is necessary to change the gripping position (step S400).
- the robot hand 22 grips the workpiece 90.
- the gripping claws 22c are moved so that the work 90 can be gripped at the position where it was originally gripped in consideration of the amount of rotation by the rotating part 32, and the work 90 is moved to the desired position. Grasp at an angle.
- the flowchart of FIG. 9 shows an example in which the workpiece 90 that has been gripped at a desired position is also switched to the posture changing device 3, it is not limited to this.
- the angle and gripping position of the workpiece 90 may be determined before step S130, and if the angle and gripping position do not need to be changed, the process may proceed directly from step S120 to step S510 without changing the grip. .
- each desired gripping position is assumed to be the region R1.
- the attitude changing device 3 grips the workpiece 90 for the axisymmetric workpiece 90 as shown in FIGS. 3A and 3B. No need to change position. Therefore, the angle of the workpiece 90 can be changed by gripping either of the remaining two areas with the changeover chuck 31 to change the angle of the part and then gripping the original position again.
- the grip change chuck 31 grips the remaining area other than the area R1.
- the gripping position of the workpiece 90 can be changed by gripping the area R1 with the robot. For example, when the workpiece 90 is gripped at the region R2 and taken out from the work placement device 6, the gripping chuck 31 grips the region R3, and then the robot grips the region R1 to obtain a desired position and position. It becomes possible to pick the workpiece 90 at an angle.
- the tilt Da2 is adjusted so that the axis of the robot hand 22 is horizontal, and the workpiece 90 is transferred to the posture changing device 3, and the work 90 is received with the rotating part 32 rotated 180°, the desired posture can be obtained. It becomes possible to pick the workpiece 90 .
- the posture changing device 3 grips and rotates the workpiece 90 gripped with different postures, so that the direction and angle can be controlled to reliably correct the posture.
- the scope will be expanded. In other words, since the direction and amount of rotation are clearly corrected, the work 90 to be picked can be widened and selected quickly, and the work efficiency is improved because the correcting is performed reliably.
- FIG. 13 is a schematic diagram corresponding to FIG. 1 for explaining the configuration of the picking system according to the first modification
- FIG. 14 is a schematic diagram corresponding to FIG. 1 for explaining the configuration of the picking system according to the second modification. It is a diagram. Configurations other than the imaging section and operations other than the operations related to the imaging section are the same as those described using FIGS.
- the picking system 1 has an imaging unit 41 attached to the robot arm 21 of the robot 2 or the robot hand 22, as shown in FIG.
- the robot control unit 23 teaches in advance the imaging position of the workpiece 90 in the workpiece mounting device 6 above the workpiece mounting device 6, moves the robot 2, and displays the three-dimensional image of the workpiece 90 at the tip of the robot. is acquired by the imaging unit 41 attached to the .
- the three-dimensional image captured by the work posture calculation unit 4 is processed, work position measurement data is generated, and the data is transmitted to the robot control unit 23 .
- the imaging unit 41 moves in accordance with the movement of the robot 2, calculations for conversion of coordinates indicating the position of the workpiece 90 are required.
- the workpiece 90 can be imaged at the closest position, so the positional relationship with the robot hand 22 can be grasped more accurately.
- the picking system 1 As shown in FIG. 14, the picking system 1 according to the second modification of the first embodiment is provided with an imaging unit 41A, an imaging unit 41B, and a plurality of imaging units 41, so that the work placement device 6 can be imaged from multiple directions. It is configured as follows.
- the imaging unit 41A is attached to the robot hand 22 in the same manner as in the first modified example, and the imaging unit 41B is fixedly installed in the space above the work placement device 6 as described with reference to FIG.
- the work posture calculation unit 4 performs image processing on each of the images captured by the imaging unit 41A and the imaging unit 41B, and calculates three-dimensional work position measurement data.
- the calculated workpiece position measurement data is transmitted to the robot control unit 23 to operate the robot 2 .
- Both of these imaging units 41 are installed above the work placement device 6. One can be installed above the work placement device 6 and the other can be installed at the tip of the robot arm 21 according to the work detection conditions. is.
- two 2D vision sensors may be installed to obtain a 2D image of the workpiece 90 in an arbitrary area from two directions.
- the shape model data of the work 90 to be picked must be input in advance to the work posture calculation unit 4, and the two-dimensional vision sensor must have a function of calculating the shape of the work 90.
- FIG. it is sufficient if the work 90 that can be taken out from the bulk state can be accurately identified from the image captured by the imaging unit 41 using the calculated shape model of the work 90, and the gripping position can be specified. .
- FIG. 15 is a schematic diagram corresponding to FIG. 1 for explaining the configuration of the picking system according to the third modification.
- the configuration and operation of the posture changing device other than the direction of the rotation axis are the same as those explained with reference to FIGS. 2 to 12C or FIGS.
- the rotating part 32 of the posture changing device 3 is attached to a bracket 33, and the rotating shaft is installed so as to be parallel to the floor surface. It is what I did. Movements of the posture changing device 3, the robot arm 21, and the robot hand 22 in this case are as shown in FIG. 11B.
- the information output from the work posture calculation unit 4 or the robot control unit 23 is used to perform control in cooperation with the control of the rotation direction Dr3.
- the posture changing device 3 may be configured by another arm of the robot 2 .
- a single microcomputer 800 having a processor 801 and a storage device 802 as shown in FIG. It is also conceivable to constitute a wear.
- the storage device 802 includes a volatile storage device such as a random access memory and a non-volatile auxiliary storage device such as a flash memory (not shown). Also, an auxiliary storage device such as a hard disk may be provided instead of the flash memory.
- Processor 801 executes a program input from storage device 802 . In this case, the program is input from the auxiliary storage device to the processor 801 via the volatile storage device. Further, the processor 801 may output data such as calculation results to the volatile storage device of the storage device 802, or may store the data in an auxiliary storage device via the volatile storage device.
- Embodiment 2 In the above first embodiment, an example of controlling the operation based on the data indicating the posture of the work on the work placement device has been described. In the second embodiment, an example will be described in which the data representing the posture of the workpiece on the posture changing device is added to the first embodiment to control the motion.
- FIG. 17 and 18 are for explaining the configuration and operation of the picking system according to the second embodiment
- FIG. 17 is a schematic diagram for explaining the overall configuration of the picking system
- FIG. 3 is a flowchart for explaining the operation of .
- the configuration and operation other than the data indicating the posture of the work on the posture changing device are the same as those described in the first embodiment, and the description of the same parts is omitted, and the Figures other than FIGS. 1 and 9 are used.
- the picking system 1 according to Embodiment 2 is provided with a second imaging unit 42 arranged above or on the side of the grip change chuck 31, and captures data indicating the posture and orientation of the workpiece 90 gripped by the grip change chuck.
- the second imaging unit 42 must be composed of a device capable of acquiring a three-dimensional image of the workpiece 90, such as a three-dimensional vision sensor, and may have a structure having a plurality of imaging units.
- a three-dimensional image of the workpiece 90 after the posture is changed is acquired by the second imaging unit 42, image processing is performed by the workpiece posture calculation unit 4, and workpiece position measurement data is generated. Based on the data, the position of the robot 2 is corrected, and the part is taken out from the holding chuck 31 by the robot hand 22. - ⁇ As a result, it is possible to pick parts with higher accuracy than in the case of the first embodiment.
- step S100 the step of capturing an image of the workpiece 90 bulk-stacked on the workpiece placement device 6
- step S200 the step of transferring the gripped workpiece 90 to the grip change chuck 31
- step S210 In addition to the information output from the work posture calculation unit 4 or the robot control unit 23, the data indicating the posture obtained in step S210 is used to determine the necessity of changing the angle and gripping position of the transferred work 90. Judgment and change operation are performed (steps S300 to S410). The subsequent steps (from step S500) are the same as in the first embodiment.
- the position of the workpiece 90 can be detected using the data obtained from the second imaging unit 42, compared to the case where the posture of the workpiece 90 is changed based on the information about the amount of rotation of the rotating unit 32. It is possible to pick the workpiece 90 with higher accuracy than the above.
- the method for changing the gripping position of the workpiece 90 is the same as in the case of the first embodiment.
- the second imaging unit 42 may be installed not only above the grip change chuck 31 but also so as to capture the grip change chuck 31 from the side and generate workpiece position measurement data. Further, as in the third modification of the first embodiment, the posture changing device 3 may be provided with the bracket 33 .
- Embodiment 3 the system and method for changing the posture of a workpiece that is different from the assumed posture by using a posture changing device having a gripping chuck and a rotating part, which is taken out of a bulk state. explained about.
- Embodiment 3 an example in which the posture changing apparatus shown in Embodiments 1 and 2 is configured by a posture changing robot and the posture changing operation of a work is controlled will be described.
- FIGS. 19 and 20 are for explaining the configuration and operation of the picking system according to the third embodiment
- FIG. 19 is a schematic diagram for explaining the overall configuration of the picking system
- FIG. 3 is a flowchart for explaining the operation of . It should be noted that, except for the configuration and operation of the device related to the posture change of the work, it is the same as that described in the first and second embodiments, and the description of the same part is omitted, and the Figures other than FIGS. 1 and 9 and figures other than FIGS. 17 and 18 used in the second embodiment are used.
- an attitude changing robot 7 is provided as shown in FIG. Although only one robot arm 71 is drawn, the posture changing robot 7 is a horizontal articulated robot with 5 degrees of freedom similar to the robot 2, a vertical articulated robot with 6 degrees of freedom, or a collaborative robot. A plurality of robot arms 71, a plurality of joints, a base, and the like are provided.
- a flange 71f is provided for attaching a robot hand 72 that grips a workpiece 90.
- the posture changing robot 7 is connected to the robot controller 23 of the robot 2 . Based on the information indicating the posture of the work 90 from the work posture calculation unit 4, the position and posture of the robot hand 72 of the posture changing robot 7 are controlled by commands from the robot control unit 23. FIG.
- the robot control section of the posture changing robot 7 may have an independent robot control section and may be configured to be controlled separately from the robot 2 .
- the independent robot control section must be configured to be connected to the workpiece attitude calculation section 4 .
- the robot hand 72 is connected to the flange 71f of the robot arm 71, and serves as a tool for receiving the workpiece 90 picked by the robot hand 22 of the robot 2, changing the attitude of the received workpiece 90, and then transferring it to the robot hand 22 again. Used.
- the robot hand 72 grips the workpiece 90 handed over from the robot 2 based on a command from the robot control unit 23 .
- gripping claws corresponding to the shape of the workpiece 90 are detachably attached, such as the gripping claws 22c shown in FIGS. 2A and 2B.
- a second imaging unit 42 for acquiring imaging data for calculating the posture of the workpiece 90 after the holding movement is performed is provided above the posture changing robot 7 , and the workpiece gripped by the posture changing robot 7 is captured. It is configured so that data indicating the posture and angle of 90 can be acquired. This makes it possible to return the workpiece 90 to the robot 2 again after performing the grip-changing motion, and to determine whether or not it is necessary to perform the grip-changing motion. be possible.
- the second imaging unit 42 must be configured with a device capable of acquiring a three-dimensional image of the workpiece 90, such as a three-dimensional vision sensor, and may have a structure having a plurality of imaging units.
- step S100 the step of capturing an image of the workpiece 90 bulk-stacked on the workpiece placement device 6
- step S120 the step of gripping the target workpiece
- the robot 2 moves the workpiece 90 that has been gripped and taken out (step S120) to a position (holding position) to be transferred to the posture changing robot 7 (step S140).
- the grip-changing position is not uniquely determined, and depending on the shape and posture of the workpiece 90 taken out in step S120, the workpiece 90 does not interfere with surrounding objects and the grip-changing operation is performed appropriately.
- step S250 the gripping claws of the robot hand 72 are opened, and the gripped workpiece 90 is transferred to the robot hand 72 of the posture changing robot 7 in the same manner as described with reference to FIG. 10B.
- step S260 the data indicating the posture obtained in step S260 is used to determine whether it is necessary to change the posture of the transferred work 90 by the posture changing robot 7. It is determined whether or not (step S600). If the posture change by the posture changing robot 7 is required ("Yes" in step S600), the robot arm 71 is operated by the control command from the robot control unit 23 to change the posture of the workpiece 90 together with the robot hand 72 (step S610). Then, it is determined again whether or not the posture of the workpiece 90 needs to be changed (step S600).
- step S700 Whether or not the posture of the work has been changed to the posture (assumed posture) that can be put into the product is determined based on the imaging result of the second imaging unit 42 and the control command from the robot control unit 23 .
- step S700 If it is determined that the posture (assumed posture) that can be put into the product is not set (No in step S700), the workpiece 90 is transferred to another robot (robot 2 in the flow currently being explained) (step S710). Then, in step S600, it is determined whether or not it is necessary to change the posture, and if necessary, the posture of the workpiece 90 is changed again.
- steps S600 to S710 are repeated to transfer the workpiece 90 between the robot 2 and the posture changing robot 7, thereby changing the posture of the workpiece 90 to a desired one.
- the operation (step S510) after the posture change of the work 90 is completed ("Yes" in step S700) is the same as that in the first embodiment, and thus the description is omitted.
- the picking system 1 by transferring the workpiece 90 a plurality of times between the robot 2 and the posture changing robot 7, it is possible to carry out the holding movement of the workpiece more accurately. is.
- the grip-changing position of the workpiece 90 can be arbitrarily set within the motion range.
- the holding change chuck 31 is fixed. Therefore, if the shape or size of the work 90 is significantly changed, there is a possibility that the work 90 will interfere with surrounding objects, making it difficult to introduce the work 90 to a production site where a wide variety of works 90 are produced. be.
- the picking system 1 according to the third embodiment can solve the above problems when the shape or size of the work 90 is changed.
- both the robot 2 and the attitude changing robot 7 can put the workpiece into the product (step S510). That is, in the flow chart of FIG. 20, this is the case where "Yes” in step S600 and "No” in step S700 have never been determined from the start. step S510) can be implemented.
- the posture changing device 3 is fixed at one point in the picking system 1, so that the work input work to the product in step S510 can be performed. Can not.
- Embodiment 3 there is a possibility that the number of times the work 90 can be changed can be reduced, and it can be said that there is an effect of reducing the cycle time required for picking.
- the flowchart of FIG. 20 shows an example in which the workpiece 90 that has been gripped at a desired position is also transferred to the posture changing robot 7, it is not limited to this.
- the angle and posture of the workpiece 90 may be determined before step S140, and if the angle and posture do not need to be changed, the process may proceed directly from step S120 to step S510.
- the imaging unit 41 for imaging the workpieces 90 piled in bulk is provided, the orientation of each workpiece 90 is calculated from the imaging data acquired from the imaging unit 41, and the object to be picked is calculated.
- a workpiece 90 is selected, and the workpiece posture calculation unit 4 determines the gripping position and angle.
- a control unit for example, robot The control unit 23, the work posture calculation unit 4, the rotation unit 32, or the microcomputer 800 are provided. Therefore, the work 90 supplied in an uneven posture is changed to a desired angle and held, so that the work 90 can be surely held in a proper posture and thrown into the product.
- any posture can be easily corrected.
- the workpiece 90 to be taken out is long and the rotation axis is horizontal, interference with the floor surface 6f or the like makes it impossible to carry out the gripping operation, as long as the inclination of the rotation axis is variable. It becomes possible to change and force posture.
- a second imaging unit 42 for imaging the workpiece gripped by the posture changing device 3 is provided. If it is configured to calculate, the posture of the workpiece 90 can be corrected more accurately.
- the posture changing device described above has a robot hand 72 as a chuck that is connected to a robot arm 71 and whose position and angle can be freely controlled. If configured to be the posture changing robot 7, the posture of the work 90 can be corrected more accurately, and the number of times the work 90 is held can be reduced, thereby reducing the work time required for the holding movement. Sometimes.
Landscapes
- Engineering & Computer Science (AREA)
- Robotics (AREA)
- Mechanical Engineering (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Orthopedic Medicine & Surgery (AREA)
- Human Computer Interaction (AREA)
- Manipulator (AREA)
Abstract
Description
図1~図12は、実施の形態1にかかるピッキングシステムの構成、および動作について説明するためのものであり、図1はピッキングシステムの全体構成を説明するための模式図、図2Aと図2Bは、ワークの形状に合わせて取り換え、ロボットアーム先端に装着する、それぞれ形状の異なる把持爪の構成を説明するための側面図、図3A、図3B、図3Cは、それぞれ棒状、段付き形状、L字形状と形状の異なるピッキング対象であるワークの構成を説明するための側面図である。
第一変形例と後述する第二変形例では、撮像部の取り付けについて図1を用いて説明した例とは異なる例について説明する。図13は第一変形例にかかるピッキングシステムの構成を説明するための図1に対応する模式図、図14は第二変形例にかかるピッキングシステムの構成を説明するための図1に対応する模式図である。なお、撮像部以外の構成および撮像部に関する動作以外の動作については、図2~図12Cを用いた説明と同様であり、同様部分の説明は省略する。
実施の形態1の第二変形例にかかるピッキングシステム1は、図14に示すように、撮像部41A、撮像部41Bと複数の撮像部41を設け、ワーク載置装置6を多方向から撮像できるように構成したものである。撮像部41Aは第一変形例と同様にロボットハンド22に装着し、撮像部41Bは図1で説明したように、ワーク載置装置6の上方の空間内に固定して設置したものである。
第三変形例では、姿勢変更装置について図1を用いて説明した例とは回転軸の方向が異なる例について説明する。図15は第三変形例にかかるピッキングシステムの構成を説明するための図1に対応する模式図である。なお、姿勢変更装置の回転軸の方向以外についての構成および動作については、図2~図12C、または図13と図14を用いた説明と同様であり、同様部分の説明は省略する。
上記実施の形態1においては、ワーク載置装置上でのワークの姿勢を示すデータに基づいて動作を制御する例について説明した。本実施の形態2においては、実施の形態1に対して、姿勢変更装置上でのワークの姿勢を示すデータも加えて動作を制御する例について説明する。
上記実施の形態1および実施の形態2においては、ばら積み状態から取り出したワークを、持ち替えチャックと回転部を有する姿勢変更装置を用いて、想定とは異なる姿勢のワークの姿勢を変更するシステムおよび手法に関して説明した。実施の形態3においては、実施の形態1および実施の形態2で示した姿勢変更装置を姿勢変更用ロボットにて構成し、ワークの姿勢変更動作を制御する例について説明する。
Claims (5)
- ばら積みされたワークを撮像する撮像部を有し、前記撮像部から取得した撮像データからそれぞれのワークの姿勢を算出し、ピッキング対象のワークを選定して、把持位置と角度の決定を行うワーク姿勢算出部、
前記ワーク姿勢算出部の決定に基づいて、前記選定したワークを把持して取り出すロボット、
チャックと、前記チャックを回転させる回転部を有し、前記チャックが掴んだ部材の姿勢を変更する姿勢変更装置、および
前記決定された把持位置と角度が、設定された把持位置と角度から外れている場合、前記ロボットが把持したワークを前記姿勢変更装置に持ち替えさせ、前記ワークを回転させてから前記設定された把持位置と角度に一致するように前記ロボットに再度把持させる制御部
を備えたことを特徴とするピッキングシステム。 - 前記回転部の回転軸が、水平であることを特徴とする請求項1に記載のピッキングシステム。
- 前記回転部の回転軸の傾きが、可変であることを特徴とする請求項1に記載のピッキングシステム。
- 前記姿勢変更装置に把持されたワークを撮像する第二撮像部を有し、
前記ワーク姿勢算出部は、前記第二撮像部から取得した撮像データに基づき、前記回転させたワークの姿勢を再算出することを特徴とする請求項1から3のいずれか1項に記載のピッキングシステム。 - 前記姿勢変更装置は、前記チャックとして、ロボットアームに接続されて位置と角度の制御が自在のロボットハンドを有し、前記ロボットが取り出したワークを受け取り、受け取ったワークの姿勢を変更させる姿勢変更用ロボットであることを特徴とする請求項1から4のいずれか1項に記載のピッキングシステム。
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US18/550,391 US20240157567A1 (en) | 2021-05-06 | 2022-03-31 | Picking system |
CN202280031079.7A CN117203026A (zh) | 2021-05-06 | 2022-03-31 | 拾取系统 |
JP2023518645A JPWO2022234752A1 (ja) | 2021-05-06 | 2022-03-31 |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2021-078318 | 2021-05-06 | ||
JP2021078318 | 2021-05-06 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2022234752A1 true WO2022234752A1 (ja) | 2022-11-10 |
Family
ID=83932164
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2022/016572 WO2022234752A1 (ja) | 2021-05-06 | 2022-03-31 | ピッキングシステム |
Country Status (4)
Country | Link |
---|---|
US (1) | US20240157567A1 (ja) |
JP (1) | JPWO2022234752A1 (ja) |
CN (1) | CN117203026A (ja) |
WO (1) | WO2022234752A1 (ja) |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2015150673A (ja) * | 2014-02-19 | 2015-08-24 | セイコーエプソン株式会社 | 制御装置、ロボット、ロボットシステムおよび制御方法 |
JP2020034526A (ja) * | 2018-08-31 | 2020-03-05 | 株式会社トキワシステムテクノロジーズ | ワークの位置姿勢認識装置およびピッキングシステム |
-
2022
- 2022-03-31 WO PCT/JP2022/016572 patent/WO2022234752A1/ja active Application Filing
- 2022-03-31 US US18/550,391 patent/US20240157567A1/en active Pending
- 2022-03-31 JP JP2023518645A patent/JPWO2022234752A1/ja active Pending
- 2022-03-31 CN CN202280031079.7A patent/CN117203026A/zh active Pending
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2015150673A (ja) * | 2014-02-19 | 2015-08-24 | セイコーエプソン株式会社 | 制御装置、ロボット、ロボットシステムおよび制御方法 |
JP2020034526A (ja) * | 2018-08-31 | 2020-03-05 | 株式会社トキワシステムテクノロジーズ | ワークの位置姿勢認識装置およびピッキングシステム |
Also Published As
Publication number | Publication date |
---|---|
JPWO2022234752A1 (ja) | 2022-11-10 |
US20240157567A1 (en) | 2024-05-16 |
CN117203026A (zh) | 2023-12-08 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP5304469B2 (ja) | ビンピッキングシステム | |
JP5272617B2 (ja) | ロボット装置及びロボット装置の制御方法 | |
JP5685027B2 (ja) | 情報処理装置、物体把持システム、ロボットシステム、情報処理方法、物体把持方法およびプログラム | |
US20160332299A1 (en) | Object pick-up system and method for picking up stacked objects | |
CN102642201B (zh) | 工件拾取系统 | |
JP5522298B2 (ja) | ビンピッキングシステム | |
WO2013002099A1 (ja) | 部品供給装置 | |
CN109952178B (zh) | 作业机器人及作业位置修正方法 | |
JP2012030320A (ja) | 作業システム、作業ロボット制御装置および作業プログラム | |
JP6897396B2 (ja) | 制御装置、ロボットシステムおよび制御方法 | |
JP2007122705A (ja) | 溶接教示位置補正システム及びキャリブレーション方法 | |
JP2012135820A (ja) | 自動ピッキング装置及び自動ピッキング方法 | |
JP6665450B2 (ja) | ロボット、制御装置、及びロボットシステム | |
JP5458807B2 (ja) | 対象物把持領域抽出装置および対象物把持領域抽出装置を用いたロボットシステム | |
WO2022234752A1 (ja) | ピッキングシステム | |
JP3328414B2 (ja) | ロボットハンドの姿勢制御装置 | |
CN113492401B (zh) | 校正方法 | |
JP2021094634A (ja) | ワーク給除材システム、可搬型ロボット装置及び可搬型ワークストッカ | |
WO2023032400A1 (ja) | 自動搬送装置、及びシステム | |
WO2022195944A1 (ja) | ロボットシステム、およびロボットシステムの制御方法 | |
WO2018088199A1 (ja) | ロボット制御装置、ロボット、ロボットシステム、及び、ロボット制御方法 | |
JPH08224623A (ja) | ロボットのワーク把持動作制御装置 | |
CN114939865B (zh) | 校准方法 | |
WO2024135220A1 (ja) | ロボット制御システム | |
JPH04372389A (ja) | ワーク取上げハンド |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 22798859 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2023518645 Country of ref document: JP Kind code of ref document: A |
|
WWE | Wipo information: entry into national phase |
Ref document number: 18550391 Country of ref document: US |
|
WWE | Wipo information: entry into national phase |
Ref document number: 202280031079.7 Country of ref document: CN |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 22798859 Country of ref document: EP Kind code of ref document: A1 |