EP3934857A1 - Verfahren zum betrieb eines antriebssystems sowie antriebssystem - Google Patents
Verfahren zum betrieb eines antriebssystems sowie antriebssystemInfo
- Publication number
- EP3934857A1 EP3934857A1 EP20709141.4A EP20709141A EP3934857A1 EP 3934857 A1 EP3934857 A1 EP 3934857A1 EP 20709141 A EP20709141 A EP 20709141A EP 3934857 A1 EP3934857 A1 EP 3934857A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- end effector
- target
- pose
- image
- drive system
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J9/00—Programme-controlled manipulators
- B25J9/16—Programme controls
- B25J9/1679—Programme controls characterised by the tasks executed
- B25J9/1692—Calibration of manipulator
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B2219/00—Program-control systems
- G05B2219/30—Nc systems
- G05B2219/39—Robotics, robotics to robotics hand
- G05B2219/39045—Camera on end effector detects reference pattern
Definitions
- the present invention relates to a method for operating a drive system according to patent claim 1, a drive system for executing such a method according to patent claim 14 and a computer program product with a program code for executing such a method according to patent claim 15.
- drive systems have been used for a long time to relieve people of mechanical work or at least to make them easier for them.
- two members of the drive system can be moved relative to one another.
- Several drives and links which can also be referred to as axes, can be combined to form multi-link or multi-axis drive systems, which carry out multi-dimensional movements and correspondingly more complex movement sequences or can follow trajectories.
- Such drive systems can also be referred to as mechatronic systems.
- the position of a link is understood to be the location within a Cartesian coordinate system at which the link is located in a geometric space. Positioning a limb is understood to mean occupying a specific spatial location. Orientation of a link is understood to mean the orientation of the link to the axes of a Cartesian coordinate system. Taking an orientation of a link means changing the current orientation of the link by rotating it around the corresponding axes of a Cartesian coordinate system into a desired orientation. Position and orientation can be referred to collectively as a pose or a configuration.
- a trajectory of a link or an end effector is a movement of the link or the end effector in space along a path, taking into account its chronological sequence. A trajectory can also be called a trajectory. The path can also be called a path.
- Electric motors which can convert the relative movement either directly or, for example, via gears, are usually used as drives for such drive systems.
- drives for such drive systems.
- translatory and rotational movements can be carried out, which can be used in combination with one another within the drive system.
- Such drive systems can For example, they can be used in industry, in particular to take on tasks in assembly, production, logistics, and packing and picking of goods.
- the drive system can be referred to as an automation system or a robot.
- Articulated arm robots in particular are widespread in industry.
- An articulated arm robot is usually a 6-axis drive system with a spherical work area, which is why articulated arm robots can be used very flexibly.
- the tool that serves as the end effector can be changed.
- the programming of the Articulated Arm robot has to be adapted to the application.
- the articulated arm robot itself can be used unchanged, which can make it very adaptable.
- robots with fewer than six axes are also known, which can take correspondingly fewer poses in the work area, but are simpler and cheaper, e.g. can be implemented in that fewer drives have to be used, operated and controlled or regulated.
- These drive systems can e.g. can also be used to carry out charging processes in electrically operated vehicles such as, in particular, land vehicles such as e.g. Carry out buses, trucks and passenger vehicles.
- electrically operated land vehicles have hitherto had the major disadvantage of the comparatively short range, which essentially results from the weight, from the size and from the costs of the accumulators as rechargeable electrical energy stores.
- the capacity of the electrical storage could be increased.
- numerous electrically operated land vehicles have been equipped with rechargeable electrical energy storage devices with comparatively low capacity, which reduces their range but can save weight, space and costs. So far, this can be more important for a customer's purchase decision than the range of the vehicle.
- the vehicle can e.g. At home overnight, during working hours at work or while shopping in a parking garage, they can be connected to an electrical charging station located there, in order to use any interruption in use to recharge.
- Corresponding drive systems can be used in parking garages and the like to automatically connect the electric charging station to the vehicle's charging port by means of its charging plug and also to separate it again automatically.
- sensors are required to usually determine the relative position for each drive in translatory movements and with rotational movements to detect the relative orientation or angular position of the two members, which are movably connected to one another by the drive; these sensors can be referred to as position sensors regardless of whether a position in the translatory direction or an angular position in the rotary direction is to be detected.
- the poses of the individual drives and members to one another and to a reference coordinate system or to a base that is fixed relative to the members can be determined from these recorded position or angle information from the position sensors via the known kinematic structure of the drive system.
- an outermost, last link of the drive system which within the kinematic structure, which e.g. in the case of an articulated arm robot can also be referred to as a kinematic chain, is arranged farthest away from the fixed base and can usually be referred to as an end effector in robots and in particular in articulated arm robots.
- the end effector or its member of the kinematic structure can e.g. have a gripper which by means of the drive system can be positioned and / or oriented with respect to the base, e.g. Tasks in production, assembly, storage, packing and commissioning, transport and the like can be performed.
- the end effector can grip a charging connection or a charging connection receptacle with its gripper or can itself be designed as a charging connection or as a charging connection receptacle.
- switching off at least the position sensors may mean that the positions or angular positions of the individual members are unknown when the drive system is switched on again, since the last ones recorded relative information has been lost when the drive system or its position sensors are switched off. Should the last recorded relative position or angle information have been saved, it cannot be ruled out that e.g. The position of the members and thus also the position of the sensor elements of the relative measuring position sensors to each other was changed by forces or moments from outside the drive system when the drive system was switched off, which could not be detected by the position sensors when switched off.
- the drive system when the drive system is switched on, the limbs would assume a different pose than is actually assumed, which can lead to errors in the movements of the drive system and in particular to collisions with other objects such as other objects or even people.
- the drive system can have been moved into a so-called home position before being switched off, in order to be switched off in a known, predetermined position and put back into operation later.
- this pose can e.g. have been changed by touching a user in the switched-off state, so that the drive system assumes the home position as the pose when the new operation starts, but actually another random pose is assumed, so that trajectories emanating from this changed pose do not lead to the ge desired positioning and orientation of the end effector.
- a charging connection cannot usually be successfully inserted into the correcting charging connection receptacle of a vehicle. Rather, this can lead to a collision of the charging plug e.g. with the body of the vehicle.
- the link to be referenced is moved by the corresponding drive in a predetermined direction until a standstill is reached and / or a specified force or a specified torque is reached or exceeded.
- This can be recognized by the control unit of the drive system, for example, via a resulting increase in the current intensity of the corresponding electric drive and assessed as reaching the known reference position or reference angular position, so that the movement of the drive ends and the position sensor is set to the current position or angular position as Reference pose can be set up.
- a disadvantage of such relatively sensing sensors can be that referencing such as e.g. previously described is necessary at all. This can delay the start of operation of the drive system after an interruption in operation.
- the referencing function described above must also be provided, which e.g. can cause additional work when programming the drive system.
- limit switch sensors can be used against which the reference movement can be carried out as described above. With these additional sensors a contact of the respective link can be recognized and this can be assessed as reaching the known reference position or reference angle position. Blockages of the movement of the limb into the reference position, as previously described, can therefore no longer lead to an incorrect detection of a reference position which is actually not assumed at all.
- Another disadvantage in this case is that a further sensor with appropriate cabling must be used per link, which, in addition to the additional costs of the absolute encoder, can also lead to additional cabling costs and additional assembly costs. Furthermore, the referencing can also be carried out if an absolute encoder fails, e.g. by damage to the sensor itself as well as e.g. can no longer be executed in the event of a cable break.
- An object of the present invention is to provide a drive system of the type described at the outset, so that the detection of the position or the angular position of at least one link can be simplified and / or improved. This should preferably be done as inexpensively as possible and / or without additional technical devices such as in particular without additional position sensors and in particular without absolute value encoders. In particular, the detection of the position or the angular position of the member when the drive system or its position sensors are switched on is to be simplified and / or improved.
- the present invention thus relates to a method for operating a drive system, preferably a robot, the drive system having:
- At least one image acquisition unit which is arranged and aligned on the end effector or independently of the end effector, to capture the end effector in a target-target pose.
- a base is to be understood as an element of the drive system against which the end effector can be moved via at least one drive.
- This mobility can be either rotary or linear.
- the drive system can have several drives, which che are connected to each other via at least one link.
- This enables an activated kinematic chain to be implemented between the end effector and the base, which can give the end effector more options for positioning and orientation than with just one drive.
- Several parallel kinematic chains can also be used, for example in the form of parallel kinematics.
- a single drive, ie a single degree of freedom, of the end effector relative to the base may be sufficient to implement the present invention.
- optical image acquisition can take place starting from the end effector.
- the image capturing unit can preferably be aligned in such a way that the area directly in front of the end effector can be captured by the image capturing area of the image capturing unit.
- an optical image acquisition can take place from a point which is independent of the end effector, i.e. that the end effector can be positioned and aligned independently of the optical image capture unit.
- the imaging unit located there does not carry out the movements of the end effector and can therefore, with appropriate alignment relative to the end effector, detect this when the end effector is in a target-target pose, which will be described in more detail below.
- the optical image acquisition unit can be arranged on a member of the drive system which is movable relative to the end effector.
- the optical image acquisition unit can also be at the base or at a location such as e.g. be arranged on a wall on which the base is arranged.
- the image acquisition unit can preferably be a camera and in particular a stereo camera pair or a mono camera. This can enable the implementation of an optical image acquisition in a comparatively cost-effective manner. If two cameras with low resolution, e.g. If CCD cameras are used, this can be implemented particularly inexpensively.
- the image processing can also be implemented with comparatively little computer power.
- Using a stereo camera pair for this purpose can offer the advantage that stereoscopic image capture can be made possible, so that depth information can be obtained from the captured images. This can enable the determination of depth information from two images recorded at the same time, which are at least essentially oriented in the same direction but spatially borrowed are offset from each other. Taking into account the depth information, a significantly more precise and robust depth estimate and thus also a more precise determination of the pose of an object in the captured image can be carried out than when evaluating just a single image.
- a mono camera can not enable the acquisition of depth information at all or only with an increased effort for image processing and pattern recognition, but for this it can be simpler and / or more compact in terms of design and size. This can lead to lower costs.
- the evaluation of the captured image data can also take place more easily and quickly, which can save computing power. For these reasons, it may be preferable to use a mono camera over a stereo camera.
- the method according to the invention can be carried out with at least the following steps:
- the target-target pose is predetermined so that a predetermined object or the end effector can be captured by the image capture unit
- the method according to the invention serves to approach a target target pose of the end effector by means of its drive so that either the predetermined object or the end effector can be optically captured as an actual image from this target target pose by the image acquisition unit .
- the captured actual image can then be compared with a target image, so that a statement can be made as to whether or not the actual image matches the target image. If there is a match between the actual image and the target image, the target-target pose was correctly approached and assumed and the actual target pose corresponds to the target-target pose, i.e. the supposed target-target pose corresponds to the actual target-target pose.
- different reactions can be carried out.
- the present invention is based on the knowledge that an actual target pose of an end effector, which was approached according to a predetermined target target pose, does not have to correspond to the actual target target pose.
- This deviation can be based on external circumstances, such as, for example, externally acting forces or moments as well as blockages in the trajectory and the like.
- There may also be, for example, inaccuracies in the control or regulation, play in the bearings the drives and / or joints, damage and soiling of the image capture unit as well as inaccuracies in the sensory position detection on a deviation between a target trajectory or target target pose and an actual trajectory or an actual target pose effect, which can be reflected accordingly in an actual target pose, which supposedly corresponds to the target target pose, but actually deviates from it.
- an image acquisition unit of the drive system can be used according to the invention.
- the actual image can be captured by the drive system without additional expenditure on components and cabling.
- an image acquisition unit which can usually be procured and used inexpensively, can be provided in a stationary manner to the end effector, as described above, in order to enable an alternative implementation of the present invention.
- the actual image and the target image are compared with one another, which can be done with known methods for image processing and / or pattern recognition, then there must be a match, provided that the target-target pose of the end effector matches the actual actual target The end effector's pose corresponds. In this case, by comparing the actual image and the target image, a correspondence between the target-target pose and the actual target-target pose can be confirmed. Otherwise, deviations can be detected and a response can be made. The response to an appropriate match can be different than to a non-matched match.
- any optically detectable object can be used as the object of which an actual image and a target image are viewed, which object is located in the target-target pose in the image acquisition area of the image acquisition unit.
- This object can lie partially or completely outside the drive system.
- part of the drive system itself such as its base, can also be used as an object.
- the drive system, and in particular its base can also have at least one marking, which is preferably optically particularly characteristic and can therefore be optically particularly easy and reliable to identify.
- Any image acquisition method that is suitable for this purpose depending on the application and configuration of the object can be used to acquire the actual image.
- the end effector itself can also be considered.
- the respective actual target pose can be compared for its correspondence with the target target pose of the end effector.
- This can be done for Reference poses, home poses and intermediate poses can be used along a trajectory of the end effector, as will be described in more detail below.
- the reactions can in particular be a continuation of a movement or the execution of a movement from the current actual target pose. If they do not match, a new referencing or an initial referencing can take place. Messages and information can also be issued to the user and other devices and, for safety reasons, the operation of the drive system can be terminated or at least interrupted.
- the method has at least the further steps before starting:
- the end effector is moved into the target target pose by means of its drives, which in this case can be verified as the actual target pose by a user, for example. This can be done on the part of the user by checking the recorded actual image, by checking recorded measured values, by using further external sensor means and the like.
- the target image can then be stored in the drive system for further use.
- the target image can also be referred to as a reference image.
- the target target pose of the end effector is approached by means of the drive, the actual target pose is verified as a target target pose, an image of the predetermined object or the end effector is captured by means of the image acquisition unit in the target-target pose and saving the captured image as a target image when the drive system is started up.
- the commissioning can in particular be an initial commissioning. Such commissioning is usually carried out by a person who is appropriately trained and trained for this purpose. A reliable check can therefore be made in this way as to whether the actual target pose of the end effector corresponds to the target target pose of the end effector and can be stored accordingly as a target image or as a reference image.
- the method according to the invention can thus be started on the basis of a target image of the actual target target pose.
- This target image can be valid for all further embodiments of the method according to the invention.
- a single target image is usually stored here. However, several target images can also be stored which, for example, were recorded at different times of the day or year and can be used, for example, to take into account different illuminations of the object or the end effector in the target-target pose. Several target images can also be recorded in a situation and averaged to form a single target image in order to compensate for smaller deviations in the lighting conditions.
- a new, current target image can also be created and saved as a reference image for every start-up that is carried out under the supervision of a person in order to take into account changes and, in particular, soiling and fading of the object or the end effector and thereby the quality to improve or maintain comparisons.
- the method has at least the further step before starting:
- the target image can thus also be specified by a predetermined target image instead of a target image verified in the actual target target pose.
- a predetermined target image can be recorded, for example, independently of the place of use of the drive system, for example in a laboratory of the manufacturer of the drive system, and stored in the drive system in a generally valid manner.
- artificially create such a predetermined target image e.g. to be generated by means of computer software and to be generally stored in the drive system. This can be done, for example, using a rendered target image. In such cases, one can speak of a factory setting, since the predetermined image can be specified as the target image regardless of the location of the drive system. This can simplify the specification of the predetermined image.
- the desired target pose of the end effector is a reference pose of the end effector.
- a reference pose is understood to mean a pose of the drive system in which the drive system is referenced. Starting from such a reference position, all further movements and in particular trajectories of the drive system can be predetermined in order to be able to start from a uniformly defined and known reference point.
- the reference point is to be understood in the sense of a landmark as a point or area to which a spatial description is based.
- This reference pose is of correspondingly great importance for the use of the drive system, since if the start pose of a path deviates from the Reference pose, the actual trajectory can also deviate from the target trajectory and thereby, for example, cause collisions with other devices or users.
- the inventive method can be used to record the actual image of the predetermined object in the supposed reference pose of the end effector and to compare this with the desired image of the reference pose. This allows the alleged reference pose to be verified against the actual reference pose in accordance with the target image as the reference image. If they match, a successfully referenced drive system or end effector can then be assumed and the trajectories can be traversed. If they do not match, a new referencing can take place, for example, which can be checked again according to the method according to the invention.
- the target-target pose of the end effector is a home pose of the end effector.
- a home pose is understood to be a pose of the end effector, which can be viewed as a general start pose from which the movements or trajectories are usually carried out starting.
- the home pose usually deviates from a reference pose, but can also coincide with this. While the reference pose is only assumed for referencing, the home pose is usually assumed after the completion of a trajectory and in particular before the drive system is switched off or shut down. In this way, the home pose is intended to ensure that the same pose can always be assumed at the start of operation and in particular at the start of trajectories.
- the home pose is also of particular importance when operating the drive system, since, as previously described for the reference pose, the accuracy of the home pose can also affect the accuracy of the movements and trajectories emanating from it. If a supposed home pose is verified as an actual home pose by the method according to the invention, then this pose can be used to execute movements of the drive system. If a mismatch is found, this should be avoided. Instead, the drive system can be referenced again, which, as described above, can also be checked according to the invention. The successfully referenced drive system can then be moved into the home pose again, which can be verified again according to the inventive method. This can improve the operational safety of the drive system.
- the method has at least the further step:
- the desired target pose of the end effector is an intermediate pose within a trajectory of the end effector.
- An intermediate pose is understood to mean a pose of the trajectory that lies between a start pose and an end pose of the trajectory.
- the trajectory can be interrupted by the end effector at the intermediate point and an image of the predetermined object can be captured there, as described above.
- a check can be made as to whether or not the trajectory was successfully followed by the drive system at least until the intermediate pose was reached. If this is determined by a match between the desired image and the actual image in the intermediate pose, the trajectory can be continued. Otherwise, the end effector can, for example, be moved back into the start pose and the trajectory can be started again. If necessary, the end effector can also be referenced in between in order to improve the accuracy of the trajectory during the subsequent movement.
- the predetermined object is, at least in sections, the base and / or a marking, preferably the base, and / or an object to be approached by means of a trajectory.
- This aspect of the present invention is based on the knowledge that the predetermined object to be captured by means of the image capture unit can differ depending on the application in terms of the way in which a pose is to be checked for correctness or accuracy.
- the predetermined object can be partially or completely the base, the marking or the object to be driven.
- the predetermined object it will usually be expedient for the predetermined object to include at least part of the drive system and / or at least part of the surroundings of the drive system, since these can be viewed as unchangeable and thus as reference objects for verifying a reference -Pose or a home pose.
- the base itself can preferably be used, since the end effector is moved relative to the base via the drive and the base not only has a fixed reference point or reference point for the kinematics of the drive system, but also for capturing the actual image or target image. can represent a landmark.
- the base can, for example, on the basis of its contour, its color, its shape, its patterning or at least one marking attached to it, be so clearly or easily recognizable in the actual image that it can be used to compare the actual image and the target image.
- Image can be particularly suitable.
- a marking which can preferably be arranged on the base but also in its surroundings, allows the respective pose to be checked as clearly as possible from the actual image and the target image.
- the marking can be a reference marking or a start marking or a home marking.
- the step of comparing the actual image of the predetermined object with the desired image of the predetermined object can be improved by a distinctive design of the base and / or by a marking to be used. This can improve the execution of the method according to the invention and in particular the result of the comparison.
- the triggering triggers at least one of the following reactions if the comparison of the actual image of the predetermined object or of the end effector with the target image of the predetermined object or of the end effector leads to a mismatch:
- Renewed referencing of the end effector can be useful or necessary in particular if the target-target pose is a reference pose which, however, was actually not taken. This can lead to the referencing being carried out again with the aim of achieving successful referencing.
- the operation of the drive system can preferably be interrupted and the user can be informed, for example via a display on a display device, that operation of the drive system does not appear to be possible at this point in time due to referencing that has not been carried out successfully several times.
- Corresponding information can also be passed on to other devices that can interact with the drive system, for example, or depend on their functionality, for example in subsequent production steps, in order to also inform them that the drive system is currently operating due to a lack of successful referencing appears not possible. A user can then investigate the reason why referencing could not be carried out successfully and eliminate the cause and / or initiate other measures.
- An initial referencing can also be carried out in this way, preferably considered after an interruption in the operation of the drive system. This can be useful or necessary, for example, if the examination of an alleged flome pose led to the result that the home pose is actually not taken at all. While the drive system could have been operated directly from a home pose actually taken, in this case referencing of the drive system should be initiated so that the home pose can be approached again and verified again. A user or other subsequent devices can also be informed about this additional effort, which in particular requires time, as described above. This applies in a comparable way to an intermediate pose within a trajectory of the end effector, which could also not be successfully verified. In this case, too, referencing the drive system can be beneficial in order to be able to run the trajectory of the end effector again from an improved start pose.
- These possible reactions in the event of a mismatch between the actual image and the target image also include canceling or interrupting the operation of the drive system, as already mentioned in some cases. This can ensure that, for example, possible damage to the drive system, which can lead to a mismatch between the actual image and the target image, does not continue and may affect other components of the drive system or the environment. Rather, it can be helpful at this point to replace the drive system from a Let the user investigate what reason the actual image and the target image could not match. The cause can be eliminated by the user and / or other measures can be initiated in order to then resume operation of the drive system.
- an indication of the mismatch can be output to a user in the form of a message, for example via an optical output device such as a monitor.
- an optical output device such as a monitor.
- Such a notice can additionally or solely be given optically by a warning signal or the like.
- Such a notice can also be given, particularly in the case of a smartphone, by triggering a vibration function.
- the attention of the user can be obtained via the notification that a mismatch between the actual image and the target image was recognized according to the method according to the invention in order to at least inform the user of this and, if necessary, to initiate his intervention, as before already mentioned.
- the output of an indication of the mismatch to at least one other device can ensure that a user can be relieved of having to transmit the information received from the drive system to other devices himself. This can be useful in particular in the case of a cooperating production process in which the drive system under consideration is integrated.
- the triggering triggers at least one of the following reactions if the comparison of the actual image of the predetermined object or of the end effector with the target image of the predetermined object or of the end effector leads to a match:
- the operation of the drive system can be continued as intended.
- this can be the departure of a predetermined trajectory of the end effector, which can preferably begin from a reference position or a home position.
- a trajectory of the end effector can be continued after the method according to the invention has verified that an intermediate pose within the trajectory has been successfully approached by the end effector up to that point. Further Rea- options can result from the respective application.
- the reference pose and the home pose can also coincide and be identical.
- the drive is designed to relatively detect a position or an angular position between its drive side and its output side.
- This aspect of the present invention is based on the knowledge that relatively detecting position sensors are often used due to their comparatively low cost, for example in drive systems considered in this way as described at the beginning. Due to their relatively working position or angle determination, however, it is always necessary to reference the relatively ar processing position sensor when starting operation. For the successful operation of the drive system, it is crucial, as described at the beginning, that the referencing is carried out successfully.
- a home pose can also be assumed before the operation of the drive system is interrupted. However, due to the interruption of the operation of the drive system, the referenced position or angle detection of the relatively operating position sensor is lost. Thus, when such a drive system starts operating, it is necessary to move it from the home pose into the reference pose in order to carry out a new referencing there, as described above. However, if, according to the invention, the home pose, which should actually be present when restarting operation, can be verified according to the invention by comparing the actual image and the target image, the additional referencing step can be dispensed with and the drive system can be operated directly the home pose can be run out. This can save time for operating the drive system.
- the drive system has a linear drive, which is designed, the base against a substrate, preferably against a Move the wall, preferably vertically.
- a linear drive which is designed, the base against a substrate, preferably against a Move the wall, preferably vertically.
- the drive system can be moved with its base on a wall, in particular vertically in the fleas.
- the end effector can be designed to be moved by the drive and the links in the horizontal plane relative to the base. This can enable comparatively simple kinematics of the drive system, since comparatively few drives and links have to be used to carry out a horizontal movement of the end effector.
- the three-dimensional mobility of the end effector can then be achieved via the relative mobility of the base in relation to the wall.
- an end effector with or as a charging plug relative to a charging socket of an electrically driven vehicle can be sufficiently positioned and oriented within a certain working space in order to carry out the charging process.
- the present invention also relates to a drive system for carrying out a method as described above with a base, an end effector, at least one drive which movably connects the end effector to the base, and at least one image acquisition unit which is arranged on the end effector.
- a drive system of this type can be used to implement the previously described method according to the invention in order to be able to implement its properties and advantages.
- the drive system can have a control unit which can carry out the method steps described above.
- the control unit can also receive the sensor queries required for this, for example from the drive and the image acquisition unit.
- the control unit can also operate the drive and the end effector or the image acquisition unit.
- the present invention also relates to a computer program product with a program code, which is stored on a medium that can be read by a computer, for carrying out a method as described above.
- the computer readable medium may include internal memory of a computer as well as removable memory such as e.g. be a floppy disk, a CD, a DVD, a USB stick, a memory card and the like.
- removable memory such as e.g. be a floppy disk, a CD, a DVD, a USB stick, a memory card and the like.
- FIG. 1 shows a schematic plan view of a drive system according to the invention according to a first exemplary embodiment
- FIG. 2 shows a schematic top view of the drive system of FIG. 1 when checking a reference pose in a first representation
- FIG. 3 shows a schematic top view of the drive system of FIG. 1 when checking the reference pose in a second representation
- FIG. 4 shows a schematic top view of the drive system of FIG. 1 when checking a flome pose in a first representation
- FIG. 5 shows a schematic plan view of the drive system of FIG. 1 when checking the home pose in a second representation
- FIG. 6 shows a schematic top view of a drive system according to a second exemplary embodiment when checking a reference pose in a first representation
- FIG. 7 shows a schematic top view of the drive system of FIG. 6 when checking the reference pose in a second representation
- FIG. 8 shows a schematic top view of the drive system of FIG. 1 when checking an intermediate pose of a trajectory in a first representation
- FIG. 9 shows a schematic top view of the drive system of FIG. 1 when checking the inter mediate pose of a trajectory in a second representation
- FIGS. 10 shows a flowchart for executing a method according to the invention for implementing the checks of FIGS. 2 to 7.
- a longitudinal direction X extends, which can also be referred to as depth X.
- a transverse direction Y which can also be referred to as width Y, extends perpendicular to the longitudinal direction X.
- a vertical direction (not shown), which can also be referred to as the height, extends perpendicular to both the longitudinal direction X and the transverse direction Y.
- Fig. 1 shows a schematic plan view of an inventive drive system 1 according to a first embodiment.
- the drive system 1 under consideration can be referred to as a robot 1 and, in particular, as an articulated arm robot 1.
- the robot 1 could also be referred to as a manipulator 1 who the.
- the robot 1 represents a charging device 1.
- the drive system 1 could also be an automation system 1.
- the robot 1 is designed as a charging device 1 in the case under consideration essentially in the horizontal plane, which is spanned by the transverse direction Y and the longitudinal direction X.
- the robot 1 has a base 10 in which a control unit 16 of the robot 1 is arranged.
- the control unit 16 can also be referred to as a computer unit 16 and can be used to carry out, for example, the method according to the invention according to the flowchart in FIG. 10.
- the robo- ter 1 is arranged on the part of its base 10 via a linear drive 17 in height (not shown) on a substrate 3 in the form of a wall 3.
- the robot 1 also has three drives 12 in the form of actuated swivel joints 12.
- Two links 11, which can also be referred to as axles 11, are arranged between the three actuated swivel joints 12.
- One of the three actuated swivel joints 12 is arranged between the two links 11.
- Another actuated swivel joint 12 is arranged between one of the links 11 and the base 10.
- the third actuated swivel joint 12 is arranged at the end of the other link 11 and has an end effector 13 on the output side, which, due to the use of the robot 1 as a charging device 1, is designed as a charging plug 13, but alternatively also designed to grip, hold and guide a charging plug 13 could be.
- the image capturing unit 14 points with its image capturing area A in the direction in which the charging plug 13 as the end effector 13 is pointing.
- a marking 15, 15a, 15b represents a reference marking 15a, the function of which will be explained in more detail below.
- a further marking 15, 15a, 15b in the form of a start marking 15b is arranged next to it, which can also be referred to as a home marking 15b.
- the function of the home marker 15b will also be explained in more detail below. Only a single marking 15, 15a, 15b can be used, which can be used both as reference marking 15a and as start marking 15b or as home marking 15b (not shown).
- While the linear drive 17 has an absolute encoder (not shown) in order to be able to detect the position of the base 10 in height relative to the wall 3 without the need for referencing at any time and thus also after an interruption in operation or after the robot 1 has been switched off actuated swivel joints 12 only equipped with relatively operating position sensors (not shown) for reasons of cost.
- the position sensors of the actuated swivel joints 12 are each designed to detect an angular position between the drive side and the output side of the respective actuated swivel joint 12, which can be made available to the control unit 16.
- FIG. 2 shows a schematic top view of the drive system 1 of FIG. 1 when checking a reference pose in a first representation.
- Fig. 3 shows a schematic plan view of the drive system 1 of FIG. 1 when checking the reference pose in a second representation.
- the end effector 13 with its image capturing unit 14 is aligned with the reference marking 15 a, so that it lies in the image capturing area A of the image capturing unit 14.
- This pose corresponds to the reference pose of the robot 1. If the links 11 or the actuated swivel joints 12 and the end effector 13 assume this reference pose, the robot 1 can be referenced. Starting from this reference pose, all further movements and trajectories of the robot 1 can be carried out, since the relatively measuring position sensors detect the angular positions of the actuated swivel joints 12 based on their respective angular position, which is assumed in the reference pose. Accordingly, it follows the control or operation of the robot 1 on the part of the control unit 16 based on the sen relative angular positions.
- this is applied to the intended application of FIGS. 2 and 3 in such a way that when the robot 1 is started up, in which the robot 1 is mounted on the wall 3 by a service technician, electrically closed as well as being put into operation for the first time, in a step 100 an approach to the reference pose is carried out as the desired target pose of the end effector 13.
- the service technician can, for example, ensure that the actual reference position is assumed. be verified by viewing the pose of the robot 1 in a step 150.
- an image of the reference marking 15a can now be captured by means of the image capture unit 14.
- the captured image can be stored as a target image or as a reference image in a further storage step 300 in the control unit 16. In this way, when the robot 1 is started up for the first time, the preparation can take place in order to be able to carry out the method according to the invention while the robot 1 is in operation.
- a predetermined image can also be saved as a target image beforehand.
- This predetermined image can, for example, be a representation of the reference marking 15a in front of a neutral, for example white, background or the like.
- the reference marking 15a can also be used in a pictorial representation instead of as a captured real image. In this way, it is possible to dispense with the effort of capturing a target image as a reference image in front of the application environment through the initial start-up, as described above.
- the generally valid predetermined image can contain less information. hold, which result for the place of application of the robot 1 in particular from the lighting conditions and can be present in a captured real image.
- the end effector 13 can move to the reference position as the target-target pose.
- an image of the reference marking 15a can now be captured by the image capturing unit 14 in a step 700.
- the captured image can be compared as the actual image in a step 800 with the target image of the reference marking 15a. It is not necessary here to compare the entire recorded actual image with the entire target image, but it can be sufficient to provide sufficiently distinctive information, such as the reference marking 15a, but also the contour, color, etc. of the base 10, which forms the background of the reference mark 15a, can be viewed in the respective images.
- the result of the comparison 800 can be that the reference markings 15a in the actual image and in the target image correspond sufficiently with regard to their size, positioning and orientation, so that it can be concluded from this that the actual target is also -Pose, from which the actual image was taken, with the desired target pose or reference pose from which the desired image or reference image was recorded, match. This can make it possible to draw the conclusion that the referencing was carried out successfully or that the reference pose was successfully assumed by the end effector 13.
- a step 900 all further steps in the operation of the robot 1 which start from the reference position can be initiated as a reaction to this.
- the actual target pose would differ from the target target pose as a reference pose, so that correspondingly large deviations between the actual image of the actual target pose and the target image or the reference image of the target Target pose are recognized by step 800 of the comparison, it can be concluded from this that the actual target pose of the end effector 13 and the desired target pose or reference pose do not match, as shown in FIG .
- a new referencing can be attempted.
- the referencing can also be aborted directly or subsequently in the event of a renewed unsuccessful referencing in a step 600 and the operation of the robot 1 can be stopped at least temporarily.
- a user can be informed about the unsuccessful referencing in order to view the robot 1 and to search for the cause of the incorrect referencing.
- FIG. 4 shows a schematic top view of the drive system 1 of FIG. 1 when checking a home position in a first representation.
- Fig. 5 shows a schematic plan view of the drive system 1 of the figure when checking the home position in a second representation.
- the method according to the invention is used in accordance with the flow chart of FIG.
- the home marker 15b is based on the base 10 of the robot ters 1 captured by capturing 700 by image capturing unit 14 of end effector 13 as an actual image.
- a comparison 800 takes place with a target image of the home marker 15b, as it was either captured and verified as a target image as part of an initial start-up or was specified at the factory as a predetermined image, as described above.
- the captured actual image of the home marker 15b is compared with the corresponding stored target image, the supposed home pose can be confirmed as the actual home pose.
- the subsequent operation of the robot 1 can take place starting from the verified home pose without the need to refer to the robot 1. The corresponding expenditure of time can thus be saved.
- Fig. 6 shows a schematic plan view of a drive system 1 according to a secondstrasbei game when checking a reference pose in a first representation.
- Fig. 7 shows a schematic plan view of the drive system 1 of Figure 6 when checking the reference pose in a second representation.
- the image acquisition unit 14 is not arranged on the end effector 13 but in a stationary manner relative to the end effector 13, which in the example of FIGS. 6 and 7 under consideration is achieved by arranging the image acquisition unit 14 on the wall 3.
- the image capture unit 14 is designed to capture the end effector in the target-target pose.
- the method according to the invention runs as described above with reference to FIGS. 2 and 3 according to the flowchart in FIG.
- the only difference from the second exemplary embodiment in FIGS. 6 and 7 is that in this case the actual image is not aligned with the reference marking 15a from the perspective of the end effector 13, but that the image acquisition unit 14 is directed towards the end effector 13 is aligned; In addition, the reference marking 15a in the background of the end effector 13 can be detected.
- This actual image can also be compared with the corresponding target image in order to identify whether the end effector 13 is actually in the target-target pose, i.e. the actual target pose and the target target pose match, as shown in FIG. 6, or whether this is not the case, as shown in FIG. 7.
- a corresponding reaction can be made to this, as has already been described with regard to FIGS. 2 and 3.
- FIG. 8 shows a schematic top view of the drive system 1 of FIG. 1 when checking an intermediate pose of a trajectory in a first representation.
- Fig. 9 shows a schematic plan view of the drive system 1 of FIG. 1 when checking the intermediate pose of a trajectory in a two-th representation.
- the method according to the invention can also be successfully applied to such an application in accordance with the flowchart in FIG. In this application, too, a target image can first be captured as a reference image during initial start-up, or it can be specified at the factory as a predetermined image, as described above.
- the predetermined object 2 represents a reference point 2 independent of the robot 1.
- the target image is a representation of the charging socket 2 from a pose of the end effector 13 in which the end effector 13 has already been moved to a certain extent towards the charging socket 2 or its vehicle.
- this pose of the end effector 13 can lie on a trajectory where a rough approach of the end effector 13 to the charging socket 2 is complete and a fine alignment of the end effector 13 with respect to the charging socket 2 has to take place.
- the image capturing unit 14 can capture 700 an image of the charging socket 2 as an actual image. In this case, too, a comparison 800 of the captured actual image of the charging socket 2 with the desired image or reference image of the charging socket 2 can take place. If a sufficient match is also found in this case, the Trajectory are continued in order to complete the process of plugging the end effector 13 as a charging plug 13 into the charging socket 2. Otherwise, the current movement can be aborted, for example, in order to avoid a collision of the end effector 13 with the vehicle. In particular, the trajectory can be carried out again, with the end effector 13 preferably being referenced again beforehand, as described above.
- the trajectory can be followed again until the intermediate pose is reached again.
- the application of the method according to the invention described above can be carried out again. If the supposed intermediate pose can now be verified as an actual intermediate pose, in this case the process of approaching the charging socket 2 can be continued and completed. If this again cannot be done, the process should be canceled and the user informed.
- the home pose can preferably be assumed in this case and the robot 1 can be stopped in the home pose or even switched to a rest mode or switched off.
- the disadvantages that result from the use of relatively detecting position sensors can be reduced to fully compensated for.
- the detection of the position or the angular position of the actuated swivel joints 12 can be simplified or improved to the effect that relatively measuring position sensors can be used and their disadvantages can be at least partially avoided.
- this can take place in a comparatively cost-effective manner, since an image acquisition unit 14 can be used, which nowadays can usually be present on the end effector 13 anyway in numerous robots 1.
- an image acquisition unit 14 can be used, which nowadays can usually be present on the end effector 13 anyway in numerous robots 1.
- the properties and advantages described above can be achieved without having to use additional technical devices.
- the properties described above can also be achieved without the use of comparatively expensive absolute encoders. This can lead to an improved robot 1 and in particular to an improved charging device 1 at comparatively low costs.
Landscapes
- Engineering & Computer Science (AREA)
- Robotics (AREA)
- Mechanical Engineering (AREA)
- Manipulator (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DE102019105466.4A DE102019105466B3 (de) | 2019-03-04 | 2019-03-04 | Verfahren zum Betrieb eines Antriebssystems sowie Antriebssystem |
PCT/EP2020/055077 WO2020178110A1 (de) | 2019-03-04 | 2020-02-27 | Verfahren zum betrieb eines antriebssystems sowie antriebssystem |
Publications (1)
Publication Number | Publication Date |
---|---|
EP3934857A1 true EP3934857A1 (de) | 2022-01-12 |
Family
ID=69743219
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP20709141.4A Pending EP3934857A1 (de) | 2019-03-04 | 2020-02-27 | Verfahren zum betrieb eines antriebssystems sowie antriebssystem |
Country Status (3)
Country | Link |
---|---|
EP (1) | EP3934857A1 (de) |
DE (1) | DE102019105466B3 (de) |
WO (1) | WO2020178110A1 (de) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11427102B2 (en) * | 2020-10-28 | 2022-08-30 | GM Global Technology Operations LLC | System and method of autonomously charging an electric vehicle |
Family Cites Families (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
AT506865B1 (de) | 2008-05-20 | 2010-02-15 | Siemens Vai Metals Tech Gmbh | Vorrichtung zum verbessern von genauigkeitseigenschaften von handhabungsgeräten |
US9393694B2 (en) | 2010-05-14 | 2016-07-19 | Cognex Corporation | System and method for robust calibration between a machine vision system and a robot |
JP2012254518A (ja) * | 2011-05-16 | 2012-12-27 | Seiko Epson Corp | ロボット制御システム、ロボットシステム及びプログラム |
DE102012209769C5 (de) * | 2012-06-12 | 2021-11-11 | Kuka Deutschland Gmbh | Verfahren zum Betreiben eines Roboters und Vorrichtung mit einem Roboter |
DE102013113949B4 (de) | 2013-12-12 | 2021-03-18 | Deutsches Zentrum für Luft- und Raumfahrt e.V. | Fertigungsanlage |
DE102016212695B4 (de) | 2016-05-31 | 2019-02-21 | Siemens Aktiengesellschaft | Industrieroboter |
US10723022B2 (en) * | 2016-09-16 | 2020-07-28 | Carbon Robotics, Inc. | System and calibration, registration, and training methods |
TWI617995B (zh) * | 2016-11-04 | 2018-03-11 | 廣明光電股份有限公司 | 機器人視覺定位的驗證方法 |
DE102017209178B4 (de) | 2017-05-31 | 2021-09-02 | Carl Zeiss Industrielle Messtechnik Gmbh | Verfahren zur Ermittlung der Raumlage eines bewegten Koordinatensystems, eines Messpunkts seines Sensors oder eines Arbeitspunktes eines Werkzeugs bei einem Roboter |
-
2019
- 2019-03-04 DE DE102019105466.4A patent/DE102019105466B3/de active Active
-
2020
- 2020-02-27 EP EP20709141.4A patent/EP3934857A1/de active Pending
- 2020-02-27 WO PCT/EP2020/055077 patent/WO2020178110A1/de unknown
Also Published As
Publication number | Publication date |
---|---|
WO2020178110A1 (de) | 2020-09-10 |
DE102019105466B3 (de) | 2020-08-06 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2019166519A1 (de) | Verfahren und vorrichtung zum selbsttätigen verbinden eines aufladeanschlusses mit einer aufladeanschlussaufnahme eines fahrzeugs, insbesondere eines landfahrzeugs | |
DE102012216980B4 (de) | Von einem Roboter bediente Fahrzeugladestation | |
DE102018203162A1 (de) | Stecksystem zum Laden eines elektrischen Energiespeichers | |
DE69936073T2 (de) | Robotersteuerung | |
WO2014015991A2 (de) | Ladesystem und verfahren zum elektrischen aufladen eines kraftfahrzeugs | |
WO2016066455A1 (de) | Verfahren und bodeneinheit zum induktiven laden von elektro- und hybridfahrzeugen | |
WO2020084111A2 (de) | Vorrichtung zum automatisierten laden eines fahrzeugs, insbesondere elektrofahrzeugs | |
DE102016003250A1 (de) | Robotersteuervorrichtung mit einer Funktion zum Erfassen eines Kontakts mit einem Objekt oder einer Person | |
DE102020100803B4 (de) | Folgeroboter und Roboterarbeitssystem | |
WO2008104167A2 (de) | Singularitätsbasiertes maschinenprüf- und kalibrierverfahren | |
EP3687933A1 (de) | Lokalisierungssystem und verfahren zur bestimmung einer aktuellen position in einem aufzugschacht einer aufzuganlage | |
EP3959042A1 (de) | Vorrichtung und verfahren zur instandhaltung einer oberleitungsanlage eines gleises | |
WO2020058525A1 (de) | Ladevorrichtung zum laden eines elektrofahrzeugs | |
WO2019224288A1 (de) | Richtungsabhängige kollisionsdetektion für einen robotermanipulator | |
DE102016120809B4 (de) | Verfahren zum robotergestützten Einpassen eines männlichen Bauteils in ein weibliches Bauteil | |
DE102007029398A1 (de) | Verfahren und Vorrichtung zum Programmieren eines Industrieroboters | |
WO2022233352A1 (de) | Verfahren zum erstellen von greiferablaufprogrammen | |
EP3934857A1 (de) | Verfahren zum betrieb eines antriebssystems sowie antriebssystem | |
DE102022205303A1 (de) | Dc-pin-lokalisierung für den ac-anschluss von elektrofahrzeugen | |
DE10323643B4 (de) | Sensorsystem für ein autonomes Flurförderfahrzeug | |
DE112020003236B4 (de) | Robotersystem | |
EP1941614A1 (de) | Fahrschalter zur steuerung eines fahrantriebs eines kraftgetriebenen flurförderzeugs | |
EP3131710A1 (de) | Robotervorrichtung mit einer linearachse | |
DE102018109329B4 (de) | Mehrgliedrige aktuierte Kinematik, vorzugsweise Roboter, besonders vorzugsweise Knickarmroboter | |
DE102020116124B3 (de) | Aufnahmeanordnungslager für mindestens eine Fertigungsstation sowie Fertigungsstation |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: UNKNOWN |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20211004 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: MATTHIAS DAGEN, JENS KOTLARSKI, TOBIAS ORTMAIER FORWARDTTC IP HOLDING GBR. |
|
DAV | Request for validation of the european patent (deleted) | ||
DAX | Request for extension of the european patent (deleted) | ||
P01 | Opt-out of the competence of the unified patent court (upc) registered |
Effective date: 20230802 |