WO2016146705A1 - Dispositif et procédé de vissage d'objets - Google Patents

Dispositif et procédé de vissage d'objets Download PDF

Info

Publication number
WO2016146705A1
WO2016146705A1 PCT/EP2016/055721 EP2016055721W WO2016146705A1 WO 2016146705 A1 WO2016146705 A1 WO 2016146705A1 EP 2016055721 W EP2016055721 W EP 2016055721W WO 2016146705 A1 WO2016146705 A1 WO 2016146705A1
Authority
WO
WIPO (PCT)
Prior art keywords
unit
tool
data
torque
screwing
Prior art date
Application number
PCT/EP2016/055721
Other languages
German (de)
English (en)
Inventor
Armin Baumgartner
Original Assignee
Nexustec Gmbh
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nexustec Gmbh filed Critical Nexustec Gmbh
Priority to EP16712766.1A priority Critical patent/EP3271116B1/fr
Publication of WO2016146705A1 publication Critical patent/WO2016146705A1/fr

Links

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25B—TOOLS OR BENCH DEVICES NOT OTHERWISE PROVIDED FOR, FOR FASTENING, CONNECTING, DISENGAGING OR HOLDING
    • B25B23/00—Details of, or accessories for, spanners, wrenches, screwdrivers
    • B25B23/14—Arrangement of torque limiters or torque indicators in wrenches or screwdrivers
    • B25B23/147—Arrangement of torque limiters or torque indicators in wrenches or screwdrivers specially adapted for electrically operated wrenches or screwdrivers
    • A—HUMAN NECESSITIES
    • A45—HAND OR TRAVELLING ARTICLES
    • A45F—TRAVELLING OR CAMP EQUIPMENT: SACKS OR PACKS CARRIED ON THE BODY
    • A45F5/00—Holders or carriers for hand articles; Holders or carriers for use while travelling or camping
    • A—HUMAN NECESSITIES
    • A45—HAND OR TRAVELLING ARTICLES
    • A45F—TRAVELLING OR CAMP EQUIPMENT: SACKS OR PACKS CARRIED ON THE BODY
    • A45F5/00—Holders or carriers for hand articles; Holders or carriers for use while travelling or camping
    • A45F5/02—Fastening articles to the garment
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25B—TOOLS OR BENCH DEVICES NOT OTHERWISE PROVIDED FOR, FOR FASTENING, CONNECTING, DISENGAGING OR HOLDING
    • B25B23/00—Details of, or accessories for, spanners, wrenches, screwdrivers
    • B25B23/14—Arrangement of torque limiters or torque indicators in wrenches or screwdrivers
    • A—HUMAN NECESSITIES
    • A45—HAND OR TRAVELLING ARTICLES
    • A45F—TRAVELLING OR CAMP EQUIPMENT: SACKS OR PACKS CARRIED ON THE BODY
    • A45F2200/00—Details not otherwise provided for in A45F
    • A45F2200/05—Holder or carrier for specific articles
    • A45F2200/0533—Cameras, e.g. reflex, digital, video camera
    • A—HUMAN NECESSITIES
    • A45—HAND OR TRAVELLING ARTICLES
    • A45F—TRAVELLING OR CAMP EQUIPMENT: SACKS OR PACKS CARRIED ON THE BODY
    • A45F2200/00—Details not otherwise provided for in A45F
    • A45F2200/05—Holder or carrier for specific articles
    • A45F2200/0575—Portable tools

Definitions

  • the present invention relates to a device and a method for screwing objects, in particular in the manufacture and / or assembly of vehicles.
  • a wrench which is capable of electrical detection and logging of the torque. This allows logging of the respective screwing cases carried out in their sequence.
  • it is thus not possible to assign the recorded bolting cases to a respective bolting location on the vehicle.
  • a manual assignment, recording, acknowledgment or logging is also required here.
  • DE 10 2010 032 553 A1 discloses a device for monitoring torque and connection conditions during the manufacturing process in the automotive industry.
  • This device comprises a rotation sensor having a projector for projecting a predetermined pattern and an image converter 66 or camera. This generates three-dimensional data, so that it is possible to monitor the rotational distance traveled by a mechanical fastening means.
  • a fastening device is based on this visual information and / or torque data and / or connection data driven accordingly.
  • DE 10 2012 003 809 A1 relates to a system with which the torque, which is necessary for opening a plastic screw cap of a bottle, is determined without contact. This is done by detecting corresponding marks by means of a camera.
  • EP 1 963 786 B1 A system for writing a position of an object is described in EP 1 963 786 B1.
  • the objects are optically detected.
  • US 2008/01 15589 A1 discloses a torque wrench having a torque measuring device.
  • This system further includes a camera and a visible pointer.
  • the visible pointer is, for example, a light signal that marks a particular connection to be tightened with the torque wrench.
  • the camera can record the connected connection and automatically determine which connection is to be tightened next, so that the user is given an exact sequence.
  • information about the individual connections can also be stored.
  • a connection tool such. As a screwdriver out, with which connecting parts can be connected.
  • the connecting parts are assigned a marking.
  • the tool has a reading device that can detect this mark.
  • the marker may be, for example, a barcode. This information can be compared with corresponding information of a database.
  • a torque determination system which determines the corresponding torque from predetermined angular positions.
  • the angular positions can be detected with an X-ray system.
  • DE 10 2013 017 007 A1 discloses a robot in which the force and torque input exerted by the robot can be determined.
  • the present invention is based on the basic idea of monitoring an operating area with the object to be screwed and a tool unit designed for screwing screw connection elements by an image recording unit and analyzing the recorded images to at least the object and a screwing point a screwing is made to recognize and automatically generate a log in which the detected object and Verschraubungsort and applied during the screwing and detected torque or an applied angle of rotation are related to each other.
  • the records of the protocol may also represent data representing the tool unit also recognized by image analysis, and / or a time stamp representing a time at which the torque or torque is applied Rotation angle has been applied, and / or based on a work plan generated specifications regarding a Verschraubungsorts on the object and / or a ringfalls and / or a tool selection.
  • the log tuples can also be used to monitor the bolting operation, to check the bolting success and / or progress, to feed back defaults and / or check results to a user, and to guide the user.
  • Feedback can be made by optical and / or acoustic signaling and / or image display.
  • the protocol tuples are preferably not backed up until it has been determined that the tool unit has been removed from the screwing point; and / or the data acquired with respect to the object and the Verschraubungsorts and the applied torque or the executed rotation angle, preferably also with respect to the tool unit, comply with specifications; and / or a worn screw is acknowledged by a user.
  • a backup can be, for example, but not limited to, printing, persistent storage in nonvolatile memory or volume, transmission to a remote administrative office, etc.
  • the torque detected and contained in the protocol tuple, in particular in the secured protocol tuple is preferably a maximum torque applied at the screwing location.
  • a device for screwing objects according to a first aspect of the present invention comprises
  • a tool unit that is designed to screw threaded fasteners
  • a rotation specification output device which is designed to output the torque to be applied during screwing with the tool unit or the angle of rotation to be executed during screwing
  • a data processing unit configured to detect torque data or rotation angle data representing the torque applied when screwing, an image pickup unit having a stereo camera adapted to receive a spatial image of a work area with at least a cutout of an object to be screwed; to provide the captured image data, wherein
  • the data processing unit has an image analysis unit which is designed to detect the object, the tool unit and a screwing location on the object in the recorded image and a protocol tuple (p) with data representing the recognized screwing location and the detected torque data and / or rotation angle data associated with each other.
  • the data processing unit is designed such that the recognition of the object takes place on the basis of at least three reference points of the acquired spatial image. With three reference points, the object is clearly defined in space or in the three-dimensional coordinate system of the image acquisition unit.
  • Recognition of the object may also be based on the points describing a particular body that is part of the object.
  • the points of this body thus represent reference points.
  • Various algorithms are known with which individual bodies are extracted from spatial images, that is to say images which comprise three-dimensional information about the detected objects, and are described using a data model.
  • the detection of the object is preferably done by comparing the reference points with the corresponding points in a three-dimensional model of the object.
  • Such a model can be derived from design data.
  • a model of the object is created in an empty learning process in which a plurality of spatial images are taken with the image acquisition unit. The model is then created from these spatial images by superimposing and aligning these images.
  • Such a model, derived from the spatial images describes the object in a manner very similar to the spatial images acquired in later operation with the imaging unit.
  • a stereo camera to produce such spatial images of the object and comparison with a three-dimensional model of the object allows directing the camera with different viewing directions on the object and still achieve a reliable comparison with the model, whereby the object and its position in the coordinate system of the stereo camera can be reliably detected, even if the spatial images are detected by the object from different viewing directions.
  • a method of bolting articles according to another aspect of the present invention comprises the following steps:
  • a tool unit in the sense of the invention can be understood to mean any screwing tool which makes it possible to detect, measure, display, recognize, etc. a torque applied during screwing.
  • the tool unit can be designed as a so-called torque wrench with a lever unit a tool holder, wherein in or on the tool holder a replaceable tool is received or receivable.
  • the replaceable tool may be a so-called nut or a so-called bit, with or without extension, and is adapted for a respective screw to the screw connection element to be screwed or adaptable.
  • suitable tooling units include, but are not limited to, a screwdriver or impact wrench.
  • the indication of the torque may be, for example, but not limited to, by an optical display such as a pointer, a scale, a clock or a digital display, and / or by sensing and transmitting measurement data.
  • an optical display such as a pointer, a scale, a clock or a digital display
  • sensing and transmitting measurement data to capture the torque in the latter case, the sensor data is transmitted to a data processing unit wireless or wired and evaluated there, and in the former case, the image supplied by the image pickup unit is also evaluated to recognize the torque indicated by the optical display.
  • a corresponding sensor may be provided for sensing the torque.
  • the rotation specification output device is preferably arranged in or on the lever unit
  • the tool unit in particular the lever unit and / or the replaceable tool, carry an identification mark.
  • the identification tag may include a bar code, a color code, a 2D bar code, and / or a punch mark.
  • the identification mark makes it possible to recognize the tool unit by means of the identification mark.
  • the identification mark can be attached to an interchangeable marking unit, which is attached or attachable to a suitable location on the tool unit.
  • a carrier unit which carries at least the image pickup unit, may preferably be in the form of a spectacle frame, protective goggles, a protective helmet, a headband or part of a garment such as an epaulette, a collar or a belt or fasteners for attachment to glasses, goggles , a protective helmet, a headband or on a garment such as an epaulette, a collar, a belt.
  • a user can wear the image pickup unit on the body.
  • image acquisition advantageously follows the head movements of the user.
  • the image capture unit is configured to generate a spatial image.
  • the image acquisition unit in particular has a first image acquisition unit and a second image acquisition unit, which are arranged spatially separated from one another.
  • the object is preferably identified by means of predetermined, stationary, first detection points on the object, wherein the first detection points are recognized by comparison with a previously stored model of the object, and wherein the first detection points are preferably inherent in the object.
  • the detection of the Verschraubungsorts preferably takes place on the basis of predetermined, stationary second Er- points on the tool unit, the second detection points are detected by comparison with a previously stored model of the tool unit, the second detection points are preferably the tool unit immanent.
  • the model can be derived from design data such as CAD data or generated by prior learning.
  • a geometry reference defined by the relative spatial position of the two image acquisition units can be used to identify the object.
  • Fig. 1 is a block diagram illustrating an apparatus for bolting objects according to an embodiment of the present invention
  • Fig. 2 is a view of a tool unit which can be used in the embodiment
  • Fig. 3 is a perspective view of a replaceable marking unit for attaching an identification mark to the tool unit of Fig. 2; 4 is a perspective view of an image pickup unit with a carrier unit according to an embodiment of the present invention;
  • FIG. 5 is a perspective view of an image pickup unit with a carrier unit according to another embodiment of the present invention.
  • FIG. 6 is a view of an image pickup unit with a carrier unit according to a still further embodiment of the present invention.
  • FIG. 7 shows a schematic representation of a screwing situation to illustrate a method for screwing objects according to an exemplary embodiment of the present invention
  • Fig. 8 is a schematic diagram schematically illustrating selected points in the situation shown in Fig. 7 in a coordinate system
  • FIG. 9 is a block diagram illustrating the method of bolting articles according to the present invention.
  • FIG. 10 shows a marking unit with a two-dimensional barcode.
  • Fig. 1 is a block diagram schematically illustrating a device for bolting objects in a bolting case.
  • a device which has a plurality of elements, namely a tool unit 200, an image acquisition unit 300, a data processing unit 400 and an image output unit 500.
  • the object 100 has a plurality of reference points 1 10 and a screw 120 on.
  • the reference points 110 are immutable detection points on the object 100, which are predetermined by the construction of the object 100.
  • the reference points 110 can also be the points that describe a particular body of the object.
  • the reference points used are also those points which describe an elongate body.
  • a data model stored in a model data storage unit 440 which enables the recognition and spatial association of the reference points 110 on the object 100 from a spatial representation will be described in more detail below.
  • This model can be derived from design data and / or generated during a learning process in which multiple spatial images are taken with the image acquisition unit 300.
  • the model is generated from the spatial images acquired with the image acquisition unit 300, since such a model is very similar to the spatial images acquired during later operation.
  • the multiple spatial images are superimposed and aligned to create the model.
  • the screwing point 120 is predetermined by a work plan and linked to the bolting case.
  • the bolting location 120 shown in FIG. 1 is preferably just one of many bolting locations to be machined according to the work schedule.
  • more than three reference points can be defined on the object 100, but for spatial orientation at least three reference points 110 are required, which preferably do not lie on a straight line.
  • the screwing location 120 can be hidden behind a part of the object 100 both in the model and with the image acquisition unit 300 of acquired spatial images. For automatic recognition of the object 100, it is sufficient if the reference points are visible in the captured image. If the object 100 is identified and its arrangement in the space or in the coordinate system of the image acquisition unit 300 known, then such hidden Verschraubungsorte 120 can be identified. The Verschraubungsorte 120 and the reference points 1 10 can be entered during the learning process and integrated into the model to be created. Here, the work plan for learning the Verschraubungsorte 120 processed.
  • a screw 150 is provided in the present embodiment. As shown in FIG.
  • a tool unit 200 is used for the screw connection, which has a torque wrench and a nut 250 adapted to the screw or the screw head of the screw 150.
  • the torque wrench includes a lever arm 210, a pin 220 for coupling with the nut 250, and a torque indicator 230.
  • a marking unit 240 is attached with an identification mark. The identification mark is designed to uniquely distinguish the torque wrench 200 from other tools, and will be described in greater detail below with reference to a specific example of the marking unit 240.
  • the torque wrench is understood as a tool unit 200 in the sense of the present invention, the lever arm 210 being understood as a lever unit, the torque indicator 230 as a turning output device, the pin 220 as a tool holder, and the nut 250 as a replaceable tool.
  • the spigot 220 has a square cross-section in a known and conventional manner, which mates with a quadrangular recess in the nut 250, and may have a spring element (not shown in more detail) on one side, which has a lateral inner wall of the recess cooperates in the nut 250 to the nut 250 with the pin 220 captive, but releasably couple.
  • the pin 220 may also be mounted in a ratchet unit (not shown in detail), which allows quasi-continuous screwing without repeated settling and reapplication of the tool.
  • the torque indicator 230 comprises in the present embodiment an optical display 232 and a radio transmitter 234, which enables both a visual reading of the applied torque and a transmission of the torque in the form of measured value data or signals to a correspondingly configured radio receiver.
  • a radio transmitter instead of a radio transmitter, it is also possible to provide a cable interface or an attached cable in order to transmit measured value data or signals by cable.
  • the present invention also works with only one of the optical display and the radio transmitter / cable interface / transmission cable. Essentially, in the context of the present invention, it is important to output the torque that is applied to the tool unit during the screwing in perceptible or receivable form.
  • the detection of the rotation angle takes place by detection of the tool unit 200 in its different rotational positions by means of the image recording unit 300 and corresponding evaluation by the data processing unit 400.
  • assembly instructions that initially prescribe a specific torque for screwed connections. When this torque has been reached, the screw connection must still be screwed on by a predetermined angle (eg 45 ° or 90 °).
  • the rotation specification output device is therefore designed such that it can specify both a torque and a rotation angle.
  • the image acquisition unit 300 comprises as essential components a camera unit 310, a control unit 320 and a radio interface 305.
  • the camera unit 310 is designed and aligned to receive at least a section of the object 100 with the reference points 110 and the screwing location 120, and supplies image data of the recorded images to the control unit 320.
  • the control unit 320 is designed to receive image data from the camera unit 310 and may be configured to send control data to the camera unit 310 to adjust acquisition parameters such as focus, aperture, depth of field, or frame.
  • the control unit 320 is further coupled to the radio interface 305, and supplies the image data received from the camera unit 310 such that the radio interface 305 can provide the recorded image data to a remote station.
  • the image pickup unit 300 further includes a laser pointer 330 as a laser pointing device, a speaker unit 340 as an acoustic output unit, and a light emitting diode unit 350 as an optical output unit.
  • the laser pointer 330, the speaker unit 340 and the light-emitting diode unit 350 are data-coupled to the control unit 320, the control unit 320 being designed to output control data to the laser pointer 330, the loudspeaker unit 340 and the light-emitting diode unit 350.
  • the data processing unit 400 includes a radio interface 405, a control unit 410, an image data acquisition unit 420, a measurement data acquisition unit 430, a model data storage unit 440, an image analysis unit 450, a timer unit 460, a logging unit 470, a schedule storage unit 480 , a default unit 485, and a feedback generation unit 495.
  • the radio interface 405 is configured to establish and maintain a wireless data communication link with the rotation default output device 230 of the tool unit 200 and the radio interface 305 of the image capture unit 300.
  • the control unit 410 is coupled to the radio interface 405 and is designed to supply image data received from the image acquisition unit 300 via the radio interface 405 to the image data acquisition unit 420 and to supply torque data received from the rotation specification output device 230 via the radio interface 405 to the measurement data acquisition unit 430 and feedback data from the response generation unit 495.
  • the image data acquisition unit 420 is designed to receive image data from the control unit 410 and, if appropriate, store it temporarily and / or permanently and to provide it to the image analysis unit 450.
  • the model data storage unit 440 is designed to store model data which store constructive and geometric characteristics of the object 100 with its fixed reference points (110, FIG. 1), the tool unit 200 or their identification features and to the image analysis unit 450.
  • the image analysis unit 450 is configured to automatically recognize the object 100, the tool unit 200 and the screwing location 120 on the object 100 by comparing the image data supplied from the image data acquisition unit 420 with the model data supplied from the model data storage unit 440 and data indicating the detected bolting location and preferably reproduce the recognized tool unit to provide the log generation unit 470.
  • the measurement data acquisition unit 430 is designed to detect torque data and rotation angles received from the control unit 410, to temporarily and / or permanently store them, if necessary, and to provide them to the protocol generation unit 470.
  • the protocol generation unit 470 is configured to generate a protocol memory 275 from the data supplied by the image analysis unit 450 regarding the screwing location and preferably the detected tool unit, the torque data / rotation angle data supplied by the measurement data acquisition unit 430 and timestamps supplied by the timer unit 460 for backup and provide to the review unit 490.
  • the log tuples generated by the log generation unit 470 may further include default data supplied from the default generation unit 485.
  • the prediction generation unit 485 is designed to generate specification data from a work plan taken from the work plan storage unit 480 and to provide it to the protocol generation unit 470 and the verification unit 490. To synchronize with the actual workflow, the default generation unit 485 may also be coupled to the timer unit 460 and the image analysis unit 450.
  • the default generation unit 485 may generate default data based on a work cycle based on a time supplied by the timer unit 460 or may flexibly supply default data adapted to an individually selected work order based on a bolting location provided by the image analysis unit 450.
  • the checking unit 490 is configured to check the protocol tuples p (not yet saved) to see whether the defaults supplied by the default generating unit 485 have been reached or not, and to provide a corresponding check result to the feedback generating unit 495.
  • the backup of the protocol tuple p in the log memory 475 can be linked to the condition that the specifications supplied by the default generation unit 485 are achieved, at least with regard to the screwing location and the detected torque or detected rotational angle.
  • the backup of the protocol tuple p can also be done by manual acknowledgment be triggered by a user.
  • a backup of a protocol tup p can occur automatically when the screwing process is interrupted, for example when the tool is set down by the screw 150.
  • the feedback generation unit 495 is configured to receive protocol tuples provided by the protocol generation unit 470, and default data provided from the specification generation unit 485, and verification results provided by the verification unit 490, to generate feedback therefrom and to provide it to the control unit 410.
  • the control unit 410 is further configured to provide feedback received by the feedback generation unit 495 via the radio interface 405 of the image acquisition unit 300 and to an image output unit 500 to be described below.
  • the control unit 320 of the image acquisition unit 300 can be configured to convert, via the radio interface 305, feedback received from the data processing unit 400 into control signals to the laser pointer 330, the loudspeaker unit 340, the light-emitting diode unit 350 and / or the camera unit 310.
  • the feedback may be output in acoustic form via the speaker unit 340
  • an optical confirmation or warning signal may be output via the light-emitting diode unit 350 and / or the camera unit 310 may change image acquisition parameters.
  • the laser pointer unit 330 can also generate a laser beam directed onto the screwing location 120 to be processed in order to guide a person to the corresponding screwing location 120.
  • the above-mentioned image output unit 500 is provided in the present embodiment as a tablet PC having a radio interface 510, a display unit 520, and a speaker unit 530. Based on the feedback received via the radio interface 510, as shown here, default values for the screw 150 to be selected as well as the torque prescribed for this purpose (tightening torque) can be output. It is understood that the principle described above allows many variations and options. For example, a green, a red and possibly a yellow LED of the light-emitting diode unit 350 of the image recording unit 300 can be activated in order to convey a work result to a user in color-coded form.
  • the correct positioning of the tool unit 200 by a yellow illumination and the correct tightening torque achieved can be indicated by a green illumination.
  • a green illumination By flickering with different frequency in yellow color, for example, an approximation of the prescribed torque, by flickering in red color too high a tightening torque can be signaled.
  • the work success can be indicated by a text message or a color underlay.
  • An embodiment of the torque wrench (tool unit) 200 is shown in more detail in FIG. 2, and the marking unit 240 for use on the tool unit 200 is shown in FIG. 2 is a plan view of the tool unit 200 (torque wrench), and FIG. 3 is a perspective view of the marking unit 240 in the form of a sleeve.
  • the torque indicator 230 is in the form of a digital display.
  • the digital display of the torque indicator 230 is readily recognizable by the camera unit 310 of the image capture unit 300 (FIG. 1).
  • the marking unit 240 is attached to the lever unit 210 near the tool holder 220.
  • the applied torque can also be moved by a pointer instrument or a cantilever that does not deform with the lever unit 210, optionally in conjunction with a scale attached to the lever arm 210, which moves along the cantilever upon deformation of the lever arm 210 ., or any other suitable visual representation.
  • the two-shell cuff marking unit 240 is formed with a top 242 and a bottom 243 connected by a series of screws 244 for clamping the marking unit 240 to the lever arm 210.
  • the marking unit 240 further carries an identification mark in the form of a bar code 246 on the one hand and a hole marking or coding 248 on the other hand. Both types of marking can be easily read by the camera unit 310 of the image recording unit 300.
  • FIG. 10 shows an alternative example of an approximately rectangular marking unit 240 having a two-dimensional barcode 247 for coding an identification number for the respective tool and at the corners each having a position mark 248, by means of which the position of the tool in space or in the coordinate system the image acquisition unit is detectable.
  • the two-dimensional code is mirrored around a centerline. Based on the position marks 248, the position of the tool in the three-dimensional coordinate system of the camera can be easily determined.
  • This marking unit 240 can be printed out with a conventional printer.
  • the marking unit 240 is then glued onto the tool unit 200, in particular the lever arm 210.
  • After attaching the marking unit 240 to the tool unit 200 it is scanned in a learning process, whether the mounting unit is a collar or a glued label, so that the position of the marking unit 240 on the tool unit 200 is uniquely detected.
  • the position of the tool unit 200 in the three-dimensional coordinate system of the image recording unit 300 can then be clearly deduced on the basis of the detection of the marking unit 240.
  • a support unit may be provided on which the image pickup unit 300 can be carried compactly or distributed on the body.
  • the carrier unit 600 is designed according to a specific exemplary embodiment in the form of protective goggles.
  • This goggle comprises a mask unit 622 which encloses protective glasses 624 and an elastic band 626 located behind the head, the band 626 being adjustable by means of a closure unit 628.
  • the image pickup unit 300 is laterally attached to a junction between the mask unit 622 and the elastic band 626 in this embodiment.
  • the carrier unit 600 is in the form of safety glasses with a frame 642 which accommodates two protective glasses 644 and two brackets 646, 646, wherein the image recording unit 300 is distributedly arranged on the carrier unit 600 ,
  • each camera unit 310 is attached to the right and left brackets 646, 646, respectively, and a speaker unit 340, the housing of which also accommodates the control unit 320 and the radio interface 305 (FIG. 1), is attached to the left bracket 646 a light-emitting diode unit 350 with three different-colored LEDs mounted on a nose root portion of the frame 642.
  • a wiring 648 between the camera units 310, the light emitting diode unit 350 and the speaker unit 340 with radio interface 305 and control unit 320 is integrated at the upper edge of the frame 642.
  • a carrier unit 600 is designed as a protective helmet 660, on each of whose sides a camera unit 310 is attached.
  • the camera units 310 may be fixedly mounted, may be attached to a bracket integrated with the helmet 660, or may be integrated with a bracket attachable to the helmet 660.
  • the further device technology of the image recording unit 300 can be distributed in one of the camera units 310, on both camera units 310 or integrated into the protective helmet 660.
  • FIG. 7 is a spatial schematic representation of a deployment situation within the meaning of the present invention.
  • a user 700 uses the torque wrench 200 to make a screw connection at a screwing point 120 on an object 100, in this case a motor vehicle.
  • the user 700 carries an image pickup unit 300 by means of a helmet-shaped carrier unit 600 (see Fig. 6).
  • Three reference points 1 10, which are structurally predetermined and immutable per se, are specified on the object 100.
  • On the tool unit 200 (torque Key) are three reference points 710 constructive and / or by marking unit (240, Fig. 3) predetermined or identifiable.
  • the bolting site 120 is hidden behind structural members of the article 100. Nevertheless, it is possible to determine from the reference points 110 of the object 100 and the reference points 710 of the tool unit 200 at which point on the object 100 the tool unit 200 attaches.
  • FIG. 8 shows the reference points 110 of the object 100 and the reference points 710 of the tool unit 200 in a virtual space 800.
  • the reference points 110 of the article 100 span a first reference triangle 810 defining a first reference plane 815.
  • the reference points 710 of the tool unit 200 clamp a second reference triangle 820 defining a second reference plane 825.
  • the reference points 1 10, 710 are detected by the camera units 310 of the image acquisition unit 300.
  • the reference points 110, 710 can be assigned to coordinates X1, X2, X3 of the virtual space 800, whereby the absolute position of the object 100 and the tool unit 820 in virtual space 800 as well as the relative position between the object 100 and the tool unit 200 are completely defined.
  • FIGS. 5 and 6 each show a carrier unit 600 with two camera units 310, so that these camera units 310 each form a stereo camera.
  • the image pickup unit 300 is shown only schematically. This is also a stereo camera.
  • the imaging unit 300 generates two spatial images per second. It is expedient that at least one spatial image is generated at least every two seconds, preferably at least one, two or at least three images are generated per second. On the other hand, the resolution of a stereo camera is sufficient to be able to unambiguously indicate the screwing locations 120 to the operator.
  • the use of the stereo camera thus makes it possible to provide the image pickup unit 300 on a carrier body 600 arranged on an operator's body, whereby the operator can move freely and occupy an arbitrary position with respect to the object 100, as long as the viewing direction of the image pickup unit 300 on the object 100 is directed.
  • the spatial image data can be quickly matched with the spatial model.
  • the relative positions of the image pickup unit 300 relative to the object 100 are uniquely identified, so that the three-dimensional coordinate system of the image pickup unit 300 is fixed and the position of the object 100 in this coordinate system is determined.
  • Pointer elements such as the laser pointer 330, are preferably mechanically connected to the image acquisition unit 300, so that their position in the coordinate system of the image acquisition unit 300 is also clearly defined.
  • An operator who carries the carrier unit 600 can thus move freely with respect to the object 100, whereby on the one hand the screwing locations 120 are automatically displayed or predetermined and on the other hand the screwing is completely logged (torque and / or angle of rotation, time stamp).
  • FIG. 9 is a block diagram illustrating processes in the implementation of an article screwing method according to another embodiment of the present invention.
  • an area 910 symbolizes a physical production level
  • an area 920 symbolizes a data processing level
  • an area 930 symbolizes a tool data level.
  • a first interface level 921 establishes a link between the physical production level 910 and the data processing level 920
  • a second interface level 923 establishes a link between the tool level 930 and the data processing level 920.
  • the physical plane 910 may be substantially compared to the article of manufacture 100 image capture unit 300 and the image output device 500 in FIG. 1, the data processing plane 920 may be substantially equated with the data processing unit 400 of FIG.
  • the interface plane 921 can be compared here with the radio interfaces 305, 405, 510 and associated radio transmission links in FIG. 1, and the interface plane 923 can essentially be integrated with a radio transmitter integrated in the rotary output device 230 of the tool unit 200 and the radio interface 405 of FIG Data processing unit 400 in Fig. 1 are compared.
  • An arrow 912 in FIG. 9 symbolizes a production sequence, for example, on a vehicle assembly line during vehicle production. Once a vehicle can be picked up at an assembly site, a NOK message with vehicle ID is made in step 914.
  • the assembly of the vehicle can also be carried out manually (generally represented as step 915) with manual OK setting 916.
  • the assembly in particular the setting of fittings on the vehicle, but including the data processing level 920.
  • data from the physical production level 910 are introduced via the interface level 921 in the data processing level 920 and provided in the data processing level 920 data via the interface level 921 in the physical production level 910 made representable.
  • a query 917 takes place, in the form of a repetitive loop, until an OK message 918 takes place from the data processing level 920.
  • the vehicle can be returned from the assembly point in the production process 912.
  • multiple processing blocks are defined. These are in particular a start block 940, a data load block 950, a recognition block 960, a navigation block 970 and a monitoring block 980.
  • a measurement data generation block 990 is to be considered, in which at the request of the navigation block 970 of the data processing level 920 measurement data on the tool (FIG. Tool unit 200, FIG. 1) and provided to the monitoring block 980 of the data processing level 920.
  • the request and provision of data between the data processing level 920 and the tool level 930 is via the interface level 923.
  • the data load level 920 is implemented on the data processing level 920 where data is loaded on the vehicle, the screwing situation, and the tool.
  • the recognition block 960 is implemented, in which a recognition is first started in a step 962, then a recognition is performed in step 964 and, after recognition in step 966, the recognized state is registered.
  • the start of the recognition in step 962 can be compared to an activation of the image recognition unit 300 in FIG. 1, in particular of the camera units 310.
  • the execution of the detection in step 964 corresponds, for example, to the detection of the vehicle (object 100), the screw joint 120 and the tool unit 200 by image analysis in the image analysis unit 450 on the basis of the image data supplied by the camera unit 310 and acquired by the image data acquisition unit 420 in comparison with FIG the model data stored in the model storage unit 440, in particular based on the predetermined and invariable reference points 1 10 and the marking unit 240 (FIG. 1) as well as on the tool unit 200 identifiable reference points 710 (FIG. 7).
  • the registration of the detection in step 966 corresponds to the generation of a data set containing data that identifies the recognized vehicle (the detected object 100), the detected tool unit 200 and the recognized screw 120 (Fig. 1) play. The generated record is then passed to navigation block 970.
  • the assembler navigates to the screwing location in step 972, for example via the laser pointer device 330 in FIG. 1, the output of default data via the image output unit 500 and optical and / or acoustic signaling via the loudspeaker unit 340 or the light-emitting diode unit 350 can be done in Fig. 1.
  • a detection message is sent to the monitoring block 980 in step 974.
  • a start of the screwing operation includes a request for measurement data from the tool unit 200 (FIG. 1).
  • processing block 990 on tool level 930 Upon request by navigation block 970, processing block 990 on tool level 930 generates measurement data corresponding to the applied torque on tool unit 200 (FIG. 1) and also transmits it to the monitoring block.
  • the monitoring block 980 performs a monitoring of the tightening operation in step 982 based on the measurement data supplied from the tool level 930 (processing block 990), and ends the monitoring in step 984 at the time of Sole achievement. Thereupon, in step 986, a generation of logs is performed, generating log tuples, which generate and store the record registered in step 966 along with the data representing the detected torque.
  • the protocol can be transferred to the interface level 921 in the form of log files and / or video logs 925.
  • the monitor block 980 provides an OK message 927 to the interface level 921 when the vehicle is still active, and via the interface level 921, the OK message 927 is translated into the OK message 980 described above.
  • the sequence described above is under the regime of a predetermined clocking and, within the framework of this cycle, screwing operations are executed on the basis of a work plan (see 480, FIG. 1), with a bolting ID being generated for each screwing case ,
  • the fferfall-ID and the above-mentioned vehicle ID are respectively part of the protocol tuple of the generated protocol.
  • the article 100 is a motor vehicle.
  • other articles such as e.g. Aircraft, medical devices or the like may be used.
  • an operator or fitter carries the carrier unit 600, on which the camera units 310 are arranged.
  • the carrier unit 600 on which the camera units 310 are arranged.
  • an automatic screwing in which the tool unit 200 is automatically moved to the respective screw 120 and operated.
  • a robot arm may be provided.
  • the automatic screwing machine and the object to be screwed can be moved relative to each other, wherein in each case at least one spatial image of the object is detected in the different positions.
  • the spatial resolution of the spatial images acquired with the image acquisition unit 300 may not be sufficient to control the tool unit 200 sufficiently precisely to the screwing location 120 based solely on a single spatial image of the article 100.
  • additional spatial images can be recorded for positioning the tool unit 200 during the positioning process, wherein the tool unit 200 and the object 100 are detected here, so that the relative position of the tool unit 200 to the object 100 is determined on the basis of these images.
  • This relative position is determined with a much higher spatial resolution than the absolute position of the object 100 in the three-dimensional coordinate system of the camera.
  • the tool unit 200 can be positioned very precisely fully automatically at the screwing location 120.
  • Such a closed-loop control for positioning the tool unit 200 can also be used in a "mobile" system with a portable carrier unit 600, wherein the fitter then optical, acoustic or other instructions are given as the tool unit 200 relative to the object 100 to has to position.

Landscapes

  • Engineering & Computer Science (AREA)
  • Mechanical Engineering (AREA)
  • Details Of Spanners, Wrenches, And Screw Drivers And Accessories (AREA)
  • General Factory Administration (AREA)

Abstract

L'invention concerne un dispositif servant à visser des objets. Ledit dispositif comporte une unité d'outils (200), un système délivrant des spécifications de tournage (230) et une unité de traitement de données (400) réalisée pour détecter des données de couple de rotation, qui reproduisent le couple de rotation appliqué lors du vissage. L'invention prévoit en outre une unité de prise d'images (300) réalisée pour prendre une image d'une zone de travail présentant au moins une partie d'un objet (100) à visser et pour fournir les données d'images prises. L'unité de traitement d'images (400) comporte une unité d'analyse d'image (450), qui est réalisée pour identifier sur l'image prise l'objet (100), l'unité d'outils (200), un emplacement de vissage et un angle de rotation correspondant au niveau de l'objet (100) et pour produire un uplet protocolaire (p) comprenant des données, qui reproduisent l'emplacement de vissage identifié, et qui comportent les données de couple de rotation détectées associés l'un à l'autre. Un procédé selon l'invention servant à visser des objets comporte les étapes qui suivent consistant à : prendre une image spatiale d'une zone de travail avec une caméra stéréo, l'image détectée comprenant au moins une partie d'un objet (100) à visser ; identifier l'objet (100) et un emplacement de vissage au niveau de l'objet (100) à partir de la ou ou des ou de multiples images prises ; détecter automatiquement un couple de rotation appliqué lors du vissage par l'unité d'outils (200) ; produire un uplet protocolaire de données, qui reproduisent l'emplacement d'assemblage par vissage et le couple de rotation associés l'un à l'autre.
PCT/EP2016/055721 2015-03-17 2016-03-16 Dispositif et procédé de vissage d'objets WO2016146705A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP16712766.1A EP3271116B1 (fr) 2015-03-17 2016-03-16 Dispositif et procede de vissage

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE102015103941.9 2015-03-17
DE102015103941.9A DE102015103941A1 (de) 2015-03-17 2015-03-17 Vorrichtung und Verfahren zum Verschrauben von Gegenständen

Publications (1)

Publication Number Publication Date
WO2016146705A1 true WO2016146705A1 (fr) 2016-09-22

Family

ID=55642418

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2016/055721 WO2016146705A1 (fr) 2015-03-17 2016-03-16 Dispositif et procédé de vissage d'objets

Country Status (3)

Country Link
EP (1) EP3271116B1 (fr)
DE (1) DE102015103941A1 (fr)
WO (1) WO2016146705A1 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018177932A1 (fr) * 2017-03-30 2018-10-04 Robert Bosch Gmbh Machine-outil
DE102022113385A1 (de) 2022-05-27 2023-11-30 Bayerische Motoren Werke Aktiengesellschaft Verfahren zur Dokumentation einer Fügestellenverschraubung eines Fahrzeugs

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102017002363A1 (de) 2017-03-10 2018-09-13 SAMA GmbH Regalbediengerät und regallagersystem
JP7266451B2 (ja) 2019-04-19 2023-04-28 株式会社ディスコ ドライバー
CN110174049B (zh) * 2019-05-22 2020-07-28 上海交通大学 钢管螺纹图像检测装置及其移动方法

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030196497A1 (en) * 2002-04-18 2003-10-23 Ivo Geilenbrugge Torque measuring device
US20080061145A1 (en) 2006-03-20 2008-03-13 Mcgushion Kevin D Identifier Scanning Joinder Tools
US20080115589A1 (en) 2006-11-17 2008-05-22 General Electric Wireless-enabled tightening system for fasteners and a method of operating the same
US20110023280A1 (en) * 2009-08-03 2011-02-03 Gm Global Technology Operations, Inc. Torque monitoring assembly gun with integral vision system
EP1963786B1 (fr) 2005-12-23 2013-07-24 GCoder Systems AB Gabarit de positionnement
WO2013111387A1 (fr) * 2012-01-25 2013-08-01 本田技研工業株式会社 Système de gestion de couple de serrage
DE102012003809A1 (de) 2012-02-27 2013-08-29 Heuft Systemtechnik Gmbh Verfahren und Vorrichtung zum berührungslosen Prüfen des zum Öffnen eines Kunststoff-Schraubverschlusses erforderlichen Drehmoments
US20140137669A1 (en) 2012-06-07 2014-05-22 Panasonic Corporation Torque measurement apparatus, method, and program
DE102013017007A1 (de) 2013-10-14 2015-04-16 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Roboter mit einem Endmanipulatorarm mit Endeffektor sowie Verfahren zur Bestimmung eines Kraft- und Drehmomenteintrages auf einen Endeffektor eines Roboters

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030196497A1 (en) * 2002-04-18 2003-10-23 Ivo Geilenbrugge Torque measuring device
EP1963786B1 (fr) 2005-12-23 2013-07-24 GCoder Systems AB Gabarit de positionnement
US20080061145A1 (en) 2006-03-20 2008-03-13 Mcgushion Kevin D Identifier Scanning Joinder Tools
US20080115589A1 (en) 2006-11-17 2008-05-22 General Electric Wireless-enabled tightening system for fasteners and a method of operating the same
US20110023280A1 (en) * 2009-08-03 2011-02-03 Gm Global Technology Operations, Inc. Torque monitoring assembly gun with integral vision system
DE102010032553A1 (de) 2009-08-03 2011-02-17 GM Global Technology Operations, Inc., Detroit Drehmoment- und Verbindungsüberwachungssystem mit Rotationssensor
WO2013111387A1 (fr) * 2012-01-25 2013-08-01 本田技研工業株式会社 Système de gestion de couple de serrage
DE102012003809A1 (de) 2012-02-27 2013-08-29 Heuft Systemtechnik Gmbh Verfahren und Vorrichtung zum berührungslosen Prüfen des zum Öffnen eines Kunststoff-Schraubverschlusses erforderlichen Drehmoments
US20140137669A1 (en) 2012-06-07 2014-05-22 Panasonic Corporation Torque measurement apparatus, method, and program
DE102013017007A1 (de) 2013-10-14 2015-04-16 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Roboter mit einem Endmanipulatorarm mit Endeffektor sowie Verfahren zur Bestimmung eines Kraft- und Drehmomenteintrages auf einen Endeffektor eines Roboters

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018177932A1 (fr) * 2017-03-30 2018-10-04 Robert Bosch Gmbh Machine-outil
CN110650821A (zh) * 2017-03-30 2020-01-03 罗伯特·博世有限公司 工具机器
CN110650821B (zh) * 2017-03-30 2022-11-11 罗伯特·博世有限公司 工具机器
DE102022113385A1 (de) 2022-05-27 2023-11-30 Bayerische Motoren Werke Aktiengesellschaft Verfahren zur Dokumentation einer Fügestellenverschraubung eines Fahrzeugs

Also Published As

Publication number Publication date
EP3271116A1 (fr) 2018-01-24
EP3271116B1 (fr) 2020-02-12
DE102015103941A1 (de) 2016-09-22

Similar Documents

Publication Publication Date Title
EP3271116B1 (fr) Dispositif et procede de vissage
DE102015015503B4 (de) Robotersystem, das eine mit erweiterter Realität kompatible Anzeige aufweist
EP3030359B1 (fr) Presse à plier
DE102010023736B4 (de) Robotersystem mit Problemerkennungsfunktion
DE102017128543B4 (de) Störbereich-einstellvorrichtung für einen mobilen roboter
DE102012219871A1 (de) Verfahren und Vorrichtung zur Protokollierung von Verschraubungen
EP2524329A2 (fr) Agencement et procédé pour vérifier un modèle réel en utilisant un modèle virtuel et utilisation associée dans la construction aéronautique
DE102015215406A1 (de) Vorrichtung und Verfahren zur kamerabasierten Überwachung von Fertigung und Montage
EP3467623B1 (fr) Procédé pour un poste de travail de montage, poste de travail de montage, programme informatique et support lisible par ordinateur
DE102013017007B4 (de) Roboter mit einem Endmanipulatorarm mit Endeffektor sowie Verfahren zur Bestimmung eines Kraft- und Drehmomenteintrages auf einen Endeffektor eines Roboters
DE102014204969A1 (de) Verfahren zur Überwachung von Fertigungsvorgängen, sowie zugehörige Überwachungsvorrichtung
DE102005045854B3 (de) Verfahren und System zur Kalibrierung einer Kamera in Produktionsmaschinen
DE102017111886B3 (de) Bestimmen der Bewegung einer abzusichernden Maschine
DE102019113764A1 (de) Verfahren zur Konfiguration einer werkstückbezogenen Werkstückhalteeinrichtung für die Pressenautomatisierung
EP1746402A2 (fr) Banc d'essai de simulation ainsi que procédé destinés à vérifier des composants de véhicules
EP1468792A2 (fr) Méthode pour calibrer un robot
DE102006005990B4 (de) Werkstückvermessung für 3-D Lageerkennung in mehreren Multi-Roboter-Stationen
DE202005011615U1 (de) Simulations-Prüfstand zur Prüfung von Kraftfahrzeug-Bauteilen
DE102013221899A1 (de) Industrieroboter
DE102014113070A1 (de) Justiervorrichtung und Verfahren zum Ausrichten eines Bauteils an einem Fahrzeug
EP2080585B2 (fr) Dispositif de surveillance
DE102020214960A1 (de) E/a-signalinformations-anzeigesystem
DE102017215518A1 (de) Verfahren und System zur Ortung eines Objekts
DE202017104899U1 (de) Anordnung zum Vergleich einer mittels einer Bestimmungseinheit bestimmten Kopfhaltung eines Insassen eines Kraftfahrzeugs mit einer Referenzmessung
DE112020001675B4 (de) Fernbedienungsvorrichtung

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16712766

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

REEP Request for entry into the european phase

Ref document number: 2016712766

Country of ref document: EP