DE102019214853A1 - Method for assigning a marker of a position determination system to a production order by means of the identification of a workpiece and device for carrying out the method - Google Patents

Abstract

The invention relates to a method and a device (10) for “marrying” a marker (16) of an interior location system with a specific production order (24). The marker (16) is assigned to the production order (24) in that an identification unit (12) creates a recording of a workpiece (22). The identification unit (12) identifies this workpiece (22) by analyzing the recording of the workpiece (22) and comparing this recording with stored object data (28) from various production orders (24). The assignment of the recording to a specific production order (24) is preferably carried out using image recognition algorithms. These image recognition algorithms are preferably based on data aggregation routines. A user input can confirm or correct a proposed production order (24). The identification unit (12) also identifies the marker (16). Finally, the marker (16) is assigned to the production order (24). The assignment can be displayed on the marker (16).

Description

Background of the invention

The invention relates to a method for assigning a marker of a position determination system to a production order.

It is known to use a position determination system with a marker in order to track a workpiece through a production plant.

From the DE 10 2017 121 098 A1 an object tracking-based control of production processes in the metalworking industry has become known, which is designed to assign a workpiece to a production order. A marker can have an image capturing device in order to assign the workpiece to a production order by means of a recording of the workpiece. For this purpose, the marker must be provided with an image acquisition device, which limits its use under production conditions in an oily or dusty environment.

The DE 10 2017 120 381 A1 discloses an assisted assignment of a workpiece to a marker of an indoor location system. A marker can be assigned to a production order by scanning both a code of the marker and the order papers. However, this procedure requires that the production order associated with the marker is known.

Object of the invention

In contrast, it is the object of the invention to provide a method or a device that allows an assignment of an, in particular unmarked, workpiece to a production order with relatively simple means.

Description of the invention

This object is achieved according to the invention by a method according to claim 1 and a device according to claim 13. The subclaims reproduce preferred developments.

The object according to the invention is thus achieved with a method in which a marker is assigned to a production order.

The marker can be a marker for a position determination system, in particular for a 2D or 3D indoor location system (“indoor GPS”). The position determination system can be designed to enable the localization of workpieces, people, transport media, machines and / or tools. The marker is a mobile tag that is designed to communicate with stationary transceiver devices (“anchors”), in particular by means of ultra broadband (“UWB”) communication technology. The marker can have its own time determination unit (“clock”) for determining the signal transit time.

A production order is understood to be a machining plan for one or more workpieces with stored object data. The object data can be stored in the form of an image of a workpiece, preferably in the form of a workpiece drawing.

To assign the marker, it is registered with an identification unit. Subsequently or beforehand, a recording of a workpiece is created with an image acquisition device of the identification unit. The assignment of the recording to a production order takes place by assigning the recording of the object to stored object data, in particular the workpiece drawing. This object data can be stored in the form of CAD data.

After the recording has been assigned to a production order, the registered marker is assigned to this production order. In this way, a workpiece, in particular a marker-free workpiece, can be assigned both to a specific production order and to a marker by means of which the further production sequence of the workpiece can be traced.

Preferred embodiments of the invention

The workpiece can be designed in the form of an essentially two-dimensional object, for example in the form of a flat sheet metal part, or in the form of a three-dimensional object, for example in the form of a sheet metal part with deformations.

The identification of the marker with the identification unit can take place by means of a recording made with the image acquisition device of the identification unit. The marker can have a computer-readable code, numbers and / or characters. These can be shown permanently and / or on a display of the marker. The identification can include the execution of an algorithm for recognizing the code, the numbers and / or the characters. Since the identification unit already has an image acquisition device in order to take a picture of the workpiece, the identification unit does not have to be provided with a further device in this case Identifying the marker can be provided and can thus be designed to be particularly simple in terms of construction.

As an alternative or in addition to this, the marker can be identified by means of near field communication (“NFC”). The marker can have an NFC coil that contains information for unambiguous identification of the marker. This means that identification can be carried out very reliably.

In a further embodiment of the method, the identification of the marker can comprise shaking the marker. In this case, the shaking of the marker is detected by at least one acceleration sensor of the marker, which sends a signal to all identification units indicating that it has just been shaken. An identification unit can then recognize the marker and assign this marker to the identification unit by reading out a confirmation input from a user. This procedure is particularly easy for the user, since the establishment of contact with the marker does not have to be initiated through complicated menu guidance.

After the marker has been identified, the method can start an application, in particular in the form of a web application, on the identification unit, which supports the user in creating the recording of the workpiece. This allows the method to be carried out in a particularly user-friendly manner.

A particularly inexpensive and convenient implementation of the method is achieved through the use of an identification unit in the form of a mobile terminal, in particular a smartphone or tablet.

In a further preferred embodiment of the invention, an image capturing device in the form of a camera is used in the method according to the invention, which is designed to create recordings (photos) in the visible light range. As a result, the identification unit can be designed in a particularly simple manner in terms of construction. Furthermore, it is easy for a user to assess whether the quality of the recording created by the identification unit is sufficient for identifying the marker or the workpiece. As an alternative or in addition to this, the recording can be made in the wavelength range that is not visible to the human eye, for example in the IR range, in the UV range and / or in the ultrasound range.

At least one algorithm of the method can be used to identify or assign the recording of the workpiece to stored object data, in particular a workpiece drawing, a production order. Several algorithms are preferably used.

The algorithm or the algorithms can be stored in a production control. The production control can be designed to be distributed over several devices.

A recording extraction algorithm particularly preferably extracts recording features from the recording. More preferably, an object extraction algorithm extracts object features from stored object data, in particular a workpiece drawing, of a production order. A comparison algorithm can compare the recording features with the object features and output assignment information with regard to the assignment of the recording to the production order. Features are thus preferably extracted from the recording as well as from the stored object data. This enables a particularly high success rate in identifying the workpiece.

Several recordings of the workpiece can be recorded with the image recording device. The recording features can then be extracted from several recordings. Allocation information can be output from several recordings for the stored objects. It has been shown that the creation and processing of multiple recordings significantly improves the quality of the assignment information, since in particular the influence of artifacts caused by the recording position is reduced.

The recording extraction algorithm and / or the object extraction algorithm can read in data of the recording or the stored object data, process them as a function of predetermined recording parameters or object parameters and take recording features or object features in the form Output processed data. The predefined recording parameters or object parameters can have weighted variables.

The recording features and / or the object features can be in the form of component dimensions, number of characteristic features (e.g. holes), the arrangement of certain features relative to one another and / or differences in the component geometry between two or more workpieces. In this way, a particularly reliable assignment of the receptacle to a specific production order can be achieved.

A user evaluation of the assignment information can further preferably be read out. Based on the user evaluation, the assignment of the recording to a production order can be confirmed or corrected. The evaluation by the user can be done by data transmission or by a Input device, in particular button, touch screen, voice recording, speech recognition or similar input devices.

Furthermore, the outputting of the assignment information of the recording preferably includes the output of several assignment options. The identification of the workpiece can thus be carried out with a high probability of success.

The output of the assignment information of the receptacle can include the output of assignment probabilities to different stored objects of different production orders. If, for example, two or more identification hits are displayed to the user, sorted according to the probability, then the user can choose the one which, in his opinion, really matches. He has thus given a user rating. This can make it possible to improve assignment information that will be issued in the future.

The user evaluation of the assignment information can be stored in a user evaluation results memory. Saving the user rating enables a large number of user ratings to be collected, as a result of which the recording extraction algorithm, the object extraction algorithm and / or the comparison algorithm can be significantly improved.

The user evaluation results memory can be cloud-based. Cloud-based here means a, in particular locally remote, preferably anonymized, storage device in which user reviews from more than one user, advantageously from several hundred or several thousand different users, are stored. In this way, different users can contribute to the optimization of the process regardless of the manufacturing location.

As an alternative or in addition to this, the production control can be designed to be cloud-based.

The recording extraction algorithm, the object extraction algorithm and / or the comparison algorithm preferably has / have an algorithm with a plurality of data aggregation routines. A data aggregation routine can be designed to aggregate several “determined data” into a new data packet. The new data packet can have one or more numbers or vectors. The new data packet can be made available in full or in part to further data aggregation routines as “determined data”. “Determined data” can be, for example, recording data, object data, or data packets made available by one of the data aggregation routines.

The recording extraction algorithm, the object extraction algorithm and / or the comparison algorithm is / are particularly preferably designed in the form of an algorithm with several connected data aggregation routines. In particular, several hundred, in particular several thousand, such data aggregation routines can be connected to one another. This significantly improves the quality and speed of the algorithm (s). The recording extraction algorithm, the object extraction algorithm and / or the comparison algorithm can / can have a function with weighted variables.

One, in particular several, particularly preferably all, data aggregation routines can be designed to combine several “determined data” in each case with a weighted variable, in particular to multiply, and thus to convert the “determined data” into “combined data” in order to then aggregate the “combined data” into a new data packet, in particular to add it up.

The change in weighting, in particular the change in the weighted variables, is particularly preferably carried out on the basis of the user evaluation. To determine suitable weighted variables, the recording extraction algorithm, the object extraction algorithm and / or the comparison algorithm can be run through with data, in particular recording data and / or object data, whose association is known in each case. The weighted variables can be determined, preferably in a first phase, separately for the recording extraction algorithm, the object extraction algorithm and the comparison algorithm.

The recording features and object features can themselves be data packets, in particular several structured data, in particular data vectors or data arrays, which themselves again "determined data", e.g. for the comparison algorithm, in particular for the data aggregation routines of the comparison algorithm, can represent. The exact structure of these recording features and object features can change, in particular improve, preferably optimize, as a result of the machine evaluation of the user assessment.

If the weighted variables changed, in particular improved, preferably optimized, which have been changed by the user evaluation of a first user or a first group of users are managed in a cloud-based manner, further can also be used Users use this in their algorithms and benefit from the process.

The algorithms mentioned or another secondary or superordinate algorithm can be designed to monitor and recognize when one or all of the algorithms output assignment information with a predetermined accumulation that is rated as bad by the user and then output a negative message. The output can take place visually, e.g. on a screen or in another suitable form, e.g. as data output. The monitoring algorithm can also be designed to respond to the output of such a negative message with an improvement routine that changes further properties or the interaction of one or more of the algorithms mentioned.

The comparison algorithm can comprise the formation of a scalar product and / or the formation of a difference between the reception features and the object features. The aforementioned measures have proven to be particularly effective in assigning the recording features to the object features.

In a particularly user-friendly embodiment of the invention, the assignment of the production order is displayed on the marker.

In general, at least one method step can be carried out at least partially cloud-based. This enables a large number of users to implement the method quickly and effectively.

The marker can indicate the progress of the process by means of visual and / or acoustic effects, in particular by means of colored lighting or flashing. For example, the marker can flash in a first color, in particular blue, while the marker is assigned to a production order and light up in the first or a second color, in particular green, when the assignment has been made.

The object according to the invention is further achieved by a device for assigning a marker of a position determination system to a production order, the device having a marker of a position determination system, an identification unit with an image acquisition device and a control device which is designed to receive a recording made with the image acquisition device, object data , in particular to assign a workpiece drawing to a production order, to identify the marker and to assign the marker to the production order.

The device according to the invention is preferably designed to carry out a method described here.

The device can have the following: an image acquisition device for taking a picture of the workpiece; a recording extraction unit with a recording extraction algorithm for extracting recording features from the recording; an object extraction unit with an object extraction algorithm for extracting object features from the stored object data; a comparison unit with a comparison algorithm for comparing the recording features with the object features; wherein the recording extraction algorithm, the object extraction algorithm and / or the comparison algorithm is preferably designed so that it can be optimized on the basis of the user assessment; and an output unit for outputting assignment information of the recording made with the image capturing device to the stored object data.

The device can furthermore have an input unit for reading out a user evaluation with regard to the assignment information.

As an alternative or in addition to this, the device can have a user evaluation results memory for storing the user evaluation of the assignment information. The user evaluation results memory can be cloud-based.

The recording extraction algorithm, the object extraction algorithm and / or the comparison algorithm can be designed in the form of an algorithm with a plurality of connected data aggregation routines.

The identification unit can be designed in the form of a mobile terminal device, in particular a smartphone or tablet, in order to enable particularly user-friendly operation.

The image acquisition device can be designed in the form of a camera, in particular for visible light.

The device preferably has at least one algorithm that is at least partially cloud-based.

The marker can more preferably have a display for displaying the production order. In this case, a user can immediately see which production order the marker in front of him is assigned to. The display can be designed in the form of an e-ink display.

The marker can have a light in order to be able to display the assignment of a production order to the marker. The lamp can be designed to flash in a first color as long as the assignment is being carried out. As an alternative or in addition to this, the lamp can be designed to light up in the first or a second color when the assignment has been made.

The identification unit can have an application, in particular in the form of a web application, which supports the user in creating the recording of the workpiece. The identification unit can be designed to start the application as soon as the user has identified the marker.

The method and / or the device can be used particularly advantageously in industrial production with a computer-based production control for processing reflective objects, in particular sheet metal parts. In the past, recordings of sheet metal parts with an image capture device were often of insufficient quality for identification, because contours can only be distinguished from the background with great difficulty and light reflections simulate false contours. For this reason, methods and devices that compare recording data with object data without the algorithms described have so far not led to any success in industrial production. With reflective objects are meant objects with a smooth surface that reflect the light in such a way that when the recording is made, in addition to the contours, undesired light reflections from other objects can also occur. Examples of such reflective objects are metals, glass, plastics with a smooth surface, coated materials, such as coated plates made of plastic, wood, metal, glass, etc.

It is particularly advantageous if the production control is at least partially cloud-based. Parameters, in particular the weighted variables, can then be used for changing, in particular improving, in particular optimizing, the algorithms from a first production facility in other production facilities, and vice versa. There is a much larger database available and the identification for each individual manufacturing company can be significantly improved.

Further advantages of the invention emerge from the description and the drawing. The features mentioned above and below can also be used according to the invention individually or collectively in any combination. The embodiments shown and described are not to be understood as an exhaustive list, but rather have an exemplary character for describing the invention.

Figure list

• 1 shows schematically an embodiment of a method according to the invention with method steps a) to f) or a device according to the invention.

1 shows an apparatus 10 with an identification unit 12th . The identification unit 12th is designed here in the form of a smartphone. The identification unit 12th comprises an image capture device 14th on. The image capture device 14th is designed here in the form of a camera for taking photos and / or videos.

The device 10 further comprises a marker 16 . The mark can be used as a traceable tag in a positioning system. The marker 16 has a display 18th , here in the form of an e-ink disk display. The text "Ready" displayed in this example shows a user that the marker 16 is ready for use.

The marker 16 still has a lamp 20th on. Preferably the marker is 16 disc-shaped or Puk-shaped. The lamp particularly preferably extends 20th - as in the present example for the disc-shaped marker 16 shown - extensively, especially extensively, of the marker 16 .

The marker 16 is used to track or determine the position of a workpiece 22nd through the positioning system. The method according to the invention and the device according to the invention 10 relates to the simple and reliable assignment of the workpiece 22nd for a production order 24 (see process step c). To do this, the marker 16 on the identification unit 12th identified according to a method step a). The workpiece continues 22nd according to a method step b) on the identification unit 12th identified. The identification of the workpiece 22nd on the identification unit 12th can be before, after or simultaneously with the identification of the marker 16 on the identification unit 12th respectively. The marker is preferably identified first 16 on the identification unit 12th , whereupon an application (application) on the identification unit 12th is started, which a user in the identification of the workpiece 22nd supported, for example, by the image capture device 14th is started.

The identification of the marker 16 according to method step a) can be done by reading out an NFC coil (not shown) of the marker 16 on the identification unit 12th respectively. Alternatively or in addition to this, the identification of the marker can be used 16 by optically detecting a character on the marker 16 by means of the image capture device 14th respectively. As an alternative or in addition to this, the marker can also be used 16 Accelerometers (not shown) have the identification unit 12th submit when the marker 16 is shaken.

The identification of the workpiece 22nd on the identification unit 12th takes place by creating a recording by means of the image capturing device 14th . The recording can be made in the form of one or more photos and / or a video.

In a process step c), the created recording becomes a production order 24 assigned. In the production order 24 in the present case is the production of the workpiece 22nd (see process step a)) from a sheet metal section 26th saved. The workpiece to be produced 22nd is here in the form of object data 28 saved. The stored object data 28 can in particular be stored in the form of a workpiece drawing. The created recording is now this stored object data 28 assigned. 1 shows in method step c) a selection presented to the user on a display of the identification unit 12th . The three production order proposals shown are sorted according to their assignment probability. Several suggestions can thus be made to the user as to which production order 24 the workpiece 22nd corresponds to. The assignment of the workpiece 22nd for a specific production order 24 can be done with the help of algorithms that are at least partially in a cloud 30th can be executed. The algorithms can include a shot extraction algorithm, an object extraction algorithm, and a comparison algorithm. The recording extraction algorithm extracts recording features from the recording. The object extraction algorithm extracts object features from the stored object data 28 . The comparison algorithm compares the recording features with the object features. The comparison algorithm can use the in 1 assignment information shown on the identification unit in method step c) 12th output.

According to method step d), the inclusion of a specific production order 24 assigned. In the present example, this is done through a user evaluation of the assignment information. In the present example, the user has the production order displayed at the top 24 selected (represented by hatching on the display of the identification unit 12th ). In particular, the user can enter his user rating by tapping. The identification unit 12th reads out this user rating.

Particularly preferably, the read-out assignment information from the user is used to set the algorithms for recognizing the correct production order 24 to optimize based on the recording.

More preferably, at least one algorithm described here, preferably several algorithms described here, each has data aggregation routines.

After the identification unit 12th now both the marker 16 as well as that of the workpiece 22nd associated production order 24 are known, this information is linked in a method step e). The marker 16 becomes a concrete production order 24 assigned. In the present case, the object data 28 of this production order 24 on the display 18th of the marker 16 displayed. While the information is being linked, the luminaire 20th flash. Once the marker 16 the production order 24 is permanently assigned, the luminaire can 20th light up or go out permanently.

In a method step f), the user creates the workpiece 22nd with the marker 16 physically connected. In the present case, the workpiece 22nd on the marker 16 hung up. Optionally, the marker 16 a holding device (not shown), for example a magnet and / or a mechanical latching device, to connect the workpiece 22nd with the marker 16 to facilitate.

Taking all representations of the drawing together, the invention relates to a method and a device in summary 10 to “marry” a marker 16 an indoor location system with a specific production order 24 . The marker 16 is the production order 24 assigned by an identification unit 12th a recording of a workpiece 22nd created. The identification unit 12th identifies this workpiece 22nd by analyzing the recording of the workpiece 22nd and comparison of this recording with stored object data 28 various production orders 24 . The assignment of the recording to a specific production order 24 preferably takes place through the use of image recognition algorithms. These image recognition algorithms are preferably based on data aggregation routines. A user input can be a proposed production order 24 confirm or correct. The identification unit 12th continues to identify the marker 16 . Eventually the marker becomes 16 the production order 24 assigned. The assignment can be made on the marker 16 are displayed.

List of reference symbols

10

contraption

12th

Identification unit

14th

Image capture device

16

marker

18th

Display

20th

lamp

22nd

workpiece

24

production order

26th

Sheet metal section

28

Item data

30th

Cloud

QUOTES INCLUDED IN THE DESCRIPTION

This list of the documents listed by the applicant was generated automatically and is included solely for the better information of the reader. The list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions.

Patent literature cited

• DE 102017121098 A1 [0003]
• DE 102017120381 A1 [0004]

Claims (15)

Method for assigning a marker (16) of a position determination system to a production order (24), with the method steps: a) identifying the marker (16) on an identification unit (12); b) creating a recording of a workpiece (22) with an image capturing device (14) of the identification unit (12); wherein process step a) is carried out before, after or during process step b); c) assigning the recording to a production order (24); d) Assigning the marker (16) to this production order (24). Procedure according to Claim 1 , in which the identification in step a) takes place by creating an at least partial recording of the marker (16) with the image capturing device (14). Procedure according to Claim 1 or 2 , in which the identification in step a) takes place through near-field communication. Method according to one of the preceding claims, in which the identification in step a) takes place by shaking an acceleration sensor of the marker (16), the marker (16) transmitting a signal to the identification unit (12) due to the shaking. Method according to one of the preceding claims, in which an identification unit (12) in the form of a mobile terminal is used. Method according to one of the preceding claims, in which an image acquisition device (14) in the form of a camera is used to create recordings with light in the visible wavelength range. Method according to one of the preceding claims, in which the assignment in step c) takes place in that a recording extraction algorithm extracts recording features from the recording and an object extraction algorithm extracts article features from stored object data (28) of the production order (24), a comparison algorithm compares the recording features with the object features and outputs assignment information relating to the recording for the production order (24). Procedure according to Claim 7 , in which a user evaluation of the assignment information is read out, on the basis of which the assignment of the recording to the production order (24) is confirmed or corrected. Method according to one of the Claims 7 or 8th , in which the output of the assignment information of the receptacle comprises the output of assignment probabilities to different stored object data (28) of different production orders (24). Method according to one of the Claims 7 to 9 , in which the recording extraction algorithm, the object extraction algorithm and / or the comparison algorithm has / have interconnected data aggregation routines. Method according to one of the preceding claims, in which in method step d) the assignment of the production order (24) is displayed on the marker (16). Method according to one of the preceding claims, in which at least one method step is carried out at least partially cloud-based. Device (10) for assigning a marker (16) of a position determination system to a production order (24), the device (10) having the following: A) a marker (16) of a position determination system; B) an identification unit (12) with an image capturing device (14); C) a control device which is designed to assign object data (28) of a production order (24) to a recording made with the image recording device (14), to identify the marker (16) and to assign the marker (16) to the production order (24). Device according to Claim 13 , in which the device (10) has at least one algorithm which is at least partially cloud-based. Device according to Claim 13 or 14th , in which the marker (16) has a display (18) for displaying the production order (24).

Images