EP3388376A1 - Method and device for monitoring the transport of products and a system for producing, processing and/or testing products - Google Patents

Abstract

The invention relates to a method and a device for monitoring the transport of products as well as a system with such a device. In this case, images of individual products are detected by means of an image capture device when the products pass through the image capture device. In addition, times are recorded at which the images of the products are recorded. The acquisition of the images is monitored on the basis of a determined period of time between two consecutive times at which two images are successively acquired and a transport time which is predetermined by a transport speed at which the products pass through the image capture device.

Description

The invention relates to a method and a device for monitoring the transport of products, in particular sheet material, preferably paper sheets, films, sheet-like substrates or banknotes, or packaging, and a system for producing, processing and / or testing of products, in particular sheet material.

Processes for the production, processing and / or testing of sheet material generally have several steps, in which, for example, individual sheets or substrates are provided, different colors or inks are applied, security features are incorporated and the individual sheets or substrates are divided into smaller units, about banknotes, to be parted.

In these methods, individual sheets of the sheet material are usually transported by a transport system, for example by one or more conveyor belts or rollers, through corresponding manufacturing, processing or testing devices and / or from such a device to the next. The transport of the sheet material in or between the devices is frequently monitored by means of cameras.

It is an object of the present invention to improve the monitoring of the transport of products, in particular sheet material, preferably paper sheets, films, sheet-shaped substrates or banknotes, or packaging, in particular to increase the reliability of the monitoring.

This object is achieved by the method, the device and the system according to the independent claims.

The method according to the invention for monitoring the transport of products, in particular sheet material, for example paper sheets, films, sheet-like substrates or banknotes, or packaging, in particular of tobacco products or pharmaceuticals, comprises the following steps: (i) capturing images of individual products, in particular sheets of the product Sheet goods, by means of an image capture device, when the products, such as sheets, pass through the image capture device, (ii) detecting times at which the images of the products are captured, and (iii) determining a time period between two consecutive times at which two images sequentially acquire and (iv) monitoring the capture of the images based on the determined time duration and a transport time dictated by a transport speed at which the products pass through the image capture device.

For simplicity, often only the use of sheets of sheet material will be listed below. Of course, the features associated with the corresponding paragraph may also be applied and applied to monitoring the transport of other products such as paper sheets, foils, banknotes, or packages, particularly tobacco or pharmaceuticals.

The device according to the invention for monitoring the transport of products, in particular sheet material such as paper sheets, foils, sheet-like substrates or banknotes, has an image capture device which is adapted to capture images of individual products, such as sheets of the sheet material, when these products, For example, leaves, the image capture device happen. In addition, a time recording device is provided, which is set up to record times at which the images of the products, for example sheets, are recorded. Further, a control device is provided, which is adapted to determine a period of time between two successive times at which two images are successively detected and capturing the images based on the determined time duration and a transport time, by a transport speed at which the products For example, leaves passing the image capture device are predetermined to monitor.

The system according to the invention for the production, processing and / or testing of products, in particular sheet material, for example of paper sheets, films, sheet-like substrates or banknotes, or packaging, in particular of tobacco products or pharmaceuticals, comprises an apparatus for the production, processing or testing of products , For example, leafing of the sheet, a device for transporting the products, for example leaves, and an inventive device for monitoring the transport of products, for example, sheet material on.

The sheet or sheets may be separate or present as a sheet as a sheet. In particular, it may be provided that the web has areas corresponding to the sheets, wherein in one step during the manufacture of a final product, the sheets are separated from the web, so that there are separate (single) sheets. For example, the web may already be a paper web during paper sheet formation, ie during drying. In this case, the sheets, which are separated to a later step, already be determined, so that corresponding to the paper web, the areas are assigned. The assignment can imaginary, ie not visible and deposited only in a data processing unit, and / or be characterized by optical identification. A sheet can also be viewed as a sheet or sheet.

One aspect of the invention is based on the approach of monitoring the acquisition of images of the transported products undertaken during the monitoring of the transport of the product by recording the time of image acquisition for each acquired image and the time interval between two subsequently acquired times Image capture and a predetermined transport time is checked for irregularities in image acquisition has come.

In this case, the transport time preferably corresponds to a time duration which the individual products, for example sheets, transported at a predetermined transport speed require in each case on average in order to reach the position of the respectively preceding product. In the production, processing and / or testing - hereinafter also referred to simply as "processing" - of products, such as sheet material, the individual products, such as leaves, are usually transported at a substantially constant transport speed, so that the transport time, in which a product reaches the position of the respective preceding product, for example in the region of the image capture device, is also substantially constant.

On the other hand, the time period between two consecutive times at which two images of the products are successively detected by the image capture device may be subject to random or systematic fluctuations and, for example, depend on the image capture process in the image capture device. For example, the readout duration of individual pixels of a CCD camera designed image capture device vary, so that the time interval between two consecutively detected by the image capture device images varies.

If the determined period of time between the two times at which two images of the products are successively detected coincides substantially with the transport time, it can be assumed that all products passing through the image capture device were detected. On the other hand, if the determined period of time deviates from the transport duration, it can be assumed that at least one product has not been detected or at least one product, for example a sheet of the sheet material, has been detected several times while the image capture device has passed through it.

On the basis of the result of this check, for example, a balance of the processed products can be corrected accordingly, without the need for a complex, usually manual, search for supposedly missing products.

Overall, the invention thus allows a more reliable monitoring of the transport of products, such as sheet material.

As an alternative or in addition to monitoring the image acquisition and possible correction of the balancing of the processed products, a device by means of which the products are transported, manufactured, processed and / or tested can be controlled on the basis of the result of the aforementioned examination. For example, the transport speed can be reduced if the detected time period is greater than the transport time. Alternatively or additionally, the preparation, testing or processing the products are interrupted or controlled so that a non or multiple imaged product is removed from the machining process.

The detected times at which the images of the products were detected and the respective captured images of the products are preferably stored together by e.g. be linked together in a database. Each recorded image of a product is thus permanently assigned a specific time, which is why the recorded times can also be referred to as the "time stamp" of the respective images.

In a preferred embodiment, it is checked on the basis of the determined time duration and the transport duration whether the image capture device has in each case captured an image of each product, for example a sheet which has passed through the image capture device. If the determined period of time coincides substantially with the transport time, ie within the scope of a predetermined tolerance, the operation of the image capture device can be classified as error-free, so that the number of captured images corresponds to the number of products that have passed through the image capture device. If the determined time duration is greater than the transport time, at least one product, for example a sheet of the sheet material, has not been or not completely detected, and the operation of the image capture device can be classified as faulty. If the determined time duration is shorter than the transport time, at least one product has been recorded several times. The operation of the image capture device can also be classified as defective. In the latter two cases, the number of images captured in each case then does not correspond to the number of products that the image capture device actually passed. This way is easy and reliably recognize whether a subsequent correction of the balancing of the processed products is required.

In a further preferred embodiment, based on the determined time duration and the transport time, a first number of products, for example sheets, is determined, of which no image was detected when passing through the image capture device. For this purpose, for example, a quotient of the determined time duration (numerator) and the transport duration (denominator) can be formed, the value of the quotient, rounded to an integer, if appropriate, corresponding to the quotient of the first number. Alternatively, a difference from the transport duration and the determined time duration can be formed, which is compared with predetermined, in each case a first number assigned, difference values in a table (so-called look-up table, LUT). In this way, the first number of unrecorded products is easily and reliably determined and, if necessary, measures can be taken to retrieve the unrecorded products and / or correct the accounting of the processed products.

In a further preferred embodiment, a second number of products, in particular sheets, is determined on the basis of the determined time duration and the transport time, from which several images were respectively captured when passing through the image capture device. For this purpose, for example, a quotient of the transport duration (counter) and the determined time duration (denominator) can be formed, the value of the quotient of the second number, rounded to an integer, if appropriate. Alternatively, a difference from the transport duration and the determined time duration can be formed, which is compared with predetermined, in each case a second number assigned, difference values in a table (so-called look-up table, LUT). In this way, the second number will be multiple reliably detects detected products, and if necessary, measures can be taken to subsequently correct the balancing of the processed products.

In a further preferred embodiment, when capturing the images of individual products, in particular sheets, an individual marking, with which the products are provided, is detected in each case. In each case, an identification information of the products is determined from the detected individual marking. The individual marking can be embodied as a character string printed on the individual products, in particular letter sequence and / or number sequence, which can be detected by the image capturing device and subsequently converted into the identification information of the products by image analysis, for example by the control device.

Alternatively or additionally, the individual marking can also be designed as a haptic pattern, for example as a perforation, and / or electrical, magnetic and / or electromagnetic element, for example as a magnetic pattern or RFID chip. In this case, the individual marking is preferably detected by a mark detection device before or after capturing the images, in particular substantially simultaneously with the images.

In the case of both embodiments described above, it can be reliably monitored which of the products are or have been transported past the image capture device or the marker acquisition device.

In a further preferred embodiment, the detected times at which the images of the products, such as sheets, have been detected, and the respectively detected individual marking and / or the identification information of the products determined therefrom are stored together. Preferably, the detected times, the detected individual markers and / or the determined identification information are stored in a database in which they are or will be linked.

This makes it possible during, but also after the transport of the products, to determine, based on a predetermined identification information, the point in time at which an image of the product having the predetermined identification information was acquired. Conversely, the identification information of a product whose image was acquired at a given time can also be determined. In particular, the transportation of the products can also be reconstructed in retrospect or verify the passage through a transport route monitored according to the invention.

For example, it can be checked whether a banknote brought into circulation has already been transported by an inspection device at an earlier point in time and has been checked for authenticity.

In a further preferred embodiment, based on the determined identification information of individual products, identification information and / or position of products, of which no image was detected when passing through the image capture device, are determined in each case. Preferably, the identification information and / or position of a product from which no image has been acquired is based on the identification information of the product preceding and following this product, from which an image was respectively captured when passing through the image capture device, determined.

For example, when a plurality of sheets are wound on a roll, the position of a non-imaged sheet on the roll can be determined by associating the order of captured images of the sheets with the order of the sheets on the roll. If, when capturing the images of the sheets closed on a non-pictorially recorded sheet, it can be concluded on the basis of the positions of the previously and then graphically recorded sheets on the position and, if necessary, the identity of the non-pictorially recorded sheet on the roll. Likewise, for example, the position of a banknote, which is transported by a testing device, in the testing device or in a banknote stack after passing through the testing device can be determined.

In a further preferred embodiment, in each case at least one property of the individual products, for example leaves, is also recorded and stored together with the detected times at which the images of the products were acquired. The detected property can relate, for example, to fitness (state), a manufacturing state, manufacturing information and / or test information. Preferably, the at least one detected property is stored together with the detected time in a database in which the detected properties are associated with the detected times, and preferably also with the identification information of the respective products.

As a result, even after the product has been transported, for example, the sheet material, it can be ascertained which product, in particular which sheet, at what time, in which state and / or in which processing device was transported. In particular, the result of a test can be stored and retrieved if necessary.

In a further preferred embodiment, the detected times at which the images of the products are detected, on a time, in particular a local time or the world time, or on a predetermined time scale, in particular a machine cycle of a device for producing, processing and / or testing the Products, related. As a result, two recorded times at which two images of the products have been recorded can be simply and reliably related to each other and a period of time between two recorded times can be determined.

If the detected times relate to a time, it is possible by means of the link with the identification information in the database to document for each product uniquely, in particular independently of the respective individual machine cycle, when and where, where appropriate, e.g. during manufacture, processing and / or testing, an image of the product concerned has been collected by the image capture device.

On the other hand, if the detected times relate to one machine cycle, it is possible in particular to reliably determine at which position the product whose image was acquired at the time acquired is located in the relevant device or when it was processed relative to other products.

Furthermore, the detected times may relate to the reaching or passing of the products of the image capture device. It is thus detected the time at which each product reaches or passes the image capture device and each image thus receives one corresponding timestamp. In the case of a comparison with the transport duration, it can be checked during monitoring whether a delay has occurred. If an unambiguous identification is assigned to the image, it can also be determined which product is not transported according to the determined time duration.

In one embodiment, during the transportation of products, several, at least two, image capture devices may be provided in the transport path of the products, with at least two images from the at least two image capture devices being captured for a product, for example for each leaf. For each image of a product, a detection time is detected in each case and the time duration between the, preferably successively, detected detection times determined. On the basis of the time period between the acquired acquisition times and the transport time, it can be checked for each individual captured image whether the product is present and whether the product also passes the image capture device according to the transport time at the expected or correct time. If a deviation is recognizable, this may be a malfunction in the operating procedure, in particular an unauthorized stealing of the product from the transport path and subsequent positioning of the product in the transport path or an exchange of the product. Again, it is particularly advantageous if each sheet has a unique identification.

Fig. 1

ein Beispiel einer Vorrichtung zum Überwachen des Transports von Blattgut;

Fig. 2

ein Beispiel eines System zur Herstellung, Verarbeitung und/oder Prüfung von Blattgut; und

Fig. 3

ein Beispiel von in einer Datenbank gespeicherten Informationen.

Further advantages, features and applications of the present invention will become apparent from the following description taken in conjunction with the figures. Show it:

Fig. 1

an example of a device for monitoring the transport of sheet material;

Fig. 2

an example of a system for the production, processing and / or testing of sheet material; and

Fig. 3

an example of information stored in a database.

FIG. 1 shows an example of an apparatus for monitoring the transport of sheet material with an image capture device 1, for example a camera that captures images of leaves Bn, which are transported by means of a transport device 3, eg a conveyor belt in the transport direction R past the image capture device 1. The sheets may be sheet material of all kinds, for example paper sheets, films, sheet or sheet-shaped substrates or documents of value, in particular banknotes.

Furthermore, a time detection device 7 is provided, which detects the times T _n at which the image capture device 1 detects an image of the leaves B _n . The time points T _n at which images of the leaves B _{n were} detected are marked on a drawn-in time ray t. In the present example, the time recording device 7 is integrated in the image capture device 1. In principle, however, the time recording device 7 can also be a separate device from the image capture device 1.

The leaves B _n pass through a detection area 4 of the image capture device 1 at preferably regular time intervals, for example are given by a machine or processing cycle and are referred to in the context of the present invention as transport duration dR. The transport time dR is essentially given by the transport speed of the sheets B _n and the spatial distance between two adjacent sheets B _n along the transport direction R.

In the illustrated example, the time points T _n marked on the time beam t respectively correspond to the time at which an image of the sheet B _n with the same index n was acquired. Accordingly, the time ray t has no time T ₀ in a region of a sheet B ₀ of which no image was detected in the present example.

By checking the durations dT between two subsequently acquired times T ₁ to T ₄ (ie T ₂ -T ₁ , T ₃ -T ₂ and T ₄ -T ₃ ) can determine whether the image capture device 1, if necessary, from a sheet ( in the present example sheet B ₀ ), which has passed the image capture device 1, has not captured an image.

Corresponds for example to a determined period of time dT (in this case T ₃ - T ₂₎ of a by an integer factor (in this case a factor of 2) multiplied transport time dR, can be made of the factor (factor of 2) the exact number (factor of 2 - 1 = 1 ) of the leaves B ₀ , of which no image was acquired within the determined time duration dT.

At the same time, with the images of the sheets B _n, an individual feature 11 of the sheets B _n , for example, a serial number, can be detected by the image capturing device 1 or a feature detecting device 2, and if necessary, identification information of the sheets B _n derived therefrom become. On the basis of the individual features 11 and the identification information also leaves B _{0 can be} identified, of which no image was detected. If, for example, it is determined that the determined time duration dT between two times T ₂ and T ₃ , for which an image of a sheet B ₂ and B _{3 was} detected, is within the scope of a predetermined tolerance, approximately twice as long as the transport time dR be concluded that another sheet B _{0 is located} at a position between the two sheets B ₂ and B ₃ , each of which an image at one of the two times T ₂ and T _{3 was} detected. The identification information of the sheet B ₀ from which no image was acquired can be derived, in particular, from the identification information of the two sheets B ₂ and B ₃ , one of which has been captured at one of the two times T ₂ and T ₃ estimate, for example, by accepting consecutive serial numbers.

As a result, the transport of sheets B _n can be reliably monitored even in the event of dropouts, at least during short-term malfunctions, of the image capture device 1.

FIG. 2 shows an example of a system 100 for processing sheets B, in particular of paper sheets, foils, sheet-shaped substrates or banknotes, with a first processing device 5 and a second processing device 5 '. Each of the processing devices 5, 5 'is associated with a transport device 3, a feature detection device 2 and a device 10 connected to a database 6 for monitoring the transport of the leaves B.

Each of the devices 10 has an image capturing device 1 for capturing images of the sheets B passing through the image capturing device 1, a time detector 7 for detecting the timings at which the images were respectively acquired and a control device 8. On the basis of the detected times, the control device 8 in each case determines a time duration between two successive times at which images of the leaves B passing through the image capture device 1 were acquired successively.

The control device 8 monitors the acquisition of the images based on the determined time periods and a transport time, which is predetermined for example by a machine or processing cycle. The above statements in connection with FIG. 1 apply accordingly.

The system 100 can be used, for example, in the production of banknotes. When passing through process steps in the first processing device 5, for example, sheets B in the form of paper sheets are unwound from a roll (not shown), printed, provided with security features and rewound onto a roll (not shown). The wound on the roll sheets B or sheets are conveyed in a separate, schematically indicated transport step 9 from the first to the second processing device 5, 5 '. In the second processing device 5 ', the sheets B or sheets are then unwound from the roll, subjected to a check and, for example, cut into banknotes. For reasons of clarity, the sheets B in the first and second processing device 5, 5 'only strongly schematized and identical reproduced, even if there is a change in shape, size and / or surface finish due to the respective manufacturing, processing or processing steps.

In order to be able to follow the production process of the bank notes in detail, the image capture devices 1 are preferably designed to detect individual markings 11 on the leaves B, from which the control device 8 can derive identification information in each case. Such individual markers 11 may be, for example, character strings printed on an edge of the sheets B.

In addition, the image capture devices 1 can also detect further properties of the sheets B, for example the respective production state, such as a paint application, applied films or security features.

The images and properties of the sheets B acquired by the image acquisition device 1 of the first processing device 5 are recorded in the database 6 together with the respectively acquired points in time at which the images are acquired, the identification information and optionally with further information, for example an identification number of the processing device 5 saved.

As a result, during or after the process steps in the second processing device 5 ', for example by the control device 8 of the second processing device 5', it can be checked whether all the sheets B or sheets processed by the first processing device 5 are also processed in the second processing device 5 ' or by comparing the information stored in the database 6 with information acquired during processing in the second processing device 5 '.

In particular, it can be monitored whether the order of the sheets B to be processed in both processing devices 5, 5 'coincides based on a comparison of the times detected by the time recording device 7 in the first and second processing devices 5 and 5' and the corresponding identification information.

Alternatively or additionally, at least one of the devices 10 can also be used during processing, in particular in the authenticity and / or state examination, of banknotes B in circulation 9. For example, the first processing device 5 is designed as a production device and the second processing device 5 'as a testing device. When checking the banknotes in the second processing device 5 ', for example, the information acquired by the device 10 of the first processing device 5 and stored in the database 6 can be accessed, in addition to checking the current state of the banknote, for example, also a correlation of the state to prepare the history in the production of the banknote or to make a statistical evaluation. In this way, the way of a banknote from the production over several stations in different cash centers up to the destruction can be traced and documented quasi gaplessly (so-called track and trace).

Although the above examples relate to the manufacture or processing of banknotes, the invention can also be used in the production of other objects using sheet-like substrates or sheets, such as in the manufacture of stamps or packages, such as blister packs. The above statements apply accordingly.

FIG. 3 shows an example of information stored in a database 6 concerning the transported sheets.

In the database 6, a plurality of data records 12 are stored, in each of which information regarding a sheet of the processed sheet material is stored. In the illustrated example, the respectively captured image B 'of a sheet is stored at a first position 13 of each data record 12 and the time T at which the image B' was acquired is displayed at a second position 14. The respectively recorded and stored times T can indicate a continuous time or be related to the respective machine cycle. At high transport speeds or processing rates, the temporal resolution of the respective recorded times is correspondingly high. For example, the time resolution of the time recording in the production and / or processing of banknotes is typically milliseconds.

At a third position 15 of the data record 12, an individual feature 11 of the sheet or an identification information derived from the individual feature 11 is stored. At a fourth position 16, finally, at least one information concerning the processing of the sheet, for example an identification number of a manufacturing and / or testing device, is stored.

In the database 6 also information can be stored, which relate to leaves from which no image B 'was detected (see record C). As related to FIG. 1 can be explained by monitoring the transport of adjacent leaves (see memory locations B and D) on the missing identification information (here "125") and possibly also on further missing information, for example, a information related to the manufacturing process (here "1337") are closed.

Although the embodiments of the FIGS. 1 to 3 on sheet material and in particular sheets of sheet material, so this special embodiment is only to be seen as an example. Rather, instead of sheets and packaging or other products can be used.

Claims (13)

Method for monitoring the transport of products, comprising the following steps: - capturing images (B ') of individual products (B) by means of an image capture device (1) when the products (B) pass through the image capture device (1); - detecting times (T) at which the images (B ') of the products (B) are detected; - determining a period of time (dT) between two consecutively detected times (T) at which two images (B ') were successively acquired; and Monitoring the acquisition of the images (B ') on the basis of the determined time duration (dT) and a transport time (dR) which is predetermined by a transport speed with which the products (B) pass through the image acquisition device (1). A method according to claim 1, wherein the product comprises sheet material, in particular sheets of sheet material, paper sheets, films, sheet-like substrates or banknotes, or packaging, in particular of tobacco products or pharmaceuticals. A method according to claim 2, wherein when capturing images (B ') of individual products (B) by means of the image capture device (1) images (B') of individual sheets (B) of sheet material are detected. Method according to one of the preceding claims, wherein it is checked on the basis of the determined time duration (dT) and the transport time (dR) whether the image acquisition device (1) of each product (B), the has passed through the image capture device (1), in each case has captured an image (B '). Method according to one of the preceding claims, wherein based on the determined time duration (dT) and the transport time (dR) a first number of products (B) is determined, of which no image (B ') was detected when passing through the image acquisition device (1). Method according to one of the preceding claims, wherein based on the determined time duration (dT) and the transport time (dR) a second number of products (B) is determined, of which several images (B ') were detected when passing through the image capture device (1) , Method according to one of the preceding claims, wherein when capturing the images (B ') of individual products (B) in each case an individual marking (11) with which the products (B) are provided, is detected and from the detected individual marking (11) in each case an identification information of the products (B) is determined. A method according to claim 7, wherein the detected times (T) at which the images (B ') of the products (B) were detected, and the respectively detected individual marking (11) and / or the identification information of the products (B) determined therefrom. stored together. The method of claim 7 or 8, wherein based on the determined identification information of individual products (B) each have an identification information and / or position of products (B), of which when passing the image capture device (1) no image (B ') was detected, is determined. Method according to one of the preceding claims, wherein further at least one property of each product (B) is detected and stored together with the detected times (T) at which the images (B ') of the products (B) were detected. Method according to one of the preceding claims, wherein the detected times (T), at which the images (B ') of the products (B) are detected, on a time, in particular a local time or the world time, or on a predetermined time scale, in particular a Machine cycle of a device (5, 5 ') for the production, processing and / or testing of the products (B), are related. Device (10) for monitoring the transport of products, in particular sheet material such as sheets of sheet material, paper sheets, films, sheet-like substrates, banknotes, or packaging, with - an image capture device (1) which is adapted to capture images (B ') of individual products (B) when the products (B) pass through the image capture device (1), a time detecting means (7) arranged to detect times (T) at which the images (B ') of the products (B) are detected, and - A control device (8) which is adapted to a time duration (dT) between two consecutively detected times (T) at which two images (B ') were sequentially detected, and detecting the images (B') based the determined time duration (dT) and a transport time (dR), the by a transport speed at which the products (B) pass through the image capture device (1) is predetermined to monitor. System (100) for the production, processing and / or testing of products, in particular sheet goods such as paper sheets, films, sheet-like substrates or banknotes, or packaging, with a device (5, 5 ') for the production, processing or testing of products (B) of the sheet material, - A device (3) for transporting the products (B) and - A device (10) for monitoring the transport of products according to the preceding claim.

Images