EP3510877B1 - Device and method for inspecting rod-shaped items for the tobacco industry - Google Patents

Device and method for inspecting rod-shaped items for the tobacco industry Download PDF

Info

Publication number
EP3510877B1
EP3510877B1 EP19150463.8A EP19150463A EP3510877B1 EP 3510877 B1 EP3510877 B1 EP 3510877B1 EP 19150463 A EP19150463 A EP 19150463A EP 3510877 B1 EP3510877 B1 EP 3510877B1
Authority
EP
European Patent Office
Prior art keywords
rod
cameras
shaped items
image
conveying
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP19150463.8A
Other languages
German (de)
French (fr)
Other versions
EP3510877A3 (en
EP3510877A2 (en
Inventor
Akram El Jarad
Piotr KOLESNIKOFF
Manfred Folger
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Koerber Technologies GmbH
Original Assignee
Koerber Technologies GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Family has litigation
First worldwide family litigation filed litigation Critical https://patents.darts-ip.com/?family=65003287&utm_source=google_patent&utm_medium=platform_link&utm_campaign=public_patent_search&patent=EP3510877(B1) "Global patent litigation dataset” by Darts-ip is licensed under a Creative Commons Attribution 4.0 International License.
Application filed by Koerber Technologies GmbH filed Critical Koerber Technologies GmbH
Publication of EP3510877A2 publication Critical patent/EP3510877A2/en
Publication of EP3510877A3 publication Critical patent/EP3510877A3/en
Application granted granted Critical
Publication of EP3510877B1 publication Critical patent/EP3510877B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A24TOBACCO; CIGARS; CIGARETTES; SIMULATED SMOKING DEVICES; SMOKERS' REQUISITES
    • A24CMACHINES FOR MAKING CIGARS OR CIGARETTES
    • A24C5/00Making cigarettes; Making tipping materials for, or attaching filters or mouthpieces to, cigars or cigarettes
    • A24C5/32Separating, ordering, counting or examining cigarettes; Regulating the feeding of tobacco according to rod or cigarette condition
    • A24C5/34Examining cigarettes or the rod, e.g. for regulating the feeding of tobacco; Removing defective cigarettes
    • A24C5/3412Examining cigarettes or the rod, e.g. for regulating the feeding of tobacco; Removing defective cigarettes by means of light, radiation or electrostatic fields
    • AHUMAN NECESSITIES
    • A24TOBACCO; CIGARS; CIGARETTES; SIMULATED SMOKING DEVICES; SMOKERS' REQUISITES
    • A24CMACHINES FOR MAKING CIGARS OR CIGARETTES
    • A24C5/00Making cigarettes; Making tipping materials for, or attaching filters or mouthpieces to, cigars or cigarettes
    • A24C5/32Separating, ordering, counting or examining cigarettes; Regulating the feeding of tobacco according to rod or cigarette condition
    • A24C5/34Examining cigarettes or the rod, e.g. for regulating the feeding of tobacco; Removing defective cigarettes
    • AHUMAN NECESSITIES
    • A24TOBACCO; CIGARS; CIGARETTES; SIMULATED SMOKING DEVICES; SMOKERS' REQUISITES
    • A24CMACHINES FOR MAKING CIGARS OR CIGARETTES
    • A24C5/00Making cigarettes; Making tipping materials for, or attaching filters or mouthpieces to, cigars or cigarettes
    • A24C5/47Attaching filters or mouthpieces to cigars or cigarettes, e.g. inserting filters into cigarettes or their mouthpieces
    • A24C5/478Transport means for filter- or cigarette-rods in view of their assembling
    • AHUMAN NECESSITIES
    • A24TOBACCO; CIGARS; CIGARETTES; SIMULATED SMOKING DEVICES; SMOKERS' REQUISITES
    • A24DCIGARS; CIGARETTES; TOBACCO SMOKE FILTERS; MOUTHPIECES FOR CIGARS OR CIGARETTES; MANUFACTURE OF TOBACCO SMOKE FILTERS OR MOUTHPIECES
    • A24D3/00Tobacco smoke filters, e.g. filter-tips, filtering inserts; Filters specially adapted for simulated smoking devices; Mouthpieces for cigars or cigarettes
    • A24D3/02Manufacture of tobacco smoke filters
    • AHUMAN NECESSITIES
    • A24TOBACCO; CIGARS; CIGARETTES; SIMULATED SMOKING DEVICES; SMOKERS' REQUISITES
    • A24DCIGARS; CIGARETTES; TOBACCO SMOKE FILTERS; MOUTHPIECES FOR CIGARS OR CIGARETTES; MANUFACTURE OF TOBACCO SMOKE FILTERS OR MOUTHPIECES
    • A24D3/00Tobacco smoke filters, e.g. filter-tips, filtering inserts; Filters specially adapted for simulated smoking devices; Mouthpieces for cigars or cigarettes
    • A24D3/02Manufacture of tobacco smoke filters
    • A24D3/0295Process control means

Definitions

  • the invention relates to a device in the tobacco processing industry for optically inspecting rod-shaped articles in the tobacco processing industry, the rod-shaped articles each being a combination of a plurality of segments, and the device comprising a conveying element for transversely axial conveying of the rod-shaped articles and the conveying element comprising a plurality of receiving troughs, in which the rod-shaped articles can be received or are received, the device further comprising an image detection device with which the rod-shaped articles arranged in the receiving troughs can be detected or are detected during the transverse-axial conveyance.
  • the invention also relates to a method for optically inspecting rod-shaped articles in the tobacco processing industry, with the rod-shaped articles each being an assembly of several segments and being conveyed transversely axially by a conveying element in a receiving trough of the conveying element.
  • Rod-shaped articles of the tobacco processing industry which are a compilation are made up of several segments are known, for example, as multi-segment filters.
  • errors can occur, for example swapping filter segments, a missing filter segment, an incorrect position or inserting a filter segment with the wrong length.
  • gaps can occur between filter segments or the filter segments can be tilted relative to one another.
  • the EP 1 769 689 A1 a device for measuring properties of multi-segment filters or combinations of filter segments in the tobacco processing industry.
  • the multi-segment filter arrangement is illuminated with a line laser.
  • the light reflected on the surface of the filter segments is received using a line camera, and the data recorded by the line camera is evaluated accordingly.
  • Another device in which multi-segment filters are tested during cross-axial promotion on a conveyor drum is, for example, from DE 10 2009 041 320 A1 famous.
  • the conveyor drum is provided with a lighting device.
  • the multi-segment filters are accommodated in a slotted receptacle, for example a receptacle trough, of this conveying element.
  • a sensor device that is also provided picks up the radiation shining through the multi-segment filter or through the arrangement of a plurality of segments present in the receiving trough. Observation takes place via a mirror, the emitted radiation is collimated using a lens and directed to a CCD camera. In this transmitted light method, filter segments filled with activated carbon are particularly easy to detect.
  • a device for optically checking articles in the tobacco processing industry which comprises an image acquisition device with at least one image sensor and at least one light source for illuminating the article to be checked.
  • the image capturing device comprises a plurality of image sensors arranged next to one another, for example in one or more rows.
  • Each of the image sensors is assigned a cylindrical lens with a rectangular cross-sectional area, which is designed, for example, as a plano-concave cylindrical lens or as a combination of plano-convex and concave cylindrical lenses.
  • DE-A1-10 2016 107 247 discloses the preamble of claim 1.
  • a line camera with a very high resolution would be required in the conventional solutions mentioned above.
  • the segment arrangement would have to be imaged on the line scan camera without distortion or distortion, which requires telecentric optics.
  • telecentric optics With telecentric optics, the light bundles from the observed object area enter the front lens of the objective parallel to the optical axis. For this reason, a telecentric lens is required to have a front lens that is as large as or larger than a maximum size of the object to be viewed. This requirement means, among other things, that telecentric optics are very expensive.
  • telecentric optics are quite large and heavy, so that the design effort to implement the measurement arrangement is correspondingly complex and expensive.
  • a large installation space is required, which in practice often leads to problems in the implementation.
  • the object of the present invention is to provide a device in the tobacco processing industry for optically inspecting rod-shaped articles in the tobacco processing industry and a method for optically inspecting rod-shaped articles in the tobacco processing industry, with which an exact examination of the rod-shaped articles can be carried out with high Resolution can be made, but the design effort should be kept low.
  • the object is achieved by a device in the tobacco processing industry for optically inspecting rod-shaped articles in the tobacco processing industry, the rod-shaped articles each being a combination of several segments, and the device comprising a conveying element for transversely axial conveying of the rod-shaped articles and the conveying element comprises a plurality of receiving troughs in which the rod-shaped articles can be received or are received, the device further comprising an image capturing device with which the rod-shaped articles arranged in the receiving troughs can be detected or are captured during the transverse axial conveyance, the image capturing device having a camera arrangement comprises a plurality of cameras for image acquisition, and wherein the cameras are synchronized in particular for simultaneous image acquisition and these cameras are arranged next to one another in a direction of longitudinal extension of the receiving troughs each camera of the camera arrangement comprises an entocentric lens and uses this to image an object field, which the rod-shaped articles arranged in the receiving recesses pass through during the transverse axial conveyance, onto an image field, with the image field compris
  • the device according to aspects of the invention is based on the technical consideration that the conventional effort, especially the use of telecentric optics and the use of a large line camera with a high resolution, can be avoided by using a camera arrangement that has a plurality of individual cameras arranged side by side. The individual images captured by these individual cameras are offset against each other after capture.
  • the cameras are synchronized, i.e. the individual images of the cameras are captured at the same point in time.
  • a camera arrangement is less expensive than a correspondingly large line scan camera, since the individual cameras can be standard products that are available at a manageable price.
  • no special optics such as telecentric optics, but rather conventional entocentric optics can be used.
  • the fundamentally disadvantageous property of entocentric optics for the measurement task namely distortion, for example pincushion-shaped or barrel-shaped distortion, only plays a subordinate role in the camera arrangement according to aspects of the invention. It does not have a negative effect on the measurement. This is achieved by excluding those edge areas of the image area in which the distortion is high from the measurement task. In other words, only those imaging areas of the cameras are used for the measurement task which lie in a central area in which the entocentric optics also image almost without distortion.
  • the device according to aspects the invention does not take up much space.
  • the entocentric optics are not overly large and can be purchased in good quality at a reasonable price.
  • the object distance can be selected to be relatively small, for example less than 100 mm, 200 mm, 300 mm or less than 500 mm.
  • the camera arrangement is preferably arranged in such a way that the rod-shaped articles are imaged directly with the entocentric lenses of the individual cameras without further optical elements, such as for example one or more prisms or the like.
  • the cameras of the camera arrangements are those with a surface sensor (2D image sensor). In particular, no line scan cameras are used. In particular, the cameras of the camera device are synchronized. In other words, in particular, an image is captured simultaneously with all the cameras in the camera arrangement.
  • the camera arrangement comprises such a large number of individual cameras that it is possible, viewed as a whole, to image the rod-shaped article completely in the central areas of the cameras. After the captured image data have been combined to form a common image, a complete image of the rod-shaped article is available for subsequent analysis.
  • the device is developed in particular in that the processing unit is also set up to quantitatively measure at least one gap between two adjacent segments and/or at least one length of a segment of the rod-shaped article.
  • a qualitative evaluation can also be carried out. For example, it is possible to assess the quality of the cut edge of the individual segments. This is advantageously possible because with the camera arrangement of the device according to aspects of the invention a visual inspection is carried out under supervision, i.e. directly from above. The viewing direction is at least approximately perpendicular to a direction of longitudinal extent of the rod-shaped article. In comparison, if an optical test were to take place with a single entocentric lens, the end faces of the individual segments would be visible at least in the outer segments due to the viewing angle becoming flatter in the edge areas. Such a perspective makes a qualitative assessment of the cut edges difficult or imprecise.
  • the device is further developed in particular in that the image acquisition device and the processing unit are also set up to measure at least one distance between two adjacent segments oriented in the direction of longitudinal extent of the receiving troughs and/or a length of a segment oriented in this direction of longitudinal extent, in particular with an accuracy of better than 0.1 mm.
  • the resolution of the cameras of the camera arrangement is selected such that the resolution of the camera is large enough to achieve the desired resolution given the selected object distance and the optics used.
  • the object distance is 200 mm and a maximum object length is also 200 mm.
  • a resolution of the camera is between 8 and 10 thousand pixels, for example.
  • more than 4 cameras are used in the camera arrangement.
  • the camera arrangement comprises 4, 6, 8 or 10 cameras.
  • the device advantageously allows a very precise measurement the width of the individual gaps between the segments and a very precise measurement of the length of the segments of the rod-shaped article.
  • the device is further developed in particular in that the processing unit is also set up to calibrate the cameras of the camera arrangement by evaluating the image data of adjacent cameras recorded in the overlapping central image areas and determining a displacement vector between the image areas of adjacent cameras.
  • the displacement vector determined as part of the calibration is applied to the subsequent recordings in order to align them with one another, so that overall, i.e. in the joint image, there is an objectively and realistically correct representation of the rod-shaped article.
  • this calibration takes place especially for all cameras. It is also possible to repeat the calibration during the measurement operation, for example at regular intervals.
  • the cameras of the camera arrangement are sensitive in the visible spectral range.
  • the rod-shaped articles are illuminated in overhead light or in transmitted light.
  • a corresponding flash light is actuated simultaneously with a trigger of the individual cameras of the camera arrangement. The image acquisition therefore takes place at the moment when the rod-shaped article, which is received in the receiving trough, is illuminated by the flashlight.
  • the flash device is therefore synchronized with the cameras of the camera device.
  • the image acquisition takes place when the rod-shaped article, which is in the Receiving trough is included, is transported through the field of view of the camera assembly.
  • the conveying element is a conveying drum on which the rod-shaped articles are conveyed transversely and axially.
  • the object is also achieved by an arrangement in the tobacco processing industry, comprising a device according to one or more of the aforementioned embodiments, the arrangement also comprising a rolling device and the device for optically inspecting rod-shaped articles in relation to a conveying direction of the rod-shaped articles upstream the rolling device is arranged.
  • the rolling device comprises, for example, a conveyor drum on which the rod-shaped articles are conveyed transversely and with which the rod-shaped articles are fed to a roller block.
  • the device for optically inspecting the rod-shaped articles is arranged, for example, in such a way that the assembly of the segments is detected directly on the conveyor drum, just before the assembly is rolled into a sheet. In other words, the device for optical testing is therefore arranged immediately before the rolling process.
  • the arrangement is set up to perform process control and/or regulation on the basis of this parameter set. To this end, it is set up, for example, to make an association between a rod-shaped article and a set of parameters. If a rod-shaped article does not meet a predefined quality criterion due to a deviation in one or more parameters from a specified target value, the arrangement is also set up, for example, to eject this rod-shaped article after the rolling process and exclude it from further processing. It is further provided in particular that the parameter set or individual values/parameters are used to readjust and/or regulate the process of assembling the segments. If, for example, the gap between segments is found to be too small, this information can be used to readjust the composition in such a way that the desired target value is maintained in the subsequent compositions.
  • the set of parameters is used within the framework of quality control for the detection of error sources. For example, defective base materials can be identified.
  • the object is also achieved by a method for optically inspecting rod-shaped articles in the tobacco processing industry, in which the rod-shaped articles are each composed of a plurality of segments and are conveyed transversely by a conveying element in a receiving trough of the conveying element, the rod-shaped articles being conveyed during the transverse axial Promotion with a plurality of Cameras are recorded, these cameras being arranged next to one another in a longitudinal extension direction of the receiving trough, characterized in that the cameras are in particular synchronized and the rod-shaped articles are recorded in particular simultaneously and each camera captures an object field partially encompassing the rod-shaped articles entocentrically or at least approximately entocentrically Image field, the image field comprising a central imaging area in which a lens of the camera images without distortion or at least with a distortion below a specified or specifiable limit value, which is surrounded by an imaging edge area with greater distortion, and the rod-shaped article is imaged in this way is that the central imaging areas of adjacent cameras overlap one another, with the image
  • the image capture takes place with the aid of cameras which include a two-dimensional image sensor. Provision is also made in particular for the images of the rod-shaped articles to be recorded without another optical element being located in the beam path, such as for example one or more prisms or a mirror. In other words, the cameras capture the rod-shaped article directly through their entocentric lenses.
  • At least one intermediate space between two adjacent segments and/or at least one length of a segment of the rod-shaped article is/is quantitatively measured.
  • the method is also used to examine the rod-shaped articles or the segments qualitatively, for example with regard to the quality of the cut edges.
  • a width of one of the intermediate spaces oriented in the direction of longitudinal extension of the receiving trough and/or a length of a segment is/are measured, in particular with an accuracy of better than 0.1 mm.
  • the method advantageously allows a very precise measurement of the width of the gaps between the individual segments.
  • the method is further developed in particular in that the rod-shaped articles are transported on a conveyor drum during the transverse axial conveyance are recorded.
  • the object is also achieved by a method for controlling and/or regulating a rolling device in an arrangement in the tobacco processing industry.
  • the arrangement comprises a device for optically inspecting rod-shaped articles according to one or more of the aforementioned embodiments and a rolling device.
  • the assembly of segments is covered with a leaflet.
  • the rod-shaped articles of the tobacco processing industry are inspected according to a method for optically inspecting rod-shaped articles of the tobacco processing industry according to one or more of the aforementioned embodiments. This check takes place upstream of the rolling device, based on a conveying direction of the rod-shaped articles.
  • the rolling device comprises, for example, a conveyor drum on which the rod-shaped articles are conveyed transversely and with which the rod-shaped articles are fed to a roller block.
  • the inspection occurs while the assembly of segments is directly on the conveyor drum, just before the assembly is rolled into a sheet.
  • Process control and/or regulation is carried out, for example, on the basis of this parameter set. For example, an association between a rod-shaped article and a parameter set can be made. If a rod-shaped article does not meet a predefined quality criterion due to a deviation in one or more parameters from a specified target value, this rod-shaped article can be ejected after the rolling process and excluded from further processing. Provision is also made in particular for the parameter set or individual values/parameters to be used in order to readjust and/or regulate the process of assembling the segments. If, for example, the gap between segments is found to be too small, this information can be used to readjust the composition in such a way that the desired target value is maintained in the subsequent compositions. Furthermore, it is provided in particular that the set of parameters is used within the framework of quality control for the detection of error sources. For example, defective base materials can be identified.
  • Fig. 12 shows schematically and simplified a prior art optical setup for imaging a rod-shaped article 2 with an entocentric or near entocentric lens 4.
  • the entocentric lens 4 is represented by a single lens.
  • the rod-shaped article 2 is an assembly of several segments 6a, 6b, 6c, 6d and 6e.
  • the entocentric lens 4 captures the objects in the object space at an aperture angle ⁇ .
  • the outer light beams in this angular range fall obliquely into the entrance lens of objective 4 .
  • This means that the outer segments 6a, 6b and 6d and 6e, especially the two outer segments 6a and 6e, are not viewed directly from above, i.e. from a viewing direction perpendicular to a longitudinal axial direction L (shown in a dot-dash line).
  • the device includes a conveying element, which later in connection with 7 is explained in more detail. Furthermore, the device comprises an image capturing device with which the rod-shaped articles 2 can be captured or are captured during the transverse axial conveyance on the conveying member.
  • the image capturing device comprises a camera arrangement 14, as is shown schematically and in simplified form in 3 is shown.
  • the camera assembly 14 includes a plurality of cameras 16a, 16b, 16c, 16d and 16e. Each of the cameras 16a..16e is provided with an entocentric lens 4a..4e.
  • the image capturing device 18 also includes means, for example a suitable control or regulation, which ensures that the cameras 16a..16e of the Camera arrangement 14 are synchronized. In other words, the cameras 16a . . . 16e are triggered at the same time, ie they capture image data at the same time.
  • the image capturing device 18 is set up to capture rod-shaped articles 2, which are arranged in receiving troughs of a conveying element, for example a conveying drum, while they are being conveyed transversely.
  • the individual cameras 16a This longitudinal direction A is in 3 indicated with a dotted line (cf. also 7 ).
  • the lenses 4a..4e of the cameras 16a..16e of the camera arrangement 14 are entocentric optics or approximately entocentric optics.
  • the lenses are entocentric 4a..4e each represented by a single lens.
  • Each lens 4a..4e captures an object field and maps this onto the sensor of the associated camera 16a..16e.
  • the viewing angles of the cameras 16a..16e are shown with their respective opening angles ⁇ 1, ⁇ 2, ⁇ 3, ⁇ 4 and ⁇ 5.
  • the opening angles ⁇ 1.. ⁇ 5 are at least approximately the same size.
  • Light incident on the lenses 4a..4e from the opening angles ⁇ 1.. ⁇ 5 is imaged onto a central imaging area of the sensors of the cameras 16a..16e.
  • the opening angles ⁇ 1.. ⁇ 5 of the entocentric lenses 4a..4e of the camera arrangement 14 are all small compared to the opening angle ⁇ of in 1 shown entocentric lens 4 according to the prior art.
  • the opening angles ⁇ 1.. ⁇ 5 of the entocentric lenses 4a..4e overlap in the object space.
  • This overlapping area in object space shall be denoted by reference numeral 26'.
  • Light incident from the overlapping area 26′ is recorded by two cameras 16a .
  • the rod-shaped article 2 passes through the object field during the cross-axial conveyance and is recorded by the cameras 16a..16e.
  • FIG. 1 shows an example of an image field 20a of the first camera 16a, as it is imaged on a surface sensor, for example a CMOS sensor, of this camera by the associated lens 4a.
  • the image field 20b of the second camera 16b of the camera arrangement 14 is also shown.
  • Each of the image fields 20a, 20b includes a central imaging area 22a, 22b.
  • Light incident from the object space at the angle ⁇ 1 in the lens 4a of the first camera 16a is imaged in the central imaging area 22a.
  • the respective central imaging areas in the object space shall be denoted by the reference symbols 22a' to 22e'. In these areas, the associated lenses 4a, 4b image without distortion or almost without distortion.
  • At least the distortion of the associated lens 4a, 4b is below a predetermined limit value. This is given, for example, as a percentage of the ideal image.
  • This limit value is, for example, less than 1%, in particular less than 2%, moreover in particular less than 2.5% and moreover in particular less than 5%, moreover in particular the imaging error is less than 7.5%, moreover in particular less than 10% and more particularly less than 15%.
  • the central imaging area 22a, 22b is surrounded by an imaging edge area 24a, 24b, in which the distortion is greater than in the central imaging area 22a, 22b.
  • the distortion in the imaging edge area 24a, 24b is above one of the aforementioned limit values.
  • the cameras 16a..16e of the camera arrangement 14 are arranged such that the central imaging areas 22a, 22b of adjacent cameras 16a..16e overlap one another.
  • the overlapping area 26 is the interface between the adjacent central imaging areas 22a, 22b of adjacent cameras 16a..16e.
  • a processing unit in the image capturing device 18 which is set up to calibrate the cameras 16a..16e of the camera arrangement 14 by evaluating the image data of neighboring cameras 16a..16e captured in the overlapping central image areas 22a, 22b. For example, a cross-correlation between the image data of the images from neighboring cameras in the overlapping area 26 is calculated. Such a comparison allows a displacement vector 28 to be calculated, by which the image fields 20a, 20b of the adjacent cameras 16a, 16b are displaced relative to one another. in the in 4 illustrated embodiment, the displacement vector 28 is directed exclusively vertically. If the overlapping area 26 turns out to be wider than desired or narrower than desired, the displacement vector 28 would also include a corresponding horizontal component. A displacement vector 28 for all neighboring cameras 16a..16e of the camera arrangement 14 is calculated.
  • the processing unit is now set up to process the cameras 16a..16e of the camera arrangement 14 in the central imaging areas 22a, 22b to calculate a common image of the camera arrangement 14.
  • figure 5 shows the two image fields 20a, 20b corrected by the displacement vector 28, for example of the cameras 16a and 16, the image field 20b of the second camera 16b being shown with a dashed line for clarification.
  • the two central recording areas 22a, 22b are combined, with the image data of one or the other camera being able to be used in the overlapping area 26 as desired.
  • the individual image fields 20a to 20e as shown in 3 are shown schematically and in simplified form, gain a complete picture of the rod-shaped article 2. Deviating from the actual execution are in 3 the image fields 20a..20e, and this only for reasons of clarity, not shown overlapping.
  • an image of the rod-shaped article 2 can be provided, as shown in FIG. 6a by way of example and schematically simplified. This is already off directly below in FIG. 6b 2 known image of the rod-shaped article 2, as can be obtained with a single entocentric lens 4.
  • apparatus in accordance with aspects of the invention provides an image of the rod-shaped article 2 in which both the edges 12, only some of which are numbered for the sake of clarity only, are clearly visible.
  • the distances D1..D4 between the individual segments 6a..6e can be determined very precisely by knowing the imaging scale of the lenses 4a..4e from the distances D1'..D4' between the images 8a..8e of the corresponding segments 6a..6e are calculated.
  • the device is set up in such a way that gaps 30 (cf. 3 , only some of which are provided with reference symbols for reasons of clarity) between adjacent ones Segments 6a..6e of the rod-shaped article 2 can be measured quantitatively. The same applies to a length of the segments 6a..6e.
  • the image capturing device 18 is also set up in particular to measure the distances D1..D4 between the segments 6a..6e with an accuracy which is better than 0.1 mm.
  • a resolution of the lenses 4a..4e and a resolution of the sensors used in the cameras 16a..16e are selected such that the desired resolution is achieved.
  • the device 32 comprises a conveying drum 34 as a conveying element, which is shown in sections.
  • the conveying direction R corresponds to a direction of rotation of the conveying drum.
  • Above the receiving troughs 36 is the previously described image capturing device 18, of which only a few camera units, each comprising a camera and an entocentric lens, are shown schematically in an exemplary representation.
  • the receiving troughs 36 have a longitudinal extension direction A, which is already in connection with 3 was mentioned and in 7 is also indicated with a dotted line.
  • the direction of longitudinal extension A is oriented at least approximately perpendicular to the conveying direction R.
  • the individual cameras 16a It is thus possible to check the rod-shaped articles 2 optically during the cross-axial conveyance on the conveying element 34 .
  • the device 32 also includes a processing unit 38, for example a computer, a workstation or the like, which is set up, among other things, to control and read out the image capturing device 18, to carry out the aforementioned calibration and to calculate the joint image of the camera arrangement 14.
  • a processing unit 38 for example a computer, a workstation or the like, which is set up, among other things, to control and read out the image capturing device 18, to carry out the aforementioned calibration and to calculate the joint image of the camera arrangement 14.

Description

Die Erfindung betrifft eine Vorrichtung der Tabak verarbeitenden Industrie zum optischen Prüfen von stabförmigen Artikeln der Tabak verarbeitenden Industrie, wobei die stabförmigen Artikel jeweils eine Zusammenstellung aus mehreren Segmenten sind, und wobei die Vorrichtung ein Förderorgan zur queraxialen Förderung der stabförmigen Artikel umfasst und das Förderorgan eine Vielzahl von Aufnahmemulden umfasst, in denen die stabförmigen Artikel aufnehmbar sind oder aufgenommen werden, wobei die Vorrichtung ferner eine Bilderfassungsvorrichtung umfasst, mit der die in den Aufnahmemulden angeordneten stabförmigen Artikel während der queraxialen Förderung erfassbar sind oder erfasst werden. Ferner betrifft die Erfindung ein Verfahren zum optischen Prüfen von stabförmigen Artikeln der Tabak verarbeitenden Industrie, wobei die stabförmigen Artikel jeweils eine Zusammenstellung aus mehreren Segmenten sind und von einem Förderorgan queraxial in einer Aufnahmemulde des Förderorgans gefördert werden.The invention relates to a device in the tobacco processing industry for optically inspecting rod-shaped articles in the tobacco processing industry, the rod-shaped articles each being a combination of a plurality of segments, and the device comprising a conveying element for transversely axial conveying of the rod-shaped articles and the conveying element comprising a plurality of receiving troughs, in which the rod-shaped articles can be received or are received, the device further comprising an image detection device with which the rod-shaped articles arranged in the receiving troughs can be detected or are detected during the transverse-axial conveyance. The invention also relates to a method for optically inspecting rod-shaped articles in the tobacco processing industry, with the rod-shaped articles each being an assembly of several segments and being conveyed transversely axially by a conveying element in a receiving trough of the conveying element.

Stabförmige Artikel der Tabak verarbeitenden Industrie, die eine Zusammenstellung aus mehreren Segmenten sind, sind beispielsweise als Multisegmentfilter bekannt. Bei der Zusammenstellung der Filtersegmente können Fehler auftreten, beispielsweise das Vertauschen von Filtersegmenten, das Fehlen eines Filtersegments, eine falsche Position oder das Einfügen eines Filtersegments mit einer falschen Länge. Ferner können Lücken zwischen Filtersegmenten auftreten oder es können die Filtersegmente gegeneinander verkippt sein.Rod-shaped articles of the tobacco processing industry, which are a compilation are made up of several segments are known, for example, as multi-segment filters. When assembling the filter segments, errors can occur, for example swapping filter segments, a missing filter segment, an incorrect position or inserting a filter segment with the wrong length. Furthermore, gaps can occur between filter segments or the filter segments can be tilted relative to one another.

Um solche Fehler während der Herstellung zu detektieren, ist aus der EP 1 769 689 A1 eine Einrichtung zur Messung von Eigenschaften von Multisegmentfiltern oder Zusammenstellungen von Filtersegmenten in der Tabak verarbeitenden Industrie bekannt. Die Multisegmentfilteranordnung wird mit einem Linienlaser beleuchtet. Das an der Oberfläche der Filtersegmente reflektierte Licht wird mithilfe einer Zeilenkamera empfangen, die von der Zeilenkamera erfassten Daten werden entsprechend ausgewertet.In order to detect such errors during production, is from the EP 1 769 689 A1 a device for measuring properties of multi-segment filters or combinations of filter segments in the tobacco processing industry. The multi-segment filter arrangement is illuminated with a line laser. The light reflected on the surface of the filter segments is received using a line camera, and the data recorded by the line camera is evaluated accordingly.

Eine weitere Vorrichtung, bei der Multisegmentfilter während der queraxialen Förderung auf einer Fördertrommel geprüft werden, ist beispielsweise aus der DE 10 2009 041 320 A1 bekannt. Die Fördertrommel ist mit einer Beleuchtungsvorrichtung versehen. Die Multisegmentfilter sind in einer geschlitzten Aufnahme, beispielsweise einer Aufnahmemulde, dieses Förderorgans aufgenommen. Eine außerdem vorgesehene Sensorvorrichtung nimmt die durch den Multisegmentfilter bzw. durch die in der Aufnahmemulde vorhandene Anordnung aus mehreren Segmenten hindurchscheinende Strahlung auf. Die Beobachtung erfolgt über einen Spiegel, die austretende Strahlung wird mithilfe einer Linse kollimiert und auf eine CCD-Kamera geleitet. In diesem Durchlichtverfahren sind vor allem mit Aktivkohle befüllte Filtersegmente gut detektierbar.Another device in which multi-segment filters are tested during cross-axial promotion on a conveyor drum is, for example, from DE 10 2009 041 320 A1 famous. The conveyor drum is provided with a lighting device. The multi-segment filters are accommodated in a slotted receptacle, for example a receptacle trough, of this conveying element. A sensor device that is also provided picks up the radiation shining through the multi-segment filter or through the arrangement of a plurality of segments present in the receiving trough. Observation takes place via a mirror, the emitted radiation is collimated using a lens and directed to a CCD camera. In this transmitted light method, filter segments filled with activated carbon are particularly easy to detect.

Aus DE 20 2015 004 790 U1 ist eine Einrichtung zum optischen Prüfen von Artikeln der Tabak verarbeitenden Industrie bekannt, welche eine Bilderfassungsvorrichtung mit wenigstens einem Bildsensor und wenigstens einem Leuchtmittel zum Beleuchten des zu prüfenden Artikels umfasst. Die Bilderfassungsvorrichtung umfasst eine Mehrzahl von nebeneinander, beispielsweise in einer oder mehreren Reihen, angeordneten Bildsensoren. Jedem der Bildsensoren ist eine Zylinderlinse mit einer rechteckförmigen Querschnittsfläche zugeordnet, die beispielsweise als plankonkave Zylinderlinse oder als Kombination aus plankonvexer und konkaver Zylinderlinse ausgebildet ist.Out of DE 20 2015 004 790 U1 a device for optically checking articles in the tobacco processing industry is known, which comprises an image acquisition device with at least one image sensor and at least one light source for illuminating the article to be checked. The image capturing device comprises a plurality of image sensors arranged next to one another, for example in one or more rows. Each of the image sensors is assigned a cylindrical lens with a rectangular cross-sectional area, which is designed, for example, as a plano-concave cylindrical lens or as a combination of plano-convex and concave cylindrical lenses.

Aus DE 10 2014 209 000 A1 ist eine Vorrichtung zum optischen Prüfen der Oberfläche von stabförmigen Artikeln der Tabak verarbeitenden Industrie bekannt. Die Artikel werden während der queraxialen Förderung auf einer Fördertrommel geprüft. Die Vorrichtung umfasst eine Mehrzahl von Lichtquellen, die mittels einer Steuerungseinrichtung in einer vorbestimmten Reihenfolge nacheinander für eine vorgegebene Zeitdauer eingeschaltet werden. DE-A1-10 2016 107 247 offenbart den Oberbegriff des Anspruchs 1.Out of DE 10 2014 209 000 A1 a device for optically checking the surface of rod-shaped articles in the tobacco processing industry is known. The articles are checked during cross-axial conveyance on a conveyor drum. The device comprises a plurality of light sources, which are switched on one after the other in a predetermined order for a predetermined period of time by means of a control device. DE-A1-10 2016 107 247 discloses the preamble of claim 1.

Soll der Abstand zwischen den Segmenten eines stabförmigen Artikels, der auf einer Fördertrommel queraxial gefördert wird, mit hoher Genauigkeit vermessen werden, wäre bei den oben genannten herkömmlichen Lösungen eine Zeilenkamera mit sehr großer Auflösung erforderlich. Solche Kameras sind jedoch aufwendig zu betreiben und außerdem teuer in der Anschaffung. Außerdem müsste die Segmentanordnung verzeichnungs- bzw. verzerrungsfrei auf die Zeilenkamera abgebildet werden, wozu eine telezentrische Optik erforderlich ist. Bei einer telezentrischen Optik treten die Lichtbündel aus dem betrachteten Objektbereich parallel zur optischen Achse in die Frontlinse des Objektivs ein. Aus diesem Grund ist es erforderlich, dass ein telezentrisches Objektiv eine Frontlinse aufweist, welche ebenso groß oder größer als eine maximale Größe des zu betrachtenden Objekts ist. Diese Anforderung führt unter anderem dazu, dass telezentrische Optiken sehr teuer sind. Außerdem sind telezentrische Optiken recht groß und schwer, so dass der konstruktive Aufwand zur Realisierung der Messanordnung entsprechend aufwendig und teuer ist. Außerdem wird ein großer Bauraum beansprucht, was in der Praxis vielfach zu Problemen bei der Realisierung führt.If the distance between the segments of a rod-shaped article, which is conveyed transversely axially on a conveyor drum, is to be measured with high accuracy, a line camera with a very high resolution would be required in the conventional solutions mentioned above. However, such cameras are complicated to operate and also expensive to purchase. In addition, the segment arrangement would have to be imaged on the line scan camera without distortion or distortion, which requires telecentric optics. With telecentric optics, the light bundles from the observed object area enter the front lens of the objective parallel to the optical axis. For this reason, a telecentric lens is required to have a front lens that is as large as or larger than a maximum size of the object to be viewed. This requirement means, among other things, that telecentric optics are very expensive. In addition, telecentric optics are quite large and heavy, so that the design effort to implement the measurement arrangement is correspondingly complex and expensive. In addition, a large installation space is required, which in practice often leads to problems in the implementation.

Aufgabe der vorliegenden Erfindung ist es, eine Vorrichtung der Tabak verarbeitenden Industrie zum optischen Prüfen von stabförmigen Artikeln der Tabak verarbeitenden Industrie sowie ein Verfahren zum optischen Prüfen von stabförmigen Artikeln der Tabak verarbeitenden Industrie anzugeben, mit der/dem eine exakte Prüfung der stabförmigen Artikel mit hoher Auflösung vorgenommen werden kann, wobei jedoch der konstruktive Aufwand gering gehalten werden soll.The object of the present invention is to provide a device in the tobacco processing industry for optically inspecting rod-shaped articles in the tobacco processing industry and a method for optically inspecting rod-shaped articles in the tobacco processing industry, with which an exact examination of the rod-shaped articles can be carried out with high Resolution can be made, but the design effort should be kept low.

Die Aufgabe wird gelöst durch eine Vorrichtung der Tabak verarbeitenden Industrie zum optischen Prüfen von stabförmigen Artikeln der Tabak verarbeitenden Industrie, wobei die stabförmigen Artikel jeweils eine Zusammenstellung aus mehreren Segmenten sind, und wobei die Vorrichtung ein Förderorgan zur queraxialen Förderung der stabförmigen Artikel umfasst und das Förderorgan eine Vielzahl von Aufnahmemulden umfasst, in denen die stabförmigen Artikel aufnehmbar sind oder aufgenommen werden, wobei die Vorrichtung ferner eine Bilderfassungsvorrichtung umfasst, mit der die in den Aufnahmemulden angeordneten stabförmigen Artikel während der queraxialen Förderung erfassbar sind oder erfasst werden, wobei die Bilderfassungsvorrichtung eine Kameraanordnung mit einer Mehrzahl von Kameras zur Bilderfassung umfasst, und wobei die Kameras insbesondere zur gleichzeitigen Bilderfassung synchronisiert sind und diese Kameras in einer Längserstreckungsrichtung der Aufnahmemulden nebeneinander angeordnet sind, wobei jede Kamera der Kameraanordnung ein entozentrisches Objektiv umfasst und mit diesem ein Objektfeld, welches die in den Aufnahmemulden angeordneten stabförmigen Artikel während der queraxialen Förderung durchlaufen, auf ein Bildfeld abbildet, wobei das Bildfeld einen zentralen Abbildungsbereich umfasst, in dem das Objektiv verzeichnungsfrei oder zumindest mit einer Verzeichnung unterhalb eines vorgegebenen oder vorgebbaren Grenzwerts abbildet, der von einem Abbildungs-Randbereich mit größerer Verzeichnung umgeben ist, wobei die Kameras in der Kameraanordnung derart angeordnet sind, dass die zentralen Abbildungsbereiche benachbarter Kameras einander überlappen, wobei die Bilderfassungsvorrichtung ferner eine Verarbeitungseinheit umfasst, die dazu eingerichtet ist, die von zumindest zwei, insbesondere allen, Kameras der Kameraanordnung in den zentralen Abbildungsbereichen erfassten Bilddaten zu einem gemeinsamen Bild der Kameraanordnung zu verrechnen.The object is achieved by a device in the tobacco processing industry for optically inspecting rod-shaped articles in the tobacco processing industry, the rod-shaped articles each being a combination of several segments, and the device comprising a conveying element for transversely axial conveying of the rod-shaped articles and the conveying element comprises a plurality of receiving troughs in which the rod-shaped articles can be received or are received, the device further comprising an image capturing device with which the rod-shaped articles arranged in the receiving troughs can be detected or are captured during the transverse axial conveyance, the image capturing device having a camera arrangement comprises a plurality of cameras for image acquisition, and wherein the cameras are synchronized in particular for simultaneous image acquisition and these cameras are arranged next to one another in a direction of longitudinal extension of the receiving troughs each camera of the camera arrangement comprises an entocentric lens and uses this to image an object field, which the rod-shaped articles arranged in the receiving recesses pass through during the transverse axial conveyance, onto an image field, with the image field comprising a central imaging area in which the lens is distortion-free or images at least with a distortion below a predetermined or predeterminable limit value, which is surrounded by an imaging edge area with greater distortion, the cameras in the camera arrangement being arranged in such a way that the central imaging areas of adjacent cameras overlap, the image capturing device also comprising a processing unit , the is set up to calculate the image data recorded by at least two, in particular all, cameras of the camera arrangement in the central imaging areas to form a common image of the camera arrangement.

Die Vorrichtung gemäß Aspekten der Erfindung beruht auf der technischen Überlegung, dass der konventionell betriebene Aufwand, vor allem der Einsatz einer telezentrischen Optik sowie die Verwendung einer großen Zeilenkamera mit einer hohen Auflösung, vermieden werden kann, indem eine Kameraanordnung zum Einsatz kommt, welche eine Mehrzahl von nebeneinander angeordneten einzelnen Kameras umfasst. Die von diesen einzelnen Kameras erfassten Einzelbilder werden nach der Erfassung miteinander verrechnet. In diesem Zusammenhang ist es vorteilhaft, wenn die Kameras synchronisiert sind, d.h. die Einzelbilder der Kameras im gleichen Zeitpunkt erfasst werden. Eine solche Kameraanordnung ist in Summe günstiger als eine entsprechend große Zeilenkamera, da es sich bei den einzelnen Kameras um zu einem überschaubaren Preis verfügbare Standardprodukte handeln kann. Ferner ist vorteilhaft, dass keine speziellen Optiken, wie beispielsweise eine telezentrische Optik, sondern konventionelle entozentrische Optiken zum Einsatz kommen können. Dies stellt einen weiteren erheblichen Kostenvorteil dar. Die für die Messaufgabe grundsätzlich nachteilige Eigenschaft entozentrischer Optiken, nämlich eine Verzeichnung, beispielsweise eine kissenförmige oder tonnenförmige Verzeichnung, spielt bei der Kameraanordnung gemäß Aspekten der Erfindung eine lediglich untergeordnete Rolle. Sie wirkt sich nicht negativ auf die Messung aus. Dies wird dadurch erreicht, dass diejenigen Randbereiche des Bildbereiches, in denen die Verzeichnung groß ist, von der Messaufgabe ausgenommen werden. Es werden also mit anderen Worten lediglich diejenigen Abbildungsbereiche der Kameras für die Messaufgabe eingesetzt, welche in einem zentralen Bereich liegen, in dem auch die entozentrischen Optiken nahezu verzeichnungsfrei abbilden.The device according to aspects of the invention is based on the technical consideration that the conventional effort, especially the use of telecentric optics and the use of a large line camera with a high resolution, can be avoided by using a camera arrangement that has a plurality of individual cameras arranged side by side. The individual images captured by these individual cameras are offset against each other after capture. In this context, it is advantageous if the cameras are synchronized, i.e. the individual images of the cameras are captured at the same point in time. Overall, such a camera arrangement is less expensive than a correspondingly large line scan camera, since the individual cameras can be standard products that are available at a manageable price. Furthermore, it is advantageous that no special optics, such as telecentric optics, but rather conventional entocentric optics can be used. This represents a further considerable cost advantage. The fundamentally disadvantageous property of entocentric optics for the measurement task, namely distortion, for example pincushion-shaped or barrel-shaped distortion, only plays a subordinate role in the camera arrangement according to aspects of the invention. It does not have a negative effect on the measurement. This is achieved by excluding those edge areas of the image area in which the distortion is high from the measurement task. In other words, only those imaging areas of the cameras are used for the measurement task which lie in a central area in which the entocentric optics also image almost without distortion.

Schließlich ist es äußerst vorteilhaft, dass die Vorrichtung gemäß Aspekten der Erfindung keinen großen Bauraum beansprucht. Die entozentrischen Optiken sind nicht übermäßig groß und in guter Qualität zu einem angemessen günstigen Preis zu erwerben. Außerdem kann der Objektabstand relativ gering gewählt werden, beispielsweise kleiner als 100 mm, 200 mm, 300 mm oder kleiner als 500 mm.Finally, it is extremely advantageous that the device according to aspects the invention does not take up much space. The entocentric optics are not overly large and can be purchased in good quality at a reasonable price. In addition, the object distance can be selected to be relatively small, for example less than 100 mm, 200 mm, 300 mm or less than 500 mm.

Die Kameraanordnung wird bevorzugt so angeordnet, dass ohne weitere optische Elemente, wie beispielsweise ein oder mehrere Prismen oder dergleichen, die stabförmigen Artikel direkt mit den entozentrischen Objektiven der einzelnen Kameras abgebildet werden.The camera arrangement is preferably arranged in such a way that the rod-shaped articles are imaged directly with the entocentric lenses of the individual cameras without further optical elements, such as for example one or more prisms or the like.

Es handelt sich bei den Kameras der Kameraanordnungen um solche mit einem Flächensensor (2D-Bildsensor). Es kommen also insbesondere keine Zeilenkameras zum Einsatz. Die Kameras der Kameraeinrichtung sind insbesondere synchronisiert. Mit anderen Worten erfolgt also insbesondere eine Bilderfassung mit allen Kameras der Kameraanordnung gleichzeitig.The cameras of the camera arrangements are those with a surface sensor (2D image sensor). In particular, no line scan cameras are used. In particular, the cameras of the camera device are synchronized. In other words, in particular, an image is captured simultaneously with all the cameras in the camera arrangement.

Die Kameraanordnung umfasst insbesondere eine so große Anzahl einzelner Kameras, dass es möglich ist, den stabförmigen Artikel in den zentralen Bereichen der Kameras in Summe betrachtet vollständig abzubilden. Nach anschließender Verrechnung der erfassten Bilddaten zu einem gemeinsamen Bild liegt eine vollständige Abbildung des stabförmigen Artikels zur anschließenden Analyse vor.In particular, the camera arrangement comprises such a large number of individual cameras that it is possible, viewed as a whole, to image the rod-shaped article completely in the central areas of the cameras. After the captured image data have been combined to form a common image, a complete image of the rod-shaped article is available for subsequent analysis.

Die Vorrichtung ist insbesondere dadurch fortgebildet, dass die Verarbeitungseinheit ferner dazu eingerichtet ist, zumindest einen Zwischenraum zwischen zwei benachbarten Segmenten und/oder zumindest eine Länge eines Segments der stabförmigen Artikel quantitativ zu vermessen.The device is developed in particular in that the processing unit is also set up to quantitatively measure at least one gap between two adjacent segments and/or at least one length of a segment of the rod-shaped article.

Neben einer quantitativen Auswertung kann auch eine qualitative Auswertung erfolgen. Beispielsweise ist es möglich, eine Qualität der Schnittkante der einzelnen Segmente zu beurteilen. Dies ist vorteilhaft möglich, da mit der Kameraanordnung der Vorrichtung gemäß Aspekten der Erfindung eine optische Prüfung in Aufsicht, also direkt von oben, erfolgt. Die Blickrichtung liegt zumindest näherungsweise senkrecht zu einer Längserstreckungsrichtung des stabförmigen Artikels. Würde im Vergleich dazu eine optische Prüfung mit einem einzigen entozentrischen Objektiv stattfinden, so würde sich auf Grund des in den Randbereichen flacher werdenden Blickwinkels zumindest bei den äußeren Segmenten ein Blick auf die Stirnseiten der einzelnen Segmente ergeben. Eine solche Perspektive macht eine qualitative Beurteilung der Schnittkanten schwierig oder ungenau. Auch eine quantitative Vermessung der Zwischenräume zwischen den benachbarten Segmenten oder eine Länge der Segmente der stabförmigen Artikel wird aufgrund der verwaschen dargestellten Kante schwierig und ungenau. Mit der Vorrichtung gemäß Aspekten der Erfindung ist dies jedoch bei wesentlich geringeren Kosten und einem wesentlich geringeren Bauraum in gleicher oder ähnlicher Qualität und Genauigkeit möglich, wie dies bei der Verwendung eines telezentrischen Objektivs der Fall ist.In addition to a quantitative evaluation, a qualitative evaluation can also be carried out. For example, it is possible to assess the quality of the cut edge of the individual segments. This is advantageously possible because with the camera arrangement of the device according to aspects of the invention a visual inspection is carried out under supervision, i.e. directly from above. The viewing direction is at least approximately perpendicular to a direction of longitudinal extent of the rod-shaped article. In comparison, if an optical test were to take place with a single entocentric lens, the end faces of the individual segments would be visible at least in the outer segments due to the viewing angle becoming flatter in the edge areas. Such a perspective makes a qualitative assessment of the cut edges difficult or imprecise. A quantitative measurement of the gaps between the adjacent segments or a length of the segments of the rod-shaped articles is difficult and imprecise due to the blurred edges. With the device according to aspects of the invention, however, this is possible at significantly lower costs and in a significantly smaller installation space with the same or similar quality and accuracy as is the case when using a telecentric lens.

Im Hinblick auf die quantitative Auswertung ist die Vorrichtung ferner insbesondere dadurch fortgebildet, dass die Bilderfassungsvorrichtung und die Verarbeitungseinheit ferner dazu eingerichtet sind, zumindest einen in Längserstreckungsrichtung der Aufnahmemulden orientierten Abstand zwischen zwei benachbarten Segmenten und/oder eine in dieser Längserstreckungsrichtung orientierte Länge eines Segments, insbesondere mit einer Genauigkeit von besser als 0,1 mm, zu messen.With regard to the quantitative evaluation, the device is further developed in particular in that the image acquisition device and the processing unit are also set up to measure at least one distance between two adjacent segments oriented in the direction of longitudinal extent of the receiving troughs and/or a length of a segment oriented in this direction of longitudinal extent, in particular with an accuracy of better than 0.1 mm.

Beispielsweise wird die Auflösung der Kameras der Kameraanordnung so gewählt, dass bei gewähltem Objektabstand und der verwendeten Optik die Auflösung der Kamera groß genug ist, um die gewünschte Auflösung zu erzielen. Beispielsweise beträgt der Objektabstand 200 mm und eine maximale Objektlänge beträgt ebenfalls 200 mm. Eine Auflösung der Kamera liegt beispielsweise zwischen 8 und 10 Tausend Pixel. Es werden in der Kameraanordnung beispielsweise mehr als 4 Kameras eingesetzt. Ferner beispielsweise umfasst die Kameraanordnung 4, 6, 8 oder 10 Kameras. Vorteilhaft erlaubt die Vorrichtung eine sehr genaue Vermessung der Breite der einzelnen Zwischenräume zwischen den Segmenten sowie eine sehr genaue Vermessung der Länge der Segmente des stabförmigen Artikels.For example, the resolution of the cameras of the camera arrangement is selected such that the resolution of the camera is large enough to achieve the desired resolution given the selected object distance and the optics used. For example, the object distance is 200 mm and a maximum object length is also 200 mm. A resolution of the camera is between 8 and 10 thousand pixels, for example. For example, more than 4 cameras are used in the camera arrangement. Furthermore, for example, the camera arrangement comprises 4, 6, 8 or 10 cameras. The device advantageously allows a very precise measurement the width of the individual gaps between the segments and a very precise measurement of the length of the segments of the rod-shaped article.

Die Vorrichtung ist ferner insbesondere dadurch fortgebildet, dass die Verarbeitungseinheit ferner dazu eingerichtet ist, die Kameras der Kameraanordnung zu kalibrieren, indem die in den einander überlappenden zentralen Bildbereichen erfassten Bilddaten benachbarter Kameras ausgewertet werden und ein Verschiebevektor zwischen den Bildbereichen benachbarter Kameras bestimmt wird.The device is further developed in particular in that the processing unit is also set up to calibrate the cameras of the camera arrangement by evaluating the image data of adjacent cameras recorded in the overlapping central image areas and determining a displacement vector between the image areas of adjacent cameras.

Der im Rahmen der Kalibrierung ermittelte Verschiebevektor wird auf die darauffolgenden Aufnahmen angewandt, um diese gegeneinander auszurichten, so dass in Summe, also in dem gemeinsamen Bild, eine objektiv- und realitätsgetreu richtige Darstellung des stabförmigen Artikels vorliegt. Selbstverständlich findet diese Kalibrierung insbesondere für alle Kameras statt. Es ist ebenfalls möglich, die Kalibrierung während des Messbetriebs, beispielsweise in regelmäßigen Abständen, zu wiederholen.The displacement vector determined as part of the calibration is applied to the subsequent recordings in order to align them with one another, so that overall, i.e. in the joint image, there is an objectively and realistically correct representation of the rod-shaped article. Of course, this calibration takes place especially for all cameras. It is also possible to repeat the calibration during the measurement operation, for example at regular intervals.

Es ist ferner insbesondere vorgesehen, dass die Kameras der Kameraanordnung im sichtbaren Spektralbereich empfindlich sind. Es erfolgt beispielsweise eine Beleuchtung der stabförmigen Artikel im Drauflicht oder im Durchlicht. Es ist ferner insbesondere vorgesehen, dass die Beleuchtung ein Dauerlicht ist oder auch insbesondere ein Blitzlicht oder dergleichen. Es findet also mit anderen Worten beispielsweise keine Dauerbeleuchtung statt. Hierzu ist eine Synchronisation des Blitzlichts mit der Kameraeinrichtung erforderlich. Diese Synchronisation wird beispielsweise von der Verarbeitungseinheit übernommen. Ein entsprechendes Blitzlicht wird gleichzeitig mit einem Auslöser der einzelnen Kameras der Kameraanordnung betätigt. Die Bilderfassung findet also in dem Moment statt, wenn der stabförmige Artikel, welcher in der Aufnahmemulde aufgenommen ist, von dem Blitzlicht beleuchtet wird. Die Blitzeinrichtung ist also mit den Kameras der Kameraeinrichtung synchronisiert. Ferner findet die Bilderfassung dann statt, wenn der stabförmige Artikel, welcher in der Aufnahmemulde aufgenommen ist, durch das Bildfeld der Kameraanordnung transportiert wird. Es ist ferner gemäß einer weiteren Ausführungsform insbesondere vorgesehen, dass das Förderorgan eine Fördertrommel ist, auf der die stabförmigen Artikel queraxial gefördert werden.It is also provided in particular that the cameras of the camera arrangement are sensitive in the visible spectral range. For example, the rod-shaped articles are illuminated in overhead light or in transmitted light. Provision is also made in particular for the illumination to be a continuous light or, in particular, a flashing light or the like. In other words, there is no permanent lighting, for example. This requires the flash to be synchronized with the camera equipment. This synchronization is taken over by the processing unit, for example. A corresponding flash light is actuated simultaneously with a trigger of the individual cameras of the camera arrangement. The image acquisition therefore takes place at the moment when the rod-shaped article, which is received in the receiving trough, is illuminated by the flashlight. The flash device is therefore synchronized with the cameras of the camera device. Furthermore, the image acquisition takes place when the rod-shaped article, which is in the Receiving trough is included, is transported through the field of view of the camera assembly. Furthermore, according to a further embodiment, it is provided in particular that the conveying element is a conveying drum on which the rod-shaped articles are conveyed transversely and axially.

Die Aufgabe wird ferner gelöst durch eine Anordnung der Tabak verarbeitenden Industrie, umfassend eine Vorrichtung nach einer oder mehreren der zuvor genannten Ausführungsformen, wobei die Anordnung ferner eine Rollvorrichtung umfasst und wobei die Vorrichtung zum optischen Prüfen von stabförmigen Artikeln bezogen auf eine Förderrichtung der stabförmigen Artikel stromaufwärts der Rollvorrichtung angeordnet ist.The object is also achieved by an arrangement in the tobacco processing industry, comprising a device according to one or more of the aforementioned embodiments, the arrangement also comprising a rolling device and the device for optically inspecting rod-shaped articles in relation to a conveying direction of the rod-shaped articles upstream the rolling device is arranged.

Die Rollvorrichtung umfasst beispielsweise eine Fördertrommel, auf der die stabförmigen Artikel queraxial gefördert werden und mit der die stabförmigen Artikel einem Rollklotz zugeführt werden. Die Vorrichtung zum optischen Prüfen der stabförmigen Artikel ist beispielsweise so angeordnet, dass die Zusammenstellung der Segmente direkt auf der Fördertrommel erfasst wird, kurz bevor die Zusammenstellung in ein Blättchen eingerollt wird. Die Vorrichtung zum optischen Prüfen ist also mit anderen Worten unmittelbar vor dem Rollprozess angeordnet.The rolling device comprises, for example, a conveyor drum on which the rod-shaped articles are conveyed transversely and with which the rod-shaped articles are fed to a roller block. The device for optically inspecting the rod-shaped articles is arranged, for example, in such a way that the assembly of the segments is detected directly on the conveyor drum, just before the assembly is rolled into a sheet. In other words, the device for optical testing is therefore arranged immediately before the rolling process.

Gemäß weiterer Aspekte ist vorgesehen, dass mit der Vorrichtung zum optischen Prüfen von stabförmigen Artikeln ein Parametersatz gewonnen wird, der die Zusammenstellung aus mehreren Segmenten insbesondere vollständig beschreibt. Dieser Parametersatz umfasst beispielsweise Informationen zu:

  • einem Vorhandensein eines oder mehrerer Segmente,
  • einer Anzahl der in der Zusammenstellung vorhandenen Segmente,
  • einer Lage und/oder Art der Segmente, wobei unter der Art eines Segments beispielsweise dessen Typ und Dimension zu verstehen ist,
  • einer Größe zumindest einer Lücke zwischen zwei benachbarten Segmenten,
  • einer Größe einer Länge zumindest eines Segments und/oder
  • einem Vorhandensein und/oder einer Lage eines Blättchens, welches zur Umhüllung der Zusammenstellung der Segmente in einer Rollvorrichtung vorgesehen ist.
According to further aspects, it is provided that with the device for the optical inspection of rod-shaped articles, a set of parameters is obtained which, in particular, completely describes the composition of a plurality of segments. For example, this set of parameters includes information about:
  • a presence of one or more segments,
  • a number of segments present in the composition,
  • a position and/or type of the segments, whereby the type of a segment is to be understood, for example, as its type and dimension,
  • a size of at least one gap between two adjacent segments,
  • a size a length of at least one segment and/or
  • a presence and/or location of a sheet intended to wrap the assembly of segments in a rolling device.

Die Anordnung ist gemäß einer weiteren Ausführungsform dazu eingerichtet, auf der Grundlage dieses Parametersatzes eine Prozesssteuerung und/oder -regelung vorzunehmen. Hierzu ist sie beispielsweise dazu eingerichtet, eine Zuordnung zwischen einem stabförmigen Artikel und einem Parametersatz vorzunehmen. Erfüllt ein stabförmiger Artikel aufgrund einer Abweichung eines oder mehrerer Parameter von einem vorgegebenen Sollwert ein vordefiniertes Qualitätskriterium nicht, so ist die Anordnung ferner beispielsweise dazu eingerichtet, diesen stabförmigen Artikel nach dem Rollprozess auszuwerfen und von der weiteren Verarbeitung auszuschließen. Es ist ferner insbesondere vorgesehen, dass der Parametersatz oder einzelne Werte/Parameter verwendet werden, um den Prozess des Zusammenstellens der Segmente nachzusteuern und/oder zu regeln. Wird beispielsweise eine zu geringe Lücke zwischen Segmenten festgestellt, so kann diese Information verwendet werden, um die Zusammenstellung so nachzuregeln, dass bei den sich anschließenden Zusammenstellungen der gewünschte Sollwert eingehalten wird.According to a further embodiment, the arrangement is set up to perform process control and/or regulation on the basis of this parameter set. To this end, it is set up, for example, to make an association between a rod-shaped article and a set of parameters. If a rod-shaped article does not meet a predefined quality criterion due to a deviation in one or more parameters from a specified target value, the arrangement is also set up, for example, to eject this rod-shaped article after the rolling process and exclude it from further processing. It is further provided in particular that the parameter set or individual values/parameters are used to readjust and/or regulate the process of assembling the segments. If, for example, the gap between segments is found to be too small, this information can be used to readjust the composition in such a way that the desired target value is maintained in the subsequent compositions.

Ferner ist insbesondere vorgesehen, dass der Parametersatz im Rahmen der Qualitätskontrolle zur Detektion von Fehlerquellen herangezogen wird. Beispielsweise können fehlerhafte Basismaterialien identifiziert werden.Furthermore, it is provided in particular that the set of parameters is used within the framework of quality control for the detection of error sources. For example, defective base materials can be identified.

Die Aufgabe wird außerdem gelöst durch ein Verfahren zum optischen Prüfen von stabförmigen Artikeln der Tabak verarbeitenden Industrie, wobei die stabförmigen Artikel jeweils eine Zusammenstellung aus mehreren Segmenten sind und von einem Förderorgan queraxial in einer Aufnahmemulde des Förderorgans gefördert werden, wobei die stabförmigen Artikel während der queraxialen Förderung mit einer Mehrzahl von Kameras erfasst werden, wobei diese Kameras in einer Längserstreckungsrichtung der Aufnahmemulde nebeneinander angeordnet sind, dadurch gekennzeichnet, dass die Kameras insbesondere synchronisiert sind und die stabförmigen Artikel insbesondere gleichzeitig erfasst werden und jede Kamera ein den stabförmigen Artikeln teilweise umfassendes Objektfeld entozentrisch oder zumindest näherungsweise entozentrisch auf ein Bildfeld abbildet, wobei das Bildfeld einen zentralen Abbildungsbereich umfasst, in dem ein Objektiv der Kamera verzeichnungsfrei oder zumindest mit einer Verzeichnung unterhalb eines vorgegebenen oder vorgebbaren Grenzwerts abbildet, der von einem Abbildungs-Randbereich mit größerer Verzeichnung umgeben ist, und wobei der stabförmige Artikel derart abgebildet wird, dass die zentralen Abbildungsbereiche benachbarter Kameras einander überlappen, wobei die von zumindest zwei, insbesondere von allen, Kameras in den zentralen Abbildungsbereichen erfassten Bilddaten zu einem gemeinsamen Bild verrechnet werden.The object is also achieved by a method for optically inspecting rod-shaped articles in the tobacco processing industry, in which the rod-shaped articles are each composed of a plurality of segments and are conveyed transversely by a conveying element in a receiving trough of the conveying element, the rod-shaped articles being conveyed during the transverse axial Promotion with a plurality of Cameras are recorded, these cameras being arranged next to one another in a longitudinal extension direction of the receiving trough, characterized in that the cameras are in particular synchronized and the rod-shaped articles are recorded in particular simultaneously and each camera captures an object field partially encompassing the rod-shaped articles entocentrically or at least approximately entocentrically Image field, the image field comprising a central imaging area in which a lens of the camera images without distortion or at least with a distortion below a specified or specifiable limit value, which is surrounded by an imaging edge area with greater distortion, and the rod-shaped article is imaged in this way is that the central imaging areas of adjacent cameras overlap one another, with the image data recorded by at least two, in particular by all, cameras in the central imaging areas being combined into one same picture will be offset.

Auf das Verfahren zum optischen Prüfen der stabförmigen Artikel treffen gleiche oder ähnliche Vorteile zu, wie sie bereits im Hinblick auf die Vorrichtung zuvor erwähnt wurden, so dass auf Wiederholungen verzichtet werden soll.The same or similar advantages apply to the method for optically inspecting the rod-shaped articles as have already been mentioned above with regard to the device, so that repetitions are dispensed with shall be.

Es ist insbesondere vorgesehen, dass die Bilderfassung mithilfe von Kameras erfolgt, welche einen zweidimensionalen Bildsensor umfassen. Es ist ferner insbesondere vorgesehen, dass die Erfassung der Bilder der stabförmigen Artikel erfolgt, ohne dass sich im Strahlengang ein weiteres optisches Element befindet, wie beispielsweise ein oder mehrere Prismen oder ein Spiegel. Mit anderen Worten erfassen also die Kameras direkt durch ihre entozentrischen Objektive den stabförmigen Artikel.In particular, it is provided that the image capture takes place with the aid of cameras which include a two-dimensional image sensor. Provision is also made in particular for the images of the rod-shaped articles to be recorded without another optical element being located in the beam path, such as for example one or more prisms or a mirror. In other words, the cameras capture the rod-shaped article directly through their entocentric lenses.

Gemäß einer vorteilhaften Ausführungsform ist vorgesehen, dass zumindest ein Zwischenraum zwischen zwei benachbarten Segmenten und/oder zumindest eine Länge eines Segments der stabförmigen Artikel quantitativ vermessen werden/wird.According to an advantageous embodiment, it is provided that at least one intermediate space between two adjacent segments and/or at least one length of a segment of the rod-shaped article is/is quantitatively measured.

Es ist ebenso vorgesehen, dass das Verfahren auch dazu eingesetzt wird, die stabförmigen Artikel bzw. die Segmente qualitativ zu untersuchen, beispielsweise im Hinblick auf eine Qualität der Schnittkanten.It is also provided that the method is also used to examine the rod-shaped articles or the segments qualitatively, for example with regard to the quality of the cut edges.

Es ist ferner insbesondere vorgesehen, dass eine in Längserstreckungsrichtung der Aufnahmemulde orientierte Breite eines der Zwischenräume und/oder eine Länge eines Segments, insbesondere mit einer Genauigkeit von besser als 0,1 mm, gemessen werden/wird. Vorteilhaft erlaubt das Verfahren eine sehr genaue Vermessung der Breite der Zwischenräume zwischen den einzelnen Segmenten.It is further provided in particular that a width of one of the intermediate spaces oriented in the direction of longitudinal extension of the receiving trough and/or a length of a segment is/are measured, in particular with an accuracy of better than 0.1 mm. The method advantageously allows a very precise measurement of the width of the gaps between the individual segments.

Es ist ferner insbesondere vorgesehen, dass die Kameras kalibriert werden, indem die in den einander überlappenden zentralen Bildbereichen erfassten Bilddaten benachbarter Kameras ausgewertet und ein Verschiebevektor zwischen den Abbildungsbereichen benachbarter Kameras bestimmt wird.Provision is also made in particular for the cameras to be calibrated by evaluating the image data of neighboring cameras recorded in the overlapping central image areas and determining a displacement vector between the imaging areas of neighboring cameras.

Das Verfahren ist außerdem insbesondere dadurch fortgebildet, dass die stabförmigen Artikel während der queraxialen Förderung auf einer Fördertrommel erfasst werden.The method is further developed in particular in that the rod-shaped articles are transported on a conveyor drum during the transverse axial conveyance are recorded.

Die Aufgabe wird ferner gelöst durch ein Verfahren zum Steuern und/oder Regeln einer Rollvorrichtung in einer Anordnung der Tabak verarbeitenden Industrie. Die Anordnung umfasst eine Vorrichtung zum optischen Prüfen von stabförmigen Artikeln nach einem oder mehreren der zuvor genannten Ausführungsformen und eine Rollvorrichtung. In der Rollvorrichtung wird die Zusammenstellung aus Segmenten mit einem Blättchen belegt. Die stabförmigen Artikel der Tabak verarbeitenden Industrie werden gemäß einem Verfahren zum optischen Prüfen von stabförmigen Artikeln der Tabak verarbeitenden Industrie gemäß einer oder mehrerer der zuvor genannten Ausführungsformen geprüft. Diese Prüfung findet, bezogen auf eine Förderrichtung der stabförmigen Artikel, stromaufwärts der Rollvorrichtung statt.The object is also achieved by a method for controlling and/or regulating a rolling device in an arrangement in the tobacco processing industry. The arrangement comprises a device for optically inspecting rod-shaped articles according to one or more of the aforementioned embodiments and a rolling device. In the rolling device, the assembly of segments is covered with a leaflet. The rod-shaped articles of the tobacco processing industry are inspected according to a method for optically inspecting rod-shaped articles of the tobacco processing industry according to one or more of the aforementioned embodiments. This check takes place upstream of the rolling device, based on a conveying direction of the rod-shaped articles.

Die Rollvorrichtung umfasst beispielsweise eine Fördertrommel, auf der die stabförmigen Artikel queraxial gefördert werden und mit der die stabförmigen Artikel einem Rollklotz zugeführt werden. Die Prüfung erfolgt beispielsweise, während sich die Zusammenstellung der Segmente direkt auf der Fördertrommel befindet, kurz bevor die Zusammenstellung in ein Blättchen eingerollt wird.The rolling device comprises, for example, a conveyor drum on which the rod-shaped articles are conveyed transversely and with which the rod-shaped articles are fed to a roller block. For example, the inspection occurs while the assembly of segments is directly on the conveyor drum, just before the assembly is rolled into a sheet.

Gemäß weiterer Aspekte ist vorgesehen, dass beim optischen Prüfen der stabförmigen Artikel ein Parametersatz gewonnen wird, der die Zusammenstellung aus mehreren Segmenten insbesondere vollständig beschreibt. Dieser Parametersatz umfasst beispielsweise Informationen zu:

  • einem Vorhandensein eines oder mehrerer Segmente,
  • einer Anzahl der in der Zusammenstellung vorhandenen Segmente,
  • einer Lage und/oder Art der Segmente, wobei unter der Art eines Segments beispielsweise dessen Typ und Dimension zu verstehen ist,
  • einer Größe zumindest einer Lücke zwischen zwei benachbarten Segmenten,
  • einer Größe einer Länge zumindest eines Segments und/oder
  • einem Vorhandensein und/oder einer Lage eines Blättchens, welches zur Umhüllung der Zusammenstellung der Segmente in einer Rollvorrichtung vorgesehen ist.
According to further aspects, it is provided that during the optical inspection of the rod-shaped articles, a set of parameters is obtained which, in particular, completely describes the composition of a plurality of segments. For example, this set of parameters includes information about:
  • a presence of one or more segments,
  • a number of segments present in the composition,
  • a position and/or type of the segments, whereby the type of a segment is to be understood, for example, as its type and dimension,
  • a size of at least one gap between two adjacent segments,
  • a size a length of at least one segment and/or
  • a presence and/or location of a leaflet which for wrapping the assembly of segments in a rolling device.

Auf der Grundlage dieses Parametersatzes wird beispielsweise eine Prozesssteuerung und/oder -regelung vorgenommen. Beispielsweise kann eine Zuordnung zwischen einem stabförmigen Artikel und einem Parametersatz vorgenommen werden. Erfüllt ein stabförmiger Artikel aufgrund einer Abweichung eines oder mehrerer Parameter von einem vorgegebenen Sollwert ein vordefiniertes Qualitätskriterium nicht, so kann dieser stabförmige Artikel nach dem Rollprozess ausgeworfen und von der weiteren Verarbeitung ausgeschlossen werden. Es ist ferner insbesondere vorgesehen, dass der Parametersatz oder einzelne Werte/Parameter verwendet werden, um den Prozess des Zusammenstellens der Segmente nachzusteuern und/oder zu -regeln. Wird beispielsweise eine zu geringe Lücke zwischen Segmenten festgestellt, so kann diese Information verwendet werden, um die Zusammenstellung so nachzuregeln, dass bei den sich anschließenden Zusammenstellungen der gewünschte Sollwert eingehalten wird. Ferner ist insbesondere vorgesehen, dass der Parametersatz im Rahmen der Qualitätskontrolle zur Detektion von Fehlerquellen herangezogen wird. Beispielsweise können fehlerhafte Basismaterialien identifiziert werden.Process control and/or regulation is carried out, for example, on the basis of this parameter set. For example, an association between a rod-shaped article and a parameter set can be made. If a rod-shaped article does not meet a predefined quality criterion due to a deviation in one or more parameters from a specified target value, this rod-shaped article can be ejected after the rolling process and excluded from further processing. Provision is also made in particular for the parameter set or individual values/parameters to be used in order to readjust and/or regulate the process of assembling the segments. If, for example, the gap between segments is found to be too small, this information can be used to readjust the composition in such a way that the desired target value is maintained in the subsequent compositions. Furthermore, it is provided in particular that the set of parameters is used within the framework of quality control for the detection of error sources. For example, defective base materials can be identified.

Weitere Merkmale der Erfindung werden aus der Beschreibung erfindungsgemäßer Ausführungsformen zusammen mit den Ansprüchen und den beigefügten Zeichnungen ersichtlich. Erfindungsgemäße Ausführungsformen können einzelne Merkmale oder eine Kombination mehrerer Merkmale erfüllen.Further features of the invention will be apparent from the description of embodiments of the invention taken together with the claims and the accompanying drawings. Embodiments according to the invention can fulfill individual features or a combination of several features.

Die Erfindung wird nachstehend ohne Beschränkung des allgemeinen Erfindungsgedankens anhand von Ausführungsbeispielen unter Bezugnahme auf die Zeichnungen beschrieben, wobei bezüglich aller im Text nicht näher erläuterten erfindungsgemäßen Einzelheiten ausdrücklich auf die Zeichnungen verwiesen wird. Es zeigen:

FIG. 1
schematisch und vereinfacht einen Aufbau gemäß dem Stand der Technik, mit dem eine optische Abbildung eines stabförmigen Artikels aus einer Zusammenstellung aus mehreren Segmenten mit einem entozentrischen Objektiv durchführbar ist,
FIG. 2
ein mit einer Anordnung aus FIG. 1 erhaltenes Bild,
FIG. 3
eine Kameraanordnung mit einer Mehrzahl von Kameras zur Bilderfassung eines stabförmigen Artikels aus einer Zusammenstellung aus mehreren Segmenten in einer Vorrichtung der Tabak verarbeitenden Industrie
FIG. 4
ein Bildfeld einer ersten und einer zweiten Kamera der Kameraanordnung,
FIG. 5
zueinander korrigierte Bildfelder der ersten und der zweiten Kamera der Kameraanordnung,
FIG. 6a
ein mit dieser Kameraanordnung erhaltenes Bild, welches von einer Verarbeitungseinheit errechnet wurde aus den Bilddaten der einzelnen Bilder der Kameras der Kameraanordnung
FIG. 6b
im Vergleich dazu das bereits aus FIG. 2 bekannte Bild und
FIG. 7
eine Vorrichtung der Tabak verarbeitenden Industrie zum optischen Prüfen von stabförmigen Artikeln der Tabak verarbeitenden Industrie, wobei die Vorrichtung eine Fördertrommel zur queraxialen Förderung der stabförmigen Artikel umfasst, die Fördertrommel eine Vielzahl von Aufnahmemulden umfasst, in denen die stabförmigen Artikel aufgenommen sind und ferner eine Bilderfassungsvorrichtung umfasst ist, mit der die in den Aufnahmemulden angeordneten stabförmigen Artikel während der queraxialen Förderung erfasst werden.
The invention is described below without restricting the general inventive concept using exemplary embodiments with reference to the drawings, with express reference being made to the drawings with regard to all details according to the invention that are not explained in more detail in the text. Show it:
FIG. 1
schematically and simplifies a structure according to the prior art, with which an optical imaging of a rod-shaped article from a combination of several segments can be carried out with an entocentric lens,
FIG. 2
one with an arrangement FIG. 1 preserved image,
FIG. 3
a camera arrangement with a plurality of cameras for image acquisition of a rod-shaped article from an assembly of several segments in an apparatus of the tobacco processing industry
FIG. 4
an image field of a first and a second camera of the camera arrangement,
FIG. 5
mutually corrected image fields of the first and the second camera of the camera arrangement,
FIG. 6a
an image obtained with this camera arrangement, which was calculated by a processing unit from the image data of the individual images of the cameras of the camera arrangement
FIG. 6b
compared to that already out FIG. 2 familiar picture and
FIG. 7
a device in the tobacco processing industry for optically inspecting rod-shaped articles in the tobacco processing industry, the device comprising a conveying drum for transversely axial conveying of the rod-shaped articles, the conveying drum comprising a multiplicity of receiving troughs in which the rod-shaped articles are accommodated and further comprising an image acquisition device is, with which the arranged in the receiving troughs rod-shaped articles are detected during the transverse axial conveyance.

In den Zeichnungen sind jeweils gleiche oder gleichartige Elemente und/oder Teile mit denselben Bezugsziffern versehen, so dass von einer erneuten Vorstellung jeweils abgesehen wird.In the drawings, elements and/or parts that are the same or of the same type are provided with the same reference numbers, so that they are not presented again in each case.

Fig. 1 zeigt schematisch und vereinfacht einen optischen Aufbau gemäß dem Stand der Technik zum Abbilden eines stabförmigen Artikels 2 mit einem entozentrischen oder nahezu entozentrischen Objektiv 4. Aus Gründen der Vereinfachung ist das entozentrische Objektiv 4 durch eine einzelne Linse dargestellt. Der stabförmige Artikel 2 ist eine Zusammenstellung aus mehreren Segmenten 6a, 6b, 6c, 6d und 6e. Das entozentrische Objektiv 4 erfasst die Gegenstände im Objektraum in einem Öffnungswinkel a. Die in diesem Winkelbereich äußeren Lichtstrahlen fallen schräg in die Eintrittslinse des Objektivs 4 ein. Dies führt dazu, dass die äußeren Segmente 6a, 6b sowie 6d und 6e, vor allem die beiden äußeren Segmente 6a und 6e nicht direkt von oben her, also aus einer Blickrichtung senkrecht zu einer Längsaxialrichtung L (dargestellt in strichpunktierter Linie), betrachtet werden. 1 Fig. 12 shows schematically and simplified a prior art optical setup for imaging a rod-shaped article 2 with an entocentric or near entocentric lens 4. For the sake of simplicity, the entocentric lens 4 is represented by a single lens. The rod-shaped article 2 is an assembly of several segments 6a, 6b, 6c, 6d and 6e. The entocentric lens 4 captures the objects in the object space at an aperture angle α. The outer light beams in this angular range fall obliquely into the entrance lens of objective 4 . This means that the outer segments 6a, 6b and 6d and 6e, especially the two outer segments 6a and 6e, are not viewed directly from above, i.e. from a viewing direction perpendicular to a longitudinal axial direction L (shown in a dot-dash line).

Fig. 2 zeigt beispielhaft und vereinfacht das resultierende Bild des stabförmigen Artikels in der aus Fig. 1 bekannten Anordnung. Die Bilder der Segmente 6a..6e sind mit 8a..8e bezeichnet. Außer dem mittleren Segment 6c (siehe Bezugszeichen 8c) werden alle Segmente 8a..8e mit zumindest teilweisem Blick auf die nach innen, also in Richtung des Zentrums des stabförmigen Artikels 2, gewandten Stirnseiten 10 dargestellt. Dieser Umstand führt dazu, dass die Kanten 12 der Segmente 6a..6e des stabförmigen Artikels 2, die in der idealisierten schematischen Darstellung von Fig. 2 mit durchgezogenener Linie dargestellt sind, nicht trennscharf erfasst werden können. Es ist also mithilfe einer entozentrischen Optik 4, wie sie beispielhaft in Fig. 1 gezeigt ist, nur unter deutlichen Abstrichen im Hinblick auf die erreichbare Genauigkeit möglich, die Abstände D1 bis D4 zwischen den Segmente 6a..6e exakt zu vermessen. Während die Abstände D2 und D3 möglicherweise noch in vertretbarem Umfang genau erfasst werden können, ist dies bei den Abständen D1 und D4 klar nicht mehr der Fall. Ferner ist es nicht möglich, eine Qualität der Kanten 12 mit ausreichender Genauigkeit zu erfassen. 2 shows an example and simplifies the resulting image of the rod-shaped article in FIG 1 known arrangement. The images of the segments 6a..6e are denoted by 8a..8e. Apart from the middle segment 6c (see reference number 8c), all segments 8a . This circumstance means that the edges 12 of the segments 6a..6e of the rod-shaped article 2, in the idealized schematic representation of 2 are shown with a solid line, cannot be clearly identified. It is therefore possible with the help of an entocentric optics 4, as exemplified in 1 is shown, it is only possible to measure the distances D1 to D4 between the segments 6a. While distances D2 and D3 may still be detectable with reasonable accuracy, distances D1 and D4 clearly cannot. Furthermore, it is not possible to guarantee the quality of the To detect edges 12 with sufficient accuracy.

Abhilfe schafft hier die Vorrichtung gemäß Aspekten der Erfindung, deren verschiedene Ausführungsbeispiele im Folgenden beschrieben werden. Die Vorrichtung umfasst ein Förderorgan, welches später im Zusammenhang mit Fig. 7 näher erläutert wird. Ferner umfasst die Vorrichtung eine Bilderfassungsvorrichtung, mit der die stabförmigen Artikel 2 während der queraxialen Förderung auf dem Förderorgan erfassbar sind oder erfasst werden.This is remedied by the device according to aspects of the invention, the various exemplary embodiments of which are described below. The device includes a conveying element, which later in connection with 7 is explained in more detail. Furthermore, the device comprises an image capturing device with which the rod-shaped articles 2 can be captured or are captured during the transverse axial conveyance on the conveying member.

Die Bilderfassungsvorrichtung umfasst eine Kameraanordnung 14, wie sie schematisch und vereinfacht in Fig. 3 gezeigt ist. Die Kameraanordnung 14 umfasst eine Mehrzahl von Kameras 16a, 16b, 16c, 16d und 16e. Jede der Kameras 16a..16e ist mit einem entozentrischen Objektiv 4a..4e versehen. Die Kameras 16a..16e der Kameraanordnung 14 bilden gemeinsam mit ihren zugehörigen entozentrischen Objektiven 4a..4e die Bilderfassungsvorrichtung 18. Die Bilderfassungsvorrichtung 18 umfasst ferner Mittel, beispielsweise eine geeignete Steuerung oder Regelung, welche dafür sorgt, dass die Kameras 16a..16e der Kameraanordnung 14 synchronisiert sind. Mit anderen Worten werden die Kameras 16a..16e zum gleichen Zeitpunkt ausgelöst, erfassen also zum gleichen Zeitpunkt Bilddaten.The image capturing device comprises a camera arrangement 14, as is shown schematically and in simplified form in 3 is shown. The camera assembly 14 includes a plurality of cameras 16a, 16b, 16c, 16d and 16e. Each of the cameras 16a..16e is provided with an entocentric lens 4a..4e. The cameras 16a..16e of the camera arrangement 14 together with their associated entocentric lenses 4a..4e form the image capturing device 18. The image capturing device 18 also includes means, for example a suitable control or regulation, which ensures that the cameras 16a..16e of the Camera arrangement 14 are synchronized. In other words, the cameras 16a . . . 16e are triggered at the same time, ie they capture image data at the same time.

Die Bilderfassungsvorrichtung 18 ist dazu eingerichtet, stabförmige Artikel 2, welche in Aufnahmemulden eines Förderorgans, beispielsweise einer Fördertrommel, angeordnet sind, während ihrer queraxialen Förderung zu erfassen. Die einzelnen Kameras 16a..16e der Kameraanordnung 14 sind in einer Längserstreckungsrichtung der Aufnahmemulden dieses Förderorgans nebeneinander angeordnet. Diese Längserstreckungsrichtung A ist in Fig. 3 mit gepunkteter Linie angedeutet (vgl. auch Fig. 7).The image capturing device 18 is set up to capture rod-shaped articles 2, which are arranged in receiving troughs of a conveying element, for example a conveying drum, while they are being conveyed transversely. The individual cameras 16a . This longitudinal direction A is in 3 indicated with a dotted line (cf. also 7 ).

Die Objektive 4a..4e der Kameras 16a..16e der Kameraanordnung 14 sind entozentrische Optiken bzw. näherungsweise entozentrische Optiken. Aus Gründen der Vereinfachung sind die entozentrischen Objektive 4a..4e jeweils durch eine einzelne Linse dargestellt. Jedes Objektiv 4a..4e erfasst ein Objektfeld und bildet dieses auf den Sensor der zugehörigen Kamera 16a..16e ab. Dargestellt sind die Blickwinkel der Kameras 16a..16e mit ihrem jeweiligen Öffnungswinkel α1, α2, α3, α4 und α5 . Die Öffnungswinkel α1..α5 sind zumindest näherungsweise gleich groß. Aus den Öffnungswinkeln α1..α5 in die Objektive 4a..4e einfallendes Licht wird auf einen zentralen Abbildungsbereich der Sensoren der Kameras 16a..16e abgebildet. Die Öffnungswinkel α1..α5 der entozentrischen Objektive 4a..4e der Kameraanordnung 14 sind allesamt klein gegen den Öffnungswinkel α des in Fig. 1 gezeigten entozentrischen Objektivs 4 gemäß dem Stand der Technik. Die Öffnungswinkel α1..α5 der entozentrischen Objektive 4a..4e überlappen einander im Objektraum. Dieser Überlappungsbereich im Objektraum soll mit Bezugszeichen 26' bezeichnet werden. Aus dem Überlappungsbereich 26' einfallendes Licht wird von jeweils zwei Kameras 16a..16e, beispielsweise von den beiden benachbarten Kameras 16a und 16b, aufgenommen und jeweils in einem zentralen Abbildungsbereich 22a, 22b abgebildet. Der stabförmige Artikel 2 durchläuft während der queraxialen Förderung das Objektfeld und wird von den Kameras 16a..16e erfasst.The lenses 4a..4e of the cameras 16a..16e of the camera arrangement 14 are entocentric optics or approximately entocentric optics. For the sake of simplicity, the lenses are entocentric 4a..4e each represented by a single lens. Each lens 4a..4e captures an object field and maps this onto the sensor of the associated camera 16a..16e. The viewing angles of the cameras 16a..16e are shown with their respective opening angles α1, α2, α3, α4 and α5. The opening angles α1..α5 are at least approximately the same size. Light incident on the lenses 4a..4e from the opening angles α1..α5 is imaged onto a central imaging area of the sensors of the cameras 16a..16e. The opening angles α1..α5 of the entocentric lenses 4a..4e of the camera arrangement 14 are all small compared to the opening angle α of in 1 shown entocentric lens 4 according to the prior art. The opening angles α1..α5 of the entocentric lenses 4a..4e overlap in the object space. This overlapping area in object space shall be denoted by reference numeral 26'. Light incident from the overlapping area 26′ is recorded by two cameras 16a . The rod-shaped article 2 passes through the object field during the cross-axial conveyance and is recorded by the cameras 16a..16e.

Fig. 4 zeigt beispielhaft ein Bildfeld 20a der ersten Kamera 16a, wie es auf einen Flächensensor, beispielsweise einen CMOS-Sensor, dieser Kamera von dem zugehörigen Objektiv 4a abgebildet wird. Ferner ist das Bildfeld 20b der zweiten Kamera 16b der Kameraanordnung 14 gezeigt. Jedes der Bildfelder 20a, 20b umfasst einen zentralen Abbildungsbereich 22a, 22b. Aus dem Objektraum unter dem Winkel α1 in das Objektiv 4a der ersten Kamera 16a einfallendes Licht wird in den zentralen Abbildungsbereich 22a abgebildet. Dies gilt analog auch für die übrigen Kameras 16b..16e. Die jeweiligen zentralen Abbildungsbereiche im Objektraum sollen mit den Bezugszeichen 22a' bis 22e' bezeichnet werden. In diesen Bereichen bilden die zugehörigen Objektive 4a, 4b verzeichnungsfrei oder nahezu verzeichnungsfrei ab. Zumindest liegt die Verzeichnung des zugehörigen Objektivs 4a, 4b unterhalb eines vorgegebenen Grenzwertes. Dieser wird beispielsweise in Prozent von der idealen Abbildung angegeben. Dieser Grenzwert liegt beispielsweise bei kleiner als 1 %, insbesondere kleiner als 2 %, ferner insbesondere kleiner als 2,5 % und ferner insbesondere kleiner als 5 %, ferner insbesondere ist der Abbildungsfehler kleiner als 7,5 %, ferner insbesondere kleiner als 10 % und ferner insbesondere kleiner als 15 %. 4 FIG. 1 shows an example of an image field 20a of the first camera 16a, as it is imaged on a surface sensor, for example a CMOS sensor, of this camera by the associated lens 4a. The image field 20b of the second camera 16b of the camera arrangement 14 is also shown. Each of the image fields 20a, 20b includes a central imaging area 22a, 22b. Light incident from the object space at the angle α1 in the lens 4a of the first camera 16a is imaged in the central imaging area 22a. This also applies analogously to the other cameras 16b..16e. The respective central imaging areas in the object space shall be denoted by the reference symbols 22a' to 22e'. In these areas, the associated lenses 4a, 4b image without distortion or almost without distortion. At least the distortion of the associated lens 4a, 4b is below a predetermined limit value. This is given, for example, as a percentage of the ideal image. This limit value is, for example, less than 1%, in particular less than 2%, moreover in particular less than 2.5% and moreover in particular less than 5%, moreover in particular the imaging error is less than 7.5%, moreover in particular less than 10% and more particularly less than 15%.

Der zentrale Abbildungsbereich 22a, 22b ist von einem Abbildungs-Randbereich 24a, 24b umgeben, in dem die Verzeichnung größer als im zentralen Abbildungsbereich 22a, 22b ist. Insbesondere liegt die Verzeichnung im Abbildungs-Randbereich 24a, 24b oberhalb eines der zuvor genannten Grenzwerte. Die Kameras 16a..16e der Kameraanordnung 14 sind derart angeordnet, dass die zentralen Abbildungsbereiche 22a, 22b benachbarter Kameras 16a..16e einander überlappen. Der Überlappungsbereich 26 ist die Schnittfläche zwischen den benachbarten zentralen Abbildungsbereichen 22a, 22b benachbarter Kameras 16a..16e.The central imaging area 22a, 22b is surrounded by an imaging edge area 24a, 24b, in which the distortion is greater than in the central imaging area 22a, 22b. In particular, the distortion in the imaging edge area 24a, 24b is above one of the aforementioned limit values. The cameras 16a..16e of the camera arrangement 14 are arranged such that the central imaging areas 22a, 22b of adjacent cameras 16a..16e overlap one another. The overlapping area 26 is the interface between the adjacent central imaging areas 22a, 22b of adjacent cameras 16a..16e.

Es ist in der Bilderfassungsvorrichtung 18 eine Verarbeitungseinheit vorhanden, welche dazu eingerichtet ist, die Kameras 16a..16e der Kameraanordnung 14 zu kalibrieren, indem die in den einander überlappenden zentralen Bildbereichen 22a, 22b erfassten Bilddaten benachbarter Kameras 16a..16e ausgewertet werden. Beispielsweise wird eine Kreuzkorrelation zwischen den Bilddaten der Bilder benachbarter Kameras in dem Überlappungsbereich 26 berechnet. Durch einen solchen Vergleich lässt sich ein Verschiebevektor 28 berechnen, um den die Bildfelder 20a, 20b der benachbarten Kameras 16a, 16b gegeneinander verschoben sind. In dem in Fig. 4 dargestellten Ausführungsbeispiel ist der Verschiebevektor 28 ausschließlich senkrecht gerichtet. Fällt der Überlappungsbereich 26 breiter als gewünscht oder schmaler als gewünscht aus, so würde der Verschiebevektor 28 zusätzlich eine entsprechende horizontale Komponente umfassen. Es wird ein Verschiebevektor 28 für alle benachbarten Kameras 16a..16e der Kameraanordnung 14 berechnet.There is a processing unit in the image capturing device 18 which is set up to calibrate the cameras 16a..16e of the camera arrangement 14 by evaluating the image data of neighboring cameras 16a..16e captured in the overlapping central image areas 22a, 22b. For example, a cross-correlation between the image data of the images from neighboring cameras in the overlapping area 26 is calculated. Such a comparison allows a displacement vector 28 to be calculated, by which the image fields 20a, 20b of the adjacent cameras 16a, 16b are displaced relative to one another. in the in 4 illustrated embodiment, the displacement vector 28 is directed exclusively vertically. If the overlapping area 26 turns out to be wider than desired or narrower than desired, the displacement vector 28 would also include a corresponding horizontal component. A displacement vector 28 for all neighboring cameras 16a..16e of the camera arrangement 14 is calculated.

Die Verarbeitungseinheit ist nun dazu eingerichtet, die von den Kameras 16a..16e der Kameraanordnung 14 in den zentralen Abbildungsbereichen 22a, 22b erfassten Bilddaten zu einem gemeinsamen Bild der Kameraanordnung 14 zu verrechnen.The processing unit is now set up to process the cameras 16a..16e of the camera arrangement 14 in the central imaging areas 22a, 22b to calculate a common image of the camera arrangement 14.

Fig. 5 zeigt die beiden um den Verschiebevektor 28 korrigierten Bildfelder 20a, 20b, beispielhaft der Kameras 16a und 16, wobei zur Verdeutlichung das Bildfeld 20b der zweiten Kamera 16b mit gestrichelter Linie dargestellt ist. Die beiden zentralen Aufnahmebereiche 22a, 22b werden zusammengefügt, wobei im Überlappungsbereich 26 wahlweise die Bilddaten der einen oder der anderen Kamera verwendet werden können. figure 5 shows the two image fields 20a, 20b corrected by the displacement vector 28, for example of the cameras 16a and 16, the image field 20b of the second camera 16b being shown with a dashed line for clarification. The two central recording areas 22a, 22b are combined, with the image data of one or the other camera being able to be used in the overlapping area 26 as desired.

Durch entsprechende Anwendung des zuvor beschriebenen Mechanismus lässt sich aus den einzelnen Bildfeldern 20a bis 20e, wie sie in Fig. 3 schematisch und vereinfacht dargestellt sind, ein vollständiges Bild des stabförmigen Artikels 2 gewinnen. Abweichend von der tatsächlichen Ausführung sind in Fig. 3 die Bildfelder 20a..20e, und dies lediglich aus Gründen der Übersichtlichkeit, nicht überlappend dargestellt.By appropriate application of the mechanism described above, the individual image fields 20a to 20e, as shown in 3 are shown schematically and in simplified form, gain a complete picture of the rod-shaped article 2. Deviating from the actual execution are in 3 the image fields 20a..20e, and this only for reasons of clarity, not shown overlapping.

Als Ergebnis dieser Messung kann ein Bild des stabförmigen Artikels 2 bereitgestellt werden, wie es Fig. 6a beispielhaft und schematisch vereinfacht zeigt. Direkt unterhalb ist in Fig. 6b das bereits aus Fig. 2 bekannte Bild des stabförmigen Artikels 2 dargestellt, wie es mit einem einzigen entozentrischen Objektiv 4 gewonnen werden kann. Vorteilhaft liefert die Vorrichtung gemäß Aspekten der Erfindung eine Abbildung des stabförmigen Artikels 2, bei dem sowohl die Kanten 12, von denen lediglich aus Gründen der Übersichtlichkeit nur einige mit Bezugszeichen versehen sind, klar und deutlich erkennbar sind. Folglich können die Abstände D1..D4 zwischen den einzelnen Segmenten 6a..6e sehr genau bestimmt werden, in dem diese unter Kenntnis des Abbildungsmaßstabs der Objektive 4a..4e aus den Abständen D1'..D4' zwischen den Bildern 8a..8e der entsprechenden Segmente 6a..6e errechnet werden.As a result of this measurement, an image of the rod-shaped article 2 can be provided, as shown in FIG. 6a by way of example and schematically simplified. This is already off directly below in FIG. 6b 2 known image of the rod-shaped article 2, as can be obtained with a single entocentric lens 4. Advantageously, apparatus in accordance with aspects of the invention provides an image of the rod-shaped article 2 in which both the edges 12, only some of which are numbered for the sake of clarity only, are clearly visible. Consequently, the distances D1..D4 between the individual segments 6a..6e can be determined very precisely by knowing the imaging scale of the lenses 4a..4e from the distances D1'..D4' between the images 8a..8e of the corresponding segments 6a..6e are calculated.

Die Vorrichtung ist also mit anderen Worten derart eingerichtet, dass Zwischenräume 30 (vgl. Fig. 3, von denen aus Gründen der Übersichtlichkeit lediglich einige mit Bezugszeichen versehen sind) zwischen benachbarten Segmenten 6a..6e der stabförmigen Artikel 2 quantitativ vermessen werden können. Gleiches gilt für eine Länge der Segmente 6a..6e.In other words, the device is set up in such a way that gaps 30 (cf. 3 , only some of which are provided with reference symbols for reasons of clarity) between adjacent ones Segments 6a..6e of the rod-shaped article 2 can be measured quantitatively. The same applies to a length of the segments 6a..6e.

Die Bilderfassungsvorrichtung 18 ist ferner insbesondere dazu eingerichtet, die Abstände D1..D4 zwischen den Segmenten 6a..6e mit einer Genauigkeit zu vermessen, welche besser als 0,1 mm ist. Hierzu wird insbesondere abhängig vom Aufnahmeabstand B (Objektweite), wie er in Fig. 3 angedeutet ist, eine Auflösung der Objektive 4a..4e und eine Auflösung der in den Kameras 16a..16e verwendeten Sensoren (Anzahl der Bildpunkte oder Pixel pro Längeneinheit) so gewählt, dass die gewünschte Auflösung erreicht wird.The image capturing device 18 is also set up in particular to measure the distances D1..D4 between the segments 6a..6e with an accuracy which is better than 0.1 mm. For this purpose, depending in particular on the recording distance B (object distance), as shown in 3 is indicated, a resolution of the lenses 4a..4e and a resolution of the sensors used in the cameras 16a..16e (number of image points or pixels per unit length) are selected such that the desired resolution is achieved.

Fig. 7 zeigt eine Vorrichtung 32 der Tabak verarbeitenden Industrie zur optischen Prüfung von stabförmigen Artikeln 2, wobei die stabförmigen Artikel 2 aus Gründen der Vereinfachung in Fig. 7 nicht als Zusammenstellung aus mehreren Segmenten dargestellt sind. Die Vorrichtung 32 umfasst als Förderorgan eine Fördertrommel 34, welche abschnittsweise dargestellt ist. Auf einer Oberfläche der Fördertrommel 34 befinden sich Aufnahmemulden 36, in denen die stabförmigen Artikel 2 während ihrer queraxialen Förderung in einer Förderrichtung R aufgenommen sind. Die Förderrichtung R entspricht einer Drehrichtung der Fördertrommel. Oberhalb der Aufnahmemulden 36 befindet sich die bereits zuvor beschriebene Bilderfassungsvorrichtung 18, von der in beispielhafter Darstellung lediglich einige Kameraeinheiten, umfassend jeweils eine Kamera und ein entozentrisches Objektiv, schematisch dargestellt sind. Die Aufnahmemulden 36 weisen eine Längserstreckungsrichtung A auf, welche bereits im Zusammenhang mit Fig. 3 erwähnt wurde und in Fig. 7 ebenfalls mit punktierter Linie angedeutet ist. Die Längserstreckungsrichtung A ist zumindest näherungsweise senkrecht zur Förderrichtung R orientiert. Die einzelnen Kameras 16a..16e der Kameraanordnung 14 der Bilderfassungsvorrichtung 18 sind in dieser Längserstreckungsrichtung A nebeneinander angeordnet. So ist es möglich, die stabförmigen Artikel 2 während der queraxialen Förderung auf dem Förderorgan 34 optisch zu prüfen. 7 shows a device 32 of the tobacco processing industry for the optical inspection of rod-shaped articles 2, the rod-shaped articles 2 for reasons of simplification in 7 are not presented as a compilation of several segments. The device 32 comprises a conveying drum 34 as a conveying element, which is shown in sections. On a surface of the conveyor drum 34 there are receiving troughs 36 in which the rod-shaped articles 2 are received in a conveying direction R during their transverse axial conveyance. The conveying direction R corresponds to a direction of rotation of the conveying drum. Above the receiving troughs 36 is the previously described image capturing device 18, of which only a few camera units, each comprising a camera and an entocentric lens, are shown schematically in an exemplary representation. The receiving troughs 36 have a longitudinal extension direction A, which is already in connection with 3 was mentioned and in 7 is also indicated with a dotted line. The direction of longitudinal extension A is oriented at least approximately perpendicular to the conveying direction R. The individual cameras 16a . It is thus possible to check the rod-shaped articles 2 optically during the cross-axial conveyance on the conveying element 34 .

Die Vorrichtung 32 umfasst ferner eine Verarbeitungseinheit 38, beispielsweise einen Computer, eine Workstation oder dergleichen, welche unter anderem dazu eingerichtet ist, die Bilderfassungsvorrichtung 18 zu steuern und auszulesen, die erwähnte Kalibrierung durchzuführen und das gemeinsame Bild der Kameraanordnung 14 zu errechnen.The device 32 also includes a processing unit 38, for example a computer, a workstation or the like, which is set up, among other things, to control and read out the image capturing device 18, to carry out the aforementioned calibration and to calculate the joint image of the camera arrangement 14.

Im Rahmen der Erfindung sind Merkmale, die mit "insbesondere" oder "vorzugsweise" gekennzeichnet sind, als fakultative Merkmale zu verstehen.In the context of the invention, features that are marked with "particularly" or "preferably" are to be understood as optional features.

BezuqszeichenlisteReference character list

22
stabförmiger Artikelrod-shaped article
4, 4a..4e4, 4a..4e
entozentrisches Objektiventocentric lens
6a..6e6a..6e
Segmentsegment
8a..8e8a..8e
BilderPictures
1010
Stirnseiteface
1212
Schnittkantencut edges
1414
Kameraanordnungcamera arrangement
16a..16e16a..16e
Kameracamera
1818
Bilderfassungsvorrichtungimage capture device
20a, 20b20a, 20b
Bildfeldimage field
22a, 22b, 22a'..22e'22a, 22b, 22a'..22e'
zentraler Abbildungsbereichcentral imaging area
24a, 24b24a, 24b
Abbildungs-RandbereichImage border area
26, 26'26, 26'
Überlappungsbereichoverlap area
2828
Verschiebevektormove vector
3030
Zwischenräumespaces
3232
Vorrichtung der Tabak verarbeitenden IndustrieDevice of the tobacco processing industry
3434
Förderorganfunding body
3636
Aufnahmemuldenreceiving recesses
3838
Verarbeitungseinheitprocessing unit
α, α1..α5α,α1..α5
Öffnungswinkelopening angle
LL
Längsaxialrichtunglongitudinal axial direction
D1..D4, D1'..D4'D1..D4, D1'..D4'
AbstandDistance
AA
Längserstreckungsrichtunglongitudinal direction
RR
Förderrichtungconveying direction

Claims (11)

  1. An apparatus (32) of the tobacco industry for visually inspecting rod-shaped items (2) of the tobacco industry, wherein the rod-shaped items (2) are each an assembly made up of multiple segments (6a..6e), and wherein the apparatus (32) comprises a conveying element (34) for conveying the rod-shaped items (2) in a transverse-axial manner and the conveying element (34) comprises a plurality of receiving troughs (36) in which the rod-shaped items (2) can be or are received, wherein the apparatus (32) additionally comprises an image acquisition device (18) with which the rod-shaped items (2) arranged in the receiving troughs (36) can be or are acquired during the transverse-axial conveying, wherein the image acquisition device (18) comprises a camera arrangement (14) having a plurality of cameras (16a..16e) for image acquisition, and wherein the cameras (16a..16e) are in particular synchronized for simultaneous image acquisition, and wherein each camera (16a..16e) of the camera arrangement (14) comprises an entocentric lens (4a..4e) and, with the latter, an object field, which the rod-shaped items (2) arranged in the receiving troughs (36) run through during the transverse-axial conveying, is imaged onto a field of view (20a, 20b), wherein the field of view (20a, 20b) comprises a central imaging region (22a, 22b) in which the lens (4a..4e) images free of distortion or at least with a distortion below a predefined or predefinable threshold value, which is surrounded by an imaging edge region (24a, 24b) having greater distortion, characterized in that said cameras (16a..16e) are arranged next to one another in a longitudinal extension direction (A) of the receiving troughs (36) and the cameras (16a..16e) are arranged in the camera arrangement (14) in such a manner that the central imaging regions (22a, 22b) of neighboring cameras (16a..16e) overlap one another, wherein the image acquisition device (18) additionally comprises a processing unit (38) which is designed to balance the image data acquired by at least two, in particular all of the, cameras (16a..16e) of the camera arrangement (14) in the central imaging regions (22a, 22b) to produce a common image of the camera arrangement (14).
  2. The apparatus (32) of the tobacco industry according to Claim 1, characterized in that the processing unit (38) is additionally configured to quantitatively survey at least one intermediate space (30) between two neighboring segments (6a..6e) and/or at least one length of a segment (6a..6e) of the rod-shaped items (2).
  3. The apparatus (32) of the tobacco industry according to Claim 2, characterized in that the image acquisition device (18) and the processing unit (38) are additionally configured to measure at least one distance (D1..D4) between two neighboring segments (6a..6e) oriented in the longitudinal extension direction (A) of the receiving troughs (36) and/or one length of a segment (6a..6e) oriented in said longitudinal extension direction (A), in particular with an accuracy of better than 0.1 mm.
  4. The apparatus (32) of the tobacco industry according to any one of Claims 1 to 3, characterized in that the processing unit (38) is additionally designed to calibrate the cameras (16a..16e) of the camera arrangement (14) by evaluating the image data of neighboring cameras (16a..16b) acquired in the central image regions (22a, 22b) overlapping one another and by determining a shift vector (28) between the fields of view (20a, 20b) of neighboring cameras (16a..16e).
  5. The apparatus (32) of the tobacco industry according to any one of Claims 1 to 4, characterized in that the conveying element (34) is a conveying drum.
  6. An arrangement of the tobacco industry, comprising an apparatus according to any one of Claims 1 to 5 and a rolling device, wherein the apparatus for visually inspecting rod-shaped items (2) is arranged upstream of the rolling device with respect to a conveying direction of the rod-shaped items (2).
  7. A method for visually inspecting rod-shaped items (2) of the tobacco industry, wherein the rod-shaped items (2) are each an assembly made up of multiple segments (6a..6e) and are conveyed by a conveying element in a transverse-axial manner in a receiving trough (36) of the conveying element, wherein the rod-shaped items (2) are acquired with a plurality of cameras (16a..16e) during the transverse-axial conveying, wherein said cameras (16a..16e) are arranged next to one another in a longitudinal extension direction (A) of the receiving trough (36), characterized in that the cameras (16a..16e) are in particular synchronized and the rod-shaped items (2) are in particular acquired simultaneously and each camera (16a..16e) images an object field partially comprising the rod-shaped items (2) entocentrically onto a field of view (20a, 20b), wherein the field of view (20a, 20b) comprises a central imaging region (22a, 22b) in which a lens (4) of the camera (16a..16e) images free of distortion or at least with a distortion below a predefined or predefinable threshold value, which is surrounded by an imaging edge region (24a, 24b) having greater distortion, and wherein the rod-shaped item (2) is imaged in such a manner that the central imaging regions (22a, 22b) of neighboring cameras (16a..16e) overlap one another, wherein the image data acquired by at least two, in particular by all, of the cameras (16a..16e) are balanced in the central imaging regions (22a, 22b) to produce a common image.
  8. The method according to Claim 7, characterized in that at least one intermediate space (30) between two neighboring segments (6a..6e) and/or at least one length of a segment (6a..6e) of the rod-shaped items (2) is/are quantitatively surveyed.
  9. The method according to Claim 8, characterized in that a width of an intermediate space (30) oriented in the longitudinal extension direction (A) of the receiving trough (36) and/or a length of a segment (6a..6e) oriented in the longitudinal extension direction (A) is/are measured, in particular with an accuracy of better than 0.1 mm.
  10. The method according to any one of Claims 7 to 9, characterized in that the cameras (16a..16e) are calibrated by evaluating the image data of neighboring cameras (16a..16e) acquired in the central image regions (22a, 22b) overlapping one another and by determining a shift vector (28) between the imaging regions (22a, 22b) of neighboring cameras (16).
  11. The method according to any one of Claims 7 to 10, characterized in that the rod-shaped items (2) are acquired during the transverse-axial conveying on a conveying drum.
EP19150463.8A 2018-01-11 2019-01-07 Device and method for inspecting rod-shaped items for the tobacco industry Active EP3510877B1 (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
DE102018100500.8A DE102018100500A1 (en) 2018-01-11 2018-01-11 Apparatus and method for testing rod-shaped articles of the tobacco processing industry

Publications (3)

Publication Number Publication Date
EP3510877A2 EP3510877A2 (en) 2019-07-17
EP3510877A3 EP3510877A3 (en) 2019-09-25
EP3510877B1 true EP3510877B1 (en) 2023-01-04

Family

ID=65003287

Family Applications (1)

Application Number Title Priority Date Filing Date
EP19150463.8A Active EP3510877B1 (en) 2018-01-11 2019-01-07 Device and method for inspecting rod-shaped items for the tobacco industry

Country Status (5)

Country Link
EP (1) EP3510877B1 (en)
KR (1) KR20190085867A (en)
CN (1) CN110025039B (en)
DE (1) DE102018100500A1 (en)
PL (1) PL3510877T3 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102022109639A1 (en) 2022-04-21 2023-10-26 Körber Technologies Gmbh Promoting rod-shaped articles in the tobacco processing industry

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102005046581A1 (en) 2005-09-28 2007-03-29 Hauni Maschinenbau Ag Multi-segmented filters properties measuring device for tobacco processing industry, has laser light source forming line of electromagnetic radiation on filters, where extension of line is smaller than diameter of filters
DE102009041320A1 (en) 2009-09-15 2011-03-24 Hauni Maschinenbau Ag Machine for the production and method of manufacturing multi-segment filters of the tobacco processing industry
DE102014209000A1 (en) * 2014-05-13 2015-11-19 Hauni Maschinenbau Ag Optical inspection of rod-shaped articles of the tobacco processing industry
DE202015004790U1 (en) * 2015-07-03 2015-08-17 Ralf Stöcker Optical inspection device for testing the surfaces of articles of the food and beverage industry, in particular the tobacco processing industry and the pharmaceutical industry
DE102016107247A1 (en) * 2016-04-19 2017-10-19 Hauni Maschinenbau Gmbh Arrangement and method for optically inspecting rod-shaped articles of the tobacco processing industry
CN205619885U (en) * 2016-04-25 2016-10-05 湖南华讯博视科技发展有限责任公司 Filter rod circumference detector

Also Published As

Publication number Publication date
KR20190085867A (en) 2019-07-19
DE102018100500A1 (en) 2019-07-11
CN110025039B (en) 2022-11-01
EP3510877A3 (en) 2019-09-25
CN110025039A (en) 2019-07-19
PL3510877T3 (en) 2023-04-24
EP3510877A2 (en) 2019-07-17

Similar Documents

Publication Publication Date Title
EP3246161B1 (en) Device for inspecting printed products
EP3891465B1 (en) Optical measuring apparatus
DE102014203158B4 (en) Optical inspection of rod-shaped articles of the tobacco processing industry
DE102011114674B4 (en) Method and device for determining the 3D coordinates of an object
DE102014118753A1 (en) Tester
DE2260090B2 (en) Photoelectric device for determining the roughness or smoothness of diffuse-scattering surfaces
DE102018114860A1 (en) Device and method for the optical measurement of a measurement object
DE102011082178A1 (en) Optical inspection of rod-shaped articles of the tobacco processing industry
WO1992008103A1 (en) Process and device for the opto-electronic measurement of objects
EP1826557B2 (en) Optical monitoring of products of the tobacco processing industry
DE2947791A1 (en) DEVICE FOR COLOR MONITORING OF SHEET OR SHAPED MATERIALS IN MOTION, IN PARTICULAR THE PRINTING MATERIALS OF PRINTING MATERIALS OF PRINTING MACHINES
EP3410091A1 (en) Device for detecting a modulation transfer function and a centring system of an optical system
DE102007036616A1 (en) Optical control of tobacco industry products
DE102013108722B4 (en) Method and device for detecting defects of a flat surface
EP3510877B1 (en) Device and method for inspecting rod-shaped items for the tobacco industry
EP2208987B1 (en) Method and device for visual surface inspection
EP3139147B1 (en) Apparatus and method for measuring a wavelength dependent optical characteristic of an optical system
DE102014209000A1 (en) Optical inspection of rod-shaped articles of the tobacco processing industry
DE102014205701A1 (en) Method and device for determining the position and / or orientation of at least one plug-in contact
EP3445183A1 (en) Assembly and method for optically inspecting rod-shaped articles of the tobacco-processing industry
DE202004020330U1 (en) Inspection device for the edge regions of planar elements, especially glass plates, has a single camera with at least two separate row or matrix imaging areas and a light deflection unit allocated to each row or matrix area
EP1862309B1 (en) Sensor device
DE102009009393A1 (en) Device and method for measuring a body
DE102006005874A1 (en) Contactless cylinder measurement unit has lamps generating lines on surface and orthogonal shadows for multiple line triangulation
DE102011116791B4 (en) Optical test method with multiple reading / freezing

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN PUBLISHED

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

PUAL Search report despatched

Free format text: ORIGINAL CODE: 0009013

AK Designated contracting states

Kind code of ref document: A3

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

RIC1 Information provided on ipc code assigned before grant

Ipc: A24C 5/34 20060101AFI20190819BHEP

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20200226

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

RIC1 Information provided on ipc code assigned before grant

Ipc: A24D 3/02 20060101ALI20220722BHEP

Ipc: A24C 5/34 20060101AFI20220722BHEP

INTG Intention to grant announced

Effective date: 20220819

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

RAP3 Party data changed (applicant data changed or rights of an application transferred)

Owner name: KOERBER TECHNOLOGIES GMBH

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 502019006669

Country of ref document: DE

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1541312

Country of ref document: AT

Kind code of ref document: T

Effective date: 20230115

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Free format text: LANGUAGE OF EP DOCUMENT: GERMAN

REG Reference to a national code

Ref country code: NL

Ref legal event code: FP

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG9D

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20230126

Year of fee payment: 5

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: NL

Payment date: 20230125

Year of fee payment: 5

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230616

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230104

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230504

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230404

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230104

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230104

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230104

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230104

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: IT

Payment date: 20230331

Year of fee payment: 5

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230104

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230504

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230405

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230104

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: PL

Payment date: 20230105

Year of fee payment: 5

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230107

REG Reference to a national code

Ref country code: DE

Ref legal event code: R026

Ref document number: 502019006669

Country of ref document: DE

Ref country code: BE

Ref legal event code: MM

Effective date: 20230131

PLBI Opposition filed

Free format text: ORIGINAL CODE: 0009260

PLAX Notice of opposition and request to file observation + time limit sent

Free format text: ORIGINAL CODE: EPIDOSNOBS2

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230104

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230104

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230104

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230131

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230104

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230104

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230104

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230131

26 Opposition filed

Opponent name: G.D S.P.A.

Effective date: 20231003

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230104

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230131

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20230404

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230404

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230104

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230107

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230404

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230304

PLBB Reply of patent proprietor to notice(s) of opposition received

Free format text: ORIGINAL CODE: EPIDOSNOBS3

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: PL

Payment date: 20231215

Year of fee payment: 6

Ref country code: NL

Payment date: 20240126

Year of fee payment: 6