EP2362330B1 - Vorrichtung und Verfahren zum Zählen und Erkennen von flächigen Produkten - Google Patents

Vorrichtung und Verfahren zum Zählen und Erkennen von flächigen Produkten Download PDF

Info

Publication number
EP2362330B1
EP2362330B1 EP11003404.8A EP11003404A EP2362330B1 EP 2362330 B1 EP2362330 B1 EP 2362330B1 EP 11003404 A EP11003404 A EP 11003404A EP 2362330 B1 EP2362330 B1 EP 2362330B1
Authority
EP
European Patent Office
Prior art keywords
products
detection
beam profile
detection region
electronic camera
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Not-in-force
Application number
EP11003404.8A
Other languages
German (de)
English (en)
French (fr)
Other versions
EP2362330A2 (de
EP2362330A3 (de
Inventor
Steven Brossi
Carl Conrad Maeder
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ferag AG
Original Assignee
Ferag AG
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ferag AG filed Critical Ferag AG
Publication of EP2362330A2 publication Critical patent/EP2362330A2/de
Publication of EP2362330A3 publication Critical patent/EP2362330A3/de
Application granted granted Critical
Publication of EP2362330B1 publication Critical patent/EP2362330B1/de
Not-in-force legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
    • B65H—HANDLING THIN OR FILAMENTARY MATERIAL, e.g. SHEETS, WEBS, CABLES
    • B65H43/00—Use of control, checking, or safety devices, e.g. automatic devices comprising an element for sensing a variable
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
    • B65H—HANDLING THIN OR FILAMENTARY MATERIAL, e.g. SHEETS, WEBS, CABLES
    • B65H29/00—Delivering or advancing articles from machines; Advancing articles to or into piles
    • B65H29/003—Delivering or advancing articles from machines; Advancing articles to or into piles by grippers
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
    • B65H—HANDLING THIN OR FILAMENTARY MATERIAL, e.g. SHEETS, WEBS, CABLES
    • B65H29/00—Delivering or advancing articles from machines; Advancing articles to or into piles
    • B65H29/02—Delivering or advancing articles from machines; Advancing articles to or into piles by mechanical grippers engaging the leading edge only of the articles
    • B65H29/04—Delivering or advancing articles from machines; Advancing articles to or into piles by mechanical grippers engaging the leading edge only of the articles the grippers being carried by endless chains or bands
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
    • B65H—HANDLING THIN OR FILAMENTARY MATERIAL, e.g. SHEETS, WEBS, CABLES
    • B65H29/00—Delivering or advancing articles from machines; Advancing articles to or into piles
    • B65H29/66—Advancing articles in overlapping streams
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
    • B65H—HANDLING THIN OR FILAMENTARY MATERIAL, e.g. SHEETS, WEBS, CABLES
    • B65H43/00—Use of control, checking, or safety devices, e.g. automatic devices comprising an element for sensing a variable
    • B65H43/08—Photoelectric devices
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06M—COUNTING MECHANISMS; COUNTING OF OBJECTS NOT OTHERWISE PROVIDED FOR
    • G06M1/00—Design features of general application
    • G06M1/08—Design features of general application for actuating the drive
    • G06M1/10—Design features of general application for actuating the drive by electric or magnetic means
    • G06M1/101—Design features of general application for actuating the drive by electric or magnetic means by electro-optical means
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06M—COUNTING MECHANISMS; COUNTING OF OBJECTS NOT OTHERWISE PROVIDED FOR
    • G06M7/00—Counting of objects carried by a conveyor
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
    • B65H—HANDLING THIN OR FILAMENTARY MATERIAL, e.g. SHEETS, WEBS, CABLES
    • B65H2301/00—Handling processes for sheets or webs
    • B65H2301/40—Type of handling process
    • B65H2301/42—Piling, depiling, handling piles
    • B65H2301/422—Handling piles, sets or stacks of articles
    • B65H2301/4224—Gripping piles, sets or stacks of articles
    • B65H2301/42242—Gripping piles, sets or stacks of articles by acting on the outermost articles of the pile for clamping the pile
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
    • B65H—HANDLING THIN OR FILAMENTARY MATERIAL, e.g. SHEETS, WEBS, CABLES
    • B65H2301/00—Handling processes for sheets or webs
    • B65H2301/40—Type of handling process
    • B65H2301/42—Piling, depiling, handling piles
    • B65H2301/422—Handling piles, sets or stacks of articles
    • B65H2301/4224—Gripping piles, sets or stacks of articles
    • B65H2301/42244—Sets in which articles are offset to each other
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
    • B65H—HANDLING THIN OR FILAMENTARY MATERIAL, e.g. SHEETS, WEBS, CABLES
    • B65H2511/00—Dimensions; Position; Numbers; Identification; Occurrences
    • B65H2511/10—Size; Dimensions
    • B65H2511/13—Thickness
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
    • B65H—HANDLING THIN OR FILAMENTARY MATERIAL, e.g. SHEETS, WEBS, CABLES
    • B65H2511/00—Dimensions; Position; Numbers; Identification; Occurrences
    • B65H2511/10—Size; Dimensions
    • B65H2511/16—Irregularities, e.g. protuberances
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
    • B65H—HANDLING THIN OR FILAMENTARY MATERIAL, e.g. SHEETS, WEBS, CABLES
    • B65H2511/00—Dimensions; Position; Numbers; Identification; Occurrences
    • B65H2511/10—Size; Dimensions
    • B65H2511/17—Deformation, e.g. stretching
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
    • B65H—HANDLING THIN OR FILAMENTARY MATERIAL, e.g. SHEETS, WEBS, CABLES
    • B65H2511/00—Dimensions; Position; Numbers; Identification; Occurrences
    • B65H2511/30—Numbers, e.g. of windings or rotations
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
    • B65H—HANDLING THIN OR FILAMENTARY MATERIAL, e.g. SHEETS, WEBS, CABLES
    • B65H2513/00—Dynamic entities; Timing aspects
    • B65H2513/40—Movement
    • B65H2513/42—Route, path
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
    • B65H—HANDLING THIN OR FILAMENTARY MATERIAL, e.g. SHEETS, WEBS, CABLES
    • B65H2553/00—Sensing or detecting means
    • B65H2553/40—Sensing or detecting means using optical, e.g. photographic, elements
    • B65H2553/41—Photoelectric detectors
    • B65H2553/414—Photoelectric detectors involving receptor receiving light reflected by a reflecting surface and emitted by a separate emitter
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
    • B65H—HANDLING THIN OR FILAMENTARY MATERIAL, e.g. SHEETS, WEBS, CABLES
    • B65H2553/00—Sensing or detecting means
    • B65H2553/40—Sensing or detecting means using optical, e.g. photographic, elements
    • B65H2553/42—Cameras
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
    • B65H—HANDLING THIN OR FILAMENTARY MATERIAL, e.g. SHEETS, WEBS, CABLES
    • B65H2553/00—Sensing or detecting means
    • B65H2553/40—Sensing or detecting means using optical, e.g. photographic, elements
    • B65H2553/46—Illumination arrangement
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
    • B65H—HANDLING THIN OR FILAMENTARY MATERIAL, e.g. SHEETS, WEBS, CABLES
    • B65H2557/00—Means for control not provided for in groups B65H2551/00 - B65H2555/00
    • B65H2557/50—Use of particular electromagnetic waves, e.g. light, radiowaves or microwaves
    • B65H2557/51—Laser
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
    • B65H—HANDLING THIN OR FILAMENTARY MATERIAL, e.g. SHEETS, WEBS, CABLES
    • B65H2701/00—Handled material; Storage means
    • B65H2701/10—Handled articles or webs
    • B65H2701/19—Specific article or web
    • B65H2701/1932—Signatures, folded printed matter, newspapers or parts thereof and books
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06M—COUNTING MECHANISMS; COUNTING OF OBJECTS NOT OTHERWISE PROVIDED FOR
    • G06M2207/00—Indexing scheme relating to counting of objects carried by a conveyor
    • G06M2207/02—Counting of generally flat and overlapped articles, e.g. cards, newspapers

Definitions

  • the present invention relates to a device for counting and detecting sheet-like products according to claim 1 and a method for counting and detecting sheet-like products according to claim 8.
  • Devices for counting flat products are generally known technical aids to determine the number of flat products. Upon detection of a deviation between an expected number of sheets and the number determined by the meter, corresponding error correction processes may be initiated. In counting devices optical sensors are often used to detect the number of flat products contactlessly and quickly.
  • Counting devices are for example in the EP-A-1 661 833 and the WO 2007/012206 disclosed.
  • flat products transported in brackets are equipped with identification information which is subjected to an optical-electronic control when the flat products move past at a control point. Images of the identification information are registered by means of an image recording device. The captured images are processed electronically and, as a result of this processing, control signals are generated for downstream processing devices.
  • planar products In the case of the known device, the planar products must additionally be provided with identification information which is then to be detected in an image acquisition process which is frequently dependent on ambient lighting. Completely flat adjacent products are not counted in this way or only with great effort.
  • An automated identification system for three-dimensional objects with a contoured surface such as cabinet doors or wooden drawer fronts, is described.
  • This includes a first classification station that uses two laser sources and video imaging techniques to identify and distinguish between similar items.
  • Each of the two lasers generates a fan-shaped light plane, which are perpendicular to each other, on the front of the door.
  • the fan-shaped light planes create a first profile strip in the horizontal direction across the width of the door surface and a second profile strip in the vertical or longitudinal direction.
  • a first video camera captures the profile of the profile strip across the width of the door.
  • a second camera is used to detect the profile strip in the vertical direction to determine whether the panel shape is square or domed.
  • the recorded profile strips are compared with a library of known profiles.
  • a third camera which is arranged substantially parallel to the first camera, makes the width measurement of the door.
  • the length of the door is determined by means of a photoelectric sensor which records the time it takes for the door to pass a point along a moving
  • the object of the present invention is to provide an apparatus and a method for counting and detecting sheet-like products, which makes it possible to detect defective products.
  • the device according to the invention for counting and detecting sheet-like products, in particular printed products has a light source, an optical sensor and an evaluation unit connected to the optical sensor.
  • the light source in a preferred embodiment, a laser, has a beam shaping optics, for example in the form of optical lenses, in particular of cylindrical lenses, of apertures or diffractive optical elements, through which the emitted light, a predetermined illumination beam profile "imprinted" is.
  • a predetermined illumination beam profile "imprinted" Within the illumination beam profile objects are irradiated with light.
  • the light source can be assigned via the beam shaping optical system an optical axis, which is based on the light source extends in a straight line in the room. For the purposes of this application, this optical axis simultaneously forms a central beam axis of the illumination beam profile and is also referred to below as an illumination beam axis.
  • the optical sensor is an electronic camera having a plurality of photosensitive elements, and is equipped with detection optics for forming a detection beam profile.
  • detection optics for example, a camera lens is used.
  • the detection beam profile includes all the locations from which the optical sensor can detect light.
  • the detection beam profile of the optical sensor is composed of the individual detection beam profiles associated with each individual photosensitive element.
  • the detection beam profile of the optical sensor could be visualized by replacing the photosensitive elements with small light sources.
  • an optical axis can also be assigned to the optical sensor via the detection optics. For the purposes of this application, this optical axis simultaneously forms a central beam axis of the detection beam profile and is also referred to below as a detection beam axis.
  • the illumination beam profile and the detection beam profile are aligned with an angle offset from one another such that they overlap in a detection area.
  • the illumination beam axis and the detection beam axis are even in one plane.
  • To count the Flat products must be at least a portion of the surface profile of the sheet products in the detection area.
  • This section is according to the invention at least partially limited by the illumination beam profile and detectable by means of the optical sensor.
  • the optical sensor may generate a detection signal with information about the detected portion of the surface profile.
  • the detection signal is forwarded to a downstream evaluation unit.
  • the evaluation unit preferably a computer, can use the detection signal to determine the number of areal products which were located in the detection area at the time of detection.
  • the apparatus for counting and detecting sheet-like products is assigned a transport device.
  • the flat products which are moved through the detection area along a transport direction by means of the transport device are preferably continuously counted in order, for example, to check their completeness.
  • the illumination beam axis is preferably aligned inclined relative to the surface normal of, for example, resting on a conveyor belt or transported by means of brackets or grippers flat products.
  • the illumination beam profile in the detection area is preferably formed by means of the beam shaping optics as a substantially rectilinear region, in particular as a so-called illumination line, which illuminates the section of the surface profile of the planar products in a defined manner.
  • the illumination line extends substantially parallel to Transport direction.
  • a camera as an optical sensor.
  • the detection beam profile is formed by the detection optics such that an image of the light line projected onto the surface of the planar products by the light source is generated on the photosensitive elements of the camera.
  • an image recorded by the camera is projected from the illumination line projected onto this uneven "projection surface” whose bends and heels reflect.
  • This image information is forwarded in the detection signal to an electrically connected computer.
  • a computer-executable image processing program can then determine from the image of the projected illumination line on the basis of the curvatures and paragraphs the number of planar products that have been in the detection area. So that the image information is influenced as little as possible by movement artefacts due to the transport of the sheet-like products during image acquisition, the recording or detection time is short compared to the time within which a flat product has moved by the amount of its thickness.
  • the number of surface products located in the detection area is determined solely from the detected surface profile of the sheet-like products. It is not necessary to attach identification information to the sheet products. Due to the relative to the ambient light comparatively high intensity of the light generated by the light source in the illumination beam profile, in particular within the illumination line in the detection area, there is sufficient contrast in the image recordings, so that a reliable identification of the illuminated surface profile is guaranteed.
  • the optical sensor may be provided with corresponding filter elements to further reduce the interference of ambient light.
  • FIG Fig. 1 A particularly preferred embodiment of the device according to the invention for counting and detecting sheet-like products (also referred to below as counting device) 10 with a transport device 12 assigned to it is shown in FIG Fig. 1 shown schematically.
  • the light source 16 preferably lasers, in particular laser diodes or gas lasers, LEDs, but also classical radiation sources, such as incandescent or halogen lamps, can be used.
  • the light source 16 is equipped with beam shaping optics 22 which provide a predetermined illumination beam profile 24 and define an optical axis of the light source 16.
  • the illumination beam profile 24 of the light source 16 arranged laterally relative to a transport direction T along which the planar products 14 are transported has a cross section (also beam cross section) with a substantially at least partially rectilinear boundary, substantially line-like, preferably substantially rectilinear shape.
  • the beam cross section is measured at right angles to the optical axis of the light source 16, hereinafter also referred to as the illumination beam axis 26.
  • the line-like, preferably straight beam cross-section is also referred to as the illumination line.
  • the illumination beam profile 24 with its line-like beam cross-section extends substantially in one plane.
  • Elongated, essentially line-like beam cross-sections can be produced with known beam-shaping optics 22, which are equipped, for example, with cylindrical lenses, diaphragms or diffractive elements.
  • the illumination beam profile 24 preferably has a higher light intensity than the ambient light, at least in a detection area defined below.
  • the light source 16 preferably provides substantially monochromatic light, such as that produced by lasers, single color LEDs, or classic light sources equipped with filters. In this way, it is possible to distinguish the light generated by the light source 16 and scattered by the planar products 14 and detected by the optical sensor 18 from the ambient light, both because of its intensity and its spectral range, and thus reliable detection and counting of the sheet-like products 14 to ensure.
  • an optical sensor 18 in the described embodiments of the inventive counting device 10 is an electronic camera with a plurality of photosensitive elements, such as a CCD camera, used.
  • the optical sensor 18 is equipped with a detection lens 28 in the form of a camera lens, which provides a detection beam profile 30 and defines an optical axis of the optical sensor 18.
  • the optical axis of the optical sensor 18 will hereinafter be referred to as the detection beam axis 32.
  • the optical sensor 18 is arranged above the sheet-like products 14, so that an image of the light line projected onto the flat products 14 on the photosensitive elements of the optical sensor 18 is generated by means of the detection optics 28.
  • the illumination beam profile 24 of the light source 16 and the detection beam profile 30 of the optical sensor 18 are aligned with angular offset from each other so that they overlap in a detection area in which there is at least a portion 33 of a surface profile of the sheet products 14 for counting.
  • the located in the detection area and thus illuminated portion 33 of the surface profile is at least partially limited by the predetermined illumination beam profile 24.
  • a scattering angle ⁇ included by the illumination beam axis 26 and the detection beam axis 32 is preferably between 10 ° and less than 180 °, more preferably between 30 ° and 45 °.
  • the light source 16 may be arranged laterally with respect to the sheet-like products 14, that the longitudinal axis of the illumination line is aligned substantially parallel to the transport direction T.
  • the illumination line preferably extends over an edge region of the sheet-like products 14 folded flat products 14 preferably over the collar 34th
  • the optical sensor 18 can be arranged both above and laterally from the flat products 14.
  • the illustrated positions of light source 16 and optical sensor 18 are also interchangeable.
  • the detection beam axis 32 or the illumination beam axis 26 is preferably aligned inclined to the surface normal of the flat products 14 and at right angles to the transport direction T.
  • the basic principle of the counting device 10 is that the known in their form, substantially rectilinear illumination line is projected onto an uneven by the thickness and / or arrangement of the sheet 14 products section 33 of the surface profile of the sheet products 14 and at a staggered detection, the height changes the surface profile of the sheet-like products as curvatures and paragraphs in the capture of the optical sensor 18 image of the illumination line can be detected.
  • the illuminated portion 33 of the surface profile of the flat products 14 detected by the optical sensor 18 is in the considered embodiment, in which a camera is used as an optical sensor 18, as an image recording.
  • the image information is forwarded by means of a detection signal via an electrical connection to the evaluation unit 20, for example a computer.
  • the relevant information about the detected section 33 of the surface profile is extracted from the detection signal by means of a suitable computer program, in particular by means of an image processing program, and associated curvatures, edges and paragraphs are assigned to a specific number of planar products 14.
  • a suitable computer program in particular by means of an image processing program, and associated curvatures, edges and paragraphs are assigned to a specific number of planar products 14.
  • disturbing additional information still present in the images for example signs and images visible on the surface of the planar products 14 due to the ambient light, can be filtered out by known discrimination methods.
  • a scanned by means of the inventive counting device surface profile is in the Fig. 1 and 3 by dashed lines, which are provided with the reference numeral A shown.
  • the sheet products 14 are in Fig. 1 transported by means belonging to the counting device 10 transport 36 in the form of brackets.
  • two flat products 14 are each held by one transport means 36 in such a way that a flat product 14 leading in the transport direction T extends further into a clamp mouth of the transport means 36, as a trailing further flat product 14 partially resting on the leading flat product 14.
  • the respective transport means 36 themselves can, as also in Fig. 1 shown, by a further sensor 38, for example in the form of a light barrier, to be detected.
  • a further sensor 38 for example in the form of a light barrier
  • the number of areal products 14 detected at a specific time can now be assigned to a specific transport means 36.
  • a predetermined target number of flat products which should be held by a transport means 36 is now determined whether errors in the placement of the transport means 36 or the transport have occurred, so that, for example, a corresponding control signal can be triggered to a downstream processing device ,
  • the used for the assignment further sensor 38 is also in Fig. 2 shown. It can be seen in the transport direction T, both before the counting device 10 and after the counting device 10 may be arranged. At the in Fig. 2 shown embodiment of the transport device 12 are each two flat products 14 completely superimposed held by grippers trained transport 36.
  • Fig. 3 is a further embodiment of a transport device 12 with a conveyor belt shown as transport 36.
  • the sheet-like products 14 are transported with their collar 34 in the transport direction T leading in an imbricated formation on the transport means 36 resting through the detection area of the counting device 10.
  • the surface profile A of the planar products 14 scanned by the counting device 10 is represented by a dashed line.
  • the optical sensor 18 In an arrangement of the optical sensor 18 such that its detection beam axis 32 is aligned substantially along the longitudinal axis of the collar 34 of the sheet products 14, which could be in the FIGS. 5a to 5e be shown abstracted image taken.
  • the illumination beam axis 26 of the light source 16 is directed from the top to the camera-side free end region of the collar 34 and advantageously extends at least nearly parallel to product pages 40 of the sheet 14.
  • the illumination beam axis 26 and the detection beam axis 32 span here a plane that is in the Substantially perpendicular to the transport direction T extends.
  • FIGS. 5a to 5e In addition to the illuminated by the illumination line sections 33 of the surface profiles, which are shown as dashed lines, for clarity, the side views of each sampled planar products 14 in the abstracted images are shown. On the basis of these exemplary abstracted image recordings, it is shown that planar products 14 transported in a suspended manner by means of grippers or clamps (individually Fig. 5a ), in pairs ( Fig. 5b, 5c and 5e ) or in a multiple arrangement, for example, three ( Fig. 5d ), transported and counted.
  • a detection and counting is shown both with flat products 14 (FIG. Fig. 5c and Fig. 5d ), as well as in completely adjacent flat products 14 possible.
  • the optical quality of the image recordings and thus the reliability of the counting that the camera acting as the optical sensor 18 records image recordings within a time that is shorter , is preferably much shorter than the time within which a sheet product 14 moves by the amount of its thickness in the detection area.
  • the reliability of the counting can be increased if, as previously mentioned, the light intensity of the light source 16 is increased relative to the ambient light or a filter tuned to the wavelength of the light emitted by the light source 16 is used in the optical sensor 18 , In addition, it is by an increase in the angle ⁇ between the illumination beam axis 26 and the detection beam axis 32, it is possible to increase the curvatures, edges and heights in the images of the illuminated surface portions 33.
  • the counting device 10 according to the invention and the method according to the invention for counting sheet-like products 14 make it possible to count surface products 14 that are suitable and reliable for a variety of transport formats of sheet-like products 14 with moderate equipment complexity.
  • the sheet-like products 14 can be transported during detection and counting be, with the amount of transport speed is limited by the shortest possible recording time of the optical sensor 18, in which, despite resulting from the transport movement artifacts in the image recordings a reliable count possible.
  • both the illumination beam profile 24 and the detection beam profile 30 can be adapted to the specific needs. It is thus possible to project a plurality of illumination lines or also time-varying patterns of illumination lines onto the surface of the planar products 14 and to detect them by means of the optical sensor 18. It is important that the located in the detection area surface portion 33 of the sheet products 14 is at least partially limited by the predetermined illumination beam profile 24.

Landscapes

  • Engineering & Computer Science (AREA)
  • Mechanical Engineering (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Length Measuring Devices By Optical Means (AREA)
  • Investigating Materials By The Use Of Optical Means Adapted For Particular Applications (AREA)
  • Controlling Sheets Or Webs (AREA)
  • Shaping Of Tube Ends By Bending Or Straightening (AREA)
  • Burglar Alarm Systems (AREA)
EP11003404.8A 2007-04-03 2008-03-05 Vorrichtung und Verfahren zum Zählen und Erkennen von flächigen Produkten Not-in-force EP2362330B1 (de)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CH5392007 2007-04-03
EP08706386A EP2130163B1 (de) 2007-04-03 2008-03-05 Vorrichtung und verfahren zum zählen und erkennen von flächigen produkten

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
EP08706386.3 Division 2008-03-05

Publications (3)

Publication Number Publication Date
EP2362330A2 EP2362330A2 (de) 2011-08-31
EP2362330A3 EP2362330A3 (de) 2011-09-14
EP2362330B1 true EP2362330B1 (de) 2013-09-25

Family

ID=38261488

Family Applications (3)

Application Number Title Priority Date Filing Date
EP11003404.8A Not-in-force EP2362330B1 (de) 2007-04-03 2008-03-05 Vorrichtung und Verfahren zum Zählen und Erkennen von flächigen Produkten
EP10008415A Withdrawn EP2256075A3 (de) 2007-04-03 2008-03-05 Vorrichtung und Verfahren zum Kontrollieren von flächigen Produkten
EP08706386A Not-in-force EP2130163B1 (de) 2007-04-03 2008-03-05 Vorrichtung und verfahren zum zählen und erkennen von flächigen produkten

Family Applications After (2)

Application Number Title Priority Date Filing Date
EP10008415A Withdrawn EP2256075A3 (de) 2007-04-03 2008-03-05 Vorrichtung und Verfahren zum Kontrollieren von flächigen Produkten
EP08706386A Not-in-force EP2130163B1 (de) 2007-04-03 2008-03-05 Vorrichtung und verfahren zum zählen und erkennen von flächigen produkten

Country Status (8)

Country Link
US (1) US8324558B2 (da)
EP (3) EP2362330B1 (da)
JP (1) JP2010524065A (da)
AU (1) AU2008234396B2 (da)
CA (1) CA2682618A1 (da)
DK (2) DK2130163T3 (da)
ES (1) ES2387448T3 (da)
WO (1) WO2008119192A1 (da)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2301877B1 (de) 2009-09-23 2012-11-28 Ferag AG Optisches Kontrollverfahren zur Qualitätsbeurteilung in der Druckweiterverarbeitung
CH701910A1 (de) * 2009-09-23 2011-03-31 Ferag Ag Optisches Kontrollverfahren zur Qualitätsbeurteilung in der Druckweiterverarbeitung.
CH705026A2 (de) 2011-05-16 2012-11-30 Ferag Ag Einrichtung und Verfahren zur Erzeugung eines lückenlosen Schuppenstromes aus flächigen Produkteinheiten, insbesondere Druckprodukten.
JP6548504B2 (ja) * 2015-08-04 2019-07-24 キヤノン株式会社 シート処理方法、シート処理装置及び画像形成装置
CH712497A1 (de) 2016-05-30 2017-11-30 Ferag Ag Zuführvorrichtung zum Zuführen von Produkten an eine Weiterverarbeitungsvorrichtung.
EP3364381B1 (de) * 2017-02-21 2022-04-20 Harting Systems GmbH Warenautomat mit bestandsführungsmittel

Family Cites Families (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US2908825A (en) * 1956-12-10 1959-10-13 Midwest Automatic Control Co Photoelectric counter
US4248532A (en) * 1978-12-26 1981-02-03 Nosler John C Electro-optical distance-measuring system
SE433200B (sv) 1980-06-04 1984-05-14 Dagens Nyheters Ab Sett och anordning for att rekna fiskfjellsartat lagda foremal
US4384195A (en) * 1980-06-09 1983-05-17 The Coe Manufacturing Company Edge-responsive apparatus for counting conveyor-transported articles
JPS5977584A (ja) 1982-10-26 1984-05-04 Tokyo Kikai Seisakusho:Kk 印刷物の計数装置
US4677302A (en) * 1985-03-29 1987-06-30 Siemens Corporate Research & Support, Inc. Optical system for inspecting printed circuit boards wherein a ramp filter is disposed between reflected beam and photodetector
JPH0814840B2 (ja) 1986-03-27 1996-02-14 株式会社東京機械製作所 被搬送体計数装置
US4929843A (en) * 1989-06-28 1990-05-29 General Electric Company Apparatus and method for determining a dimension of an object
US5132791A (en) * 1990-09-25 1992-07-21 Ball Corporation Optical sheet inspection system
US5221837A (en) * 1992-03-27 1993-06-22 Faraday National Corporation Non-contact envelope counter using distance measurement
CH684656A5 (de) * 1992-05-06 1994-11-15 Baumer Electric Ag Verfahren und Vorrichtung zum Erkennen und Auswerten von Kanten an Gegenständen.
EP0626663A1 (de) 1993-04-29 1994-11-30 COPACO GESELLSCHAFT FÜR VERPACKUNGEN mbH & Co. KG Berührungsloser Detektor
US6133948A (en) * 1995-12-04 2000-10-17 Virginia Tech Intellectual Properties, Inc. Automatic identification of articles having contoured surfaces
JPH1134187A (ja) * 1997-07-15 1999-02-09 Mitsubishi Heavy Ind Ltd 製函用シート材の接合部判定方法及び製函用シート材の接合部判定装置
DE19842192A1 (de) * 1998-09-15 2000-03-16 Roland Man Druckmasch Einrichtung zur Überwachung des Bogenlaufes einer bogenverarbeitenden Vorrichtung
DE10012138B4 (de) 2000-03-13 2010-02-25 Sick Ag Verfahren und Vorrichtung zur Erfassung von Kantenbereichen von Objekten
DE10220186A1 (de) 2002-05-06 2003-11-27 Gramatec Gmbh Verfahren und Vorrichtung zum Zählen von Kanten von Produkten
US6876716B2 (en) * 2003-02-19 2005-04-05 Quipp Systems, Inc. Method and apparatus for utilizing a shadow effect for counting newspapers, magazines, books, printed products, signatures and other like printed matter
GB0418040D0 (en) 2004-08-12 2004-09-15 Wessex Technology Opto Electro Improvements in double feed mail detection
DK1661833T3 (da) 2004-11-26 2008-06-09 Ferag Ag Fremgangsmåde og anordning til forarbejdning af trykkeriprodukter
US7809158B2 (en) * 2005-05-02 2010-10-05 Siemens Industry, Inc. Method and apparatus for detecting doubles in a singulated stream of flat articles
AU2006274426B2 (en) 2005-07-29 2010-11-11 Ferag Ag Process and apparatus for monitoring sheet-like products transported by clamps

Also Published As

Publication number Publication date
EP2256075A3 (de) 2010-12-22
EP2130163B1 (de) 2012-06-27
EP2256075A2 (de) 2010-12-01
DK2130163T3 (da) 2012-07-30
EP2130163A1 (de) 2009-12-09
JP2010524065A (ja) 2010-07-15
EP2362330A2 (de) 2011-08-31
ES2387448T3 (es) 2012-09-24
EP2362330A3 (de) 2011-09-14
US20100116975A1 (en) 2010-05-13
AU2008234396A1 (en) 2008-10-09
WO2008119192A1 (de) 2008-10-09
CA2682618A1 (en) 2008-10-09
AU2008234396B2 (en) 2012-09-13
US8324558B2 (en) 2012-12-04
DK2362330T3 (da) 2013-11-18

Similar Documents

Publication Publication Date Title
EP2362330B1 (de) Vorrichtung und Verfahren zum Zählen und Erkennen von flächigen Produkten
CN102105888A (zh) 用于检查印刷品的方法和装置、计算机程序以及计算机程序产品
EP2022347B1 (de) Optische Kontrolle von Produkten der Tabak verarbeitenden Industrie
EP2620775B1 (de) Aufnahmemagazin
EP1910202B1 (de) Verfahren und vorrichtung zur kontrolle von klammertransportierten flächigen produkten
EP3693927A1 (de) Ausrichten einer zeilenkamera mit dreiecken als ausrichtziel
DE102008051758A1 (de) Verfahren und Vorrichtung zum Bearbeiten von Wertdokumenten
DE10111907A1 (de) Vorrichtung und Verfahren zur Entwertung von Blattgut
EP1844865B1 (de) Elektronisches Markieren zum Sortieren von in Objektverbänden hergestellten und geprüften Einzelobjekten
EP2546177A1 (de) Verfahren und Vorrichtung zur Qualitätsprüfung flächiger Druckprodukte
EP2656326B1 (de) Verschmutzungsprüfung des fensters einer messvorrichtung zur prüfung von blattgut
EP2283307B1 (de) Optische positionserkennung
EP0897887B1 (de) Verfahren und Vorrichtung zur Kontrolle der Dicke von kontinuierlich geförderten, flächigen Gegenständen
EP1992580A2 (de) Verfahren und Vorrichtung zum Öffnen von Druckereiprodukten
DE102006017787B4 (de) Verfahren und Vorrichtung zum Bestimmen der Soll-Position eines Trennschnitts zwischen plattenförmigen Werkstücken
EP2480470B1 (de) Optisches kontrollverfahren zur qualitätsbeurteilung in der druckweiterverarbeitung
DE102005008747B4 (de) Verfahren und Vorrichtung für die Erfassung von Banknoten
DE102007001989B4 (de) Anordnung zur Erkennung von Doppelabzügen in Postsortieranlagen
EP2301877B1 (de) Optisches Kontrollverfahren zur Qualitätsbeurteilung in der Druckweiterverarbeitung
DE102020114980B4 (de) Vorrichtung und system zur inspektion zumindest eines diffraktiven optischen elements eines dokuments
AT521247B1 (de) Verfahren zur Oberflächenprüfung von Münzen
DE10233052A1 (de) Erkennung von Mehrfachabzügen
EP3388376A1 (de) Verfahren und vorrichtung zum überwachen des transports von produkten und system zur herstellung, verarbeitung und/oder prüfung von produkten
EP4338855A1 (de) Sortieranlage zum sortieren von poststücken sowie verfahren zur erfassung einer belegung von zum transport von poststücken verwendeten ablagen einer sortieranlage
DE102015003480A1 (de) Vorrichtung und Verfahren zum Prüfen von Wertdokumenten, insbesondere Banknoten, sowie Wertdokumentbearbeitungssystem

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

PUAL Search report despatched

Free format text: ORIGINAL CODE: 0009013

AC Divisional application: reference to earlier application

Ref document number: 2130163

Country of ref document: EP

Kind code of ref document: P

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MT NL NO PL PT RO SE SI SK TR

AK Designated contracting states

Kind code of ref document: A3

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MT NL NO PL PT RO SE SI SK TR

RIC1 Information provided on ipc code assigned before grant

Ipc: B65H 43/00 20060101AFI20110808BHEP

17P Request for examination filed

Effective date: 20120306

17Q First examination report despatched

Effective date: 20120912

REG Reference to a national code

Ref country code: DE

Ref legal event code: R079

Ref document number: 502008010733

Country of ref document: DE

Free format text: PREVIOUS MAIN CLASS: G06M0007100000

Ipc: B65H0029040000

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

RIC1 Information provided on ipc code assigned before grant

Ipc: B65H 29/66 20060101ALI20130502BHEP

Ipc: B65H 43/08 20060101ALI20130502BHEP

Ipc: B65H 29/04 20060101AFI20130502BHEP

Ipc: G06M 1/10 20060101ALI20130502BHEP

Ipc: G06M 7/06 20060101ALI20130502BHEP

Ipc: B65H 43/00 20060101ALI20130502BHEP

INTG Intention to grant announced

Effective date: 20130531

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AC Divisional application: reference to earlier application

Ref document number: 2130163

Country of ref document: EP

Kind code of ref document: P

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MT NL NO PL PT RO SE SI SK TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REG Reference to a national code

Ref country code: CH

Ref legal event code: NV

Representative=s name: PATENTANWAELTE SCHAAD, BALASS, MENZL AND PARTN, CH

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 633618

Country of ref document: AT

Kind code of ref document: T

Effective date: 20131015

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Free format text: LANGUAGE OF EP DOCUMENT: GERMAN

REG Reference to a national code

Ref country code: DK

Ref legal event code: T3

Effective date: 20131115

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 502008010733

Country of ref document: DE

Effective date: 20131121

REG Reference to a national code

Ref country code: SE

Ref legal event code: TRGR

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20131225

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130925

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130925

REG Reference to a national code

Ref country code: NL

Ref legal event code: VDEP

Effective date: 20130925

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130925

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130925

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130925

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20131226

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130925

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140125

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130925

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130925

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130925

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130925

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130925

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130925

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130925

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 502008010733

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140127

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130925

26N No opposition filed

Effective date: 20140626

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 502008010733

Country of ref document: DE

Effective date: 20140626

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140305

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20140305

REG Reference to a national code

Ref country code: FR

Ref legal event code: ST

Effective date: 20141128

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20140331

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20140305

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20140305

REG Reference to a national code

Ref country code: AT

Ref legal event code: MM01

Ref document number: 633618

Country of ref document: AT

Kind code of ref document: T

Effective date: 20140305

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20140305

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130925

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DK

Payment date: 20160321

Year of fee payment: 9

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130925

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130925

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130925

Ref country code: BE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140331

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20080305

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: SE

Payment date: 20170321

Year of fee payment: 10

REG Reference to a national code

Ref country code: DK

Ref legal event code: EBP

Effective date: 20170331

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170331

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20180322

Year of fee payment: 11

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180306

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: CH

Payment date: 20190605

Year of fee payment: 12

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 502008010733

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191001

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200331

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200331