EP2726856B1 - Optische inspektion von behältern - Google Patents

Optische inspektion von behältern Download PDF

Info

Publication number
EP2726856B1
EP2726856B1 EP12731224.7A EP12731224A EP2726856B1 EP 2726856 B1 EP2726856 B1 EP 2726856B1 EP 12731224 A EP12731224 A EP 12731224A EP 2726856 B1 EP2726856 B1 EP 2726856B1
Authority
EP
European Patent Office
Prior art keywords
container
light
images
light sources
light source
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP12731224.7A
Other languages
English (en)
French (fr)
Other versions
EP2726856A1 (de
Inventor
George H. HALL Jr.
Benjamin L. Daniel
Stephen M. Graff
John W. Juvinall
Timothy A. KOHLER
Thomas F. MICHALSKI
James A. Ringlien
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Owens Brockway Glass Container Inc
Original Assignee
Owens Brockway Glass Container Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Family has litigation
First worldwide family litigation filed litigation Critical https://patents.darts-ip.com/?family=46420525&utm_source=google_patent&utm_medium=platform_link&utm_campaign=public_patent_search&patent=EP2726856(B1) "Global patent litigation dataset” by Darts-ip is licensed under a Creative Commons Attribution 4.0 International License.
Application filed by Owens Brockway Glass Container Inc filed Critical Owens Brockway Glass Container Inc
Priority to EP23169275.7A priority Critical patent/EP4235159A3/de
Publication of EP2726856A1 publication Critical patent/EP2726856A1/de
Application granted granted Critical
Publication of EP2726856B1 publication Critical patent/EP2726856B1/de
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/84Systems specially adapted for particular applications
    • G01N21/88Investigating the presence of flaws or contamination
    • G01N21/90Investigating the presence of flaws or contamination in a container or its contents
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/84Systems specially adapted for particular applications
    • G01N21/88Investigating the presence of flaws or contamination
    • G01N21/90Investigating the presence of flaws or contamination in a container or its contents
    • G01N21/9018Dirt detection in containers
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/84Systems specially adapted for particular applications
    • G01N21/88Investigating the presence of flaws or contamination
    • G01N21/90Investigating the presence of flaws or contamination in a container or its contents
    • G01N21/9054Inspection of sealing surface and container finish

Definitions

  • the present disclosure is directed to methods and apparatus for optical inspection of containers.
  • Acommercial variations can involve one of numerous attributes of the container.
  • commercial variations can include dimensional characteristics of the container at an open mouth of the container.
  • Ainspection@ is used in its broadest sense to encompass any optical, electro-optical, mechanical or electrical observation or engagement with a container to measure or determine a potentially variable characteristic, including but not necessarily limited to commercial variations.
  • FIG. 21 illustrates in simplified and diagrammatic form an apparatus 810 for inspecting parameters of a container mouth 812 in one type of inspection process for a container 814 that generally conforms to an apparatus shown and described in U.S. Pat. No. 5,461,228 , which is assigned to the assignee hereof.
  • the apparatus 810 includes a light source 818 that directs light into the container 814, and a light sensor 824 disposed with respect to the light source 818 and the container 814 to receive light transmitted out of the container 814 through the container mouth 812.
  • a telecentric lens 822 directs onto the light sensor 824 only light transmitted through the container mouth 812 substantially axially of the container mouth 812.
  • the sensor 824 develops a two-dimensional image of the container mouth 812.
  • the sensor 812 is coupled to information processing electronics for determining or calculating a circle of greatest diameter that will fit within the two-dimensional image of the container mouth 812, and treating such circle as indicative of the effective inside diameter of the container mouth 812.
  • the container 814 may include commercial variations like choke portions 813 that may block some light rays 815 and reflect other, angled, light rays 817 in a direction generally parallel with the container longitudinal axis.
  • the sensor 824 receives not only unimpeded light rays 819 that indicate the inside diameter of the container mouth 812, but also the reflected light rays 817 that tend to make the container mouth 812 appear larger than it really is. Accordingly, as shown in prior art FIG. 22 , a prior art light image produced by light from the light source of FIG. 21 includes a pattern of bright unimpeded light 819' representing the inside diameter of the mouth 812, and a halo or additional pattern of reflected light 817' representing the reflections off the inside diameter of the mouth 812.
  • DE2909061 discloses an arrangement for examining a moving bottle PR, including a single light source ( FIG. 2 ) having a plurality of light-emitting diodes (LEDs) carried on a circular disk.
  • the LEDs occupy an area of the disk having a diameter slightly larger than that of a bottom of the bottle.
  • EP1494013 discloses a bottle inspection machine including a light source assembly (12) including a single light source (14) having two different colors, for example, red and green.
  • the machine also includes a lens (18) that directs the light firm the source to a beam splitter (19) that divides the light into red and green beams and sends those beams to a red fitter (23) and first camera (21) and a green filter (25) and second camera (22).
  • the red light could appear as bright light
  • the green light could appear as darkness.
  • DE9415768 discloses an optical inspection system for a bottle (1) including a single lighting device (3) under the bottle and having individual light sources (3a) that are independently adjustable.
  • US2010/0225908 discloses an inspection apparatus for inspecting a container (8), and including two illumination devices 2, 3 below a base 6 of the container.
  • the first illumination device 2 includes on LED spotlight to illuminate a scattering device 4 from below in a point fashion to produce a hard directional light.
  • the second illumination device 3 includes a plurality of LEDs to emit light onto the scattering device 4 from above to produce a soft indirect light.
  • a general object of the present disclosure in accordance with one aspect of the disclosure, is to provide a more reliable optical plug gage (OPG) apparatus for gaging a container mouth to reduce or eliminate reflected light in an OPG image, and/or to prevent passage of certain light rays reflected from an inside surface of a container mouth in a direction parallel to a container axis to a light sensor so that the container mouth does not appear larger than actual size.
  • OPG optical plug gage
  • the present disclosure embodies a number of aspects that can be implemented separately from or in combination with each other.
  • An apparatus for inspecting a container having a base and a mouth and defining a longitudinal axis includes a light source for directing light through the container base into the container and out of the container through the container mouth.
  • the apparatus also includes a light sensor disposed with respect to the light source and the container to receive light transmitted through the container mouth.
  • the light source includes at least first and second light sources operatively disposed adjacent to each other beneath the container base and having differing operating characteristics.
  • the first and second light sources are a pair of opposed light sources disposed on opposite sides of the longitudinal axis.
  • the light sensor captures images of the container mouth in opposed pairs, that is in pairs of images comprising a first image obtained by sensing the light of the first light source and a second image obtained by sensing the light of the second light source, each pair of images comprising images of respective segments of the container mouth disposed on opposite sides of the longitudinal axis of the container.
  • a method of inspecting a container having a base and a mouth including the step of directing light through the container base into the container, and out of the container through the container mouth, using at least first and second light sources operatively disposed adjacent to each other beneath the container base and having differing operating characteristics.
  • the first and second light sources are a pair of opposed light sources.
  • the method also includes the step of sensing light transmitted through the container mouth.
  • the method also includes the step of capturing images of the container mouth in opposed pairs, that is in pairs of images comprising a first image obtained by sensing the light of the first light source and a second image obtained by sensing the light of the second light source.
  • FIG. 1 illustrates an exemplary embodiment of an optical plug gage apparatus 10 for inspecting an open mouth M of a container C.
  • the apparatus 10 includes one or more light sources 12 operatively disposed below the container C to produce light used in inspecting the container mouth M, and one or more light sensors 14 disposed above the container C to sense light produced by the light source 12 and passing through the container mouth M.
  • the terminology Aoperatively disposed@ includes light sources that may be located anywhere but emit light from below the container C, for example, via mirrors, fiber optics or the like.
  • the apparatus 10 optionally may include one or more light diffusers 16 disposed between the light source 12 and the container C to diffuse and/or direct light through a bottom B of the container C into the container C and through the container mouth M.
  • the apparatus 10 further may include a lens system 18 disposed between the container C and the light sensor 14 to direct light passing through the container mouth M to the light sensor 14.
  • the apparatus 10 additionally may include a processor 20 or any other suitable device(s) to scan the light sensor 14 and develop an image of the container mouth M and/or any other suitable inspection information, and a display 22 to display the image and/or other inspection information.
  • the apparatus 10 also may include a container rotator 24 to rotate the container C.
  • the container C may be ajar, or a bottle as illustrated in FIG. 1 , or any other suitable type of container.
  • the container C may be composed of plastic, glass, or any other suitable material.
  • the container C may be clear, colored, transparent, translucent, or of any other suitable optical quality.
  • the light source 12 includes a plurality of light sources 12a, 12b, each of which may include one or more discrete light elements 12p ( FIG. 2 ).
  • the light source 12 includes at least two light sources 12a, 12b that are operatively disposed adjacent to each other beneath the container base B and/or may be diametrically opposed to one another( FIG. 1 ), and that may be energized independently and alternatingly.
  • the light elements 12p FIG. 2
  • the light elements 12p may include a plurality of light emitting diodes (LEDs), wherein the light source 12 may be a multiple-LED light source.
  • the light source 12 may receive power from any suitable source in any suitable manner and may be controlled by the processor 20 ( FIG. 1 ) in any suitable manner. Moreover, those of ordinary skill in the art will recognize that the light source 12 may be divided into sub-sections or sub-portions or may be composed of two separate light sources.
  • the light sources 12a, 12b have differing operating characteristics.
  • the light sources 12a, 12b may be energized alternatingly or sequentially, for example, with no overlap in emission of light.
  • the light sources 12a, 12b may emit light of different wavelengths with simultaneous emission of light. The example different operating characteristics will be described below in greater detail.
  • the light sensor 14 may include any suitable device to sense light.
  • the light sensor 14 may include an image sensor, for instance, a charge-coupled device (CCD), complementary metalBoxideBsemiconductor (CMOS) device, or any other suitable image sensor.
  • the light sensor 14 may include a photodiode device, a photoresistor device, or any other suitable photodetector device.
  • the light diffuser 16 may include any suitable device to diffuse light.
  • the light diffuser 16 may include a ground glass diffuser, a teflon diffuser, a holographic diffuser, an opal glass diffuser, a greyed glass diffuser, or any other suitable diffuser.
  • the lens system 18 may include any suitable device to direct or focus light.
  • the lens system 18 may include a telecentric lens, an entrance pupil, and pupil lenses on either side of the pupil.
  • the lens system 18 may direct only light rays that emerge from the container mouth M essentially parallel to an axis A of the container C.
  • the processor 20 may include any suitable device(s) to acquire images from the light sensor 14 and output images to the display 22.
  • the container rotator 24 may include any suitable device to rotate the container C.
  • the rotator 24 may include one or more rollers, wheels, belts, discs, and/or any other suitable element(s) to rotate the container C.
  • the container C may remain stationary, and one or more of the various apparatus elements 12, 14, 16, 18 may be rotated in any suitable manner.
  • the first light source 12a is energized, and light from that first light source 12a extending parallel to the container axis A and through the container mouth M is sensed by the light sensor 14 to obtain a corresponding first image 112a as shown in FIG. 3A . Any reflections that may impinge on the right half of the sensor 14 may be digitally discarded, for example, by the information processor 20. Then, the first light source 12a is de-energized and the second light source 12b is energized and light from that second light source 12b extending parallel to the container axis A and through the container mouth M is sensed by the light sensor 14 to obtain a corresponding second image 112b as shown in FIG. 3B .
  • images of the container mouth M may be acquired in pairs.
  • the first image 112a of the pair is acquired by the light sensor 14, and transfer of the image 112a from the light sensor 14 to the processor 20 is begun, then a short time (e.g. sub-millisecond) elapses, and thereafter the second image 112b of the pair is acquired while the first image 112a is still being transferred. Accordingly, the images 112a, 112b are obtained selectively, sequentially, and synchronously.
  • each of the images 112a, 112b include approximately 180 circumferentially angular degrees of the container mouth M, only select portions, for example central portions 113a, 113b, of the images 112a, 112b can be assumed to be essentially free of low-angle reflections that would interfere with image processing. This is because regions of the container mouth M that are coincident with the divider of the light source 12 (or edges of the light sources 12a, 12b) could have some low-angle reflections. Accordingly, only the central portions 113a, 113b of the images 112a, 112b may be evaluated.
  • An example circumferentially angular range of the central portions 113a, 113b may be 30 to 120 circumferentially angular degrees as depicted in FIGS. 3A and 3B . Stated another way, an example circumferentially angular range of the central portions 113a, 113b may be about 15% to about 70% of the circumferentially angular extent of the corresponding 112a, 112b images. In one specific example, the central portions 113a, 113b each may be 90 circumferentially angular degrees, to result in corresponding portions 113a, 113b in a composite image 112. Therefore, it may be desirable to capture similar, additional, angularly interposed and adjacent image portions 113c, 113d in the composite image 112.
  • the composite image 112 may include a full 360 circumferentially angular degrees of the container mouth M. This may be particularly desirable for inspection of commercial variations or where a circumferentially continuous diametric measurement of the container mouth M. Those of ordinary skill in the art will recognize that more image portions may be obtained and evaluated, for example, twelve 30-degree portions, ten 36-degree portions, six 60-degree portions, and/or the like.
  • the first and second images 112a, 112b can be superimposed or added to obtain a complete image 112 of the inside of the container mouth M.
  • the image 112 can be used to identify commercial variations in the container, measure the inside diameter of the container mouth M, or for any other suitable container inspection techniques.
  • stray light (exemplified by numerals 817, 817' in FIGS. 21 and 22 ) that is reflected by a choke or other portions of the container C along a direction generally parallel to the container axis A will be ignored, one way or another.
  • reflected light (as exemplified by numeral 817 on the left side in FIG. 21 ) that emerges from the right side or section light source 12b is ignored because it impinges on the left side of the image sensor 14 and the corresponding image portion 112a is ignored.
  • the reflections are largely eliminated by not evaluating that portion of the container mouth M opposite of the energized light source 12b.
  • FIG. 4 illustrates another exemplary embodiment of an optical plug gage apparatus 210 for inspecting a mouth M of a container C.
  • This embodiment is similar in many respects to the embodiment of FIG. 1 and like numerals between the embodiments generally designate like or corresponding elements throughout the several views of the drawing figures. Accordingly, the descriptions of the embodiments are incorporated into one another. Additionally, the description of the common subject matter generally may not be repeated here.
  • a light source 212 may have a plurality of light sources 212a, 212b that produce light of differing wavelengths.
  • the light source 212 may be a multiple-LED type of light source with differing wavelength LEDs of the respective light sources 212a, 212b.
  • shorter-wavelength LEDs may be provided on a first light source 212a and longer-wavelength LEDs may be provided on a second light source 212b.
  • the shorter-wavelength LEDs may emit light at 740nm wavelength
  • the longer wavelength LEDs may emit light at 850nm.
  • a filter 217 is positioned between the container C and the light sensor 14.
  • the filter 217 may include a plurality of filters 217a, 217b that filter light of differing wavelengths.
  • a first filter 217a may be a short pass filter to filter out longer wavelength light emanating from the second light source 212b and allow passage of shorter wavelength light emanating from the second light source 212b.
  • a second filter 217b may be a long pass filter to filter out shorter wavelength light emanating from the first light source 212a and allow passage of longer wavelength light emanating from the first light source 212a.
  • the short pass filter 217a on the left side will not admit stray light from the right side of the light source 212b that gets reflected from a choke in the container neck, and vice versa.
  • the filter 217 may be divided into sub-sections or may be composed of two separate filters.
  • both sides of the light source 212 can be energized simultaneously. Accordingly, light from both the first and second light sources 212a, 212b extending parallel to the container axis A and through the container mouth M is sensed by the light sensor 14 to obtain corresponding first and second images 312a, 312b as shown in FIGS. 6A and 6B . Accordingly, the images 312a, 312b are obtained simultaneously to produce one image 312 of the container mouth M. Like the previous embodiment, less than the entirety of each image 312a, 312b may be evaluated and, thus, the container C may be rotated to obtain additional interposed images.
  • stray light (exemplified by numerals 817, 817' in FIGS. 21 and 22 ) that is reflected by a choke or other portions of the container C along a direction generally parallel to the container axis A will be ignored, one way or another.
  • the reflected light as exemplified on the left side in FIG. 21 is ignored because it emerges from the longer-wavelength second light source 212b but is blocked by the shorter wavelength filter 217a.
  • FIG. 7 illustrates another exemplary embodiment of a portion of an optical plug gage apparatus 410, wherein a container may be inspected as it rotates about its longitudinal axis.
  • This embodiment is similar in many respects to the embodiments of FIGS. 1-6C and like numerals between the embodiments generally designate like or corresponding elements throughout the several views of the drawing figures. Accordingly, the descriptions of the embodiments are incorporated into one another. Additionally, the description of the common subject matter generally may not be repeated here.
  • the apparatus 410 includes one or more light sources 412 operatively disposed below the base B of the container C to produce light used in inspecting the container mouth (not shown).
  • the light sources 412 may include a pair of light sources 412a, 412b, that may be diametrically opposed to one another.
  • Each of the light sources 412a, 412b may correspond to portions or segments of the container base B.
  • each light source 412a, 412b may be about 1/X in circumferentially angular size, wherein the container base B theoretically may be divided into X segments and wherein X is a quantity of images to be captured of the container.
  • each light source of the light sources 412a, 412b may be about thirty six degrees in circumferentially angular size and the quantity of images equals ten.
  • the phrase Aabout 1/X@ may include within plus or minus ten degrees. Therefore, for example, each light source 412a, 412b may be about forty degrees in circumferentially angular size with a quantity of images still equal to ten such that there is some circumferential overlap in images produced from the light sources 412a, 412b.
  • the overlap may be included, for example, to address slippage between the container rotator and the container, variable latencies in image frame acquisition, errors in rotation encoding, and/or the like.
  • the container C may be inspected as it rotates, and this example corresponds to the embodiment of FIGS. 1 through 3C .
  • the container C may be stationary, may begin to rotate, or may be rotating already.
  • the portions 412a, 412b of the light source 412 are energized alternately or sequentially and light from that source is sensed by the light sensor to sequentially obtain the corresponding first and second images 512a, 512b and select portions 513a, 513b thereof as shown in FIGS. 8A and 8B .
  • the first light source 412a is energized, and light from that first light source 412a extends through a corresponding segment 0 A of the container base B parallel to the container axis and through the container mouth M. That light is sensed by a light sensor to obtain a corresponding first image 512a and a select portion 513a thereof as shown in FIG. 8A . Then, the first light source 412a is de-energized and the second light source 412b is energized, and light from that second light source 412b extends through another corresponding segment 0 B diametrically opposed to the first segment 0 A parallel to the container axis and through the container mouth. That light is sensed by the light sensor to obtain a corresponding second image 512b and a select portion 513b as shown in FIG. 8B .
  • the container C may have circumferentially indexed over some circumferentially angular range before additional imaging occurs. For example, by the time the image sensor is ready to process additional images, segment 1 A of the container base B will be aligned in correspondence with the light source 412a and opposed segment 1 B of the container base B will be aligned in correspondence with the light source 412b. In a more specific example, at an initial time (0 milliseconds) when the light sources 412a, 412b are sequentially energized to illuminate the container base B, the angular rotation of the container C at that instant is considered zero.
  • subsequent imaging may be activated, for example, about 20 milliseconds after the previous imaging and such imaging corresponds to segments 1 A , 1 B of the container base B.
  • the first light source 412a is again energized, and light from that first light source 412a extends through the corresponding segment 1 A of the container base B parallel to the container axis and through the container mouth. That light is sensed by the light sensor to obtain a corresponding third image 512c and a select portion 513c thereof as shown in FIG. 9A .
  • the first light source 412a is de-energized and the second light source 412b is energized, and light from that second light source 412b extends through another corresponding segment 1 B diametrically opposed to the first segment 1 A parallel to the container axis and through the container mouth. That light is sensed by the light sensor to obtain a corresponding fourth image 512d and a select portion 513d thereof as shown in FIG. 9B .
  • This operation repeats until the container C has rotated 12/10 (twelve-tenths) of a full revolution and wherein fifth through tenth images 512e through 512j and selection portions 513e through 513j thereof are obtained corresponding to container base segments 2A through 4B, as shown in FIGS. 10A through 12B .
  • the container C Before a subsequent container arrives at the station to be inspected, the container C may rotate beyond 12/10 of the full revolution, for example, about 1.5 revolutions.
  • the operation may occur, for example, over about 80 milliseconds; the time for five pairs of images to be processed and including the time for circumferential indexing of the container C therebetween.
  • the container C may be inspected as it rotates, and this example corresponds to the embodiment of FIGS. 4 through 6C .
  • the container C may be stationary, may begin to rotate, or may be rotating already.
  • the container C may have circumferentially indexed over some circumferentially angular range before additional imaging occurs. For example, by the time the image sensor is ready to process additional images, segment 1 A of the container base B will be aligned in correspondence with the light source 412a and opposed segment 1 B of the container base B will be aligned in correspondence with the light source 412b. At that instant, both light sources 412a, 412b are energized simultaneously. Accordingly, light from both the first and second light sources 412a, 412b extend through corresponding theoretical segments 1 A , 1 B of the container base B parallel to the container axis and through the container mouth.
  • FIG. 14 illustrates another exemplary embodiment of a portion of an optical plug gage apparatus 610, wherein a container may be inspected as it is circumferentially stationary.
  • This embodiment is similar in many respects to the embodiments of FIGS. 1-13 and like numerals between the embodiments generally designate like or corresponding elements throughout the several views of the drawing figures. Accordingly, the descriptions of the embodiments are incorporated into one another. Additionally, the description of the common subject matter generally may not be repeated here.
  • the apparatus 610 includes one or more light sources 612 operatively disposed below the base B of the container C to produce light used in inspecting the container mouth (not shown).
  • the light sources 612 may include a plurality of pairs of light sources 612a through 612j, each pair of which may include two diametrically opposed sources.
  • Each of the light sources 612a through 612j may correspond to portions or segments of the container base B.
  • each light source 612a through 612j may be about 1/X in circumferentially angular size, wherein the container base B theoretically may be divided into X segments and wherein X is a quantity of images to be captured of the container.
  • each light source of the plurality of pairs of light sources 612a through 612j is about thirty six degrees in circumferentially angular size and the quantity of images equals ten.
  • the container C is not rotated or is stationary as the plurality of pairs of light sources 612a through 612j are energized circumferentially sequentially around the container C.
  • the container C may be inspected in a circumferentially stationary position, and this example corresponds to the embodiment of FIGS. 1 through 3C .
  • the container C may be circumferentially stationary.
  • a pair of light sources 612a, 612b are energized alternately or sequentially and light from the sources is sensed by the light sensor to sequentially obtain the corresponding first and second images 712a, 712b and select portions 713a, 713b thereof as shown in FIGS. 15A and 15B .
  • a first light source 612a is energized, and light from that first light source 612a extends through a corresponding segment 0 A of the container base B parallel to the container axis and through the container mouth. That light is sensed by a light sensor to obtain a corresponding first image 712a and a select portion 713a thereof as shown in FIG. 15A .
  • the first light source 612a is de-energized and a second light source 612b is energized, and light from that second light source 612b extends through another corresponding segment 0 B diametrically opposed to the first segment 0 A parallel to the container axis and through the container mouth. That light is sensed by the light sensor to obtain a corresponding second image 712b and a select portion 713b as shown in FIG. 15B .
  • a third light source 612c is energized, and light from that third light source 612c extends through a corresponding segment 1 A of the container base B parallel to the container axis and through the container mouth. That light is sensed by a light sensor to obtain a corresponding third image 712c and a select portion 713c thereof as shown in FIG. 16A .
  • the third light source 612c is de-energized and a fourth light source 612d is energized, and light from that fourth light source 612d extends through another corresponding segment 1 B diametrically opposed to the third segment 1 A parallel to the container axis and through the container mouth. That light is sensed by the light sensor to obtain a corresponding fourth image 712d and a select portion 713d as shown in FIG. 16B .
  • the container C may be inspected in a circumferentially stationary position and this example corresponds to the embodiment of FIGS. 4 through 6C .
  • the images 712a through 712j and the select portions 713a through 713j may be summed in an any suitable manner to produce one image 712 of the container mouth M. That image 712 then may be inspected according to any suitable inspection techniques for size, shape, anomalies, or the like.
  • low-angle reflections are reduced to a degree that does not interfere with image processing because the reflections are at least one of filtered before reaching a light sensor or impinge on a portion of the light sensor that is not presently evaluated.

Landscapes

  • Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Chemical & Material Sciences (AREA)
  • Analytical Chemistry (AREA)
  • Biochemistry (AREA)
  • General Health & Medical Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • Immunology (AREA)
  • Pathology (AREA)
  • Investigating Materials By The Use Of Optical Means Adapted For Particular Applications (AREA)
  • Length Measuring Devices By Optical Means (AREA)
  • Image Processing (AREA)
  • Investigating Or Analysing Materials By Optical Means (AREA)

Claims (17)

  1. Vorrichtung zum Prüfen eines Behälters (C), der einen Boden (B) sowie eine Mündung (M) aufweist, wobei der zu prüfende Behälter (C) eine Längsachse (A) definiert, wobei die Vorrichtung umfasst:
    eine Lichtquelle (12, 212, 412, 612) zum Richten von Licht durch den Behälterboden hindurch in den Behälter und durch die Behältermündung hindurch aus dem Behälter heraus, und
    einen Lichtsensor (14), der in Bezug auf die Lichtquelle und den zu prüfenden Behälter (C) derart angeordnet ist, dass er Licht empfängt, das durch die Behältermündung durchgelassen wird,
    wobei die Lichtquelle mindestens eine erste und eine zweite Lichtquelle (12a, 12b) umfasst, die betriebsbereit nebeneinander unterhalb des Behälterbodens angeordnet sind und unterschiedliche Betriebseigenschaften aufweisen,
    wobei die erste und die zweite Lichtquelle ein Paar aus einander gegenüberliegenden Lichtquellen darstellt, die auf entgegengesetzten Seiten der Längsachse (A) angeordnet sind,
    wobei der Lichtsensor Bilder der Behältermündung in einander gegenüberliegenden Paaren erfasst, das heißt als Bildpaare, die ein erstes Bild (112a) umfassen, das durch Erfassen des Lichts von der ersten Lichtquelle (12a) erhalten wird, sowie ein zweites Bild (112b), das durch Erfassen des Lichts von der zweiten Lichtquelle (12b) erhalten wird, wobei jedes Bildpaar Bilder jeweiliger Segmente der Behältermündung umfasst, die auf gegenüberliegenden Seiten der Längsachse des Behälters angeordnet sind.
  2. Vorrichtung nach Anspruch 1, mit einer Behälterdreheinrichtung (24) zum Drehen des Behälters in verschiedene Winkelpositionen zum Erfassen weiterer gegenüberliegender Paare (513a und 513b, 513c und 513d, 513e und 513f, 513g und 513h, 513i und 513j) von Bildern der Behältermündung (M).
  3. Vorrichtung nach Anspruch 1, wobei die unterschiedlichen Betriebseigenschaften darin bestehen, dass die erste und die zweite Lichtquelle (12a, 12b) entweder nacheinander angeschaltet werden oder dass die erste und die zweite Lichtquelle (12a, 12b) gleichzeitig angeschaltet werden und unterschiedliche Wellenlängen aufweisen.
  4. Vorrichtung nach Anspruch 3, wobei mindestens ein erster und ein zweiter optischer Filter (217a und 217b) funktional zwischen der Behältermündung (M) und dem Lichtsensor (14) angeordnet sind, wobei die Filter (217a und 217b) Wellenlängeneigenschaften aufweisen, die auf die Wellenlängeneigenschaften der jeweils darunter liegenden Lichtquellen abgestimmt sind.
  5. Vorrichtung nach Anspruch 4, wobei die erste Lichtquelle (12a) Licht einer im Vergleich kürzeren Wellenlänge aussendet, die zweite Lichtquelle (12b) Licht einer im Vergleich längeren Wellenlänge aussendet, der erste optische Filter (217a) ein Kurzpassfilter ist und der zweite optische Filter (217b) ein Langpassfilter ist.
  6. Vorrichtung nach Anspruch 1, wobei die mindestens erste und zweite Lichtquelle eine Mehrzahl von Paaren einander gegenüberliegender Lichtquellen (412a, 412b, 612a - 612j) umfassen, wobei jede Lichtquelle eine Umfangswinkelgröße von etwa 1/X aufweist, wobei X zumindest entweder eine Menge von zu erfassenden Bildern des Behälters (C) oder eine Menge von zu erfassenden Bildabschnitten des Behälters (C) ist.
  7. Vorrichtung nach Anspruch 1, wobei die mindestens erste und zweite Lichtquelle eine Mehrzahl von Paaren einander gegenüberliegender Lichtquellen (412a, 412b, 612a - 612j) umfassen und der Behälter (C) stationär gehalten wird, während die Mehrzahl von Paaren einander gegenüberliegender Lichtquellen (412a, 412b, 612a - 612j) nacheinander in Umfangsrichtung um den Behälter (C) herum angeschaltet werden.
  8. Vorrichtung nach Anspruch 1, wobei das Paar einander gegenüberliegender Lichtquellen (12a, 12b) diametral gegenüberliegend zueinander angeordnet ist und jedes Bildpaar Bilder von entsprechenden Segmenten der Behältermündung (M) umfasst, die diametral einander gegenüberliegen.
  9. Verfahren zum Prüfen eines Behälters (C), der einen Boden (B) sowie eine Mündung (M) aufweist, wobei der zu prüfende Behälter eine Längsachse (A) definiert, mit folgenden Schritten:
    Richten von Licht durch den Behälterboden (B) hindurch in den Behälter und durch die Behältermündung (M) aus dem Behälter heraus unter Verwendung von mindestens einer ersten und einer zweiten Lichtquelle (12a, 12b), die betriebsbereit nebeneinander unterhalb des Behälterbodens angeordnet sind und unterschiedliche Betriebseigenschaften aufweisen, wobei die erste und die zweite Lichtquelle ein Paar aus einander gegenüberliegenden Lichtquellen darstellen, die auf entgegengesetzten Seiten der Längsachse (A) angeordnet sind,
    Erfassen von Licht, das durch die Behältermündung durchgelassen wird, und
    Aufnehmen von Bildern der Behältermündung in einander gegenüberliegenden Paaren, das heißt als Bildpaare, die ein erstes Bild (112a) umfassen, das durch Erfassen des Lichts von der ersten Lichtquelle (12a) erhalten wird, sowie ein zweites Bild (112b), das durch Erfassen des Lichts von der zweiten Lichtquelle (12b) erhalten wird.
  10. Verfahren nach Anspruch 9, wobei die Lichtquellen (12a, 12b) diametral einander gegenüberliegen und jeweils ein oder mehrere diskrete Lichtelemente (12p) enthalten, und wobei ferner jedes Bildpaar (112a, 112b) Bilder von jeweiligen Segmenten der Behältermündung (M) umfasst, die diametral einander gegenüberliegen.
  11. Verfahren nach Anspruch 9, welches das Drehen des Behälters (C) in verschiedene Umfangswinkelpositionen umfasst, um weitere Bildpaare (513a und 513b, 513c und 513d, 513e und 513f, 513g und 513h, 513i und 513j) der Behältermündung (M) zu erfassen.
  12. Verfahren nach Anspruch 9, welches das Erzeugen eines zusammengesetzten Bildes (112) aus den Bildern (112a, 112b) umfasst.
  13. Verfahren nach Anspruch 9, wobei die unterschiedlichen Betriebseigenschaften darin bestehen, dass die erste und die zweite Lichtquelle (12a, 12b) entweder nacheinander angeschaltet werden oder dass die erste und die zweite Lichtquelle (12a, 12b) gleichzeitig angeschaltet werden und unterschiedliche Wellenlängen aufweisen.
  14. Verfahren nach Anspruch 9, wobei Reflexionen in kleinem Winkel auf ein Maß reduziert werden, das die Bildverarbeitung nicht stört, weil die Reflexionen entweder herausgefiltert werden, bevor sie den Lichtsensor (14) erreichen, und/oder auf einen Bereich des Lichtsensors auftreffen, der aktuell nicht ausgewertet wird.
  15. Verfahren nach Anspruch 9, wobei jede Lichtquelle (12a, 12b) eine Umfangswinkelgröße von etwa 1/X aufweist, wobei X zumindest entweder eine Menge von zu erfassenden Bildern des Behälters (C) oder eine Menge von zu erfassenden Bildabschnitten des Behälters (C) ist.
  16. Verfahren nach Anspruch 9, wobei die mindestens erste und zweite Lichtquelle, die genutzt werden, eine Mehrzahl von Paaren einander gegenüberliegender Lichtquellen (412a, 412b, 612a - 612j) umfassen, wobei jede Lichtquelle eine Umfangswinkelgröße von etwa 1/X aufweist, wobei X zumindest entweder eine Menge von zu erfassenden Bildern des Behälters (C) oder eine Menge von zu erfassenden Bildabschnitten des Behälters (C) ist.
  17. Verfahren nach Anspruch 9, wobei die mindestens erste und zweite Lichtquelle, die genutzt werden, eine Mehrzahl von Paaren einander gegenüberliegender Lichtquellen (412a, 412b, 612a - 612j) umfassen und der Behälter (C) stationär gehalten wird, während die Mehrzahl von Paaren einander gegenüberliegender Lichtquellen (412a, 412b, 612a - 612j) nacheinander in Umfangsrichtung um den Behälter (C) herum angeschaltet werden.
EP12731224.7A 2011-06-29 2012-06-06 Optische inspektion von behältern Active EP2726856B1 (de)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP23169275.7A EP4235159A3 (de) 2011-06-29 2012-06-06 Optische inspektion von behältern

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US13/172,258 US9335274B2 (en) 2011-06-29 2011-06-29 Optical inspection of containers
PCT/US2012/041074 WO2013002982A1 (en) 2011-06-29 2012-06-06 Optical inspection of containers

Related Child Applications (2)

Application Number Title Priority Date Filing Date
EP23169275.7A Division-Into EP4235159A3 (de) 2011-06-29 2012-06-06 Optische inspektion von behältern
EP23169275.7A Division EP4235159A3 (de) 2011-06-29 2012-06-06 Optische inspektion von behältern

Publications (2)

Publication Number Publication Date
EP2726856A1 EP2726856A1 (de) 2014-05-07
EP2726856B1 true EP2726856B1 (de) 2023-05-31

Family

ID=46420525

Family Applications (2)

Application Number Title Priority Date Filing Date
EP23169275.7A Pending EP4235159A3 (de) 2011-06-29 2012-06-06 Optische inspektion von behältern
EP12731224.7A Active EP2726856B1 (de) 2011-06-29 2012-06-06 Optische inspektion von behältern

Family Applications Before (1)

Application Number Title Priority Date Filing Date
EP23169275.7A Pending EP4235159A3 (de) 2011-06-29 2012-06-06 Optische inspektion von behältern

Country Status (19)

Country Link
US (1) US9335274B2 (de)
EP (2) EP4235159A3 (de)
JP (1) JP2014526038A (de)
CN (1) CN103782161A (de)
AR (1) AR086786A1 (de)
AU (1) AU2012275966B2 (de)
BR (1) BR112013033824B1 (de)
CL (1) CL2013003724A1 (de)
CO (1) CO6930329A2 (de)
ES (1) ES2949732T3 (de)
HU (1) HUE063565T2 (de)
MX (1) MX2014000166A (de)
MY (1) MY167078A (de)
PE (1) PE20141837A1 (de)
PL (1) PL2726856T3 (de)
PT (1) PT2726856T (de)
TW (1) TW201307798A (de)
WO (1) WO2013002982A1 (de)
ZA (1) ZA201400112B (de)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9335274B2 (en) 2011-06-29 2016-05-10 Owens-Brockway Glass Container Inc. Optical inspection of containers
US9188545B2 (en) * 2011-10-28 2015-11-17 Owens-Brockway Glass Container Inc. Container inspection apparatus and method
DE102014102450A1 (de) * 2014-02-25 2015-08-27 Khs Gmbh Inspektionsvorrichtung mit inverser Folienlinse
EP3146501B1 (de) * 2014-05-19 2020-09-09 The Regents of the University of California Ptychografische fourier-mikroskopie mit multiplex-beleuchtung
DE102017123139A1 (de) * 2016-10-05 2018-04-05 Cognex Corporation Optisches Zubehörteil zur Befestigung an einem Mobilgerät
JP6744240B2 (ja) * 2017-02-23 2020-08-19 倉敷紡績株式会社 プリフォームの底部検査装置

Family Cites Families (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE2909061A1 (de) * 1979-03-08 1980-09-11 Siemens Ag Anordnung zum pruefen von bewegten gegenstaenden mittels einer fernsehkamera
AU5856780A (en) 1979-05-21 1980-11-27 United Glass Ltd. Surface irregularity of translucent material
DE3029678C2 (de) * 1980-08-01 1984-03-22 Siemens AG, 1000 Berlin und 8000 München Anordnung zur optisch-elektronischen Ermittlung von Verunreinigungen im Bodenbereich von transparenten Behältern
JPH0711494B2 (ja) * 1988-06-16 1995-02-08 松下電工株式会社 透光性容器の検査方法
US5216239A (en) * 1991-08-20 1993-06-01 Hajime Industries Ltd. Residual fluid detection apparatus for detecting fluid at the bottom of a bottle using both IR and visible light
US5461228A (en) * 1994-04-07 1995-10-24 Owens-Brockway Glass Container Inc. Optical inspection of container dimensional parameters using a telecentric lens
DE9415768U1 (de) * 1994-09-30 1996-02-01 Max Kettner Verpackungsmaschinenfabrik GmbH & Co KG, 83026 Rosenheim Vorrichtung zum Überprüfen von Flaschen auf Normabweichungen in Form von Beschädigung und/oder Fremdkörpern
JP3181605B2 (ja) 1996-10-30 2001-07-03 クロネス・アクチェンゲゼルシャフト びん等の検査装置
US6031221A (en) 1998-02-19 2000-02-29 Emhart Glass S.A. Container inspection machine
US6175107B1 (en) 1998-05-27 2001-01-16 Owens-Brockway Glass Container Inc. Inspection of containers employing a single area array sensor and alternately strobed light sources
US6198102B1 (en) 1998-06-17 2001-03-06 Owens-Brockway Glass Container Inc. Inspection of container mouth using infrared energy emitted by the container bottom
FR2806478B1 (fr) * 2000-03-14 2002-05-10 Optomachines Dispositif et procede de controle optique de pieces de vaisselle comme des assiettes emaillees ou tout produit ceramique emaille
RU2298780C2 (ru) * 2001-11-16 2007-05-10 Хейнекен Текникал Сервисес Б.В. Устройство для проведения замеров в расфасованном в стеклотару жидком продукте
US20040223342A1 (en) * 2001-12-31 2004-11-11 Klipstein Donald L. LED inspection lamp, cluster LED, and LED with stabilizing agents
JP3989739B2 (ja) * 2002-01-24 2007-10-10 ユニバーサル製缶株式会社 検査装置
WO2004065903A1 (ja) * 2003-01-24 2004-08-05 Nihon Yamamura Glass Co., Ltd. 容器の口部検査装置
JP4286569B2 (ja) * 2003-03-25 2009-07-01 日本山村硝子株式会社 容器の口部検査装置
US20040263619A1 (en) 2003-06-30 2004-12-30 Diehr Richard D Container inspection machine
JP2005283527A (ja) * 2004-03-31 2005-10-13 Hitachi High-Technologies Corp 異物検出装置
DE102005001810B3 (de) 2005-01-13 2006-06-22 Heye International Gmbh Verfahren und Vorrichtung zum Prüfen einer Dichtfläche einer Behältermündung
DE102006034432A1 (de) * 2006-07-26 2008-01-31 Krones Ag Inspektionsvorrichtung für Behältnisse
DE102006047150B4 (de) * 2006-10-05 2013-01-17 Krones Aktiengesellschaft Inspektionsvorrichtung für Behältnisse
US7541572B2 (en) 2006-10-23 2009-06-02 Emhart Glass S.A. Machine for inspecting rotating glass containers with light source triggered multiple times during camera exposure time
US7414716B2 (en) 2006-10-23 2008-08-19 Emhart Glass S.A. Machine for inspecting glass containers
US7697132B2 (en) * 2007-05-02 2010-04-13 Emhart Glass S.A. Machine for inspecting glass containers
US9335274B2 (en) 2011-06-29 2016-05-10 Owens-Brockway Glass Container Inc. Optical inspection of containers

Also Published As

Publication number Publication date
AU2012275966B2 (en) 2015-06-11
PL2726856T3 (pl) 2023-07-24
AR086786A1 (es) 2014-01-22
BR112013033824A2 (pt) 2017-02-14
CN103782161A (zh) 2014-05-07
NZ620240A (en) 2015-07-31
US9335274B2 (en) 2016-05-10
EP4235159A2 (de) 2023-08-30
WO2013002982A8 (en) 2014-03-27
PE20141837A1 (es) 2014-12-08
TW201307798A (zh) 2013-02-16
MY167078A (en) 2018-08-10
WO2013002982A1 (en) 2013-01-03
BR112013033824B1 (pt) 2020-09-24
CO6930329A2 (es) 2014-04-28
HUE063565T2 (hu) 2024-01-28
PT2726856T (pt) 2023-07-28
CL2013003724A1 (es) 2014-08-01
ZA201400112B (en) 2015-04-29
ES2949732T3 (es) 2023-10-02
AU2012275966A1 (en) 2014-01-23
US20130002851A1 (en) 2013-01-03
EP4235159A3 (de) 2023-09-27
EP2726856A1 (de) 2014-05-07
MX2014000166A (es) 2014-06-04
JP2014526038A (ja) 2014-10-02

Similar Documents

Publication Publication Date Title
EP2726856B1 (de) Optische inspektion von behältern
RU2665329C2 (ru) Способ и устройство для наблюдения и анализа оптических особенностей стеклянных сосудов
CN107076680B (zh) 用于对容器进行透射光检查的检查设备和方法
US9188545B2 (en) Container inspection apparatus and method
JP4227272B2 (ja) 異なる波長の光を用いた物品の検査装置
CN102253053B (zh) 外观检查装置
JP6199042B2 (ja) 容器の検査装置
JP2011089978A (ja) ラベル付き容器を検査するための装置と方法
JP2019045470A (ja) 外観検査装置及びその方法
JPH08178869A (ja) 透明容器の点検方法および装置
JP2012026858A (ja) 円筒容器の内周面検査装置
JP2007024776A (ja) 容器の外形検査装置
JP5959430B2 (ja) ボトルキャップの外観検査装置及び外観検査方法
JP6897929B2 (ja) 透明物品の検査装置
JP5425387B2 (ja) ガラス容器を検査するための機械
JP2004271205A (ja) 容器口部の欠陥検査装置
CA3158259A1 (en) Borescope
NZ620240B2 (en) Optical inspection of containers
JP2020193867A (ja) 画像処理装置、制御方法、制御プログラムおよびコンピュータで読み取り可能な記録媒体
JP2016014589A (ja) 容器検査方法及び容器検査装置
JP6860227B2 (ja) キャップの検査方法及び検査装置
JP2017156301A (ja) 検査装置及び回転体の検査方法
CN111225141A (zh) 用于读取图像传感器的方法

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20140121

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

RIN1 Information on inventor provided before grant (corrected)

Inventor name: JUVINALL, JOHN, W.

Inventor name: HALL JR., GEORGE, H.

Inventor name: MICHALSKI, THOMAS, F.

Inventor name: KOHLER, TIMOTHY, A.

Inventor name: GRAFF, STEPHEN, M.

Inventor name: RINGLIEN, JAMES, A.

Inventor name: DANIEL, BENJAMIN, L.

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20180216

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20221214

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602012079603

Country of ref document: DE

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1571204

Country of ref document: AT

Kind code of ref document: T

Effective date: 20230615

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230526

REG Reference to a national code

Ref country code: SE

Ref legal event code: TRGR

REG Reference to a national code

Ref country code: NL

Ref legal event code: FP

REG Reference to a national code

Ref country code: PT

Ref legal event code: SC4A

Ref document number: 2726856

Country of ref document: PT

Date of ref document: 20230728

Kind code of ref document: T

Free format text: AVAILABILITY OF NATIONAL TRANSLATION

Effective date: 20230724

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: NL

Payment date: 20230626

Year of fee payment: 12

Ref country code: FR

Payment date: 20230626

Year of fee payment: 12

Ref country code: DE

Payment date: 20230626

Year of fee payment: 12

REG Reference to a national code

Ref country code: EE

Ref legal event code: FG4A

Ref document number: E023434

Country of ref document: EE

Effective date: 20230704

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG9D

REG Reference to a national code

Ref country code: ES

Ref legal event code: FG2A

Ref document number: 2949732

Country of ref document: ES

Kind code of ref document: T3

Effective date: 20231002

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1571204

Country of ref document: AT

Kind code of ref document: T

Effective date: 20230531

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230831

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230531

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: IT

Payment date: 20230822

Year of fee payment: 12

Ref country code: GB

Payment date: 20230627

Year of fee payment: 12

Ref country code: ES

Payment date: 20230703

Year of fee payment: 12

Ref country code: EE

Payment date: 20230621

Year of fee payment: 12

Ref country code: CZ

Payment date: 20230621

Year of fee payment: 12

Ref country code: CH

Payment date: 20230702

Year of fee payment: 12

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230531

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230531

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230531

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230930

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230531

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230901

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: SE

Payment date: 20230627

Year of fee payment: 12

Ref country code: PT

Payment date: 20230728

Year of fee payment: 12

Ref country code: PL

Payment date: 20230807

Year of fee payment: 12

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230531

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230531

REG Reference to a national code

Ref country code: HU

Ref legal event code: AG4A

Ref document number: E063565

Country of ref document: HU

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230531

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230531

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230531

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230531

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: HU

Payment date: 20230622

Year of fee payment: 12

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20230630

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230531

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230531

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230606

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602012079603

Country of ref document: DE

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230606

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230606

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230606

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230531

26N No opposition filed

Effective date: 20240301

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230531

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230630