EP1984725A1 - Device for monitoring a web - Google Patents

Device for monitoring a web

Info

Publication number
EP1984725A1
EP1984725A1 EP07704828A EP07704828A EP1984725A1 EP 1984725 A1 EP1984725 A1 EP 1984725A1 EP 07704828 A EP07704828 A EP 07704828A EP 07704828 A EP07704828 A EP 07704828A EP 1984725 A1 EP1984725 A1 EP 1984725A1
Authority
EP
European Patent Office
Prior art keywords
web
elements
image
imaging
cameras
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP07704828A
Other languages
German (de)
French (fr)
Other versions
EP1984725A4 (en
EP1984725B1 (en
Inventor
Hannu Ruuska
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Valmet Automation Oy
Original Assignee
Viconsys Oy
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Viconsys Oy filed Critical Viconsys Oy
Publication of EP1984725A1 publication Critical patent/EP1984725A1/en
Publication of EP1984725A4 publication Critical patent/EP1984725A4/en
Application granted granted Critical
Publication of EP1984725B1 publication Critical patent/EP1984725B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/84Systems specially adapted for particular applications
    • G01N21/86Investigating moving sheets
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/84Systems specially adapted for particular applications
    • G01N21/88Investigating the presence of flaws or contamination
    • G01N21/89Investigating the presence of flaws or contamination in moving material, e.g. running paper or textiles
    • G01N21/8901Optical details; Scanning details
    • G01N21/8903Optical details; Scanning details using a multiple detector array
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/56Cameras or camera modules comprising electronic image sensors; Control thereof provided with illuminating means
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70Circuitry for compensating brightness variation in the scene
    • H04N23/74Circuitry for compensating brightness variation in the scene by influencing the scene brightness using illuminating means
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/90Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums

Definitions

  • the present invention relates to a device for monitoring a web, which device includes cameras imaging the web in order to take digital images of the web from a transverse area of the web at the imaging frequency, and each camera includes an image element, which consists of pixels, and the individual pixels of the imaging element of the camera are real image-elements, and the real image-elements are arranged to combine to form effec- tive image-elements of the web in the machine direction.
  • Digital cameras have been used for detecting faults in various types of webs.
  • a matrix camera is used in fault detection.
  • the matrix camera is used to locate faults in the web.
  • the detection precision is such that a pixel of the imaging element of the camera corresponds to an area in the web of about 0,75 mm * 0,75 mm.
  • rubbish and similar faults are generally detected.
  • the level in question is adequate in many cases, if the paper grade in question is of the sc or newsprint type.
  • many webs, particularly coated papers contain faults that are even smaller than this, such as coating streaks in the longitudinal direction. It would be necessary to see such faults already in the order of magnitude of 0,1 mm.
  • a pixel of the camera element should be focussed on an even smaller area. If the intention is for a pixel to correspond to an even smaller area, the number of cameras must be increased, leading to a considerable increase in the bit flow. The increased bit flow requires even larger transfer and calculation capacities. More cameras and greater transfer and calculation capacities are always a cost item. An increasingly accurate image signal will produce micro-formation on the paper. The appearance of paper micro-formation in the images increases the noise appearing in the signal. When a pixel of the camera element corresponds to an even smaller area in the web, less light is collected for the image element, so that the amount of light, i.e. on the other hand the exposure time becomes a problem. This makes detection, according to the prior art, of narrow machine-direction streaks very difficult.
  • Publication EP 0738886 discloses a coating-density analyser and a method to use an asynchronous TDI-CCD camera. These cameras are generally used in an attempt to amplify the light power in poor lighting conditions.
  • the camera disclosed in the publication is used to image the same physical image-element in each row by phasing the imaging frequency with the movement of the web. If the imaging frequency is not precisely synchronized with the movement of the web, as is the case in some of the publication's examples, the result obtained is an exposure of a lengthened area in the machine direction, the length of which is, according to the publication, only about two times its width.
  • Publication US 2003 /0038944A1 discloses a spectroscopical imaging method, in which a moving subject, typically a coating jet, is imaged through filters, by means of which areas of different wavelength are distinguished from each other.
  • the imaging speed is typically 25 images/second. Point-like sub- jects often become imaged as a stripe-like exposure.
  • the invention is intended to create a device for monitoring a web, by means of which faults in the web can be distinguished better than before, by directing the imaging power to where it is needed.
  • the characteristic features of the present invention are stated in the accompanying Claim 1.
  • the device for monitoring a web includes cameras imaging the web , for taking digital images from a transverse area of the web .
  • the distance imaged by the device in the machine direction can be , for example , 80 - 300 mm .
  • the term web refers to the webs in paper and coating machines .
  • the term paper machine refers to paper and board machines .
  • the term coating machine refers , in turn, to machines intended to coat paper or board.
  • the web to be imaged by the device is essentially planar .
  • each camera includes an imaging element, the indi- vidual pixels of which are real image-elements , and the real image-elements are combined to form effective image-elements in the machine direction of the web .
  • the cameras used in the device are matrix cameras .
  • the real image- elements which are combined in the device to form ef fective image- element s , are exposed simultaneously.
  • the matrix camera pixels are simultaneously exposed, forming a two-dimens ional matrix .
  • the real image- elements are combined to form effective image-elements by exploiting the binning function of the matrix camera .
  • the device includes a strobe- lighting unit, the synchroni zation of which is arranged wi th the imaging periods of the matrix cameras , to expose the image-elements s imultaneously, the imaging periods being common to all the cameras .
  • the image frequency is arranged to be such that essentially all the areas of the web are imaged, so that they can be processed as an essentially continuous image flow of the web .
  • the imaging power available in the matrix camera can be directed optimally in terms of detecting faults , by using a higher resolution in the critical direction and a lower resolution in the less direction .
  • a suitable resolution for each purpose unnecessary noise in the image signal can be avoided.
  • the device is especially necessary in paper and coating machines , in which faults must be detected more accurately in the cross direction of the machine than in the machine direction. There is no benefit in imaging at as high a precision in the machine direction of a paper web as in the cross direction, as the limit to the precision in the machine direction is set by the speed of the machine and the exposure time used.
  • the web is imaged as a continuous unified series of imaged areas.
  • the binning function in a matrix camera is utilized to combine real image-elements to form effective image-elements, the combination can be made using an application in the matrix camera itself. If the exposure is based on a light impulse produced by a strobe-lighting unit synchronized with the imaging frequency of the matrix cameras, the web area in the cross direction will be imaged simultaneously, even through there are several cameras in parallel. In exposures using strobe light, the real image- elements in the machine direction too will be exposed simultaneously.
  • the use of the apparatus will particularly reduce the bit flow, it will also improve the exposure and reduce noise.
  • the amount of light is increased without lengthening the exposure time, which is very important when imaging high-speed webs .
  • the device permits a more accurate transverse resolution than that permitted by devices according to the prior art at the same noise level. In other words, the device permits a reduction in the noise in the signal, caused by the micro-formation coming from the more accurate resolution.
  • the pixels i.e. real image-elements of the matrix camera are arranged to correspond to an area, with a side less than 0,5 mm long, preferably less than 0,3 mm long.
  • real image-elements of this size are combined to form effective image-elements in the machine direction of the web, the precision in the cross direction of the web will be at a level at which significant streaks can be detected.
  • essential information will not be lost, as the dimensions of detectable faults in the web in the machine direction of the web are more than the area of the web recorded in the real image-element.
  • by combining the real image-elements it is possible to reduce the occurrence of micro-formation.
  • the device includes processing means, a host unit, and a user interface for controlling the processing means and the host unit.
  • the processing unit belonging to the device is arranged to perform the analysis of images .
  • the device includes 1 - 7 cameras /m, preferably 2 - 5 cameras/m in the cross direction of the web. In that case, even a wide web can be imaged at the precision required to find machine-direction streaks, using a reasonably small number of cameras. In other words, if there are fewer cameras, the web cannot be imaged at the desired precision. On the other hand, if there are more cameras, the cost of the apparatus will be greater, without bringing any significant additional benefit.
  • the device is arranged to take images at an imaging frequency, which is more than 30 images/s, preferably more than 100 images/s. At such a high imaging frequency, even a high-speed web will move less than 5 mm, preferably less than 3 mm during the imaging period.
  • the device is thus arranged to image a web, which travels typically at more than 400 m/min, preferably at even 2500 m/min.
  • the host unit belonging to the device is arranged to control the strobe-light unit and the timing of the matrix cameras.
  • the use of the same host unit to control the strobe-light unit and the matrix cameras achieves a precise timing operation, allowing even a rapidly-moving web to be imaged with the precision required by the device, using several matrix cameras , the real image-elements contained in the imag- ing element of which are exposed simultaneously .
  • delays are significant . If the strobe-light unit and the matrix cameras ' timing are controlled by the host unit, the detrimental effects of the delays will be reduced.
  • the binning function of the matrix cameras is used in such a way that the size of an effective image-element in the cross direction of the web is one real image-element.
  • the number of cameras is minimized and the system is built at the most economical cost, as each real image-element is utilized in the cross-direction of the web as an effective image-element.
  • the size of an effective image-element in the cross direction of the web is 2 - 10, preferably 2 - 5 real image-elements .
  • Figure 1 shows the device according to the invention in operation
  • Figure 2 shows a diagram of the implementation of the device according to the invention
  • Figures 3a - 3c show the device according to the invention for combining real image-elements to form effective image-elements
  • Figure 4 shows the imaging area of a device used in the prior art, in which the imaging precision is 0,74 mm *0,74 mm,
  • Figure 5 shows the imaging area of the device accord- ing to the invention, in which the imaging precision is 0,50 mm * 0,25 mm.
  • Figure 1 shows the device according to the invention for monitoring a web.
  • a matrix- camera beam 12 for imaging the web.
  • a strobe-lighting unit 14 for creating the correct exposure time and lighting level .
  • the strobe-lighting unit can also be located on the same side of the web as the matrix- camera beam (not shown) , in which case specified parts of the surface of the web can be examined in greater detail with the aid of reflected light.
  • the matrix-camera beam 12 consists of the necessary number of matrix cameras 16, in which there is a binning function.
  • the strobe-lighting unit 14 can advantageously be a strobe-lighting beam, which can, in turn be manu- factured using many different methods, but one alternative that can be mentioned are LED lights 18.
  • the matrix cameras 16 forming the matrix-camera beam 12 are CCD cameras.
  • CCD cameras achieve sufficient light power even with a short exposure time and thicker paper grades, as well as boards.
  • the image quality is sufficiently good.
  • the implementation of the device is explained as a diagram in Figure 2.
  • the processor means 21 and the host unit 22 are controlled through the user interface 20, which host unit in turn controls the operation of the strobe-lighting unit 14 and the matrix cameras 16.
  • ERS electronic rolling shutter
  • the shutters of the cameras 16 still remain open for a standby time, after which they close and the data are read to the host computer 22.
  • the voltages of the real image-elements exposed simultaneous by the imaging-elements forming the matrix are combined as desired using the binning function contained in the matrix cameras .
  • the exposure time is adjusted as desired by varying the flash time of the strobe- lighting unit.
  • a bus 24 runs from the host unit 22 to the strobe-lighting unit 14 while a bus 26 runs to the matrix cameras 16 to transmit the imaging command.
  • the data imaged using the matrix cameras 16 travels over the bus 28 to the processing unit 21, where the image is processed.
  • the processing of the image can be performed, for example, by setting a threshold for the values of the image pixels.
  • a single imaging command is enough for the cameras, on the basis of which the cameras are programmed to open the shutters and to close them after the desired period of time, as well as to read the image-elements from the imaging element by exploiting the binning function as desired to com- bine the real image-elements to form effective image-elements .
  • the standby time is used to ensure that all the shutters of the cameras are open when the strobe-lighting unit flashes. In such a very high-speed system, in which up to hundreds of images are taken each second, delays easily become significant.
  • the essential feature in terms of the present invention is the reduction in the bit flow.
  • the reduction in the bit flow being transferred from the matrix camera permits the matrix camera to be used in a mode in which the imaging frequency is considerably higher than when using a larger bit flow.
  • the binning function of the matrix camera combines the real simultaneously exposed image-elements when reading them from the image-element.
  • the binning function is implemented in an analog form, before the content of the real image-elements is converted into bits.
  • Figures 3a - 3c show one possibility for converting the real image-elements 30 into effective image-elements 32.
  • one real image-element 30 is also an effective image-element 32.
  • the real image-elements 30 are combined to form effective image-elements 32, there are fewer effective image- elements 32. If three real image-elements 30 are combined to form a single effective image-element 32, and the number of real image-elements 30 is originally n, the number of effective image-elements 32 will be n/3. This should be taken into ac- count when comparing Figures 3a and 3b.
  • the real image- elements 30 When the real image- elements 30 are combined, some information is lost, as the single value that was obtained when combining the real image- elements, is used as the value of the effective image-element after the combination.
  • the real image-elements 30 are combined using the binning function, the light power of the real image-elements are combined preferably in an analog man- ner.
  • the effective image- elements 32 are lighter than the real image-e1ements , which is illustrated in Figure 3c if it is compared with Figure 3b.
  • Figure 3a shows the real image-elements 30, i.e. the pixels simultaneously exposed by the matrix camera are arranged to correspond to an area, the length of the side of which is less than 0,5 mm, preferably less than 0,3 mm.
  • the real image-element 30 has a square shape and the sides of the real image-element are arranged to correspond to an area of the web with a side that is 0,5 mm.
  • the precision of the effective image-element in the machine direction of the web will be 1 , 5 mm.
  • a single effective image-element will correspond to an area that is 0,5 mm in the cross direction of the web and 1,5 mm in the machine direction.
  • the significant deviations in the cross direction can be very narrow machine-direction streaks in the web.
  • a single effective image- element will correspond to an area that is 0,3 mm in the cross direction of the web and 0,9 mm in the machine direction.
  • the detection of coating streaks appearing in the web will find all the coating streaks that are significant in terms of the process .
  • the machine direction of the web in turn, no essential information will be lost, as the dimensions of the faults that can be detected in the web in its machine direction are greater than the area of the web recorded in the real image-element.
  • no essential information will be lost when the real image-element are combined in the machine direction.
  • the real image-elements 30 shown in Figure 3a are arranged to correspond to an area, with a side length of more than 0,05 mm, preferably more than 0,1 mm.
  • Machine-direction stripes which are significant in terms of web quality, are more than 0,05 mm, typically more than 0,1 mm wide. Thus there is no reason to image the web with greater precision. All in all, it can be said that the real image-elements are arranged to correspond to an area, the side of which in the web is 0,05 - 0,5 mm, preferably 0,1 - 0,3 mm.
  • the real image-elements can be arranged to correspond to even smaller areas, if the binning function is used in both directions. If more real image-elements are combined simultaneously in the machine direction of the web than in its cross direc- tion, the same result as that above will be achieved.
  • the cross-direction dimension of the effective image- elements being examined is 0,05 - 0,5 mm, preferably 0,1 - 0,3 mm while the machine-direction dimension is greater than the cross-direction dimension.
  • This embodiment can be considered, for example, for use with imaging elements that are larger than at present.
  • the embodiment in question permits the camera to be used in a mode, in which the imaging speed is made sufficiently high.
  • the embodiment in question is also significant in terms of light power and micro-information.
  • this embodiment requires more cameras, making the most advantageous cross-direction dimension of an effective image-element the cross-direction dimension of a real image-element.
  • the binning function of the matrix camera is preferably used in such a way that the size of an effective image-element in the cross direction of the web is one real image-element.
  • the effective image-element is less than 5 mm, preferably less than 3 mm.
  • the effective image-element is more than 0,3 mm, preferably more than 0,5 mm.
  • the device in question is suitable for use in high-speed processes, in which in order to image the entire web more than 30, preferably more than 100 images are taken each second.
  • the speed of the paper machine is 2100 m/min, i.e. 35 000 mm/s while the imaging should take place in a machine-direction area of less than 200 mm. A spe- cific point in the paper will then travel the distance of 200 mm in 0,005714 seconds. If it is wished to image each point on the paper, 175 images should be taken each second.
  • imaging elements of different sizes available in the camera and the transfer speed of information from the camera can vary.
  • Figures 4 - 5 and the calculations presented in connection with them are based on the assumption of using a matrix camera with an imaging element containing 800 * 600 pixels and a maximum of 38 million pixels that can be transferred from the camera each second.
  • each image can contain a maximum of about 217 000 pixels, due to the limitation of the size of the trans- fer channel, which limits the size of the image area being transferred.
  • the markings MD and CD appear in Figures 4 and 5, of which MD refers to the machine direction of the web and CD to the cross direction.
  • Figures 4 shows the imaging of the web using a matrix camera, the number of points of the imaging element of which in the cross direction of the web is marked by w, the numerical value of which in the example is 800, while there are 600 lines in the longitudinal direction h of the web.
  • the imaging element of the camera sees the area A + B + C.
  • the information contained in all the pixels of the imaging element cannot be transferred from the camera, if the imaging speed is too high.
  • the information contained in the areas B and C is left unread.
  • the information of the area A is read from the imaging element and then forwarded from the camera .
  • Imaging in the machine direction should take place over a distance of 200 mm, which is marked by b. This distance consists of 271 points, so that the dimension of the side of a point will be 0,738 mm.
  • An area 800 * 0,738 mm 590,4 mm wide, which is marked by a, can thus be detected in the cross direction. Much of the cross-direction material, i.e. 329 lines, is left unused.
  • an area 590 mm wide can be imaged over a distance of 200 mm in the machine direction, using a single camera with a 800 * 600 imaging element. The precision of the imaging is 0,738 mm * 0,738 mm. In order to monitor a 10-metre wide web, 17 cameras will then be required.
  • a single pixel should correspond to a smaller area of the web.
  • the size of the readable image area in the machine direction is 800 points .
  • the imaging in the machine direction should take place over a distance of 200 mm. This distance consists of 800 points, so that the dimension of the side of the point is 0,250 mm.
  • an area 67,75 mm wide can be imaged over a distance of 200 mm using a single camera with an 800 * 600 imaging element. 149 cameras would then be required to monitor a 10-metre wide web.
  • An imaging precision of 0,25 mm in the machine direction is unnecessarily accurate, as when the exposure time is, for example, 6 ⁇ s, the web will travel 0,21 mm during the exposure if the machine speed is 35 000 mm/s. As the smallest distinguishable area is 0,25 mm and its movement during the exposure time is 0,21 mm, practically no benefit is offered by a machine-direction precision of 0,25 mm.
  • the aforementioned precision of 0,75 mm will in addition be sufficient, because in the said direction the faults to be detected will generally be in that area. Extra precision will demand unnecessary transfer and processing power.
  • the cameras imaging the web can be rotated through 90° as described above, but it is preferable for the width, i.e. the longer side, of the camera's imaging element to be parallel to the cross direction of the machine and the web.
  • Figure 5 shows the imaging of a web using a matrix camera, the number of points of the imaging element of which in the transverse direction of the web is marked by w, the numerical value of which in the example is 800, with 600 lines in the longitudinal direction h of the web.
  • the camera's imaging element sees the area A' .
  • the number of effective image-elements transferred during one second is limited.
  • 800 * 200 160 000 effective image- elements will be forwarded from a camera equipped with an 800 * 600-image-element imaging element, covering the entire area of the imaging element in each image. If the bit flow being transferred from the camera in one second is limited to 38 million effective image-elements, it will be possible to take 237 images in one second. In the case in the example, the machine speed was 35 000 mm/s, so that the distance being imaged should be at least 148 mm.
  • a single real image-element will correspond to a square with a side of 0,25 mm.
  • the imaging element there are 800 points in the cross direction of the web, which corresponds to 200 mm.
  • the area of the imaging element is exploited fully.
  • the preci- sion of the imaging is 0,75 mm in the machine direction and 0,25 mm in the cross direction. 50 cameras will then be required to monitor a 10-metre wide web.
  • This form of use described in connection with Figure 5 is highly advantageous, as it exploits the entire area of the imaging element of the matrix camera and achieves a shorter 150-mm long imaging area in the machine direction.
  • the imaging distance required in the machine direction has been advantageously shortened.
  • the use of the binning function also achieves other benefits.
  • the imaging element is made to correspond to a smaller area than previously, so that the amount of light received by the imaging element will diminish.
  • the darkness of the images may cause problems .
  • the lighting of the images will increase, which will permit the use of shorter exposure times, or the imaging of thicker material using the same exposure time.
  • Coating pigments absorb a great deal of light, making the increased amount of light very important.
  • the term conversion to a bit flow refers to A/D conversion.
  • the combination of the real image-elements to form effective image-elements takes place when the real image-elements are read from the imaging element, when the information contained in the real image-elements is combined.
  • the voltages are combined in an analog manner prior to conversion to a bit flow, i.e. A/D conversion.
  • the device for monitoring a web includes matrix cameras imaging the web, a strobe-lighting unit, a host unit, and a processing unit.
  • the processing unit processes the images taken of the web into a form, in which the machine operator, the processing unit, or both analyse the images.
  • the individual pixels of the imaging element of the matrix camera are real image-elements .
  • Present matrix cameras include a function, by means of which these real image-elements can be combined. Using this function it is possible to combine the real image-elements already when they are still voltage differences in the imaging element.
  • the combination of the real image-elements creates effective image- elements, which are converted into bits. By selecting the real image-elements as desired to be converted, the desired form of the effective image-elements is obtained.
  • the method used in the combination is binning.
  • Real image-elements are combined to form effective image-elements in the machine direction of the web, in order to reduce the bit flow.
  • 2 - 10, preferably 2 - 5 real image-elements in the machine direction are combined to form an effective image- element.
  • an effective image-element would be 1 - 6, preferably 2 - 4 real image-elements .
  • the binning function is preferably used in such a way that the size of the effective image-element in the cross direction is one real image-element .
  • the synchronization of the strobe light is made to correspond with the imaging period of the matrix cameras . All the matrix cameras have essentially the same imaging period.
  • the timing of the strobe-lighting unit and the matrix cameras is controlled centrally by the host unit. The lighting of a desired point is performed in such a way that first the host unit commands the matrix cameras to open their shutters. After that, with a small delay the host unit commands the strobe-lighting unit to illuminate the area to be imaged. After that, the shutters of the matrix cameras are closed and the data is read from the imaging element. When the data is being read, the real image-elements are combined to form the desired effective image-element.
  • the distance imaged by the device in the machine direction is 80 - 300 mm, preferably 100 - 250 mm.
  • the imaging frequency is set to be such that all the areas of the web are imaged, so that they can be shown as a continuous, or substantially continuous image of the web. In other words, all the areas of the web are imaged, so that they can be processed as a continuous or substantially continuous image flow of the web.
  • the device according to the invention is suitable for use in high-speed processes, in which in order to image the entire web 30 - 200 images are taken each second, the area being imaged being the aforesaid 100 - 250 mm.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Analytical Chemistry (AREA)
  • Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Chemical & Material Sciences (AREA)
  • Biochemistry (AREA)
  • General Health & Medical Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • Immunology (AREA)
  • Pathology (AREA)
  • Textile Engineering (AREA)
  • Investigating Materials By The Use Of Optical Means Adapted For Particular Applications (AREA)
  • Studio Devices (AREA)

Abstract

The invention relates to a device for monitoring a web (10). The device includes cameras imaging the web (10) in order to take digital images of the web from a transverse area of the web at the imaging frequency. Each camera includes an image element, which consists of pixels. The individual pixels of the imaging element of the camera are real image- elements (30). The real image- elements (30) are arranged to combine to form effective image- elements (32) of the web (10) in the machine direction. In addition, the cameras used in the device are matrix cameras (16), the imaging elements in which are arranged to be exposed simultaneously. The real image-elements are arranged to be combined to form effective image-elements by exploiting the binning function of the matrix camera (16). The device includes a strobe-lighting unit (14), the synchronization of which is arranged in step with the exposure of the matrix cameras (16), the imaging periods being common to all the cameras. The imaging frequency is arranged to be such that essentially all the areas of the web (10) are imaged.

Description

DEVICE FOR MONITORING A WEB
The present invention relates to a device for monitoring a web, which device includes cameras imaging the web in order to take digital images of the web from a transverse area of the web at the imaging frequency, and each camera includes an image element, which consists of pixels, and the individual pixels of the imaging element of the camera are real image-elements, and the real image-elements are arranged to combine to form effec- tive image-elements of the web in the machine direction.
Digital cameras have been used for detecting faults in various types of webs. In patent publication DE19720308, a matrix camera is used in fault detection. The matrix camera is used to locate faults in the web. The detection precision is such that a pixel of the imaging element of the camera corresponds to an area in the web of about 0,75 mm * 0,75 mm. When the web is imaged at this precision, rubbish and similar faults are generally detected. The level in question is adequate in many cases, if the paper grade in question is of the sc or newsprint type. However, many webs, particularly coated papers, contain faults that are even smaller than this, such as coating streaks in the longitudinal direction. It would be necessary to see such faults already in the order of magnitude of 0,1 mm.
If the prior art is used to attempt to detect even narrower streaks, a pixel of the camera element should be focussed on an even smaller area. If the intention is for a pixel to correspond to an even smaller area, the number of cameras must be increased, leading to a considerable increase in the bit flow. The increased bit flow requires even larger transfer and calculation capacities. More cameras and greater transfer and calculation capacities are always a cost item. An increasingly accurate image signal will produce micro-formation on the paper. The appearance of paper micro-formation in the images increases the noise appearing in the signal. When a pixel of the camera element corresponds to an even smaller area in the web, less light is collected for the image element, so that the amount of light, i.e. on the other hand the exposure time becomes a problem. This makes detection, according to the prior art, of narrow machine-direction streaks very difficult.
Publication EP 0738886 discloses a coating-density analyser and a method to use an asynchronous TDI-CCD camera. These cameras are generally used in an attempt to amplify the light power in poor lighting conditions. The camera disclosed in the publication is used to image the same physical image-element in each row by phasing the imaging frequency with the movement of the web. If the imaging frequency is not precisely synchronized with the movement of the web, as is the case in some of the publication's examples, the result obtained is an exposure of a lengthened area in the machine direction, the length of which is, according to the publication, only about two times its width. Using the apparatus of the publication, in a typical case an area 12 mm x 24 mm on an area 15-cm long is imaged in stages into imaging pixels on the same row, which are finally summed. Thus a TDI-CCD camera does not permit continuous imaging, but instead leaves a completely non-imaged area between the imaging periods .
Publication US 2003 /0038944A1 discloses a spectroscopical imaging method, in which a moving subject, typically a coating jet, is imaged through filters, by means of which areas of different wavelength are distinguished from each other. The imaging speed is typically 25 images/second. Point-like sub- jects often become imaged as a stripe-like exposure.
The invention is intended to create a device for monitoring a web, by means of which faults in the web can be distinguished better than before, by directing the imaging power to where it is needed. The characteristic features of the present invention are stated in the accompanying Claim 1. The device for monitoring a web includes cameras imaging the web , for taking digital images from a transverse area of the web . The distance imaged by the device in the machine direction can be , for example , 80 - 300 mm . The term web refers to the webs in paper and coating machines . The term paper machine refers to paper and board machines . The term coating machine refers , in turn, to machines intended to coat paper or board. The web to be imaged by the device is essentially planar . In the device, each camera includes an imaging element, the indi- vidual pixels of which are real image-elements , and the real image-elements are combined to form effective image-elements in the machine direction of the web . By combining the real image- elements in the machine direction of the web, the desired shape of the effective image elements is obtained . In addition, the cameras used in the device are matrix cameras . The real image- elements , which are combined in the device to form ef fective image- element s , are exposed simultaneously. Thus , in the matrix camera pixels are simultaneously exposed, forming a two-dimens ional matrix . The real image- elements are combined to form effective image-elements by exploiting the binning function of the matrix camera . The device includes a strobe- lighting unit, the synchroni zation of which is arranged wi th the imaging periods of the matrix cameras , to expose the image-elements s imultaneously, the imaging periods being common to all the cameras . The image frequency is arranged to be such that essentially all the areas of the web are imaged, so that they can be processed as an essentially continuous image flow of the web .
By means of the device , the imaging power available in the matrix camera can be directed optimally in terms of detecting faults , by using a higher resolution in the critical direction and a lower resolution in the less direction . By selecting a suitable resolution for each purpose, unnecessary noise in the image signal can be avoided. The device is especially necessary in paper and coating machines , in which faults must be detected more accurately in the cross direction of the machine than in the machine direction. There is no benefit in imaging at as high a precision in the machine direction of a paper web as in the cross direction, as the limit to the precision in the machine direction is set by the speed of the machine and the exposure time used. Unlike in TDI cameras, if the cross-direction and machine-direction image-elements are simultaneously exposed in a matrix camera, the web is imaged as a continuous unified series of imaged areas. When the binning function in a matrix camera is utilized to combine real image-elements to form effective image-elements, the combination can be made using an application in the matrix camera itself. If the exposure is based on a light impulse produced by a strobe-lighting unit synchronized with the imaging frequency of the matrix cameras, the web area in the cross direction will be imaged simultaneously, even through there are several cameras in parallel. In exposures using strobe light, the real image- elements in the machine direction too will be exposed simultaneously.
Though the use of the apparatus will particularly reduce the bit flow, it will also improve the exposure and reduce noise. By means of the device, the amount of light is increased without lengthening the exposure time, which is very important when imaging high-speed webs . The device permits a more accurate transverse resolution than that permitted by devices according to the prior art at the same noise level. In other words, the device permits a reduction in the noise in the signal, caused by the micro-formation coming from the more accurate resolution.
In one embodiment, the pixels, i.e. real image-elements of the matrix camera are arranged to correspond to an area, with a side less than 0,5 mm long, preferably less than 0,3 mm long. When real image-elements of this size are combined to form effective image-elements in the machine direction of the web, the precision in the cross direction of the web will be at a level at which significant streaks can be detected. In the machine direction of the web, in turn, essential information will not be lost, as the dimensions of detectable faults in the web in the machine direction of the web are more than the area of the web recorded in the real image-element. In addition, by combining the real image-elements it is possible to reduce the occurrence of micro-formation.
In a second embodiment, the device includes processing means, a host unit, and a user interface for controlling the processing means and the host unit.
In a third embodiment, the processing unit belonging to the device is arranged to perform the analysis of images .
In a fourth embodiment, the device includes 1 - 7 cameras /m, preferably 2 - 5 cameras/m in the cross direction of the web. In that case, even a wide web can be imaged at the precision required to find machine-direction streaks, using a reasonably small number of cameras. In other words, if there are fewer cameras, the web cannot be imaged at the desired precision. On the other hand, if there are more cameras, the cost of the apparatus will be greater, without bringing any significant additional benefit.
In a fifth embodiment, the device is arranged to take images at an imaging frequency, which is more than 30 images/s, preferably more than 100 images/s. At such a high imaging frequency, even a high-speed web will move less than 5 mm, preferably less than 3 mm during the imaging period. The device is thus arranged to image a web, which travels typically at more than 400 m/min, preferably at even 2500 m/min.
In a sixth embodiment, the host unit belonging to the device is arranged to control the strobe-light unit and the timing of the matrix cameras. The use of the same host unit to control the strobe-light unit and the matrix cameras achieves a precise timing operation, allowing even a rapidly-moving web to be imaged with the precision required by the device, using several matrix cameras , the real image-elements contained in the imag- ing element of which are exposed simultaneously . In other words , when imaging high-speed webs , delays are significant . If the strobe-light unit and the matrix cameras ' timing are controlled by the host unit, the detrimental effects of the delays will be reduced.
In a seventh embodiment, the binning function of the matrix cameras is used in such a way that the size of an effective image-element in the cross direction of the web is one real image-element. The number of cameras is minimized and the system is built at the most economical cost, as each real image-element is utilized in the cross-direction of the web as an effective image-element.
In an eighth embodiment, the size of an effective image-element in the cross direction of the web is 2 - 10, preferably 2 - 5 real image-elements . By combining the real image-elements in question in the machine direction of the web, no essential information will be lost, but a more rapid imaging frequency will be possible.
In the following, the invention is examined in detail reference to the accompanying drawings depicting some applications of the invention, in which
Figure 1 shows the device according to the invention in operation, Figure 2 shows a diagram of the implementation of the device according to the invention,
Figures 3a - 3c show the device according to the invention for combining real image-elements to form effective image-elements , Figure 4 shows the imaging area of a device used in the prior art, in which the imaging precision is 0,74 mm *0,74 mm,
Figure 5 shows the imaging area of the device accord- ing to the invention, in which the imaging precision is 0,50 mm * 0,25 mm.
Figure 1 shows the device according to the invention for monitoring a web. On the first side of the web 10 is a matrix- camera beam 12 for imaging the web. On the second side of the web is a strobe-lighting unit 14, for creating the correct exposure time and lighting level . The strobe-lighting unit can also be located on the same side of the web as the matrix- camera beam (not shown) , in which case specified parts of the surface of the web can be examined in greater detail with the aid of reflected light. The matrix-camera beam 12 consists of the necessary number of matrix cameras 16, in which there is a binning function. The strobe-lighting unit 14 can advantageously be a strobe-lighting beam, which can, in turn be manu- factured using many different methods, but one alternative that can be mentioned are LED lights 18.
In the device according to the invention, shown in Figure 1, the matrix cameras 16 forming the matrix-camera beam 12 are CCD cameras. CCD cameras, achieve sufficient light power even with a short exposure time and thicker paper grades, as well as boards. In addition, with CCD cameras the image quality is sufficiently good.
The implementation of the device is explained as a diagram in Figure 2. The processor means 21 and the host unit 22 are controlled through the user interface 20, which host unit in turn controls the operation of the strobe-lighting unit 14 and the matrix cameras 16. In one preferred embodiment, the host computer 22 first commands the cameras 16 to open the shutters (ERS = electronic rolling shutter) . This followed by a standby time, when a check is made that the shutters of all the cameras 16 are open. After the standby time, the shutters of the cameras are sure to be open and the strobe-lighting unit 12 receives a command to light up for the desired period of time. When the strobe-lighting unit 12 is shut down after the desired time, the shutters of the cameras 16 still remain open for a standby time, after which they close and the data are read to the host computer 22. In reading, the voltages of the real image-elements exposed simultaneous by the imaging-elements forming the matrix are combined as desired using the binning function contained in the matrix cameras . The exposure time is adjusted as desired by varying the flash time of the strobe- lighting unit. In order to pass the lighting command, a bus 24 runs from the host unit 22 to the strobe-lighting unit 14 while a bus 26 runs to the matrix cameras 16 to transmit the imaging command. The data imaged using the matrix cameras 16 travels over the bus 28 to the processing unit 21, where the image is processed. The processing of the image can be performed, for example, by setting a threshold for the values of the image pixels. Preferably a single imaging command is enough for the cameras, on the basis of which the cameras are programmed to open the shutters and to close them after the desired period of time, as well as to read the image-elements from the imaging element by exploiting the binning function as desired to com- bine the real image-elements to form effective image-elements . The standby time is used to ensure that all the shutters of the cameras are open when the strobe-lighting unit flashes. In such a very high-speed system, in which up to hundreds of images are taken each second, delays easily become significant. Because of the disturbing effects of delays, standby times, which minimize the detrimental effects of the delays, are used. Significant delays appear in the signal transmitted to the cameras and in the operation of the cameras . The system described above is only one example of how the problems brought by delays can be solved and the flashes of the strobe-lighting unit synchronized with the operation of the cameras . In connection with Figures 3 - 5, the invention is examined through the amount of the bit flow and by the limited nature of the bit flow being transferred from the camera. Besides the reduction in the bit flow made possible by the invention, it is important to take into account the advantage brought by the lighting made possible by the invention and the reduction in noise appearing in the signal. Though the advantage brought to the lighting by the binning function can be significant on machines manufacturing thick paper grades and boards, the essential feature in terms of the present invention is the reduction in the bit flow. The reduction in the bit flow being transferred from the matrix camera permits the matrix camera to be used in a mode in which the imaging frequency is considerably higher than when using a larger bit flow. The binning function of the matrix camera combines the real simultaneously exposed image-elements when reading them from the image-element. The binning function is implemented in an analog form, before the content of the real image-elements is converted into bits.
Figures 3a - 3c show one possibility for converting the real image-elements 30 into effective image-elements 32. In Figure 3a, one real image-element 30 is also an effective image-element 32. When the real image-elements 30 are combined to form effective image-elements 32, there are fewer effective image- elements 32. If three real image-elements 30 are combined to form a single effective image-element 32, and the number of real image-elements 30 is originally n, the number of effective image-elements 32 will be n/3. This should be taken into ac- count when comparing Figures 3a and 3b. When the real image- elements 30 are combined, some information is lost, as the single value that was obtained when combining the real image- elements, is used as the value of the effective image-element after the combination. When the real image-elements 30 are combined using the binning function, the light power of the real image-elements are combined preferably in an analog man- ner. When the binning function is used, the effective image- elements 32 are lighter than the real image-e1ements , which is illustrated in Figure 3c if it is compared with Figure 3b.
Figure 3a shows the real image-elements 30, i.e. the pixels simultaneously exposed by the matrix camera are arranged to correspond to an area, the length of the side of which is less than 0,5 mm, preferably less than 0,3 mm. In Figure 3a, the real image-element 30 has a square shape and the sides of the real image-element are arranged to correspond to an area of the web with a side that is 0,5 mm. When the real image-elements are combined to form effective image-elements in the machine direction of the web, the cross-direction precision remains 0,5 mm. If three real image-elements in the machine direction of the web are combined to form an effective image-element, as is shown in Figure 3b, the precision of the effective image-element in the machine direction of the web will be 1 , 5 mm. In that case, a single effective image-element will correspond to an area that is 0,5 mm in the cross direction of the web and 1,5 mm in the machine direction. At this precision, it is possible to take into account significant deviations in both directions . The significant deviations in the cross direction can be very narrow machine-direction streaks in the web.
Correspondingly, if the real image-elements are arranged to correspond to an area 0,3 * 0,3 mm, a single effective image- element will correspond to an area that is 0,3 mm in the cross direction of the web and 0,9 mm in the machine direction. At this precision, the detection of coating streaks appearing in the web will find all the coating streaks that are significant in terms of the process . In the machine direction of the web in turn, no essential information will be lost, as the dimensions of the faults that can be detected in the web in its machine direction are greater than the area of the web recorded in the real image-element. In addition, due to the machine-direction movement of the web during the exposure time, no essential information will be lost when the real image-element are combined in the machine direction. By combining the real image- elements, the appearance of micro-formation can also be reduced.
The real image-elements 30 shown in Figure 3a are arranged to correspond to an area, with a side length of more than 0,05 mm, preferably more than 0,1 mm. Machine-direction stripes, which are significant in terms of web quality, are more than 0,05 mm, typically more than 0,1 mm wide. Thus there is no reason to image the web with greater precision. All in all, it can be said that the real image-elements are arranged to correspond to an area, the side of which in the web is 0,05 - 0,5 mm, preferably 0,1 - 0,3 mm.
The real image-elements can be arranged to correspond to even smaller areas, if the binning function is used in both directions. If more real image-elements are combined simultaneously in the machine direction of the web than in its cross direc- tion, the same result as that above will be achieved. In other words, the cross-direction dimension of the effective image- elements being examined is 0,05 - 0,5 mm, preferably 0,1 - 0,3 mm while the machine-direction dimension is greater than the cross-direction dimension. This embodiment can be considered, for example, for use with imaging elements that are larger than at present. In addition, the embodiment in question permits the camera to be used in a mode, in which the imaging speed is made sufficiently high. The embodiment in question is also significant in terms of light power and micro-information. However, this embodiment requires more cameras, making the most advantageous cross-direction dimension of an effective image-element the cross-direction dimension of a real image-element. In other words, the binning function of the matrix camera is preferably used in such a way that the size of an effective image-element in the cross direction of the web is one real image-element. In the machine direction, the effective image-element is less than 5 mm, preferably less than 3 mm. On the other hand, in the machine direction, the effective image-element is more than 0,3 mm, preferably more than 0,5 mm. The device in question is suitable for use in high-speed processes, in which in order to image the entire web more than 30, preferably more than 100 images are taken each second. At such a high imaging frequency, even a rapidly moving web will move a very short distance, which is less than 5 mm, preferably less than 3 mm, during an imaging period. On the other hand, during an imaging period the web will move more than 0,3 mm, preferably more than 0,5 mm. Therefore it will be desired to examine the web in greater detail in the cross direction than it is necessary in the machine direction, thus no essential information is lost when the machine-direction real image-elements are combined.
In the following example, the speed of the paper machine is 2100 m/min, i.e. 35 000 mm/s while the imaging should take place in a machine-direction area of less than 200 mm. A spe- cific point in the paper will then travel the distance of 200 mm in 0,005714 seconds. If it is wished to image each point on the paper, 175 images should be taken each second. There can be imaging elements of different sizes available in the camera and the transfer speed of information from the camera can vary. Figures 4 - 5 and the calculations presented in connection with them are based on the assumption of using a matrix camera with an imaging element containing 800 * 600 pixels and a maximum of 38 million pixels that can be transferred from the camera each second. However, the invention is in no way bound to these cameras, but instead can be applied similarly with any matrix camera whatever, in which there is a function that combines image-elements . If the camera in question is used to take 175 images each second, each image can contain a maximum of about 217 000 pixels, due to the limitation of the size of the trans- fer channel, which limits the size of the image area being transferred. The markings MD and CD appear in Figures 4 and 5, of which MD refers to the machine direction of the web and CD to the cross direction. Figures 4 shows the imaging of the web using a matrix camera, the number of points of the imaging element of which in the cross direction of the web is marked by w, the numerical value of which in the example is 800, while there are 600 lines in the longitudinal direction h of the web. The imaging element of the camera sees the area A + B + C. The information contained in all the pixels of the imaging element cannot be transferred from the camera, if the imaging speed is too high. As stated above, the number of pixels to be transferred according to a single image is limited and permits the imaging area size to be 800 * 271 = 216 800 pixels, i.e. 271 lines in the machine direction of the web. In this example, the information contained in the areas B and C is left unread. The information of the area A is read from the imaging element and then forwarded from the camera . Imaging in the machine direction should take place over a distance of 200 mm, which is marked by b. This distance consists of 271 points, so that the dimension of the side of a point will be 0,738 mm. An area 800 * 0,738 mm = 590,4 mm wide, which is marked by a, can thus be detected in the cross direction. Much of the cross-direction material, i.e. 329 lines, is left unused. In the example in question, an area 590 mm wide can be imaged over a distance of 200 mm in the machine direction, using a single camera with a 800 * 600 imaging element. The precision of the imaging is 0,738 mm * 0,738 mm. In order to monitor a 10-metre wide web, 17 cameras will then be required.
If it is desired to image more accurately, a single pixel should correspond to a smaller area of the web. When using the full width of the imaging element in the machine direction, the size of the readable image area in the machine direction is 800 points . The imaging in the machine direction should take place over a distance of 200 mm. This distance consists of 800 points, so that the dimension of the side of the point is 0,250 mm. Thus, in the width direction it is possible to detect an area with a width of 271 * 0,250 mm = 67,75 mm. Much of the cross-direction material, i.e. 329 points, is left unused. By adding cameras so as to achieve a precision of 0,25 * 0,25 mm, an area 67,75 mm wide can be imaged over a distance of 200 mm using a single camera with an 800 * 600 imaging element. 149 cameras would then be required to monitor a 10-metre wide web. An imaging precision of 0,25 mm in the machine direction is unnecessarily accurate, as when the exposure time is, for example, 6 μs, the web will travel 0,21 mm during the exposure if the machine speed is 35 000 mm/s. As the smallest distinguishable area is 0,25 mm and its movement during the exposure time is 0,21 mm, practically no benefit is offered by a machine-direction precision of 0,25 mm. In the machine direc- tion, the aforementioned precision of 0,75 mm will in addition be sufficient, because in the said direction the faults to be detected will generally be in that area. Extra precision will demand unnecessary transfer and processing power. The cameras imaging the web can be rotated through 90° as described above, but it is preferable for the width, i.e. the longer side, of the camera's imaging element to be parallel to the cross direction of the machine and the web.
Figure 5 shows the imaging of a web using a matrix camera, the number of points of the imaging element of which in the transverse direction of the web is marked by w, the numerical value of which in the example is 800, with 600 lines in the longitudinal direction h of the web. The camera's imaging element sees the area A' .
As described above, the number of effective image-elements transferred during one second is limited. By using the binning function to combine three real image-elements to form one effective image-element, 800 * 200 = 160 000 effective image- elements will be forwarded from a camera equipped with an 800 * 600-image-element imaging element, covering the entire area of the imaging element in each image. If the bit flow being transferred from the camera in one second is limited to 38 million effective image-elements, it will be possible to take 237 images in one second. In the case in the example, the machine speed was 35 000 mm/s, so that the distance being imaged should be at least 148 mm. If the distance c being imaged is selected as 150 mm, a single real image-element will correspond to a square with a side of 0,25 mm. In the imaging element, there are 800 points in the cross direction of the web, which corresponds to 200 mm. In the example of Figure 5, the area of the imaging element is exploited fully. In the example in question, a single camera with an 800 * 800 imaging element can be used to image an area with the width a' = 200 mm over a distance of 150 mm in the machine direction. The preci- sion of the imaging is 0,75 mm in the machine direction and 0,25 mm in the cross direction. 50 cameras will then be required to monitor a 10-metre wide web. This form of use described in connection with Figure 5 is highly advantageous, as it exploits the entire area of the imaging element of the matrix camera and achieves a shorter 150-mm long imaging area in the machine direction. The imaging distance required in the machine direction has been advantageously shortened.
The example in the above description of Figures 4 and 5 gives only a single machine speed, exposure time, and size of imaging element. However, the invention can be correspondingly used even if the machine speed and exposure time vary over a wide range. The essential point is that no important information will be lost by combining machine-direction image-elements when reading the data from the imaging element. In addition, both an improved exposure result and reduced noise appearing in the signal, which leads to micro-formation appearing in accurate images, will be obtained. When three real image-elements are combined in the machine direction, the amount of data to be transferred will drop to one third, while retaining the cross- direction precision. If cameras with larger imaging elements than in the above description are used, the use of the binning function in both directions can be envisaged.
In order to reduce optical noise large pixels are preferable. In the accurate imaging of the web even the smallest differences in the texture of the paper will appear, thus increasing the micro-formation. Increased micro-formation will lead to increased signal noise. As the pixel size approaches zero, the noise will exponentially approach the maximum. As precision increases, the noise in the signal increases. The amount of noise can be reduced by combining the machine-direction real image-elements when reading them from the imaging element. In terms of minimizing noise, it is not worth using unnecessary precision in the machine direction, in which the preferable precision is 0,5 - 0,8 mm.
Besides reducing the bit flow, the use of the binning function also achieves other benefits. By making the optics more accurate, the imaging element is made to correspond to a smaller area than previously, so that the amount of light received by the imaging element will diminish. In seeking an improved precision, the darkness of the images may cause problems . When combining the real image-elements while reading data from the imaging element, the lighting of the images will increase, which will permit the use of shorter exposure times, or the imaging of thicker material using the same exposure time. Coating pigments absorb a great deal of light, making the increased amount of light very important. It is possible to obtain a greater lighting power for the effective image-ele- ments and the entire image, because the real image-elements are combined to form effective image-elements, so that their light powers too are combined advantageously already before the bit flow is converted. The term conversion to a bit flow refers to A/D conversion. The combination of the real image-elements to form effective image-elements takes place when the real image-elements are read from the imaging element, when the information contained in the real image-elements is combined. When the real image- elements are combined to form effective image-elements, the voltages are combined in an analog manner prior to conversion to a bit flow, i.e. A/D conversion.
The device for monitoring a web includes matrix cameras imaging the web, a strobe-lighting unit, a host unit, and a processing unit. The processing unit processes the images taken of the web into a form, in which the machine operator, the processing unit, or both analyse the images. The individual pixels of the imaging element of the matrix camera are real image-elements . Present matrix cameras include a function, by means of which these real image-elements can be combined. Using this function it is possible to combine the real image-elements already when they are still voltage differences in the imaging element. The combination of the real image-elements creates effective image- elements, which are converted into bits. By selecting the real image-elements as desired to be converted, the desired form of the effective image-elements is obtained. The method used in the combination is binning.
On a paper machine, narrow machine-direction streaks can appear especially in coated papers. To detect these streaks, a very precise resolution capacity is required in the cross direction of the web, but a high resolution in the machine direction will unnecessarily increase the noise appearing in the signal . Real image-elements are combined to form effective image-elements in the machine direction of the web, in order to reduce the bit flow. 2 - 10, preferably 2 - 5 real image-elements in the machine direction are combined to form an effective image- element. It is possible to envisage special applications, in which image-elements are combined in the cross direction. In these applications, an effective image-element would be 1 - 6, preferably 2 - 4 real image-elements . However, the binning function is preferably used in such a way that the size of the effective image-element in the cross direction is one real image-element .
The synchronization of the strobe light is made to correspond with the imaging period of the matrix cameras . All the matrix cameras have essentially the same imaging period. The timing of the strobe-lighting unit and the matrix cameras is controlled centrally by the host unit. The lighting of a desired point is performed in such a way that first the host unit commands the matrix cameras to open their shutters. After that, with a small delay the host unit commands the strobe-lighting unit to illuminate the area to be imaged. After that, the shutters of the matrix cameras are closed and the data is read from the imaging element. When the data is being read, the real image-elements are combined to form the desired effective image-element.
In a third embodiment, the distance imaged by the device in the machine direction is 80 - 300 mm, preferably 100 - 250 mm. If the speed of the paper machine is constant, the imaging frequency is set to be such that all the areas of the web are imaged, so that they can be shown as a continuous, or substantially continuous image of the web. In other words, all the areas of the web are imaged, so that they can be processed as a continuous or substantially continuous image flow of the web. The device according to the invention is suitable for use in high-speed processes, in which in order to image the entire web 30 - 200 images are taken each second, the area being imaged being the aforesaid 100 - 250 mm. On a high-speed paper machine, in which the speed of the paper is, for example, 2100 m/rαin, and the area to be imaged is 200 mm, 175 images should be taken each second, in order to create a continuous image of the entire web. On a slower board machine, in which the speed of the board is, for example, 400 m/min, and the area to be image is 200 mm, 33 images should be taken each second.

Claims

1. Device for monitoring a web (10) , which device includes cameras imaging the web (10) in order to take digital images of the web from a transverse area of the web at the imaging frequency, and each camera includes an image element, which consists of pixels, and the individual pixels of the imaging element of the camera are real image-elements (30) , and the real image-elements (30) are arranged to combine to form effec- tive image-elements (32) of the web (10) in the machine direction, characterized in that the cameras used in the device are matrix cameras (16) , the imaging elements in which are arranged to be exposed simultaneously, and the real image-elements are arranged to be combined to form effective image-elements by exploiting the binning function of the matrix camera (16), and the device includes a strobe-lighting unit (14) , the synchronization of which is arranged in step with the exposure of the matrix cameras (16), the imaging periods being common to all the cameras , and the imaging frequency is arranged to be such that essentially all the areas of the web (10) are imaged.
2. Device according to Claim 1, characterized in that the pixels of the matrix camera (16), i.e. the real image-elements
(30) , are arranged to correspond essentially to a square area of the web, the length of the side of which area being less than 0,5 mm, preferably less than 0,3 mm.
3. Device according to Claim 1 or 2 , characterized in that the device includes processing means (21), a host unit (22), and a user interface (20) for controlling the processing means (21) and the host unit (22) .
4. Device according to any of Claims 1 - 3 , characterized in that the processing unit (21) belonging to the device is ar- ranged to perform the analysis of the images.
5. Device according to Claim 4, characterized in that the processing unit (21) is arranged to create thresholds for the values of the image pixels .
6. Device according to any of Claims 1 - 5, characterized in that the device includes 1 - 7 matrix cameras (16) per metre, preferably 2 - 5 matrix cameras (16) per metre, in the cross direction of the web.
7. Device according to any of Claims 1 - 3, characterized in that the device is arranged to take images at an imaging frequency, which is more than 30 images/s, preferably more than 100 images/s.
8. Device according to any of Claims 1 - 4, characterized in that the host unit (22) belonging to the device is arranged to control the timing of the strobe-lighting unit (14) and the matrix cameras (16).
9. Device according to any of Claims 1 - 5, characterized in that the distance imaged by the device in the machine direction of the web (10) is 80 - 300 mm, preferably 100 - 250 mm.
10. Device according to any of Claims 1 - 7, characterized in that the binning function of the matrix camera is used in such a way that the size of an effective image-element (32), in the cross direction of the web, is one real image-element (30) .
11. Device according to any of Claims 1 - 8, characterized in that the size of an effective image-element (32) , in the machine direction, is 2 - 10, preferably 2 - 5 real image-elements (30) .
12. Device according to any of Claims 1 - 8, characterized in that the matrix camera (16) is a CCD camera.
EP07704828.8A 2006-02-01 2007-02-01 Device for monitoring a web Active EP1984725B1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
FI20065078A FI119708B (en) 2006-02-01 2006-02-01 Device for checking a path
PCT/FI2007/050058 WO2007088250A1 (en) 2006-02-01 2007-02-01 Device for monitoring a web

Publications (3)

Publication Number Publication Date
EP1984725A1 true EP1984725A1 (en) 2008-10-29
EP1984725A4 EP1984725A4 (en) 2011-03-02
EP1984725B1 EP1984725B1 (en) 2013-08-14

Family

ID=35953677

Family Applications (1)

Application Number Title Priority Date Filing Date
EP07704828.8A Active EP1984725B1 (en) 2006-02-01 2007-02-01 Device for monitoring a web

Country Status (4)

Country Link
US (1) US8587650B2 (en)
EP (1) EP1984725B1 (en)
FI (1) FI119708B (en)
WO (1) WO2007088250A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102023003095B3 (en) 2023-07-28 2024-09-26 ZM - Technik GmbH Camera system for taking images of a fast moving surface

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FI121859B (en) * 2008-11-25 2011-05-13 Metso Automation Oy A method for controlling the repair of a web with a rolling machine and corresponding system
US9077961B1 (en) * 2013-02-05 2015-07-07 Lucasfilm Entertainment Company Ltd. Rolling shutter timing tester
JP6296864B2 (en) * 2014-03-31 2018-03-20 キヤノン株式会社 Image forming apparatus
FI128850B (en) * 2016-05-06 2021-01-29 Procemex Oy Ltd A machine vision method and system for monitoring manufacturing processes
FI128735B (en) * 2016-05-06 2020-11-13 Procemex Oy Ltd A machine vision method and system
DE102016220759A1 (en) 2016-10-21 2018-04-26 Texmag Gmbh Vertriebsgesellschaft Method and device for compensating a material web offset during material web inspection
DE102016220757A1 (en) 2016-10-21 2018-04-26 Texmag Gmbh Vertriebsgesellschaft Method and device for material web observation and material web inspection
CN112880563B (en) * 2021-01-22 2021-12-28 北京航空航天大学 Single-dimensional pixel combination mode equivalent narrow-area-array camera spatial position measuring method

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5899959A (en) * 1996-10-25 1999-05-04 International Paper Company Measurement of visual characteristics of paper

Family Cites Families (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US1616A (en) * 1840-05-25 Machine fob washing clothes
US5359525A (en) * 1990-05-01 1994-10-25 Kimberly-Clark Corporation Apparatus and method for registration control of assembled components
US5440648A (en) * 1991-11-19 1995-08-08 Dalsa, Inc. High speed defect detection apparatus having defect detection circuits mounted in the camera housing
US5668887A (en) 1992-05-29 1997-09-16 Eastman Kodak Company Coating density analyzer and method using non-synchronous TDI camera
US5305392A (en) * 1993-01-11 1994-04-19 Philip Morris Incorporated High speed, high resolution web inspection system
USH1616H (en) * 1994-05-31 1996-12-03 Minnesota Mining And Manufacturing Company Web inspection system having enhanced video signal preprocessing
JPH09145638A (en) * 1995-11-24 1997-06-06 Kawasaki Steel Corp Method and device for detecting surface defect
DE19611639A1 (en) 1996-03-25 1997-10-02 Deutsche Telekom Ag Paging and mailbox system
EP0816825A3 (en) * 1996-06-26 1998-08-12 Toshiba Engineering Corporation Method and apparatus for inspecting streak
DE19735156C1 (en) 1996-11-25 1999-04-29 Fraunhofer Ges Forschung Piezo-electrically operated micro valve
US5982452A (en) * 1997-03-27 1999-11-09 Dalhousie University Analog video merging system for merging N video signals from N video cameras
JP4230566B2 (en) * 1998-07-21 2009-02-25 東芝ソリューション株式会社 Defect integration processing apparatus and defect integration processing method
US6327374B1 (en) * 1999-02-18 2001-12-04 Thermo Radiometrie Oy Arrangement and method for inspection of surface quality
FI111192B (en) 2000-03-31 2003-06-13 Oseir Oy Method for Imaging Measurement, Imaging Measurement and Use of Measured Information in Process Control
US6531707B1 (en) * 2000-12-29 2003-03-11 Cognex Corporation Machine vision method for the inspection of a material for defects
FI115205B (en) * 2002-09-04 2005-03-31 Data Instmsto Oy Printing quality method and apparatus for on-line monitoring
US7030400B2 (en) * 2003-12-30 2006-04-18 Xerox Corporation Real-time web inspection method and apparatus using combined reflected and transmitted light images
EP1718954A4 (en) * 2004-01-22 2010-08-11 Wintriss Engineering Corp Illumination system for material inspection
US20050226466A1 (en) 2004-04-06 2005-10-13 Quad/Tech, Inc. Image acquisition assembly

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5899959A (en) * 1996-10-25 1999-05-04 International Paper Company Measurement of visual characteristics of paper

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of WO2007088250A1 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102023003095B3 (en) 2023-07-28 2024-09-26 ZM - Technik GmbH Camera system for taking images of a fast moving surface

Also Published As

Publication number Publication date
FI20065078A0 (en) 2006-02-01
US20100214416A1 (en) 2010-08-26
EP1984725A4 (en) 2011-03-02
WO2007088250A1 (en) 2007-08-09
EP1984725B1 (en) 2013-08-14
FI119708B (en) 2009-02-13
FI20065078A (en) 2007-08-02
US8587650B2 (en) 2013-11-19

Similar Documents

Publication Publication Date Title
US8587650B2 (en) Device for monitoring a web
US5696591A (en) Apparatus and method for detecting longitudinally oriented flaws in a moving web
US8212877B2 (en) Image capturing system, image capturing method, and computer program product at which an image is captured at a predetermined time
EP1584471B1 (en) Method and apparatus for visually insepecting a substrate on a printing press
WO2007042844A3 (en) Reflectance and illumination properties from varying illumination
WO2002065107A8 (en) Web inspection system
EP0884179A1 (en) Process for regulating operations carried out by a printing machine
EP1850269B1 (en) Scanning method and apparatus
CA2099912A1 (en) Watermark detection
FI127055B (en) System for monitoring a track and corresponding method for monitoring the track
CN201058521Y (en) Single lens image collecting device for reference alignement and detection
EP1543354B1 (en) Method and apparatus for visually inspecting a substrate on a printing press
US7039228B1 (en) System and method for three-dimensional surface inspection
JP2008134875A (en) Coin sortor
JP2008286646A (en) Surface flaw inspection device
DE102009001026A1 (en) Method and measuring device for the optical detection and evaluation of a fiber-containing web
JP2516606B2 (en) Print quality inspection device
KR100740250B1 (en) Vision inspection system and method for inspection using thereof
EP0437648B1 (en) Quality inspection method for a printed matter
Shankar et al. On-line defect detection in web offset printing
CN101162140A (en) Paper size feeler mechanism for image scanner
JP3716573B2 (en) Non-contact temperature distribution measuring device
Brown Latest developments in on-and off-line inspection of bank notes during production
JPH09330412A (en) Picture inspecting method and its device
JPH11987A (en) Method and apparatus for inspecting quality of printed matter

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20080826

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: METSO AUTOMATION OY

A4 Supplementary search report drawn up and despatched

Effective date: 20110127

DAX Request for extension of the european patent (deleted)
REG Reference to a national code

Ref country code: DE

Ref legal event code: R079

Ref document number: 602007032213

Country of ref document: DE

Free format text: PREVIOUS MAIN CLASS: G01N0021860000

Ipc: G01N0021890000

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

RIC1 Information provided on ipc code assigned before grant

Ipc: G01N 21/89 20060101AFI20130312BHEP

Ipc: G01N 21/86 20060101ALI20130312BHEP

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: METSO AUTOMATION OY

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

Ref country code: AT

Ref legal event code: REF

Ref document number: 627116

Country of ref document: AT

Kind code of ref document: T

Effective date: 20130815

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602007032213

Country of ref document: DE

Effective date: 20131010

REG Reference to a national code

Ref country code: SE

Ref legal event code: TRGR

REG Reference to a national code

Ref country code: NL

Ref legal event code: VDEP

Effective date: 20130814

Ref country code: AT

Ref legal event code: MK05

Ref document number: 627116

Country of ref document: AT

Kind code of ref document: T

Effective date: 20130814

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20131216

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130814

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130619

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130814

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20131214

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130814

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20131115

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130814

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130814

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130814

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130814

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130814

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130814

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130814

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130814

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130814

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130814

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130814

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130814

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130814

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20140515

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602007032213

Country of ref document: DE

Effective date: 20140515

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130814

Ref country code: LU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140201

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20140201

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20140228

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20140228

REG Reference to a national code

Ref country code: FR

Ref legal event code: ST

Effective date: 20141031

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20140228

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20140201

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20140201

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130814

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20070201

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130814

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20180219

Year of fee payment: 12

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 602007032213

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190903

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: SE

Payment date: 20240219

Year of fee payment: 18