WO2020254259A1 - Detection of deviations in packaging containers for liquid food - Google Patents
Detection of deviations in packaging containers for liquid food Download PDFInfo
- Publication number
- WO2020254259A1 WO2020254259A1 PCT/EP2020/066515 EP2020066515W WO2020254259A1 WO 2020254259 A1 WO2020254259 A1 WO 2020254259A1 EP 2020066515 W EP2020066515 W EP 2020066515W WO 2020254259 A1 WO2020254259 A1 WO 2020254259A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- current
- deviation
- basis functions
- packaging containers
- grading
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0004—Industrial image inspection
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
- G06F18/213—Feature extraction, e.g. by transforming the feature space; Summarisation; Mappings, e.g. subspace methods
- G06F18/2135—Feature extraction, e.g. by transforming the feature space; Summarisation; Mappings, e.g. subspace methods based on approximation criteria, e.g. principal component analysis
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/24—Classification techniques
- G06F18/241—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/77—Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
- G06V10/7715—Feature extraction, e.g. by transforming the feature space, e.g. multi-dimensional scaling [MDS]; Mappings, e.g. subspace methods
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10024—Color image
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20048—Transform domain processing
- G06T2207/20056—Discrete and fast Fourier transform, [DFT, FFT]
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20048—Transform domain processing
- G06T2207/20064—Wavelet transform [DWT]
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20076—Probabilistic image processing
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30108—Industrial image inspection
- G06T2207/30128—Food products
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V2201/00—Indexing scheme relating to image or video recognition or understanding
- G06V2201/06—Recognition of objects for industrial automation
Definitions
- the present disclosure generally relates to techniques for detection of deviations in packaging containers for liquid food, and in particular detection based on image data captured in a manufacturing plant during production of the packaging containers.
- Deviations in the produced packaging containers may lead to variations in the appearance of the packaging containers, e.g. inconsistencies that may cause concern from the consumer point-of-view, or cause sub-optimal performance, e.g. in terms of packaging container integrity or stability.
- One objective is to provide for automated detection and grading of deviations in packaging containers for liquid food.
- a further objective is to provide for detection of deviations of different deviation types in packaging containers for liquid food.
- a first aspect of the invention is a method a method of detecting deviations in packaging containers for liquid food in a manufacturing plant.
- the method comprises: obtaining image data of a packaging container, or a starting material for use in producing the packaging container; analyzing the image data for detection of a current deviation; processing the current deviation in relation to a set of basis functions, which is associated with a deviation type of the current deviation, to obtain a current set of weights that represent the current deviation; and determining a current grading of the current deviation based on the current set of weights.
- the first aspect provides a versatile and efficient technique that is well-suited for automated detection and grading of deviations in packaging containers for liquid food.
- the first aspect characterizes the detected deviations in terms of one or more weights of basis functions that are known to represent the deviation type of the detected deviations.
- basis functions makes the detection versatile, since different sets of basis functions may be determined for different deviation types. Further, the basis functions for a deviation type may be pre-computed based on reproductions of actual deviations, and the detection and grading may thus be tailored to an actual production environment.
- the computation of the current set of weights yields a corresponding set of weight values that provides a“fingerprint” of the current deviation and thereby enables the current deviation to be simply and reliably assigned a quality grading, for example by use of a known and predetermined relation between values of the weights and quality gradings.
- a quality grading for example by use of a known and predetermined relation between values of the weights and quality gradings.
- the method further comprises: mapping the current set of weights to a grading database that relates combinations of weights to gradings for the deviation type of the current deviation, wherein the current grading of the current deviation is determined based on said mapping.
- the processing further comprises : processing the current deviation for determination of the deviation type.
- the method further comprises: obtaining the set of basis functions from a basis function database as a function of the deviation type.
- the method further comprises: defining a current feature vector representing the current deviation; and computing the current set of weights as a function of the current feature vector and the set of basis functions.
- the computing the current set of weights comprises:
- the basis functions are linearly independent and/or mutually orthogonal.
- the basis functions correspond to principal components given by Principal Component Analysis, PCA.
- the method further comprises: determining a time stamp for the current deviation; determining, based on the time stamp, associated production parameters of the manufacturing plant, and correlating the time stamp, the current grading and the deviation type with the production parameters.
- the method further comprises: communicating control instructions to a machine in the manufacturing plant comprising modified production parameters according to the current grading and/or the deviation type.
- the method further comprises: causing an alert notification as a function of the current grading.
- the deviation type comprises any of: wrinkles in a material of the packaging containers or in the starting material, unsealed flaps of the packaging containers, torn or cloudy holes in the packaging containers or the starting material, dents or bumps in the packaging containers, delamination of the packaging containers or in the starting material, and flawed patterning and/or coloring and/or holographic or metallized film of a surface of the packaging containers or the starting material.
- a second aspect of the invention is a method for generating a set of basis functions associated with a deviation type for use in the method of the first aspect or any of its embodiments.
- the method of the second aspect method comprises:
- reproductions of packaging containers or a starting material for use in producing the packaging containers, said reproductions comprising deviations of said deviation type; processing the deviations by a basis function computation algorithm to obtain one or more basis functions; and generating the set of basis functions based on the one or more basis functions.
- a third aspect of the invention is a computer-readable medium comprising computer instructions which, when executed by a processor, cause the processor to perform the method of the first or second aspects or any embodiment thereof.
- a fourth aspect of the invention is a system for detecting deviations in packaging containers for liquid food produced in a manufacturing plant, the system comprising a processor configured to perform the method of the first or second aspects or any embodiment thereof.
- the system may further comprise at least one imaging device configured to capture and provide the image data.
- the processor may be included in a monitoring device and operatively connected to a communication interface which is configured for connection to the at least one imaging device.
- Fig. 1 is a schematic illustration of a system for detection of deviations in packaging containers.
- Fig. 2 is a top-down view of a packaging container having a deviation in the top- right corner.
- Fig. 3 is a flowchart of an example method for detection of deviations.
- Fig. 4 is a schematic illustration of a system for deviation detection when operative in a manufacturing plant.
- Fig. 5a shows an example of a set of basis functions for a specific deviation type
- Fig. 5b is a scatter plot of weight values determined for packaging containers having the specific deviation type and using two of the basis functions in Fig. 5a.
- Fig. 6 is a flowchart of an example method for generation of basis functions.
- Fig. 7 is functional block diagram of a system for generating basis functions.
- Fig. 8 is a block diagram of a device that may implement methods in
- the terms “a” and/or “an” shall mean “at least one” or “one or more”, even though the phrase “one or more” or “at least one” is also used herein.
- the word“comprise” or variations such as“comprises” or“comprising” is used in an inclusive sense, that is, to specify the presence of the stated features but not to preclude the presence or addition of further features in various embodiments.
- the term“and/or” comprises any and all combinations of one or more of the associated listed items. Further, a“set” of items is intended to imply the provision of one or more items.
- liquid food refers to any food product that is non-solid, semi liquid or pourable at room temperature, including beverages, such as fruit juices, wines, beers, sodas, as well as dairy products, sauces, oils, creams, custards, soups, etc, and also solid food products in a liquid, such as beans, fruits, tomatoes, stews, etc.
- packaging container refers to any container suitable for sealed containment of liquid food products, including but not limited to containers formed of packaging laminate, e.g. cellulose-based material, and containers made of or comprising plastic material.
- starting material refers to any base material that is processed to form part of a packaging container, including but not limited to sheet material of packaging laminate, closures (caps, lids, covers, plugs, foil, etc.) for closing the packaging container, labels for attachment to the sheet material or the packaging container.
- deformation is intended to generally designate any distortion of or deviation from an acceptable or ideal appearance of packaging containers.
- a deformation is not restricted to alterations of form or shape but also includes alterations in surface structure, surface patterning, surface coloring, etc.
- basis functions is used in its ordinary meaning and refers to linearly independent elements that span a function space so that every function in the function space can be represented as a linear combination of the basis functions.
- the basis functions may be represented as vectors, and the function space may be a vector space of any dimension.
- Like reference signs refer to like elements throughout.
- Fig. 1 a is a schematic illustration of a system 300 for detection of deviations in packaging containers 401 for liquid food produced in a manufacturing plant.
- the containers 401 are sealed to contain the liquid food and may be at least partly made of a laminated on non-laminated paperboard material or a plastic material.
- the containers 401 may be cartons or bottles, which are well-known in the art.
- the system 300 may be arranged to detect the deviations upstream, within or downstream of a machine 400 in the plant.
- the machine 400 may be a machine for feeding and/or manipulating a starting material for the container 401 or part thereof, a filling machine, a capping machine, an accumulator machine, a straw application machine, a secondary packaging machine, or any other type of packaging machine that is deployed in manufacturing plants for packaging of liquid food.
- the system 300 comprises a monitoring or inspection device 301 which is configured to detect and signal deviations occurring during production of the packaging containers 401 , and an imaging device 302 which is arranged and operated to capture image data of the containers 401 or the starting material, for use by the monitoring device 301 .
- the imaging device 302 may be arranged along any part of production line(s) in the manufacturing plant. It is also conceivable that a plurality of imaging devices 302 may be arranged to capture the image data from different parts of the production line(s) and/or from different angles in relation to the containers 401 , and/or with different exposure settings or image processing parameters.
- the image data may thus comprise multiple streams of image data captured from such a plurality of imaging devices 302.
- the image data may represent the external appearance of the containers 401 or the starting material, or part thereof.
- the imaging device 302 may be configured to capture images representing internal features of the containers 401 , e.g. one or more cross-sectional images.
- the image data may be one-dimensional, two-dimensional or three-dimensional and comprise any number of channels, e.g. a grayscale channel and/or any number of color channels.
- the system 300 may be deployed for quality monitoring, for example to indicate packaging containers and/or starting material to be discarded for lack of quality, or to sort packaging containers 401 according to different quality gradings.
- the system 300 may be deployed to provide input data for a control system of one or more machines 400 in the manufacturing plant.
- the input data may cause the control system to interrupt production in a machine or to reconfigure a machine by adjusting one or more of its current settings.
- Fig. 2 is an image of a packaging container 401 taken in top plan view by the imaging system 302.
- the container 401 has a deviation 403 in the top right corner, in this example a deformation in the form of a dent/bump.
- the monitoring device 301 is configured to process the image in Fig. 2 to determine a grading for the container in the image.
- One aspect of the present disclosure relates to a detection method, which may be implemented by the system 300 and comprises: obtaining image data of a packaging container, or a starting material for use in producing the packaging container; analyzing the image data for detection of a current deviation; processing the current deviation in relation to a set of basis functions, which is associated with a deviation type of the current deviation, to obtain a current set of weights that represent the current deviation; and determining a current grading of the current deviation based on the current set of weights.
- the detection method is deterministic and operates on pre computed basis functions for a specific type or class of deviations, denoted "deviation type" herein.
- the deviation type may be defined by a specific location on the container (or starting material) and/or a specific deformation, e.g. dents, wrinkles, unsealed flaps, torn or cloudy holes, delamination, flawed color and/or pattern of a surface, a flaw in a holographic or metallized film attached to or otherwise included on a surface, imperfect embossing or folding, etc.
- the deviation type may be a specific deformation, irrespective of location.
- the deviation type may be any deformation at a specific location. Many variants are conceivable and readily appreciated by the person skilled in the art.
- the set of basis functions may have been pre-computed by use of any suitable basis function computation algorithm that renders linearly independent basis functions based on feature vectors representing the deviation type in a plurality of containers (or items of starting material).
- suitable basis function computation algorithms include, without limitation, Principal Component Analysis (PCA), Independent Component Analysis (ICA), Wavelet analysis, Non-negative Matrix Factorization (NMF), Fourier analysis, Autoregression analysis, Factor Analysis, Common Spatial Pattern (CSP), Canonical Correlation Analysis (CCA), etc.
- PCA Principal Component Analysis
- ICA Independent Component Analysis
- NMF Non-negative Matrix Factorization
- CSP Common Spatial Pattern
- CCA Canonical Correlation Analysis
- Such computation algorithms define a model function for observations in terms a set of basis functions.
- X ⁇ (wi -f ⁇ ), where X is an observation, f ⁇ is a respective basis function, and wi is a respective weight or basis function coefficient.
- the basis functions are linearly independent.
- some computation algorithms may also impose orthogonality among the basis functions.
- PCA is a statistical procedure that uses a transformation to convert a set of observations of correlated variables into a set of values of linearly uncorrelated basis functions called "principal components".
- the number of principal components is less than or equal to the number of original variables.
- PCA results in a number of principal components for the set of observations and a variance for each principal component.
- the variance is or corresponds to the above-mentioned weight for the respective basis function.
- the detection method will now be exemplified with reference to the flow chart in Fig. 3 and an exemplifying monitoring system in FIG. 4.
- the monitoring system comprises an imaging system 302 which is arranged to capture images of containers 401 and/or starting material 401 ' (illustrated as a sheet of packaging material) in a manufacturing plant.
- the monitoring device 301 comprises a deviation detector 40, a weight generator 41 and a grader 42.
- the monitoring device 301 is arranged to access a first database 43 which stores a pre-computed dictionary of basis functions, and a second database 44 which stores grading data.
- the databases 43, 44 may be part of the monitoring device 301 , as shown, or located on one or more external devices and accessed by the monitoring device 301 over a wired or wireless connection.
- the illustrated detection method 30 comprises a step 31 of obtaining current image data of one or more containers 401 or the starting material 401 '.
- the current image data may be exemplified by the image lc in Fig. 4, which depicts a container 401 with a deviation 403.
- Step 32 analyzes the current image data lc for detection of a current deviation.
- step 32 compares the current image data lc, or a selected subset thereof, to a reference image of a deviation-free container or starting material to detect presence of a current deviation.
- step 32 extracts values of one of more characterizing parameters from the current image data and compares the values to one or more reference values to detect the presence of a current deviation. If no deviation is detected by step 32 the method 30 will return to step 31.
- steps 31 and 32 may be performed by the deviation detector 40.
- Step 33 may compute any number of weights, including a single weight.
- the current deviation data is determined in the same format as the observations that were used for determining the set of predefined basis functions.
- the current deviation data represents the current deviation by a plurality of numeric values that are extracted from the current image data lc.
- the current deviation data may thus be denoted a current "feature vector" of one or more dimensions.
- the feature vector represents the geometry of the deviation, e.g. its shape and/or topography.
- topography is the distribution of height values in relation to a geometric reference, e.g. a two-dimensional geometric plane.
- the topography may designate the variations in height perpendicular to a geometric plane parallel to the top surface of the container 401.
- the topography may be represented as height values along a line, e.g. along a deviation, such as a wrinkle, or along a predefined reference line.
- the topography may be represented as a 2D distribution of height values.
- the feature vector may define the curvature at different locations within the deviation, e.g. along a line or in two dimensions. Any suitable definition of curvature may be used, including conventional measures of intrinsic and external curvature in two or three dimensions.
- the feature vector may represent a computed difference, in one or more dimensions, between the image data and a reference template that corresponds to a container (or starting material) without the deviation. It is also conceivable that the feature vector comprises a combination of different metrics, e.g. any of the foregoing.
- step 33 determines projections of the current feature vector onto the set of basis functions, and determines the current set of weights based on scalar values of the projections.
- the respective weight may be computed as a dot product (scalar product) between the feature vector and the respective basis function.
- step 33 may be performed by the weight generator 41 and the set of basis functions may be retrieved from the first database 43.
- the current set of weights that is computed by the weight generator 41 for the current image data lc is designated by [W]c.
- step 33 may process the current deviation to assign the current deviation to one of a number of predefined deviation types, and retrieve a corresponding set of basis functions for the current deviation type, e.g. from the first database 43.
- the first database 43 may store different sets of basis functions, designated by [BF]i, for different deviation types, designated by TYPEi.
- step 33 may involve determining a current deviation type TYPEc for the current deviation, and accessing the first database 43 to retrieve a current set of basis functions, [BF]c, associated with the current deviation type, TYPEc.
- Step 34 maps the set of weights computed by step 33 to grading data in a grading database.
- the grading database may store grading data for each deviation type.
- the grading data associates values of one or more weights with a grading.
- the grading data may define a "weight space" and associate different regions in the weight space with a respective grading, where each weight in the set of weights define a dimension of the weight space. For example, if the set of weights comprises four weights, the weight space has four dimensions and the above-mentioned regions are defined in the four-dimensional weight space.
- Step 35 determines a current grading or ranking of the current deviation based on the mapping in step 34.
- the grading may indicate the magnitude (severity) of the current deviation for the appearance and/or function of the packaging container 401.
- the grading may be assigned in any number of gradings, levels or ranks. In one non-limiting example, the grading is binary and may designate the packaging container as being either acceptable or non-acceptable.
- steps 34-35 may be performed by the grader 42, and the grading database corresponds to the second database 44, in which the above- mentioned regions are designated by [W]i, the respective associated grading is designated by Gi, and the current grading is designated by Gc.
- Fig. 5a illustrates a set of basis functions, [BF], that has been pre-computed for a specific deviation type by operating a PCA algorithm on feature vectors derived from image data of a large number of containers with deviations 403 of a specific deviation type.
- the basis functions BF1 -BF4 are principal components produced by the PCA algorithm.
- the feature vectors and the basis functions are one-dimensional and represent curvature at points along a line in the image data.
- Fig. 5b illustrates a weight space determined for basis functions BF1 and BF2 in FIG. 5a. The weight space is thus defined by a weight W1 for BF1 , and a weight W2 for BF2.
- Fig. 5b is calculated for a deviation of an individual container as detected in image data.
- Fig. 5b also indicates grading regions in the weight space, where the different grading regions are assigned a respective grading ll-V, where the magnitude of the deviation decreases from II to V.
- the grading has been determined by ocular inspection and manual grading of the deviation of the containers corresponding to the points in Fig. 5b. In this particular example, it is possible to assign a grading to the respective container based on the weights W1 , W2.
- Fig. 5b also indicates grading regions in the weight space, where the different grading regions are assigned a respective grading ll-V, where the magnitude of the deviation decreases from II to V.
- the grading has been determined by ocular inspection and manual grading of the deviation of the containers corresponding to the points in Fig. 5b. In this particular example, it is possible to assign a grading to the respective container based on the weights W
- the cross 403' illustrates the result of a mapping by step 34 of a current deviation to the weight space, where the current deviation has been detected by step 32 and has been assigned current values of the weights W1 , W2 by step 33.
- step 35 may assign grading IV to the current deviation.
- basis functions gives great freedom in adapting the method 30 to grade deviations of different deviation types.
- different definitions of the feature vector may be tested, e.g. by computing a respective scatter plot of the type shown in Fig. 5b, to achieve a desired accuracy and specificity in the grading.
- the method 30 may further comprise a step 36 of providing feedback to an operator and/or a control system in the manufacturing plant.
- step 36 signals that the current container 401 or starting material 401 ' should be discarded.
- step 36 generates an alert notification indicative of a production error, and optionally causes one or more machines to be stopped. The alert notification may depend on and/or be indicative of the current grading and/or the deviation type.
- step 36 causes or facilitates a reconfiguration of one or more machines in the manufacturing plant.
- step 36 comprises a sub-step of determining a time stamp for the current deviation.
- this sub-step may be performed only if the current grading exceeds a grading limit.
- the time stamp may be given with reference to a master clock within the manufacturing plant.
- Step 36 may further comprise a sub-step of determining, based on the time stamp, associated production parameters of the manufacturing plant. Accordingly, when the current deviation is detected and the associated time stamp is defined, step 36 is configured to obtain production data comprising parameters of the production process at or before the time stamp.
- the production data may be obtained from a control system in the manufacturing plant.
- the production parameters may comprise any parameter associated with the chain of the production of the packaging containers 401 , such as settings and/or sensor data in one or more machines, and/or properties of the starting material 401 ' or the liquid food to be sealed therein.
- Step 36 may comprise a further sub-step of correlating the time stamp, the current grading and the deviation type with the production parameters. By this correlation, step 36 is capable of accurately characterizing the origin and circumstances of the formation of the current deviation. This allows facilitated optimization of the production line and provides a reliable tool for deviation detection.
- step 36 may further communicate control instructions to a machine in the production plant comprising modified production parameters according to the current grading and/or the deviation type.
- Step 61 obtains a plurality of reproductions of containers 401 , or a starting material 401 ' for use in producing the containers 401.
- the reproductions comprise deviations of the specific deviation type and may be in the form of image data, e.g. as indicated by [I] in Fig. 7.
- the reproductions preferably depict containers with deviations of different magnitude.
- Step 62 processes the deviations in the reproductions by a basis function computation algorithm to compute basis functions, e.g. the basis functions BF1 -BF4 as exemplified in Fig. 5a.
- Step 63 generates the pre defined set of basis functions, [BF], to be used by the detection method 30.
- step 63 may involve selecting a subset of the basis functions generated by step 62, scaling the basis functions, etc.
- the generation method 60 may be performed by a dedicated basis function computing device 70, which is configured to store the set of basis functions, [BF], in the first database 43.
- the computing device 70 may execute the generation method 60 for different deviation types, and store a respective set of base functions, [BF]i, in association with the deviation type, TYPEi, in the first database 43.
- Fig. 8 is a block diagram of an example structure of the monitoring device 301 of Figs 1 and 4 or the computing device 70 of Fig. 7.
- the device 301/70 comprises a processing system 80 and a memory 81 .
- the processing system 80 may include any commercially available processing device, such as a CPU, DSP, GPU, microprocessor, ASIC, FPGA, or other electronic programmable logic device, or any combination thereof.
- the processing system 80 may be configured to read executable computer program instructions 81 A from the memory 81 and execute these instructions to control the operation of the device 301/70, e.g. to perform any of the methods described herein.
- the program instructions 81 A may be provided to the device 301/70 on a computer-readable medium 85, which may be a tangible (non- transitory) product (e.g. magnetic medium, optical disk, read-only memory, flash memory, etc.) or a transitory product, such as a propagating signal.
- the memory 81 may be, for example, one or more of a buffer, a flash memory, a hard drive, a removable media, a volatile memory, a non-volatile memory, a random access memory (RAM), or other suitable device. As indicated in Fib. 8, the memory 81 may also store data 81 B for use by the processing system 80, e.g. the first and second databases 43, 44.
- the device 301/70 further comprises one or more communication interfaces 82 for operatively connecting the device 30/701 to an external device by wire or wirelessly, e.g. to access the first database 43 and/or the second database 44, to receive the image data from the imaging device(s) 302, to provide the alert notification and/or control instructions, etc.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Multimedia (AREA)
- Evolutionary Computation (AREA)
- Artificial Intelligence (AREA)
- Data Mining & Analysis (AREA)
- Quality & Reliability (AREA)
- Medical Informatics (AREA)
- Health & Medical Sciences (AREA)
- Databases & Information Systems (AREA)
- Software Systems (AREA)
- Computing Systems (AREA)
- General Health & Medical Sciences (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Bioinformatics & Computational Biology (AREA)
- Evolutionary Biology (AREA)
- General Engineering & Computer Science (AREA)
- Life Sciences & Earth Sciences (AREA)
- General Factory Administration (AREA)
- Investigating Materials By The Use Of Optical Means Adapted For Particular Applications (AREA)
- Image Analysis (AREA)
Abstract
Description
Claims
Priority Applications (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2021575224A JP7518102B2 (en) | 2019-06-18 | 2020-06-15 | Detection of deviations in packaging containers for liquid foods |
| CN202080043115.2A CN114008667B (en) | 2019-06-18 | 2020-06-15 | Detecting deviations in packaging containers for liquid foods |
| US17/616,342 US12045971B2 (en) | 2019-06-18 | 2020-06-15 | Detection of deviations in packaging containers for liquid food |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| EP19180967.2 | 2019-06-18 | ||
| EP19180967 | 2019-06-18 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2020254259A1 true WO2020254259A1 (en) | 2020-12-24 |
Family
ID=66999568
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/EP2020/066515 Ceased WO2020254259A1 (en) | 2019-06-18 | 2020-06-15 | Detection of deviations in packaging containers for liquid food |
Country Status (6)
| Country | Link |
|---|---|
| US (1) | US12045971B2 (en) |
| EP (1) | EP3754602B1 (en) |
| JP (1) | JP7518102B2 (en) |
| CN (1) | CN114008667B (en) |
| ES (1) | ES3048300T3 (en) |
| WO (1) | WO2020254259A1 (en) |
Family Cites Families (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6751354B2 (en) * | 1999-03-11 | 2004-06-15 | Fuji Xerox Co., Ltd | Methods and apparatuses for video segmentation, classification, and retrieval using image class statistical models |
| KR100868884B1 (en) | 2007-06-20 | 2008-11-14 | 삼성코닝정밀유리 주식회사 | Glass Substrate Glass Defect Information System and Classification Method |
| US8725667B2 (en) * | 2008-03-08 | 2014-05-13 | Tokyo Electron Limited | Method and system for detection of tool performance degradation and mismatch |
| JP5505818B2 (en) * | 2010-06-14 | 2014-05-28 | 新日鐵住金株式会社 | Defect determination device |
| EP2520992B1 (en) | 2011-05-02 | 2014-04-16 | Autoform Engineering GmbH | Method and computer system for characterizing a sheet metal part |
| US8688862B1 (en) * | 2012-11-07 | 2014-04-01 | General Electric Company | Systems and methods for monitoring input signal parameters |
| CN103323526A (en) | 2013-05-30 | 2013-09-25 | 哈尔滨工业大学 | Welding line defect detection and identification method based on ultrasonic phased array and support vector machine |
| WO2015049087A1 (en) * | 2013-10-02 | 2015-04-09 | Asml Netherlands B.V. | Methods & apparatus for obtaining diagnostic information relating to an industrial process |
| US10062156B2 (en) * | 2016-02-25 | 2018-08-28 | Kla-Tencor Corporation | Method and system for detecting defects on a substrate |
| CN106600059B (en) * | 2016-12-13 | 2020-07-24 | 北京邮电大学 | Short-term load forecasting method for smart grid based on improved RBF neural network |
| GB201704373D0 (en) * | 2017-03-20 | 2017-05-03 | Rolls-Royce Ltd | Surface defect detection |
| JP2019040431A (en) | 2017-08-25 | 2019-03-14 | 三菱重工業株式会社 | Abnormality determination system, abnormality determination method, program, learnt model, and learnt model production method |
-
2020
- 2020-06-15 WO PCT/EP2020/066515 patent/WO2020254259A1/en not_active Ceased
- 2020-06-15 EP EP20180077.8A patent/EP3754602B1/en active Active
- 2020-06-15 JP JP2021575224A patent/JP7518102B2/en active Active
- 2020-06-15 CN CN202080043115.2A patent/CN114008667B/en active Active
- 2020-06-15 US US17/616,342 patent/US12045971B2/en active Active
- 2020-06-15 ES ES20180077T patent/ES3048300T3/en active Active
Non-Patent Citations (2)
| Title |
|---|
| LE TAN-TOAN ET AL: "Inspection of specular surfaces using optimized M-channel wavelets", ICASSP, IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING - PROCEEDINGS 1999 IEEE, IEEE, 26 May 2013 (2013-05-26), pages 2405 - 2409, XP032509323, ISSN: 1520-6149, ISBN: 978-0-7803-5041-0, [retrieved on 20131018], DOI: 10.1109/ICASSP.2013.6638086 * |
| LUIZ A O MARTINS ET AL: "Automatic detection of surface defects on rolled steel using Computer Vision and Artificial Neural Networks", IECON 2010 - 36TH ANNUAL CONFERENCE ON IEEE INDUSTRIAL ELECTRONICS SOCIETY, IEEE, PISCATAWAY, NJ, USA, 7 November 2010 (2010-11-07), pages 1081 - 1086, XP031840573, ISBN: 978-1-4244-5225-5, DOI: 10.1109/IECON.2010.5675519 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114008667A (en) | 2022-02-01 |
| EP3754602A1 (en) | 2020-12-23 |
| JP7518102B2 (en) | 2024-07-17 |
| US12045971B2 (en) | 2024-07-23 |
| CN114008667B (en) | 2025-09-19 |
| US20220327683A1 (en) | 2022-10-13 |
| ES3048300T3 (en) | 2025-12-09 |
| EP3754602B1 (en) | 2025-07-30 |
| JP2022537193A (en) | 2022-08-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11373290B1 (en) | Detection of deviations in packaging containers for liquid food | |
| USRE47557E1 (en) | Method and computer system for characterizing a sheet metal part | |
| US11100630B2 (en) | Method of defect detection in packaging containers | |
| US10343803B2 (en) | Methods and apparatuses for guided quality control of a packaging system | |
| JP7732969B2 (en) | Condition monitoring of a packaging machine for liquid foods | |
| US12045971B2 (en) | Detection of deviations in packaging containers for liquid food | |
| JP7748449B2 (en) | Condition monitoring of cutting units in food packaging machines | |
| EP3397562B1 (en) | Methods and apparatuses for packaging quality assurance | |
| CN116883404B (en) | A label fitting effect detection method for food production and packaging | |
| KR102218508B1 (en) | Method for checking the quality of blanks, in particular blanks to be processed in packaging material, and quality inspection system | |
| US11217038B2 (en) | System and method for detection of deviations in packaging containers | |
| Suppitaksakul et al. | Machine vision system for counting the number of corrugated cardboard | |
| CN114841998A (en) | Artificial intelligence-based packaging printing abnormity monitoring method | |
| Tosin et al. | Smart Control for Crease and Cutter Process of Package Through Computer Vision | |
| Hou et al. | Tool flank wear recognition based on the variation of milling force vector in end milling |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 20731512 Country of ref document: EP Kind code of ref document: A1 |
|
| ENP | Entry into the national phase |
Ref document number: 2021575224 Country of ref document: JP Kind code of ref document: A |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 20731512 Country of ref document: EP Kind code of ref document: A1 |
|
| WWG | Wipo information: grant in national office |
Ref document number: 202080043115.2 Country of ref document: CN |