EP3835017B1 - Slice classification system and method, for a food slicer machine - Google Patents

Slice classification system and method, for a food slicer machine Download PDF

Info

Publication number
EP3835017B1
EP3835017B1 EP19383114.6A EP19383114A EP3835017B1 EP 3835017 B1 EP3835017 B1 EP 3835017B1 EP 19383114 A EP19383114 A EP 19383114A EP 3835017 B1 EP3835017 B1 EP 3835017B1
Authority
EP
European Patent Office
Prior art keywords
images
slices
area
region
classification
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP19383114.6A
Other languages
German (de)
French (fr)
Other versions
EP3835017A1 (en
Inventor
Emilio DE LA RED BELLVIS
Iván CALLEN BARCELONA
Daniel ARTAL GONZÁLEZ
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Inndeo Proyectos Industriales SL
Original Assignee
Inndeo Proyectos Industriales SL
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Inndeo Proyectos Industriales SL filed Critical Inndeo Proyectos Industriales SL
Priority to ES19383114T priority Critical patent/ES2956779T3/en
Priority to EP19383114.6A priority patent/EP3835017B1/en
Publication of EP3835017A1 publication Critical patent/EP3835017A1/en
Application granted granted Critical
Publication of EP3835017B1 publication Critical patent/EP3835017B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B26HAND CUTTING TOOLS; CUTTING; SEVERING
    • B26DCUTTING; DETAILS COMMON TO MACHINES FOR PERFORATING, PUNCHING, CUTTING-OUT, STAMPING-OUT OR SEVERING
    • B26D5/00Arrangements for operating and controlling machines or devices for cutting, cutting-out, stamping-out, punching, perforating, or severing by means other than cutting
    • B26D5/007Control means comprising cameras, vision or image processing systems
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B26HAND CUTTING TOOLS; CUTTING; SEVERING
    • B26DCUTTING; DETAILS COMMON TO MACHINES FOR PERFORATING, PUNCHING, CUTTING-OUT, STAMPING-OUT OR SEVERING
    • B26D7/00Details of apparatus for cutting, cutting-out, stamping-out, punching, perforating, or severing by means other than cutting
    • B26D7/27Means for performing other operations combined with cutting
    • B26D7/32Means for performing other operations combined with cutting for conveying or stacking cut product
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B26HAND CUTTING TOOLS; CUTTING; SEVERING
    • B26DCUTTING; DETAILS COMMON TO MACHINES FOR PERFORATING, PUNCHING, CUTTING-OUT, STAMPING-OUT OR SEVERING
    • B26D7/00Details of apparatus for cutting, cutting-out, stamping-out, punching, perforating, or severing by means other than cutting
    • B26D7/27Means for performing other operations combined with cutting
    • B26D7/32Means for performing other operations combined with cutting for conveying or stacking cut product
    • B26D7/325Means for performing other operations combined with cutting for conveying or stacking cut product stacking the cut product individually separated by separator elements
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B26HAND CUTTING TOOLS; CUTTING; SEVERING
    • B26DCUTTING; DETAILS COMMON TO MACHINES FOR PERFORATING, PUNCHING, CUTTING-OUT, STAMPING-OUT OR SEVERING
    • B26D2210/00Machines or methods used for cutting special materials
    • B26D2210/02Machines or methods used for cutting special materials for cutting food products, e.g. food slicers

Definitions

  • the present invention belongs to the technical field of food processing.
  • this invention relates to a system and a method for a food slicer machine, which are capable of classifying the slices of food by capturing and processing digital matrix images, taken at high speed during the process of cutting the food into slices. Thanks to said image classification, the system and the method of the invention enable possible quality failures to be detected in the slices obtained, prior to the packaging thereof.
  • system and the method according to the present invention enable the slices of food to be classified according to different preconfigurable quality parameters.
  • These machines are intended to slice foods (for example and without limitation: cheeses, sausages, or ham) which initially have an elongated shape, usually a shape similar to a bar, in order to obtain slices thereof.
  • Each set of slices is grouped vertically in a portion in the shape of a stack of products, which is subsequently carried by a conveyor belt.
  • Said belt can tilt in different positions in order to direct them to different lines.
  • One of the positions usually enables distinguishing the set of slices if it has an excess or lack of weight, rejecting the portion of slices.
  • a plastic sheet can also be arranged, also known as “interleaver”, intended to separate said pair of slices and prevent them from sticking together.
  • Cutting devices of this type are disclosed, for example, in US 5 129 298A or in DE 199 06 021 A1 .
  • the slices obtained by cutting the foods "in bars” do not meet the quality requirements required for them to be sold.
  • the most common defects that slices usually have in these types of foods are: the presence of contaminants (for example, blood, rust or bones in the ham), the deformation of some region of the product (for example, excess subcutaneous or central fat in the ham), the lack of interleaver (or breakage thereof), or breakage of the slices.
  • the slicer machines currently used on an industrial scale work at high cutting speeds, in the order of 900-2000 cuts/minute. This fact makes it difficult for computer vision equipment to be able to take at least one image of each of the slices created, and this in turn significantly complicates the possibility to classify said images in a time frame compatible with the processing speed of the food.
  • Document EP 0 449 512 A1 discloses A slice classification system for a food slicer machine, said slicer machine comprising: a feeder mechanism configured to carry food to a cutting region; a cutting region wherein a cutting blade is provided, configured to cut the food into slices; a conveyor belt configured to transport slices of food, from a first area adjacent to the cutting region, to a second area spaced away from the cutting region; classification means for slices adjacent to the second area so that in case of a lean/ fat ration being unacceptable a commercially unacceptable slice or a portion containing an unacceptable slice may be diverted, said means being provided with image capture means, configured to capture a sequence of digital images from a viewing area located inside the cutting region and transmit said sequence of digital images to processing means, as the image data is periodically sampled, to update the Grey Level thresholds; processing means, configured to analyse at least one predetermined control area of each image of the sequence of images to compare at least one region of interest of the preferred images with at least one reference pattern and to classify the preferred images according to said comparison with the reference
  • the present invention aims to solve the difficulties and disadvantages of the prior art, indicated above.
  • a first object of the invention relates to a slice classification system for a food slicer machine, said slicer machine comprising:
  • the present invention enables, in spite of the high cutting speeds of the commonly used slicer machines, all the slices making up the formed stacks of slices to be analysed before they are packaged. This represents a significant improvement in the detection of possible defects, with respect to the prior art.
  • the image capture means exclusively take images of a viewing area of the camera included inside the cutting region, inside of which there is a final end of the food which will be cut into a slice. Also, inside the viewing area, one or several control regions are established, which enable the position of the cutting blade and one or several regions of interest to be detected, which enable the quality of the slicing to be examined.
  • the processing means when analysing said control regions, preferably by means of computer vision algorithms, are able to select the specific images (or frames) from the complete sequence of images wherein the regions of interest can be processed, since they are not hidden (either by the cutting blade, or by an interleaver).
  • the images thereby selected are precisely called “preferred images” and each one shows one of the slices obtained by the slicer machine.
  • the hue of the pixels of said control area is compared with at least one predetermined chromatic hue, corresponding to the colour of the cutting blade and/or the colour of the separating sheet (or interleaver). Since both the cutting blade and the interleaver have a colour that is notably different from the colour of the food, thanks to said comparison it is possible to determine the presence of the cutting blade and/or the interleaver and choose as preferred images those wherein none of these elements are present.
  • each preferred image is only carried out in those image portions corresponding to the region or regions of interest, reducing the load of computing operations and the volume of data used by the processing means.
  • This enables the preferred images to be processed quickly and enables the slices shown in said images to be classified (as acceptable slices or slices with defects) and enables decisions to be made online (accepting or rejecting the stack wherein said slice is located), in other words, making decisions before the stack of slices reaches the classification means.
  • the present invention enables deciding whether a stack of slices meets the quality requirements and therefore continues to the packaging line, or, on the other hand, if the presence of a defect is detected, ordering the rejection thereof by sending a corresponding instruction to the actuation means of the classification means.
  • the slice classification system according to the present invention is independent of the cutting machine, being able to be coupled to any type of new or already-existing slicer machine. To do so, the shape and size of the image capture means can be adapted to the geometry of the slicer machine.
  • At least one control region is preferably located in the highest portion, or in the lowest portion, of the viewing area (meaning, in the vicinity of the upper edge or the lower edge of the viewing area, that which is determined by the size of the slice with a margin on the perimeter thereof of at least two centimetres). These specific positions are preferred because they can more easily detect the position of the cutting blade with respect to the slice, as well as the presence and position of the interleaver.
  • the processing means preferably processes the region (or regions) of interest of the selected images, also called preferred images, transforming them into a predetermined colour model.
  • the processing means quantify the pixels of at least one predetermined hue which are present in the region of interest of the preferred images, grouping them into portions with a predetermined hue and analysing the outline and surface of said portions. Subsequently, the processing means compare the outline and surface of said portions with a predetermined hue, comparing them with the reference patterns. This enables the processing means to classify said regions of interest, determining by means of simple comparisons if they meet the necessary requirements. For example, if a feature of the food can be inscribed with a circumference having a certain diameter, or if a possible defect can be circumscribed in a circle having a certain diameter or if a percentage of a certain hue of the pixels contained in a region is exceeded.
  • the reference patterns can be, for example and without limitation, reference patterns for shape, size and hue.
  • the present invention it is also possible to determine whether or not the slice has been cut, since the slicer machine stops cutting between one portion of the stack of slices and another. This makes it possible to count the number of slices in each stack, which in turn enables the initial and final cut of the bar of food to be determined, since a smaller number of slices is cut than that of the stack in both cases.
  • the present invention also enables certain regions to be discriminated according to the shape thereof, such that areas that are not of interest can be removed from the comparison in order to determine whether or not a product has the quality necessary.
  • the image capture means comprise a digital camera with a speed for recording sequences of images that is greater than 120 frames per second.
  • Said digital camera is preferably far from the cutting area in order to avoid splashing due to waste projected from the cutting, although the lens of said camera focuses on the viewing area.
  • the image capture means preferably comprise an elongated lighting device, arranged parallel to a cutting edge and provided with a semi-diffusion filter. Said semi-diffusion filter reduces the appearance of glare in the slices being cut.
  • the image capture means are also preferably provided with a protective casing equipped with an elastomeric sealing gasket, fastened by means of mechanical fasteners. These mechanical fasteners enable the easy opening thereof for maintenance operations and in turn guarantee the seal during the cleaning operations with pressurised hot water.
  • the image capture means may be provided with a communication cable connected to the processing means by which they transmit the sequence of digital images.
  • the processing means may be provided with a computer.
  • Said computer is preferably located in a control cabinet, far from the cutting area in order to avoid splashing.
  • the classification instructions can be control signals from a PLC (Programmable Logic Controller).
  • the actuation means may comprise at least one pneumatic solenoid valve which can be actuated by means of control signals from a PCL.
  • the slice classification system according to the present invention is preferably provided with a monitor configured to show images of the sequence of images captured by the image capture means.
  • the images shown may be images of the defects detected.
  • the slice classification system according to the present invention is preferably provided with a touch interface.
  • Said touch interface may preferably enable, among other functions, parameters to be set for the operation of the processing means and/or it may enable the historical record of classified stacks to be consulted.
  • a second aspect of the invention relates to a method for classifying slices of food cut by a slicer machine, said slicer machine comprising:
  • any technical feature explained in relation to a slice classification system according to the first aspect of the present invention is also fully applicable to a slice classification method according to the second aspect of the present invention.
  • Figure 1 shows a schematic representation of a cutting device according to the invention.
  • the device for cutting food (10), such as, for example, sausage, ham or cheese, has a product feeder mechanism with a product seat, which is open towards a cutting region (13).
  • the product (10) to be cut is located in the food feeder mechanism on the seat surface and in contact with a tightening roller (24). Said food (10) can be led to the cutting region (13) with the help of an advancing mechanism (not shown), which acts on the rear end of the product.
  • slices (11) of product (10) are separated in a rapid sequence with the help of a cutting blade (20), for example, a rotating blade, which are stacked in a portion of a stack of slices (25) as the conveyor belt (16) advances.
  • a cutting blade (20) for example, a rotating blade
  • the separated product slices (25) are withdrawn separately or in portions by means of an endless belt (16) outside the cutting region (13). Between the withdrawal mechanism (16) and the cutting edge (14), there is a withdrawal belt (15), responsible for rejecting the initial and final ends of the bar of product, which are led to a tank.
  • means (1) for capturing the images at a high speed have been arranged above the cutting edge (14).
  • Said capture means (1) are used to obtain images of the viewing area (22) focused on the cutting area (13) of the product with the aim of being able to determine whether the slices have any quality defects.
  • the images captured at high speed by the means (1) are transmitted by a communication cable to processing means, which in this embodiment of the invention include a computer (8) located in the control cabinet (18), which processes the images received by means of computer vision software which uses the image classification method claimed in this patent, determining whether the slice (11) has a quality defect, communicating, if affirmative, a signal to actuation means, which in this embodiment of the invention include a PLC (9) in order to remove the portions (26) of product actuating once it reaches the classification means, which in this embodiment of the invention, include a tilting classifying belt (17).
  • processing means which in this embodiment of the invention include a computer (8) located in the control cabinet (18), which processes the images received by means of computer vision software which uses the image classification method claimed in this patent, determining whether the slice (11) has a quality defect, communicating, if affirmative, a signal to actuation means, which in this embodiment of the invention include a PLC (9) in order to remove the portions (26) of product actuating once it reaches the classification means
  • a monitor (19) is further provided wherein a control panel is displayed on which the images that are being captured by the image capture means (1) are displayed, in addition to counters which show operating parameters of the equipment, as well as quality failures detected in the stacks (25) of slices.
  • Figure 2 shows a schematic representation of the viewing area of the device.
  • the viewing area (22) of the camera is contained in the cutting region (13), and inside of it the slice (11), the lower cutting edge (14) and the tightening roller (24) are located (not visible in Fig. 2 ).
  • the processing means are processed in the processing means by computer vision algorithms with the aim of detecting the position of the cutting blade (20) and the interleaver with respect to the slice (11) and being able to determine the precise moment at which to process the region of interest (23) by means of computer vision algorithms with which a classification is performed based on the quality thereof.
  • Figures 3A-3C show sequences of images of slicing wherein they illustrate, among other aspects of the invention, how the cut or uncut state of a slice is detected by means of the processing of the different control regions.
  • Fig. 3A shows a sequence of images taken during the process of cutting a slice of food.
  • the space shown in said images corresponds to the viewing area (22).
  • the pixels corresponding to four different control areas designated with the numerical reference (21) are processed.
  • the images of the areas of said control areas (21) are shown in green, the presence of the interleaver is evaluated. It is possible to detect the presence of the interleaver because, since it is translucent, if said interleaver is present it modifies the colour of the region. If the occupation of the blade is not detected, according to a method similar to that for detecting the interleaver, in the entirety of the lower cutting region, a slice is subsequently counted.
  • Fig. 3B show a sequence of steps of the cutting blade wherein the slice is not cut.
  • the pixels corresponding to four different control areas designated with the numerical reference (21) are processed.
  • the two upper control areas (21) are activated, the images of the areas of said control areas (21) are shown in green, the presence of the interleaver is evaluated. If said interleaver is not subsequently detected, this may be due to a quality error or to the fact that a slice is not going to be cut.
  • the processing means of the system of the invention determine that a slice has not been cut.
  • the images in Fig. 3C show an example of processing the region (23) of interest, once the frame of interest of the captured sequence of images has been selected.
  • the processing means identify the presence of central fat and subcutaneous fat (shown in red and blue in the images) in order to detect if they are within predefined quality values.
  • Figures 4 and 5 show an embodiment of the slice classification system coupled to a slicer machine from the state of the art.
  • Figure 4 shows in two isometric views the different elements of the slice classification system according to the invention already described in Figures 1 and 2 , with the aim of facilitating an understanding of the diagrams.
  • Figure 5 shows two views from different angles of the image capture means (1).
  • the image capture means (1) are provided with a protective casing (4) provided with an inner cavity (5) on the inside of which a high speed camera (2) and lighting means (3) are housed.
  • the casing (4) also has an elastomeric sealing gasket (7), fastened by means of mechanical joints (6) which enable it to be opened for maintenance operations and which in turn guarantees the seal during the cleaning operations with pressurised hot water.

Description

    OBJECT OF THE INVENTION
  • The present invention belongs to the technical field of food processing.
  • More particularly, this invention relates to a system and a method for a food slicer machine, which are capable of classifying the slices of food by capturing and processing digital matrix images, taken at high speed during the process of cutting the food into slices. Thanks to said image classification, the system and the method of the invention enable possible quality failures to be detected in the slices obtained, prior to the packaging thereof.
  • Furthermore, the system and the method according to the present invention enable the slices of food to be classified according to different preconfigurable quality parameters.
  • BACKGROUND OF THE INVENTION AND TECHNICAL PROBLEM TO BE SOLVED
  • In the food processing sector, a multitude of industrial machines are known for cutting foods into slices, which are also called "slicer" machines or "slicing" machines.
  • These machines are intended to slice foods (for example and without limitation: cheeses, sausages, or ham) which initially have an elongated shape, usually a shape similar to a bar, in order to obtain slices thereof.
  • Each set of slices is grouped vertically in a portion in the shape of a stack of products, which is subsequently carried by a conveyor belt. Said belt can tilt in different positions in order to direct them to different lines. One of the positions usually enables distinguishing the set of slices if it has an excess or lack of weight, rejecting the portion of slices.
  • Likewise, between each pair of adjacent slices of one same stack, a plastic sheet can also be arranged, also known as "interleaver", intended to separate said pair of slices and prevent them from sticking together.
  • Cutting devices of this type are disclosed, for example, in US 5 129 298A or in DE 199 06 021 A1 .
  • However, sometimes the slices obtained by cutting the foods "in bars" do not meet the quality requirements required for them to be sold. The most common defects that slices usually have in these types of foods are: the presence of contaminants (for example, blood, rust or bones in the ham), the deformation of some region of the product (for example, excess subcutaneous or central fat in the ham), the lack of interleaver (or breakage thereof), or breakage of the slices.
  • On the market, there are different sets of equipment with computer vision which inspect the portions formed by stacks of slices, after packaging, although given the stack arrangement thereof, it is only possible to detect defects in the slices that are at the top or bottom of the stack if transparent packaging is used.
  • Therefore, in the technical field of food processing there is a need to incorporate into the food slicer machines, especially in the case of foods with irregular surfaces, such as ham, slice classification systems and methods which enable, on the one hand, the entirety of the slices making up each stack to be analysed and that, furthermore, are able to perform said analysis before the packaging process.
  • The slicer machines currently used on an industrial scale work at high cutting speeds, in the order of 900-2000 cuts/minute. This fact makes it difficult for computer vision equipment to be able to take at least one image of each of the slices created, and this in turn significantly complicates the possibility to classify said images in a time frame compatible with the processing speed of the food. Document EP 0 449 512 A1 discloses A slice classification system for a food slicer machine, said slicer machine comprising: a feeder mechanism configured to carry food to a cutting region; a cutting region wherein a cutting blade is provided, configured to cut the food into slices; a conveyor belt configured to transport slices of food, from a first area adjacent to the cutting region, to a second area spaced away from the cutting region; classification means for slices adjacent to the second area so that in case of a lean/ fat ration being unacceptable a commercially unacceptable slice or a portion containing an unacceptable slice may be diverted, said means being provided with image capture means, configured to capture a sequence of digital images from a viewing area located inside the cutting region and transmit said sequence of digital images to processing means, as the image data is periodically sampled, to update the Grey Level thresholds; processing means, configured to analyse at least one predetermined control area of each image of the sequence of images to compare at least one region of interest of the preferred images with at least one reference pattern and to classify the preferred images according to said comparison with the reference pattern and to send classification instructions to actuation means; and actuation means, configured to actuate the classification means for slices according to the classification instructions of the processing means.
  • DESCRIPTION OF THE INVENTION
  • The present invention aims to solve the difficulties and disadvantages of the prior art, indicated above.
  • More particularly, as defined in claim 1, a first object of the invention relates to a slice classification system for a food slicer machine, said slicer machine comprising:
    • a feeder mechanism configured to carry food to a cutting region;
    • a cutting region wherein a cutting blade is provided, configured to cut the food into slices;
    • a conveyor belt configured to transport stacks of slices of food, from a first area adjacent to the cutting region, to a second area spaced away from the cutting region; and
    • classification means for stacks of slices, adjacent to the second area (far from the cutting region),
    said slice classification system being characterised in that it is provided with:
    • image capture means, configured to capture a sequence of digital images from a viewing area located inside the cutting region and transmit said sequence of digital images to processing means;
    • processing means, configured to analyse at least one predetermined control area of each image of the sequence of images; to select from the entire sequence some preferred images based on said analysis of the control area; to compare at least one region of interest of the preferred images with at least one reference pattern; to classify the preferred images according to said comparison with the reference pattern and to send classification instructions to actuation means; and
    • actuation means, configured to actuate the classification means for stacks of slices according to the classification instructions of the processing means.
  • As will be explained in more detail below, the present invention enables, in spite of the high cutting speeds of the commonly used slicer machines, all the slices making up the formed stacks of slices to be analysed before they are packaged. This represents a significant improvement in the detection of possible defects, with respect to the prior art.
  • As set forth above, in accordance with the present invention the image capture means exclusively take images of a viewing area of the camera included inside the cutting region, inside of which there is a final end of the food which will be cut into a slice. Also, inside the viewing area, one or several control regions are established, which enable the position of the cutting blade and one or several regions of interest to be detected, which enable the quality of the slicing to be examined.
  • The processing means, when analysing said control regions, preferably by means of computer vision algorithms, are able to select the specific images (or frames) from the complete sequence of images wherein the regions of interest can be processed, since they are not hidden (either by the cutting blade, or by an interleaver). The images thereby selected are precisely called "preferred images" and each one shows one of the slices obtained by the slicer machine.
  • Preferably, in the present invention, when analysing the control area of each of the images in the sequence, the hue of the pixels of said control area is compared with at least one predetermined chromatic hue, corresponding to the colour of the cutting blade and/or the colour of the separating sheet (or interleaver). Since both the cutting blade and the interleaver have a colour that is notably different from the colour of the food, thanks to said comparison it is possible to determine the presence of the cutting blade and/or the interleaver and choose as preferred images those wherein none of these elements are present.
  • Moreover, the analysis of each preferred image is only carried out in those image portions corresponding to the region or regions of interest, reducing the load of computing operations and the volume of data used by the processing means. This enables the preferred images to be processed quickly and enables the slices shown in said images to be classified (as acceptable slices or slices with defects) and enables decisions to be made online (accepting or rejecting the stack wherein said slice is located), in other words, making decisions before the stack of slices reaches the classification means.
  • In this manner, the present invention enables deciding whether a stack of slices meets the quality requirements and therefore continues to the packaging line, or, on the other hand, if the presence of a defect is detected, ordering the rejection thereof by sending a corresponding instruction to the actuation means of the classification means.
  • The slice classification system according to the present invention is independent of the cutting machine, being able to be coupled to any type of new or already-existing slicer machine. To do so, the shape and size of the image capture means can be adapted to the geometry of the slicer machine.
  • In the present invention, at least one control region is preferably located in the highest portion, or in the lowest portion, of the viewing area (meaning, in the vicinity of the upper edge or the lower edge of the viewing area, that which is determined by the size of the slice with a margin on the perimeter thereof of at least two centimetres). These specific positions are preferred because they can more easily detect the position of the cutting blade with respect to the slice, as well as the presence and position of the interleaver.
  • Also, in the present invention, the processing means preferably processes the region (or regions) of interest of the selected images, also called preferred images, transforming them into a predetermined colour model.
  • Furthermore, preferably, in the present invention the processing means quantify the pixels of at least one predetermined hue which are present in the region of interest of the preferred images, grouping them into portions with a predetermined hue and analysing the outline and surface of said portions. Subsequently, the processing means compare the outline and surface of said portions with a predetermined hue, comparing them with the reference patterns. This enables the processing means to classify said regions of interest, determining by means of simple comparisons if they meet the necessary requirements. For example, if a feature of the food can be inscribed with a circumference having a certain diameter, or if a possible defect can be circumscribed in a circle having a certain diameter or if a percentage of a certain hue of the pixels contained in a region is exceeded.
  • The reference patterns can be, for example and without limitation, reference patterns for shape, size and hue.
  • Thanks to the present invention, it is also possible to determine whether or not the slice has been cut, since the slicer machine stops cutting between one portion of the stack of slices and another. This makes it possible to count the number of slices in each stack, which in turn enables the initial and final cut of the bar of food to be determined, since a smaller number of slices is cut than that of the stack in both cases.
  • The present invention also enables certain regions to be discriminated according to the shape thereof, such that areas that are not of interest can be removed from the comparison in order to determine whether or not a product has the quality necessary.
  • Preferably, in the present invention, the image capture means comprise a digital camera with a speed for recording sequences of images that is greater than 120 frames per second. Said digital camera is preferably far from the cutting area in order to avoid splashing due to waste projected from the cutting, although the lens of said camera focuses on the viewing area.
  • Likewise, the image capture means preferably comprise an elongated lighting device, arranged parallel to a cutting edge and provided with a semi-diffusion filter. Said semi-diffusion filter reduces the appearance of glare in the slices being cut.
  • The image capture means are also preferably provided with a protective casing equipped with an elastomeric sealing gasket, fastened by means of mechanical fasteners. These mechanical fasteners enable the easy opening thereof for maintenance operations and in turn guarantee the seal during the cleaning operations with pressurised hot water.
  • Furthermore, the image capture means may be provided with a communication cable connected to the processing means by which they transmit the sequence of digital images.
  • The processing means may be provided with a computer. Said computer is preferably located in a control cabinet, far from the cutting area in order to avoid splashing.
  • Moreover, the classification instructions can be control signals from a PLC (Programmable Logic Controller). Also, the actuation means may comprise at least one pneumatic solenoid valve which can be actuated by means of control signals from a PCL.
  • The slice classification system according to the present invention is preferably provided with a monitor configured to show images of the sequence of images captured by the image capture means. The images shown may be images of the defects detected.
  • The slice classification system according to the present invention is preferably provided with a touch interface. Said touch interface may preferably enable, among other functions, parameters to be set for the operation of the processing means and/or it may enable the historical record of classified stacks to be consulted.
  • A second aspect of the invention, as defined in claim 8, relates to a method for classifying slices of food cut by a slicer machine, said slicer machine comprising:
    • a feeder mechanism configured to carry food to a cutting region;
    • a cutting region wherein a cutting blade is provided, configured to cut the food into slices;
    • a conveyor belt configured to transport stacks of slices of food, from a first area adjacent to the cutting region, to a second area spaced away from the cutting region; and
    • classification means for stacks of slices, adjacent to the second area (far from the cutting region),
    said classification method being characterized in that it comprises the following steps:
    • providing image capture means, such that they focus on a viewing area located inside the cutting region of the slicer machine;
    • actuating the image capture means, capturing a sequence of digital images of the viewing area and transmitting said sequence of digital images to processing means;
    • analyzing, with the processing means, at least one predetermined control area of each image of the sequence of images;
    • selecting, with the processing means, preferred images from the entire sequence of images, depending on the result of the analysis of the control area;
    • comparing, with the processing means, at least one region of interest of the preferred images with at least one reference pattern;
    • classifying, with the processing means, the preferred images according to the result of said comparison of the region of interest thereof with the reference pattern; and
    • sending classification instructions to actuation means configured to actuate the classification means for stacks of slices according to the classification instructions of the processing means.
  • Unless expressly stated otherwise, any technical feature explained in relation to a slice classification system according to the first aspect of the present invention is also fully applicable to a slice classification method according to the second aspect of the present invention.
  • BRIEF DESCRIPTION OF THE FIGURES
  • What follows is a very brief description of a series of drawings that aid in better understanding the invention and which are expressly related to an embodiment of said invention that are presented by way of non-limiting examples of the same.
    • Fig. 1 is a schematic side view of a first embodiment of a slice cutting system according to the present invention;
    • Fig. 2 is a schematic cross-sectional view of the slice cutting system shown in Figure 1;
    • Figs. 3A-3C show a sequence of images obtained by the image capture means; and
    • Figs. 4 and 5 show a preferred embodiment of the slice classification system coupled to a slicer machine from the state of the art.
    DESCRIPTION OF A PREFERRED EMBODIMENT
  • Next, a detailed description of several preferred embodiments of the present invention is provided with the help of the attached Figures 1 to 5.
  • Throughout the present invention, as well as in the attached figures, the elements with equal or similar functions will be designated with the same numerical references.
  • Figure 1 shows a schematic representation of a cutting device according to the invention.
  • The device for cutting food (10), such as, for example, sausage, ham or cheese, has a product feeder mechanism with a product seat, which is open towards a cutting region (13). The product (10) to be cut is located in the food feeder mechanism on the seat surface and in contact with a tightening roller (24). Said food (10) can be led to the cutting region (13) with the help of an advancing mechanism (not shown), which acts on the rear end of the product.
  • In the cutting region (13), slices (11) of product (10) are separated in a rapid sequence with the help of a cutting blade (20), for example, a rotating blade, which are stacked in a portion of a stack of slices (25) as the conveyor belt (16) advances.
  • Furthermore, it has a cutting edge (14) in the seat surface of the cutting region (13).
  • The separated product slices (25) are withdrawn separately or in portions by means of an endless belt (16) outside the cutting region (13). Between the withdrawal mechanism (16) and the cutting edge (14), there is a withdrawal belt (15), responsible for rejecting the initial and final ends of the bar of product, which are led to a tank.
  • In the half-space in front of the cutting region (13), means (1) for capturing the images at a high speed have been arranged above the cutting edge (14).
  • Said capture means (1) are used to obtain images of the viewing area (22) focused on the cutting area (13) of the product with the aim of being able to determine whether the slices have any quality defects.
  • The images captured at high speed by the means (1) are transmitted by a communication cable to processing means, which in this embodiment of the invention include a computer (8) located in the control cabinet (18), which processes the images received by means of computer vision software which uses the image classification method claimed in this patent, determining whether the slice (11) has a quality defect, communicating, if affirmative, a signal to actuation means, which in this embodiment of the invention include a PLC (9) in order to remove the portions (26) of product actuating once it reaches the classification means, which in this embodiment of the invention, include a tilting classifying belt (17).
  • In the embodiment of the slice classification system (11) shown in Fig. 1, a monitor (19) is further provided wherein a control panel is displayed on which the images that are being captured by the image capture means (1) are displayed, in addition to counters which show operating parameters of the equipment, as well as quality failures detected in the stacks (25) of slices.
  • Figure 2 shows a schematic representation of the viewing area of the device.
  • As seen in said figure, the viewing area (22) of the camera is contained in the cutting region (13), and inside of it the slice (11), the lower cutting edge (14) and the tightening roller (24) are located (not visible in Fig. 2). Inside the viewing area (22), several control areas (21) and one region (23) of interest are established, said control areas are processed in the processing means by computer vision algorithms with the aim of detecting the position of the cutting blade (20) and the interleaver with respect to the slice (11) and being able to determine the precise moment at which to process the region of interest (23) by means of computer vision algorithms with which a classification is performed based on the quality thereof.
  • Figures 3A-3C show sequences of images of slicing wherein they illustrate, among other aspects of the invention, how the cut or uncut state of a slice is detected by means of the processing of the different control regions.
  • More particularly, Fig. 3A shows a sequence of images taken during the process of cutting a slice of food. The space shown in said images corresponds to the viewing area (22).
  • In this embodiment of the invention, the pixels corresponding to four different control areas designated with the numerical reference (21) are processed.
  • When the two upper control areas (21) are activated, the images of the areas of said control areas (21) are shown in green, the presence of the interleaver is evaluated. It is possible to detect the presence of the interleaver because, since it is translucent, if said interleaver is present it modifies the colour of the region. If the occupation of the blade is not detected, according to a method similar to that for detecting the interleaver, in the entirety of the lower cutting region, a slice is subsequently counted.
  • The images in Fig. 3B show a sequence of steps of the cutting blade wherein the slice is not cut.
  • As in the previous case, the pixels corresponding to four different control areas designated with the numerical reference (21) are processed. When the two upper control areas (21) are activated, the images of the areas of said control areas (21) are shown in green, the presence of the interleaver is evaluated. If said interleaver is not subsequently detected, this may be due to a quality error or to the fact that a slice is not going to be cut. When the cutting blade is detected in the inner control region, the processing means of the system of the invention determine that a slice has not been cut.
  • The images in Fig. 3C show an example of processing the region (23) of interest, once the frame of interest of the captured sequence of images has been selected. In the images shown, corresponding to slices of serrano ham, the processing means identify the presence of central fat and subcutaneous fat (shown in red and blue in the images) in order to detect if they are within predefined quality values.
  • Figures 4 and 5 show an embodiment of the slice classification system coupled to a slicer machine from the state of the art.
  • More particularly, Figure 4 shows in two isometric views the different elements of the slice classification system according to the invention already described in Figures 1 and 2, with the aim of facilitating an understanding of the diagrams.
  • Figure 5 shows two views from different angles of the image capture means (1).
  • In this particular embodiment of the invention, the image capture means (1) are provided with a protective casing (4) provided with an inner cavity (5) on the inside of which a high speed camera (2) and lighting means (3) are housed. The casing (4) also has an elastomeric sealing gasket (7), fastened by means of mechanical joints (6) which enable it to be opened for maintenance operations and which in turn guarantees the seal during the cleaning operations with pressurised hot water.
  • The present invention is in no way limited to the embodiments herein disclosed. For a person skilled in the art, other possible different embodiments of this invention will be evident in light of the present description. As a result, the scope of protection of the present invention is exclusively defined by the claims that follow.

Claims (12)

  1. A slice classification system (11) for a food (10) slicer machine, said slicer machine comprising:
    - a feeder mechanism configured to carry food (10) to a cutting region (13);
    - a cutting region (13) wherein a cutting blade (20) is provided, configured to cut the food (10) into slices (11);
    - a conveyor belt (16) configured to transport stacks (25) of slices (11) of food (10), from a first area (A) adjacent to the cutting region (13), to a second area (B) spaced away from the cutting region (13); and
    - classification means (17) for stacks (25) of slices (11) adjacent to the second area (B),
    said slice classification system being characterized in that it is provided with:
    - image capture means (1), configured to capture a sequence of digital images from a viewing area (22) located inside the cutting region (13) and transmit said sequence of digital images to processing means;
    - processing means (8), configured to analyse at least one predetermined control area (21) of each image of the sequence of images; to select from the entire sequence some preferred images based on said analysis of the control area (21); to compare at least one region of interest (23) of the preferred images with at least one reference pattern; to classify the preferred images according to said comparison with the reference pattern and to send classification instructions to actuation means (9); and
    - actuation means (9), configured to actuate the classification means (17) for stacks (25) of slices (11) according to the classification instructions of the processing means.
  2. The system according to claim 1, wherein the image capture means (1) comprise a digital camera with a recording speed greater than 120 frames per second.
  3. The system according to any of the preceding claims, wherein the image capture means (1) comprise an elongated lighting device (3), arranged parallel to a cutting edge (14) and provided with a semi-diffusion filter.
  4. The system according to any of the preceding claims, wherein the actuation means (9) comprise at least one pneumatic solenoid valve which can be actuated by means of control signals from a programmable logic controller.
  5. The system according to any of the preceding claims, further comprising a monitor (19) configured to show images of the sequence of images captured by the image capture means (1).
  6. The system according to any of the preceding claims, further comprising a touch interface.
  7. The system according to any of the preceding claims, wherein the image capture means (1) are provided with a protective casing (4) equipped with an elastomeric sealing gasket (7), fastened by means of mechanical fasteners (6).
  8. A method for classifying slices (11) of food (10) cut by a slicer machine, said slicer machine comprising:
    - a feeder mechanism configured to carry food (10) to a cutting region (13);
    - a cutting region (13) wherein a cutting blade (20) is provided, configured to cut the food (10) into slices (11);
    - a conveyor belt (16) configured to transport stacks (25) of slices (11) of food (10), from a first area (A) adjacent to the cutting region (13), to a second area (B) spaced away from the cutting region (13); and
    - classification means (17) for stacks (25) of slices (11) adjacent to the second area (B),
    said classification method being characterised in that it comprises the following steps:
    a) providing image capture means (1), such that they focus on a viewing area (22) located inside the cutting region (13) of the slicer machine;
    b) actuating the image capture means (1), capturing a sequence of digital images of the viewing area (22) and transmitting said sequence of digital images to processing means (8);
    c) analyzing, with the processing means (8), at least one predetermined control area (21) of each image of the sequence of images;
    d) selecting, with the processing means (8), preferred images from the entire sequence of images, depending on the result of the analysis of the control area (21);
    e) comparing, with the processing means (8), at least one region (23) of interest of the preferred images with at least one reference pattern;
    f) classifying, with the processing means (8), the preferred images according to the result of said comparison of the region (23) of interest thereof with the reference pattern; and
    g) sending classification instructions to actuation means (9) configured to actuate the classification means (17) for stacks (25) of slices (11).
  9. The method according to claim 8, further comprising transforming the region (23) of interest of the preferred images into a predetermined colour model.
  10. The method according to claim 9, further comprising quantifying the pixels of at least one predetermined hue which are present in the region (23) of interest of the preferred images, grouping them into portions with a predetermined hue and analysing the outline and surface of said portions with a predetermined hue.
  11. The method according to any of claims 8 to 10, wherein at least one area (21) is located in the highest portion, or in the lowest portion, of the viewing area (22).
  12. The method according to any of claims 8 to 11, wherein, in step c) when analyzing the control area (21) of each of the images in the sequence, the hue of the pixels of said control area (21) is compared with at least one predetermined chromatic hue, corresponding to the colour of the cutting blade and/or the colour of the separating sheet.
EP19383114.6A 2019-12-13 2019-12-13 Slice classification system and method, for a food slicer machine Active EP3835017B1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
ES19383114T ES2956779T3 (en) 2019-12-13 2019-12-13 Section classification system and method, for a food slicing machine
EP19383114.6A EP3835017B1 (en) 2019-12-13 2019-12-13 Slice classification system and method, for a food slicer machine

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
EP19383114.6A EP3835017B1 (en) 2019-12-13 2019-12-13 Slice classification system and method, for a food slicer machine

Publications (2)

Publication Number Publication Date
EP3835017A1 EP3835017A1 (en) 2021-06-16
EP3835017B1 true EP3835017B1 (en) 2023-06-21

Family

ID=69174290

Family Applications (1)

Application Number Title Priority Date Filing Date
EP19383114.6A Active EP3835017B1 (en) 2019-12-13 2019-12-13 Slice classification system and method, for a food slicer machine

Country Status (2)

Country Link
EP (1) EP3835017B1 (en)
ES (1) ES2956779T3 (en)

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0463961A1 (en) * 1990-06-29 1992-01-02 Societe Des Viandes Bretagne Anjou - Soviba Automatic machine to cut non-rigid products as food stuffs like meat

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB9006804D0 (en) * 1990-03-27 1990-05-23 Thurne Eng Co Ltd Slicing machine
DE19906021C2 (en) 1999-02-16 2003-02-27 Holger Wente Method and device for separating disc-shaped bodies from an original body
US6997089B2 (en) * 2002-06-25 2006-02-14 Formax, Inc. Optical grading system for slicer apparatus

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0463961A1 (en) * 1990-06-29 1992-01-02 Societe Des Viandes Bretagne Anjou - Soviba Automatic machine to cut non-rigid products as food stuffs like meat

Also Published As

Publication number Publication date
EP3835017A1 (en) 2021-06-16
ES2956779T3 (en) 2023-12-27

Similar Documents

Publication Publication Date Title
CN109661176B (en) Apparatus for acquiring and analyzing data and system and method for processing product
EP2923305B1 (en) Method for scoring and controlling quality of food products in a dynamic production line
EP1534478B1 (en) Optical grading system and method for slicer apparatus
US5267168A (en) Apparatus for and method of controlling slicing machine
EP2029330B1 (en) Product slicing machine with VISION SYSTEM USING STROBED ILLUMINATION and method of assessing an end face of a product
EP3352574B1 (en) A sensor-guided automated method and system for processing crustaceans
EP1915240B1 (en) Two colour vision system
US20080212842A1 (en) Two Colour Vision System
JP2010505397A (en) Method and apparatus for processing fish, chicken or other meat products conveyed along a processing line
CA3127547A1 (en) Food processing device and method
US20220330560A1 (en) Method and system for processing products
EP3835017B1 (en) Slice classification system and method, for a food slicer machine
GB2362711A (en) Scanning meat samples for bones where the sample container has a data storage element read by control means
JP6861678B2 (en) Quality confirmation system and blister packaging system
EP3550982A1 (en) A method of processing a food object
CA3151935A1 (en) Conveyor with selective width rejection system
GB2362710A (en) Scanning meat samples for bones where sample container has a data storage element read by control means
WO2012004550A1 (en) Dual sensitivity browser for sorting machines
CN113329851B (en) Apparatus and method for processing beverage closures
CN111842216A (en) Agricultural product quality detection automatic sorting management system based on machine vision
US20230005127A1 (en) Method and device for detecting containers which have fallen over and/or are damaged in a container mass flow
CN102247102B (en) Egg receiving device and egg breaking equipment
JP2024054976A (en) Product Inspection System
CN117600088A (en) Digital invisible mark and eliminating method for package printed matter inspection products
WO2021133348A1 (en) An artificial vision system for real-time detection of abrage errors in the yarn coil

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN PUBLISHED

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20211215

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20230206

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602019031304

Country of ref document: DE

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1580592

Country of ref document: AT

Kind code of ref document: T

Effective date: 20230715

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG9D

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20230621

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230621

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230921

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1580592

Country of ref document: AT

Kind code of ref document: T

Effective date: 20230621

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230621

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230621

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230621

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230621

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230621

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230922

REG Reference to a national code

Ref country code: ES

Ref legal event code: FG2A

Ref document number: 2956779

Country of ref document: ES

Kind code of ref document: T3

Effective date: 20231227

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230621

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230621

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231021

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230621

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230621

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230621

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231023

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231021

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230621

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230621

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230621

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230621