CN212180649U - Paste appearance defect detection equipment - Google Patents
Paste appearance defect detection equipment Download PDFInfo
- Publication number
- CN212180649U CN212180649U CN202020333588.3U CN202020333588U CN212180649U CN 212180649 U CN212180649 U CN 212180649U CN 202020333588 U CN202020333588 U CN 202020333588U CN 212180649 U CN212180649 U CN 212180649U
- Authority
- CN
- China
- Prior art keywords
- camera
- paste
- light source
- shooting
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Abstract
The utility model provides a lotion appearance imperfections check out test set belongs to product detection technical field, and this equipment includes: a conveyor for a user to transport the paste in a specified direction; the first trigger sensor is arranged at a first position of the conveying device and used for detecting whether the paste arrives at the first position; a first camera, a second camera, and a fifth camera; a second trigger sensor; the third camera and the fourth camera are used for shooting the paste body at a second position in the horizontal direction; and the defect detection processor judges whether the paste has appearance defects or not according to images shot by the first camera, the second camera, the third camera, the fourth camera and the fifth camera. Through the utility model discloses a processing scheme can whether there is the defect by automated inspection lotion outward appearance.
Description
Technical Field
The utility model relates to a defect monitoring technology field especially relates to a lotion appearance imperfections check out test set and method.
Background
In the traditional lipstick manufacturing production line, the lipstick is easy to have the defects of 'tip breakage', scratches, stains and the like after demolding in the production process. The rotation angle of the paste of a lipstick product on a production line has uncertainty, and the paste image at a preset angle is difficult to be shot deterministically.
The existing lipstick or similar paste manufacturing enterprises still rely on manual inspection in the appearance detection link, and semi-automatic or automatic detection modes are not popularized by people, so that the appearance yield of products is difficult to control.
In order to solve this problem or such problems, general equipment manufacturers will provide general visual inspection devices or software modules for cosmetic manufacturers, which are adapted to various product types through configuration and debugging, but the applicability of such products is different from the present invention. The general equipment has low accuracy because of no light source, structure and algorithm module specially designed for lipstick paste.
SUMMERY OF THE UTILITY MODEL
In view of this, the embodiments of the present invention provide a paste appearance defect detecting apparatus to at least partially solve the problems in the prior art.
The embodiment of the utility model provides a lotion appearance imperfections check out test set, include:
a conveyor for a user to transport the paste in a specified direction;
the first trigger sensor is arranged at a first position of the conveying device and used for detecting whether the paste arrives at the first position;
the paste body shooting device comprises a first camera, a second camera and a fifth camera, wherein the first camera and the second camera are used for shooting the paste body in the horizontal direction at a first position, and the fifth camera is used for shooting the paste body in the vertical downward direction at the first position;
the second trigger sensor is arranged at a second position of the conveying device and used for detecting whether the paste arrives at the second position;
the third camera and the fourth camera are used for shooting the paste body at a second position in the horizontal direction;
and the defect detection processor judges whether the paste has appearance defects or not according to images shot by the first camera, the second camera, the third camera, the fourth camera and the fifth camera.
According to the utility model discloses a concrete implementation mode, the device still includes:
a first light source to illuminate the paste at the first location.
According to the utility model discloses a concrete implementation mode, the device still includes:
a first shielding baffle disposed on an opposite side of the first light source for reflecting light of the first light source to the first position.
According to the utility model discloses a concrete implementation mode, the device still includes:
a second light source illuminating the paste at the second location.
According to the utility model discloses a concrete implementation mode, the device still includes:
a second shielding baffle disposed on an opposite side of the second light source for reflecting light of the second light source to the second position.
According to the utility model discloses a concrete implementation mode, its characterized in that:
the first light source is a panel type LED normally-on light source, and the LED normally-on light source is lighted and triggered through an upstream trigger sensor.
According to the utility model discloses a concrete implementation mode, the device still includes:
the first shielding plate and the second shielding plate are made of diffuse reflection materials.
According to the utility model discloses a concrete implementation mode, its characterized in that:
for the image shot by the fifth camera, roughly positioning the image by adopting an image processing technology for determining the position and the radius of the paste body;
and judging whether the paste has preset defects in the positions and the radius areas of the paste, wherein the preset defects comprise at least one of broken tips, air holes and depressions.
According to the utility model discloses a concrete implementation mode, its characterized in that:
performing image enhancement operation on the side images of the paste body shot by the first camera, the second camera, the third camera and the fourth camera;
and monitoring the defects of the image after the enhancement operation processing by using a preset deep learning model.
The embodiment of the utility model provides a lotion appearance defect detection scheme, including conveyer, the conveyer user is used for transporting the lotion in the appointed direction; the first trigger sensor is arranged at a first position of the conveying device and used for detecting whether the paste arrives at the first position; the paste body shooting device comprises a first camera, a second camera and a fifth camera, wherein the first camera and the second camera are used for shooting the paste body in the horizontal direction at a first position, and the fifth camera is used for shooting the paste body in the vertical downward direction at the first position; the second trigger sensor is arranged at a second position of the conveying device and used for detecting whether the paste arrives at the second position; the third camera and the fourth camera are used for shooting the paste body at a second position in the horizontal direction; and the defect detection processor judges whether the paste has appearance defects or not according to images shot by the first camera, the second camera, the third camera, the fourth camera and the fifth camera. Through the utility model discloses a processing scheme accomplishes automated inspection through adding peripheral hardware such as detection device (image acquisition device, light source, image analysis treater). The rotation angle of a class of product lotion of lipstick on the production line has the uncertainty, is difficult to the lotion image of shooting predetermined angle of certainty, and the utility model discloses a many visual angles detect the defect, specifically: and a plurality of cameras respectively sample the shot lipstick from the side surface and the top part each time the shot lipstick is shot. The auxiliary light source and the background lamp panel are matched to highlight the defects of the shot object. And respectively estimating the defect form system of the target under different visual angles, and comprehensively judging whether the target is a defective product.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without creative efforts.
Fig. 1 is a schematic structural diagram of a device for detecting appearance defects of a paste according to an embodiment of the present invention;
fig. 2 is a flowchart of a method for detecting appearance defects of a paste according to an embodiment of the present invention.
Detailed Description
The embodiments of the present invention will be described in detail below with reference to the accompanying drawings.
The following description of the embodiments of the present invention is provided for illustrative purposes, and other advantages and effects of the present invention will be readily apparent to those skilled in the art from the disclosure herein. It is to be understood that the embodiments described are only some embodiments of the invention, and not all embodiments. The present invention can also be implemented or applied through other different specific embodiments, and various details in the present specification can be modified or changed based on different viewpoints and applications without departing from the spirit of the present invention. It is to be noted that the features in the following embodiments and examples may be combined with each other without conflict. Based on the embodiments in the present invention, all other embodiments obtained by a person skilled in the art without creative efforts belong to the protection scope of the present invention.
It is noted that various aspects of the embodiments are described below within the scope of the appended claims. It should be apparent that the aspects described herein may be embodied in a wide variety of forms and that any specific structure and/or function described herein is merely illustrative. Based on the disclosure, one skilled in the art should appreciate that one aspect described herein may be implemented independently of any other aspects and that two or more of these aspects may be combined in various ways. For example, an apparatus may be implemented and/or a method practiced using any number of the aspects set forth herein. Additionally, such an apparatus may be implemented and/or such a method may be practiced using other structure and/or functionality in addition to one or more of the aspects set forth herein.
It should be noted that the drawings provided in the following embodiments are only for illustrating the basic idea of the present invention, and the drawings only show the components related to the present invention rather than being drawn according to the number, shape and size of the components in actual implementation, and the form, amount and ratio of the components in actual implementation can be changed at will, and the layout of the components may be more complicated.
In addition, in the following description, specific details are provided to facilitate a thorough understanding of the examples. However, it will be understood by those skilled in the art that the aspects may be practiced without these specific details.
Referring to fig. 1, the utility model provides a lotion appearance defect detection equipment can include:
a conveyor for a user to transport the paste in a specified direction;
the first trigger sensor is arranged at a first position of the conveying device and used for detecting whether the paste arrives at the first position;
the paste body shooting device comprises a first camera, a second camera and a fifth camera, wherein the first camera and the second camera are used for shooting the paste body in the horizontal direction at a first position, and the fifth camera is used for shooting the paste body in the vertical downward direction at the first position;
the second trigger sensor is arranged at a second position of the conveying device and used for detecting whether the paste arrives at the second position;
the third camera and the fourth camera are used for shooting the paste body at a second position in the horizontal direction;
and the defect detection processor judges whether the paste has appearance defects or not according to images shot by the first camera, the second camera, the third camera, the fourth camera and the fifth camera.
Specifically, the device structure of the utility model is as shown in fig. 1, and the first, second, third and fourth cameras are used for shooting the image of the side of the paste body. The fifth camera is used to take an image of the top of the paste. It should be noted that the arrangement method of the first, second, third and fourth cameras is only a preferred scheme, and 3, 4, 5 cameras can be used according to the situation of the production line site, the utility model discloses the important point is that two types of cameras are used, one type (such as the first, second, third and fourth cameras) is used for shooting the paste and the lateral cylindrical surface of the shell, and the other type (such as the fifth camera) is installed directly above the lipstick paste and is shot towards the lipstick head edge part vertically, and is used for detecting the defects of the lipstick paste head edge part, such as the "sharp cut" and the like.
As shown in fig. 1, the product is transported forward via a conveyor (e.g., a conveyor belt) and a photograph is triggered when the product passes a trigger sensor (e.g., a first trigger sensor or a second trigger sensor). In one embodiment a reflective proximity sensor is used as the trigger signal source. The upstream trigger sensor (first trigger sensor) is connected with the first camera and the second camera. And the downstream trigger sensor (second trigger sensor) is connected with the third camera and the fourth camera. The same object is photographed twice at the moment that the upstream and the downstream are triggered respectively to form images of a plurality of visual angles, and the images are synchronously transmitted to the image processing sensor. In one embodiment, a fifth camera is connected with the upstream trigger sensor and is used for shooting the paste head edge part at the upstream; in another embodiment, a fifth camera is connected to the downstream trigger sensor, i.e. shoots the cream's brim.
According to the utility model discloses a concrete implementation mode, the device still includes:
a first light source to illuminate the paste at the first location.
According to the utility model discloses a concrete implementation mode, the device still includes:
a first shielding baffle disposed on an opposite side of the first light source for reflecting light of the first light source to the first position.
According to the utility model discloses a concrete implementation mode, the device still includes:
a second light source illuminating the paste at the second location.
According to the utility model discloses a concrete implementation mode, the device still includes:
a second shielding baffle disposed on an opposite side of the second light source for reflecting light of the second light source to the second position.
According to the utility model discloses a concrete implementation mode, its characterized in that:
the first light source is a panel type LED normally-on light source, and the LED normally-on light source is lighted and triggered through an upstream trigger sensor.
According to the utility model discloses a concrete implementation mode, the device still includes:
the first shielding plate and the second shielding plate are made of diffuse reflection materials.
Optionally, the first light source may be a panel-type LED normally-bright light source; optionally, the first light source is connected to the upstream trigger, and after receiving the start signal, the first light source flashes to illuminate the object. The first light source is disposed between the upstream side cameras, facing the subject.
For the downstream, optionally, the second light source may be a panel type LED normally-bright light source; the optional second light source is connected with the trigger sensor, and after receiving the trigger signal, the second light source flashes to illuminate the shot object. The second light source is disposed between the downstream lateral cameras, facing the subject.
On the opposite side of the upstream and downstream cameras from the conveyor, baffles are respectively disposed. The barrier is used to avoid interference from the surrounding environment in an image and to highlight a subject. It should be noted that the baffle is made of diffuse reflection material, and in one example, a neutral gray scale diffuse reflection acrylic board is used. In one embodiment, an LED panel light box with soft light material is used.
Preferably, all the devices are shielded by the shading box, so that the interference of ambient light on the acquisition device is avoided.
According to the utility model discloses a concrete implementation mode, its characterized in that:
for the image shot by the fifth camera, roughly positioning the image by adopting an image processing technology for determining the position and the radius of the paste body;
and judging whether the paste has preset defects in the positions and the radius areas of the paste, wherein the preset defects comprise at least one of broken tips, air holes and depressions.
According to the utility model discloses a concrete implementation mode, its characterized in that:
performing image enhancement operation on the side images of the paste body shot by the first camera, the second camera, the third camera and the fourth camera;
and monitoring the defects of the image after the enhancement operation processing by using a preset deep learning model.
For images taken by the overhead camera, it is preferred to first coarsely position the images using conventional image processing techniques. In one embodiment, the position and radius of the lipstick (paste) are determined by using Hough circle detection, and the region of interest is determined by the position and radius of the center of the lipstick. The perceptual area is scaled to a preset size and marked as an input image. The input image is analyzed using a first class of deep learning model. In one embodiment, the depth model serves as a sort task, namely, whether a defect exists in the region of interest is identified; in another embodiment, the depth model is used as a multi-label classification task, the number of labels is related to the number of defect types, for example, three types of defects, namely, broken tip, air hole, recess and normal four types of classification labels, mainly exist.
For the deep learning model, resnet50 may be used as the classification model and softmax as the classification loss function in one embodiment. And carrying out supervised training on the deep learning model by using a large number of pictures of lipstick with different colors and shapes. Finally, an effective first deep learning model can be obtained.
For images taken by the side cameras, it is preferable to first image-enhance the images using conventional image processing techniques. In one embodiment, the illumination is removed using a self-quotient method. Optionally, image details are enhanced using adaptive histogram equalization. The enhanced image is marked as an input image.
The input image is analyzed using a second deep learning model. In one embodiment, defect detection is used as a target locating and classifying task, and ssd, yolov3, etc. can be used as a second deep learning model, for example, to regress the location of the defect and the classification label. The output result is a series of 5 tuples, which respectively represent the horizontal and vertical coordinates of the upper left corner point of the regression frame, the width and the height of the regression frame and the classification label. According to the definition of the defect type, the defect type can be used as a binary classification task, namely whether a defect exists or not; or a multi-label task, and classifying the type of the defect; in another embodiment, the object localization model is used in its entirety in tandem with the classification model as a second deep learning model. The former is used for determining the position and the size of a target, then an interesting area is extracted from the position of each defect and marked as an input sub-image of a classification model, and the classification depth model is used for identifying the sub-image. It is determined whether the target is a defect, or which defect. In another embodiment, a binarization or self-adaptive binarization method is used for segmenting an original image, noise is removed through morphological opening-up operation, connected regions are counted, and candidate interested regions of defects are determined. The candidate regions of interest are then classified using resnet or the like as a second deep learning model. The training method of the second deep learning model is similar to the first deep learning model, and belongs to the prior art, and is not described herein again.
Corresponding to above equipment to be right, see fig. 2, the embodiment of the utility model provides a lotion appearance defect detecting method is still provided, include:
s201, conveying the paste in a specified direction by a user through a conveying device;
s202, arranging a first trigger sensor at a first position of the conveying device, and detecting whether the paste arrives at the first position;
s203, arranging a first camera, a second camera and a fifth camera, wherein the first camera and the second camera are used for shooting the paste body at a first position in the horizontal direction, and the fifth camera is used for shooting the paste body at the first position in the vertical downward direction;
s204, arranging a second trigger sensor, wherein the second trigger sensor is arranged at a second position of the conveying device and used for detecting whether the paste arrives at the second position;
s205, arranging a third camera and a fourth camera, wherein the third camera and the fourth camera are used for shooting the paste body at a second position in the horizontal direction;
and S206, setting a defect detection processor, wherein the defect detection processor judges whether the paste has appearance defects according to images shot by the first camera, the second camera, the third camera, the fourth camera and the fifth camera.
In the process of implementing steps S201 to S206, the first, second, third, and fourth cameras are used to capture images of the side surfaces of the paste. The fifth camera is used to take an image of the top of the paste. It should be noted that the arrangement method of the first, second, third and fourth cameras is only a preferred scheme, and 3, 4, 5 cameras can be used according to the situation of the production line site, the utility model discloses the important point is that two types of cameras are used, one type (such as the first, second, third and fourth cameras) is used for shooting the paste and the lateral cylindrical surface of the shell, and the other type (such as the fifth camera) is installed directly above the lipstick paste and is shot towards the lipstick head edge part vertically, and is used for detecting the defects of the lipstick paste head edge part, such as the "sharp cut" and the like.
As shown in fig. 1, the product is transported forward via a conveyor (e.g., a conveyor belt) and a photograph is triggered when the product passes a trigger sensor (e.g., a first trigger sensor or a second trigger sensor). In one embodiment a reflective proximity sensor is used as the trigger signal source. The upstream trigger sensor (first trigger sensor) is connected with the first camera and the second camera. And the downstream trigger sensor (second trigger sensor) is connected with the third camera and the fourth camera. The same object is photographed twice at the moment that the upstream and the downstream are triggered respectively to form images of a plurality of visual angles, and the images are synchronously transmitted to the image processing sensor. In one embodiment, a fifth camera is connected with the upstream trigger sensor and is used for shooting the paste head edge part at the upstream; in another embodiment, a fifth camera is connected to the downstream trigger sensor, i.e. shoots the cream's brim.
The utility model discloses though regard lipstick as the scheme target, but not be limited to the lipstick, can explain for lipstick and the lotion that has lipstick outward appearance characteristic, such as lip gloss, lip gloss etc..
The above description is only for the specific embodiments of the present invention, but the protection scope of the present invention is not limited thereto, and any changes or substitutions that can be easily conceived by those skilled in the art within the technical scope of the present invention should be covered by the protection scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
Claims (8)
1. A paste appearance defect detection device is characterized by comprising:
a conveyor for a user to transport the paste in a specified direction;
the first trigger sensor is arranged at a first position of the conveying device and used for detecting whether the paste arrives at the first position;
the paste body shooting device comprises a first camera, a second camera and a fifth camera, wherein the first camera and the second camera are used for shooting the paste body in the horizontal direction at a first position, and the fifth camera is used for shooting the paste body in the vertical downward direction at the first position;
the second trigger sensor is arranged at a second position of the conveying device and used for detecting whether the paste arrives at the second position;
the third camera and the fourth camera are used for shooting the paste body at a second position in the horizontal direction;
and the defect detection processor judges whether the paste has appearance defects or not according to images shot by the first camera, the second camera, the third camera, the fourth camera and the fifth camera.
2. The apparatus of claim 1, further comprising:
a first light source to illuminate the paste at the first location.
3. The apparatus of claim 2, further comprising:
a first shielding baffle disposed on an opposite side of the first light source for reflecting light of the first light source to the first position.
4. The apparatus of claim 3, further comprising:
a second light source illuminating the paste at the second location.
5. The apparatus of claim 4, further comprising:
a second shielding baffle disposed on an opposite side of the second light source for reflecting light of the second light source to the second position.
6. The apparatus of claim 5, wherein:
the first light source is a panel type LED normally-on light source, and the LED normally-on light source is lighted and triggered through an upstream trigger sensor.
7. The apparatus of claim 1, wherein:
for the image shot by the fifth camera, roughly positioning the image by adopting an image processing technology for determining the position and the radius of the paste body;
and judging whether the paste has preset defects in the positions and the radius areas of the paste, wherein the preset defects comprise at least one of broken tips, air holes and depressions.
8. The apparatus of claim 1, wherein:
performing image enhancement operation on the side images of the paste body shot by the first camera, the second camera, the third camera and the fourth camera;
and monitoring the defects of the image after the enhancement operation processing by using a preset deep learning model.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202020333588.3U CN212180649U (en) | 2020-03-17 | 2020-03-17 | Paste appearance defect detection equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202020333588.3U CN212180649U (en) | 2020-03-17 | 2020-03-17 | Paste appearance defect detection equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN212180649U true CN212180649U (en) | 2020-12-18 |
Family
ID=73778053
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202020333588.3U Active CN212180649U (en) | 2020-03-17 | 2020-03-17 | Paste appearance defect detection equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN212180649U (en) |
-
2020
- 2020-03-17 CN CN202020333588.3U patent/CN212180649U/en active Active
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111239142A (en) | Paste appearance defect detection device and method | |
| US11830179B2 (en) | Food inspection assisting system, food inspection assisting apparatus and computer program | |
| US8254659B2 (en) | Method and apparatus for visually inspecting an object | |
| CN109724984B (en) | Defect detection and identification device and method based on deep learning algorithm | |
| CN104483320B (en) | Digitized defect detection device and detection method of industrial denitration catalyst | |
| EP3801934B1 (en) | Process and system for in-line inspection of product stream for detection of foreign objects | |
| CN110246122A (en) | Small size bearing quality determining method, apparatus and system based on machine vision | |
| CN110146516B (en) | Fruit grading device based on orthogonal binocular machine vision | |
| WO2019151393A1 (en) | Food inspection system, food inspection program, food inspection method and food production method | |
| CN102713579B (en) | Appearance inspection device | |
| CN106651802A (en) | Machine vision tin soldering location detection method | |
| CN110929755A (en) | Poultry egg detection method, device and system, electronic equipment and storage medium | |
| US20230342909A1 (en) | System and method for imaging reflecting objects | |
| CN212180649U (en) | Paste appearance defect detection equipment | |
| CN105572133A (en) | Flaw detection method and device | |
| CN211403010U (en) | Foreign body positioning device for display panel | |
| CN111239145A (en) | Paste surface air hole automatic detection equipment and method | |
| CN113640303A (en) | Surface flaw detection equipment for notebook computer and detection method thereof | |
| KR102117697B1 (en) | Apparatus and method for surface inspection | |
| CN110441315B (en) | Electronic component testing apparatus and method | |
| CN111458344A (en) | Mask defect visual detection method, equipment and storage medium | |
| CN112525931A (en) | Shoe garment broken needle detection device and method based on artificial intelligence technology | |
| CN112763506A (en) | Flaw detection method and device with AOI and AI functions | |
| JPS62211544A (en) | Inspecting method for egg | |
| CN212180650U (en) | Paste surface air hole automatic detection equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| GR01 | Patent grant | ||
| GR01 | Patent grant |