CN113643250B - Detection method, device, equipment and storage medium - Google Patents
Detection method, device, equipment and storage medium Download PDFInfo
- Publication number
- CN113643250B CN113643250B CN202110908522.1A CN202110908522A CN113643250B CN 113643250 B CN113643250 B CN 113643250B CN 202110908522 A CN202110908522 A CN 202110908522A CN 113643250 B CN113643250 B CN 113643250B
- Authority
- CN
- China
- Prior art keywords
- target element
- detection
- abnormal
- target
- distance
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000001514 detection method Methods 0.000 title claims abstract description 162
- 230000002159 abnormal effect Effects 0.000 claims abstract description 151
- 239000011521 glass Substances 0.000 claims abstract description 68
- 238000000034 method Methods 0.000 claims abstract description 31
- 238000011084 recovery Methods 0.000 claims description 22
- 238000004590 computer program Methods 0.000 claims description 11
- 238000007689 inspection Methods 0.000 claims description 9
- 230000005856 abnormality Effects 0.000 claims description 2
- 238000010586 diagram Methods 0.000 description 14
- 230000002950 deficient Effects 0.000 description 13
- 238000011027 product recovery Methods 0.000 description 12
- 230000006870 function Effects 0.000 description 9
- 230000003287 optical effect Effects 0.000 description 8
- 239000000463 material Substances 0.000 description 6
- 238000012545 processing Methods 0.000 description 5
- 238000004064 recycling Methods 0.000 description 5
- 238000004891 communication Methods 0.000 description 4
- 239000013307 optical fiber Substances 0.000 description 3
- 238000003491 array Methods 0.000 description 2
- 238000004377 microelectronic Methods 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 230000002547 anomalous effect Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008707 rearrangement Effects 0.000 description 1
- 238000012216 screening Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0004—Industrial image inspection
- G06T7/0008—Industrial image inspection checking presence/absence
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10004—Still image; Photographic image
Abstract
The invention discloses a detection method, a detection device, detection equipment and a storage medium. The method is applied to an appearance detection device, and the appearance detection device comprises: a glass disc and a first camera, the method comprising: acquiring first image information of a first area acquired by the first camera, wherein the first area comprises: a detection region and a non-detection region on the glass disk; if the abnormal object exists in the second area corresponding to the target element according to the first image information, the target element is marked abnormally, wherein the non-detection area comprises the second area.
Description
Technical Field
The embodiment of the invention relates to the technical field of appearance inspection, in particular to a detection method, a detection device, detection equipment and a storage medium.
Background
The appearance detection equipment is used for detecting the appearance of the micro electronic component, the elements are arranged in a line through the vibration disc and then are vibrated on the glass disc, the glass disc rotates at a certain speed to drive the elements to move to the photographing position of the camera, the surface appearance flaw detection is carried out, the detection result is qualified, the qualified product recovery box is recovered by using the pneumatic element, and the unqualified product recovery box is recovered by using the pneumatic element.
When the vibrating disk vibrates an object to the glass disk, the posture and the position of the element on the glass disk can be changed due to the influence of speed and height difference, and the appearance detection device is provided with a guide mechanism for ensuring that the elements on the glass disk can be arranged in a row. However, due to individual differences of the components themselves, individual components or other abnormal objects may jump out of the glass inspection area, so that components that have not been subjected to the appearance inspection are easily recycled into the same recycling box together with components that have been subjected to the appearance inspection, and if components that have not been subjected to the appearance inspection are recycled into a good product recycling box together with good components that have been inspected, there is a risk that defective products will be present in the good products of customers.
Disclosure of Invention
The embodiment of the invention provides a detection method, a device, equipment and a storage medium, which aim to solve the problems that due to individual differences of elements, individual elements jump out of a glass detection area, elements which are not subjected to appearance detection are easy to recycle into the same recycling box together with elements which are subjected to appearance detection, and if the elements which are not subjected to appearance detection and the detected qualified elements are recycled into a qualified product recycling box together, defective products are in qualified products of customers, and whether abnormal objects exist in the detection area and the non-detection area on a glass disc or not can be monitored, so that material mixing is prevented.
In a first aspect, an embodiment of the present invention provides a detection method, which is applied to an appearance detection device, where the appearance detection device includes: glass disc and first camera, the detection method includes:
acquiring first image information of a first area acquired by the first camera, wherein the first area comprises: a detection region and a non-detection region on the glass disk;
and if the abnormal object exists in a second area corresponding to the target element according to the first image information, performing abnormal marking on the target element, wherein the non-detection area comprises the second area.
Further, if it is determined that an abnormal object exists in the second region corresponding to the target element according to the first image information, performing abnormal marking on the target element includes:
judging whether an abnormal object exists in a second area corresponding to the target element according to the first image information;
if an abnormal object exists, acquiring a target distance between the target element and the abnormal object;
if the target distance is smaller than or equal to a first distance threshold value, carrying out abnormity marking on the target element;
and recovering the target element carrying the abnormal mark into the first recovery box.
Further, the method also comprises the following steps:
and if the target distance is greater than the first distance threshold value, recovering the target element into a second recovery box.
Further, the target element includes: a first element and a second element;
correspondingly, if it is determined that an abnormal object exists in the second region corresponding to the target element according to the first image information, performing abnormal marking on the target element includes:
if it is determined that a first abnormal object exists in the region corresponding to the first element and a first abnormal object exists in the region corresponding to the second element according to the target image, acquiring a first distance between the first abnormal object and the first element and a second distance between the first abnormal object and the second element;
if the first distance is larger than the second distance, the second element is marked abnormally;
and if the first distance is smaller than or equal to the second distance, carrying out abnormal marking on the first element.
Further, the appearance inspection apparatus further includes: a vibrating disk and a second camera;
correspondingly, before acquiring the image information of the first area acquired by the first camera, the method further includes:
controlling the vibration disk to vibrate so as to enable the element to vibrate onto the glass disk, wherein the glass disk rotates at a preset speed;
acquiring second image information of a detection area on the glass disc through the second camera;
and performing appearance detection on the elements in the detection area on the glass disc according to the second image information.
Further, if it is determined that an abnormal object exists in the second region corresponding to the target element according to the first image information, performing abnormal marking on the target element includes:
and if the target element is a qualified element and the abnormal object exists in the second area corresponding to the target element according to the first image information, carrying out abnormal marking on the target element.
In a second aspect, an embodiment of the present invention further provides a detection apparatus, configured on an appearance detection device, where the appearance detection device includes: glass disc and first camera, detection device includes:
an obtaining module, configured to obtain first image information of a first area acquired by the first camera, where the first area includes: a detection region and a non-detection region on the glass disk;
and a marking module, configured to perform abnormal marking on the target element if it is determined that an abnormal object exists in a second region corresponding to the target element according to the first image information, where the non-detection region includes the second region.
Further, the marking module is specifically configured to:
judging whether an abnormal object exists in a second area corresponding to the target element according to the first image information;
if an abnormal object exists, acquiring a target distance between the target element and the abnormal object;
if the target distance is smaller than or equal to a first distance threshold value, carrying out abnormity marking on the target element;
and recovering the target element carrying the abnormal mark into the first recovery box.
Further, the marking module is specifically configured to:
and if the target distance is greater than the first distance threshold value, recovering the target element into a second recovery box.
Further, the target element includes: a first element and a second element;
correspondingly, the marking module is specifically configured to:
if it is determined that a first abnormal object exists in the region corresponding to the first element and a first abnormal object exists in the region corresponding to the second element according to the target image, acquiring a first distance between the first abnormal object and the first element and a second distance between the first abnormal object and the second element;
if the first distance is larger than the second distance, the second element is marked abnormally;
and if the first distance is smaller than or equal to the second distance, carrying out abnormal marking on the first element.
Further, the appearance inspection apparatus further includes: a vibrating disk and a second camera;
correspondingly, the detection device further comprises:
the control module is used for controlling the vibration disc to vibrate so as to enable the element to vibrate on the glass disc, wherein the glass disc rotates at a preset speed;
the acquisition module is used for acquiring second image information of the detection area on the glass disc through the second camera;
and the detection module is used for performing appearance detection on elements in the detection area on the glass disc according to the second image information.
Further, the marking module is specifically configured to:
and if the target element is a qualified element and the abnormal object exists in the second area corresponding to the target element according to the first image information, carrying out abnormal marking on the target element.
In a third aspect, an embodiment of the present invention further provides a computer device, including a memory, a processor, and a computer program stored on the memory and executable on the processor, where the processor executes the computer program to implement the detection method according to any one of the embodiments of the present invention.
In a fourth aspect, the embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, and the computer program, when executed by a processor, implements the detection method according to any one of the embodiments of the present invention.
According to the embodiment of the invention, first image information of a first area acquired by a first camera is acquired, wherein the first area comprises: a detection region and a non-detection region on the glass disk; if the abnormal object exists in the second area corresponding to the target element according to the first image information, the target element is marked abnormally, wherein the non-detection area comprises the second area, the problem that due to the individual difference of the elements, individual elements jump out of the glass detection area, the elements which are not subjected to appearance detection are easily recovered into the same recovery box together with the elements which are subjected to appearance detection is solved, if the elements which are not subjected to appearance detection and the detected qualified elements are recovered into the qualified product recovery box together, the risk that defective products exist in the qualified products of customers is solved, whether the abnormal object exists in the detection area and the non-detection area on the glass disc can be monitored, and therefore mixed materials are prevented from occurring.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the embodiments will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present invention and therefore should not be considered as limiting the scope, and for those skilled in the art, other related drawings can be obtained according to the drawings without inventive efforts.
FIG. 1 is a flow chart of a detection method in an embodiment of the invention;
fig. 1a is a schematic diagram of an abnormal object existing in a second area according to an embodiment of the present invention;
FIG. 1b is a schematic diagram of an abnormal object existing in a second area according to another embodiment of the present invention;
FIG. 1c is a schematic illustration of a target distance between an anomalous object and a target element in an embodiment of the invention;
FIG. 1d is a schematic structural diagram of an appearance inspection apparatus according to an embodiment of the present invention;
FIG. 2 is a schematic structural diagram of a detecting device according to an embodiment of the present invention;
fig. 3 is a schematic structural diagram of an electronic device in an embodiment of the present invention;
fig. 4 is a schematic structural diagram of a computer-readable storage medium containing a computer program in an embodiment of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be further noted that, for the convenience of description, only some structures related to the present invention are shown in the drawings, not all of them. In addition, the embodiments and features of the embodiments in the present invention may be combined with each other without conflict.
Before discussing exemplary embodiments in more detail, it should be noted that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although a flowchart may describe the operations (or steps) as a sequential process, many of the operations can be performed in parallel, concurrently or simultaneously. In addition, the order of the operations may be re-arranged. The process may be terminated when its operations are completed, but may have additional steps not included in the figure. The processes may correspond to methods, functions, procedures, subroutines, and the like. In addition, the embodiments and features of the embodiments in the present invention may be combined with each other without conflict.
The term "include" and variations thereof as used herein are intended to be open-ended, i.e., "including but not limited to". The term "based on" is "based at least in part on". The term "one embodiment" means "at least one embodiment".
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures. Meanwhile, in the description of the present invention, the terms "first", "second", and the like are used only for distinguishing the description, and are not to be construed as indicating or implying relative importance.
Fig. 1 is a flowchart of a detection method provided in an embodiment of the present invention, where this embodiment is applicable to a situation of element detection, and the method may be executed by a detection apparatus in an embodiment of the present invention, where the detection apparatus may be implemented in a software and/or hardware manner, and as shown in fig. 1, the method specifically includes the following steps:
s110, acquiring first image information of a first area acquired by the first camera, wherein the first area comprises: a detection region and a non-detection region on the glass disk.
The number of the cameras is at least one, the number of the first cameras is related to the shooting range of the first cameras, only one first camera is needed if the shooting range of the first cameras comprises a detection area and a non-detection area on the glass disc, and the definition is high, and the number of the first cameras is determined according to the shooting range of the first cameras, the detection area and the non-detection area on the glass disc if the shooting range of the first cameras is smaller than the detection area and the non-detection area on the glass disc.
The first area may be an area within a certain range inside and outside the normal glass track with the normal glass detection track as a center.
The detection area is an area for detecting the appearance of the element, and for example, if the element is in the area a, the appearance of the element can be detected, and as shown in fig. 1a, an area 8 corresponding to a normal track is a detection area.
For example, as shown in fig. 1a, the area 1 where no component remains is a non-detection area, the area 2 where no component remains is a non-detection area, the component 4 is in the non-detection area, and is easily recovered to a non-defective product recovery box along with the defective component 6 in the detection area, and the component 5 is in the non-detection area, and is easily recovered to the non-defective product recovery box along with the defective component 7 in the detection area, so that a risk of defective products in the defective products of customers may occur.
Specifically, the first image information of the first area acquired by the first camera may be, for example, as shown in fig. 1a, image information of the detection area 8 corresponding to the normal track acquired by the first camera and the non-detection areas 1 and 2 corresponding to the areas where no component remains are acquired.
The detection method provided by the embodiment of the invention is applied to appearance detection equipment, and the appearance detection equipment comprises the following steps: the device comprises a glass disc, a first camera, a second camera, a vibrating disc and a pneumatic element, wherein the elements are arranged in a line through the vibrating disc and then vibrated on the glass disc, the glass disc rotates at a certain speed to drive the elements to move to a photographing position of the second camera for surface appearance flaw detection, first image information of a detection area and a non-detection area on the glass disc is collected through the first camera, if a detection result of a target element is qualified, and an abnormal object exists in a second area corresponding to the target element according to the first image information, abnormal marking is carried out on the target element, the target element is recovered to a unqualified product recovery box through the pneumatic element, wherein the number of the first camera is at least one, the number of the second cameras is related to the number of surfaces detected by appearance, for example, if six surfaces of the hexahedral microminiature electronic component are detected, 6 second cameras are required to be arranged; if three surfaces of the hexahedral microminiature electronic component are detected, 3 second cameras need to be arranged, or the number of the second cameras can be appropriately reduced by improving the shooting accuracy of the second cameras, which is not limited in the embodiment of the present invention.
And S120, if it is determined that an abnormal object exists in a second area corresponding to the target element according to the first image information, performing abnormal marking on the target element, wherein the non-detection area comprises the second area.
The abnormal object may be an element or another object, which is not limited in this embodiment of the present invention.
Wherein the second region is a non-detection region. And the second region is a non-detection region around the target element, for example, as shown in fig. 1a, the second region corresponding to the element 6 is a region 3. It should be noted that, in fig. 1a, the second region is a circular region, but the second region in the embodiment of the present invention may also be a square region, an oval region, or a triangular region, and fig. 1a merely illustrates that the second region may be a circular region, and the shape of the second region is not limited in the embodiment of the present invention.
Specifically, if it is determined that an abnormal object exists in the second region corresponding to the target element according to the first image information, the method for performing the abnormal marking on the target element may be: determining whether an abnormal object exists in the second region corresponding to the target element according to the first image information, and if an abnormal object exists in the second region corresponding to the target element, performing an abnormal marking on the target element, for example, as shown in fig. 1a, if an element 4 exists in the second region 3 corresponding to the element 6, performing an abnormal marking on the element 6. If it is determined that an abnormal object exists in the second region corresponding to the target element according to the first image information, the method for performing abnormal marking on the target element may further be: determining whether an abnormal object exists in a second region corresponding to the target element according to the first image information, if the abnormal object exists in the second region corresponding to the target element, acquiring a target distance between the abnormal object and the target element, and if the target distance is smaller than or equal to a first distance threshold, performing abnormal marking on the target element; and recovering the target element carrying the abnormal mark into the first recovery box. And if the target distance is greater than the first distance threshold value, recovering the target element into a second recovery box. For example, as shown in fig. 1a, if there is a component 4 in the second area 3 corresponding to the component 6, the distance between the component 4 and the component 6 is obtained, if the distance between the component 4 and the component 6 is less than or equal to the first distance threshold, the component 6 is abnormally marked, the component 6 is recovered to the second recovery box, if there is a component 5 in the second area corresponding to the component 7, the distance between the component 7 and the component 5 is obtained, and if the distance between the component 7 and the component 5 is greater than the first distance threshold, the component 7 is recovered to the second recovery box. If it is determined that an abnormal object exists in the second region corresponding to the target element according to the first image information, the method for performing the abnormal marking on the target element may further be: if it is determined that a first abnormal object exists in the region corresponding to the first element and a first abnormal object exists in the region corresponding to the second element according to the target image, acquiring a first distance between the first abnormal object and the first element and a second distance between the first abnormal object and the second element; if the first distance is larger than the second distance, the second element is marked abnormally; and if the first distance is smaller than or equal to the second distance, carrying out abnormal marking on the first element. For example, as shown in fig. 1b, if there are some components 4 in the second region 3 corresponding to the component 6 and some components 4 in the second region 9 corresponding to the component 10, the distance between the component 4 and the component 6 and the distance between the component 4 and the component 10 are obtained, and the distance between the component 4 and the component 6 is smaller than the distance between the component 4 and the component 10, the component 6 is marked with an abnormality.
It should be noted that, if it is determined that an abnormal object exists in the second region corresponding to the target element according to the first image information, the performing an abnormal mark on the target element may be: before appearance detection is carried out on the target element, if an abnormal object exists in a second area corresponding to the target element according to the first image information, abnormal marking is carried out on the target element, and appearance detection does not need to be carried out on the target element; if it is determined that an abnormal object exists in the second region corresponding to the target element according to the first image information, the abnormal marking of the target element may also be: if the target element is subjected to appearance detection, if the detection result is qualified, whether an abnormal object exists in the second area corresponding to the target element is judged according to the first image information, if the abnormal object exists, the target element is subjected to abnormal marking, and if the target element is not subjected to appearance detection, the foreign object judgment is not required according to the first image information.
Optionally, if it is determined that an abnormal object exists in the second region corresponding to the target element according to the first image information, performing abnormal marking on the target element includes:
judging whether an abnormal object exists in a second area corresponding to the target element according to the first image information;
if an abnormal object exists, acquiring a target distance between the target element and the abnormal object;
if the target distance is smaller than or equal to a first distance threshold value, carrying out abnormity marking on the target element;
and recovering the target element carrying the abnormal mark into the first recovery box.
Wherein the first recovery box is a defective recovery box.
The manner of obtaining the target distance between the target element and the abnormal object may be: acquiring the distance between the central point of the target element and the central point of the abnormal object; the manner of acquiring the target distance between the target element and the abnormal object may also be: the distance between the target element and the nearest vertex of the abnormal object is obtained, as shown in fig. 1c, and the way of obtaining the distance between the element 4 and the element 6 may be any one shown in the figure. It should be noted that the manner of acquiring the target distance between the target element and the abnormal object has an influence on the first distance threshold, and the first distance thresholds corresponding to different acquisition manners may be different.
The first distance threshold may be set by a user or a system, which is not limited in this embodiment of the present invention.
The method for abnormally marking the target element may be the same as the method for abnormally marking the defective element. After the target element is abnormally marked, the target element and the detected unqualified element can be collected into an unqualified product recovery box together.
Optionally, the method further includes:
and if the target distance is greater than the first distance threshold value, recovering the target element into a second recovery box.
Wherein, the second recovery box is a qualified product recovery box.
Specifically, if the target distance is greater than the first distance threshold, the target element may be recovered into the second recovery box by: and if the target distance is greater than the first distance threshold value, recovering the target component to the qualified product recovery box by starting the component.
Optionally, the target element includes: a first element and a second element;
correspondingly, if it is determined that an abnormal object exists in the second region corresponding to the target element according to the first image information, performing abnormal marking on the target element includes:
if it is determined that a first abnormal object exists in the region corresponding to the first element and a first abnormal object exists in the region corresponding to the second element according to the target image, acquiring a first distance between the first abnormal object and the first element and a second distance between the first abnormal object and the second element;
if the first distance is larger than the second distance, the second element is marked abnormally;
and if the first distance is smaller than or equal to the second distance, carrying out abnormal marking on the first element.
Specifically, if it is determined that a first abnormal object exists in a region corresponding to the first element and a first abnormal object exists in a region corresponding to the second element according to the target image, a first distance between the first abnormal object and the first element and a second distance between the first abnormal object and the second element are obtained; if the first distance is larger than the second distance, the second element is marked abnormally; if the first distance is less than or equal to the second distance, the first element is marked as abnormal, for example, as shown in fig. 1b, if there is a part of the element 4 in the second region 3 corresponding to the element 6, and there is a part of the element 4 in the second region 9 corresponding to the element 10, the distance between the element 4 and the element 6, and the distance between the element 4 and the element 10, and the distance between the element 4 and the element 6 is less than the distance between the element 4 and the element 10, the element 6 is marked as abnormal.
Optionally, the appearance detecting device further includes: a vibrating disk and a second camera;
correspondingly, before acquiring the image information of the first area acquired by the first camera, the method further includes:
controlling the vibration disk to vibrate so as to enable the element to vibrate onto the glass disk, wherein the glass disk rotates at a preset speed;
acquiring second image information of a detection area on the glass disc through the second camera;
and performing appearance detection on the elements in the detection area on the glass disc according to the second image information.
The number of the second cameras is related to the number of the surfaces detected by the appearance, for example, if six surfaces of a hexahedral microminiature electronic component are detected, 6 second cameras need to be arranged; if three surfaces of the hexahedral micro electronic component are detected, 3 second cameras need to be arranged, or the number of the second cameras can be appropriately reduced by improving the shooting accuracy of the second cameras, which is not limited in the embodiment of the present invention.
As shown in fig. 1d, the detection method provided by the embodiment of the present invention is applied to an appearance detection device, where the appearance detection device includes: the device comprises a glass disc, a first camera (not shown in the figure), a second camera (not shown in the figure), a vibrating disc (not shown in the figure) and a pneumatic element (not shown in the figure), wherein the elements are arranged in a line through the vibrating disc and then vibrated onto the glass disc, the glass disc rotates at a certain speed to drive the elements to move to a photographing position of the second camera for surface appearance flaw detection, first image information of a detection area and a non-detection area on the glass disc is collected through the first camera, if a target element detection result is qualified, and an abnormal object is determined to exist in a second area corresponding to the target element according to the first image information, the target element is marked abnormally, and the target element is recovered to an unqualified product recovery box through the pneumatic element.
Optionally, if it is determined that an abnormal object exists in the second region corresponding to the target element according to the first image information, performing abnormal marking on the target element includes:
and if the target element is a qualified element and the abnormal object exists in the second area corresponding to the target element according to the first image information, carrying out abnormal marking on the target element.
Specifically, if the target element is a qualified element and it is determined that an abnormal object exists in a second region corresponding to the target element according to the first image information, the target element is marked abnormally, for example, the vibration of the vibration disk is controlled to vibrate the element onto the glass disk, wherein the glass disk rotates at a preset speed; acquiring second image information of a detection area on the glass disc through the second camera; and performing appearance detection on the elements in the detection area on the glass disc according to the second image information, if the target element is a qualified element according to the appearance detection result, determining whether an abnormal object exists in the second area corresponding to the target element according to the first image information, and if so, performing abnormal marking on the target element.
According to the embodiment of the invention, whether residual elements exist in a certain position area of the inner ring and the outer ring of a normal material track or not is monitored by using another high-speed camera. If an abnormal element is detected, the element with the normal track can be marked, and the element can not be recycled to the qualified product recycling box, so that the material mixing is prevented. In addition, the embodiment of the invention is provided with a specially customized DSP chip IMXRT2, and can realize the real-time position tracking of 80 MHz. Compared with a traditional PLC or PC operating system, the position tracking precision of the vision system and the screening system is greatly improved, and meanwhile, the system has higher stability.
According to the technical scheme of the embodiment, first image information of a first area acquired by a first camera is acquired, wherein the first area comprises: a detection region and a non-detection region on the glass disk; if the abnormal object exists in the second area corresponding to the target element according to the first image information, the target element is marked abnormally, wherein the non-detection area comprises the second area, the problem that due to the individual difference of the elements, individual elements jump out of the glass detection area, the elements which are not subjected to appearance detection are easily recovered into the same recovery box together with the elements which are subjected to appearance detection is solved, if the elements which are not subjected to appearance detection and the detected qualified elements are recovered into the qualified product recovery box together, the risk that defective products exist in the qualified products of customers is solved, whether the abnormal object exists in the detection area and the non-detection area on the glass disc can be monitored, and therefore mixed materials are prevented from occurring.
Fig. 2 is a schematic structural diagram of a detection apparatus according to an embodiment of the present invention. The embodiment may be applicable to the case of detecting an element, the apparatus may be implemented in a software and/or hardware manner, and the detecting apparatus may be integrated in any device that provides an element appearance detecting function, as shown in fig. 2, where the detecting apparatus specifically includes: an acquisition module 210 and a marking module 220.
The acquisition module is configured to acquire first image information of a first area acquired by the first camera, where the first area includes: a detection region and a non-detection region on the glass disk;
and a marking module, configured to perform abnormal marking on the target element if it is determined that an abnormal object exists in a second region corresponding to the target element according to the first image information, where the non-detection region includes the second region.
Optionally, the marking module is specifically configured to:
judging whether an abnormal object exists in a second area corresponding to the target element according to the first image information;
if an abnormal object exists, acquiring a target distance between the target element and the abnormal object;
if the target distance is smaller than or equal to a first distance threshold value, carrying out abnormity marking on the target element;
and recovering the target element carrying the abnormal mark into the first recovery box.
Optionally, the marking module is specifically configured to:
and if the target distance is greater than the first distance threshold value, recovering the target element into a second recovery box.
Optionally, the target element includes: a first element and a second element;
correspondingly, the marking module is specifically configured to:
if it is determined that a first abnormal object exists in the region corresponding to the first element and a first abnormal object exists in the region corresponding to the second element according to the target image, acquiring a first distance between the first abnormal object and the first element and a second distance between the first abnormal object and the second element;
if the first distance is larger than the second distance, the second element is marked abnormally;
and if the first distance is smaller than or equal to the second distance, carrying out abnormal marking on the first element.
Optionally, the appearance detecting device further includes: a vibrating disk and a second camera;
correspondingly, the detection device further comprises:
the control module is used for controlling the vibration disc to vibrate so as to enable the element to vibrate on the glass disc, wherein the glass disc rotates at a preset speed;
the acquisition module is used for acquiring second image information of the detection area on the glass disc through the second camera;
and the detection module is used for performing appearance detection on the elements in the detection area on the glass disc according to the second image information.
Optionally, the marking module is specifically configured to:
and if the target element is a qualified element and the abnormal object exists in the second area corresponding to the target element according to the first image information, carrying out abnormal marking on the target element.
The product can execute the method provided by any embodiment of the invention, and has corresponding functional modules and beneficial effects of the execution method.
According to the technical scheme of the embodiment, first image information of a first area acquired by a first camera is acquired, wherein the first area comprises: a detection region and a non-detection region on the glass disk; if the abnormal object exists in the second area corresponding to the target element according to the first image information, the target element is marked abnormally, wherein the non-detection area comprises the second area, the problem that due to the individual difference of the elements, individual elements jump out of the glass detection area, the elements which are not subjected to appearance detection are easily recovered into the same recovery box together with the elements which are subjected to appearance detection is solved, if the elements which are not subjected to appearance detection and the detected qualified elements are recovered into the qualified product recovery box together, the risk that defective products exist in the qualified products of customers is solved, whether the abnormal object exists in the detection area and the non-detection area on the glass disc can be monitored, and therefore mixed materials are prevented from occurring.
Fig. 3 is a schematic structural diagram of an electronic device in an embodiment of the present invention. FIG. 3 illustrates a block diagram of an exemplary electronic device 12 suitable for use in implementing embodiments of the present invention. The electronic device 12 shown in fig. 3 is only an example and should not bring any limitations to the function and scope of use of the embodiments of the present invention.
As shown in FIG. 3, electronic device 12 is in the form of a general purpose computing device. The components of electronic device 12 may include, but are not limited to: one or more processors or processing units 16, a system memory 28, and a bus 18 that couples various system components including the system memory 28 and the processing unit 16.
The system Memory 28 may include computer system readable media in the form of volatile Memory, such as Random Access Memory (RAM) 30 and/or cache Memory 32. The electronic device 12 may further include other removable/non-removable, volatile/nonvolatile computer system storage media. By way of example only, storage system 34 may be used to read from and write to non-removable, nonvolatile magnetic media (not shown in FIG. 3, and commonly referred to as a "hard drive"). Although not shown in FIG. 3, a magnetic disk drive for reading from and writing to a removable, nonvolatile magnetic disk (e.g., a "floppy disk") and an optical disk drive for reading from or writing to a removable, nonvolatile optical disk (a Compact disk-Read Only Memory (CD-ROM)), Digital Video disk (DVD-ROM), or other optical media may be provided. In these cases, each drive may be connected to bus 18 by one or more data media interfaces. System memory 28 may include at least one program product having a set (e.g., at least one) of program modules that are configured to carry out the functions of embodiments of the invention.
A program/utility 40 having a set (at least one) of program modules 42 may be stored, for example, in system memory 28, such program modules 42 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each of which examples or some combination thereof may comprise an implementation of a network environment. Program modules 42 generally carry out the functions and/or methodologies of the described embodiments of the invention.
The processing unit 16 executes various functional applications and data processing by running programs stored in the system memory 28, for example, to implement the detection method provided by the embodiment of the present invention:
acquiring first image information of a first area acquired by the first camera, wherein the first area comprises: a detection region and a non-detection region on the glass disk;
and if the abnormal object exists in a second area corresponding to the target element according to the first image information, performing abnormal marking on the target element, wherein the non-detection area comprises the second area.
Fig. 4 is a schematic structural diagram of a computer-readable storage medium containing a computer program according to an embodiment of the present invention. Embodiments of the present invention provide a computer-readable storage medium 61, on which a computer program 610 is stored, which when executed by one or more processors implements the detection method as provided by all inventive embodiments of the present application:
acquiring first image information of a first area acquired by the first camera, wherein the first area comprises: a detection region and a non-detection region on the glass disk;
and if the abnormal object exists in a second area corresponding to the target element according to the first image information, performing abnormal marking on the target element, wherein the non-detection area comprises the second area.
Any combination of one or more computer-readable media may be employed. The computer readable medium may be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
In some embodiments, the clients, servers may communicate using any currently known or future developed network Protocol, such as HTTP (Hyper Text Transfer Protocol), and may interconnect with any form or medium of digital data communication (e.g., a communications network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), the Internet (e.g., the Internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future developed network.
The computer readable medium may be embodied in the electronic device; or may exist separately without being assembled into the electronic device.
Computer program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems that perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The units described in the embodiments of the present disclosure may be implemented by software or hardware. Where the name of an element does not in some cases constitute a limitation on the element itself.
The functions described herein above may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), systems on a chip (SOCs), Complex Programmable Logic Devices (CPLDs), and the like.
In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.
Claims (8)
1. A detection method applied to an appearance detection device, the appearance detection device comprising: glass disc and first camera, the detection method includes:
acquiring first image information of a first area acquired by the first camera, wherein the first area comprises: a detection region and a non-detection region on the glass disk;
if it is determined that an abnormal object exists in a second region corresponding to the target element according to the first image information, performing abnormal marking on the target element, wherein the non-detection region comprises the second region;
if it is determined that an abnormal object exists in the second region corresponding to the target element according to the first image information, performing abnormal marking on the target element includes:
judging whether an abnormal object exists in a second area corresponding to the target element according to the first image information;
if an abnormal object exists, acquiring a target distance between the target element and the abnormal object;
if the target distance is smaller than or equal to a first distance threshold value, carrying out abnormity marking on the target element;
and recovering the target element carrying the abnormal mark into the first recovery box.
2. The method of claim 1, further comprising:
and if the target distance is greater than the first distance threshold value, recovering the target element into a second recovery box.
3. The method of claim 1, wherein the target element comprises: a first element and a second element;
correspondingly, if it is determined that an abnormal object exists in the second region corresponding to the target element according to the first image information, performing abnormal marking on the target element includes:
if it is determined that a first abnormal object exists in the region corresponding to the first element and a first abnormal object exists in the region corresponding to the second element according to the target image, acquiring a first distance between the first abnormal object and the first element and a second distance between the first abnormal object and the second element;
if the first distance is larger than the second distance, the second element is marked abnormally;
and if the first distance is smaller than or equal to the second distance, carrying out abnormal marking on the first element.
4. The method of claim 1, wherein the appearance inspection device further comprises: a vibrating disk and a second camera;
correspondingly, before acquiring the image information of the first area acquired by the first camera, the method further includes:
controlling the vibration disk to vibrate so as to enable the element to vibrate onto the glass disk, wherein the glass disk rotates at a preset speed;
acquiring second image information of a detection area on the glass disc through the second camera;
and performing appearance detection on the elements in the detection area on the glass disc according to the second image information.
5. The method according to claim 4, wherein if it is determined from the first image information that an abnormal object exists in the second region corresponding to the target element, the performing an abnormality marking on the target element comprises:
and if the target element is a qualified element and the abnormal object exists in the second area corresponding to the target element according to the first image information, carrying out abnormal marking on the target element.
6. A detection apparatus, provided on an appearance detection device, the appearance detection device comprising: glass disc and first camera, detection device includes:
an obtaining module, configured to obtain first image information of a first area acquired by the first camera, where the first area includes: a detection region and a non-detection region on the glass disk;
a marking module, configured to perform abnormal marking on a target element if it is determined that an abnormal object exists in a second region corresponding to the target element according to the first image information, where the non-detection region includes the second region;
wherein the marking module is specifically configured to:
judging whether an abnormal object exists in a second area corresponding to the target element according to the first image information;
if an abnormal object exists, acquiring a target distance between the target element and the abnormal object;
if the target distance is smaller than or equal to a first distance threshold value, carrying out abnormity marking on the target element;
and recovering the target element carrying the abnormal mark into the first recovery box.
7. An electronic device, comprising:
one or more processors;
a memory for storing one or more programs;
the one or more programs, when executed by the one or more processors, cause the processors to implement the method of any of claims 1-5.
8. A computer-readable storage medium containing a computer program, on which the computer program is stored, characterized in that the program, when executed by one or more processors, implements the method according to any one of claims 1-5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110908522.1A CN113643250B (en) | 2021-08-09 | 2021-08-09 | Detection method, device, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110908522.1A CN113643250B (en) | 2021-08-09 | 2021-08-09 | Detection method, device, equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113643250A CN113643250A (en) | 2021-11-12 |
| CN113643250B true CN113643250B (en) | 2022-09-16 |
Family
ID=78420185
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110908522.1A Active CN113643250B (en) | 2021-08-09 | 2021-08-09 | Detection method, device, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113643250B (en) |
Family Cites Families (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2009198392A (en) * | 2008-02-22 | 2009-09-03 | Nikon Corp | Surface inspection device |
| CN204064936U (en) * | 2014-07-21 | 2014-12-31 | 重庆颖泉标准件有限公司 | Machine vision detection mechanism |
| US20180211373A1 (en) * | 2017-01-20 | 2018-07-26 | Aquifi, Inc. | Systems and methods for defect detection |
| CN107622486A (en) * | 2017-08-18 | 2018-01-23 | 陕西维视数字图像技术有限公司 | A kind of product batch mixing defective vision detecting system |
| JP7008528B2 (en) * | 2018-02-09 | 2022-01-25 | 東芝Ｉｔコントロールシステム株式会社 | Visual inspection equipment |
| CN110118785A (en) * | 2019-05-07 | 2019-08-13 | 鲁班嫡系机器人（深圳）有限公司 | Detection method, detection device and industrial equipment |
| CN110118786B (en) * | 2019-05-07 | 2022-05-17 | 鲁班嫡系机器人（深圳）有限公司 | Detection method, detection device and industrial equipment |
| CN210138854U (en) * | 2019-05-17 | 2020-03-13 | 南京微伽自动化技术有限公司 | Automatic defect detection equipment for electronic components |
| CN111860301A (en) * | 2020-07-17 | 2020-10-30 | 苏州英诺威视图像有限公司 | Component position detection method and system |
| CN111921890A (en) * | 2020-08-24 | 2020-11-13 | 东莞市正邦自动化科技有限公司 | Novel image screening mechanism and using method thereof |
-
2021
- 2021-08-09 CN CN202110908522.1A patent/CN113643250B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN113643250A (en) | 2021-11-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| TWI729331B (en) | Image annotation information processing method, device, server and system | |
| US11276158B2 (en) | Method and apparatus for inspecting corrosion defect of ladle | |
| US10679066B2 (en) | Best image grab from video with digital grid assistance for aviation engine borescope inspection | |
| US11676257B2 (en) | Method and device for detecting defect of meal box, server, and storage medium | |
| US10664966B2 (en) | Anomaly detection using image-based physical characterization | |
| CN109543680B (en) | Method, apparatus, device, and medium for determining location of point of interest | |
| CN111784663A (en) | Method and device for detecting parts, electronic equipment and storage medium | |
| CN111693534A (en) | Surface defect detection method, model training method, device, equipment and medium | |
| US10860901B2 (en) | Detection system, information processing apparatus, evaluation method, and program | |
| CN110910415A (en) | Parabolic detection method, device, server and computer readable medium | |
| CN111310815A (en) | Image recognition method and device, electronic equipment and storage medium | |
| CN111402220B (en) | Method and device for acquiring information | |
| US20170180293A1 (en) | Contextual temporal synchronization markers | |
| CN116559177A (en) | Defect detection method, device, equipment and storage medium | |
| CN113643250B (en) | Detection method, device, equipment and storage medium | |
| CN113936232A (en) | Screen fragmentation identification method, device, equipment and storage medium | |
| CN111401229B (en) | Automatic labeling method and device for small visual targets and electronic equipment | |
| CN111951328A (en) | Object position detection method, device, equipment and storage medium | |
| US11354793B2 (en) | Object detection with missing annotations in visual inspection | |
| US11720969B2 (en) | Detecting vehicle identity and damage status using single video analysis | |
| US11501426B2 (en) | Tracking of mass-produced products | |
| CN117824974B (en) | Switch drop test method, device, electronic equipment and computer readable medium | |
| CN113762308A (en) | Training method, classification method, device, medium and equipment of classification model | |
| CN111062920B (en) | Method and device for generating semiconductor detection report | |
| US11961284B2 (en) | Task appropriateness determination apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP01 | Change in the name or title of a patent holder | ||
| CP01 | Change in the name or title of a patent holder |
Address after: 215000 room 801, 8 / F, building N1, No. 88, Dongchang Road, Suzhou Industrial Park, Suzhou City, Jiangsu Province Patentee after: Suzhou Yingnuo Weishi Semiconductor Equipment Co.,Ltd. Address before: 215000 room 801, 8 / F, building N1, No. 88, Dongchang Road, Suzhou Industrial Park, Suzhou City, Jiangsu Province Patentee before: Suzhou innovision image Co.,Ltd. |