CN116071365A - Part detection method, device, equipment and storage medium - Google Patents

Part detection method, device, equipment and storage medium Download PDF

Info

Publication number
CN116071365A
CN116071365A CN202310320587.3A CN202310320587A CN116071365A CN 116071365 A CN116071365 A CN 116071365A CN 202310320587 A CN202310320587 A CN 202310320587A CN 116071365 A CN116071365 A CN 116071365A
Authority
CN
China
Prior art keywords
projection direction
preset
preset projection
contour
identification number
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202310320587.3A
Other languages
Chinese (zh)
Inventor
谢晖
金作徽
余善善
易建业
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ji Hua Laboratory
Original Assignee
Ji Hua Laboratory
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ji Hua Laboratory filed Critical Ji Hua Laboratory
Priority to CN202310320587.3A priority Critical patent/CN116071365A/en
Publication of CN116071365A publication Critical patent/CN116071365A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • G06T7/0004Industrial image inspection
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01BMEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B11/00Measuring arrangements characterised by the use of optical techniques
    • G01B11/24Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/13Edge detection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10Character recognition
    • G06V30/19Recognition using electronic means
    • G06V30/191Design or setup of recognition systems or techniques; Extraction of features in feature space; Clustering techniques; Blind source separation
    • G06V30/19173Classification techniques
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30108Industrial image inspection
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02PCLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/30Computing systems specially adapted for manufacturing

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Theoretical Computer Science (AREA)
  • Quality & Reliability (AREA)
  • Multimedia (AREA)
  • Image Analysis (AREA)

Abstract

The present disclosure relates to a part inspection method, apparatus, device, and storage medium. According to the embodiment of the disclosure, the identification number of the part to be tested is obtained; acquiring actual outer contours of the parts to be tested in all preset projection directions and standard outer contours of target parts corresponding to the identification numbers in all preset projection directions; calculating the contour similarity of the actual outer contour of the preset projection direction relative to the standard outer contour of the preset projection direction aiming at each preset projection direction; when the contour similarity corresponding to each preset projection direction is larger than a preset threshold value, the part to be detected is determined to be a qualified part of the target part, the accuracy of the contour detection of the part can be improved, the contour of the corresponding part can be automatically compared and detected according to the part identification number, the efficiency of the part detection is greatly improved, and the large-scale management of the part detection and the informatization construction of the whole process are facilitated.

Description

Part detection method, device, equipment and storage medium
Technical Field
The disclosure relates to the technical field of visual inspection, and in particular relates to a part inspection method, a device, equipment and a storage medium.
Background
In the product manufacturing industry, a plurality of problems exist in the classification and management of parts due to various factors, complicated shapes, numerous and miscellaneous supply channels and the like, and great challenges are brought to informatization and intellectualization of factories. For example, mold inserts, which are of a different type of non-standard part than the largest type of mold part due to their functional specificity, may each come from different processing plants, arrive at the product at different times throughout the production cycle, and are diverted to various stations during assembly of the complete set of molds, which can lead to confusion in material management.
At present, the contour of a part with complex modeling is detected mainly by manpower, and whether the part can be qualified and put in storage is determined according to whether the contour of the part meets the requirement, however, the mode requires a detector to have certain detection experience on the part, the detection efficiency is low, the detection accuracy is low, and the large-scale management and the informatization construction of the whole flow are not facilitated.
Disclosure of Invention
In order to solve the technical problems, the present disclosure provides a part detection method, a device, equipment and a storage medium.
A first aspect of an embodiment of the present disclosure provides a part inspection method, including:
Acquiring an identification number of a part to be tested;
acquiring actual outer contours of the parts to be tested in all preset projection directions and standard outer contours of target parts corresponding to the identification numbers in all preset projection directions;
calculating the contour similarity of the actual outer contour of the preset projection direction relative to the standard outer contour of the preset projection direction aiming at each preset projection direction;
and when the contour similarity corresponding to each preset projection direction is larger than a preset threshold value, determining that the part to be detected is a qualified part of the target part.
A second aspect of an embodiment of the present disclosure provides a part inspection apparatus, the apparatus comprising:
the first acquisition module is used for acquiring the identification number of the part to be tested;
the second acquisition module is used for acquiring the actual outer contour of the part to be detected in each preset projection direction and the standard outer contour of the target part corresponding to the identification number in each preset projection direction;
the calculation module is used for calculating the contour similarity of the actual outer contour of the preset projection direction relative to the standard outer contour of the preset projection direction aiming at each preset projection direction;
the first determining module is used for determining that the part to be detected is a qualified part of the target part when the contour similarity corresponding to each preset projection direction is larger than a preset threshold value.
A third aspect of the disclosed embodiments provides a computer apparatus comprising:
a memory and a processor, wherein the memory stores a computer program which, when executed by the processor, can implement the part inspection method of the first aspect described above.
A fourth aspect of the embodiments of the present disclosure provides a computer-readable storage medium in which a computer program is stored, which when executed by a processor, can implement the part inspection method of the first aspect.
Compared with the prior art, the technical scheme provided by the embodiment of the disclosure has the following advantages:
according to the embodiment of the disclosure, the identification number of the part to be tested is obtained; acquiring actual outer contours of the parts to be tested in all preset projection directions and standard outer contours of target parts corresponding to the identification numbers in all preset projection directions; calculating the contour similarity of the actual outer contour of the preset projection direction relative to the standard outer contour of the preset projection direction aiming at each preset projection direction; when the contour similarity corresponding to each preset projection direction is larger than a preset threshold, determining that the part to be detected is a qualified part of the target part, and determining whether the contour of the part to be detected is qualified or not by comparing the contour similarity of the actual outer contour of the part to be detected in each preset projection direction relative to the standard outer contour of the part, so that the accuracy of the contour detection of the part can be improved, the contour of the corresponding part can be automatically compared and detected according to the part identification number, the efficiency of the part detection is greatly improved, and the large-scale management of the part detection and the informatization construction of the whole flow are facilitated.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the disclosure and together with the description, serve to explain the principles of the disclosure.
In order to more clearly illustrate the embodiments of the present disclosure or the solutions in the prior art, the drawings that are required for the description of the embodiments or the prior art will be briefly described below, and it will be obvious to those skilled in the art that other drawings can be obtained from these drawings without inventive effort.
FIG. 1 is a flow chart of a part inspection method provided by an embodiment of the present disclosure;
FIG. 2 is a flow chart of another part inspection method provided by an embodiment of the present disclosure;
FIG. 3 is a flow chart of yet another part inspection method provided by an embodiment of the present disclosure;
FIG. 4 is a schematic diagram of a component inspection apparatus according to an embodiment of the present disclosure;
fig. 5 is a schematic structural diagram of a computer device according to an embodiment of the present disclosure.
Detailed Description
In order that the above objects, features and advantages of the present disclosure may be more clearly understood, a further description of aspects of the present disclosure will be provided below. It should be noted that, without conflict, the embodiments of the present disclosure and features in the embodiments may be combined with each other.
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present disclosure, but the present disclosure may be practiced otherwise than as described herein; it will be apparent that the embodiments in the specification are only some, but not all, embodiments of the disclosure.
It should be understood that the various steps recited in the method embodiments of the present disclosure may be performed in a different order and/or performed in parallel. Furthermore, method embodiments may include additional steps and/or omit performing the illustrated steps. The scope of the present disclosure is not limited in this respect.
It should be noted that in this document, relational terms such as "first" and "second" and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
It should be noted that references to "one", "a plurality" and "a plurality" in this disclosure are intended to be illustrative rather than limiting, and those of ordinary skill in the art will appreciate that "one or more" is intended to be understood as "one or more" unless the context clearly indicates otherwise.
In the product manufacturing industry, a plurality of problems exist in the classification and management of parts due to various factors, complicated shapes, numerous and miscellaneous supply channels and the like, and great challenges are brought to informatization and intellectualization of factories. For example, mold inserts, which are of a different type of non-standard part than the largest type of mold part due to their functional specificity, may each come from different processing plants, arrive at the product at different times throughout the production cycle, and are diverted to various stations during assembly of the complete set of molds, which can lead to confusion in material management.
At present, the contour of a part with complex modeling is detected by manpower, and whether the part can be qualified and put in storage is determined according to whether the contour of the part meets the requirement, however, the mode requires a certain detection experience on the part by a detector, the detection efficiency is low, the detection accuracy is low, and the large-scale management and the full-flow informatization are not facilitated.
Aiming at the defects of the related technology in the aspect of part detection, the embodiment of the disclosure provides a part detection method, a device, equipment and a storage medium, and the method, the device, the equipment and the storage medium are used for determining whether the outline of the part to be detected is qualified or not by comparing the outline similarity of the actual outline of the part to be detected in each preset projection direction relative to the standard outline of the part, so that the accuracy of part outline detection can be improved, the outline of the corresponding part can be automatically compared and detected according to the part identification number, the part detection efficiency is greatly improved, and the large-scale management of part detection and the information construction of the whole process are facilitated.
The part inspection method provided by the embodiments of the present disclosure may be performed by a computer device, which may be understood as any device having processing and computing capabilities, including, but not limited to, mobile terminals such as smartphones, notebook computers, personal Digital Assistants (PDAs), tablet computers (PADs), etc., and stationary electronic devices such as digital TVs, desktop computers, servers, etc.
In order to better understand the inventive concepts of the embodiments of the present disclosure, the technical solutions of the embodiments of the present disclosure are described below in conjunction with exemplary embodiments.
Fig. 1 is a flowchart of a part detection method according to an embodiment of the present disclosure, and as shown in fig. 1, the part detection method provided in the embodiment may include the following steps:
step 110, obtaining the identification number of the part to be tested.
The part to be tested in the embodiments of the present disclosure may be understood as any part that is qualified by evaluating a contour, including metallic parts and non-metallic parts, such as inserts of a mold, and the like.
In the embodiments of the present disclosure, the identification number of a part may be understood as a number capable of uniquely determining identity information of the part, and may be composed of a plurality of letters and numbers. The identification number of the part can be identified and determined according to the number of the part surface inscribed during the manufacture of the part. When designing a part, a designer will compile an identification number of each part according to the information of the part, the mounting position and the like, and in order to ensure that no error occurs in processing, the identification number is usually directly carved on a specific position on the surface of the part. The number of the part can comprise information such as an identification number of the part, a production date, a manufacturer code, a production batch, a part material code and the like.
In the embodiment of the disclosure, the computer equipment can acquire the identification number of the part to be tested. Any manner in which the part identification number to be measured may be obtained may be used in the embodiments of the present disclosure, and is not limited herein.
In some embodiments, obtaining the identification number of the part under test may include steps 1101-1102:
step 1101, obtaining a numbered image of the surface of the part to be measured, wherein the numbered image comprises the identification number of the part to be measured.
In some embodiments, the numbered image of the part surface to be measured includes an identification number of the part to be measured. An image acquisition device, such as a video camera, a camera and the like, is arranged on a detection line of the part, the image acquisition device can acquire a serial number image of the surface of the part to be detected, the computer equipment can communicate with the image acquisition device, and the computer equipment can acquire the serial number image of the surface of the part to be detected from the image acquisition device.
In other embodiments, the inspector may use an image capturing device (e.g., a camera of a mobile terminal or the like) to capture a numbered image of the surface of the part to be inspected, and upload the numbered image to a computer device, which may capture the numbered image of the surface of the part to be inspected. The lens of the image acquisition device has the functions of automatic focusing and automatic exposure adjustment, so that the image can still keep good shooting quality under the condition of handheld acquisition, the reliability and stability of data are ensured, and the on-site inspector can be helped to quickly acquire effective images by adding a target shooting frame, a cross center and the like on an acquisition interface.
And 1102, carrying out character recognition on the numbered images based on a preset character recognition model to obtain the identification numbers of the parts to be detected.
In the embodiment of the disclosure, the character recognition model can be understood as a deep learning model constructed based on an optical character recognition (Optical Character Recognition, OCR) algorithm, can recognize the character shape in the image, and adopts a Fourier filtering mode to process the numbered image, so that the contrast between the character and the background is improved, the character is easier to recognize, and further the character information in the image is acquired. Specifically, the method can be based on an open source OCR model framework easy OCR, wherein the easy OCR is an open source model capable of identifying various characters, serial images are processed in a Fourier filtering mode aiming at the identification of serial characters of parts, so that the contrast between the characters and the background is improved, the characters are easier to identify, a large amount of serial image data are adopted for training an original model, an accurate character identification model is obtained, and a specific training mode can refer to the related technology and is not repeated herein.
In the embodiment of the disclosure, after the numbered image on the surface of the part to be measured is obtained, the computer device may input the numbered image into a preset character recognition model, and identify the characters in the numbered image based on the character recognition model to obtain the identification number of the part to be measured.
And 120, acquiring actual outer contours of the part to be tested in each preset projection direction and standard outer contours of the target part corresponding to the identification number in each preset projection direction.
In this embodiment of the present disclosure, the preset projection direction may be understood as a preset direction of shooting a part to be measured, and may include one or more directions of a front view projection direction, a rear view projection direction, a left side projection direction, a right side projection direction, a top view projection direction, and a bottom view projection direction, where the preset projection direction may be determined according to a profile surface to be measured of the part to be measured, the profile surface to be measured may include a profile surface having a specific function on the part to be measured, the profile surface to be measured may include a main forming surface on the part to be measured, a profile surface to be matched with a profile surface of another part to be measured in the part to be measured, and the like, or may be set as required, and is not limited herein. For example, if the contour surfaces of the part to be measured in the top view and the left side projection directions need to be matched with the contour surfaces of other parts, and the other contour surfaces do not need to be matched with the contour surfaces of other parts, the preset projection directions of the part to be measured may be determined as the top view projection directions and the left side projection directions.
In the embodiment of the disclosure, after the identification number of the part to be detected is obtained, the image acquisition device on the part detection line can acquire projection images of the part to be detected in each preset projection direction, and the computer equipment can acquire the projection images of each preset projection direction from the image acquisition device, and acquire the actual outer contour of the part to be detected in each preset projection direction by carrying out contour recognition on the projection images.
In the embodiment of the disclosure, after the identification number of the part to be measured is obtained, the computer device may obtain, from a local storage space or a server (e.g., a cloud server), a two-dimensional drawing or a three-dimensional model of the target part corresponding to the identification number of the part to be measured, and obtain, by identifying the contours in each preset projection direction in the two-dimensional drawing or the three-dimensional model, the standard outer contours of the target part in each preset projection direction. The target part corresponding to the identification number of the part to be tested refers to a qualified part corresponding to the design size requirement of the part to be tested.
Step 130, calculating, for each preset projection direction, a contour similarity of an actual outer contour of the preset projection direction relative to a standard outer contour of the preset projection direction.
The profile similarity in the embodiments of the present disclosure can be understood as the degree of similarity between two profiles, and can be used to evaluate the magnitude of the difference between the two profiles. The contour similarity can be calculated according to the correlation of invariant moment of the contour image, and the specific calculation process can refer to the related technology, which is not repeated here.
In the embodiment of the disclosure, for each preset projection direction of a part to be measured, the computer device may calculate a contour similarity of an actual outer contour of the preset projection direction relative to a standard outer contour of the preset projection direction.
For example, the definition of the contour similarity φ is as follows:
Figure SMS_1
wherein Δ is a profile difference score, the smaller the profile difference score, the higher the profile similarity;
Figure SMS_2
for the contour factor of image A, +.>
Figure SMS_3
Is the contour factor of image B.
Figure SMS_4
The hi in the formulas (3) and (4) is the actual definition of the image invariant moment Hu, which is the linear combination of the normalized center moment, and the specific calculation formula is as follows, eta mn (m, n=0,., 3) is the normalized center-to-center distance of each order of the image, sign (x) is a sign function that functions in mathematical and computer operations to take a certain number of signs (positive or negative): when x is>At 0 sign (x) =1; when x=0, sign (x) =0; when x is <At 0 sign (x) = -1.
Figure SMS_5
And 140, determining that the part to be measured is a qualified part of the target part when the contour similarity corresponding to each preset projection direction is larger than a preset threshold value.
The preset threshold in the embodiments of the present disclosure may be understood as the minimum contour precision of the target part meeting the qualification requirement, and the preset threshold may be set according to needs, for example, 0.8, which is not limited herein specifically. For example, through a large number of early test experiments, when the outline similarity of the outer outlines of the two views is more than 80%, the part recognition accuracy is more than 97.5%, and whether the outline of the part is consistent with the outline of a corresponding two-dimensional drawing or three-dimensional model can be accurately judged, so that the outline recognition of the part to be detected is realized, and whether the part to be detected is qualified is determined.
In the embodiment of the disclosure, after calculating the contour similarity of the actual outer contour of each preset projection direction of the part to be measured relative to the standard outer contour, the computer device may determine whether the contour similarity corresponding to each preset projection direction is greater than a preset threshold, and when the contour similarity corresponding to each preset projection direction is greater than the preset threshold, it is indicated that each contour surface of the part to be measured meets the contour precision required by the qualified part, and the computer device may determine that the part to be measured is the qualified part of the target part and generate the detection report.
In some embodiments, when the contour similarity corresponding to each preset projection direction is smaller than or equal to a preset threshold value, the contour surface which does not meet the contour precision required by the qualified part exists in the part to be tested, and the computer equipment can determine that the part to be tested is the unqualified part of the target part and generate a detection report. In some embodiments, an alarm may also be sent, and the alarm may include that the part to be tested is not acceptable.
According to the embodiment of the disclosure, the identification number of the part to be tested is obtained; acquiring actual outer contours of the parts to be tested in all preset projection directions and standard outer contours of target parts corresponding to the identification numbers in all preset projection directions; calculating the contour similarity of the actual outer contour of the preset projection direction relative to the standard outer contour of the preset projection direction aiming at each preset projection direction; when the contour similarity corresponding to each preset projection direction is larger than a preset threshold, determining that the part to be detected is a qualified part of the target part, and determining whether the contour of the part to be detected is qualified or not by comparing the contour similarity of the actual outer contour of the part to be detected in each preset projection direction relative to the standard outer contour of the part, so that the accuracy of the contour detection of the part can be improved, the contour of the corresponding part can be automatically compared and detected according to the part identification number, the efficiency of the part detection is greatly improved, and the large-scale management of the part detection and the informatization construction of the whole flow are facilitated.
Fig. 2 is a flowchart of a part inspection method according to an embodiment of the present disclosure, and as shown in fig. 2, the part inspection method according to the present embodiment may include the following steps:
step 210, obtaining the identification number of the part to be tested.
Step 210 in the embodiment of the present disclosure may refer to the content of step 110 described above, and will not be described herein.
Step 220, obtaining projection images of the part to be tested in each preset projection direction.
In the embodiment of the disclosure, the image acquisition device is arranged on the detection line of the part, the image acquisition device can acquire projection images of the part to be detected in each preset projection direction, and the computer equipment can acquire the projection images of the part to be detected in each preset projection direction from the image acquisition device.
In some embodiments, obtaining projection images of the part under test in respective predetermined projection directions may include steps 2201-2203:
step 2201, controlling the moving state of the part to be tested.
In the embodiment of the disclosure, the computer equipment can control the moving state of the part to be tested by controlling the movement of the movable transportation platform. The mobile transport platform is understood to mean a platform for transporting objects by means of a conveyor, which belongs to the component parts of the part detection line.
And 2202, when the part to be measured is in a moving state, controlling the linear array camera to acquire a projection image of the part to be measured in a first preset projection direction corresponding to the moving direction.
When the part to be measured is in a moving state, if a common area array camera is used for collecting projection images of the part to be measured in a first preset projection direction corresponding to the moving direction, projection distortion can be generated on the projection images in the moving direction and the non-moving direction, so that the outline in the projection images is unclear or the projection distortion is caused, wherein the area array camera is a camera for shooting one surface through one exposure. Based on this, in the embodiment of the disclosure, when the part to be measured is in a moving state, the computer device may send a control instruction to the line array camera on the detection line, and control the line array camera to obtain a projection image of the part to be measured in a first preset projection direction corresponding to the moving direction by controlling a trigger signal of the line array camera. Specifically, a line-array camera is arranged at a specific position of the part detection line, the line-array camera refers to a camera adopting a line-array image sensor, for each preset projection direction corresponding to a moving direction, the line-array camera obtains a row of images through each exposure, a plurality of rows of images in the preset projection direction are obtained through multiple exposure, and then the plurality of rows of images are spliced according to an exposure sequence to obtain a projection image in the preset projection direction. Therefore, the projection distortion of the part in the moving direction is eliminated by adopting a scanning shooting mode of the linear array camera, and the accuracy of the projection profile can be improved.
Step 2203, when the part to be measured is in a static state, controlling the area array camera to acquire a projection image of the part to be measured in a second preset projection direction, wherein the second preset projection direction is other preset projection directions except the first preset projection direction.
In the embodiment of the disclosure, when the part to be measured is in a static state, the part is in a parallel light irradiation state at this time, projection distortion is not easy to generate in the outer outline of the projection image, the computer equipment can send a control instruction to the area array camera on the detection line, and the area array camera is controlled to acquire the projection image of the part to be measured in a second preset projection direction by controlling the trigger signal of the area array camera. The second preset projection direction is other preset projection directions except the first preset projection direction.
In one embodiment, after the identification number of the part to be measured is obtained, the part to be measured can be placed on the mobile transportation platform, the computer device can control the conveying mechanism of the mobile transportation platform to run at a constant speed, further control the part to be measured to move at a constant speed from left to right on the mobile transportation platform, at this time, the computer device can send a control instruction to the line array camera on the detection line, the line array camera is controlled to obtain a projection image of the part to be measured in a first preset projection direction corresponding to the movement direction by controlling a trigger signal of the line array camera, the movement direction is from left to right, the first preset projection direction can comprise a overlooking projection direction, a forward looking projection direction and a backward looking projection direction, after the shooting of the line array camera is completed, the computer device can control the conveying mechanism of the mobile transportation platform to stop running, further control the part to be measured to be in a static state, at this time, the computer device can send a control instruction to the area array camera on the detection line, and control the area array camera to obtain a projection image of the part to be measured in a second preset projection direction by controlling the trigger signal of the area array camera, and the second preset projection direction can comprise a left-side projection direction and a forward looking projection direction.
In some embodiments of the present disclosure, reflection of light from a machined surface of a metal part may affect the definition of a projected image, so that in an area camera and a line camera on a detection line, a light source may be set to be a polarized light source, and a polarizer may be additionally installed on a lens, so as to reduce the influence of reflection of light from the metal part and improve the definition of the projected image.
In other embodiments of the present disclosure, the projection may be performed in a back-projection manner in the projection direction, so that the influence of the surface texture of the part on the extraction of the external contour may be avoided.
And 230, extracting the outline of the projection image to obtain the actual outline of the part to be tested in each preset projection direction.
In the embodiment of the disclosure, after the projection images of the part to be measured in each preset projection direction are obtained, the computer equipment can perform contour extraction on each projection image, and obtain the contour image in each projection image, so that the actual outer contour of the part to be measured in each preset projection direction can be obtained.
Step 240, obtaining projection views of the target part corresponding to the identification number in each preset projection direction.
In the embodiment of the disclosure, a two-dimensional drawing or a three-dimensional digital model of a target part corresponding to the identification number of each part may be stored in the computer device, and a two-dimensional drawing or a three-dimensional digital model of the target part corresponding to the identification number of each part may also be stored in the server, where the identification numbers of the parts and the two-dimensional drawing or the three-dimensional digital model of the target part are in one-to-one correspondence. After the identification number of the part to be measured is obtained, the computer equipment can obtain a two-dimensional drawing or a three-dimensional digital model of the target part corresponding to the identification number of the part to be measured from the computer equipment locally or a server according to the identification number of the part to be measured, and then obtain a projection view of the target part in each preset projection direction in the two-dimensional drawing of the target part, or project the three-dimensional digital model of the target part in each preset projection direction, so as to obtain a projection view of the target part in each preset projection direction.
And 250, extracting the contour of the projection view to obtain the standard outer contour of the target part in each preset projection direction.
In the embodiment of the disclosure, after obtaining the projection views of the target part in each preset projection direction, the computer device may perform contour extraction on each projection view, and obtain a contour image in each projection view, so as to obtain a standard outer contour of the target part in each preset projection direction.
Step 260, calculating, for each preset projection direction, the contour similarity of the actual outer contour of the preset projection direction relative to the standard outer contour of the preset projection direction.
And 270, determining that the part to be measured is a qualified part of the target part when the contour similarity corresponding to each preset projection direction is larger than a preset threshold value.
The content of steps 260-270 in the embodiments of the present disclosure may refer to the content of steps 130-140 described above, and will not be described here again.
Therefore, whether the outline of the part to be detected is qualified or not can be determined by comparing the outline similarity of the actual outline of the part to be detected in each preset projection direction relative to the standard outline of the part, the accuracy of the outline detection of the part can be improved, the outline of the corresponding part can be automatically compared and detected according to the part identification number, the efficiency of the part detection is greatly improved, and the large-scale management of the part detection and the informatization construction of the whole process are facilitated.
Fig. 3 is a flowchart of a part inspection method according to an embodiment of the present disclosure, and as shown in fig. 3, the part inspection method according to the present embodiment may include the following steps:
step 310, obtaining the identification number of the part to be tested.
Step 310 in the embodiment of the present disclosure may refer to the content of step 110 described above, and will not be described herein.
Step 320, judging whether the identification number exists in the preset database, if so, executing steps 330-370, and if not, executing step 380.
In the embodiment of the present disclosure, after the identification number of the part to be measured is obtained, the computer device may determine whether the identification number exists in the preset database, if so, execute steps 330 to 370, and if not, execute step 380.
The preset database may be understood as a database for storing the part identification number and the two-dimensional drawing and/or the three-dimensional digital-analog of the target part corresponding to the part identification number, and the preset database may be set in a local storage space of the computer device or may be set in a server, which is not limited herein.
Step 330, if so, acquiring the actual outer contours of the part to be measured in each preset projection direction and the standard outer contours of the target part corresponding to the identification numbers in each preset projection direction.
Step 340, calculating, for each preset projection direction, a contour similarity of an actual outer contour of the preset projection direction relative to a standard outer contour of the preset projection direction.
And 350, determining that the part to be measured is a qualified part of the target part when the contour similarity corresponding to each preset projection direction is larger than a preset threshold value.
The content of steps 330-350 in the embodiments of the present disclosure may refer to the content of steps 120-140, which is not described herein.
Step 360, determining the target warehousing location corresponding to the identification number based on the mapping relation between the identification number and the warehousing location.
In the embodiment of the disclosure, the mapping relation between the identification numbers of the parts and the warehouse-in positions are prestored in the computer equipment, and the warehouse-in positions can be understood as specific storage positions of the parts in the intelligent stereoscopic warehouse. After determining that the part to be measured is a qualified part of the target part, the computer device may determine a target warehousing location corresponding to the identification number of the part to be measured based on a mapping relationship between the identification number of the part to be measured and the warehousing location.
And 370, conveying the part to be tested to a target warehouse-in position.
In the embodiment of the disclosure, after determining the target warehousing position corresponding to the identification number of the part to be tested, the computer equipment can control the transmission route of the mobile transportation platform of the part to be tested, convey the part to be tested to the target warehousing position, and warehouse the qualified part to be tested.
And 380, if the part to be tested does not exist, sending out prompt information, wherein the prompt information comprises the error of the identification number of the part to be tested.
In the embodiment of the disclosure, if the identification number of the part to be tested does not exist in the preset database, the computer equipment can send out prompt information, wherein the prompt information can include the error of the identification number of the part to be tested and prompt the detection personnel in time.
Therefore, only if the identification number of the part to be detected exists in the preset database, whether the contour of the part to be detected is qualified or not can be determined by comparing the contour similarity of the actual outer contour of the part to be detected in each preset projection direction relative to the standard outer contour of the part, and the efficiency of detecting the part can be further improved.
Fig. 4 is a schematic structural diagram of a part inspection apparatus according to an embodiment of the present disclosure, which may be understood as the above-mentioned computer device or a part of functional modules in the above-mentioned computer device. As shown in fig. 4, the part inspection apparatus 400 may include:
a first obtaining module 410, configured to obtain an identification number of a part to be tested;
the second obtaining module 420 is configured to obtain an actual outer contour of the part to be measured in each preset projection direction, and a standard outer contour of the target part corresponding to the identification number in each preset projection direction;
A calculating module 430, configured to calculate, for each preset projection direction, a contour similarity of an actual outer contour of the preset projection direction relative to a standard outer contour of the preset projection direction;
the first determining module 440 is configured to determine that the part to be measured is a qualified part of the target part when the profile similarity corresponding to each preset projection direction is greater than a preset threshold.
Optionally, the first obtaining module 410 may include:
the first acquisition submodule is used for acquiring a numbered image of the surface of the part to be measured, and the numbered image comprises an identification number of the part to be measured;
and the recognition sub-module is used for carrying out character recognition on the numbered images based on a preset character recognition model to obtain the identification numbers of the parts to be detected.
Optionally, the second obtaining module 420 may include:
the second acquisition submodule is used for acquiring projection images of the part to be detected in each preset projection direction;
the first extraction submodule is used for extracting the outline of the projection image to obtain the actual outline of the part to be detected in each preset projection direction;
the third acquisition submodule is used for acquiring projection views of the target part corresponding to the identification number in each preset projection direction;
And the second extraction submodule is used for extracting the contour of the projection view to obtain the standard outer contour of the target part in each preset projection direction.
Optionally, the second obtaining sub-module may include:
the monitoring unit is used for controlling the moving state of the part to be tested;
the first acquisition unit is used for controlling the linear array camera to acquire a projection image of the part to be detected in a first preset projection direction corresponding to the moving direction when the part to be detected is in the moving state;
the second acquisition unit is used for controlling the area array camera to acquire projection images of the part to be measured in a second preset projection direction when the part to be measured is in a static state, wherein the second preset projection direction is other preset projection directions except the first preset projection direction.
Optionally, the part inspection apparatus 400 may include:
the judging module is used for judging whether the identification number exists in a preset database or not;
the third acquisition module is used for acquiring the actual outer contour of the part to be detected in each preset projection direction and the standard outer contour of the target part corresponding to the identification number in each preset projection direction if the actual outer contour exists;
and the prompt module is used for sending prompt information if the prompt information does not exist, and the prompt information comprises an identification number error.
Optionally, the part inspection apparatus 400 may include:
and the alarm module is used for sending alarm information if the contour similarity smaller than or equal to a preset threshold exists in the contour similarity corresponding to each preset projection direction, and the alarm information comprises unqualified parts to be detected.
Optionally, the part inspection apparatus 400 may include:
the second determining module is used for determining a target warehousing position corresponding to the identification number based on the mapping relation between the identification number and the warehousing position;
and the conveying module is used for conveying the part to be tested to the target warehouse-in position.
The method of any one of the above embodiments may be implemented by the part detection device provided in the embodiment of the present disclosure, and the implementation manner and the beneficial effects of the method are similar, and are not described herein again.
The embodiment of the disclosure further provides a computer device, where the computer device includes a processor and a memory, where the memory stores a computer program, and when the computer program is executed by the processor, the method of any one of the foregoing embodiments may be implemented, and an implementation manner and a beneficial effect of the method are similar, and are not repeated herein.
A computer device in embodiments of the present disclosure may be understood as any device having processing and computing capabilities, which may include, but is not limited to, mobile terminals such as smartphones, notebook computers, personal Digital Assistants (PDAs), tablet computers (PADs), etc., as well as stationary electronic devices such as digital TVs, desktop computers, servers, etc.
Fig. 5 is a schematic structural diagram of a computer device according to an embodiment of the present disclosure, as shown in fig. 5, a computer device 500 may include a processor 510 and a memory 520, where the memory 520 stores a computer program 521, and when the computer program 521 is executed by the processor 510, the method provided in any of the foregoing embodiments may be implemented, and the implementation manner and the beneficial effects are similar, and are not repeated herein.
Of course, only some of the components of the computer apparatus 500 relevant to the present invention are shown in fig. 5 for simplicity, and components such as buses, input/output interfaces, input devices, output devices, and the like are omitted. In addition, the computer device 500 may include any other suitable components, depending on the particular application.
The embodiments of the present disclosure provide a computer readable storage medium, in which a computer program is stored, where when the computer program is executed by a processor, the method of any of the foregoing embodiments may be implemented, and the implementation manner and beneficial effects are similar, and are not described herein again.
The computer readable storage media described above can employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may include, for example, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium would include the following: an electrical connection having one or more wires, a portable disk, a hard disk, random Access Memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
The computer programs described above may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C++ or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer device, partly on the user's device, as a stand-alone software package, partly on the user's computer device and partly on a remote computer device or entirely on the remote computer device or server.
The embodiment of the disclosure also provides a part detection system, which comprises computer equipment, a mobile transportation platform, a linear array camera imaging system, an area array camera imaging system, an electrical control system and an upper computer software system, wherein whether the outline of the part to be detected is qualified or not can be determined by comparing the outline similarity of the actual outline of the part to be detected in each preset projection direction relative to the standard outline of the part, the accuracy of part outline detection can be improved, the part outline can be automatically detected, the part detection efficiency is greatly improved, and the large-scale management of the part detection and the information construction of the whole process are facilitated.
The linear array camera imaging system, the area array camera imaging system, the mobile transportation platform and the computer equipment are in the same local area network; the movable transportation platform can be composed of a group of screw guide rails, a servo motor and a movable sliding table, and mainly realizes the functions of part transportation and scanning shooting by matching with a linear array camera; the linear array camera imaging system can consist of a 4K high-definition linear array camera, a coaxial linear light source and a moving platform background plate, and mainly realizes acquisition of part overlooking projection images; the imaging system of the area array camera can consist of a common color area array camera and a group of large-area rectangular backlight sources, wherein the camera is positioned on the right vertical surface of the mobile platform, and the light sources are positioned on the left vertical surface of the mobile platform, so that the acquisition of side view projection images of parts is mainly realized; the electric control system mainly comprises a power supply circuit and a control circuit, the core of the control circuit is a motion control card which is used for controlling the mobile transportation platform and providing shooting trigger signals and light source control signals for the camera; the upper computer software takes C# as a main programming language, takes an algorithm provided by an OpenCV image processing library as a basis, combines the characteristics of part images, develops a whole set of image processing and contour matching programs, and is integrated with a control program of a motion control card to form a complete machine vision software system.
The foregoing description is only of the preferred embodiments of the present disclosure and description of the principles of the technology being employed. It will be appreciated by persons skilled in the art that the scope of the disclosure referred to in this disclosure is not limited to the specific combinations of features described above, but also covers other embodiments which may be formed by any combination of features described above or equivalents thereof without departing from the spirit of the disclosure. Such as those described above, are mutually substituted with the technical features having similar functions disclosed in the present disclosure (but not limited thereto).
Moreover, although operations are depicted in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order. In certain circumstances, multitasking and parallel processing may be advantageous. Likewise, while several specific implementation details are included in the above discussion, these should not be construed as limiting the scope of the present disclosure. Certain features that are described in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable subcombination.
The foregoing is merely a specific embodiment of the disclosure to enable one skilled in the art to understand or practice the disclosure. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the disclosure. Thus, the present disclosure is not intended to be limited to the embodiments shown and described herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims (10)

1. A method of part inspection comprising:
acquiring an identification number of a part to be tested;
acquiring actual outer contours of the parts to be tested in all preset projection directions and standard outer contours of target parts corresponding to the identification numbers in all preset projection directions;
calculating the contour similarity of the actual outer contour of the preset projection direction relative to the standard outer contour of the preset projection direction for each preset projection direction;
and when the contour similarity corresponding to each preset projection direction is larger than a preset threshold value, determining the part to be detected as a qualified part of the target part.
2. The method of claim 1, wherein the obtaining the identification number of the part under test comprises:
acquiring a number image of the surface of the part to be measured, wherein the number image comprises an identification number of the part to be measured;
and carrying out character recognition on the numbered images based on a preset character recognition model to obtain the identification numbers of the parts to be detected.
3. The method according to claim 1, wherein the obtaining the actual outer contour of the part to be measured in each preset projection direction and the standard outer contour of the target part corresponding to the identification number in each preset projection direction includes:
obtaining projection images of the part to be tested in each preset projection direction;
extracting the outline of the projection image to obtain the actual outline of the part to be detected in each preset projection direction;
obtaining projection views of the target part corresponding to the identification number in each preset projection direction;
and extracting the outline of the projection view to obtain the standard outline of the target part in each preset projection direction.
4. A method according to claim 3, wherein said obtaining projection images of the part under test in respective predetermined projection directions comprises:
Controlling the moving state of the part to be tested;
when the part to be measured is in a moving state, controlling a linear array camera to acquire a projection image of the part to be measured in a first preset projection direction corresponding to the moving direction;
when the part to be measured is in a static state, the area array camera is controlled to acquire a projection image of the part to be measured in a second preset projection direction, wherein the second preset projection direction is other preset projection directions except the first preset projection direction.
5. The method of claim 1, wherein the acquiring the actual outer contours of the part under test in each of the predetermined projection directions is preceded by:
judging whether the identification number exists in a preset database or not;
if so, acquiring the actual outer contour of the part to be detected in each preset projection direction and the standard outer contour of the target part corresponding to the identification number in each preset projection direction;
if not, sending out prompt information, wherein the prompt information comprises the identification number error.
6. The method according to claim 1, wherein after calculating the contour similarity of the actual outer contour of the preset projection direction with respect to the standard outer contour of the preset projection direction for each of the preset projection directions, the method further comprises:
And if the contour similarity corresponding to each preset projection direction is smaller than or equal to a preset threshold value, sending out alarm information, wherein the alarm information comprises unqualified parts to be tested.
7. The method of claim 1, wherein after the determining that the part under test is a conforming part of the target part, the method further comprises:
determining a target warehousing position corresponding to the identification number based on the mapping relation between the identification number and the warehousing position;
and conveying the part to be tested to the target warehouse-in position.
8. A part inspection apparatus, comprising:
the first acquisition module is used for acquiring the identification number of the part to be tested;
the second acquisition module is used for acquiring the actual outer contour of the part to be detected in each preset projection direction and the standard outer contour of the target part corresponding to the identification number in each preset projection direction;
the calculation module is used for calculating the contour similarity of the actual outer contour of the preset projection direction relative to the standard outer contour of the preset projection direction aiming at each preset projection direction;
And the first determining module is used for determining that the part to be detected is the qualified part of the target part when the contour similarity corresponding to each preset projection direction is larger than a preset threshold value.
9. A computer device, comprising:
a memory and a processor, wherein the memory has stored therein a computer program which, when executed by the processor, implements the part inspection method of any one of claims 1-7.
10. A computer-readable storage medium, in which a computer program is stored which, when executed by a processor, implements the part inspection method according to any one of claims 1-7.
CN202310320587.3A 2023-03-29 2023-03-29 Part detection method, device, equipment and storage medium Pending CN116071365A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310320587.3A CN116071365A (en) 2023-03-29 2023-03-29 Part detection method, device, equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310320587.3A CN116071365A (en) 2023-03-29 2023-03-29 Part detection method, device, equipment and storage medium

Publications (1)

Publication Number Publication Date
CN116071365A true CN116071365A (en) 2023-05-05

Family

ID=86173468

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310320587.3A Pending CN116071365A (en) 2023-03-29 2023-03-29 Part detection method, device, equipment and storage medium

Country Status (1)

Country Link
CN (1) CN116071365A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117455221A (en) * 2023-12-25 2024-01-26 青岛可颂食品有限公司 Processing flow management system suitable for baking cream

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108267104A (en) * 2018-01-22 2018-07-10 浙江大学 A kind of axial workpiece radius size measuring method based on binocular vision
CN108537887A (en) * 2018-04-18 2018-09-14 北京航空航天大学 Sketch based on 3D printing and model library 3-D view matching process
CN108764938A (en) * 2018-05-07 2018-11-06 上海博泰悦臻电子设备制造有限公司 A kind of non-certified products recognition methods of auto repair part and system
CN111156923A (en) * 2019-12-30 2020-05-15 上海森松制药设备工程有限公司 Workpiece detection method, workpiece detection device, computer equipment and storage medium
CN112560613A (en) * 2020-12-02 2021-03-26 北京理工大学 Part identification method and device and computer equipment
CN114549513A (en) * 2022-03-02 2022-05-27 季华实验室 Part identification method, part identification device, quality inspection method, electronic device, and storage medium

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108267104A (en) * 2018-01-22 2018-07-10 浙江大学 A kind of axial workpiece radius size measuring method based on binocular vision
CN108537887A (en) * 2018-04-18 2018-09-14 北京航空航天大学 Sketch based on 3D printing and model library 3-D view matching process
CN108764938A (en) * 2018-05-07 2018-11-06 上海博泰悦臻电子设备制造有限公司 A kind of non-certified products recognition methods of auto repair part and system
CN111156923A (en) * 2019-12-30 2020-05-15 上海森松制药设备工程有限公司 Workpiece detection method, workpiece detection device, computer equipment and storage medium
CN112560613A (en) * 2020-12-02 2021-03-26 北京理工大学 Part identification method and device and computer equipment
CN114549513A (en) * 2022-03-02 2022-05-27 季华实验室 Part identification method, part identification device, quality inspection method, electronic device, and storage medium

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
林强强,等: "面向机器人抓取的零散工件识别与测量方法", 西安工程大学学报, no. 02, pages 80 - 85 *
顾桂鹏,等: "基于机器视觉的零件产品检测系统设计", 工业控制计算机, no. 01, pages 24 - 25 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117455221A (en) * 2023-12-25 2024-01-26 青岛可颂食品有限公司 Processing flow management system suitable for baking cream
CN117455221B (en) * 2023-12-25 2024-03-26 青岛可颂食品有限公司 Processing flow management system suitable for baking cream

Similar Documents

Publication Publication Date Title
US12020415B2 (en) Method for monitoring manufacture of assembly units
CN111507976B (en) Defect detection method and system based on multi-angle imaging
CN111310826B (en) Method and device for detecting labeling abnormality of sample set and electronic equipment
CN110415214A (en) Appearance detecting method, device, electronic equipment and the storage medium of camera module
CN108993929A (en) A kind of dual-machine linkage industrial machine vision automatic checkout system
CN113822882A (en) Circuit board surface defect detection method and device based on deep learning
CN116071365A (en) Part detection method, device, equipment and storage medium
Liu et al. Printed circuit board defect detection based on MobileNet-Yolo-Fast
Chao-Ching et al. Machine vision and deep learning based rubber gasket defect detection
CN111160450A (en) Fruit and vegetable weighing method based on neural network, storage medium and device
CN117761060A (en) Visual detection system and detection method thereof
CN116681677A (en) Lithium battery defect detection method, device and system
Nguyen et al. Detection of weak micro-scratches on aspherical lenses using a Gabor neural network and transfer learning
CN112798608B (en) Optical detection device and optical detection method for side wall of inner cavity of mobile phone camera support
CN115272340A (en) Industrial product defect detection method and device
CN115631169A (en) Product detection method and device, electronic equipment and storage medium
US11978197B2 (en) Inspection method for inspecting an object and machine vision system
CN113267506A (en) Wood board AI visual defect detection device, method, equipment and medium
CN111464743A (en) Photographic composition matching method and system
CN115908952B (en) High-speed railway tunnel fixture detection method based on improved YOLOv5 algorithm
CN113808067B (en) Circuit board detection method, visual detection equipment and device with storage function
CN116046791B (en) Method and device for detecting defect of adhesive dispensing
CN117571721B (en) Method and device for detecting surface defects of circuit board bonding pad and storage medium
CN116358834A (en) Interface component detection equipment and method
CN117670820B (en) Plastic film production defect detection method and system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20230505

RJ01 Rejection of invention patent application after publication