CN113160148A - Mold processing method, mold processing device, electronic apparatus, mold processing system, and storage medium - Google Patents

Mold processing method, mold processing device, electronic apparatus, mold processing system, and storage medium Download PDF

Info

Publication number
CN113160148A
CN113160148A CN202110340045.3A CN202110340045A CN113160148A CN 113160148 A CN113160148 A CN 113160148A CN 202110340045 A CN202110340045 A CN 202110340045A CN 113160148 A CN113160148 A CN 113160148A
Authority
CN
China
Prior art keywords
insert
area
image
template image
mold
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110340045.3A
Other languages
Chinese (zh)
Inventor
程鑫
吉守龙
张翔
吴丰礼
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Topstar Technology Co Ltd
Original Assignee
Guangdong Topstar Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Topstar Technology Co Ltd filed Critical Guangdong Topstar Technology Co Ltd
Priority to CN202110340045.3A priority Critical patent/CN113160148A/en
Priority to PCT/CN2021/097262 priority patent/WO2022205606A1/en
Publication of CN113160148A publication Critical patent/CN113160148A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • G06T7/0004Industrial image inspection
    • G06T5/70
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/30Determination of transform parameters for the alignment of images, i.e. image registration
    • G06T7/33Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods
    • G06T7/337Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods involving reference images or patches
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/20Image preprocessing
    • G06V10/25Determination of region of interest [ROI] or a volume of interest [VOI]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10004Still image; Photographic image
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20024Filtering details
    • G06T2207/20032Median filtering
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30108Industrial image inspection
    • G06T2207/30164Workpiece; Machine component

Abstract

The embodiment of the invention discloses a mold processing method, a mold processing device, electronic equipment, a mold processing system and a storage medium, wherein the mold processing method comprises the following steps: acquiring a template image and a real measurement image of the mold, and determining an insert area of the real measurement image according to the insert area of the template image; determining an insert abnormal area according to the insert area of the template image and the insert area of the actual measurement image; determining attribute information of an insert abnormal area; and sending the attribute information to a correction device so that the correction device performs insert correction on the mold according to the attribute information. According to the embodiment of the invention, the insert state of the mold can be automatically detected and the insert abnormity can be corrected according to the template image and the actual measurement image of the mold, so that the problems of product scrapping, mold damage and the like caused by the insert state abnormity of the mold are avoided, the production efficiency is improved, and the production cost is reduced.

Description

Mold processing method, mold processing device, electronic apparatus, mold processing system, and storage medium
Technical Field
Embodiments of the present invention relate to manufacturing technologies, and in particular, to a method and an apparatus for processing a mold, an electronic device, a system, and a storage medium.
Background
The insert injection molding is a method for fixing an insert in a proper position in a mold in advance, then injecting plastic for molding, after the mold is opened, the insert is tightly wrapped and embedded in a product by the cooled and solidified plastic to obtain the product with the inserts such as a threaded ring, an electrode and the like, and the insert state of the mold is directly related to the quality of an injection molding product. In the actual production process, the injection product may be scrapped due to the abnormal states of missed placement, dislocation and the like of the inserts in the mold, and the mold may be damaged due to dislocation of the inserts, so that the production efficiency is reduced and the production cost is increased.
Disclosure of Invention
The embodiment of the invention provides a mold processing method, a mold processing device, electronic equipment, a mold processing system and a storage medium, which can improve the production efficiency and reduce the production cost.
In a first aspect, an embodiment of the present invention provides a mold processing method, including:
acquiring a template image and a real measurement image of a mold, and determining an insert area of the real measurement image according to the insert area of the template image;
determining an insert abnormal area according to the insert area of the template image and the insert area of the actual measurement image;
determining attribute information of the insert abnormal area;
and sending the attribute information to a correction device so that the correction device performs insert correction on the mold according to the attribute information.
Optionally, the acquiring a template image and a measured image of the mold includes:
acquiring the template image with the original size and the actual measurement image with the original size;
the determining the insert area of the measured image according to the insert area of the template image comprises:
reducing the template image with the original size and the actual measurement image with the original size to obtain the reduced template image and the reduced actual measurement image;
and matching the insert area of the reduced-size template image with the reduced-size actual measurement image to obtain the insert area of the reduced-size actual measurement image.
Optionally, the reducing the template image in the original size and the actual measurement image in the original size to obtain the reduced template image and the reduced actual measurement image includes:
determining a scaling factor according to the size relation between the insert area of the template image with the original size and the template image with the original size;
and carrying out reduction processing on the template image with the original size according to the scaling factor to obtain the reduced size template image, and carrying out reduction processing on the actual measurement image with the original size according to the scaling factor to obtain the reduced size actual measurement image.
Optionally, before performing a reduction process on the template image in the original size and the real image in the original size, the method further includes:
determining an insert area of the template image in an original size;
and carrying out filtering and noise reduction treatment on the insert area of the template image with the original size.
Optionally, the determining the original size of the insert region of the template image includes:
obtaining each interest area framed and selected in the template image with the original size;
and combining the interest areas to obtain the insert area of the template image with the original size.
Optionally, the determining an insert abnormal region according to the insert region of the template image and the insert region of the actual measurement image includes:
carrying out size reduction processing on the insert area of the reduced-size actual measurement image according to the scaling factor to obtain the insert area of the actual measurement image with the original size;
and determining the insert abnormal area according to the insert area of the template image with the original size and the insert area of the actual measurement image with the original size.
Optionally, the determining the insert abnormal region according to the insert region of the template image of the original size and the insert region of the actual measurement image of the original size includes:
acquiring a difference image of an insert area of the template image with the original size and an insert area of the actual measurement image with the original size;
performing region filtering on the difference image according to a preset gray threshold value to obtain a candidate region;
and determining the insert abnormal area according to the candidate area.
Optionally, the determining the insert abnormal region according to the candidate region includes:
and performing area filtering on the candidate area according to a first area threshold value to obtain the insert abnormal area.
Optionally, the determining attribute information of the insert abnormal area includes:
performing type identification on the insert abnormal area according to a second area threshold to obtain type information of the insert abnormal area;
and calculating the center of the insert abnormal area to obtain the position information of the insert abnormal area.
Optionally, the sending the attribute information to the correction device includes:
and sending the type information and the position information of the insert abnormal area to the correction equipment.
In a second aspect, an embodiment of the present invention provides a mold processing apparatus, including:
the first determining module is used for acquiring a template image and a real measurement image of a mold and determining an insert area of the real measurement image according to the insert area of the template image;
the second determining module is used for determining an insert abnormal area according to the insert area of the template image and the insert area of the actual measurement image;
the third determining module is used for determining the attribute information of the insert abnormal area;
and the sending module is used for sending the attribute information to the correcting equipment so that the correcting equipment can carry out insert correction on the mould according to the attribute information.
In a third aspect, an embodiment of the present invention provides an electronic device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor executes the computer program to implement the mold processing method according to any embodiment of the present invention.
In a fourth aspect, an embodiment of the present invention provides a mold processing system, which includes a calibration apparatus and an electronic apparatus for performing the mold processing method according to any embodiment of the present invention.
In a fifth aspect, an embodiment of the present invention provides a computer-readable storage medium, on which a computer program is stored, where the computer program is executed by a processor to implement the mold processing method according to any embodiment of the present invention.
In the embodiment of the invention, a template image and a measured image of a mold can be obtained, and an insert area of the measured image is determined according to the insert area of the template image; determining an insert abnormal area according to the insert area of the template image and the insert area of the actual measurement image; determining attribute information of the insert abnormal area; and sending the attribute information to a correction device so that the correction device performs insert correction on the mold according to the attribute information. The embodiment of the invention can automatically detect the insert state of the die and correct the insert abnormality according to the template image and the actual measurement image of the die, thereby avoiding the problems of product scrapping, die damage and the like caused by the insert state abnormality of the die, improving the production efficiency and reducing the production cost.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the embodiments will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present invention and therefore should not be considered as limiting the scope, and for those skilled in the art, other related drawings can be obtained according to the drawings without inventive efforts.
Fig. 1 is a schematic flow chart of a mold processing method according to an embodiment of the present invention.
Fig. 2 is another schematic flow chart of a mold processing method according to an embodiment of the present invention.
Fig. 3 is a schematic structural diagram of a mold processing apparatus according to an embodiment of the present invention.
Fig. 4 is a schematic structural diagram of a mold processing system according to an embodiment of the present invention.
Fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be further noted that, for the convenience of description, only some of the structures related to the present invention are shown in the drawings, not all of the structures.
Fig. 1 is a schematic flow chart of a mold processing method according to an embodiment of the present invention, which may be implemented by a mold processing apparatus according to an embodiment of the present invention, and the apparatus may be implemented in software and/or hardware. In a specific embodiment, the apparatus may be integrated into an electronic device, such as a Personal Computer (PC), a tablet Computer, a notebook Computer, a desktop Computer, and the like. The following embodiments will be described by taking as an example that the apparatus is integrated in an electronic device, and referring to fig. 1, the method may specifically include the following steps:
step 101, obtaining a template image and a measured image of a mold, and determining an insert area of the measured image according to the insert area of the template image.
For example, the mold may be an insert injection mold, and in a specific implementation, the insert may be correctly fixed in the mold in advance and the mold may be photographed to obtain a template image of the mold, where the insert correctly fixed in the mold may include one or more inserts. In actual production, the die can be shot in real time to obtain an actual measurement image of the die.
In specific implementation, a manual framing method can be adopted to frame out the insert areas in the template image, the insert areas selected by the frame can be circular, rectangular, polygonal and the like, one or more insert areas selected by the frame can be included, and one insert area corresponds to one insert correctly fixed in the mold. After the insert region is selected from the template image, the electronic device may match the insert region of the template image with the actual image, so as to determine the insert region of the actual image.
And 102, determining an insert abnormal area according to the insert area of the template image and the insert area of the actual measurement image.
In a specific implementation, the insert abnormal area can be determined in the following manner:
(1) and comparing the insert area of the template image with the insert area of the actual measurement image to obtain a difference image of the insert area of the template image and the insert area of the actual measurement image.
The difference image can display the difference between the insert area of the template image and the insert area of the measured image.
(2) And carrying out region filtering on the difference image according to a preset gray threshold value to obtain a candidate region.
For example, a template image coordinate gray value and an actual image coordinate gray value corresponding to each pixel point in the differential image may be obtained, the template image coordinate gray value is a gray value of a coordinate position corresponding to a pixel point of the insert region of the template image, the actual image coordinate gray value is a gray value of a coordinate position corresponding to a pixel point of the insert region of the actual image, a difference between the template image coordinate gray value and the actual image coordinate gray value corresponding to each pixel point is calculated, if the difference exceeds a preset gray threshold, a region corresponding to the pixel point is retained, otherwise, if the difference does not exceed the preset gray threshold, a region corresponding to the pixel point is filtered, the retained region is a candidate region, and the preset gray threshold is an adaptive value.
In a specific implementation, if the similarity of two images is high, the remaining candidate regions are fewer after the difference is performed; if the similarity of the two images is low and is obviously different, more candidate areas are reserved after the difference is carried out.
(3) And determining the insert abnormal area according to the candidate area.
Specifically, the reserved candidate areas are not necessarily all insert abnormal areas, and further identification and judgment are required. In the embodiment of the invention, a first area threshold value can be set, and after the candidate area is obtained, the candidate area can be subjected to area filtering based on the first area threshold value to obtain the insert abnormal area.
For example, whether the area of each candidate region is larger than a first area threshold value or not may be determined, the candidate regions larger than the first area threshold value are retained, the candidate regions not larger than the first area threshold value are filtered, and the retained candidate regions are insert abnormal regions.
And 103, determining the attribute information of the insert abnormal area.
For example, the attribute information of the insert abnormality region may include type information and location information of the insert abnormality region.
Through a large number of experiments, two typical insert abnormal states, namely insert missing and dislocation, are known, and therefore, in the embodiment of the invention, the type information of the insert abnormal area can include missing and dislocation. Further, the missing and misplacement have corresponding characteristics, wherein the missing usually presents large-area abnormality, for example, the whole insert is in an abnormal area; while dislocations typically present a smaller area anomaly, such as only an insert edge region anomaly. Specifically, in the embodiment of the present invention, a second area threshold may be set according to the features, and the type of the insert abnormal area is identified by using the second area threshold, so as to obtain the type information of the insert abnormal area.
For example, it may be determined whether the area of each insert abnormal region is greater than a second area threshold, the type of the insert abnormal region greater than the second area threshold is identified as missing, and the type of the insert abnormal region not greater than the second area threshold is identified as misplaced.
In a specific implementation, the position information of the insert abnormal area can be obtained by calculating the center of the insert abnormal area. For example, the circumscribed rectangle of the insert abnormal area can be determined, the center of the circumscribed rectangle is used as the center of the insert abnormal area, the coordinate information of the center is obtained, and the coordinate information is used as the position information of the insert abnormal area. In addition, the center of gravity of the insert abnormal area may be determined in some manner, coordinate information of the center of gravity may be obtained, and the coordinate information may be used as the position information of the insert abnormal area, which is not specifically limited herein.
And 104, sending the attribute information to a correction device so that the correction device performs insert correction on the mold according to the attribute information.
For example, the type information and the position information of the insert abnormality region may be transmitted to the correction device, so that the correction device performs insert correction on the mold according to the type information and the position information of the insert abnormality region. Wherein, the correction device may be a robot arm, a robot, etc., and is not particularly limited herein.
In one possible implementation, the specific attribute information sent to the correction device may also be determined according to the number of inserts of the mold configuration. For example, when there is only one insert configured for the mold, after determining the attribute information of the insert abnormal region, the type information of the insert abnormal region may be sent only to the correction device; when a plurality of inserts are arranged in the mold, after the attribute information of the insert abnormal area is determined, the type information and the position information of the insert abnormal area can be sent to the correction device.
In the embodiment of the invention, a template image and a measured image of a mold can be obtained, and an insert area of the measured image is determined according to the insert area of the template image; determining an insert abnormal area according to the insert area of the template image and the insert area of the actual measurement image; determining attribute information of the insert abnormal area; and sending the attribute information to a correction device so that the correction device performs insert correction on the mold according to the attribute information. The embodiment of the invention can automatically detect the insert state of the die and correct the insert abnormality according to the template image and the actual measurement image of the die, thereby avoiding the problems of product scrapping, die damage and the like caused by the insert state abnormality of the die, improving the production efficiency and reducing the production cost.
The mold processing method provided by the embodiment of the present invention is further described below, and as shown in fig. 2, the mold processing method includes the following steps:
step 201, obtaining a template image of the original size of the mold and a measured image of the original size.
For example, the mold may be an insert injection mold, and in a specific implementation, the insert may be correctly fixed in the mold in advance and the mold may be photographed to obtain a template image of the mold, where the insert correctly fixed in the mold may include one or more inserts. In actual production, the die can be shot in real time to obtain an actual measurement image of the die.
In step 202, the regions of interest framed in the template image of the original size are obtained.
In a specific implementation, a region of interest (ROI) may be frame-selected in a template image by using a manual frame selection method, where the region of interest selected in the frame may be a circle, a rectangle, a polygon, or the like, and the region of interest selected in the frame may include one or more regions, and one region of interest corresponds to one insert correctly fixed in a mold, that is, each region of interest is a region including an insert.
And step 203, combining the interest areas to obtain an insert area of the template image with the original size.
In a specific implementation, when there is more than one region of interest to be framed, the regions of interest may be merged to reduce the number of regions, which is convenient for subsequent processing.
Specifically, for example, a minimum bounding rectangle of the multiple regions of interest may be calculated, and a region corresponding to the minimum bounding rectangle may be determined as a region of the insert of the template image of the original size. The minimum circumscribed rectangle can be calculated by adopting the following formula:
Figure BDA0002999165470000101
wherein (ROI. x, ROI. y) represents the coordinates of the upper left corner of the minimum bounding rectangle, (roi. y)1.x,roi1.y)、(roin.x、roinY) respectively representing the upper left corner coordinate of the first interest region and the upper left corner coordinate of the nth interest region, n is an integer greater than or equal to 2, ROInWidth denotes the width, roi, of the nth region of interestnHeight denotes the height of the nth region of interest.
And 204, carrying out filtering and noise reduction processing on the insert area of the template image with the original size.
For example, an Adaptive Median Filter (Adaptive Median Filter) may be used to perform filtering and denoising processing on an embedded region of a template image of an original size, where the Adaptive Median Filter can Filter out pepper-salt noise with a high probability and can also smooth other non-impulse noise, protect detail information in the image as much as possible, and avoid thinning or coarsening of an image edge.
The adaptive median filter requires a rectangular window SxyUnlike conventional median filters, the size of this window changes (increases) during the filtering process. The output of the filter is a pixel value that is used to replace the pixel value at point (x, y) at the center position of the filter window.
The following notation is needed in describing the adaptive median filter:
Zmin=Sxyminimum gray value of;
Zmax=Sxymaximum gray value of (1);
Zmed=Sxythe median of the pixel values in (a);
Zxyrepresenting the gray value at coordinate (x, y);
Smax=Sxythe maximum window size allowed.
The adaptive median filter has two processes, which are respectively denoted as: a and B.
Step A, the purpose of the step is to determine the median value Z obtained in the current windowmeWhether d is noise. The method comprises the following specific steps:
let A1=Zmed-Zmin
A2=Zmed-Zmax
If A is1> 0 and A2If the value is less than 0, jumping to the step B;
otherwise, increasing the size of the window; if the size of the window is less than or equal to S after the increasemaxRepeating the process of the step A;
otherwise, output Zmed
And B:
let B1=Zxy-Zmin
B2=Zxy-Zmax
If B is present1> 0 and B2If < 0, then output Zxy
Otherwise output Zmed
As can be seen from the above steps, the probability of noise occurrence is low, and the adaptive median filter can obtain a result quickly without increasing the size of a window; conversely, if the probability of occurrence of noise is high, the window size of the filter needs to be increased.
The embodiment of the present invention is described by taking an adaptive Median Filter as an example, and in practical applications, other filters may be used for filtering and denoising, such as a Median Filter (media Filter), which is not specifically limited herein.
Step 205, determining a scaling factor according to the size relationship between the insert area of the template image with the original size and the template image with the original size.
For example, the scaling factor may be determined based on the aspect ratio of the inset region of the original-size template image to the original-size template image. In a specific embodiment, the scaling factor may be calculated as follows:
Figure BDA0002999165470000121
wherein G denotes a scaling factor, src.width denotes a width of the insert region of the template image of the original size, src.height denotes a height of the insert region of the template image of the original size, dst.width denotes a width of the template image of the original size, and dst.height denotes a height of the template image of the original size.
That is, if the width of the mosaic region of the original-size template image is greater than half the width of the original-size template image, or the height of the mosaic region of the original-size template image is greater than half the height of the original-size template image, the scaling factor is set to 0.25; otherwise, the scaling factor is set to 0.5.
And step 206, carrying out reduction processing on the template image with the original size according to the scaling factor to obtain a reduced-size template image, and carrying out reduction processing on the actual measurement image with the original size according to the scaling factor to obtain a reduced-size actual measurement image.
Because the insert region is determined by adopting the template matching method, the larger the size of the image is, the longer the time consumption is, and the lower the detection efficiency is, in the embodiment of the invention, the template image with the original size and the actually-measured image with the original size can be both subjected to reduction processing, and the small-size image is adopted for template matching, so that the subsequent matching detection speed is improved.
And step 207, matching the insert area of the reduced-size template image with the reduced-size actual measurement image to obtain the insert area of the reduced-size actual measurement image.
And 208, performing size reduction processing on the insert area of the reduced-size measured image according to the scaling factor to obtain the insert area of the original-size measured image.
Because the subsequent difference calculation needs to be performed by using the image with the original size, after the insert region of the reduced-size measured image is obtained, the size reduction processing can be performed on the insert region of the reduced-size measured image according to the scaling factor adopted in the foregoing, so as to obtain the insert region of the original-size measured image, and specifically, the reduction processing can be performed by adopting the following formula:
Figure BDA0002999165470000131
wherein, P (a, b) is the position coordinate obtained by matching after reducing the size, and P (x, y) is the coordinate in the image which is mapped and restored to the original size.
Step 209 is to obtain a difference image between the insert area of the template image with the original size and the insert area of the actual measurement image with the original size.
The difference image can display the difference between the insert area of the template image and the insert area of the measured image.
And step 210, performing area filtering on the difference image according to a preset gray threshold value to obtain a candidate area.
For example, a template image coordinate gray value and an actual image coordinate gray value corresponding to each pixel point in the differential image may be obtained, the template image coordinate gray value is a gray value of a coordinate position corresponding to a pixel point of the insert region of the template image, the actual image coordinate gray value is a gray value of a coordinate position corresponding to a pixel point of the insert region of the actual image, a difference between the template image coordinate gray value and the actual image coordinate gray value corresponding to each pixel point is calculated, if the difference exceeds a preset gray threshold, a region corresponding to the pixel point is retained, otherwise, if the difference does not exceed the preset gray threshold, a region corresponding to the pixel point is filtered, the retained region is a candidate region, and the preset gray threshold is an adaptive value.
Specifically, the following formula can be adopted to perform region filtering on the difference image:
Figure BDA0002999165470000141
wherein D (x, y) represents a determination result of the region, when D (x, y) is 1, the corresponding region is retained, when D (x, y) is 0, the corresponding region is filtered out, M (x, y) represents a template image coordinate gray-scale value, N (x, y) represents a measured image coordinate gray-scale value, and T represents a preset gray-scale threshold value.
And step 211, performing area filtering on the candidate area according to the first area threshold to obtain an insert abnormal area.
Specifically, since the reserved candidate regions are not necessarily all insert abnormality regions, further identification and judgment are required. In the embodiment of the invention, a first area threshold value can be set, and after the candidate area is obtained, the candidate area can be subjected to area filtering based on the first area threshold value to obtain the insert abnormal area.
For example, whether the area of each candidate region is larger than a first area threshold value or not may be determined, the candidate regions larger than the first area threshold value are retained, the candidate regions not larger than the first area threshold value are filtered, and the retained candidate regions are insert abnormal regions.
And step 212, identifying the type of the insert abnormal area according to the second area threshold value to obtain the type information of the insert abnormal area.
Through a large number of experiments, two typical insert abnormal states, namely insert missing and dislocation, are known, and therefore, in the embodiment of the invention, the type information of the insert abnormal area can include missing and dislocation. Further, the missing and misplacement have corresponding characteristics, wherein the missing usually presents large-area abnormality, for example, the whole insert is in an abnormal area; while dislocations typically present a smaller area anomaly, such as only an insert edge region anomaly. Specifically, in the embodiment of the present invention, a second area threshold may be set according to the features, and the type of the insert abnormal area is identified by using the second area threshold, so as to obtain the type information of the insert abnormal area.
For example, it may be determined whether the area of each insert abnormal region is greater than a second area threshold, the type of the insert abnormal region greater than the second area threshold is identified as missing, and the type of the insert abnormal region not greater than the second area threshold is identified as misplaced.
And step 213, calculating the center of the insert abnormal area to obtain the position information of the insert abnormal area.
In a specific implementation, the position information of the insert abnormal area can be obtained by calculating the center of the insert abnormal area. For example, the circumscribed rectangle of the insert abnormal area can be determined, the center of the circumscribed rectangle is used as the center of the insert abnormal area, the coordinate information of the center is obtained, and the coordinate information is used as the position information of the insert abnormal area. In addition, the center of gravity of the insert abnormal area may be determined in some manner, coordinate information of the center of gravity may be obtained, and the coordinate information may be used as the position information of the insert abnormal area, which is not specifically limited herein.
And 214, sending the type information and the position information of the insert abnormal area to the correcting device, so that the correcting device performs insert correction on the mold according to the type information and the position information of the insert abnormal area.
In one possible implementation, the specific attribute information sent to the correction device may also be determined according to the number of inserts of the mold configuration. For example, when there is only one insert configured for the mold, after determining the attribute information of the insert abnormal region, the type information of the insert abnormal region may be sent only to the correction device; when a plurality of inserts are arranged in the mold, after the attribute information of the insert abnormal area is determined, the type information and the position information of the insert abnormal area can be sent to the correction device.
Illustratively, the correction device may be a robot arm, a robot, or the like, which is not particularly limited herein.
In the embodiment of the invention, a template image and a measured image of a mold can be obtained, and an insert area of the measured image is determined according to the insert area of the template image; determining an insert abnormal area according to the insert area of the template image and the insert area of the actual measurement image; determining attribute information of the insert abnormal area; and sending the attribute information to a correction device so that the correction device performs insert correction on the mold according to the attribute information. The embodiment of the invention can automatically detect the insert state of the die and correct the insert abnormality according to the template image and the actual measurement image of the die, thereby avoiding the problems of product scrapping, die damage and the like caused by the insert state abnormality of the die, improving the production efficiency and reducing the production cost.
It should be understood that, although the steps in the flowchart of fig. 2 are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least a portion of the steps in fig. 2 may include multiple sub-steps or multiple stages that are not necessarily performed at the same time, but may be performed at different times, and the order of performance of the sub-steps or stages is not necessarily sequential, but may be performed in turn or alternately with other steps or at least a portion of the sub-steps or stages of other steps.
Fig. 3 is a block diagram of a mold processing apparatus according to an embodiment of the present invention, which is adapted to perform the mold processing method according to an embodiment of the present invention. As shown in fig. 3, the apparatus may specifically include:
the first determining module 301 is configured to obtain a template image and a real-measurement image of a mold, and determine an insert area of the real-measurement image according to the insert area of the template image;
a second determining module 302, configured to determine an insert abnormal region according to the insert region of the template image and the insert region of the actual measurement image;
a third determining module 303, configured to determine attribute information of the insert abnormal area;
a sending module 304, configured to send the attribute information to a correction device, so that the correction device performs insert correction on the mold according to the attribute information.
In one embodiment, the acquiring the template image and the actual measurement image of the mold by the first determining module 301 includes:
acquiring the template image with the original size and the actual measurement image with the original size;
the determining the insert area of the measured image according to the insert area of the template image comprises:
reducing the template image with the original size and the actual measurement image with the original size to obtain the reduced template image and the reduced actual measurement image;
and matching the insert area of the reduced-size template image with the reduced-size actual measurement image to obtain the insert area of the reduced-size actual measurement image.
In an embodiment, the reducing the template image with the original size and the real image with the original size by the first determining module 301 to obtain the reduced template image and the reduced real image, includes:
determining a scaling factor according to the size relation between the insert area of the template image with the original size and the template image with the original size;
and carrying out reduction processing on the template image with the original size according to the scaling factor to obtain the reduced size template image, and carrying out reduction processing on the actual measurement image with the original size according to the scaling factor to obtain the reduced size actual measurement image.
In one embodiment, the apparatus further comprises:
the fourth determining module is used for determining the insert area of the template image with the original size;
and the noise reduction module is used for carrying out filtering and noise reduction processing on the insert area of the template image with the original size.
In one embodiment, the fourth determining module determines the inset region of the template image in an original size, including:
obtaining each interest area framed and selected in the template image with the original size;
and combining the interest areas to obtain the insert area of the template image with the original size.
In an embodiment, the determining the insert anomaly region by the second determining module 302 according to the insert region of the template image and the insert region of the measured image includes:
carrying out size reduction processing on the insert area of the reduced-size actual measurement image according to the scaling factor to obtain the insert area of the actual measurement image with the original size;
and determining the insert abnormal area according to the insert area of the template image with the original size and the insert area of the actual measurement image with the original size.
In an embodiment, the determining the insert abnormality region by the second determining module 302 according to the insert region of the template image in the original size and the insert region of the real measurement image in the original size includes:
acquiring a difference image of an insert area of the template image with the original size and an insert area of the actual measurement image with the original size;
performing region filtering on the difference image according to a preset gray threshold value to obtain a candidate region;
and determining the insert abnormal area according to the candidate area.
In one embodiment, the second determining module 302 determines the insert anomaly region according to the candidate region, including:
and performing area filtering on the candidate area according to a first area threshold value to obtain the insert abnormal area.
In one embodiment, the third determining module 303 determines the attribute information of the insert abnormality region, including:
performing type identification on the insert abnormal area according to a second area threshold to obtain type information of the insert abnormal area;
and calculating the center of the insert abnormal area to obtain the position information of the insert abnormal area.
In an embodiment, the sending module 304 sends the attribute information to a correction device, including:
and sending the type information and the position information of the insert abnormal area to the correction equipment.
It is obvious to those skilled in the art that, for convenience and simplicity of description, the foregoing division of the functional modules is merely used as an example, and in practical applications, the above function distribution may be performed by different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules to perform all or part of the above described functions. For the specific working process of the functional module, reference may be made to the corresponding process in the foregoing method embodiment, which is not described herein again.
The device provided by the embodiment of the invention can be used for acquiring the template image and the actual measurement image of the mold, and determining the insert area of the actual measurement image according to the insert area of the template image; determining an insert abnormal area according to the insert area of the template image and the insert area of the actual measurement image; determining attribute information of the insert abnormal area; and sending the attribute information to a correction device so that the correction device performs insert correction on the mold according to the attribute information. The embodiment of the invention can automatically detect the insert state of the die and correct the insert abnormality according to the template image and the actual measurement image of the die, thereby avoiding the problems of product scrapping, die damage and the like caused by the insert state abnormality of the die, improving the production efficiency and reducing the production cost.
The embodiment of the invention also provides electronic equipment, which comprises a memory, a processor and a computer program which is stored on the memory and can run on the processor, wherein when the processor executes the program, the mold processing method provided by any embodiment is realized.
The embodiment of the invention also provides a computer readable medium, on which a computer program is stored, and the program is executed by a processor to implement the mold processing method provided by any one of the above embodiments.
Fig. 4 shows an exemplary architecture of a mold processing system according to an embodiment of the present invention, as shown in fig. 4, the mold processing system includes an electronic device 401 and a correction device 402, the electronic device 401 may be the electronic device described in the foregoing embodiment, and a specific interaction process between the electronic device 401 and the correction device 402 may refer to the description of the foregoing embodiment, which is not described herein again.
Referring now to FIG. 5, shown is a block diagram of a computer system 500 suitable for use in implementing an electronic device of an embodiment of the present invention. The electronic device shown in fig. 5 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present invention.
As shown in fig. 5, the computer system 500 includes a Central Processing Unit (CPU)501 that can perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM)502 or a program loaded from a storage section 508 into a Random Access Memory (RAM) 503. In the RAM 503, various programs and data necessary for the operation of the system 500 are also stored. The CPU 501, ROM 502, and RAM 503 are connected to each other via a bus 504. An input/output (I/O) interface 505 is also connected to bus 504.
The following components are connected to the I/O interface 505: an input portion 506 including a keyboard, a mouse, and the like; an output portion 507 including a display such as a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), and the like, and a speaker; a storage portion 508 including a hard disk and the like; and a communication section 509 including a network interface card such as a LAN card, a modem, or the like. The communication section 509 performs communication processing via a network such as the internet. The driver 510 is also connected to the I/O interface 505 as necessary. A removable medium 511 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is mounted on the drive 510 as necessary, so that a computer program read out therefrom is mounted into the storage section 508 as necessary.
In particular, according to the embodiments of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method illustrated in the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network through the communication section 509, and/or installed from the removable medium 511. The computer program performs the above-described functions defined in the system of the present invention when executed by the Central Processing Unit (CPU) 501.
It should be noted that the computer readable medium shown in the present invention can be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present invention, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In the present invention, however, a computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, fiber optic cable, RF, etc., or any suitable combination of the foregoing.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams or flowchart illustration, and combinations of blocks in the block diagrams or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The modules and/or units described in the embodiments of the present invention may be implemented by software, and may also be implemented by hardware. The described modules and/or units may also be provided in a processor, and may be described as: a processor includes a first determination module, a second determination module, a third determination module, and a sending module. Wherein the names of the modules do not in some cases constitute a limitation of the module itself.
As another aspect, the present invention also provides a computer-readable medium that may be contained in the apparatus described in the above embodiments; or may be separate and not incorporated into the device. The computer readable medium carries one or more programs which, when executed by a device, cause the device to comprise: acquiring a template image and a real measurement image of a mold, and determining an insert area of the real measurement image according to the insert area of the template image; determining an insert abnormal area according to the insert area of the template image and the insert area of the actual measurement image; determining attribute information of the insert abnormal area; and sending the attribute information to a correction device so that the correction device performs insert correction on the mold according to the attribute information.
According to the technical scheme of the embodiment of the invention, the template image and the actual measurement image of the mold can be obtained, and the insert area of the actual measurement image is determined according to the insert area of the template image; determining an insert abnormal area according to the insert area of the template image and the insert area of the actual measurement image; determining attribute information of the insert abnormal area; and sending the attribute information to a correction device so that the correction device performs insert correction on the mold according to the attribute information. The embodiment of the invention can automatically detect the insert state of the die and correct the insert abnormality according to the template image and the actual measurement image of the die, thereby avoiding the problems of product scrapping, die damage and the like caused by the insert state abnormality of the die, improving the production efficiency and reducing the production cost.
The above-described embodiments should not be construed as limiting the scope of the invention. Those skilled in the art will appreciate that various modifications, combinations, sub-combinations, and substitutions can occur, depending on design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims (14)

1. A method of mold handling, comprising:
acquiring a template image and a real measurement image of a mold, and determining an insert area of the real measurement image according to the insert area of the template image;
determining an insert abnormal area according to the insert area of the template image and the insert area of the actual measurement image;
determining attribute information of the insert abnormal area;
and sending the attribute information to a correction device so that the correction device performs insert correction on the mold according to the attribute information.
2. The mold processing method of claim 1, wherein the acquiring of the template image and the measured image of the mold comprises:
acquiring the template image with the original size and the actual measurement image with the original size;
the determining the insert area of the measured image according to the insert area of the template image comprises:
reducing the template image with the original size and the actual measurement image with the original size to obtain the reduced template image and the reduced actual measurement image;
and matching the insert area of the reduced-size template image with the reduced-size actual measurement image to obtain the insert area of the reduced-size actual measurement image.
3. The mold processing method according to claim 2, wherein the reducing the original size of the template image and the original size of the real image to obtain the reduced size of the template image and the reduced size of the real image comprises:
determining a scaling factor according to the size relation between the insert area of the template image with the original size and the template image with the original size;
and carrying out reduction processing on the template image with the original size according to the scaling factor to obtain the reduced size template image, and carrying out reduction processing on the actual measurement image with the original size according to the scaling factor to obtain the reduced size actual measurement image.
4. The mold processing method according to claim 2, further comprising, before the reducing process of the template image in an original size and the real image in an original size:
determining an insert area of the template image in an original size;
and carrying out filtering and noise reduction treatment on the insert area of the template image with the original size.
5. The mold handling method of claim 4, wherein the determining the original size of the insert region of the template image comprises:
obtaining each interest area framed and selected in the template image with the original size;
and combining the interest areas to obtain the insert area of the template image with the original size.
6. The mold handling method of claim 3, wherein the determining an insert anomaly region from the insert region of the template image and the insert region of the real image comprises:
carrying out size reduction processing on the insert area of the reduced-size actual measurement image according to the scaling factor to obtain the insert area of the actual measurement image with the original size;
and determining the insert abnormal area according to the insert area of the template image with the original size and the insert area of the actual measurement image with the original size.
7. The mold processing method of claim 6, wherein the determining the insert anomaly region from the insert region of the template image of original size and the insert region of the real image of original size comprises:
acquiring a difference image of an insert area of the template image with the original size and an insert area of the actual measurement image with the original size;
performing region filtering on the difference image according to a preset gray threshold value to obtain a candidate region;
and determining the insert abnormal area according to the candidate area.
8. The mold handling method of claim 7, wherein said determining the insert anomaly region from the candidate region comprises:
and performing area filtering on the candidate area according to a first area threshold value to obtain the insert abnormal area.
9. The mold handling method of any of claims 1 to 8, wherein the determining attribute information of the insert abnormality region includes:
performing type identification on the insert abnormal area according to a second area threshold to obtain type information of the insert abnormal area;
and calculating the center of the insert abnormal area to obtain the position information of the insert abnormal area.
10. The mold processing method according to claim 9, wherein the sending the attribute information to a correction apparatus includes:
and sending the type information and the position information of the insert abnormal area to the correction equipment.
11. A mold handling apparatus, comprising:
the first determining module is used for acquiring a template image and a real measurement image of a mold and determining an insert area of the real measurement image according to the insert area of the template image;
the second determining module is used for determining an insert abnormal area according to the insert area of the template image and the insert area of the actual measurement image;
the third determining module is used for determining the attribute information of the insert abnormal area;
and the sending module is used for sending the attribute information to the correcting equipment so that the correcting equipment can carry out insert correction on the mould according to the attribute information.
12. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the mold processing method of any one of claims 1 to 10 when executing the program.
13. A mold processing system characterized by comprising a correction apparatus and an electronic apparatus for performing the mold processing method according to any one of claims 1 to 10.
14. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out a method of mold processing according to any one of claims 1 to 10.
CN202110340045.3A 2021-03-30 2021-03-30 Mold processing method, mold processing device, electronic apparatus, mold processing system, and storage medium Pending CN113160148A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202110340045.3A CN113160148A (en) 2021-03-30 2021-03-30 Mold processing method, mold processing device, electronic apparatus, mold processing system, and storage medium
PCT/CN2021/097262 WO2022205606A1 (en) 2021-03-30 2021-05-31 Mould processing method and apparatus, electronic device, system, and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110340045.3A CN113160148A (en) 2021-03-30 2021-03-30 Mold processing method, mold processing device, electronic apparatus, mold processing system, and storage medium

Publications (1)

Publication Number Publication Date
CN113160148A true CN113160148A (en) 2021-07-23

Family

ID=76885801

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110340045.3A Pending CN113160148A (en) 2021-03-30 2021-03-30 Mold processing method, mold processing device, electronic apparatus, mold processing system, and storage medium

Country Status (2)

Country Link
CN (1) CN113160148A (en)
WO (1) WO2022205606A1 (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103407283A (en) * 2013-08-21 2013-11-27 日东电子科技(深圳)有限公司 Solder paste printing press and vision aligning method thereof
CN104899597A (en) * 2015-04-16 2015-09-09 厦门博视源机器视觉技术有限公司 Mould protector specific to insert molding and realization method thereof
CN105046271A (en) * 2015-06-25 2015-11-11 哈尔滨工业大学 MELF (Metal Electrode Leadless Face) component positioning and detecting method based on match template
CN107576667A (en) * 2017-10-13 2018-01-12 成都精工华耀机械制造有限公司 A kind of railway rail clip abnormality detection system based on linear array thermal camera
US20200068081A1 (en) * 2018-08-23 2020-02-27 Konica Minolta, Inc. Image inspection device and program
CN111369513A (en) * 2020-02-28 2020-07-03 广州视源电子科技股份有限公司 Abnormity detection method, abnormity detection device, terminal equipment and storage medium

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103407283A (en) * 2013-08-21 2013-11-27 日东电子科技(深圳)有限公司 Solder paste printing press and vision aligning method thereof
CN104899597A (en) * 2015-04-16 2015-09-09 厦门博视源机器视觉技术有限公司 Mould protector specific to insert molding and realization method thereof
CN105046271A (en) * 2015-06-25 2015-11-11 哈尔滨工业大学 MELF (Metal Electrode Leadless Face) component positioning and detecting method based on match template
CN107576667A (en) * 2017-10-13 2018-01-12 成都精工华耀机械制造有限公司 A kind of railway rail clip abnormality detection system based on linear array thermal camera
US20200068081A1 (en) * 2018-08-23 2020-02-27 Konica Minolta, Inc. Image inspection device and program
CN111369513A (en) * 2020-02-28 2020-07-03 广州视源电子科技股份有限公司 Abnormity detection method, abnormity detection device, terminal equipment and storage medium

Also Published As

Publication number Publication date
WO2022205606A1 (en) 2022-10-06

Similar Documents

Publication Publication Date Title
CN110008806B (en) Information processing device, learning processing method, learning device, and object recognition device
US20230377158A1 (en) Image segmentation method, apparatus, device, and medium
US9905025B2 (en) Moving object tracking apparatus, method and unmanned aerial vehicle using the same
US20180253852A1 (en) Method and device for locating image edge in natural background
WO2020082731A1 (en) Electronic device, credential recognition method and storage medium
WO2021169102A1 (en) Text image processing method and apparatus, and computer device and storage medium
WO2021189848A1 (en) Model training method and apparatus, cup-to-disc ratio determination method and apparatus, and device and storage medium
US9245194B2 (en) Efficient line detection method
CN113436100B (en) Method, apparatus, device, medium, and article for repairing video
CN111539238B (en) Two-dimensional code image restoration method and device, computer equipment and storage medium
CN109300139B (en) Lane line detection method and device
WO2019001164A1 (en) Optical filter concentricity measurement method and terminal device
CN113066088A (en) Detection method, detection device and storage medium in industrial detection
CN110827301B (en) Method and apparatus for processing image
CN114298985B (en) Defect detection method, device, equipment and storage medium
WO2019109410A1 (en) Fully convolutional network model training method for splitting abnormal signal region in mri image
CN113160148A (en) Mold processing method, mold processing device, electronic apparatus, mold processing system, and storage medium
CN116342585A (en) Product defect detection method, device, equipment and storage medium
CN108629219B (en) Method and device for identifying one-dimensional code
CN115829929A (en) Method, device and equipment for detecting defects of product surface image and storage medium
CN111429450B (en) Corner point detection method, system, equipment and storage medium
CN114596210A (en) Noise estimation method, device, terminal equipment and computer readable storage medium
CN114241036A (en) Method and device for determining transparent band boundary, electronic equipment and storage medium
CN112053300B (en) Correction method, device and equipment for illumination non-uniform image
CN114581890B (en) Method and device for determining lane line, electronic equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination