WO2022110043A1 - Erosion detection method and apparatus, and computer-readable medium - Google Patents

Erosion detection method and apparatus, and computer-readable medium Download PDF

Info

Publication number
WO2022110043A1
WO2022110043A1 PCT/CN2020/132353 CN2020132353W WO2022110043A1 WO 2022110043 A1 WO2022110043 A1 WO 2022110043A1 CN 2020132353 W CN2020132353 W CN 2020132353W WO 2022110043 A1 WO2022110043 A1 WO 2022110043A1
Authority
WO
WIPO (PCT)
Prior art keywords
target
component
depth value
detected
erosion
Prior art date
Application number
PCT/CN2020/132353
Other languages
French (fr)
Chinese (zh)
Inventor
董晓滨
赵杰
许晓东
Original Assignee
西门子股份公司
西门子(中国)有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 西门子股份公司, 西门子(中国)有限公司 filed Critical 西门子股份公司
Priority to PCT/CN2020/132353 priority Critical patent/WO2022110043A1/en
Publication of WO2022110043A1 publication Critical patent/WO2022110043A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis

Definitions

  • the present invention relates to the technical field of non-destructive testing, and in particular, to an erosion detection method, device and computer-readable medium.
  • Ceramic heat shield is located on the outer layer of the thermal protection structure on the inner surface of the gas turbine and has excellent ablation resistance. Defects such as damage and falling blocks, when the ceramic insulation tile has defects such as cracks, damage and falling blocks, the high temperature will cause damage to the metal casing of the combustion chamber. Therefore, the erosion detection of ceramic insulation tiles is an important link in the routine inspection process of gas turbines. According to the results of erosion detection, it can be determined whether the ceramic insulation tiles need to be replaced.
  • the erosion detection method, device and computer readable medium provided by the present invention can improve the efficiency of erosion detection.
  • an embodiment of the present invention provides an erosion detection method, including:
  • the depth values of at least two target points on the component to be detected are determined, wherein the depth value of any target point on the component to be detected is used to represent The distance between the target point and the center point of the two lenses included in the binocular camera;
  • the degree of erosion of the component to be inspected is determined.
  • an embodiment of the present invention further provides an erosion detection device, including:
  • an acquisition module configured to acquire a first detection image and a second detection image of the component to be detected, wherein the first detection image and the second detection image are respectively collected by two cameras included in the binocular camera;
  • An image processing module for determining at least two target points on the component to be detected according to the parallax of the first detection image acquired by the acquisition module and the second detection image acquired by the acquisition module , wherein the depth value of any target point on the component to be detected is used to represent the distance between the target point and the center point of the two lenses included in the binocular camera;
  • An erosion judging module is used for determining the degree of erosion of the part to be inspected according to the depth value of each of the target points on the part to be inspected determined by the image processing module.
  • an embodiment of the present invention further provides another erosion detection apparatus, including: at least one memory and at least one processor;
  • the at least one memory for storing a machine-readable program
  • the at least one processor is configured to invoke the machine-readable program to execute the method provided in the first aspect.
  • an embodiment of the present invention further provides a computer-readable medium, where computer instructions are stored on the computer-readable medium, and when executed by a processor, the computer instructions cause the processor to execute the above-mentioned first method provided by the aspect.
  • the first detection image and the second detection image of the component to be detected respectively collected by the two cameras included in the binocular camera are acquired, according to the first detection image and the second detection image. 2. Detect the parallax of the image, determine the depth value of at least two target points on the component to be detected, and then determine the degree of erosion of the component to be detected according to the depth value of each target point, wherein the depth value of any target point on each component to be detected It is used to characterize the distance between the target point and the center point of the two lenses included in the binocular camera.
  • the distance between each target point on the component to be detected and the line connecting the center points of the two lenses of the binocular camera can be obtained by using the parallax between the two images captured by the binocular camera.
  • the depth value of each target point can determine the degree of corrosion of the component to be tested, so that the degree of corrosion can be indirectly reflected by the depth value, without the need for staff to perform visual inspection one by one, and then rely on work experience to determine whether the component to be tested needs to be replaced. Thereby, the efficiency of performing erosion detection is improved.
  • the depth value of each target point on the component to be detected according to the parallax of the first detection image and the second detection image it is possible to first determine that the target point is in pixel points corresponding to the first detection image and the second detection image, and then determine the parallax of the first detection image and the second detection image to determine the depth value of the target point.
  • the depth value can be determined in the following ways:
  • the target parallax is used to represent the relative position of the first pixel point in the first detection image and the second pixel point The difference between the relative positions of the pixel points in the second detection image;
  • the depth value of the target point is determined according to the target parallax, the focal length of the camera in the binocular camera, and the distance between the optical centers of the two cameras in the binocular camera.
  • the depth value is the distance from the target point on the component to be detected to the plane of the binocular camera, it can indirectly reflect the erosion information on the upper surface of the component to be detected, and then can treat Test components for objective and reasonable evaluation. At the same time, there is no need for staff to perform visual inspection based on experience, thereby further improving the efficiency of erosion inspection.
  • the corrosion degree of the component to be tested can be determined by the following methods:
  • the depth value of each of the target points on the edge of the component to be detected is within the preset threshold range, determine the depth of the component to be detected according to the depth value of each of the target points on the component to be detected degree of erosion;
  • the degree of erosion of the part to be inspected is determined according to the calibrated depth value of each of the target points on the part to be inspected.
  • the depth value of each target point located at the edge of the component to be detected is within a preset threshold range, it can be determined whether there is an included angle between the imaging plane of the binocular camera and the surface of the component to be detected, If the depth value of each target point located at the edge of the part to be inspected is within the preset threshold range, then there is no included angle (ie parallel) between the imaging plane of the binocular camera and the surface of the part to be inspected, and the determined The depth value of the target point determines the degree of erosion of the component to be detected; if the depth values of each target point located on the edge of the component to be detected are not all within the preset threshold range, it needs to be determined according to the depth value of each target point on the edge of the component to be detected.
  • the angle between the imaging plane of the binocular camera and the surface of the part to be inspected (that is, not parallel), and the depth value of each target point on the part to be inspected is calibrated according to the angle, and then according to the depth value of each target after calibration
  • the effective detection of the component to be detected may be determined first. area, and then determine the erosion degree of the component to be inspected according to the depth value of each target point in the effective inspection area.
  • the corrosion degree of the component to be tested can be determined by the following methods:
  • an effective detection area on the component to be detected is determined, wherein the effective detection area includes at least two the target point, and the depth value of each of the target points in the effective detection area is within the set range;
  • the degree of erosion of the component to be detected is determined.
  • the effective detection area is determined according to the depth value of each target point and the distribution of each target point on the component to be detected, so that the target points far away from the center of the component to be detected, with a small number and a large error can be removed, Only the area where 90% of the target points concentrated on the parts to be inspected are reserved as the effective detection area, so as to determine the degree of erosion of the parts to be inspected according to the depth value of each target point in the effective inspection area, so as to realize the detection of each target point. Noise reduction processing of depth values further improves the accuracy and reliability of erosion detection.
  • the maximum depth of The difference between the value and the minimum depth value further determines the degree of erosion of the component to be inspected.
  • the corrosion degree of the component to be tested can be determined by the following methods:
  • first target depth value is the maximum value among the depth values of each of the target points on the component to be detected
  • second target depth value is the minimum value among the depth values of each of the target points on the component to be detected
  • the component to be inspected has an erosion degree that needs to be replaced.
  • the maximum depth value and the minimum depth value are respectively determined from the depth values of each target point on the component to be detected, and the target difference value is compared by calculating the target difference value between the maximum depth value and the minimum depth value.
  • the preset threshold if the target difference is not greater than the preset threshold, it is determined that the component to be detected is an erosion degree that does not need to be replaced temporarily; if the target difference is greater than the preset threshold, it is determined that the component to be detected is The level of erosion that needs to be replaced.
  • the target difference is the actual maximum erosion depth of the surface of the component to be detected. Therefore, when the target difference exceeds the set standard value (ie, the preset threshold), the component to be detected needs to be replaced. Detection of corrosion levels of components. This process eliminates the need for personnel to perform visual inspections with experience, increasing the efficiency of erosion inspections.
  • FIG. 2 is a flowchart of a method for acquiring a depth value provided by an embodiment of the present invention
  • FIG. 3 is a flowchart of a method for determining an erosion degree provided by an embodiment of the present invention.
  • FIG. 4 is a flowchart of another method for determining the degree of erosion provided by an embodiment of the present invention.
  • FIG. 5 is a flowchart of another method for determining an erosion degree provided by an embodiment of the present invention.
  • FIG. 6 is a flowchart of another erosion detection method provided by an embodiment of the present invention.
  • FIG. 7 is a schematic diagram of an erosion detection device provided by an embodiment of the present invention.
  • FIG. 8 is a schematic diagram of another erosion detection device provided by an embodiment of the present invention.
  • FIG. 9 is a schematic diagram of another erosion detection device provided by an embodiment of the present invention.
  • FIG. 10 is a schematic diagram of still another erosion detection device provided by an embodiment of the present invention.
  • FIG. 11 is a schematic diagram of still another erosion detection device provided by an embodiment of the present invention.
  • FIG. 12 is a schematic diagram of an erosion detection apparatus including a memory and a processor provided by an embodiment of the present invention.
  • Memory 705 Processor 7021: Pixel acquisition unit
  • the first relationship determination unit 7033 The second relationship determination unit 7034: The area determination unit
  • Second erosion determination unit 7036 Depth value filtering unit 7037: Operation unit
  • the second judgment unit 7039 The erosion degree determination unit
  • the staff in the current corrosion detection of ceramic thermal insulation tiles in gas turbines, the staff usually enters the combustion chamber through the manhole, and directly visually inspects them with the naked eye, and determines the position, direction and length of the cracks against the ceramic defect template. Etc., based on work experience to determine the crack depth of the ceramic thermal insulation tile, and then determine the ceramic thermal insulation tile that needs to be replaced. This method is labor-intensive, slow in detection and susceptible to subjective factors, resulting in low efficiency in corrosion detection of ceramic insulation tiles.
  • the first detection image and the second detection image of the component to be detected respectively collected by the two cameras included in the binocular camera are acquired, and according to the target points corresponding to the first detection image and the second detection image, respectively According to the coordinate difference between the two pixel points, the target parallax of the target point in the first detection image and the second detection image is determined, and according to the target parallax, the distance between the optical centers of the two cameras in the binocular camera The distance between and the focal length of the camera determine the depth value of the target point. In this way, the depth value of each target point in the component to be detected can be obtained, and the maximum depth value and the minimum depth value are respectively determined from the depth values of each target point.
  • the threshold value When the target difference between the maximum depth value and the minimum depth value is greater than the preset value When the threshold value is reached, it can be determined that the component to be detected is the degree of corrosion that needs to be replaced, so as to realize the detection of the degree of corrosion of the component to be detected. This process eliminates the need for personnel to perform visual inspections with experience, increasing the efficiency of erosion inspections.
  • the first detection image and the second detection image may also be collected by two cameras of the binocular camera, the two cameras in the binocular camera have the same focal length, and the two cameras in the binocular camera have the same focal length.
  • the depth value of any target point on the component to be detected is used to represent the distance between the target point and the center point of the two lenses included in the binocular camera.
  • the target parallax is used to represent the difference between the relative position of the first pixel point in the first detection image and the relative position of the second pixel point in the second detection image.
  • an embodiment of the present invention provides an erosion detection method, and the method may include the following steps:
  • Step 101 Acquire a first detection image and a second detection image of the component to be detected, wherein the first detection image and the second detection image are respectively collected by two cameras included in the binocular camera;
  • Step 102 Determine the depth values of at least two target points on the component to be detected according to the parallax of the first detection image and the second detection image, wherein the depth value of any target point on the component to be detected is used to characterize the target point and the dual target point.
  • Step 103 Determine the degree of erosion of the component to be detected according to the depth values of each target point on the component to be detected.
  • the first detection image and the second detection image of the component to be detected that are respectively collected by two cameras included in the binocular camera are acquired, and the to-be-detected image is determined according to the parallax of the first detection image and the second detection image.
  • the depth values of at least two target points on the component and then determine the degree of erosion of the component to be detected according to the depth value of each target point, wherein the depth value of any target point on each component to be detected is used to characterize the target point and the The distance between the center points of the two lenses included in the binocular camera.
  • the distance between each target point on the component to be detected and the line connecting the center points of the two lenses of the binocular camera can be obtained by using the parallax between the two images captured by the binocular camera.
  • the depth value of each target point can determine the degree of corrosion of the component to be tested, so that the degree of corrosion can be indirectly reflected by the depth value, without the need for staff to perform visual inspection one by one, and then rely on work experience to determine whether the component to be tested needs to be replaced. Non-destructive testing of components to be tested is achieved, thereby improving the efficiency of corrosion testing.
  • the left and right cameras included in the binocular camera simultaneously capture images of the component to be detected, wherein the distance from the binocular camera to the surface of the component to be detected can be determined according to user requirements.
  • the distance from the binocular camera to the surface of the part to be inspected can be adjusted according to the size of the part to be inspected. For example, if the size of the ceramic thermal insulation tile inside the gas turbine generator is 20cm*20cm, the distance between the binocular camera plane and the ceramic thermal insulation tile is 30-50cm.
  • the detection image includes multiple components to be detected, the distance from the binocular camera to the surface of the components to be detected can be adjusted according to the number of components to be detected.
  • the two lenses included in the binocular camera should be placed directly above the surface to be inspected when collecting inspection images.
  • Auxiliary lighting can be used to maintain a good background light source to obtain inspection images with clear image quality, thereby improving the accuracy of erosion detection. and reliability.
  • the present invention there is a deviation between the positions of the pixels imaged by the two cameras in the same scene, that is, parallax.
  • parallax Based on the parallax, according to the relative positional relationship between the left and right cameras and the parameter information of the camera itself, the spatial distribution of the target can be obtained.
  • Depth information which is used to represent the distance of a certain point on the target in the scene from the camera. Therefore, by means of the parallax of the first detection image and the second detection image collected by the binocular camera, the depth value of the target point of the component to be detected can be determined.
  • the three-dimensional position information of the target in space can be obtained according to the depth value information. Therefore, according to the depth value of each target point on the part to be inspected, the three-dimensional position information of the part to be inspected in space can be determined, and then the three-dimensional position information of the part to be inspected can be determined. The degree of corrosion of the parts, to achieve non-destructive testing of the parts to be tested.
  • determining the depth value of each target point on the component to be detected according to the parallax of the first detection image and the second detection image it can be determined that the target point is in the first detection image.
  • the pixel points corresponding to the first detection image and the second detection image are further determined to determine the parallax of the first detection image and the second detection image to determine the depth value of the target point.
  • determining the depth value according to the disparity can be implemented as follows:
  • Step 201 for each target point on the component to be detected, determine the first pixel point corresponding to the target point in the first detection image, and determine the second pixel point corresponding to the target point in the second detection image;
  • Step 202 Determine the target parallax between the first pixel point and the second pixel point, wherein the target parallax is used to represent the relative position of the first pixel point in the first detection image and the position of the second pixel point in the second detection image. difference in relative position;
  • Step 203 Determine the depth value of the target point according to the target parallax, the focal length of the camera in the binocular camera, and the distance between the optical centers of the two cameras in the binocular camera.
  • the corresponding pixel points of the target point in the first detection image and the second detection image are determined, and according to the coordinates of the pixel point, it is determined that the target point is in the first detection image and the second detection image.
  • the difference between the relative positions of the two detection images is the target parallax of the target point, and then the depth of the target point is obtained through parameters such as the target parallax, the focal length of the camera in the binocular camera, and the distance between the optical centers of the two cameras. value.
  • the first detection image may be used as a reference, and for each target point, the pixel coordinates of the first pixel point corresponding to the target point in the reference image may be used as a template, and the second detection image may be searched for the For the same or similar target points, the pixel coordinates of the second pixel point are determined, and the disparity is determined by the positional deviation between the pixel coordinates of the two pixel points. Because the binocular cameras are usually placed horizontally, the positional deviation is generally reflected in the horizontal direction.
  • the coordinate of point X in the scene in the horizontal direction of the left camera is x
  • the coordinate of the image in the horizontal direction of the right camera is x+p
  • p is the parallax of point X.
  • a parallax map of the image to be detected can be obtained.
  • the parallax map can be based on the first detected image, its size is the size of the first detected image, and the element value is the parallax of each target point. , so that the disparity of each target point can be intuitively obtained through the disparity map, which is convenient for subsequent acquisition of the depth value of each target point.
  • the depth value of each target point is determined by the following formula:
  • h is used to characterize the depth value of each target point in the part to be detected
  • b is used to characterize the distance between the optical centers of the two cameras in the binocular camera
  • c is used to characterize the focal length of the camera in the binocular camera
  • p is used to characterize The parallax of each target point between the first detection image and the second detection image is characterized.
  • the depth value is used to represent the distance between the target point and the center point of the two lenses included in the binocular camera, because the erosion information on the upper surface of the component to be detected can be reflected by the depth value, thereby enabling The objective and reasonable evaluation of the parts to be tested is carried out, the non-destructive testing of the parts to be tested is realized, and the visual inspection is avoided, thereby further improving the efficiency of corrosion testing.
  • determining the degree of erosion of the component to be detected according to the depth value of each target point on the component to be detected you can first determine the degree of erosion of the component to be detected according to the depth of each target point on the edge of the component to be detected.
  • the depth value ensures that the surface of the part to be inspected is parallel to the imaging plane of the binocular camera, thereby determining the degree of erosion of the part to be inspected.
  • determining the degree of erosion of the component to be inspected can be achieved as follows:
  • Step 301 determine whether the depth value of each target point located at the edge of the component to be detected is within the preset threshold range, if it is Y, go to step 302, if not N, go to step 303;
  • Step 302 According to the depth value of each target point on the component to be detected, determine the degree of erosion of the component to be detected, and end the current process;
  • Step 303 Determine the angle between the imaging plane of the binocular camera and the surface of the component to be detected according to the depth value of each target point on the edge of the component to be detected;
  • Step 304 Calibrate the depth value of each target point on the component to be detected according to the included angle
  • Step 305 Determine the degree of erosion of the component to be detected according to the calibrated depth values of each target point on the component to be detected, and end the current process.
  • the depth value of each target point located at the edge of the component to be detected is within a preset threshold range, it can be determined whether there is an included angle between the imaging plane of the binocular camera and the surface of the component to be detected, If the depth value of each target point located at the edge of the component to be detected is within the preset threshold range, then there is no included angle (that is, parallel) between the imaging plane of the binocular camera and the surface of the component to be detected, and the determined
  • the depth value of the target point determines the degree of erosion of the component to be detected; if the depth values of each target point located on the edge of the component to be detected are not all within the preset threshold range, it needs to be determined according to the depth value of each target point on the edge of the component to be detected.
  • the angle between the imaging plane of the binocular camera and the surface of the part to be inspected (that is, not parallel), and the depth value of each target point on the part to be inspected is calibrated according to the angle, and then according to the depth value of each target after calibration
  • the depth value of each target point located at the edge of the component to be detected is within the preset threshold range.
  • the threshold range is set to 50cm ⁇ 0.5cm. If the depth values of each target point on the edge of the component to be detected are 49.5cm, 49.6cm, 50.3cm, 49.8cm, 49.5cm, 50cm, 49.7cm, 50.1cm and 50.5cm respectively, the It is determined that the depth values of each target point are all within the preset threshold range, that is, the imaging plane of the binocular camera is parallel to the surface of the component to be detected.
  • the depth value of each target point in the component to be detected can be calibrated in the following manner:
  • S1 Determine the minimum depth value (A) and the maximum depth value (B) from the depth values of each target point on the edge of the component to be detected;
  • h i is used to represent the depth value of the i target point in the component to be detected after calibration processing
  • is used to represent the angle between the imaging plane of the binocular camera and the surface of the component to be detected
  • h b is used to represent the maximum
  • the depth value (B) ha is used to represent the minimum depth value (A)
  • x b is used to represent the abscissa of the pixel corresponding to the B target point corresponding to the maximum depth value (B) in the first detection image
  • x a is used to represent the abscissa of the pixel point corresponding to the A target point corresponding to the minimum depth value (A) in the first detection image
  • h i 1 is used to represent the i target point in the component to be detected before the calibration process.
  • Depth value; x i is used to represent the abscissa of the pixel point corresponding to the i target point in the first detection image.
  • the component to be detected may be other components in the gas turbine, such as a blade, but the surface of the blade is an arc surface. Therefore, during the erosion detection process, it is necessary to use the above-mentioned depth value of each target point in the component to be detected for calibration way to calibrate the depth value of the blade.
  • the effective detection area of the component to be detected can be determined first, and then The erosion degree of the component to be inspected is determined according to the depth value of each target point in the effective inspection area.
  • determining the degree of erosion of the component to be inspected can be achieved in the following ways:
  • Step 401 According to the depth value of each target point and the distribution of each target point on the component to be detected, determine the effective detection area on the component to be detected, wherein, the effective detection area includes at least two target points, and the effective detection area The depth value of each target point is within the set range;
  • Step 402 Determine the degree of erosion of the component to be detected according to the depth value of each target point in the effective detection area.
  • the effective detection area is determined according to the depth value of each target point and the distribution of each target point on the component to be detected, so that the target points far away from the center of the component to be detected, with a small number and a large error can be removed, Only the area where 90% of the target points concentrated on the parts to be inspected are reserved as the effective detection area, so as to determine the degree of erosion of the parts to be inspected according to the depth value of each target point in the effective inspection area, so as to realize the detection of each target point.
  • the noise reduction processing of depth value further improves the accuracy and reliability of erosion detection.
  • a polymorphic filter may be used to remove abnormal depth values, so as to realize noise reduction processing on the depth values of each target point and reduce errors in the erosion detection result.
  • the degree of erosion of the component to be inspected may be further determined by the difference between the maximum depth value and the minimum depth value.
  • the method for determining the degree of erosion of the component to be inspected includes the following steps:
  • Step 501 Determine a first target depth value and a second target depth value, wherein the first target depth value is the maximum value among the depth values of each target point on the component to be detected, and the second target depth value is the depth value of each target point on the component to be detected. The minimum value among the depth values of the target point;
  • Step 502 Perform a difference operation on the first target depth value and the second target depth value to obtain a target difference value
  • Step 503 Determine whether the absolute value of the target difference is greater than the preset threshold, if it is Y, go to step 504, if not N, go to step 505;
  • Step 504 Determine the corrosion degree of the component to be detected that needs to be replaced, and end the current process
  • Step 505 Determine the corrosion degree of the component to be inspected that does not need to be replaced, and end the current process.
  • the maximum depth value and the minimum depth value are respectively determined from the depth values of each target point on the component to be detected, and the target difference value is compared by calculating the target difference value between the maximum depth value and the minimum depth value.
  • the preset threshold if the target difference is not greater than the preset threshold, it is determined that the component to be detected is an erosion degree that does not need to be replaced temporarily; if the target difference is greater than the preset threshold, it is determined that the component to be detected is The level of erosion that needs to be replaced.
  • the target difference is the actual maximum erosion depth of the surface of the component to be detected. Therefore, when the target difference exceeds the set standard value (ie, the preset threshold), the component to be detected needs to be replaced. Detection of corrosion levels of components. This process eliminates the need for personnel to perform visual inspections with experience, increasing the efficiency of erosion inspections.
  • the target difference between the maximum depth value and the minimum depth value among the depth values of each target point on the component to be detected is greater than a preset threshold, it is determined that the component to be detected is an erosion degree that needs to be replaced , and output the target difference, which is the actual erosion depth. Based on all the output target difference values and the parts to be inspected, an inspection report for this inspection can also be automatically generated.
  • the inspection report can include the location of the inspected parts that need to be replaced, the erosion condition, the erosion depth value, and the maintenance date. and other statistical data, thereby helping to complete the erosion detection work faster and improve the efficiency of erosion detection.
  • a parallax map of the image to be detected can be obtained, and the depth value of each target point on the component to be detected is converted to the parallax map to obtain a depth map, a depth map It can be a grayscale image or a pseudo-color image, but the pixel value of the depth map is the actual distance between the target point and the center point of the two lenses included in the binocular camera.
  • the color in the depth map represents the depth.
  • a three-dimensional image corresponding to the part to be inspected can be obtained according to the depth map, wherein the three-dimensional image includes the three-dimensional position information and depth value of each target point of the part to be inspected in space, and the three-dimensional image of the part to be inspected can be visually seen through the three-dimensional image.
  • the topography information is more visualized, and it is convenient to directly judge the two-dimensional topography and erosion depth of the surface of the component to be tested.
  • the method may include the following steps:
  • Step 601 Acquire a first inspection image and a second inspection image of the component to be inspected.
  • the first detection image and the second detection image may be collected by two cameras of the binocular camera or two cameras in the binocular camera, and the first detection image and the second detection image may include a to-be-detected image.
  • the image of the inspection part may also include images of a plurality of parts to be inspected.
  • a binocular camera is used, and the binocular camera is placed on the surface of the ceramic thermal insulation tile to be detected at a position where the distance between the binocular camera plane and the ceramic thermal insulation tile is 50cm.
  • auxiliary lighting a first inspection image and a second inspection image of the ceramic thermal insulation tile are collected.
  • Step 602 Determine the target disparity of the target point.
  • each target point on the component to be detected determines the first pixel point and the second pixel point corresponding to the target point in the first detection image and the second detection image respectively, and according to the The difference between the relative positions of one pixel point and the second pixel point determines the target parallax of the target point in the first detection image and the second detection image.
  • the first pixel point X1 (x1, y1) corresponding to the X point in the first detection image, and determine the first pixel point X1 (x1, y1) in the second detection image.
  • the corresponding second pixel point X2 (x2, y2), according to the difference in the relative position of X1 and X2 in the horizontal direction, determine the target parallax of point X in the first detection image and the second detection image is x1-x2 absolute. value.
  • Step 603 Determine the depth value of the target point.
  • the depth value of each target point is determined by the following formula:
  • h is used to characterize the depth value of each target point in the part to be detected
  • b is used to characterize the distance between the optical centers of the two cameras in the binocular camera
  • c is used to characterize the focal length of the camera in the binocular camera
  • p is used to characterize The parallax of each target point between the first detection image and the second detection image is characterized.
  • the target parallax p is the absolute value of x1-x2
  • the distance between the optical centers of the two cameras in the binocular camera is b
  • the camera in the binocular camera is the absolute value of x1-x2.
  • the focal length is c
  • the depth value h of point X is calculated by the above formula.
  • Step 604 Determine the effective inspection area on the component to be inspected.
  • the effective detection area on the component to be detected is determined according to the depth value of each target point and the distribution of each target point on the component to be detected,
  • the noise reduction processing for the depth value of each target point is realized, wherein at least two target points are included in the effective detection area, and the depth value of each target point in the effective detection area is within the set range.
  • the target points far away from the center of the component to be detected with a small number and a large error can be removed, and only Retain the area where 90% of the target points concentrated on the ceramic heat insulation tile are located as the effective detection area.
  • Step 605 Determine whether the depth value of each target point on the edge of the component to be detected is within the preset threshold range, if yes, go to Step 607, if not, go to Step 606.
  • step 607 is performed for the depth value of each target point on the component to be detected, if the depth value of each target point on the edge is not within the preset threshold value range, then for the component to be detected.
  • Step 606 is performed on the depth value of each upper target point.
  • step 606 determines whether the depth value of each target point located on the inner edge of the effective detection area is within 50cm ⁇ 0.5cm, if the depth of each target point on the edge is within 50cm ⁇ 0.5cm
  • the values are 49.5cm, 60cm, 56.8cm, 54.2cm, 52.5cm, 50cm, 49.7cm, 53.1cm and 56.2cm respectively, then the depth value of each target point on the edge is not within the preset threshold range, and the imaging of the binocular camera If the plane is not parallel to the surface of the component to be inspected, step 606 is executed.
  • Step 606 Calibrate the depth value of each target point on the component to be detected.
  • the angle between the imaging plane of the binocular camera and the surface of the component to be detected is determined according to the depth value of each target point on the edge of the component to be detected, and the depth value of each target point on the edge of the component to be detected is determined from the depth value of each target point on the edge of the component to be detected. Determine the minimum depth value (A) and the maximum depth value (B) respectively;
  • the depth value of each target point in the component to be detected is calibrated by the following formula:
  • h i is used to represent the depth value of the i target point in the component to be detected after calibration processing
  • is used to represent the angle between the imaging plane of the binocular camera and the surface of the component to be detected
  • h b is used to represent the maximum
  • the depth value (B) ha is used to represent the minimum depth value (A)
  • x b is used to represent the abscissa of the pixel corresponding to the B target point corresponding to the maximum depth value (B) in the first detection image
  • x a is used to represent the abscissa of the pixel point corresponding to the A target point corresponding to the minimum depth value (A) in the first detection image
  • h i 1 is used to represent the i target point in the component to be detected before the calibration process.
  • Depth value; x i is used to represent the abscissa of the pixel point corresponding to the i target point in the first detection image.
  • the minimum depth value (A: 50cm) and the maximum depth value (B: 60cm) are respectively determined from the depth values of each target point on the edge of the component to be detected, and the corresponding point A in the first detection image is determined.
  • the pixel coordinates (1, 2) are determined, the pixel coordinates (19, 4) corresponding to point B in the first detection image are determined, and the distance between the imaging plane of the binocular camera and the surface of the component to be detected is determined by the above formula.
  • the angle is arctan5/9
  • the Y point on the ceramic heat insulation tile the pixel coordinate in the first detection image is (10,9)
  • its depth value is 60cm
  • the calibration is performed by the above formula to obtain the calibration
  • the depth value of the rear Y point is 55cm (ie 60-5).
  • Step 607 Determine the first target depth value and the second target depth value.
  • a first target depth value and a second target depth value are determined, wherein the first target depth value is the maximum value among the depth values of each target point on the component to be detected, and the second target depth value is the value to be detected. Detects the minimum value of the depth values of each target point on the part.
  • the maximum depth value is Y 55cm
  • the minimum depth value is 50cm
  • Step 608 Perform a difference operation on the first target depth value and the second target depth value.
  • a difference value operation is performed on the first target depth value and the second target depth value to obtain a target difference value.
  • the maximum depth value is Y 55cm
  • the minimum depth value is 50cm
  • the target difference is 5cm.
  • Step 609 Determine the erosion degree of the component to be inspected.
  • the component to be inspected when judging whether the absolute value of the target difference is greater than a preset threshold, if so, it is determined that the component to be inspected is an erosion degree that needs to be replaced; if not, it is determined that the component to be inspected is an erosion that does not require replacement. degree.
  • the ceramic thermal insulation tile is the degree of erosion that needs to be replaced.
  • an embodiment of the present invention provides an erosion detection device, including:
  • An acquisition module 701 configured to acquire the first detection image and the second detection image of the component to be detected, wherein the first detection image and the second detection image are respectively collected by two cameras included in the binocular camera;
  • An image processing module 702 for determining the depth values of at least two target points on the component to be detected according to the parallax of the first detection image acquired by the acquisition module 701 and the second detection image acquired by the acquisition module, wherein the The depth value of any target point on the component is used to represent the distance between the target point and the center point of the two lenses included in the binocular camera;
  • An erosion judging module 703 is configured to determine the degree of erosion of the part to be inspected according to the depth values of each target point on the part to be inspected determined by the image processing module 702 .
  • the acquisition module 701 can be used to perform step 101 in the above method embodiments
  • the image processing module 702 can be used to perform step 102 in the above method embodiments
  • the erosion determination module 703 can be used to perform the above method embodiments. step 103.
  • the image processing module 702 includes:
  • a pixel point acquisition unit 7021 for each target point on the component to be detected, to determine the first pixel point corresponding to the target point in the first detection image, and to determine the target point corresponding to the second detection image.
  • a depth value acquisition unit 7023 configured to determine the depth value of the target point according to the focal length of the camera in the binocular camera, the distance between the optical centers of the two cameras in the binocular camera, and the target parallax determined by the parallax acquisition unit 7022.
  • the pixel point acquisition unit 7021 may be used to perform step 201 in the above method embodiments
  • the parallax acquisition unit 7022 may be used to perform step 202 in the above method embodiments
  • the depth value acquisition unit 7023 may be used to perform the above mentioned method embodiments. Step 203 in the method embodiment.
  • the erosion judgment module 703 includes:
  • a first judgment unit 7031 for judging whether the depth value of each target point located at the edge of the component to be detected is within the preset threshold range
  • a first relationship determination unit 7032 is used for when the first judgment unit 7031 determines that the depth value of each target point on the edge of the component to be detected is within the preset threshold range, then according to the depth value of each target point on the component to be detected, Determine the degree of erosion of the part to be inspected;
  • a second relationship determination unit 7033 is used for when the first judgment unit 7031 determines that the depth values of each target point on the edge of the component to be detected are not all within the preset threshold range, according to the depth of each target point on the edge of the component to be detected.
  • the value determines the angle between the imaging plane of the binocular camera and the surface of the part to be inspected, and calibrates the depth value of each target point on the part to be inspected according to the angle, and according to the calibrated depth value of each target point on the part to be inspected The depth value determines the degree of erosion of the part to be inspected.
  • the first judging unit 7031 may be configured to perform step 301 in the foregoing method embodiments
  • the first relationship determining unit 7032 may be configured to execute step 302 in the foregoing method embodiments
  • the second relationship determining unit 7033 may be configured to perform Steps 304 and 305 in the above method embodiments are performed.
  • the erosion judgment module 703 includes:
  • An area determination unit 7034 for determining the effective detection area on the component to be detected according to the depth value of each target point and the distribution of each target point on the component to be detected, wherein the effective detection area includes at least two target points , and the depth value of each target point in the effective detection area is within the set range;
  • a second erosion determination unit 7035 is configured to determine the degree of erosion of the component to be inspected according to the depth values of each target point in the effective inspection area determined by the area determination unit 7034 .
  • the region determination unit 7034 may be configured to perform step 401 in the above method embodiments, and the second erosion determination unit 7035 may be configured to perform step 402 in the above method embodiments.
  • the erosion determination module 703 includes:
  • a depth value screening unit 7036 for determining a first target depth value and a second target depth value, wherein the first target depth value is the maximum value among the depth values of each target point on the component to be detected, and the second target depth value is is the minimum value among the depth values of each target point on the component to be detected;
  • An erosion degree determination unit 7039 configured to determine that the component to be detected is an erosion degree that needs to be replaced when the absolute value of the target difference determined by the second determination unit 7038 is greater than a preset threshold.
  • the depth value screening unit 7036 may be configured to perform step 501 in the foregoing method embodiments
  • the computing unit 7037 may be configured to perform step 502 in the foregoing method embodiments
  • the second determining unit 7038 may be configured to execute the foregoing method implementations
  • the erosion degree determination unit 7039 may be used to perform steps 504 and 505 in the above method embodiments.
  • an embodiment of the present invention provides an erosion detection apparatus, including: at least one memory 704 and at least one processor 705;
  • the at least one memory 704 for storing a machine-readable program
  • the at least one processor 705 is configured to invoke the machine-readable program to execute the erosion detection methods provided in the foregoing embodiments.
  • the present invention also provides a computer-readable medium storing instructions for causing a machine to perform the erosion detection method as described herein.
  • a system or device equipped with a storage medium on which software program codes for implementing the functions of any of the above-described embodiments are stored, and which enables a computer (or CPU or MPU of the system or device) ) to read and execute the program code stored in the storage medium.
  • the program code itself read from the storage medium can implement the functions of any of the above-described embodiments, and thus the program code and the storage medium storing the program code form part of the present invention.
  • Examples of storage media for providing program code include floppy disks, hard disks, magneto-optical disks, optical disks (eg CD-ROM, CD-R, CD-RW, DVD-ROM, DVD-RAM, DVD-RW, DVD+RW), Magnetic tapes, non-volatile memory cards and ROMs.
  • the program code may be downloaded from a server computer over a communications network.
  • the program code read from the storage medium is written into the memory provided in the expansion board inserted into the computer or into the memory provided in the expansion module connected with the computer, and then based on the program code
  • the instructions cause the CPU or the like installed on the expansion board or expansion module to perform part and all of the actual operations, so as to realize the functions of any one of the above-mentioned embodiments.
  • the hardware modules may be implemented mechanically or electrically.
  • a hardware module may include permanent dedicated circuits or logic (eg, dedicated processors, FPGAs or ASICs) to perform corresponding operations.
  • the hardware modules may also include programmable logic or circuits (eg, general-purpose processors or other programmable processors), which may be temporarily set by software to complete corresponding operations.
  • the specific implementation mechanical, or dedicated permanent circuit, or temporarily provided circuit can be determined based on cost and time considerations.

Abstract

An erosion detection method and apparatus, and a computer-readable medium. The erosion detection method comprises: acquiring a first detection image and a second detection image of a component to be detected (101), wherein the first detection image and the second detection image are respectively collected by two cameras that are comprised in a binocular camera; determining depth values of at least two target points on said component according to the parallax of the first detection image and the second detection image (102), wherein the depth value of any target point on said component is used for representing the distance between the target point and a connecting line of center points of two lenses that are comprised in the binocular camera; and determining an erosion degree of said component according to the depth value of each target point on said component (103). By means of the method, the efficiency of erosion detection can be improved.

Description

侵蚀检测方法、装置和计算机可读介质Erosion detection method, apparatus and computer readable medium 技术领域technical field
本发明涉及无损检测技术领域,尤其涉及侵蚀检测方法、装置和计算机可读介质。The present invention relates to the technical field of non-destructive testing, and in particular, to an erosion detection method, device and computer-readable medium.
背景技术Background technique
陶瓷隔热瓦(ceramic heat shield,CHS)位于燃机内表面热防护结构的外层,具有优异的抗烧蚀性能,但长时间处于高温环境下陶瓷隔热瓦也会由于侵蚀而出现裂纹、破损及掉块等缺陷,当陶瓷隔热瓦出现裂纹、破损及掉块等缺陷时高温会导致燃烧室的金属壳体损坏。因此,陶瓷隔热瓦的侵蚀检测是燃气轮机常规检查过程中的重要环节,根据侵蚀检测的结果可以判断是否需要更换陶瓷隔热瓦。Ceramic heat shield (CHS) is located on the outer layer of the thermal protection structure on the inner surface of the gas turbine and has excellent ablation resistance. Defects such as damage and falling blocks, when the ceramic insulation tile has defects such as cracks, damage and falling blocks, the high temperature will cause damage to the metal casing of the combustion chamber. Therefore, the erosion detection of ceramic insulation tiles is an important link in the routine inspection process of gas turbines. According to the results of erosion detection, it can be determined whether the ceramic insulation tiles need to be replaced.
目前在对燃气轮机中陶瓷隔热瓦进行侵蚀检测时,通常由工作人员从人孔进入燃烧室,直接用肉眼进行目视检查,对照陶瓷缺陷模板确定裂纹的位置、走向、长度等,进而确定需要进行更换的陶瓷隔热瓦,导致对陶瓷隔热瓦进行侵蚀检测的效率较低。At present, when testing the erosion of ceramic thermal insulation tiles in gas turbines, the staff usually enters the combustion chamber from the manhole, and conducts visual inspection directly with the naked eye. Replacement ceramic insulation tiles result in less efficient erosion detection of ceramic insulation tiles.
发明内容SUMMARY OF THE INVENTION
有鉴于此,本发明提供的侵蚀检测方法、装置和计算机可读介质,能够提高进行侵蚀检测的效率。In view of this, the erosion detection method, device and computer readable medium provided by the present invention can improve the efficiency of erosion detection.
第一方面,本发明实施例提供了一种侵蚀检测方法,包括:In a first aspect, an embodiment of the present invention provides an erosion detection method, including:
获取待检测部件的第一检测图像和第二检测图像,其中,所述第一检测图像和所述第二检测图像由双目摄像机包括的两个摄像机分别采集;acquiring a first detection image and a second detection image of the component to be detected, wherein the first detection image and the second detection image are respectively collected by two cameras included in the binocular camera;
根据所述第一检测图像和所述第二检测图像的视差,确定所述待检测部件上至少两个目 标点的深度值,其中,所述待检测部件上任一个目标点的深度值用于表征该目标点与所述双目摄像机包括的两个镜头的中心点连线的距离;According to the parallax of the first detection image and the second detection image, the depth values of at least two target points on the component to be detected are determined, wherein the depth value of any target point on the component to be detected is used to represent The distance between the target point and the center point of the two lenses included in the binocular camera;
根据所述待检测部件上各所述目标点的深度值,确定所述待检测部件的侵蚀程度。According to the depth value of each of the target points on the component to be inspected, the degree of erosion of the component to be inspected is determined.
第二方面,本发明实施例还提供了一侵蚀检测装置,包括:In a second aspect, an embodiment of the present invention further provides an erosion detection device, including:
一个获取模块,用于获取待检测部件的第一检测图像和第二检测图像,其中,所述第一检测图像和所述第二检测图像由双目摄像机包括的两个摄像机分别采集;an acquisition module, configured to acquire a first detection image and a second detection image of the component to be detected, wherein the first detection image and the second detection image are respectively collected by two cameras included in the binocular camera;
一个图像处理模块,用于根据所述获取模块所获取的所述第一检测图像和所述获取模块所获取的所述第二检测图像的视差,确定所述待检测部件上至少两个目标点的深度值,其中,所述待检测部件上任一个目标点的深度值用于表征该目标点与所述双目摄像机包括的两个镜头的中心点连线的距离;An image processing module for determining at least two target points on the component to be detected according to the parallax of the first detection image acquired by the acquisition module and the second detection image acquired by the acquisition module , wherein the depth value of any target point on the component to be detected is used to represent the distance between the target point and the center point of the two lenses included in the binocular camera;
一个侵蚀判断模块,用于根据由所述图像处理模块所确定的所述待检测部件上各所述目标点的深度值,确定所述待检测部件的侵蚀程度。An erosion judging module is used for determining the degree of erosion of the part to be inspected according to the depth value of each of the target points on the part to be inspected determined by the image processing module.
第三方面,本发明实施例还提供了另一侵蚀检测装置,包括:至少一个存储器和至少一个处理器;In a third aspect, an embodiment of the present invention further provides another erosion detection apparatus, including: at least one memory and at least one processor;
所述至少一个存储器,用于存储机器可读程序;the at least one memory for storing a machine-readable program;
所述至少一个处理器,用于调用所述机器可读程序,执行上述第一方面所提供的方法。The at least one processor is configured to invoke the machine-readable program to execute the method provided in the first aspect.
第四方面,本发明实施例还提供了一种计算机可读介质,所述计算机可读介质上存储有计算机指令,所述计算机指令在被处理器执行时,使所述处理器执行上述第一方面所提供的方法。In a fourth aspect, an embodiment of the present invention further provides a computer-readable medium, where computer instructions are stored on the computer-readable medium, and when executed by a processor, the computer instructions cause the processor to execute the above-mentioned first method provided by the aspect.
根据上述第一方面至第四方面所提供的技术方案可知,获取由双目摄像机包括的两个摄像机分别采集的待检测部件的第一检测图像和第二检测图像,根据第一检测图像和第二检测图像的视差,确定待检测部件上至少两个目标点的深度值,进而根据各目标点的深度值,确定待检测部件的侵蚀程度,其中,各待检测部件上任一个目标点的深度值用于表征该目标点 与所述双目摄像机包括的两个镜头的中心点连线的距离。由此可见,利用由双目摄像机拍摄的两张图像之间的视差,便可以得到待检测部件上各目标点至该双目摄像机两个镜头中心点连线的距离,即深度值,通过对比各目标点的深度值,便可以确定待检测部件的侵蚀程度,如此侵蚀程度便可以通过深度值间接反映出来,无需工作人员逐个进行目视检查,再凭借工作经验确定待检测部件是否需要更换,从而提高了进行侵蚀检测的效率。According to the technical solutions provided in the above first to fourth aspects, the first detection image and the second detection image of the component to be detected respectively collected by the two cameras included in the binocular camera are acquired, according to the first detection image and the second detection image. 2. Detect the parallax of the image, determine the depth value of at least two target points on the component to be detected, and then determine the degree of erosion of the component to be detected according to the depth value of each target point, wherein the depth value of any target point on each component to be detected It is used to characterize the distance between the target point and the center point of the two lenses included in the binocular camera. It can be seen that the distance between each target point on the component to be detected and the line connecting the center points of the two lenses of the binocular camera, that is, the depth value, can be obtained by using the parallax between the two images captured by the binocular camera. The depth value of each target point can determine the degree of corrosion of the component to be tested, so that the degree of corrosion can be indirectly reflected by the depth value, without the need for staff to perform visual inspection one by one, and then rely on work experience to determine whether the component to be tested needs to be replaced. Thereby, the efficiency of performing erosion detection is improved.
在第一种可能的实现方式中,结合上述的任一方面,在根据第一检测图像和第二检测图像的视差,确定待检测部件上各目标点的深度值时,可以先确定目标点在第一检测图像和第二检测图像所对应的像素点,进而确定第一检测图像和第二检测图像的视差,以确定目标点的深度值。具体可以通过如下方式来确定深度值:In a first possible implementation manner, in combination with any of the above-mentioned aspects, when determining the depth value of each target point on the component to be detected according to the parallax of the first detection image and the second detection image, it is possible to first determine that the target point is in pixel points corresponding to the first detection image and the second detection image, and then determine the parallax of the first detection image and the second detection image to determine the depth value of the target point. Specifically, the depth value can be determined in the following ways:
针对所述待检测部件上的每一个所述目标点,均执行:For each of the target points on the component to be detected, execute:
确定该目标点在所述第一检测图像中对应的第一像素点,并确定该目标点在所述第二检测图像中所对应的第二像素点;Determine the first pixel point corresponding to the target point in the first detection image, and determine the second pixel point corresponding to the target point in the second detection image;
确定所述第一像素点与所述第二像素点的目标视差,其中,所述目标视差用于表征所述第一像素点在所述第一检测图像中所处相对位置与所述第二像素点在所述第二检测图像中所处相对位置的差异;determining the target parallax between the first pixel point and the second pixel point, wherein the target parallax is used to represent the relative position of the first pixel point in the first detection image and the second pixel point The difference between the relative positions of the pixel points in the second detection image;
根据所述目标视差、所述双目摄像机中摄像机的焦距和所述双目摄像机中两个摄像机光心之间的距离,确定该目标点的深度值。The depth value of the target point is determined according to the target parallax, the focal length of the camera in the binocular camera, and the distance between the optical centers of the two cameras in the binocular camera.
在本发明实施例中,针对待检测部件上的每一个目标点,通过确定该目标点分别在第一检测图像和第二检测图像中对应的像素点,可以根据两个像素点之间的坐标差异,确定该目标点在两个检测图像中所处相对位置的差异,即该目标点在这两个检测图像中的目标视差,进而通过目标视差、双目摄像机中摄像机的焦距和两个摄像机光心之间的距离得到该目标点的深度值,由于深度值为待检测部件上的目标点到双目摄像机平面的距离,因此可以间接反映出待检测部件上表面的侵蚀信息,进而能够对待检测部件进行客观合理的评价。同时,无需工作人员凭借经验进行目测检测,从而进一步提高了进行侵蚀检测的效率。In the embodiment of the present invention, for each target point on the component to be detected, by determining the corresponding pixel points of the target point in the first detection image and the second detection image respectively, the coordinates between the two pixel points can be determined according to the coordinates between the two pixel points. Difference, determine the difference between the relative positions of the target point in the two detection images, that is, the target parallax of the target point in the two detection images, and then pass the target parallax, the focal length of the camera in the binocular camera and the two cameras. The distance between the optical centers obtains the depth value of the target point. Since the depth value is the distance from the target point on the component to be detected to the plane of the binocular camera, it can indirectly reflect the erosion information on the upper surface of the component to be detected, and then can treat Test components for objective and reasonable evaluation. At the same time, there is no need for staff to perform visual inspection based on experience, thereby further improving the efficiency of erosion inspection.
在第二种可能的实现方式中,结合上述的任一方面的实现方式,在根据待检测部件上各目标点的深度值,确定待检测部件的侵蚀程度时,可以先根据待检测部件边缘的各目标点的深度值确保待检测部件的表面与双目摄像机的成像平面平行,进而确定待检测部件的侵蚀程度。具体可以通过如下方式来确定待检测部件的侵蚀程度:In the second possible implementation manner, in combination with the implementation manner of any of the above-mentioned aspects, when determining the degree of erosion of the component to be detected according to the depth value of each target point on the component to be detected, you can first determine the degree of erosion of the component to be detected according to the edge of the component to be detected. The depth value of each target point ensures that the surface of the part to be inspected is parallel to the imaging plane of the binocular camera, thereby determining the degree of erosion of the part to be inspected. Specifically, the corrosion degree of the component to be tested can be determined by the following methods:
判断位于所述待检测部件边缘的各所述目标点的深度值是否位于预设阈值范围内;Judging whether the depth value of each target point located at the edge of the component to be detected is within a preset threshold range;
如果位于所述待检测部件边缘的各所述目标点的深度值位于所述预设阈值范围内,则根据所述待检测部件上各所述目标点的深度值,确定所述待检测部件的侵蚀程度;If the depth value of each of the target points on the edge of the component to be detected is within the preset threshold range, determine the depth of the component to be detected according to the depth value of each of the target points on the component to be detected degree of erosion;
如果位于所述待检测部件边缘的各所述目标点的深度值未全部位于所述预设阈值范围内,则执行:If the depth values of the target points located at the edge of the component to be detected are not all within the preset threshold range, execute:
根据所述待检测部件边缘的各所述目标点的深度值确定所述双目摄像机的成像平面与所述待检测部件的表面之间的夹角;Determine the angle between the imaging plane of the binocular camera and the surface of the component to be detected according to the depth value of each of the target points on the edge of the component to be detected;
根据所述夹角对所述待检测部件上各所述目标点的深度值进行校准;calibrating the depth value of each of the target points on the component to be detected according to the included angle;
根据经校准的所述待检测部件上各所述目标点的深度值确定所述待检测部件的侵蚀程度。The degree of erosion of the part to be inspected is determined according to the calibrated depth value of each of the target points on the part to be inspected.
在本发明实施例中,通过判断位于待检测部件边缘的各目标点的深度值是否位于预设阈值范围内,可以确定双目摄像机的成像平面与待检测部件的表面之间是否存在夹角,如果位于待检测部件边缘的各目标点的深度值位于预设阈值范围内,则双目摄像机的成像平面与待检测部件的表面之间无夹角(即平行),可以直接利用所确定的各目标点的深度值确定待检测部件的侵蚀程度;如果位于待检测部件边缘的各目标点的深度值未全部位于预设阈值范围内,则需要根据待检测部件边缘的各目标点的深度值确定双目摄像机的成像平面与待检测部件的表面之间的夹角(即不平行),并根据该夹角对待检测部件上各目标点的深度值进行校准,进而根据校准后的各目标深度值确定待检测部件的侵蚀程度。由于双目摄像机的成像平面与待检测部件的表面平行时,所确定的深度值才更足以说明待检测部件表面的真实侵蚀情况,如此便可以确保所获得的深度值的准确性,进而提高侵蚀检测的准确性和可靠性。In the embodiment of the present invention, by judging whether the depth value of each target point located at the edge of the component to be detected is within a preset threshold range, it can be determined whether there is an included angle between the imaging plane of the binocular camera and the surface of the component to be detected, If the depth value of each target point located at the edge of the part to be inspected is within the preset threshold range, then there is no included angle (ie parallel) between the imaging plane of the binocular camera and the surface of the part to be inspected, and the determined The depth value of the target point determines the degree of erosion of the component to be detected; if the depth values of each target point located on the edge of the component to be detected are not all within the preset threshold range, it needs to be determined according to the depth value of each target point on the edge of the component to be detected. The angle between the imaging plane of the binocular camera and the surface of the part to be inspected (that is, not parallel), and the depth value of each target point on the part to be inspected is calibrated according to the angle, and then according to the depth value of each target after calibration Determine the degree of erosion of the part to be inspected. Since the imaging plane of the binocular camera is parallel to the surface of the part to be inspected, the determined depth value is more sufficient to describe the real erosion situation on the surface of the part to be inspected, so that the accuracy of the obtained depth value can be ensured, and the erosion can be improved. Accuracy and reliability of detection.
在第三种可能的实现方式中,结合上述任一方面的实现方式,在根据待检测部件上各目标点的深度值,确定待检测部件的侵蚀程度时,可以先确定待检测部件的有效检测区域,进 而根据有效检测区域内的各目标点的深度值确定待检测部件的侵蚀程度。具体可以通过如下方式来确定待检测部件的侵蚀程度:In a third possible implementation manner, combined with the implementation manner of any of the above aspects, when determining the degree of erosion of the component to be detected according to the depth value of each target point on the component to be detected, the effective detection of the component to be detected may be determined first. area, and then determine the erosion degree of the component to be inspected according to the depth value of each target point in the effective inspection area. Specifically, the corrosion degree of the component to be tested can be determined by the following methods:
根据各所述目标点的深度值和各所述目标点在所述待检测部件上的分布,确定所述待检测部件上的有效检测区域,其中,所述有效检测区域内包括有至少两个所述目标点,且所述有效检测区域内各所述目标点的深度值位于设定范围内;According to the depth value of each target point and the distribution of each target point on the component to be detected, an effective detection area on the component to be detected is determined, wherein the effective detection area includes at least two the target point, and the depth value of each of the target points in the effective detection area is within the set range;
根据所述有效检测区域内各所述目标点的深度值,确定所述待检测部件的侵蚀程度。According to the depth value of each of the target points in the effective detection area, the degree of erosion of the component to be detected is determined.
在本发明实施例中,根据各目标点的深度值和各目标点在待检测部件上的分布,确定有效检测区域,如此可以去掉远离待检测部件中心、数量少且误差极大的目标点,仅保留90%集中分布在待检测部件上的目标点所在的区域作为有效检测区域,以根据有效检测区域内的各目标点的深度值确定待检测部件的侵蚀程度,从而实现对各目标点的深度值的降噪处理,进一步提高侵蚀检测的准确性和可靠性。In the embodiment of the present invention, the effective detection area is determined according to the depth value of each target point and the distribution of each target point on the component to be detected, so that the target points far away from the center of the component to be detected, with a small number and a large error can be removed, Only the area where 90% of the target points concentrated on the parts to be inspected are reserved as the effective detection area, so as to determine the degree of erosion of the parts to be inspected according to the depth value of each target point in the effective inspection area, so as to realize the detection of each target point. Noise reduction processing of depth values further improves the accuracy and reliability of erosion detection.
在第四种可能的实现方式中,结合上述任一方面或任一种可能的实现方式,在根据待检测部件上各目标点的深度值,确定待检测部件的侵蚀程度时,可以通过最大深度值与最小深度值之间的差值进一步确定待检测部件的侵蚀程度。具体可以通过如下方式来确定待检测部件的侵蚀程度:In a fourth possible implementation manner, in combination with any of the above aspects or any of the possible implementation manners, when determining the degree of erosion of the component to be detected according to the depth value of each target point on the component to be detected, the maximum depth of The difference between the value and the minimum depth value further determines the degree of erosion of the component to be inspected. Specifically, the corrosion degree of the component to be tested can be determined by the following methods:
确定第一目标深度值和第二目标深度值,其中,所述第一目标深度值为所述待检测部件上各所述目标点的深度值中的最大值,所述第二目标深度值为所述待检测部件上各所述目标点的深度值中的最小值;Determine a first target depth value and a second target depth value, wherein the first target depth value is the maximum value among the depth values of each of the target points on the component to be detected, and the second target depth value is the minimum value among the depth values of each of the target points on the component to be detected;
对所述第一目标深度值和所述第二目标深度值进行差值运算,获得目标差值;performing a difference operation on the first target depth value and the second target depth value to obtain a target difference value;
判断所述目标差值的绝对值是否大于预设阈值;judging whether the absolute value of the target difference is greater than a preset threshold;
如果所述目标差值的绝对值大于所述预设阈值,则确定所述待检测部件为需要更换的侵蚀程度。If the absolute value of the target difference value is greater than the preset threshold value, it is determined that the component to be inspected has an erosion degree that needs to be replaced.
在本发明实施例中,从待检测部件上各目标点的深度值中分别确定最大深度值和最小深度值,通过计算最大深度值与最小深度值之间的目标差值,对比该目标差值与预设阈值,如果该目标差值不大于该预设阈值,则确定该待检测部件为暂不需要更换的侵蚀程度;如果该 目标差值大于该预设阈值,则确定该待检测部件为需要更换的侵蚀程度。其中,目标差值为待检测部件表面的实际最大侵蚀深度,因此当该目标差值超过设定的标准值(即预设阈值)时,该待检测部件即需进行更换,如此实现了对待检测部件的侵蚀程度的检测。该过程无需工作人员凭借经验进行目测检测,从而提高了进行侵蚀检测的效率。In the embodiment of the present invention, the maximum depth value and the minimum depth value are respectively determined from the depth values of each target point on the component to be detected, and the target difference value is compared by calculating the target difference value between the maximum depth value and the minimum depth value. With the preset threshold, if the target difference is not greater than the preset threshold, it is determined that the component to be detected is an erosion degree that does not need to be replaced temporarily; if the target difference is greater than the preset threshold, it is determined that the component to be detected is The level of erosion that needs to be replaced. Among them, the target difference is the actual maximum erosion depth of the surface of the component to be detected. Therefore, when the target difference exceeds the set standard value (ie, the preset threshold), the component to be detected needs to be replaced. Detection of corrosion levels of components. This process eliminates the need for personnel to perform visual inspections with experience, increasing the efficiency of erosion inspections.
附图说明Description of drawings
图1是本发明一个实施例提供的一种侵蚀检测方法的流程图;1 is a flowchart of an erosion detection method provided by an embodiment of the present invention;
图2是本发明一个实施例提供的一种深度值获取方法的流程图;2 is a flowchart of a method for acquiring a depth value provided by an embodiment of the present invention;
图3是本发明一个实施例提供的一种侵蚀程度确定方法的流程图;3 is a flowchart of a method for determining an erosion degree provided by an embodiment of the present invention;
图4是本发明一个实施例提供的另一种侵蚀程度确定方法的流程图;FIG. 4 is a flowchart of another method for determining the degree of erosion provided by an embodiment of the present invention;
图5是本发明一个实施例提供的又一种侵蚀程度确定方法的流程图;5 is a flowchart of another method for determining an erosion degree provided by an embodiment of the present invention;
图6是本发明一个实施例提供的另一种侵蚀检测方法的流程图;6 is a flowchart of another erosion detection method provided by an embodiment of the present invention;
图7是本发明一个实施例提供的一种侵蚀检测装置的示意图;7 is a schematic diagram of an erosion detection device provided by an embodiment of the present invention;
图8是本发明一个实施例提供的另一种侵蚀检测装置的示意图;FIG. 8 is a schematic diagram of another erosion detection device provided by an embodiment of the present invention;
图9是本发明一个实施例提供的又一种侵蚀检测装置的示意图;FIG. 9 is a schematic diagram of another erosion detection device provided by an embodiment of the present invention;
图10是本发明一个实施例提供的还一种侵蚀检测装置的示意图;10 is a schematic diagram of still another erosion detection device provided by an embodiment of the present invention;
图11是本发明一个实施例提供的再一种侵蚀检测装置的示意图;11 is a schematic diagram of still another erosion detection device provided by an embodiment of the present invention;
图12是本发明一个实施例提供的一种包括存储器和处理器的侵蚀检测装置的示意图。FIG. 12 is a schematic diagram of an erosion detection apparatus including a memory and a processor provided by an embodiment of the present invention.
附图标记列表:List of reference numbers:
101:获取待检测部件的第一检测图像和第二检测图像101: Acquire a first inspection image and a second inspection image of the component to be inspected
102:根据第一检测图像和第二检测图像的视差,确定待检测部件上至少两个目标点的深度值102: Determine depth values of at least two target points on the component to be detected according to the parallax of the first detected image and the second detected image
103:根据待检测部件上各目标点的深度值,确定待检测部件的侵蚀程度103: Determine the degree of erosion of the part to be inspected according to the depth value of each target point on the part to be inspected
201:针对待检测部件上的每一个目标点,确定该目标点在第一检测图像中对应的第一像素点,并确定该目标点在第二检测图像中所对应的第二像素点201: For each target point on the component to be detected, determine the first pixel point corresponding to the target point in the first detection image, and determine the second pixel point corresponding to the target point in the second detection image
202:确定第一像素点与第二像素点的目标视差202: Determine the target parallax between the first pixel point and the second pixel point
203:根据目标视差、双目摄像机中摄像机的焦距和双目摄像机中两个摄像机光心之间的距离,确定该目标点的深度值203: Determine the depth value of the target point according to the target parallax, the focal length of the camera in the binocular camera, and the distance between the optical centers of the two cameras in the binocular camera
301:判断位于待检测部件边缘的各目标点的深度值是否位于预设阈值范围内301: Determine whether the depth value of each target point located at the edge of the component to be detected is within a preset threshold range
302:根据待检测部件上各目标点的深度值,确定待检测部件的侵蚀程度,并结束当前流程302: Determine the degree of erosion of the component to be detected according to the depth value of each target point on the component to be detected, and end the current process
303:根据待检测部件边缘的各目标点的深度值确定双目摄像机的成像平面与待检测部件的表面之间的夹角303: Determine the angle between the imaging plane of the binocular camera and the surface of the component to be detected according to the depth value of each target point on the edge of the component to be detected
304:根据夹角对待检测部件上各目标点的深度值进行校准304: Calibrate the depth value of each target point on the part to be detected according to the included angle
305:根据经校准的待检测部件上各目标点的深度值确定待检测部件的侵蚀程度,并结束当前流程305: Determine the degree of erosion of the part to be inspected according to the calibrated depth values of each target point on the part to be inspected, and end the current process
401:确定待检测部件上的有效检测区域401: Determine the effective inspection area on the part to be inspected
402:根据有效检测区域内各目标点的深度值,确定待检测部件的侵蚀程度402: Determine the degree of erosion of the component to be detected according to the depth value of each target point in the effective detection area
501:确定第一目标深度值和第二目标深度值501: Determine the first target depth value and the second target depth value
502:对第一目标深度值和第二目标深度值进行差值运算,获得目标差值502: Perform a difference operation on the first target depth value and the second target depth value to obtain a target difference value
503:判断目标差值的绝对值是否大于预设阈值503: Determine whether the absolute value of the target difference is greater than the preset threshold
504:确定待检测部件为需要更换的侵蚀程度,并结束当前流程504: Determine the corrosion degree of the component to be inspected that needs to be replaced, and end the current process
505:确定待检测部件为不需要更换的侵蚀程度,并结束当前流程505: Determine the corrosion degree of the component to be inspected that does not need to be replaced, and end the current process
601:获取待检测部件的第一检测图像和第二检测图像601: Acquire a first inspection image and a second inspection image of the component to be inspected
602:确定目标点的目标视差602: Determine the target disparity of the target point
603:确定目标点的深度值603: Determine the depth value of the target point
604:确定待检测部件上的有效检测区域604: Determine the effective detection area on the component to be detected
605:判断待检测部件边缘的各目标点的深度值是否位于预设阈值范围内605: Determine whether the depth value of each target point on the edge of the component to be detected is within a preset threshold range
606:对待检测部件上各目标点的深度值进行校准606: Calibrate the depth value of each target point on the part to be detected
607:确定第一目标深度值和第二目标深度值607: Determine the first target depth value and the second target depth value
608:对第一目标深度值和第二目标深度值进行差值运算608: Perform a difference operation on the first target depth value and the second target depth value
609:确定待检测部件的侵蚀程度609: Determining the degree of erosion of the part to be inspected
701:获取模块            702:图像处理模块        703:侵蚀判断模块701: Acquisition module 702: Image processing module 703: Erosion judgment module
704:存储器              705:处理器              7021:像素点获取单元704: Memory 705: Processor 7021: Pixel acquisition unit
7022:视差获取单元       7023:深度值获取单元     7031:第一判断单元7022: Parallax acquisition unit 7023: Depth value acquisition unit 7031: First judgment unit
7032:第一关系确定单元   7033:第二关系确定单元   7034:区域确定单元7032: The first relationship determination unit 7033: The second relationship determination unit 7034: The area determination unit
7035:第二侵蚀确定单元   7036:深度值筛选单元     7037:运算单元7035: Second erosion determination unit 7036: Depth value filtering unit 7037: Operation unit
7038:第二判断单元       7039:侵蚀程度确定单元7038: The second judgment unit 7039: The erosion degree determination unit
具体实施方式Detailed ways
如前所述,目前在对燃气轮机中陶瓷隔热瓦进行侵蚀检测时,通常由工作人员从人孔进入燃烧室,直接用肉眼进行目视检查,对照陶瓷缺陷模板确定裂纹的位置、走向、长度等,凭借工作经验确定陶瓷隔热瓦的裂纹深度,进而确定需要进行更换的陶瓷隔热瓦。这种方法劳动强度大、检测速度慢且易受主观因素影响,导致对陶瓷隔热瓦进行侵蚀检测的效率较低。As mentioned above, in the current corrosion detection of ceramic thermal insulation tiles in gas turbines, the staff usually enters the combustion chamber through the manhole, and directly visually inspects them with the naked eye, and determines the position, direction and length of the cracks against the ceramic defect template. Etc., based on work experience to determine the crack depth of the ceramic thermal insulation tile, and then determine the ceramic thermal insulation tile that needs to be replaced. This method is labor-intensive, slow in detection and susceptible to subjective factors, resulting in low efficiency in corrosion detection of ceramic insulation tiles.
本发明实施例中,获取由双目摄像机包括的两个摄像机分别采集的待检测部件的第一检测图像和第二检测图像,根据目标点分别在第一检测图像和第二检测图像上所对应的像素点,根据两个像素点之间的坐标差异,确定该目标点在第一检测图像和第二检测图像中的目标视差,并根据该目标视差、双目摄像机中两个摄像机光心之间的距离和摄像机的焦距,确定该目标点的深度值。如此,可以获得待检测部件中各目标点的深度值,从各目标点的深度值中 分别确定最大深度值和最小深度值,当最大深度值和最小深度值之间的目标差值大于预设阈值时,便可以确定该待检测部件为需要更换的侵蚀程度,实现对待检测部件的侵蚀程度的检测。该过程无需工作人员凭借经验进行目测检测,从而提高了进行侵蚀检测的效率。In the embodiment of the present invention, the first detection image and the second detection image of the component to be detected respectively collected by the two cameras included in the binocular camera are acquired, and according to the target points corresponding to the first detection image and the second detection image, respectively According to the coordinate difference between the two pixel points, the target parallax of the target point in the first detection image and the second detection image is determined, and according to the target parallax, the distance between the optical centers of the two cameras in the binocular camera The distance between and the focal length of the camera determine the depth value of the target point. In this way, the depth value of each target point in the component to be detected can be obtained, and the maximum depth value and the minimum depth value are respectively determined from the depth values of each target point. When the target difference between the maximum depth value and the minimum depth value is greater than the preset value When the threshold value is reached, it can be determined that the component to be detected is the degree of corrosion that needs to be replaced, so as to realize the detection of the degree of corrosion of the component to be detected. This process eliminates the need for personnel to perform visual inspections with experience, increasing the efficiency of erosion inspections.
需要说明的是,第一检测图像和第二检测图像也可以由双目相机的两个相机分别采集,双目摄像机中的两个摄像机的焦距相同,双目相机中的两个相机的焦距相同。待检测部件上任一个目标点的深度值用于表征该目标点与双目摄像机包括的两个镜头的中心点连线的距离。目标视差用于表征第一像素点在第一检测图像中所处相对位置与第二像素点在第二检测图像中所处相对位置的差异。It should be noted that the first detection image and the second detection image may also be collected by two cameras of the binocular camera, the two cameras in the binocular camera have the same focal length, and the two cameras in the binocular camera have the same focal length. . The depth value of any target point on the component to be detected is used to represent the distance between the target point and the center point of the two lenses included in the binocular camera. The target parallax is used to represent the difference between the relative position of the first pixel point in the first detection image and the relative position of the second pixel point in the second detection image.
下面结合附图对本发明实施例提供的侵蚀检测方法和装置进行详细说明。The erosion detection method and device provided by the embodiments of the present invention will be described in detail below with reference to the accompanying drawings.
如图1所示,本发明实施例提供了一种侵蚀检测方法,该方法可以包括如下步骤:As shown in FIG. 1, an embodiment of the present invention provides an erosion detection method, and the method may include the following steps:
步骤101:获取待检测部件的第一检测图像和第二检测图像,其中,第一检测图像和第二检测图像由双目摄像机包括的两个摄像机分别采集;Step 101: Acquire a first detection image and a second detection image of the component to be detected, wherein the first detection image and the second detection image are respectively collected by two cameras included in the binocular camera;
步骤102:根据第一检测图像和第二检测图像的视差,确定待检测部件上至少两个目标点的深度值,其中,待检测部件上任一个目标点的深度值用于表征该目标点与双目摄像机包括的两个镜头的中心点连线的距离;Step 102: Determine the depth values of at least two target points on the component to be detected according to the parallax of the first detection image and the second detection image, wherein the depth value of any target point on the component to be detected is used to characterize the target point and the dual target point. The distance between the center points of the two lenses included in the eye camera;
步骤103:根据待检测部件上各目标点的深度值,确定待检测部件的侵蚀程度。Step 103: Determine the degree of erosion of the component to be detected according to the depth values of each target point on the component to be detected.
在本发明实施例中,获取由双目摄像机包括的两个摄像机分别采集的待检测部件的第一检测图像和第二检测图像,根据第一检测图像和第二检测图像的视差,确定待检测部件上至少两个目标点的深度值,进而根据各目标点的深度值,确定待检测部件的侵蚀程度,其中,各待检测部件上任一个目标点的深度值用于表征该目标点与所述双目摄像机包括的两个镜头的中心点连线的距离。由此可见,利用由双目摄像机拍摄的两张图像之间的视差,便可以得到待检测部件上各目标点至该双目摄像机两个镜头中心点连线的距离,即深度值,通过对比各目标点的深度值,便可以确定待检测部件的侵蚀程度,如此侵蚀程度便可以通过深度值间接反映出来,无需工作人员逐个进行目视检查,再凭借工作经验确定待检测部件是否需要更 换,实现了针对待检测部件的无损检测,从而提高了进行侵蚀检测的效率。In the embodiment of the present invention, the first detection image and the second detection image of the component to be detected that are respectively collected by two cameras included in the binocular camera are acquired, and the to-be-detected image is determined according to the parallax of the first detection image and the second detection image. The depth values of at least two target points on the component, and then determine the degree of erosion of the component to be detected according to the depth value of each target point, wherein the depth value of any target point on each component to be detected is used to characterize the target point and the The distance between the center points of the two lenses included in the binocular camera. It can be seen that the distance between each target point on the component to be detected and the line connecting the center points of the two lenses of the binocular camera, that is, the depth value, can be obtained by using the parallax between the two images captured by the binocular camera. The depth value of each target point can determine the degree of corrosion of the component to be tested, so that the degree of corrosion can be indirectly reflected by the depth value, without the need for staff to perform visual inspection one by one, and then rely on work experience to determine whether the component to be tested needs to be replaced. Non-destructive testing of components to be tested is achieved, thereby improving the efficiency of corrosion testing.
在本发明实施例中,双目摄像机包括的左右两个摄像机同时分别采集待检测部件的图像,其中双目摄像机到待检测部件表面的距离可以根据用户需求确定,若仅需要检测图像中包括一个待检测部件,则双目摄像机到待检测部件表面的距离可以根据待检测部件的尺寸调节。例如,燃气轮机发电机内部的陶瓷隔热瓦片的尺寸为20cm*20cm,则双目摄像机平面距陶瓷隔热瓦的距离为30-50cm。若需要检测图像中包括多个待检测部件,则双目摄像机到待检测部件表面的距离可以根据所包括的待检测部件的个数进行调节。其中,采集检测图像时双目摄像机包括的两个镜头应置于待检测表面的正上方,可以使用辅助照明保持良好的背景光源,以获得画质清晰的检测图像,进而提高侵蚀检测的准确性和可靠性。In this embodiment of the present invention, the left and right cameras included in the binocular camera simultaneously capture images of the component to be detected, wherein the distance from the binocular camera to the surface of the component to be detected can be determined according to user requirements. For the part to be inspected, the distance from the binocular camera to the surface of the part to be inspected can be adjusted according to the size of the part to be inspected. For example, if the size of the ceramic thermal insulation tile inside the gas turbine generator is 20cm*20cm, the distance between the binocular camera plane and the ceramic thermal insulation tile is 30-50cm. If the detection image includes multiple components to be detected, the distance from the binocular camera to the surface of the components to be detected can be adjusted according to the number of components to be detected. Among them, the two lenses included in the binocular camera should be placed directly above the surface to be inspected when collecting inspection images. Auxiliary lighting can be used to maintain a good background light source to obtain inspection images with clear image quality, thereby improving the accuracy of erosion detection. and reliability.
在本发明实施例中,同一场景在两个摄像机下成像的像素的位置之间存在偏差,即视差,基于视差,根据左右摄像机所在相对位置关系及摄像机本身的参数信息,可以获得目标在空间的深度信息,深度信息用于表征场景中目标上某一点距离摄像机的远近。因此借助双目摄像机所采集的第一检测图像和第二检测图像的视差,可以确定待检测部件的目标点的深度值。In the embodiment of the present invention, there is a deviation between the positions of the pixels imaged by the two cameras in the same scene, that is, parallax. Based on the parallax, according to the relative positional relationship between the left and right cameras and the parameter information of the camera itself, the spatial distribution of the target can be obtained. Depth information, which is used to represent the distance of a certain point on the target in the scene from the camera. Therefore, by means of the parallax of the first detection image and the second detection image collected by the binocular camera, the depth value of the target point of the component to be detected can be determined.
在本发明实施例中,根据深度值信息可以获得目标在空间的三维位置信息,因此根据待检测部件上各目标点的深度值,可以确定待检测部件在空间的三维位置信息,进而确定待检测部件的侵蚀程度,实现待检测部件的无损检测。In the embodiment of the present invention, the three-dimensional position information of the target in space can be obtained according to the depth value information. Therefore, according to the depth value of each target point on the part to be inspected, the three-dimensional position information of the part to be inspected in space can be determined, and then the three-dimensional position information of the part to be inspected can be determined. The degree of corrosion of the parts, to achieve non-destructive testing of the parts to be tested.
可选地,在图1所示侵蚀检测方法的基础上,在根据第一检测图像和第二检测图像的视差,确定待检测部件上各目标点的深度值时,可以先确定目标点在第一检测图像和第二检测图像所对应的像素点,进而确定第一检测图像和第二检测图像的视差,以确定目标点的深度值。如图2所示,根据视差确定深度值可以通过如下方式实现:Optionally, on the basis of the erosion detection method shown in FIG. 1, when determining the depth value of each target point on the component to be detected according to the parallax of the first detection image and the second detection image, it can be determined that the target point is in the first detection image. The pixel points corresponding to the first detection image and the second detection image are further determined to determine the parallax of the first detection image and the second detection image to determine the depth value of the target point. As shown in Figure 2, determining the depth value according to the disparity can be implemented as follows:
步骤201:针对待检测部件上的每一个目标点,确定该目标点在第一检测图像中对应的第一像素点,并确定该目标点在第二检测图像中所对应的第二像素点;Step 201: for each target point on the component to be detected, determine the first pixel point corresponding to the target point in the first detection image, and determine the second pixel point corresponding to the target point in the second detection image;
步骤202:确定第一像素点与第二像素点的目标视差,其中,目标视差用于表征第一像素点在第一检测图像中所处相对位置与第二像素点在第二检测图像中所处相对位置的差异;Step 202: Determine the target parallax between the first pixel point and the second pixel point, wherein the target parallax is used to represent the relative position of the first pixel point in the first detection image and the position of the second pixel point in the second detection image. difference in relative position;
步骤203:根据目标视差、双目摄像机中摄像机的焦距和双目摄像机中两个摄像机光心之间的距离,确定该目标点的深度值。Step 203: Determine the depth value of the target point according to the target parallax, the focal length of the camera in the binocular camera, and the distance between the optical centers of the two cameras in the binocular camera.
在本发明实施例中,针对待检测部件上的每一个目标点,确定该目标点分别在第一检测 图像和第二检测图像中对应的像素点,根据像素点的坐标,确定该目标点在两个检测图像中所处相对位置的差异,即该目标点的目标视差,进而通过目标视差、双目摄像机中摄像机的焦距和两个摄像机光心之间的距离等参数得到该目标点的深度值。In the embodiment of the present invention, for each target point on the component to be detected, the corresponding pixel points of the target point in the first detection image and the second detection image are determined, and according to the coordinates of the pixel point, it is determined that the target point is in the first detection image and the second detection image. The difference between the relative positions of the two detection images is the target parallax of the target point, and then the depth of the target point is obtained through parameters such as the target parallax, the focal length of the camera in the binocular camera, and the distance between the optical centers of the two cameras. value.
在本发明实施例中,可以以第一检测图像为基准,对于每一个目标点,以基准图像中该目标点所对应的第一像素点的像素坐标为模板,在第二检测图像中搜索与目标点相同或相似的点,确定该第二像素点的像素坐标,通过两个像素点的像素坐标之间的位置偏差确定视差。因为通常双目摄像机是水平放置的,所以位置偏差一般体现在水平方向。比如场景中的X点在左摄像机水平方向的坐标是x,在右摄像机水平方向成像的坐标是x+p,则p就是X点的视差。基于所获得的各目标点的视差,可以获得待检测图像的视差图,该视差图可以以第一检测图像为基准,其大小为该第一检测图像的大小,元素值为各目标点的视差,如此通过视差图可以直观地获取个目标点的视差,便于后续获取各目标点的深度值。In this embodiment of the present invention, the first detection image may be used as a reference, and for each target point, the pixel coordinates of the first pixel point corresponding to the target point in the reference image may be used as a template, and the second detection image may be searched for the For the same or similar target points, the pixel coordinates of the second pixel point are determined, and the disparity is determined by the positional deviation between the pixel coordinates of the two pixel points. Because the binocular cameras are usually placed horizontally, the positional deviation is generally reflected in the horizontal direction. For example, the coordinate of point X in the scene in the horizontal direction of the left camera is x, and the coordinate of the image in the horizontal direction of the right camera is x+p, then p is the parallax of point X. Based on the obtained parallax of each target point, a parallax map of the image to be detected can be obtained. The parallax map can be based on the first detected image, its size is the size of the first detected image, and the element value is the parallax of each target point. , so that the disparity of each target point can be intuitively obtained through the disparity map, which is convenient for subsequent acquisition of the depth value of each target point.
在本发明实施例中,通过如下公式确定每一个目标点的深度值:In this embodiment of the present invention, the depth value of each target point is determined by the following formula:
h=b*c/ph=b*c/p
其中,h用于表征待检测部件中各目标点的深度值,b用于表征双目摄像机中两个摄像机光心之间的距离,c用于表征双目摄像机中摄像机的焦距,p用于表征各目标点在第一检测图像与第二检测图像之间的视差。Among them, h is used to characterize the depth value of each target point in the part to be detected, b is used to characterize the distance between the optical centers of the two cameras in the binocular camera, c is used to characterize the focal length of the camera in the binocular camera, p is used to characterize The parallax of each target point between the first detection image and the second detection image is characterized.
在本发明实施例中,深度值用于表征该目标点与双目摄像机包括的两个镜头的中心点连线的距离,因为通过深度值可以反映出待检测部件上表面的侵蚀信息,进而能够对待检测部件进行客观合理的评价,实现对待检测部件的无损检测,避免目测检测,从而进一步提高了进行侵蚀检测的效率。In the embodiment of the present invention, the depth value is used to represent the distance between the target point and the center point of the two lenses included in the binocular camera, because the erosion information on the upper surface of the component to be detected can be reflected by the depth value, thereby enabling The objective and reasonable evaluation of the parts to be tested is carried out, the non-destructive testing of the parts to be tested is realized, and the visual inspection is avoided, thereby further improving the efficiency of corrosion testing.
可选地,在图1所示侵蚀检测方法的基础上,在根据待检测部件上各目标点的深度值,确定待检测部件的侵蚀程度时,可以先根据待检测部件边缘的各目标点的深度值确保待检测部件的表面与双目摄像机的成像平面平行,进而确定待检测部件的侵蚀程度。如图3所示,确定待检测部件的侵蚀程度可以通过如下方式实现:Optionally, on the basis of the erosion detection method shown in FIG. 1 , when determining the degree of erosion of the component to be detected according to the depth value of each target point on the component to be detected, you can first determine the degree of erosion of the component to be detected according to the depth of each target point on the edge of the component to be detected. The depth value ensures that the surface of the part to be inspected is parallel to the imaging plane of the binocular camera, thereby determining the degree of erosion of the part to be inspected. As shown in Figure 3, determining the degree of erosion of the component to be inspected can be achieved as follows:
步骤301:判断位于待检测部件边缘的各目标点的深度值是否位于预设阈值范围内,如果是Y,执行步骤302,如果否N,执行步骤303;Step 301: determine whether the depth value of each target point located at the edge of the component to be detected is within the preset threshold range, if it is Y, go to step 302, if not N, go to step 303;
步骤302:根据待检测部件上各目标点的深度值,确定待检测部件的侵蚀程度,并结束 当前流程;Step 302: According to the depth value of each target point on the component to be detected, determine the degree of erosion of the component to be detected, and end the current process;
步骤303:根据待检测部件边缘的各目标点的深度值确定双目摄像机的成像平面与待检测部件的表面之间的夹角;Step 303: Determine the angle between the imaging plane of the binocular camera and the surface of the component to be detected according to the depth value of each target point on the edge of the component to be detected;
步骤304:根据夹角对待检测部件上各目标点的深度值进行校准;Step 304: Calibrate the depth value of each target point on the component to be detected according to the included angle;
步骤305:根据经校准的待检测部件上各目标点的深度值确定待检测部件的侵蚀程度,并结束当前流程。Step 305: Determine the degree of erosion of the component to be detected according to the calibrated depth values of each target point on the component to be detected, and end the current process.
在本发明实施例中,通过判断位于待检测部件边缘的各目标点的深度值是否位于预设阈值范围内,可以确定双目摄像机的成像平面与待检测部件的表面之间是否存在夹角,如果位于待检测部件边缘的各目标点的深度值位于预设阈值范围内,则双目摄像机的成像平面与待检测部件的表面之间无夹角(即平行),可以直接利用所确定的各目标点的深度值确定待检测部件的侵蚀程度;如果位于待检测部件边缘的各目标点的深度值未全部位于预设阈值范围内,则需要根据待检测部件边缘的各目标点的深度值确定双目摄像机的成像平面与待检测部件的表面之间的夹角(即不平行),并根据该夹角对待检测部件上各目标点的深度值进行校准,进而根据校准后的各目标深度值确定待检测部件的侵蚀程度。由于双目摄像机的成像平面与待检测部件的表面平行时,所确定的深度值更足以说明待检测部件表面的真实侵蚀情况,如此便可以确保所获得的深度值的准确性,进而提高侵蚀检测的准确性和可靠性。In the embodiment of the present invention, by judging whether the depth value of each target point located at the edge of the component to be detected is within a preset threshold range, it can be determined whether there is an included angle between the imaging plane of the binocular camera and the surface of the component to be detected, If the depth value of each target point located at the edge of the component to be detected is within the preset threshold range, then there is no included angle (that is, parallel) between the imaging plane of the binocular camera and the surface of the component to be detected, and the determined The depth value of the target point determines the degree of erosion of the component to be detected; if the depth values of each target point located on the edge of the component to be detected are not all within the preset threshold range, it needs to be determined according to the depth value of each target point on the edge of the component to be detected. The angle between the imaging plane of the binocular camera and the surface of the part to be inspected (that is, not parallel), and the depth value of each target point on the part to be inspected is calibrated according to the angle, and then according to the depth value of each target after calibration Determine the degree of erosion of the part to be inspected. Since the imaging plane of the binocular camera is parallel to the surface of the part to be inspected, the determined depth value is more sufficient to describe the real erosion situation on the surface of the part to be inspected, so that the accuracy of the obtained depth value can be ensured, thereby improving erosion detection. accuracy and reliability.
在本发明实施例中,由于双目摄像机的成像平面与待检测部件的表面之间存在夹角时,会导致所获得的深度值存在定值误差,因此为了保证深度值的真实性和准确性,需要检测双目摄像机的成像平面与待检测部件的表面是否存在夹角,减少误差。In the embodiment of the present invention, since there is an included angle between the imaging plane of the binocular camera and the surface of the component to be detected, there will be a fixed value error in the obtained depth value. Therefore, in order to ensure the authenticity and accuracy of the depth value , it is necessary to detect whether there is an included angle between the imaging plane of the binocular camera and the surface of the component to be detected to reduce errors.
在本发明实施例中,判断位于待检测部件边缘的各目标点的深度值是否位于预设阈值范围内,例如,接前例所述,双目摄像机平面距陶瓷隔热瓦的距离为50cm,预设阈值范围为50cm±0.5cm,若待检测部件边缘的各目标点的深度值分别为49.5cm、49.6cm、50.3cm、49.8cm、49.5cm、50cm、49.7cm、50.1cm和50.5cm,可以判断各目标点的深度值均位于预设阈值范围内,即双目摄像机的成像平面与待检测部件的表面平行。In the embodiment of the present invention, it is determined whether the depth value of each target point located at the edge of the component to be detected is within the preset threshold range. The threshold range is set to 50cm±0.5cm. If the depth values of each target point on the edge of the component to be detected are 49.5cm, 49.6cm, 50.3cm, 49.8cm, 49.5cm, 50cm, 49.7cm, 50.1cm and 50.5cm respectively, the It is determined that the depth values of each target point are all within the preset threshold range, that is, the imaging plane of the binocular camera is parallel to the surface of the component to be detected.
在本发明实施例中,如果位于待检测部件边缘的各目标点的深度值未全部位于预设阈值范围内,具体可以通过如下方式来对待检测部件中各目标点的深度值进行校准:In the embodiment of the present invention, if the depth values of each target point located at the edge of the component to be detected are not all within the preset threshold range, the depth value of each target point in the component to be detected can be calibrated in the following manner:
S1:从待检测部件边缘的各目标点的深度值分别确定最小深度值(A)和最大深度值(B);S1: Determine the minimum depth value (A) and the maximum depth value (B) from the depth values of each target point on the edge of the component to be detected;
S2:根据最小深度值(A)和最大深度值B),通过如下公式对待检测部件中的各目标点的深度值进行校准:S2: According to the minimum depth value (A) and the maximum depth value B), the depth value of each target point in the component to be detected is calibrated by the following formula:
Figure PCTCN2020132353-appb-000001
Figure PCTCN2020132353-appb-000001
Figure PCTCN2020132353-appb-000002
Figure PCTCN2020132353-appb-000002
其中,h i用于表征校准处理后的待检测部件中i目标点的深度值,θ用于表征双目摄像机的成像平面与待检测部件的表面之间的夹角,h b用于表征最大深度值(B),h a用于表征最小深度值(A),x b用于表征最大深度值(B)所对应的B目标点在第一检测图像中所对应的像素点的横坐标,x a用于表征最小深度值(A)所对应的A目标点在第一检测图像中所对应的像素点的横坐标,h i 1用于表征校准处理前的待检测部件中i目标点的深度值;x i用于表征i目标点在第一检测图像中所对应的像素点的横坐标。 Among them, h i is used to represent the depth value of the i target point in the component to be detected after calibration processing, θ is used to represent the angle between the imaging plane of the binocular camera and the surface of the component to be detected, h b is used to represent the maximum The depth value (B), ha is used to represent the minimum depth value (A), x b is used to represent the abscissa of the pixel corresponding to the B target point corresponding to the maximum depth value (B) in the first detection image, x a is used to represent the abscissa of the pixel point corresponding to the A target point corresponding to the minimum depth value (A) in the first detection image, and h i 1 is used to represent the i target point in the component to be detected before the calibration process. Depth value; x i is used to represent the abscissa of the pixel point corresponding to the i target point in the first detection image.
在本发明实施例中,待检测部件可以为燃气轮机中的其它部件,例如叶片,但叶片表面为弧面,因此在侵蚀检测过程中,需要利用上述对待检测部件中各目标点的深度值进行校准的方式,对叶片的深度值进行校准。In the embodiment of the present invention, the component to be detected may be other components in the gas turbine, such as a blade, but the surface of the blade is an arc surface. Therefore, during the erosion detection process, it is necessary to use the above-mentioned depth value of each target point in the component to be detected for calibration way to calibrate the depth value of the blade.
可选地,在图1所示侵蚀检测方法的基础上,在根据待检测部件上各目标点的深度值,确定待检测部件的侵蚀程度时,可以先确定待检测部件的有效检测区域,进而根据有效检测区域内的各目标点的深度值确定待检测部件的侵蚀程度。如图4所示,确定待检测部件的侵蚀程度可以通过如下方式实现:Optionally, on the basis of the erosion detection method shown in FIG. 1, when determining the degree of erosion of the component to be detected according to the depth value of each target point on the component to be detected, the effective detection area of the component to be detected can be determined first, and then The erosion degree of the component to be inspected is determined according to the depth value of each target point in the effective inspection area. As shown in Figure 4, determining the degree of erosion of the component to be inspected can be achieved in the following ways:
步骤401:根据各目标点的深度值和各目标点在待检测部件上的分布,确定待检测部件上的有效检测区域,其中,有效检测区域内包括有至少两个目标点,且有效检测区域内各目标点的深度值位于设定范围内;Step 401: According to the depth value of each target point and the distribution of each target point on the component to be detected, determine the effective detection area on the component to be detected, wherein, the effective detection area includes at least two target points, and the effective detection area The depth value of each target point is within the set range;
步骤402:根据有效检测区域内各目标点的深度值,确定待检测部件的侵蚀程度。Step 402: Determine the degree of erosion of the component to be detected according to the depth value of each target point in the effective detection area.
在本发明实施例中,根据各目标点的深度值和各目标点在待检测部件上的分布,确定有效检测区域,如此可以去掉远离待检测部件中心、数量少且误差极大的目标点,仅保留90%集中分布在待检测部件上的目标点所在的区域作为有效检测区域,以根据有效检测区域内的各目标点的深度值确定待检测部件的侵蚀程度,从而实现对各目标点的深度值的降噪处理, 进一步提高侵蚀检测的准确性和可靠性。In the embodiment of the present invention, the effective detection area is determined according to the depth value of each target point and the distribution of each target point on the component to be detected, so that the target points far away from the center of the component to be detected, with a small number and a large error can be removed, Only the area where 90% of the target points concentrated on the parts to be inspected are reserved as the effective detection area, so as to determine the degree of erosion of the parts to be inspected according to the depth value of each target point in the effective inspection area, so as to realize the detection of each target point. The noise reduction processing of depth value further improves the accuracy and reliability of erosion detection.
在本发明实施例中,可以采用多变滤波器去除深度异常值,以实现对各目标点的深度值的降噪处理,降低对侵蚀检测结果的误差。In the embodiment of the present invention, a polymorphic filter may be used to remove abnormal depth values, so as to realize noise reduction processing on the depth values of each target point and reduce errors in the erosion detection result.
可选地,在图1所示侵蚀检测方法或图2所示深度值获取方法或图3所示侵蚀程度确定方法或图4所示侵蚀程度确定方法的基础上,在根据待检测部件上各目标点的深度值,确定待检测部件的侵蚀程度时,可以通过最大深度值与最小深度值之间的差值进一步确定待检测部件的侵蚀程度。如图5所示,确定待检测部件的侵蚀程度的方法包括如下步骤:Optionally, on the basis of the erosion detection method shown in FIG. 1 or the depth value acquisition method shown in FIG. 2 or the erosion degree determination method shown in FIG. 3 or the erosion degree determination method shown in FIG. The depth value of the target point, when determining the degree of erosion of the component to be inspected, the degree of erosion of the component to be inspected may be further determined by the difference between the maximum depth value and the minimum depth value. As shown in FIG. 5 , the method for determining the degree of erosion of the component to be inspected includes the following steps:
步骤501:确定第一目标深度值和第二目标深度值,其中,第一目标深度值为待检测部件上各目标点的深度值中的最大值,第二目标深度值为待检测部件上各目标点的深度值中的最小值;Step 501: Determine a first target depth value and a second target depth value, wherein the first target depth value is the maximum value among the depth values of each target point on the component to be detected, and the second target depth value is the depth value of each target point on the component to be detected. The minimum value among the depth values of the target point;
步骤502:对第一目标深度值和第二目标深度值进行差值运算,获得目标差值;Step 502: Perform a difference operation on the first target depth value and the second target depth value to obtain a target difference value;
步骤503:判断目标差值的绝对值是否大于预设阈值,如果是Y,执行步骤504,如果否N,执行步骤505;Step 503: Determine whether the absolute value of the target difference is greater than the preset threshold, if it is Y, go to step 504, if not N, go to step 505;
步骤504:确定待检测部件为需要更换的侵蚀程度,并结束当前流程;Step 504: Determine the corrosion degree of the component to be detected that needs to be replaced, and end the current process;
步骤505:确定待检测部件为不需要更换的侵蚀程度,并结束当前流程。Step 505 : Determine the corrosion degree of the component to be inspected that does not need to be replaced, and end the current process.
在本发明实施例中,从待检测部件上各目标点的深度值中分别确定最大深度值和最小深度值,通过计算最大深度值与最小深度值之间的目标差值,对比该目标差值与预设阈值,如果该目标差值不大于该预设阈值,则确定该待检测部件为暂不需要更换的侵蚀程度;如果该目标差值大于该预设阈值,则确定该待检测部件为需要更换的侵蚀程度。其中,目标差值为待检测部件表面的实际最大侵蚀深度,因此当该目标差值超过设定的标准值(即预设阈值)时,该待检测部件即需进行更换,如此实现了对待检测部件的侵蚀程度的检测。该过程无需工作人员凭借经验进行目测检测,从而提高了进行侵蚀检测的效率。In the embodiment of the present invention, the maximum depth value and the minimum depth value are respectively determined from the depth values of each target point on the component to be detected, and the target difference value is compared by calculating the target difference value between the maximum depth value and the minimum depth value. With the preset threshold, if the target difference is not greater than the preset threshold, it is determined that the component to be detected is an erosion degree that does not need to be replaced temporarily; if the target difference is greater than the preset threshold, it is determined that the component to be detected is The level of erosion that needs to be replaced. Among them, the target difference is the actual maximum erosion depth of the surface of the component to be detected. Therefore, when the target difference exceeds the set standard value (ie, the preset threshold), the component to be detected needs to be replaced. Detection of corrosion levels of components. This process eliminates the need for personnel to perform visual inspections with experience, increasing the efficiency of erosion inspections.
在本发明实施例中,当待检测部件上各目标点的深度值中的最大深度值和最小深度值之间的目标差值大于预设阈值时,确定该待检测部件为需要更换的侵蚀程度,并输出该目标差值,该目标差值即为实际的侵蚀深度。基于所有输出的目标差值和其待检测部件,还可以生成自动生成针对此次检测的检测报告,该检测报告中可以包括需要更换的待检测部件的位置、 侵蚀情况、侵蚀深度值、检修日期等统计数据,从而有助于更快地完成侵蚀检测工作,提高侵蚀检测的效率。In the embodiment of the present invention, when the target difference between the maximum depth value and the minimum depth value among the depth values of each target point on the component to be detected is greater than a preset threshold, it is determined that the component to be detected is an erosion degree that needs to be replaced , and output the target difference, which is the actual erosion depth. Based on all the output target difference values and the parts to be inspected, an inspection report for this inspection can also be automatically generated. The inspection report can include the location of the inspected parts that need to be replaced, the erosion condition, the erosion depth value, and the maintenance date. and other statistical data, thereby helping to complete the erosion detection work faster and improve the efficiency of erosion detection.
在本发明实施例中,基于所获得的各目标点的视差,可以获得待检测图像的视差图,待检测部件上各目标点的深度值对视差图进行转换运算,可以获得深度图,深度图可以是灰度图像,也可以是伪彩色图像,只是深度图的像素值是目标点距离双目摄像机包括的两个镜头的中心点连线的实际距离,其中,深度图中颜色代表深度高低。根据深度图可以获得与待检测部件相对应的三维图,其中,三维图包括有待检测部件的各目标点在空间的三维位置信息和深度值,通过三维图可以直观地看到待检测部件的三维形貌信息,更加可视化,便于直接判断出待检测部件表面的二维形貌和侵蚀深度情况。In the embodiment of the present invention, based on the obtained parallax of each target point, a parallax map of the image to be detected can be obtained, and the depth value of each target point on the component to be detected is converted to the parallax map to obtain a depth map, a depth map It can be a grayscale image or a pseudo-color image, but the pixel value of the depth map is the actual distance between the target point and the center point of the two lenses included in the binocular camera. The color in the depth map represents the depth. A three-dimensional image corresponding to the part to be inspected can be obtained according to the depth map, wherein the three-dimensional image includes the three-dimensional position information and depth value of each target point of the part to be inspected in space, and the three-dimensional image of the part to be inspected can be visually seen through the three-dimensional image. The topography information is more visualized, and it is convenient to directly judge the two-dimensional topography and erosion depth of the surface of the component to be tested.
下面以燃气轮机中陶瓷隔热瓦为待检测部件为例,对本发明实施例所提供的侵蚀检测方法作进一步详细说明,如图6所示,该方法可以包括如下步骤:The following takes the ceramic heat insulating tile in the gas turbine as the component to be detected as an example to further describe the erosion detection method provided by the embodiment of the present invention. As shown in FIG. 6 , the method may include the following steps:
步骤601:获取待检测部件的第一检测图像和第二检测图像。Step 601: Acquire a first inspection image and a second inspection image of the component to be inspected.
在本发明实施例中,可以由双目相机的两个相机或双目摄像机中的两个摄像机采集第一检测图像和第二检测图像,第一检测图像和第二检测图像中可以包括一个待检测部件的图像,也可以包括多个待检测部件的图像。In this embodiment of the present invention, the first detection image and the second detection image may be collected by two cameras of the binocular camera or two cameras in the binocular camera, and the first detection image and the second detection image may include a to-be-detected image. The image of the inspection part may also include images of a plurality of parts to be inspected.
例如,针对一片尺寸为20cm*20cm陶瓷隔热瓦,采用双目摄像机,在双目摄像机平面距陶瓷隔热瓦的距离为50cm的位置,将双目摄像机至于该待检测陶瓷隔热瓦表面的正上方,使用辅助照明,采集该陶瓷隔热瓦的第一检测图像和第二检测图像。For example, for a piece of ceramic thermal insulation tile with a size of 20cm*20cm, a binocular camera is used, and the binocular camera is placed on the surface of the ceramic thermal insulation tile to be detected at a position where the distance between the binocular camera plane and the ceramic thermal insulation tile is 50cm. Right above, using auxiliary lighting, a first inspection image and a second inspection image of the ceramic thermal insulation tile are collected.
步骤602:确定目标点的目标视差。Step 602: Determine the target disparity of the target point.
在本发明实施例中,针对待检测部件上的每一个目标点,确定该目标点分别在第一检测图像和第二检测图像中所对应的第一像素点、第二像素点,并根据第一像素点和第二像素点所处相对位置的差异,确定该目标点在第一检测图像和第二检测图像中的目标视差。In the embodiment of the present invention, for each target point on the component to be detected, determine the first pixel point and the second pixel point corresponding to the target point in the first detection image and the second detection image respectively, and according to the The difference between the relative positions of one pixel point and the second pixel point determines the target parallax of the target point in the first detection image and the second detection image.
例如,接前例所述,对该陶瓷隔热瓦上的X点,首先确定X点在第一检测图像中所对应的第一像素点X1(x1,y1),在第二检测图像中确定所对应的第二像素点X2(x2,y2),根据X1、X2所处水平方向上相对位置的差异,确定X点在第一检测图像和第二检测图像中 的目标视差为x1-x2的绝对值。For example, as described in the previous example, for the X point on the ceramic heat insulation tile, first determine the first pixel point X1 (x1, y1) corresponding to the X point in the first detection image, and determine the first pixel point X1 (x1, y1) in the second detection image. The corresponding second pixel point X2 (x2, y2), according to the difference in the relative position of X1 and X2 in the horizontal direction, determine the target parallax of point X in the first detection image and the second detection image is x1-x2 absolute. value.
步骤603:确定目标点的深度值。Step 603: Determine the depth value of the target point.
在本发明实施例中,根据每一个目标点的目标视差、双目摄像机中摄像机的焦距和双目摄像机中两个摄像机光心之间的距离,通过如下公式确定每一个目标点的深度值:In the embodiment of the present invention, according to the target parallax of each target point, the focal length of the camera in the binocular camera, and the distance between the optical centers of the two cameras in the binocular camera, the depth value of each target point is determined by the following formula:
h=b*c/ph=b*c/p
其中,h用于表征待检测部件中各目标点的深度值,b用于表征双目摄像机中两个摄像机光心之间的距离,c用于表征双目摄像机中摄像机的焦距,p用于表征各目标点在第一检测图像与第二检测图像之间的视差。Among them, h is used to characterize the depth value of each target point in the part to be detected, b is used to characterize the distance between the optical centers of the two cameras in the binocular camera, c is used to characterize the focal length of the camera in the binocular camera, p is used to characterize The parallax of each target point between the first detection image and the second detection image is characterized.
例如,接前例所述,对该陶瓷隔热瓦上的X点,目标视差p为x1-x2的绝对值,双目摄像机中两个摄像机光心之间的距离为b,双目摄像机中摄像机的焦距为c,则通过上述公式计算得到X点的深度值h。For example, as described in the previous example, for the X point on the ceramic thermal insulation tile, the target parallax p is the absolute value of x1-x2, the distance between the optical centers of the two cameras in the binocular camera is b, and the camera in the binocular camera is the absolute value of x1-x2. The focal length is c, then the depth value h of point X is calculated by the above formula.
步骤604:确定待检测部件上的有效检测区域。Step 604: Determine the effective inspection area on the component to be inspected.
在本发明实施例中,在获得待检测部件的各目标点的深度值之后,根据各目标点的深度值和各目标点在待检测部件上的分布,确定待检测部件上的有效检测区域,实现对各目标点深度值的降噪处理,其中,有效检测区域内包括有至少两个目标点,且有效检测区域内各目标点的深度值位于设定范围内。In the embodiment of the present invention, after obtaining the depth value of each target point of the component to be detected, the effective detection area on the component to be detected is determined according to the depth value of each target point and the distribution of each target point on the component to be detected, The noise reduction processing for the depth value of each target point is realized, wherein at least two target points are included in the effective detection area, and the depth value of each target point in the effective detection area is within the set range.
例如,接前例所述,针对该陶瓷隔热瓦,在获得该陶瓷隔热瓦上的各目标点的深度值之后,可以去掉远离待检测部件中心、数量少且误差极大的目标点,仅保留90%集中分布在该陶瓷隔热瓦上的目标点所在的区域作为有效检测区域。For example, as described in the previous example, for the ceramic thermal insulation tile, after obtaining the depth values of each target point on the ceramic thermal insulation tile, the target points far away from the center of the component to be detected, with a small number and a large error can be removed, and only Retain the area where 90% of the target points concentrated on the ceramic heat insulation tile are located as the effective detection area.
步骤605:判断待检测部件边缘的各目标点的深度值是否位于预设阈值范围内,如果是Y,执行步骤607,如果否N,执行步骤606。Step 605: Determine whether the depth value of each target point on the edge of the component to be detected is within the preset threshold range, if yes, go to Step 607, if not, go to Step 606.
在本发明实施例中,在获得待检测部件的各目标点的深度值之后,判断待检测部件有效检测区域内边缘上的各目标点的深度值是否位于预设阈值范围内,如果边缘的各目标点的深度值位于预设阈值范围内,则针对待检测部件上各目标点的深度值执行步骤607,如果边缘的各目标点的深度值不位于预设阈值范围内,则针对待检测部件上各目标点的深度值执行步骤606。In the embodiment of the present invention, after obtaining the depth value of each target point of the component to be detected, it is determined whether the depth value of each target point on the edge of the effective detection area of the component to be detected is within the preset threshold range, if The depth value of the target point is within the preset threshold value range, then step 607 is performed for the depth value of each target point on the component to be detected, if the depth value of each target point on the edge is not within the preset threshold value range, then for the component to be detected. Step 606 is performed on the depth value of each upper target point.
例如,接前例所述,在该陶瓷隔热瓦的有效检测区域内,判断位于有效检测区域内边缘上的各目标点的深度值是否位于50cm±0.5cm内,若边缘的各目标点的深度值分别为49.5cm、60cm、56.8cm、54.2cm、52.5cm、50cm、49.7cm、53.1cm和56.2cm,则边缘的各目标点的深度值不位于预设阈值范围内,双目摄像机的成像平面与待检测部件的表面不平行,执行步骤606。For example, as described in the previous example, in the effective detection area of the ceramic heat insulation tile, determine whether the depth value of each target point located on the inner edge of the effective detection area is within 50cm±0.5cm, if the depth of each target point on the edge is within 50cm ± 0.5cm The values are 49.5cm, 60cm, 56.8cm, 54.2cm, 52.5cm, 50cm, 49.7cm, 53.1cm and 56.2cm respectively, then the depth value of each target point on the edge is not within the preset threshold range, and the imaging of the binocular camera If the plane is not parallel to the surface of the component to be inspected, step 606 is executed.
步骤606:对待检测部件上各目标点的深度值进行校准。Step 606: Calibrate the depth value of each target point on the component to be detected.
在本发明实施例中,根据待检测部件边缘的各目标点的深度值确定双目摄像机的成像平面与待检测部件的表面之间的夹角,从待检测部件边缘的各目标点的深度值分别确定最小深度值(A)和最大深度值(B);In this embodiment of the present invention, the angle between the imaging plane of the binocular camera and the surface of the component to be detected is determined according to the depth value of each target point on the edge of the component to be detected, and the depth value of each target point on the edge of the component to be detected is determined from the depth value of each target point on the edge of the component to be detected. Determine the minimum depth value (A) and the maximum depth value (B) respectively;
根据最小深度值(A)和最大深度值B),通过如下公式对待检测部件中的各目标点的深度值进行校准:According to the minimum depth value (A) and the maximum depth value B), the depth value of each target point in the component to be detected is calibrated by the following formula:
Figure PCTCN2020132353-appb-000003
Figure PCTCN2020132353-appb-000003
Figure PCTCN2020132353-appb-000004
Figure PCTCN2020132353-appb-000004
其中,h i用于表征校准处理后的待检测部件中i目标点的深度值,θ用于表征双目摄像机的成像平面与待检测部件的表面之间的夹角,h b用于表征最大深度值(B),h a用于表征最小深度值(A),x b用于表征最大深度值(B)所对应的B目标点在第一检测图像中所对应的像素点的横坐标,x a用于表征最小深度值(A)所对应的A目标点在第一检测图像中所对应的像素点的横坐标,h i 1用于表征校准处理前的待检测部件中i目标点的深度值;x i用于表征i目标点在第一检测图像中所对应的像素点的横坐标。 Among them, h i is used to represent the depth value of the i target point in the component to be detected after calibration processing, θ is used to represent the angle between the imaging plane of the binocular camera and the surface of the component to be detected, h b is used to represent the maximum The depth value (B), ha is used to represent the minimum depth value (A), x b is used to represent the abscissa of the pixel corresponding to the B target point corresponding to the maximum depth value (B) in the first detection image, x a is used to represent the abscissa of the pixel point corresponding to the A target point corresponding to the minimum depth value (A) in the first detection image, and h i 1 is used to represent the i target point in the component to be detected before the calibration process. Depth value; x i is used to represent the abscissa of the pixel point corresponding to the i target point in the first detection image.
例如,接前例所述,从待检测部件边缘的各目标点的深度值分别确定最小深度值(A:50cm)和最大深度值(B:60cm),确定A点在第一检测图像中所对应的像素点坐标(1,2),确定B点在第一检测图像中所对应的像素点坐标(19,4),通过如上公式确定双目摄像机的成像平面与待检测部件的表面之间的夹角为arctan5/9,对该陶瓷隔热瓦上的Y点,在第一检测图像中的像素点坐标为(10,9),其深度值为60cm,则通过如上公式进行校准,获得校准后Y点的深度值为55cm(即60-5)。For example, as described in the previous example, the minimum depth value (A: 50cm) and the maximum depth value (B: 60cm) are respectively determined from the depth values of each target point on the edge of the component to be detected, and the corresponding point A in the first detection image is determined. The pixel coordinates (1, 2) are determined, the pixel coordinates (19, 4) corresponding to point B in the first detection image are determined, and the distance between the imaging plane of the binocular camera and the surface of the component to be detected is determined by the above formula. The angle is arctan5/9, the Y point on the ceramic heat insulation tile, the pixel coordinate in the first detection image is (10,9), and its depth value is 60cm, then the calibration is performed by the above formula to obtain the calibration The depth value of the rear Y point is 55cm (ie 60-5).
步骤607:确定第一目标深度值和第二目标深度值。Step 607: Determine the first target depth value and the second target depth value.
在本发明实施例中,确定第一目标深度值和第二目标深度值,其中,第一目标深度值为待检测部件上各目标点的深度值中的最大值,第二目标深度值为待检测部件上各目标点的深度值中的最小值。In the embodiment of the present invention, a first target depth value and a second target depth value are determined, wherein the first target depth value is the maximum value among the depth values of each target point on the component to be detected, and the second target depth value is the value to be detected. Detects the minimum value of the depth values of each target point on the part.
例如,接前例所述,该陶瓷隔热瓦上目标点的深度值经过校准后,其中,最大深度值为Y 55cm,最小深度值为50cm。For example, as described in the previous example, after the depth value of the target point on the ceramic heat insulating tile is calibrated, the maximum depth value is Y 55cm, and the minimum depth value is 50cm.
步骤608:对第一目标深度值和第二目标深度值进行差值运算。Step 608: Perform a difference operation on the first target depth value and the second target depth value.
在本发明实施例中,对第一目标深度值和第二目标深度值进行差值运算,获得目标差值。In the embodiment of the present invention, a difference value operation is performed on the first target depth value and the second target depth value to obtain a target difference value.
例如,接前例所述,该陶瓷隔热瓦上目标点的深度值经过校准后,其中,最大深度值为Y 55cm,最小深度值为50cm,目标差值为5cm。For example, following the previous example, after the depth value of the target point on the ceramic heat insulation tile is calibrated, the maximum depth value is Y 55cm, the minimum depth value is 50cm, and the target difference is 5cm.
步骤609:确定待检测部件的侵蚀程度。Step 609: Determine the erosion degree of the component to be inspected.
在本发明实施例中,在判断目标差值的绝对值是否大于预设阈值,如果是,则确定待检测部件为需要更换的侵蚀程度;如果否,则确定待检测部件为不需要更换的侵蚀程度。In the embodiment of the present invention, when judging whether the absolute value of the target difference is greater than a preset threshold, if so, it is determined that the component to be inspected is an erosion degree that needs to be replaced; if not, it is determined that the component to be inspected is an erosion that does not require replacement. degree.
例如,接前例所述,预设阈值为3.5cm,目标差值为5cm大于预设阈值,则确定该陶瓷隔热瓦为需要更换的侵蚀程度。For example, as described in the previous example, if the preset threshold is 3.5 cm, and the target difference value is 5 cm greater than the preset threshold, then it is determined that the ceramic thermal insulation tile is the degree of erosion that needs to be replaced.
如图7所示,本发明实施例提供了一种侵蚀检测装置,包括:As shown in FIG. 7 , an embodiment of the present invention provides an erosion detection device, including:
一个获取模块701,用于获取待检测部件的第一检测图像和第二检测图像,其中,第一检测图像和第二检测图像由双目摄像机包括的两个摄像机分别采集;An acquisition module 701, configured to acquire the first detection image and the second detection image of the component to be detected, wherein the first detection image and the second detection image are respectively collected by two cameras included in the binocular camera;
一个图像处理模块702,用于根据获取模块701所获取的第一检测图像和获取模块所获取的第二检测图像的视差,确定待检测部件上至少两个目标点的深度值,其中,待检测部件上任一个目标点的深度值用于表征该目标点与双目摄像机包括的两个镜头的中心点连线的距离;An image processing module 702 for determining the depth values of at least two target points on the component to be detected according to the parallax of the first detection image acquired by the acquisition module 701 and the second detection image acquired by the acquisition module, wherein the The depth value of any target point on the component is used to represent the distance between the target point and the center point of the two lenses included in the binocular camera;
一个侵蚀判断模块703,用于根据由图像处理模块702所确定的待检测部件上各目标点的深度值,确定待检测部件的侵蚀程度。An erosion judging module 703 is configured to determine the degree of erosion of the part to be inspected according to the depth values of each target point on the part to be inspected determined by the image processing module 702 .
在本发明实施例中,获取模块701可用于执行上述方法实施例中的步骤101,图像处理模块702可用于执行上述方法实施例中的步骤102,侵蚀判断模块703可用于执行上述方法实施例中的步骤103。In this embodiment of the present invention, the acquisition module 701 can be used to perform step 101 in the above method embodiments, the image processing module 702 can be used to perform step 102 in the above method embodiments, and the erosion determination module 703 can be used to perform the above method embodiments. step 103.
在图7所示侵蚀检测装置的基础上,如图8所示,图像处理模块702包括:Based on the erosion detection device shown in FIG. 7 , as shown in FIG. 8 , the image processing module 702 includes:
一个像素点获取单元7021,用于针对待检测部件上的每一个目标点,确定该目标点在第一检测图像中对应的第一像素点,并确定该目标点在第二检测图像中所对应的第二像素点;A pixel point acquisition unit 7021, for each target point on the component to be detected, to determine the first pixel point corresponding to the target point in the first detection image, and to determine the target point corresponding to the second detection image. The second pixel point of ;
一个视差获取单元7022,用于确定像素点获取单元7022所确定出的第一像素点与第二像素点的目标视差,其中,目标视差用于表征第一像素点在第一检测图像中所处相对位置与第二像素点在第二检测图像中所处相对位置的差异;A parallax acquisition unit 7022 for determining the target parallax between the first pixel point and the second pixel point determined by the pixel point acquisition unit 7022, wherein the target parallax is used to represent the position of the first pixel point in the first detection image. the difference between the relative position and the relative position of the second pixel in the second detection image;
一个深度值获取单元7023,用于根据双目摄像机中摄像机的焦距、双目摄像机中两个摄像机光心之间的距离和视差获取单元7022确定出的目标视差,确定该目标点的深度值。A depth value acquisition unit 7023, configured to determine the depth value of the target point according to the focal length of the camera in the binocular camera, the distance between the optical centers of the two cameras in the binocular camera, and the target parallax determined by the parallax acquisition unit 7022.
在本发明实施例中,像素点获取单元单元7021可用于执行上述方法实施例中的步骤201,视差获取单元7022可用于执行上述方法实施例中的步骤202,深度值获取单元7023可用于执行上述方法实施例中的步骤203。In this embodiment of the present invention, the pixel point acquisition unit 7021 may be used to perform step 201 in the above method embodiments, the parallax acquisition unit 7022 may be used to perform step 202 in the above method embodiments, and the depth value acquisition unit 7023 may be used to perform the above mentioned method embodiments. Step 203 in the method embodiment.
可选地,在图7所示侵蚀检测装置的基础上,如图9所示,侵蚀判断模块703包括:Optionally, based on the erosion detection device shown in FIG. 7 , as shown in FIG. 9 , the erosion judgment module 703 includes:
一个第一判断单元7031,用于判断位于待检测部件边缘的各目标点的深度值是否位于预设阈值范围内;A first judgment unit 7031 for judging whether the depth value of each target point located at the edge of the component to be detected is within the preset threshold range;
一个第一关系确定单元7032,用于在第一判断单元7031确定位于待检测部件边缘的各目标点的深度值位于预设阈值范围内时,则根据待检测部件上各目标点的深度值,确定待检测部件的侵蚀程度;A first relationship determination unit 7032 is used for when the first judgment unit 7031 determines that the depth value of each target point on the edge of the component to be detected is within the preset threshold range, then according to the depth value of each target point on the component to be detected, Determine the degree of erosion of the part to be inspected;
一个第二关系确定单元7033,用于在第一判断单元7031确定位于待检测部件边缘的各目标点的深度值未全部位于预设阈值范围内时,根据待检测部件边缘的各目标点的深度值确定双目摄像机的成像平面与待检测部件的表面之间的夹角,并根据夹角对待检测部件上各目标点的深度值进行校准,以及根据校准后的待检测部件上各目标点的深度值确定待检测部件的侵蚀程度。A second relationship determination unit 7033 is used for when the first judgment unit 7031 determines that the depth values of each target point on the edge of the component to be detected are not all within the preset threshold range, according to the depth of each target point on the edge of the component to be detected. The value determines the angle between the imaging plane of the binocular camera and the surface of the part to be inspected, and calibrates the depth value of each target point on the part to be inspected according to the angle, and according to the calibrated depth value of each target point on the part to be inspected The depth value determines the degree of erosion of the part to be inspected.
在本发明实施例中,第一判断单元7031可用于执行上述方法实施例中的步骤301,第一 关系确定单元7032可用于执行上述方法实施例中的步骤302,第二关系确定单元7033可用于执行上述方法实施例中的步骤304和步骤305。In this embodiment of the present invention, the first judging unit 7031 may be configured to perform step 301 in the foregoing method embodiments, the first relationship determining unit 7032 may be configured to execute step 302 in the foregoing method embodiments, and the second relationship determining unit 7033 may be configured to perform Steps 304 and 305 in the above method embodiments are performed.
可选地,在图9所示侵蚀检测装置的基础上,如图10所示,侵蚀判断模块703包括:Optionally, based on the erosion detection device shown in FIG. 9 , as shown in FIG. 10 , the erosion judgment module 703 includes:
一个区域确定单元7034,用于根据各目标点的深度值和各目标点在待检测部件上的分布,确定待检测部件上的有效检测区域,其中,有效检测区域内包括有至少两个目标点,且有效检测区域内各目标点的深度值位于设定范围内;An area determination unit 7034 for determining the effective detection area on the component to be detected according to the depth value of each target point and the distribution of each target point on the component to be detected, wherein the effective detection area includes at least two target points , and the depth value of each target point in the effective detection area is within the set range;
一个第二侵蚀确定单元7035,用于根据区域确定单元7034确定出的有效检测区域内的各目标点的深度值,确定待检测部件的侵蚀程度。A second erosion determination unit 7035 is configured to determine the degree of erosion of the component to be inspected according to the depth values of each target point in the effective inspection area determined by the area determination unit 7034 .
在本发明实施例中,区域确定单元7034可用于执行上述方法实施例中的步骤401,第二侵蚀确定单元7035可用于执行上述方法实施例中的步骤402。In this embodiment of the present invention, the region determination unit 7034 may be configured to perform step 401 in the above method embodiments, and the second erosion determination unit 7035 may be configured to perform step 402 in the above method embodiments.
可选地,在图7、图8、图9或图10所示侵蚀检测装置的基础上,如图11所示,侵蚀判断模块703包括:Optionally, based on the erosion detection device shown in FIG. 7 , FIG. 8 , FIG. 9 or FIG. 10 , as shown in FIG. 11 , the erosion determination module 703 includes:
一个深度值筛选单元7036,用于确定第一目标深度值和第二目标深度值,其中,第一目标深度值为待检测部件上各目标点的深度值中的最大值,第二目标深度值为待检测部件上各目标点的深度值中的最小值;A depth value screening unit 7036 for determining a first target depth value and a second target depth value, wherein the first target depth value is the maximum value among the depth values of each target point on the component to be detected, and the second target depth value is is the minimum value among the depth values of each target point on the component to be detected;
一个运算单元7037,用于对由深度值筛选单元7036确定的第一目标深度值和由深度值筛选单元7036确定的第二目标深度值进行差值运算,获得目标差值;an operation unit 7037 for performing a difference operation on the first target depth value determined by the depth value screening unit 7036 and the second target depth value determined by the depth value screening unit 7036 to obtain the target difference value;
一个第二判断单元7038,用于判断由运算单元7037确定的目标差值的绝对值是否大于预设阈值;A second judging unit 7038 for judging whether the absolute value of the target difference determined by the arithmetic unit 7037 is greater than a preset threshold;
一个侵蚀程度确定单元7039,用于在第二判断单元7038确定的目标差值的绝对值大于预设阈值时,确定待检测部件为需要更换的侵蚀程度。An erosion degree determination unit 7039, configured to determine that the component to be detected is an erosion degree that needs to be replaced when the absolute value of the target difference determined by the second determination unit 7038 is greater than a preset threshold.
在本发明实施例中,深度值筛选单元7036可用于执行上述方法实施例中的步骤501,运算单元7037可用于执行上述方法实施例中的步骤502,第二判断单元7038可用于执行上述方法实施例中的步骤503,侵蚀程度确定单元7039可用于执行上述方法实施例中的步骤504和步骤505。In this embodiment of the present invention, the depth value screening unit 7036 may be configured to perform step 501 in the foregoing method embodiments, the computing unit 7037 may be configured to perform step 502 in the foregoing method embodiments, and the second determining unit 7038 may be configured to execute the foregoing method implementations In step 503 in this example, the erosion degree determination unit 7039 may be used to perform steps 504 and 505 in the above method embodiments.
如图12所示,本发明一个实施例提供了一种侵蚀检测装置,包括:至少一个存储器704和至少一个处理器705;As shown in FIG. 12, an embodiment of the present invention provides an erosion detection apparatus, including: at least one memory 704 and at least one processor 705;
所述至少一个存储器704,用于存储有机器可读程序;the at least one memory 704 for storing a machine-readable program;
所述至少一个处理器705,用于调用所述机器可读程序,执行上述各个实施例所提供的侵蚀检测方法。The at least one processor 705 is configured to invoke the machine-readable program to execute the erosion detection methods provided in the foregoing embodiments.
本发明还提供了一种计算机可读介质,存储用于使一机器执行如本文所述的侵蚀检测方法的指令。具体地,可以提供配有存储介质的系统或者装置,在该存储介质上存储着实现上述实施例中任一实施例的功能的软件程序代码,且使该系统或者装置的计算机(或CPU或MPU)读出并执行存储在存储介质中的程序代码。The present invention also provides a computer-readable medium storing instructions for causing a machine to perform the erosion detection method as described herein. Specifically, it is possible to provide a system or device equipped with a storage medium on which software program codes for implementing the functions of any of the above-described embodiments are stored, and which enables a computer (or CPU or MPU of the system or device) ) to read and execute the program code stored in the storage medium.
在这种情况下,从存储介质读取的程序代码本身可实现上述实施例中任何一项实施例的功能,因此程序代码和存储程序代码的存储介质构成了本发明的一部分。In this case, the program code itself read from the storage medium can implement the functions of any of the above-described embodiments, and thus the program code and the storage medium storing the program code form part of the present invention.
用于提供程序代码的存储介质实施例包括软盘、硬盘、磁光盘、光盘(如CD-ROM、CD-R、CD-RW、DVD-ROM、DVD-RAM、DVD-RW、DVD+RW)、磁带、非易失性存储卡和ROM。可选择地,可以由通信网络从服务器计算机上下载程序代码。Examples of storage media for providing program code include floppy disks, hard disks, magneto-optical disks, optical disks (eg CD-ROM, CD-R, CD-RW, DVD-ROM, DVD-RAM, DVD-RW, DVD+RW), Magnetic tapes, non-volatile memory cards and ROMs. Alternatively, the program code may be downloaded from a server computer over a communications network.
此外,应该清楚的是,不仅可以通过执行计算机所读出的程序代码,而且可以通过基于程序代码的指令使计算机上操作的操作系统等来完成部分或者全部的实际操作,从而实现上述实施例中任意一项实施例的功能。In addition, it should be clear that part or all of the actual operations can be implemented not only by executing the program code read out by the computer, but also by the operating system or the like operating on the computer based on the instructions of the program code, so as to realize the above-mentioned embodiments. Function of any one of the embodiments.
此外,可以理解的是,将由存储介质读出的程序代码写到插入计算机内的扩展板中所设置的存储器中或者写到与计算机相连接的扩展模块中设置的存储器中,随后基于程序代码的指令使安装在扩展板或者扩展模块上的CPU等来执行部分和全部实际操作,从而实现上述实施例中任一实施例的功能。In addition, it can be understood that the program code read from the storage medium is written into the memory provided in the expansion board inserted into the computer or into the memory provided in the expansion module connected with the computer, and then based on the program code The instructions cause the CPU or the like installed on the expansion board or expansion module to perform part and all of the actual operations, so as to realize the functions of any one of the above-mentioned embodiments.
需要说明的是,上述各流程和各系统结构图中不是所有的步骤和模块都是必须的,可以根据实际的需要忽略某些步骤或模块。各步骤的执行顺序不是固定的,可以根据需要进行调整。上述各实施例中描述的系统结构可以是物理结构,也可以是逻辑结构,即,有些模块可 能由同一物理实体实现,或者,有些模块可能分由多个物理实体实现,或者,可以由多个独立设备中的某些部件共同实现。It should be noted that not all steps and modules in the above-mentioned processes and system structure diagrams are necessary, and some steps or modules may be omitted according to actual needs. The execution order of each step is not fixed and can be adjusted as required. The system structure described in the above embodiments may be a physical structure or a logical structure, that is, some modules may be implemented by the same physical entity, or some modules may be implemented by multiple physical entities, or may be implemented by multiple physical entities. Some components in separate devices are implemented together.
以上各实施例中,硬件模块可以通过机械方式或电气方式实现。例如,一个硬件模块可以包括永久性专用的电路或逻辑(如专门的处理器,FPGA或ASIC)来完成相应操作。硬件模块还可以包括可编程逻辑或电路(如通用处理器或其它可编程处理器),可以由软件进行临时的设置以完成相应操作。具体的实现方式(机械方式、或专用的永久性电路、或者临时设置的电路)可以基于成本和时间上的考虑来确定。In the above embodiments, the hardware modules may be implemented mechanically or electrically. For example, a hardware module may include permanent dedicated circuits or logic (eg, dedicated processors, FPGAs or ASICs) to perform corresponding operations. The hardware modules may also include programmable logic or circuits (eg, general-purpose processors or other programmable processors), which may be temporarily set by software to complete corresponding operations. The specific implementation (mechanical, or dedicated permanent circuit, or temporarily provided circuit) can be determined based on cost and time considerations.
上文通过附图和优选实施例对本发明进行了详细展示和说明,然而本发明不限于这些已揭示的实施例,基与上述多个实施例本领域技术人员可以知晓,可以组合上述不同实施例中的代码审核手段得到本发明更多的实施例,这些实施例也在本发明的保护范围之内。The present invention is shown and described in detail above through the accompanying drawings and preferred embodiments. However, the present invention is not limited to these disclosed embodiments. Those skilled in the art can know that the above-mentioned different embodiments can be combined based on the above-mentioned multiple embodiments. More embodiments of the present invention can be obtained by the code review method in the present invention, and these embodiments are also within the protection scope of the present invention.

Claims (12)

  1. 侵蚀检测方法,包括:Erosion detection methods, including:
    获取待检测部件的第一检测图像和第二检测图像,其中,所述第一检测图像和所述第二检测图像由双目摄像机包括的两个摄像机分别采集;acquiring a first detection image and a second detection image of the component to be detected, wherein the first detection image and the second detection image are respectively collected by two cameras included in the binocular camera;
    根据所述第一检测图像和所述第二检测图像的视差,确定所述待检测部件上至少两个目标点的深度值,其中,所述待检测部件上任一个目标点的深度值用于表征该目标点与所述双目摄像机包括的两个镜头的中心点连线的距离;According to the parallax of the first detection image and the second detection image, the depth values of at least two target points on the component to be detected are determined, wherein the depth value of any target point on the component to be detected is used to represent The distance between the target point and the center point of the two lenses included in the binocular camera;
    根据所述待检测部件上各所述目标点的深度值,确定所述待检测部件的侵蚀程度。According to the depth value of each of the target points on the component to be inspected, the degree of erosion of the component to be inspected is determined.
  2. 根据权利要求1所述的方法,其中,所述根据所述第一检测图像和所述第二检测图像的视差,确定所述待检测部件上至少两个目标点的深度值,包括:The method according to claim 1, wherein the determining the depth values of at least two target points on the component to be detected according to the parallax of the first detection image and the second detection image comprises:
    针对所述待检测部件上的每一个所述目标点,均执行:For each of the target points on the component to be detected, execute:
    确定该目标点在所述第一检测图像中对应的第一像素点,并确定该目标点在所述第二检测图像中所对应的第二像素点;Determine the first pixel point corresponding to the target point in the first detection image, and determine the second pixel point corresponding to the target point in the second detection image;
    确定所述第一像素点与所述第二像素点的目标视差,其中,所述目标视差用于表征所述第一像素点在所述第一检测图像中所处相对位置与所述第二像素点在所述第二检测图像中所处相对位置的差异;determining the target parallax between the first pixel point and the second pixel point, wherein the target parallax is used to represent the relative position of the first pixel point in the first detection image and the second pixel point The difference between the relative positions of the pixel points in the second detection image;
    根据所述目标视差、所述双目摄像机中摄像机的焦距和所述双目摄像机中两个摄像机光心之间的距离,确定该目标点的深度值。The depth value of the target point is determined according to the target parallax, the focal length of the camera in the binocular camera, and the distance between the optical centers of the two cameras in the binocular camera.
  3. 根据权利要求1所述的方法,其中,所述根据所述待检测部件上各所述目标点的深度值,确定所述待检测部件的侵蚀程度,包括:The method according to claim 1, wherein the determining the degree of erosion of the part to be inspected according to the depth value of each of the target points on the part to be inspected comprises:
    判断位于所述待检测部件边缘的各所述目标点的深度值是否位于预设阈值范围内;Judging whether the depth value of each target point located at the edge of the component to be detected is within a preset threshold range;
    如果位于所述待检测部件边缘的各所述目标点的深度值位于所述预设阈值范围内,则根据所述待检测部件上各所述目标点的深度值,确定所述待检测部件的侵蚀程度;If the depth value of each of the target points on the edge of the component to be detected is within the preset threshold range, determine the depth of the component to be detected according to the depth value of each of the target points on the component to be detected degree of erosion;
    如果位于所述待检测部件边缘的各所述目标点的深度值未全部位于所述预设阈值范围内,则执行:If the depth values of the target points located at the edge of the component to be detected are not all within the preset threshold range, execute:
    根据所述待检测部件边缘的各所述目标点的深度值确定所述双目摄像机的成像平面与所述待检测部件的表面之间的夹角;Determine the angle between the imaging plane of the binocular camera and the surface of the component to be detected according to the depth value of each of the target points on the edge of the component to be detected;
    根据所述夹角对所述待检测部件上各所述目标点的深度值进行校准;calibrating the depth value of each of the target points on the component to be detected according to the included angle;
    根据经校准的所述待检测部件上各所述目标点的深度值确定所述待检测部件的侵蚀程度。The degree of erosion of the part to be inspected is determined according to the calibrated depth value of each of the target points on the part to be inspected.
  4. 根据权利要求1所述的方法,其中,所述根据所述待检测部件上各所述目标点的深度值,确定所述待检测部件的侵蚀程度,包括:The method according to claim 1, wherein the determining the degree of erosion of the part to be inspected according to the depth value of each of the target points on the part to be inspected comprises:
    根据各所述目标点的深度值和各所述目标点在所述待检测部件上的分布,确定所述待检测部件上的有效检测区域,其中,所述有效检测区域内包括有至少两个所述目标点,且所述有效检测区域内各所述目标点的深度值位于设定范围内;According to the depth value of each target point and the distribution of each target point on the component to be detected, an effective detection area on the component to be detected is determined, wherein the effective detection area includes at least two the target point, and the depth value of each of the target points in the effective detection area is within the set range;
    根据所述有效检测区域内各所述目标点的深度值,确定所述待检测部件的侵蚀程度。According to the depth value of each of the target points in the effective detection area, the degree of erosion of the component to be detected is determined.
  5. 根据权利要求1至4中任一所述的方法,其中,所述根据所述待检测部件上各所述目标点的深度值,确定所述待检测部件的侵蚀程度,包括:The method according to any one of claims 1 to 4, wherein the determining the degree of erosion of the part to be inspected according to the depth value of each of the target points on the part to be inspected comprises:
    确定第一目标深度值和第二目标深度值,其中,所述第一目标深度值为所述待检测部件上各所述目标点的深度值中的最大值,所述第二目标深度值为所述待检测部件上各所述目标点的深度值中的最小值;Determine a first target depth value and a second target depth value, wherein the first target depth value is the maximum value among the depth values of each of the target points on the component to be detected, and the second target depth value is the minimum value among the depth values of each of the target points on the component to be detected;
    对所述第一目标深度值和所述第二目标深度值进行差值运算,获得目标差值;performing a difference operation on the first target depth value and the second target depth value to obtain a target difference value;
    判断所述目标差值的绝对值是否大于预设阈值;judging whether the absolute value of the target difference is greater than a preset threshold;
    如果所述目标差值的绝对值大于所述预设阈值,则确定所述待检测部件为需要更换的侵蚀程度。If the absolute value of the target difference value is greater than the preset threshold value, it is determined that the component to be inspected has an erosion degree that needs to be replaced.
  6. 侵蚀检测装置,包括:Erosion detection device including:
    一个获取模块(701),用于获取待检测部件的第一检测图像和第二检测图像,其中,所述第一检测图像和所述第二检测图像由双目摄像机包括的两个摄像机分别采集;An acquisition module (701) for acquiring a first detection image and a second detection image of the component to be detected, wherein the first detection image and the second detection image are collected by two cameras included in the binocular camera respectively ;
    一个图像处理模块(702),用于根据所述获取模块(701)所获取的所述第一检测图像和所述获取模块所获取的所述第二检测图像的视差,确定所述待检测部件上至少两个目标点的深度值,其中,所述待检测部件上任一个目标点的深度值用于表征该目标点与所述双目摄像机包括的两个镜头的中心点连线的距离;An image processing module (702) for determining the component to be detected according to the parallax of the first detection image acquired by the acquisition module (701) and the second detection image acquired by the acquisition module The depth values of at least two target points on the above, wherein the depth value of any target point on the component to be detected is used to represent the distance between the target point and the center point of the two lenses included in the binocular camera;
    一个侵蚀判断模块(703),用于根据由所述图像处理模块(702)所确定的所述待检测部件上各所述目标点的深度值,确定所述待检测部件的侵蚀程度。An erosion judging module (703) is configured to determine the degree of erosion of the part to be inspected according to the depth values of the target points on the part to be inspected determined by the image processing module (702).
  7. 根据权利要求6所述的装置,其中,所述图像处理模块(702)包括:The apparatus of claim 6, wherein the image processing module (702) comprises:
    一个像素点获取单元(7021),用于针对所述待检测部件上的每一个所述目标点,确定该目标点在所述第一检测图像中对应的第一像素点,并确定该目标点在所述第二检测图像中所对应的第二像素点;A pixel point acquisition unit (7021), configured to, for each of the target points on the component to be detected, determine the first pixel point corresponding to the target point in the first detected image, and determine the target point the corresponding second pixel in the second detection image;
    一个视差获取单元(7022),用于确定所述像素点获取单元(7021)所确定出的所述第一像素点与所述第二像素点的目标视差,其中,所述目标视差用于表征所述第一像素点在所述第一检测图像中所处相对位置与所述第二像素点在所述第二检测图像中所处相对位置的差异;A parallax acquisition unit (7022), configured to determine the target parallax between the first pixel point and the second pixel point determined by the pixel point acquisition unit (7021), wherein the target parallax is used to represent The difference between the relative position of the first pixel point in the first detection image and the relative position of the second pixel point in the second detection image;
    一个深度值获取单元(7023),用于根据所述双目摄像机中摄像机的焦距、所述双目摄像机中两个摄像机光心之间的距离和所述视差获取单元(7022)确定出的所述目标视差,确定该目标点的深度值。A depth value acquisition unit (7023), configured to obtain the result determined by the disparity acquisition unit (7022) according to the focal length of the camera in the binocular camera, the distance between the optical centers of the two cameras in the binocular camera, and the parallax acquisition unit (7022). Describe the target disparity, and determine the depth value of the target point.
  8. 根据权利要求6所述的装置,其中,所述侵蚀判断模块(703)包括:The apparatus according to claim 6, wherein the erosion determination module (703) comprises:
    一个第一判断单元(7031),用于判断位于所述待检测部件边缘的各所述目标点的深度值是否位于预设阈值范围内;A first judging unit (7031) for judging whether the depth value of each of the target points located at the edge of the component to be detected is within a preset threshold range;
    一个第一关系确定单元(7032),用于在所述第一判断单元(7031)确定位于所述待检测部件边缘的各所述目标点的深度值位于所述预设阈值范围内时,则根据所述待检测部件上各所述目标点的深度值,确定所述待检测部件的侵蚀程度;A first relationship determination unit (7032), configured to, when the first determination unit (7031) determines that the depth value of each of the target points located at the edge of the component to be detected is within the preset threshold range, then Determine the degree of erosion of the component to be detected according to the depth value of each of the target points on the component to be detected;
    一个第二关系确定单元(7033),用于所述在第一判断单元(7031)确定位于所述待检测部件边缘的各所述目标点的深度值未全部位于所述预设阈值范围内时,根据所述待检测部件边缘的各所述目标点的深度值确定所述双目摄像机的成像平面与所述待检测部件的表面之间的夹角,并根据所述夹角对所述待检测部件上各所述目标点的深度值进行校准,以及根据校准后的所述待检测部件上各所述目标点的深度值确定所述待检测部件的侵蚀程度。A second relationship determination unit (7033), used for when the first determination unit (7031) determines that the depth values of each of the target points located at the edge of the component to be detected are not all within the preset threshold range , determine the angle between the imaging plane of the binocular camera and the surface of the component to be detected according to the depth value of each target point on the edge of the component to be detected, and determine the angle between the The depth value of each target point on the detection part is calibrated, and the degree of erosion of the to-be-detected part is determined according to the calibrated depth value of each of the target points on the to-be-detected part.
  9. 根据权利要求6所述的装置,其中,所述侵蚀判断模块(703)包括:The apparatus according to claim 6, wherein the erosion determination module (703) comprises:
    一个区域确定单元(7034),用于根据各所述目标点的深度值和各所述目标点在所述待检测部件上的分布,确定所述待检测部件上的有效检测区域,其中,所述有效检测区域内包括有至少两个所述目标点,且所述有效检测区域内各所述目标点的深度值位于设定范围内;An area determination unit (7034), configured to determine the effective detection area on the component to be detected according to the depth value of each of the target points and the distribution of each of the target points on the component to be detected, wherein the The effective detection area includes at least two of the target points, and the depth value of each of the target points in the effective detection area is within a set range;
    一个第二侵蚀确定单元(7035),用于根据所述区域确定单元(7034)确定出的所述有效检测区域内的各所述目标点的深度值,确定所述待检测部件的侵蚀程度。A second erosion determination unit (7035), configured to determine the degree of erosion of the component to be inspected according to the depth values of the target points in the effective inspection area determined by the area determination unit (7034).
  10. 根据权利要求6至9中任一所述的装置,其中,所述侵蚀判断模块(703)包括:The apparatus according to any one of claims 6 to 9, wherein the erosion determination module (703) comprises:
    一个深度值筛选单元(7036),用于确定第一目标深度值和第二目标深度值,其中,所述第一目标深度值为所述待检测部件上各所述目标点的深度值中的最大值,所述第二目标深度值为所述待检测部件上各所述目标点的深度值中的最小值;A depth value screening unit (7036), for determining a first target depth value and a second target depth value, wherein the first target depth value is a The maximum value, the second target depth value is the minimum value among the depth values of the target points on the component to be detected;
    一个运算单元(7037),用于对由所述深度值筛选单元(7036)确定的所述第一目标深度值和由所述深度值筛选单元(7036)确定的所述第二目标深度值进行差值运算,获得目标差值;An operation unit (7037) configured to perform an operation on the first target depth value determined by the depth value screening unit (7036) and the second target depth value determined by the depth value screening unit (7036); Difference operation to obtain the target difference;
    一个第二判断单元(7038),用于判断由所述运算单元(7037)确定的所述目标差值的绝对值是否大于预设阈值;a second judging unit (7038) for judging whether the absolute value of the target difference determined by the computing unit (7037) is greater than a preset threshold;
    一个侵蚀程度确定单元(7039),用于在所述第二判断单元(7038)确定的所述目标差值的绝对值大于所述预设阈值时,确定所述待检测部件为需要更换的侵蚀程度。An erosion degree determination unit (7039), configured to determine that the component to be detected is erosion that needs to be replaced when the absolute value of the target difference determined by the second judgment unit (7038) is greater than the preset threshold degree.
  11. 侵蚀检测装置,包括:至少一个存储器(704)和至少一个处理器(705);an erosion detection apparatus, comprising: at least one memory (704) and at least one processor (705);
    所述至少一个存储器(704),用于存储机器可读程序;the at least one memory (704) for storing a machine-readable program;
    所述至少一个处理器(705),用于调用所述机器可读程序,执行权利要求1至5中任一所述的方法。The at least one processor (705) is configured to invoke the machine-readable program to execute the method of any one of claims 1-5.
  12. 计算机可读介质,所述计算机可读介质上存储有计算机指令,所述计算机指令在被处理器执行时,使所述处理器执行权利要求1至5中任一所述的方法。A computer-readable medium having computer instructions stored thereon, the computer instructions, when executed by a processor, cause the processor to perform the method of any one of claims 1 to 5.
PCT/CN2020/132353 2020-11-27 2020-11-27 Erosion detection method and apparatus, and computer-readable medium WO2022110043A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CN2020/132353 WO2022110043A1 (en) 2020-11-27 2020-11-27 Erosion detection method and apparatus, and computer-readable medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2020/132353 WO2022110043A1 (en) 2020-11-27 2020-11-27 Erosion detection method and apparatus, and computer-readable medium

Publications (1)

Publication Number Publication Date
WO2022110043A1 true WO2022110043A1 (en) 2022-06-02

Family

ID=81753828

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/132353 WO2022110043A1 (en) 2020-11-27 2020-11-27 Erosion detection method and apparatus, and computer-readable medium

Country Status (1)

Country Link
WO (1) WO2022110043A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115100203A (en) * 2022-08-25 2022-09-23 山东振鹏建筑钢品科技有限公司 Steel bar polishing and rust removing quality detection method
CN116363136A (en) * 2023-06-01 2023-06-30 山东创元智能设备制造有限责任公司 On-line screening method and system for automatic production of motor vehicle parts

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040183900A1 (en) * 2003-03-20 2004-09-23 Everest Vit Method and system for automatically detecting defects in remote video inspection applications
US20100045955A1 (en) * 2008-08-20 2010-02-25 Asml Holding N.V. Particle Detection on an Object Surface
CN107578397A (en) * 2017-07-25 2018-01-12 西南交通大学 A kind of novel non-contact abrasion of contact wire detection method
CN109615654A (en) * 2019-01-09 2019-04-12 中国矿业大学(北京) Drainage pipeline inside corrosion depth and area measurement method based on binocular vision
CN110033447A (en) * 2019-04-12 2019-07-19 东北大学 A kind of high-speed rail heavy rail detection method of surface flaw based on cloud method
CN110186934A (en) * 2019-06-12 2019-08-30 中国神华能源股份有限公司 Axle box rubber packing crack detecting method and detection device
CN110706182A (en) * 2019-10-10 2020-01-17 普联技术有限公司 Method and device for detecting flatness of shielding case, terminal equipment and storage medium

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040183900A1 (en) * 2003-03-20 2004-09-23 Everest Vit Method and system for automatically detecting defects in remote video inspection applications
US20100045955A1 (en) * 2008-08-20 2010-02-25 Asml Holding N.V. Particle Detection on an Object Surface
CN107578397A (en) * 2017-07-25 2018-01-12 西南交通大学 A kind of novel non-contact abrasion of contact wire detection method
CN109615654A (en) * 2019-01-09 2019-04-12 中国矿业大学(北京) Drainage pipeline inside corrosion depth and area measurement method based on binocular vision
CN110033447A (en) * 2019-04-12 2019-07-19 东北大学 A kind of high-speed rail heavy rail detection method of surface flaw based on cloud method
CN110186934A (en) * 2019-06-12 2019-08-30 中国神华能源股份有限公司 Axle box rubber packing crack detecting method and detection device
CN110706182A (en) * 2019-10-10 2020-01-17 普联技术有限公司 Method and device for detecting flatness of shielding case, terminal equipment and storage medium

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115100203A (en) * 2022-08-25 2022-09-23 山东振鹏建筑钢品科技有限公司 Steel bar polishing and rust removing quality detection method
CN115100203B (en) * 2022-08-25 2022-11-18 山东振鹏建筑钢品科技有限公司 Method for detecting quality of steel bar polishing and rust removal
CN116363136A (en) * 2023-06-01 2023-06-30 山东创元智能设备制造有限责任公司 On-line screening method and system for automatic production of motor vehicle parts
CN116363136B (en) * 2023-06-01 2023-08-11 山东创元智能设备制造有限责任公司 On-line screening method and system for automatic production of motor vehicle parts

Similar Documents

Publication Publication Date Title
TWI605249B (en) Wafer inspection using free-form care areas
JP4707605B2 (en) Image inspection method and image inspection apparatus using the method
TWI600897B (en) Computer-implemented method, non-transitory computer-readable medium, and system for detecting defects on a wafer
WO2022110043A1 (en) Erosion detection method and apparatus, and computer-readable medium
JP2014517265A (en) Analysis of digital images of the outer surface of tires and processing of false measurement points
WO2015100777A1 (en) Display panel defect detecting method and defect detecting device
US20150055754A1 (en) X-ray inspection method and x-ray inspection device
IL262170A (en) System, method and computer program product for correcting a difference image generated from a comparison of target and reference dies
CN115731165B (en) Detection system and method for on-line size spot inspection of lithium battery
JP2017040600A (en) Inspection method, inspection device, image processor, program and record medium
TW202238112A (en) Wafer surface defect inspection method and apparatus thereof
JP2010181328A (en) Device, program and method for inspecting surface of solar battery wafer
JP4981433B2 (en) Inspection device, inspection method, inspection program, and inspection system
JP2002290994A (en) Foreign matter inspection method and apparatus for small camera module
KR20140039098A (en) Apparatus for detecting defect
JP5876139B2 (en) Analysis of digital images of tire inner surfaces and processing of false measurement points
JP2014016239A (en) X-ray inspection method and x-ray inspection device
TW201317587A (en) Dimension measuring device and method thereof
TWI493177B (en) Method of detecting defect on optical film with periodic structure and device thereof
JP2003247954A (en) Defect detection method for round body circumference
JP2006284308A (en) Visual examination method of semiconductor device
JP2012078143A (en) Foreign matter inspection device and alignment adjustment method
JP5870676B2 (en) Image processing method
TWI571829B (en) Optical inspection method
JP2010091319A (en) Visual examination device and method

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20962933

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20962933

Country of ref document: EP

Kind code of ref document: A1