WO2022105676A1 - Method and system for measuring wear of workpiece plane - Google Patents

Method and system for measuring wear of workpiece plane Download PDF

Info

Publication number
WO2022105676A1
WO2022105676A1 PCT/CN2021/130178 CN2021130178W WO2022105676A1 WO 2022105676 A1 WO2022105676 A1 WO 2022105676A1 CN 2021130178 W CN2021130178 W CN 2021130178W WO 2022105676 A1 WO2022105676 A1 WO 2022105676A1
Authority
WO
WIPO (PCT)
Prior art keywords
point
wear
reference line
workpiece
laser
Prior art date
Application number
PCT/CN2021/130178
Other languages
French (fr)
Chinese (zh)
Inventor
王维林
Original Assignee
深圳市道通科技股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市道通科技股份有限公司 filed Critical 深圳市道通科技股份有限公司
Publication of WO2022105676A1 publication Critical patent/WO2022105676A1/en

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01BMEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B11/00Measuring arrangements characterised by the use of optical techniques
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01BMEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B11/00Measuring arrangements characterised by the use of optical techniques
    • G01B11/22Measuring arrangements characterised by the use of optical techniques for measuring depth

Definitions

  • the present application relates to the technical field of workpiece measurement, and in particular, to a method and system for measuring plane wear of a workpiece.
  • the monocular laser ranging first shoots the target laser line through the camera, then extracts the laser line from the camera image, converts the image pixel coordinates into 3D point cloud data through projection transformation, and then analyzes the point cloud data. The measured distance information of the target is displayed.
  • point cloud data analysis the position of the unworn point is usually used as the reference point, and the difference in laser projection depth between the worn area and the reference point is compared to obtain the wear information.
  • the purpose of the embodiments of the present invention is to provide a method and system for measuring the plane wear of a workpiece, which can accurately determine the unworn points and wear areas, thereby improving the measurement accuracy of the plane wear degree of the workpiece.
  • an embodiment of the present invention provides a method for measuring plane wear of a workpiece, the method comprising:
  • the coordinates of the plane, x n represents the x-axis coordinate corresponding to the laser point d n when the length direction of the laser line is taken as the x-axis, and y n represents the depth direction of the laser line set on the plane of the workpiece to be detected as the x-axis.
  • the y-axis coordinate corresponding to the laser point d n On the y-axis, the y-axis coordinate corresponding to the laser point d n ;
  • the rotation reference line f'(x', y') is determined so that the rotation reference line f'(x', y') the slope with respect to the x-axis is in an interval containing 0;
  • the degree of wear of the plane of the workpiece to be measured is determined.
  • the determined rotation reference line is calculated according to a rotation formula, and the rotation formula is:
  • determining the degree of wear of the plane of the workpiece to be measured according to the rotation reference line includes:
  • the depth of wear is determined.
  • the determining an unworn point in the area where the rotation reference line is located includes:
  • the lowest point of the area below the rotation reference line is searched as the unworn point.
  • determining the wear depth according to the unworn point and the rotation reference line includes:
  • the wear depth is determined.
  • the determining of the wear depth according to the worn points and the unworn points includes:
  • At least one of a maximum wear degree, an average wear degree or a wear consistency is determined.
  • the determining wear consistency includes:
  • the wear consistency information is output.
  • the determining the maximum degree of wear comprises:
  • the coordinate information corresponding to the maximum wear point is output as the maximum wear information.
  • the method further includes:
  • the determining, in the point cloud data, a set of consistent points located in the wear area includes:
  • the initial point set passes the consistency evaluation, the initial point set is used as the consistency point set.
  • the step of searching the point cloud data for continuous segments whose loss function is smaller than a preset value and conforms to a preset length as a busbar includes:
  • point cloud data start from the center of the point cloud data to both ends or from the two ends of the point cloud data to the center to search for continuous segments whose loss function is less than a preset value and conforms to a preset length as a busbar.
  • expanding the coincidence point according to the bus includes:
  • the corresponding point is combined with the bus bar to obtain a consistent point.
  • the culling of singular points in the consistent points to obtain an initial set of points including:
  • At least one singular point including discrete points and hole twill interference points in the consistent points is eliminated to obtain the initial point set.
  • an embodiment of the present invention provides a system for measuring plane wear of a workpiece, the system comprising:
  • a laser which is fixed on the bracket, and the laser projects a laser line to the plane of the workpiece to be inspected;
  • a camera fixed on the bracket, and the camera is used to collect an image containing the laser line;
  • a memory in communication with the at least one processor, the memory storing instructions executable by the at least one processor, the instructions being executed by the at least one processor to cause the at least one processor
  • the processor is capable of performing any of the methods described above.
  • embodiments of the present invention provide a non-volatile computer-readable storage medium, where the computer-readable storage medium stores computer-executable instructions, when the computer-executable instructions are worn by the workpiece plane measurement system When executed, the measurement system for flat wear of the workpiece executes the method as described above.
  • the method and system for measuring plane wear of a workpiece use laser measurement technology to determine a set of consistent points located in the wear area in point cloud data, and fit a set of points representing the wear area according to the set of consistent points. and according to the slope of the reference line relative to the x-axis, determine the rotation reference line, so that the slope of the rotation reference line relative to the x-axis is within the interval including 0, and the effective and precise rotation Reference line; fit the wear area according to the rotation reference line, and determine the wear degree of the workpiece plane to be measured, thereby greatly improving the measurement accuracy.
  • FIG. 1 is a schematic structural diagram of a measuring system for plane wear of a workpiece according to an embodiment of the present invention
  • FIG. 2 is a schematic flow chart of an embodiment of a method for measuring plane wear of a workpiece of the present invention
  • FIG. 3 is a schematic structural diagram of a laser line image of an embodiment of the method for measuring plane wear of a workpiece of the present invention
  • 4a is a schematic structural diagram of an embodiment of a method for measuring plane wear of a workpiece of the present invention
  • 4b is a schematic structural diagram of an embodiment of a method for measuring plane wear of a workpiece of the present invention
  • FIG. 5 is a schematic structural diagram of an embodiment of a method for measuring plane wear of a workpiece of the present invention
  • 6a is a schematic structural diagram of an embodiment of a method for measuring plane wear of a workpiece of the present invention
  • 6b is a schematic structural diagram of an embodiment of a method for measuring plane wear of a workpiece of the present invention
  • FIG. 7a is a schematic structural diagram of an embodiment of a method for measuring plane wear of a workpiece of the present invention.
  • 7b is a schematic structural diagram of an embodiment of a method for measuring plane wear of a workpiece of the present invention.
  • 7c is a schematic structural diagram of an embodiment of a method for measuring plane wear of a workpiece of the present invention.
  • FIG. 8 is a schematic structural diagram of an embodiment of a method for measuring plane wear of a workpiece of the present invention.
  • FIG. 9 is a schematic diagram of the hardware structure of the controller in an embodiment of the workpiece plane wear measurement system of the present invention.
  • FIG. 1 A schematic structural diagram of a measurement system for workpiece plane wear provided by an embodiment of the present invention.
  • the measurement system 10 for the plane wear of the workpiece includes a bracket; a laser 14 is fixed on the bracket, and the laser 14 projects a laser line to the plane of the workpiece to be inspected;
  • the camera 15 is fixed on the bracket, and the camera 15 is used for collecting images including the laser lines.
  • the measurement system 10 of workpiece plane wear may also include a display device 16 for displaying the degree of wear;
  • the power supply 17 is used to supply power to the laser 14, the camera 15 and the main control center.
  • the workpiece plane wear measurement system 10 can be implemented in various environments such as PCs, embedded systems, handheld devices, industrial control machines, etc.
  • the workpiece plane wear measurement system 10 is provided with a controller as the main control center. , Accurate non-wear points and wear areas, thereby improving the measurement accuracy of the level of wear on the workpiece plane.
  • FIG. 2 is a schematic flowchart of a method for measuring plane wear of a workpiece provided by an embodiment of the present invention.
  • the method can be executed by the controller 13 in the measuring system 10 for plane wear of a workpiece, and the method includes:
  • a laser is used to project a laser line to the plane of the workpiece to be inspected, and a camera is used to capture an image including the laser line.
  • the workpieces to be detected include brake discs and other workpieces that have wear characteristics after long-term use.
  • the surface to be inspected in the workpiece to be inspected is substantially flat.
  • the acquired image including the laser line is shown in FIG. 3 , the image includes a black background area and a highlighted laser line area that is different from the black background area, and is determined according to the highlighted laser line area Point cloud data used to represent laser line coordinates.
  • the highlighted laser line area can be divided into an edge area and a measurement area, and the edge area can also be called an edge interference area, as shown in FIG. 4a, wherein the laser line in the edge area is to be tested for the wear degree of the workpiece Therefore, the laser line area can be further processed, the edge area can be identified and eliminated, and only the measurement area is reserved for subsequent wear degree determination.
  • the pixel points in the edge area can be eliminated by the adjacent point distance judgment method, the sorting method, the rebound detection method, and the like.
  • the edge area is usually larger than the measurement area.
  • the distance is usually smaller inside the measurement section, so the edge section can be separated by the distance difference.
  • the edge section can be separated by this feature, as shown in Figure 4a, Separate the left edge segment.
  • the first lowest point lower than the reference line is usually not the reference point, but the interference data generated by the edge interference in the background laser line, which needs to be eliminated.
  • the effective reference point After removing the edge interference data, it can be determined that the effective reference point is close to the center of the point cloud, and has the feature of large rebound in the ordinate direction. According to this feature, the effective reference point as shown in Figure 4b can be identified.
  • the point cloud data is incomplete and incomplete.
  • the position of the incomplete reference point is usually at the edge of the point cloud data sequence, and the point cloud data is incomplete.
  • the longitudinal distance between them is relatively large, and the adjacent points are relatively small.
  • the incomplete reference points can be identified according to the above characteristics. After the incomplete reference points are identified, the incomplete reference points cannot be used as the reference point for point cloud wear detection. Similarly, need to be removed.
  • the image is mapped to the coordinate system in which the abscissa is the length direction of the laser line, and the ordinate is the depth of the laser line on the plane of the workpiece to be inspected.
  • the gray-scale centroid method can be used to analyze the pixel coordinates of the laser line in the measurement area.
  • Formula 1 For the calculation formula of the pixel coordinates, refer to Formula 1:
  • W(i, j) represents the grayscale weight of the image pixel
  • i, j represent the horizontal and vertical coordinates of the pixel respectively
  • S represents the target area
  • S(x 0 , y 0 ) represents the center of the target area.
  • Pixel coordinates, k is a positive integer, indicating the kth point.
  • the gray-scale centroid method can be regarded as a weighted centroid method with the gray square as the weight. Using the gray-scale centroid method does not need to binarize the image, and has good results when the target and the background have a large grayscale gap. positioning effect.
  • the extraction of the laser line is not limited to the extraction by the gray-scale centroid method, and other methods other than the gray-scale centroid method, such as the centroid method, can also be used.
  • the pixel coordinates S(x 0 , y 0 ) are extracted from the image, the pixel coordinates are converted into camera coordinates through projection transformation, so as to be converted into coordinates where the laser line is located, with reference to formula 2:
  • A represents the camera internal parameter matrix
  • C represents the camera coordinates
  • u represents the horizontal direction of the pixel coordinates
  • v represents the vertical direction of the pixel coordinates
  • both u and v are scalars.
  • the direction of the projection transformation can be changed, the reference point is above, and the wear area is below, as shown in Figure 7a.
  • Three coordinates representing the camera coordinate system Represents the three coordinates of the laser coordinate system
  • R represents the rotation change matrix
  • C represents the camera coordinate system
  • L represents the laser coordinate system
  • the camera coordinate system and the laser coordinate system coordinate origin coincide.
  • the point cloud data is a 3D laser coordinate system
  • the 3d laser coordinate system based on the 3d laser coordinate system, only the coordinates of the laser line direction and the laser projection direction are retained, and the 2d point cloud data is obtained, as shown in Figure 5.
  • y n represents the y-axis coordinate corresponding to the laser point d n when the depth direction of the laser line is set on the plane of the workpiece to be detected as the y-axis.
  • the horizontal direction identifies the x-axis direction
  • the vertical direction identifies the y-axis direction.
  • the mapping relationship between the image and the horizontal and vertical coordinates in Figure 4a, or the coordinate diagram in Figure 4b can be understood as the point cloud map of the point cloud data or the coordinate map of the point cloud data, which is used to indicate the horizontal and vertical coordinates of the point cloud data. value.
  • the point cloud is not parallel to the abscissa axis in the abscissa direction, and it is difficult to find the measurement point and reference point from the original point cloud data. Therefore, , the point cloud data needs to be rotated into data parallel to the abscissa.
  • the determining, in the point cloud data, a set of consistent points located in the wear area includes:
  • Equation 4 the loss function is calculated according to Equation 4.
  • the busbar is generally preferred to the point near the center of the point cloud position, because the degree of wear at this position is generally close. If there is no suitable busbar near the center of the wear area, you can search from both ends of the point cloud data.
  • the initial length of the busbar is also critical. If it is too short, the consistency will be poor. If it is too long, the search failure probability will be high. In this scheme, the preset search length is preferably 10mm.
  • it may include:
  • the corresponding point is combined with the bus bar to obtain a consistent point.
  • a search range can be defined as the preset range of the bus, and then the Euclidean distance from the points within the preset range to the bus is calculated. If the Euclidean distance is less than the preset distance, the corresponding point and the bus will be combined. If the Euclidean distance If it is greater than the preset distance, it means that the points are farther apart, and then these points are crossed.
  • the worn area may contain holes, patterns, or singularities such as edge reflections, which will cause distortion of the point cloud data. Therefore, when searching for consistent points, at least one singular point including discrete points and hole twill interference points in the consistent points is eliminated to obtain the initial point set.
  • discrete points may be misjudged as reference points due to uneven plane of the workpiece to be detected, target reflection, clutter, etc.
  • the point cloud data may be misjudged as a reference point.
  • the culling principle is usually considered based on factors such as the number of point sets, gradient changes, and data locations.
  • the interference of the hole twill will affect the continuity of the laser line, or the point cloud of the laser line will be distorted. Therefore, it needs to be eliminated.
  • Hole twill interference point The depth of holes or twill lines in the projection direction of the laser line is usually larger than that of the wear area.
  • the coordinates are usually above the reference line, and the width is limited, and the changes are relatively drastic. Through the above characteristics, holes or twill lines can be identified. Then remove the hole twill interference point.
  • the reference line f(x, y) used to represent the wear area is calculated by fitting.
  • the reference line f(x,y) is a straight line or a quadratic curve.
  • the reference line f(x,y) may have an included angle compared with the x-axis, that is, the reference line f(x,y) has a slope k, and the slope has May affect the accuracy of determining the degree of wear such as depth of wear, so before determining the degree of wear, the influence of this slope k should be eliminated so that the reference line is roughly parallel to the x-axis.
  • the reference line f(x, y) used to represent the wear area is calculated by the method of fitting.
  • the slope of the reference line f(x, y) is k, and according to the slope k of the reference line f(x, y) relative to the x-axis, the rotation reference line f'(x', y') is determined according to the rotation formula Calculation, the rotation formula is as formula 5:
  • the transformed coordinate point set can be used to simulate the rotation reference line, which can be simulated as a quadratic curve or a straight line, which is not limited here.
  • the slope of any line end is 0 or less than the allowable threshold, so that the rotation reference line is roughly parallel to the x-axis of the point cloud.
  • the rotation reference line usually a quadratic curve can be used, which is closer to the actual wear situation and meets the application requirements.
  • determining the degree of wear of the plane of the workpiece to be measured according to the rotation reference line may include:
  • the depth of wear is determined.
  • the worn area usually occupies a relatively large area
  • determining an unworn point in the area where the rotation reference line is located may include: searching for the lowest point of the area lower than the rotation reference line as the unworn point wear point. Then, based on the unworn point and the rotation reference line, the wear depth is determined.
  • determining the wear depth according to the unworn point and the rotation reference line may include:
  • the wear depth is determined.
  • the worn area usually occupies a relatively large area, and the search starts from the unworn point, that is, the reference line, to the center of the consistency point set, and the point near the rotation reference line or above the rotation reference line is used as the wear point.
  • the wear depth is determined according to the wear point and the non-wear point, which may include:
  • At least one of a maximum wear degree, an average wear degree or a wear consistency is determined.
  • determining wear uniformity includes:
  • the wear consistency information is output.
  • the set of multiple wear points can be determined as the wear area.
  • the wear consistency information is output so that the user can obtain the consistency information.
  • determining the maximum degree of wear includes:
  • the coordinate information corresponding to the maximum wear point is output as the maximum wear information.
  • the position with the largest ordinate in FIG. 8 can be considered as the maximum wear point and the corresponding area, then the coordinate information corresponding to the maximum wear point is output, so that the user can obtain the maximum wear point information.
  • the method further includes:
  • a preset wear degree can be set. When the preset wear degree exceeds the preset wear degree, it means that the workpiece is too worn and it is inconvenient for continued use, and a prompt message prompting the user to replace the workpiece to be inspected is output.
  • laser measurement technology is used, and an intelligent method is used to measure plane wear, and a local search method is used to determine the set of consistent points located in the wear area in the point cloud data, and fit the set according to the set of consistent points.
  • the reference line used to represent the wear area is effectively accurate reference line; and the rotation reference line is determined according to the slope of the reference line relative to the x-axis, so that the slope of the rotation reference line relative to the x-axis is within the range including 0. In the interval, the reference line is effectively and accurately rotated; according to the rotation reference line, the wear degree of the workpiece plane to be measured is determined, thereby greatly improving the measurement accuracy, and the embodiment of the present invention can meet the measurement requirements of most scenarios.
  • controller 13 includes:
  • One or more processors 131 , memory 132 are used as examples.
  • the processor 131 and the memory 132 may be connected by a bus or in other ways, and the connection by a bus is taken as an example in FIG. 9 .
  • the memory 132 can be used to store non-volatile software programs, non-volatile computer-executable programs and modules, such as corresponding to the method for measuring the plane wear of the workpiece in the embodiment of the present application. program instructions/modules.
  • the processor 131 executes various functional applications and data processing of the controller by running the non-volatile software programs, instructions and modules stored in the memory 132, that is, to implement the method for measuring the plane wear of the workpiece in the above method embodiments.
  • the memory 132 may include a stored program area and a stored data area, wherein the stored program area may store an operating system, an application program required for at least one function; the stored data area may store data created according to the use of a measurement system for workpiece plane wear, etc. . Additionally, memory 132 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some embodiments, the memory 132 may optionally include memory located remotely from the processor 131, and these remote memories may be connected via a network to the workpiece flat wear measurement system. Examples of such networks include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.
  • the one or more modules are stored in the memory 132, and when executed by the one or more processors 131, execute the method for measuring the plane wear of the workpiece in any of the above method embodiments, for example, execute the above-described method Method steps 101 to 106 in FIG. 2 .
  • the above product can execute the method provided by the embodiments of the present application, and has functional modules and beneficial effects corresponding to the execution method.
  • the above product can execute the method provided by the embodiments of the present application, and has functional modules and beneficial effects corresponding to the execution method.
  • Embodiments of the present application provide a non-volatile computer-readable storage medium, where the computer-readable storage medium stores computer-executable instructions, and the computer-executable instructions are executed by one or more processors, for example, in FIG. 9
  • a processor 131 of the above-mentioned one or more processors can execute the method for measuring the plane wear of the workpiece in any of the above-mentioned method embodiments, for example, to execute the above-described method steps 101 to 106 in FIG. 2 .
  • the device embodiments described above are only illustrative, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in One place, or it can be distributed over multiple network elements. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution in this embodiment.
  • each embodiment can be implemented by means of software plus a general hardware platform, and certainly can also be implemented by hardware.
  • Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be completed by instructing relevant hardware through a computer program, and the program can be stored in a computer-readable storage medium, and the program can be stored in a computer-readable storage medium. During execution, it may include the processes of the embodiments of the above-mentioned methods.
  • the storage medium may be a magnetic disk, an optical disk, a read-only memory (Read-Only Memory, ROM), or a random access memory (Random Access Memory, RAM) or the like.

Abstract

A method and system for measuring the wear of a workpiece plane. The method comprises: projecting laser rays onto a workpiece plane to be tested, and acquiring an image containing the laser rays (101); acquiring, according to the image, point cloud data related to the laser rays (102); determining, from the point cloud data, a consistency point set DSn located in a wear region, wherein DSn is a subset of Dn (103); performing fitting according to the consistency point set to obtain a reference line f(x,y) for representing the wear region (104); determining a rotation reference line f'(x',y') according to the slope of the reference line f(x,y) with respect to an x-axis, so that the slope of the rotation reference line f'(x',y'), with respect to the x-axis, is within an interval containing 0 (105); and determining the degree of wear of said workpiece plane according to the rotation reference line (106).

Description

一种工件平面磨损的测量方法和系统Method and system for measuring plane wear of workpiece
本申请要求于2020年11月17日提交中国专利局、申请号为202011287507.1、申请名称为“一种工件平面磨损的测量方法和系统”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims the priority of the Chinese patent application filed on November 17, 2020 with the application number 202011287507.1 and the application title "A Method and System for Measuring Flat Wear of Workpieces", the entire contents of which are incorporated by reference in in this application.
技术领域technical field
本申请涉及工件测量技术领域,特别涉及一种工件平面磨损的测量方法和系统。The present application relates to the technical field of workpiece measurement, and in particular, to a method and system for measuring plane wear of a workpiece.
背景技术Background technique
相互接触且有相对运动的工件通常会存在磨损,比如,刹车盘与刹车片之间,三角单目激光测距可用于检测这种磨损。具体检测原理为:单目激光测距首先通过相机拍摄目标激光线,然后,从相机图像中提取出激光线,通过投影变换把图像像素坐标转换成3D点云数据,再从点云数据里面分析出目标的测量距离信息。在点云数据分析中,通常以未磨损点位置作为参考点,比较磨损区与参考点的激光投射深度差异,以获取磨损信息。Workpieces that are in contact with each other and move relative to each other often experience wear, for example, between a brake disc and a brake pad, and triangulation monocular laser ranging can be used to detect such wear. The specific detection principle is: the monocular laser ranging first shoots the target laser line through the camera, then extracts the laser line from the camera image, converts the image pixel coordinates into 3D point cloud data through projection transformation, and then analyzes the point cloud data. The measured distance information of the target is displayed. In point cloud data analysis, the position of the unworn point is usually used as the reference point, and the difference in laser projection depth between the worn area and the reference point is compared to obtain the wear information.
由于从点云数据中磨损区的确定方式影响测量刹车盘磨损信息的精确度,当前,如何精准确定磨损区成为本领域技术人员亟待解决的技术问题。Since the method of determining the wear area from the point cloud data affects the accuracy of measuring the wear information of the brake disc, at present, how to accurately determine the wear area has become a technical problem to be solved urgently by those skilled in the art.
发明内容SUMMARY OF THE INVENTION
本发明实施例的目的是提供一种工件平面磨损的测量方法和系统,精确未磨损点和磨损区域,从而提高对工件平面磨损程度的测量精度。The purpose of the embodiments of the present invention is to provide a method and system for measuring the plane wear of a workpiece, which can accurately determine the unworn points and wear areas, thereby improving the measurement accuracy of the plane wear degree of the workpiece.
第一方面,本发明实施例提供了一种工件平面磨损的测量方法,所述方法包括:In a first aspect, an embodiment of the present invention provides a method for measuring plane wear of a workpiece, the method comprising:
向待检测工件平面投射激光线,并获取包含所述激光线的图像;Projecting a laser line to the plane of the workpiece to be inspected, and acquiring an image containing the laser line;
根据所述图像获取所述激光线相关的点云数据;所述点云数据为所述激光线投射在所述待检测工件平面的坐标数据序列D n;其中,D n={d 1(x 1,y 1)……d n(x n,y n)},n为正整数,d n(x n,y n)表示所述激光线上的激光点d n投射在所述待检测工件平面的坐标,x n表示以所述激光线的长度方向作为x轴时,激光点d n对应的x轴坐标,y n表示以所述激光线设在所述待检测工件平面的深度方向作为y轴时,激光点d n对应的y轴坐标; Acquire point cloud data related to the laser line according to the image; the point cloud data is the coordinate data sequence D n projected by the laser line on the plane of the workpiece to be detected; wherein D n ={d 1 (x 1 , y 1 )...d n (x n , y n )}, n is a positive integer, d n (x n , y n ) indicates that the laser point d n on the laser line is projected on the workpiece to be inspected The coordinates of the plane, x n represents the x-axis coordinate corresponding to the laser point d n when the length direction of the laser line is taken as the x-axis, and y n represents the depth direction of the laser line set on the plane of the workpiece to be detected as the x-axis. On the y-axis, the y-axis coordinate corresponding to the laser point d n ;
在所述点云数据中确定位于磨损区域的一致性点集DS n;其中,DS n为D n的子集; Determine the consistent point set DS n in the wear area in the point cloud data; wherein, DS n is a subset of D n ;
根据所述一致性点集拟合出用于表示磨损区域的参考线f(x,y);Fitting a reference line f(x, y) for representing the wear area according to the set of consistency points;
根据所述参考线f(x,y)相对于所述x轴的斜率,确定旋转参考线f'(x',y'),以使所述旋转参考线f'(x',y')相对于所述x轴的斜率在包含0的区间内;According to the slope of the reference line f(x, y) with respect to the x-axis, the rotation reference line f'(x', y') is determined so that the rotation reference line f'(x', y') the slope with respect to the x-axis is in an interval containing 0;
根据所述旋转参考线,确定所述待测工件平面的磨损程度。According to the rotation reference line, the degree of wear of the plane of the workpiece to be measured is determined.
在一些实施例中,所述确定旋转参考线根据旋转公式计算,所述旋转公式为:In some embodiments, the determined rotation reference line is calculated according to a rotation formula, and the rotation formula is:
Figure PCTCN2021130178-appb-000001
Figure PCTCN2021130178-appb-000001
其中,
Figure PCTCN2021130178-appb-000002
为所述旋转参考线f'(x',y')中各点的坐标,
Figure PCTCN2021130178-appb-000003
为所述参考线f(x,y)中各点的坐标,k为所述参考线f(x,y)相对于所述x轴的斜率,θ为所述参考线f(x,y)相对于所述x轴的旋转角度。
in,
Figure PCTCN2021130178-appb-000002
is the coordinate of each point in the rotation reference line f'(x', y'),
Figure PCTCN2021130178-appb-000003
is the coordinate of each point in the reference line f(x, y), k is the slope of the reference line f(x, y) relative to the x-axis, θ is the reference line f(x, y) The angle of rotation relative to the x-axis.
在一些实施例中,所述根据所述旋转参考线,确定所述待测工件平面的磨损程度,包括:In some embodiments, determining the degree of wear of the plane of the workpiece to be measured according to the rotation reference line includes:
在所述旋转参考线所在的区域确定未磨损点;determining an unworn point in the area where the rotation reference line is located;
根据所述未磨损点和所述旋转参考线,确定磨损深度。Based on the unworn point and the rotation reference line, the depth of wear is determined.
在一些实施例中,所述在所述旋转参考线所在的区域确定未磨损点,包括:In some embodiments, the determining an unworn point in the area where the rotation reference line is located includes:
搜索低于所述旋转参考线的区域的最低点作为未磨损点。The lowest point of the area below the rotation reference line is searched as the unworn point.
在一些实施例中,所述根据所述未磨损点和所述旋转参考线,确定磨损深度,包括:In some embodiments, determining the wear depth according to the unworn point and the rotation reference line includes:
从所述未磨损点,向所述一致性点集的中心查找,将在所述旋转参考线的预设范围内的点作为磨损点;From the unworn point, search to the center of the consistent point set, and use the point within the preset range of the rotation reference line as the wear point;
根据所述磨损点及所述未磨损点,确定磨损深度。According to the worn point and the unworn point, the wear depth is determined.
在一些实施例中,所述根据所述磨损点及所述未磨损点,确定磨损深度,包括:In some embodiments, the determining of the wear depth according to the worn points and the unworn points includes:
根据所述未磨损点和所述磨损点,确定最大磨损程度、平均磨损程度或磨损一致性中的至少一种磨损程度。According to the unworn point and the worn point, at least one of a maximum wear degree, an average wear degree or a wear consistency is determined.
在一些实施例中,所述确定磨损一致性,包括:In some embodiments, the determining wear consistency includes:
根据所述磨损点,确定磨损区域;According to the wear point, determine the wear area;
根据所述参考线的曲率和所述磨损区域对应的点集的离散性确定所述磨损一致性信息;determining the wear consistency information according to the curvature of the reference line and the discreteness of the point set corresponding to the wear area;
输出所述磨损一致性信息。The wear consistency information is output.
在一些实施例中,所述确定最大磨损程度,包括:In some embodiments, the determining the maximum degree of wear comprises:
获取所述磨损点的坐标信息;obtain the coordinate information of the wear point;
在所述磨损点的纵坐标为最大值时,确定所述磨损点为最大磨损点;When the ordinate of the wear point is the maximum value, determining the wear point as the maximum wear point;
输出所述最大磨损点对应的坐标信息,作为最大磨损信息。The coordinate information corresponding to the maximum wear point is output as the maximum wear information.
在一些实施例中,在所述根据所述未磨损点和所述旋转参考线,确定磨损深度之后,所述方法还包括:In some embodiments, after determining the wear depth according to the unworn point and the rotation reference line, the method further includes:
在所述磨损深度超过预设磨损程度时,输出提示用户更换所述待检工件的提示信息。When the wear depth exceeds a preset wear degree, output prompt information prompting the user to replace the workpiece to be inspected.
在一些实施例中,所述在所述点云数据中确定位于磨损区域的一致性点集,包括:In some embodiments, the determining, in the point cloud data, a set of consistent points located in the wear area includes:
在所述点云数据中查找连续的、损失函数小于预设值且符合预设长度的区段作为母线;Searching for a continuous segment in the point cloud data whose loss function is less than a preset value and conforms to a preset length as a busbar;
根据所述母线扩充一致点;Expand the coincidence point according to the busbar;
剔除所述一致点中的奇异点,得到初始点集;Eliminate singular points in the consistent points to obtain an initial point set;
利用所述损失函数对所述初始点集进行一致性评估;Using the loss function to evaluate the consistency of the initial point set;
在所述初始点集通过所述一致性评估时,将所述初始点集作为所述一致性点集。When the initial point set passes the consistency evaluation, the initial point set is used as the consistency point set.
在一些实施例中,所述在所述点云数据中查找连续的、损失函数小于预设值且符合预设长度的区段作为母线,包括:In some embodiments, the step of searching the point cloud data for continuous segments whose loss function is smaller than a preset value and conforms to a preset length as a busbar includes:
在所述点云数据中,由所述点云数据的中心向两端或由所述点云数据的两端向中心开始查找连续的、损失函数小于预设值且符合预设长度的区段作为母线。In the point cloud data, start from the center of the point cloud data to both ends or from the two ends of the point cloud data to the center to search for continuous segments whose loss function is less than a preset value and conforms to a preset length as a busbar.
在一些实施例中,所述根据所述母线扩充一致点,包括:In some embodiments, expanding the coincidence point according to the bus includes:
在所述母线的预设范围内,计算所述母线的预设范围内的点到所述母线的欧式距离;Within the preset range of the busbar, calculate the Euclidean distance from the point within the preset range of the busbar to the busbar;
若所述欧式距离小于预设距离,则将对应的点与所述母线组合,得到一致点。If the Euclidean distance is less than the preset distance, the corresponding point is combined with the bus bar to obtain a consistent point.
在一些实施例中,所述剔除所述一致点中的奇异点,得到初始点集,包括:In some embodiments, the culling of singular points in the consistent points to obtain an initial set of points, including:
剔除所述一致点中的包括离散点、孔洞斜纹干扰点中的至少一种奇异点,得到所述初始点集。At least one singular point including discrete points and hole twill interference points in the consistent points is eliminated to obtain the initial point set.
第二方面,本发明实施例提供了一种工件平面磨损的测量系统,所述系统包括:In a second aspect, an embodiment of the present invention provides a system for measuring plane wear of a workpiece, the system comprising:
支架;bracket;
激光器,固定于所述支架上,所述激光器向所述待检工件平面投射激光线;a laser, which is fixed on the bracket, and the laser projects a laser line to the plane of the workpiece to be inspected;
相机,固定于所述支架上,所述相机用于采集包含所述激光线的图像;a camera, fixed on the bracket, and the camera is used to collect an image containing the laser line;
至少一个处理器,以及at least one processor, and
存储器,所述存储器与所述至少一个处理器通信连接,所述存储器存储有可被所述至少一个处理器执行的指令,所述指令被所述至少一个处理器执行,以使所述至少一个处理器能够执行上述任一项所述的方法。a memory in communication with the at least one processor, the memory storing instructions executable by the at least one processor, the instructions being executed by the at least one processor to cause the at least one processor The processor is capable of performing any of the methods described above.
第三方面,本发明实施例提供了一种非易失性计算机可读存储介质,所述计算机可读存储介质存储有计算机可执行指令,当所述计算机可执行指令被工件平面磨损的测量系统执行时,使所述工件平面磨损的测量系统执行如上所述的方法。In a third aspect, embodiments of the present invention provide a non-volatile computer-readable storage medium, where the computer-readable storage medium stores computer-executable instructions, when the computer-executable instructions are worn by the workpiece plane measurement system When executed, the measurement system for flat wear of the workpiece executes the method as described above.
本发明实施例的工件平面磨损的测量方法和系统,采用激光测量技术,通 过在点云数据中确定位于磨损区域的一致性点集,根据所述一致性点集拟合出用于表示磨损区域的参考线,有效精准参考线;且根据所述参考线相对于x轴的斜率,确定旋转参考线,以使旋转参考线相对于所述x轴的斜率在包含0的区间内,有效精准旋转参考线;根据所述旋转参考线拟合磨损区,确定所述待测工件平面的磨损程度,从而极大的提高测量精度。The method and system for measuring plane wear of a workpiece according to the embodiments of the present invention use laser measurement technology to determine a set of consistent points located in the wear area in point cloud data, and fit a set of points representing the wear area according to the set of consistent points. and according to the slope of the reference line relative to the x-axis, determine the rotation reference line, so that the slope of the rotation reference line relative to the x-axis is within the interval including 0, and the effective and precise rotation Reference line; fit the wear area according to the rotation reference line, and determine the wear degree of the workpiece plane to be measured, thereby greatly improving the measurement accuracy.
附图说明Description of drawings
一个或多个实施例通过与之对应的附图中的图片进行示例性说明,这些示例性说明并不构成对实施例的限定,附图中具有相同参考数字标号的元件表示为类似的元件,除非有特别申明,附图中的图不构成比例限制。One or more embodiments are exemplified by the pictures in the corresponding drawings, and these exemplifications do not constitute limitations of the embodiments, and elements with the same reference numerals in the drawings are denoted as similar elements, Unless otherwise stated, the figures in the accompanying drawings do not constitute a scale limitation.
图1是本发明实施例工件平面磨损的测量系统的结构示意图;1 is a schematic structural diagram of a measuring system for plane wear of a workpiece according to an embodiment of the present invention;
图2是本发明工件平面磨损的测量方法的一个实施例的流程示意图;2 is a schematic flow chart of an embodiment of a method for measuring plane wear of a workpiece of the present invention;
图3是本发明工件平面磨损的测量方法的一个实施例的激光线图像的结构示意图;3 is a schematic structural diagram of a laser line image of an embodiment of the method for measuring plane wear of a workpiece of the present invention;
图4a是本发明工件平面磨损的测量方法的一个实施例的结构示意图;4a is a schematic structural diagram of an embodiment of a method for measuring plane wear of a workpiece of the present invention;
图4b是本发明工件平面磨损的测量方法的一个实施例的结构示意图;4b is a schematic structural diagram of an embodiment of a method for measuring plane wear of a workpiece of the present invention;
图5是本发明工件平面磨损的测量方法的一个实施例的结构示意图;5 is a schematic structural diagram of an embodiment of a method for measuring plane wear of a workpiece of the present invention;
图6a是本发明工件平面磨损的测量方法的一个实施例的结构示意图;6a is a schematic structural diagram of an embodiment of a method for measuring plane wear of a workpiece of the present invention;
图6b是本发明工件平面磨损的测量方法的一个实施例的结构示意图;6b is a schematic structural diagram of an embodiment of a method for measuring plane wear of a workpiece of the present invention;
图7a是本发明工件平面磨损的测量方法的一个实施例的结构示意图;7a is a schematic structural diagram of an embodiment of a method for measuring plane wear of a workpiece of the present invention;
图7b是本发明工件平面磨损的测量方法的一个实施例的结构示意图;7b is a schematic structural diagram of an embodiment of a method for measuring plane wear of a workpiece of the present invention;
图7c是本发明工件平面磨损的测量方法的一个实施例的结构示意图;7c is a schematic structural diagram of an embodiment of a method for measuring plane wear of a workpiece of the present invention;
图8是本发明工件平面磨损的测量方法的一个实施例的结构示意图;8 is a schematic structural diagram of an embodiment of a method for measuring plane wear of a workpiece of the present invention;
图9是本发明工件平面磨损的测量系统的一个实施例中控制器的硬件结构示意图。FIG. 9 is a schematic diagram of the hardware structure of the controller in an embodiment of the workpiece plane wear measurement system of the present invention.
具体实施方式Detailed ways
为使本发明实施例的目的、技术方案和优点更加清楚,下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。In order to make the purposes, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments These are some embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.
本发明实施例提供的工件平面磨损的测量系统的结构示意图。如图1所示,工件平面磨损的测量系统10包括支架;激光器14,固定于所述支架上,所述激光器14向所述待检工件平面投射激光线;A schematic structural diagram of a measurement system for workpiece plane wear provided by an embodiment of the present invention. As shown in FIG. 1 , the measurement system 10 for the plane wear of the workpiece includes a bracket; a laser 14 is fixed on the bracket, and the laser 14 projects a laser line to the plane of the workpiece to be inspected;
相机15,固定于所述支架上,所述相机15用于采集包含所述激光线的图像。The camera 15 is fixed on the bracket, and the camera 15 is used for collecting images including the laser lines.
工件平面磨损的测量系统10还可以包括显示设备16,用于显示磨损程度;The measurement system 10 of workpiece plane wear may also include a display device 16 for displaying the degree of wear;
电源17,用于给激光器14、相机15及主控中心供电。The power supply 17 is used to supply power to the laser 14, the camera 15 and the main control center.
可以理解的是,工件平面磨损的测量系统10中,可实施在PC、嵌入式系统、手持设备、工业控制机等多种环境,工件平面磨损的测量系统10设置有控制器,作为主控中心,精确未磨损点和磨损区域,从而提高对工件平面磨损程度的测量精度。It can be understood that the workpiece plane wear measurement system 10 can be implemented in various environments such as PCs, embedded systems, handheld devices, industrial control machines, etc. The workpiece plane wear measurement system 10 is provided with a controller as the main control center. , Accurate non-wear points and wear areas, thereby improving the measurement accuracy of the level of wear on the workpiece plane.
请参阅图2,图2为本发明实施例提供的工件平面磨损的测量方法的流程示意图,所述方法可以由工件平面磨损的测量系统10中的控制器13执行,所述方法包括:Please refer to FIG. 2. FIG. 2 is a schematic flowchart of a method for measuring plane wear of a workpiece provided by an embodiment of the present invention. The method can be executed by the controller 13 in the measuring system 10 for plane wear of a workpiece, and the method includes:
101:向待检测工件平面投射激光线,并获取包含所述激光线的图像。101: Project a laser line to the plane of the workpiece to be inspected, and acquire an image including the laser line.
在对待检工件进行工件平面磨损测量时,利用激光器向所述待检工件平面投射激光线,且利用相机采集包含所述激光线的图像。其中,待检测工件包括刹车盘等具有长时间使用后出现磨损特性的工件。待检测工件中的待检测面大体成平面。When the workpiece plane wear measurement is performed on the workpiece to be inspected, a laser is used to project a laser line to the plane of the workpiece to be inspected, and a camera is used to capture an image including the laser line. The workpieces to be detected include brake discs and other workpieces that have wear characteristics after long-term use. The surface to be inspected in the workpiece to be inspected is substantially flat.
102:根据所述图像获取所述激光线相关的点云数据;所述点云数据为所述激光线投射在所述待检测工件平面的坐标数据序列Dn;其中,Dn={d 1(x 1,y 1)……dn(x n,y n)},n为正整数,d n(x n,y n)表示所述激光线上的激光点d n投射在所述待检测工件平面的坐标,x n表示以所述激光线的长度方向作为x轴时,激光点d n对应的x轴坐标,y n表示以所述激光线设在所述待检测工件平面的深度方向作为y轴时,激光点d n对应的y轴坐标。 102: Acquire point cloud data related to the laser line according to the image; the point cloud data is the coordinate data sequence Dn projected by the laser line on the plane of the workpiece to be detected; wherein, Dn={d 1 (x 1 , y 1 )...dn(x n , y n )}, n is a positive integer, d n (x n , y n ) indicates that the laser point d n on the laser line is projected on the plane of the workpiece to be detected x n represents the x-axis coordinate corresponding to the laser point d n when the length direction of the laser line is taken as the x-axis, y n represents the depth direction of the laser line set on the plane of the workpiece to be detected as y axis, the y-axis coordinate corresponding to the laser point d n .
在一些实施例中,获取的包含激光线的图像如图3所示,该图像包括黑色的背景区以及区别于黑色背景区的高亮显示的激光线区域,根据高亮显示的激光线区域确定用于代表激光线坐标的点云数据。In some embodiments, the acquired image including the laser line is shown in FIG. 3 , the image includes a black background area and a highlighted laser line area that is different from the black background area, and is determined according to the highlighted laser line area Point cloud data used to represent laser line coordinates.
在一些实施例中,高亮显示的激光线区域可以分为边缘区域和测量区,边缘区域又可称为边缘干扰区域,如图4a所示,其中,边缘区域的激光线对待检测工件磨损程度的测量并无贡献,如对其作为考量,会影响测量精度,因此,可以对激光线区域做进一步处理,识别并剔除边缘区域,仅保留测量区域用作后续的磨损程度确定。剔除边缘区域的像素点可以利用相邻点距离判定法、排序法、回弹检测法等。In some embodiments, the highlighted laser line area can be divided into an edge area and a measurement area, and the edge area can also be called an edge interference area, as shown in FIG. 4a, wherein the laser line in the edge area is to be tested for the wear degree of the workpiece Therefore, the laser line area can be further processed, the edge area can be identified and eliminated, and only the measurement area is reserved for subsequent wear degree determination. The pixel points in the edge area can be eliminated by the adjacent point distance judgment method, the sorting method, the rebound detection method, and the like.
具体的,相邻点距离判定法,由于边缘区和测量区在激光线投射方向距离比较远,变化比较剧烈,在激光线区域获取的点云数据中,边缘区通常与测量区段有较大的距离,而在测量区段内部通常距离比较小,因此可以通过距离差异分离出边缘区段。Specifically, in the method of judging the distance between adjacent points, since the distance between the edge area and the measurement area is relatively far in the projection direction of the laser line, the change is relatively severe. In the point cloud data obtained from the laser line area, the edge area is usually larger than the measurement area. The distance is usually smaller inside the measurement section, so the edge section can be separated by the distance difference.
排序法,由于边缘区段在横坐标方向上的点的坐标的先后顺序与测量区在横坐标方向上的点集顺序不一致,因此可以通过这个特性分离出边缘区段,如图4a所示,分离出左边为边缘区段。In the sorting method, since the order of the coordinates of the points in the abscissa direction of the edge section is inconsistent with the order of the point sets in the measurement area in the abscissa direction, the edge section can be separated by this feature, as shown in Figure 4a, Separate the left edge segment.
回弹检测法,如图4b所示,低于参考线的第一个最低点通常不是参考点,是背景激光线中边缘干扰产生的干扰数据,需要剔除。In the rebound detection method, as shown in Figure 4b, the first lowest point lower than the reference line is usually not the reference point, but the interference data generated by the edge interference in the background laser line, which needs to be eliminated.
在剔除边缘干扰数据后,可以判定有效参考点在靠近点云中心的位置,在纵坐标方向上具有较大回弹的特征,可以根据这个特征识别出如图4b中的有效参考点。After removing the edge interference data, it can be determined that the effective reference point is close to the center of the point cloud, and has the feature of large rebound in the ordinate direction. According to this feature, the effective reference point as shown in Figure 4b can be identified.
如图6b右侧所示,还存在不完备参考点,当参考点没有拍完全时,点云数据不完整,存在残缺,不完备参考点的位置通常处于点云数据序列的边缘,且点之间的纵向距离比较大,相邻点比较少,可以根据上述特征来进行识别不完备参考点,在识别到不完备参考点后,不能将不完备参考点作为点云磨损检测的参考点,同样需要剔除。As shown on the right side of Figure 6b, there are still incomplete reference points. When the reference point is not completely captured, the point cloud data is incomplete and incomplete. The position of the incomplete reference point is usually at the edge of the point cloud data sequence, and the point cloud data is incomplete. The longitudinal distance between them is relatively large, and the adjacent points are relatively small. The incomplete reference points can be identified according to the above characteristics. After the incomplete reference points are identified, the incomplete reference points cannot be used as the reference point for point cloud wear detection. Similarly, need to be removed.
在图4a,图4b中,图像映射到坐标系中横坐标为激光线的长度方向,纵坐标为激光线在待检测工件平面的深度。在确定出测量区后,可仅对测量区的图像进行处理分析,确定测量区的激光线映射在坐标系中的点云数据。具体的,例如可以采用灰度重心法解析激光线在测量区的像素坐标,所述像素坐标的计算公式参考公式1:In Fig. 4a and Fig. 4b, the image is mapped to the coordinate system in which the abscissa is the length direction of the laser line, and the ordinate is the depth of the laser line on the plane of the workpiece to be inspected. After the measurement area is determined, only the image of the measurement area can be processed and analyzed to determine the point cloud data of the laser line in the measurement area mapped in the coordinate system. Specifically, for example, the gray-scale centroid method can be used to analyze the pixel coordinates of the laser line in the measurement area. For the calculation formula of the pixel coordinates, refer to Formula 1:
Figure PCTCN2021130178-appb-000004
Figure PCTCN2021130178-appb-000004
其中,W(i,j)表示图像像素的灰度权值,i、j分别表示该像素的横向坐标和纵向坐标,S表示目标区域,S(x 0,y 0)表示目标区域的中心的像素坐标,k为正整数,表示第k个点。 Among them, W(i, j) represents the grayscale weight of the image pixel, i, j represent the horizontal and vertical coordinates of the pixel respectively, S represents the target area, and S(x 0 , y 0 ) represents the center of the target area. Pixel coordinates, k is a positive integer, indicating the kth point.
灰度重心法可以看成是灰度平方为权值的加权型心法,利用灰度重心法,不需要对图像进行二值化,在目标和背景具有较大的灰阶差距时具有良好的定位效果。The gray-scale centroid method can be regarded as a weighted centroid method with the gray square as the weight. Using the gray-scale centroid method does not need to binarize the image, and has good results when the target and the background have a large grayscale gap. positioning effect.
可以理解的是,激光线的提取,不局限于灰度重心法的方式提取,也可以采用其他非灰度重心法的方式,如型心法等。It can be understood that the extraction of the laser line is not limited to the extraction by the gray-scale centroid method, and other methods other than the gray-scale centroid method, such as the centroid method, can also be used.
从所述图像中提取出像素坐标S(x 0,y 0)后,通过投影变换,将所述像素坐标转换为相机坐标,从而转换为激光线所在的坐标,参考公式2: After the pixel coordinates S(x 0 , y 0 ) are extracted from the image, the pixel coordinates are converted into camera coordinates through projection transformation, so as to be converted into coordinates where the laser line is located, with reference to formula 2:
Figure PCTCN2021130178-appb-000005
Figure PCTCN2021130178-appb-000005
其中,
Figure PCTCN2021130178-appb-000006
表示相机坐标在3D平面的三个坐标,A表示相机内参矩阵,C表示相机坐标,u表示像素坐标横向方向,v表示像素坐标纵向方向,且u和v均为标量。
in,
Figure PCTCN2021130178-appb-000006
Represents the three coordinates of the camera coordinates in the 3D plane, A represents the camera internal parameter matrix, C represents the camera coordinates, u represents the horizontal direction of the pixel coordinates, v represents the vertical direction of the pixel coordinates, and both u and v are scalars.
投影变换方向可以改变,参考点在上方,磨损区在下方,如图7中a图所示。The direction of the projection transformation can be changed, the reference point is above, and the wear area is below, as shown in Figure 7a.
在得到相机坐标后,将相机坐标转换成激光坐标,如公式3所示:After getting the camera coordinates, convert the camera coordinates into laser coordinates, as shown in Equation 3:
Figure PCTCN2021130178-appb-000007
Figure PCTCN2021130178-appb-000007
其中,
Figure PCTCN2021130178-appb-000008
表示相机坐标系的三个坐标,
Figure PCTCN2021130178-appb-000009
表示激光坐标系的三个坐标,R表示旋转变化矩阵,C表示相机坐标系,L表示激光坐标系,且相机坐标系与激光坐标系坐标原点重合。
in,
Figure PCTCN2021130178-appb-000008
Three coordinates representing the camera coordinate system,
Figure PCTCN2021130178-appb-000009
Represents the three coordinates of the laser coordinate system, R represents the rotation change matrix, C represents the camera coordinate system, L represents the laser coordinate system, and the camera coordinate system and the laser coordinate system coordinate origin coincide.
在转换为激光坐标后,由于点云数据为3D激光坐标系,因此,基于3d激光坐标系,仅仅保留激光线方向和激光投射方向的坐标,得到2d点云数据,如图5所示,得到激光线投射在所述待检测工件平面的坐标数据序列D n;其中,Dn={d 1(x 1,y 1)……d n(x n,y n)},n为正整数,d n(x n,y n)表示所述激光线上的激光点d n投射在所述待检测工件平面的坐标,x n表示以所述激光线的长度方向作为x轴时,激光点d n对应的x轴坐标,y n表示以所述激光线设在所述待检测工件平面的深度方向作为y轴时,激光点d n对应的y轴坐标。例如,如图5中所示,水平方向标识x轴方向,竖直方向标识y轴方向。其中,如图4a中图像至横纵坐标的映射关系,或者图4b中坐标图,可以理解为点云数据的点云图或者点云数据的坐标图,其用于标明点云数据的横纵坐标值。 After converting to laser coordinates, since the point cloud data is a 3D laser coordinate system, based on the 3d laser coordinate system, only the coordinates of the laser line direction and the laser projection direction are retained, and the 2d point cloud data is obtained, as shown in Figure 5. The coordinate data sequence D n of the laser line projected on the plane of the workpiece to be detected; wherein, Dn={d 1 (x 1 , y 1 )...d n (x n , y n )}, n is a positive integer, d n (x n , y n ) represents the coordinates of the laser point d n on the laser line projected on the plane of the workpiece to be detected, and x n represents the laser point d n when the length direction of the laser line is taken as the x-axis The corresponding x-axis coordinate, y n represents the y-axis coordinate corresponding to the laser point d n when the depth direction of the laser line is set on the plane of the workpiece to be detected as the y-axis. For example, as shown in FIG. 5, the horizontal direction identifies the x-axis direction, and the vertical direction identifies the y-axis direction. Among them, the mapping relationship between the image and the horizontal and vertical coordinates in Figure 4a, or the coordinate diagram in Figure 4b, can be understood as the point cloud map of the point cloud data or the coordinate map of the point cloud data, which is used to indicate the horizontal and vertical coordinates of the point cloud data. value.
103:在所述点云数据中确定位于磨损区域的一致性点集DS n;其中,DS n为D n的子集。 103: Determine, in the point cloud data, a set of consistent points DS n located in the wear area; where DS n is a subset of D n .
如图5所示,由于相机拍摄角度可能存在倾斜,在点云图中,点云在横坐标方向不平行于横坐标轴,从原始的点云数据中查找测量点和参考点会比较困难,因此,需要把点云数据旋转成与横坐标平行的数据。As shown in Figure 5, since the camera shooting angle may be inclined, in the point cloud image, the point cloud is not parallel to the abscissa axis in the abscissa direction, and it is difficult to find the measurement point and reference point from the original point cloud data. Therefore, , the point cloud data needs to be rotated into data parallel to the abscissa.
在其中一些实施例中,所述在所述点云数据中确定位于磨损区域的一致性点集,包括:In some of the embodiments, the determining, in the point cloud data, a set of consistent points located in the wear area includes:
31:在所述点云数据中查找连续的、损失函数小于预设值且符合预设长度的区段作为母线。31: Search for a continuous segment in the point cloud data with a loss function smaller than a preset value and conforming to a preset length as a busbar.
在母线探索时,由于在磨损区,大部分位置磨损程度比较接近,因此,可以认为这些点都处于某条直线附近,可以在所述点云数据中,由所述点云数据的中心向两端或由所述点云数据的两端向中心开始查找连续的、损失函数小于预设值且符合预设长度的区段作为母线。During busbar exploration, since most of the positions in the wear area are relatively close in degree of wear, it can be considered that these points are all near a certain straight line. In the point cloud data, from the center of the point cloud data to the two The end or from the two ends of the point cloud data to the center to search for a continuous segment whose loss function is less than a preset value and conforms to a preset length as a busbar.
具体地,损失函数按照公式4计算:Specifically, the loss function is calculated according to Equation 4:
Figure PCTCN2021130178-appb-000010
Figure PCTCN2021130178-appb-000010
其中,m和n均为正整数,表示第m个凹槽,有n个点,计算点到直线的平均欧式距离最短作为评估准则,k表示点集拟合直线的斜率,通过y=kx+b点斜表示该拟合直线。母线一般优选点云位置中心附近的点,因为该位置磨损程度一般比较接近。如果磨损区中心附近搜索不到适合的母线,可以分别从点云数据的两端搜索。母线的初始长度也很关键,太短则一致性不好,太长则查找失败概率高,本方案优选预设长度为10mm的搜索长度。Among them, m and n are both positive integers, representing the mth groove, with n points, the shortest average Euclidean distance from the point to the straight line is calculated as the evaluation criterion, k represents the slope of the straight line fitted by the point set, through y=kx+ Point b obliquely represents the fitted straight line. The busbar is generally preferred to the point near the center of the point cloud position, because the degree of wear at this position is generally close. If there is no suitable busbar near the center of the wear area, you can search from both ends of the point cloud data. The initial length of the busbar is also critical. If it is too short, the consistency will be poor. If it is too long, the search failure probability will be high. In this scheme, the preset search length is preferably 10mm.
32:根据所述母线扩充一致点。32: Expand the coincidence point according to the busbar.
在其中一些实施例中,根据所述母线扩充一致性,可以包括:In some of these embodiments, according to the bus expansion consistency, it may include:
在所述母线的预设范围内,计算所述母线的预设范围内的点到所述母线的欧式距离;Within the preset range of the busbar, calculate the Euclidean distance from the point within the preset range of the busbar to the busbar;
若所述欧式距离小于预设距离,则将对应的点与所述母线组合,得到一致点。If the Euclidean distance is less than the preset distance, the corresponding point is combined with the bus bar to obtain a consistent point.
可以划定一块搜索范围,作为母线的预设范围,然后,计算该预设范围内的点到母线的欧式距离,如果欧式距离小于预设距离,则将对应的点与母线组合,如果欧式距离大于预设距离,说明点离得较远,则跨越这些点。A search range can be defined as the preset range of the bus, and then the Euclidean distance from the points within the preset range to the bus is calculated. If the Euclidean distance is less than the preset distance, the corresponding point and the bus will be combined. If the Euclidean distance If it is greater than the preset distance, it means that the points are farther apart, and then these points are crossed.
根据欧式距离及预设距离,搜索到预设范围内与母线一致性比较好的点,从而有效扩充一致点。According to the Euclidean distance and the preset distance, a point with good consistency with the busbar within the preset range is searched, so as to effectively expand the consistent point.
可以理解的是,在扩充一致点时,还可以采用非平均欧式距离的其它方法,只要能有效扩充一致点的方式,均为本案的简单变形和变换,落入本案保护的范围内。It is understandable that other methods of non-average Euclidean distance can also be used when expanding the consistent points. As long as the methods can effectively expand the consistent points, they are all simple deformations and transformations of this case, and fall within the scope of protection in this case.
33:剔除所述一致点中的奇异点,得到初始点集。33: Eliminate singular points in the consistent points to obtain an initial point set.
在实际应用中,磨损区域可能包含孔洞、花纹,或者边缘反光等奇异点,他们都会引起点云数据的畸变。因此,在搜索一致性点时,剔除所述一致点中的包括离散点、孔洞斜纹干扰点中的至少一种奇异点,得到所述初始点集。In practical applications, the worn area may contain holes, patterns, or singularities such as edge reflections, which will cause distortion of the point cloud data. Therefore, when searching for consistent points, at least one singular point including discrete points and hole twill interference points in the consistent points is eliminated to obtain the initial point set.
如图6a和图7c所示,离散点通常由于待检测工件平面不均匀、目标反光、杂波等引起点云数据可能会误判成参考点,因此,在分析点云数据时,需要剔除,剔除原则通常根据点集数量、梯度变化、数据位置等因素考虑。As shown in Figure 6a and Figure 7c, discrete points may be misjudged as reference points due to uneven plane of the workpiece to be detected, target reflection, clutter, etc. The point cloud data may be misjudged as a reference point. The culling principle is usually considered based on factors such as the number of point sets, gradient changes, and data locations.
如图7b和7c所示,孔洞斜纹的干扰,通常是待检测工件平面中磨损平面的孔洞或者花纹,将会对激光线连续性产生影响,或者激光线点云会产生畸变,因此,需要剔除孔洞斜纹干扰点。孔洞或斜纹,在激光线投射方向的深度通常比磨损区大,在点云数据中坐标通常在参考线之上,且宽度受限,变化比较剧烈,通过上述特征,可以识别出孔洞或者斜纹,然后将孔洞斜纹干扰点剔除点。As shown in Figures 7b and 7c, the interference of the hole twill, usually the hole or pattern of the worn plane in the plane of the workpiece to be detected, will affect the continuity of the laser line, or the point cloud of the laser line will be distorted. Therefore, it needs to be eliminated. Hole twill interference point. The depth of holes or twill lines in the projection direction of the laser line is usually larger than that of the wear area. In the point cloud data, the coordinates are usually above the reference line, and the width is limited, and the changes are relatively drastic. Through the above characteristics, holes or twill lines can be identified. Then remove the hole twill interference point.
34:利用所述损失函数对所述初始点集进行一致性评估。34: Use the loss function to perform consistency evaluation on the initial point set.
在得到初始点集后,利用损失函数对初始点集进行一致性评估,计算初始点集中各个点与母线的平均欧式距离,根据平均欧式距离确定初始点集中的点是否通过一致性评估。After obtaining the initial point set, use the loss function to evaluate the consistency of the initial point set, calculate the average Euclidean distance between each point in the initial point set and the bus, and determine whether the points in the initial point set pass the consistency evaluation according to the average Euclidean distance.
35:在所述初始点集通过所述一致性评估时,将所述初始点集作为所述一致性点集。35: When the initial point set passes the consistency evaluation, use the initial point set as the consistency point set.
在初始点集中各个点与母线的平均欧式距离符合预设距离时,可以判定初始点集通过所述一致性评估,从而将通过一致性评估的初始点集作为一致性点集。When the average Euclidean distance between each point in the initial point set and the busbar conforms to the preset distance, it can be determined that the initial point set passes the consistency evaluation, so that the initial point set that passes the consistency evaluation is used as the consistency point set.
在初始点集中存在点与母线的平均欧式距离不符合预设距离时,循环剔除一致点中的奇异点的步骤,直至初始点集中所有的点均通过一致性评估。When the average Euclidean distance between the points in the initial point set and the bus bar does not meet the preset distance, the steps of eliminating singular points in the consistent points are looped until all the points in the initial point set pass the consistency evaluation.
104:根据所述一致性点集拟合出用于表示磨损区域的参考线f(x,y)。104: Fit a reference line f(x, y) for representing the wear area according to the set of consistency points.
在查找出一致性点集后,通过拟合的方法计算出用于表示磨损区域的参考线f(x,y)。通常该参考线f(x,y)为一直线或二次曲线。一种情形下,由于相机拍摄角度可能存在倾斜,因此参考线f(x,y)可能相较于x轴存在一夹角,即参考线f(x,y)存在一斜率k,该斜率有可能会影响确定磨损深度等磨损程度的精度,因此,在确定磨损程度之前,应消除该斜率k的影响,使参考线大致平行于x轴。After finding the consistent point set, the reference line f(x, y) used to represent the wear area is calculated by fitting. Usually the reference line f(x,y) is a straight line or a quadratic curve. In one case, since the camera shooting angle may be inclined, the reference line f(x,y) may have an included angle compared with the x-axis, that is, the reference line f(x,y) has a slope k, and the slope has May affect the accuracy of determining the degree of wear such as depth of wear, so before determining the degree of wear, the influence of this slope k should be eliminated so that the reference line is roughly parallel to the x-axis.
105:根据所述参考线f(x,y)相对于所述x轴的斜率,确定旋转参考线f'(x',y'),以使所述旋转参考线f'(x',y')相对于所述x轴的斜率在包含0的区间内。105: Determine a rotation reference line f'(x', y') according to the slope of the reference line f(x, y) relative to the x-axis, so that the rotation reference line f'(x', y ') with respect to the slope of the x-axis in an interval containing 0.
通过拟合的方法计算出用于表示磨损区域的参考线f(x,y)。参考线f(x,y)的斜率为k,根据所述参考线f(x,y)相对于所述x轴的斜率k,确定旋转参考线f'(x',y')根据旋转公式计算,旋转公式如公式5:The reference line f(x, y) used to represent the wear area is calculated by the method of fitting. The slope of the reference line f(x, y) is k, and according to the slope k of the reference line f(x, y) relative to the x-axis, the rotation reference line f'(x', y') is determined according to the rotation formula Calculation, the rotation formula is as formula 5:
Figure PCTCN2021130178-appb-000011
Figure PCTCN2021130178-appb-000011
其中,
Figure PCTCN2021130178-appb-000012
为所述旋转参考线f'(x',y')中各点的坐标,
Figure PCTCN2021130178-appb-000013
为所述参考线f(x,y)中各点的坐标,k为所述参考线f(x,y)相对于所述x轴的斜率,θ为所述参考线f(x,y)相对于所述x轴的旋转角度。
in,
Figure PCTCN2021130178-appb-000012
is the coordinate of each point in the rotation reference line f'(x', y'),
Figure PCTCN2021130178-appb-000013
is the coordinate of each point in the reference line f(x, y), k is the slope of the reference line f(x, y) relative to the x-axis, θ is the reference line f(x, y) The angle of rotation relative to the x-axis.
在坐标变换后,可以利用变换后的坐标点集模拟旋转参考线,可以将其模拟为二次曲线或直线,在此不予限定。在模拟的旋转参考线中,任意一线端的斜率为0或者小于允许阈值,从而实现旋转参考线大致平行于点云图的x轴。After the coordinate transformation, the transformed coordinate point set can be used to simulate the rotation reference line, which can be simulated as a quadratic curve or a straight line, which is not limited here. In the simulated rotation reference line, the slope of any line end is 0 or less than the allowable threshold, so that the rotation reference line is roughly parallel to the x-axis of the point cloud.
旋转参考线,通常可以采用二次曲线,与实际磨损情况较为接近,满足应用需求。The rotation reference line, usually a quadratic curve can be used, which is closer to the actual wear situation and meets the application requirements.
如图7中a图所示,为旋转后的点云图。As shown in Figure a in Figure 7, it is the rotated point cloud.
106:根据所述旋转参考线,确定所述待测工件平面的磨损程度。106: Determine the wear degree of the plane of the workpiece to be measured according to the rotation reference line.
在其中一些实施例中,根据所述旋转参考线,确定所述待测工件平面的磨损程度,可以包括:In some of the embodiments, determining the degree of wear of the plane of the workpiece to be measured according to the rotation reference line may include:
在所述旋转参考线所在的区域确定未磨损点;determining an unworn point in the area where the rotation reference line is located;
根据所述未磨损点和所述旋转参考线,确定磨损深度。Based on the unworn point and the rotation reference line, the depth of wear is determined.
具体地,如图7a所示,磨损区域通常占据比较大的区域,在所述旋转参 考线所在的区域确定未磨损点,可以包括:搜索低于所述旋转参考线的区域的最低点作为未磨损点。然后,根据所述未磨损点和所述旋转参考线,确定磨损深度。Specifically, as shown in FIG. 7a, the worn area usually occupies a relatively large area, and determining an unworn point in the area where the rotation reference line is located may include: searching for the lowest point of the area lower than the rotation reference line as the unworn point wear point. Then, based on the unworn point and the rotation reference line, the wear depth is determined.
在其中一些实施方式中,根据所述未磨损点和所述旋转参考线,确定磨损深度,可以包括:In some of the embodiments, determining the wear depth according to the unworn point and the rotation reference line may include:
从所述未磨损点,向所述一致性点集的中心查找,将在所述旋转参考线的预设范围内的点作为磨损点;Searching from the unworn point to the center of the consistent point set, and taking the point within the preset range of the rotation reference line as the wear point;
根据所述磨损点及所述未磨损点,确定磨损深度。According to the worn point and the unworn point, the wear depth is determined.
磨损区域通常占据比较大的区域,从未磨损点即参考线向一致性点集的中心开始查找,将旋转参考线附近或者是旋转参考线之上的点作为磨损点。The worn area usually occupies a relatively large area, and the search starts from the unworn point, that is, the reference line, to the center of the consistency point set, and the point near the rotation reference line or above the rotation reference line is used as the wear point.
在其中一些实施方式中,根据所述磨损点及所述未磨损点,确定磨损深度,可以包括:In some of the embodiments, the wear depth is determined according to the wear point and the non-wear point, which may include:
根据所述未磨损点和所述磨损点,确定最大磨损程度、平均磨损程度或磨损一致性中的至少一种磨损程度。According to the unworn point and the worn point, at least one of a maximum wear degree, an average wear degree or a wear consistency is determined.
在其中一些实施方式中,确定磨损一致性,包括:In some of these embodiments, determining wear uniformity includes:
根据所述磨损点,确定磨损区域;According to the wear point, determine the wear area;
根据所述参考线的曲率和所述磨损区域对应的点集的离散性确定所述磨损一致性信息;determining the wear consistency information according to the curvature of the reference line and the discreteness of the point set corresponding to the wear area;
输出所述磨损一致性信息。The wear consistency information is output.
多个磨损点的集合,可以确定为磨损区域,参考线的曲率越小,一致性越好,点集的离散性越小,一致性越好,可以用公式4来判定点集的离散性。The set of multiple wear points can be determined as the wear area. The smaller the curvature of the reference line, the better the consistency, and the smaller the discreteness of the point set, the better the consistency. Equation 4 can be used to determine the discreteness of the point set.
在确定磨损一致性信息后,输出磨损一致性信息,使得用户可以得到一致性信息。After the wear consistency information is determined, the wear consistency information is output so that the user can obtain the consistency information.
在其中一些实施方式中,确定最大磨损程度,包括:In some of these embodiments, determining the maximum degree of wear includes:
获取所述磨损点的坐标信息;obtain the coordinate information of the wear point;
在所述磨损点的纵坐标为最大值时,确定所述磨损点为最大磨损点;When the ordinate of the wear point is the maximum value, determining the wear point as the maximum wear point;
输出所述最大磨损点对应的坐标信息,作为最大磨损信息。The coordinate information corresponding to the maximum wear point is output as the maximum wear information.
如图8所示,图8中纵坐标最大的位置,可以认为是最大磨损点,对应的区域,那么,输出最大磨损点对应的坐标信息,使用户得到该最大磨损点信息。As shown in FIG. 8 , the position with the largest ordinate in FIG. 8 can be considered as the maximum wear point and the corresponding area, then the coordinate information corresponding to the maximum wear point is output, so that the user can obtain the maximum wear point information.
在其中一些实施方式中,在所述根据所述未磨损点和所述旋转参考线,确定磨损深度之后,所述方法还包括:In some of the embodiments, after determining the wear depth according to the unworn point and the rotation reference line, the method further includes:
在所述磨损深度超过预设磨损程度时,输出提示用户更换所述待检工件的提示信息。When the wear depth exceeds a preset wear degree, output prompt information prompting the user to replace the workpiece to be inspected.
可以设定一个预设磨损程度,当超过预设磨损程度时,说明该工件磨损太厉害,不便于继续使用,输出提示用户更换该待检工件的提示信息。A preset wear degree can be set. When the preset wear degree exceeds the preset wear degree, it means that the workpiece is too worn and it is inconvenient for continued use, and a prompt message prompting the user to replace the workpiece to be inspected is output.
本发明实施例采用激光测量技术,用智能化的方法进行平面磨损测量,采用局部查找的方式,通过在点云数据中确定位于磨损区域的一致性点集,根据所述一致性点集拟合出用于表示磨损区域的参考线,有效精准参考线;且根据 所述参考线相对于x轴的斜率,确定旋转参考线,以使旋转参考线相对于所述x轴的斜率在包含0的区间内,有效精准旋转参考线;根据所述旋转参考线,确定所述待测工件平面的磨损程度,从而极大的提高测量精度,且本发明实施例能够满足绝大部分场景的测量需求。In the embodiment of the present invention, laser measurement technology is used, and an intelligent method is used to measure plane wear, and a local search method is used to determine the set of consistent points located in the wear area in the point cloud data, and fit the set according to the set of consistent points. The reference line used to represent the wear area is effectively accurate reference line; and the rotation reference line is determined according to the slope of the reference line relative to the x-axis, so that the slope of the rotation reference line relative to the x-axis is within the range including 0. In the interval, the reference line is effectively and accurately rotated; according to the rotation reference line, the wear degree of the workpiece plane to be measured is determined, thereby greatly improving the measurement accuracy, and the embodiment of the present invention can meet the measurement requirements of most scenarios.
图9为工件平面磨损的测量系统10的一个实施例中控制器的硬件结构示意图,如图9所示,控制器13包括:9 is a schematic diagram of the hardware structure of the controller in an embodiment of the workpiece plane wear measurement system 10. As shown in FIG. 9, the controller 13 includes:
一个或多个处理器131、存储器132。图9中以一个处理器131、一个存储器132为例。One or more processors 131 , memory 132 . In FIG. 9 , one processor 131 and one memory 132 are used as examples.
处理器131、存储器132可以通过总线或者其他方式连接,图9中以通过总线连接为例。The processor 131 and the memory 132 may be connected by a bus or in other ways, and the connection by a bus is taken as an example in FIG. 9 .
存储器132作为一种非易失性计算机可读存储介质,可用于存储非易失性软件程序、非易失性计算机可执行程序以及模块,如本申请实施例中的工件平面磨损的测量方法对应的程序指令/模块。处理器131通过运行存储在存储器132中的非易失性软件程序、指令以及模块,从而执行控制器的各种功能应用以及数据处理,即实现上述方法实施例的工件平面磨损的测量方法。As a non-volatile computer-readable storage medium, the memory 132 can be used to store non-volatile software programs, non-volatile computer-executable programs and modules, such as corresponding to the method for measuring the plane wear of the workpiece in the embodiment of the present application. program instructions/modules. The processor 131 executes various functional applications and data processing of the controller by running the non-volatile software programs, instructions and modules stored in the memory 132, that is, to implement the method for measuring the plane wear of the workpiece in the above method embodiments.
存储器132可以包括存储程序区和存储数据区,其中,存储程序区可存储操作系统、至少一个功能所需要的应用程序;存储数据区可存储根据工件平面磨损的测量系统的使用所创建的数据等。此外,存储器132可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件、闪存器件、或其他非易失性固态存储器件。在一些实施例中,存储器132可选包括相对于处理器131远程设置的存储器,这些远程存储器可以通过网络连接至工件平面磨损的测量系统。上述网络的实例包括但不限于互联网、企业内部网、局域网、移动通信网及其组合。The memory 132 may include a stored program area and a stored data area, wherein the stored program area may store an operating system, an application program required for at least one function; the stored data area may store data created according to the use of a measurement system for workpiece plane wear, etc. . Additionally, memory 132 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some embodiments, the memory 132 may optionally include memory located remotely from the processor 131, and these remote memories may be connected via a network to the workpiece flat wear measurement system. Examples of such networks include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.
所述一个或者多个模块存储在所述存储器132中,当被所述一个或者多个处理器131执行时,执行上述任意方法实施例中的工件平面磨损的测量方法,例如,执行以上描述的图2中的方法步骤101至步骤106。The one or more modules are stored in the memory 132, and when executed by the one or more processors 131, execute the method for measuring the plane wear of the workpiece in any of the above method embodiments, for example, execute the above-described method Method steps 101 to 106 in FIG. 2 .
上述产品可执行本申请实施例所提供的方法,具备执行方法相应的功能模块和有益效果。未在本实施例中详尽描述的技术细节,可参见本申请实施例所提供的方法。The above product can execute the method provided by the embodiments of the present application, and has functional modules and beneficial effects corresponding to the execution method. For technical details not described in detail in this embodiment, reference may be made to the methods provided in the embodiments of this application.
本申请实施例提供了一种非易失性计算机可读存储介质,所述计算机可读存储介质存储有计算机可执行指令,该计算机可执行指令被一个或多个处理器执行,例如图9中的一个处理器131,可使得上述一个或多个处理器可执行上述任意方法实施例中的工件平面磨损的测量方法,例如,执行以上描述的图2中的方法步骤101至步骤106。Embodiments of the present application provide a non-volatile computer-readable storage medium, where the computer-readable storage medium stores computer-executable instructions, and the computer-executable instructions are executed by one or more processors, for example, in FIG. 9 A processor 131 of the above-mentioned one or more processors can execute the method for measuring the plane wear of the workpiece in any of the above-mentioned method embodiments, for example, to execute the above-described method steps 101 to 106 in FIG. 2 .
以上所描述的装置实施例仅仅是示意性的,其中所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也 可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部模块来实现本实施例方案的目的。The device embodiments described above are only illustrative, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in One place, or it can be distributed over multiple network elements. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution in this embodiment.
通过以上的实施例的描述,本领域普通技术人员可以清楚地了解到各实施例可借助软件加通用硬件平台的方式来实现,当然也可以通过硬件。本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程是可以通过计算机程序来指令相关的硬件来完成,所述的程序可存储于一计算机可读取存储介质中,该程序在执行时,可包括如上述各方法的实施例的流程。其中,所述的存储介质可为磁碟、光盘、只读存储记忆体(Read-Only Memory,ROM)或随机存储记忆体(RandomAccessMemory,RAM)等。From the description of the above embodiments, those of ordinary skill in the art can clearly understand that each embodiment can be implemented by means of software plus a general hardware platform, and certainly can also be implemented by hardware. Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be completed by instructing relevant hardware through a computer program, and the program can be stored in a computer-readable storage medium, and the program can be stored in a computer-readable storage medium. During execution, it may include the processes of the embodiments of the above-mentioned methods. The storage medium may be a magnetic disk, an optical disk, a read-only memory (Read-Only Memory, ROM), or a random access memory (Random Access Memory, RAM) or the like.
最后应说明的是:以上实施例仅用以说明本发明的技术方案,而非对其限制;在本发明的思路下,以上实施例或者不同实施例中的技术特征之间也可以进行组合,步骤可以以任意顺序实现,并存在如上所述的本发明的不同方面的许多其它变化,为了简明,它们没有在细节中提供;尽管参照前述实施例对本发明进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本发明各实施例技术方案的范围。Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, but not to limit them; under the idea of the present invention, the technical features in the above embodiments or different embodiments can also be combined, The steps may be carried out in any order, and there are many other variations of the different aspects of the invention as described above, which are not provided in detail for the sake of brevity; although the invention has been The skilled person should understand that it is still possible to modify the technical solutions recorded in the foregoing embodiments, or to perform equivalent replacements on some of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the implementation of the present invention. scope of technical solutions.

Claims (15)

  1. 一种工件平面磨损的测量方法,其特征在于,所述方法包括:A method for measuring plane wear of a workpiece, characterized in that the method comprises:
    向待检测工件平面投射激光线,并获取包含所述激光线的图像;Projecting a laser line to the plane of the workpiece to be inspected, and acquiring an image containing the laser line;
    根据所述图像获取所述激光线相关的点云数据;所述点云数据为所述激光线投射在所述待检测工件平面的坐标数据序列D n;其中,D n={d 1(x 1,y 1)……d n(x n,y n)},n为正整数,d n(x n,y n)表示所述激光线上的激光点d n投射在所述待检测工件平面的坐标,x n表示以所述激光线的长度方向作为x轴时,激光点d n对应的x轴坐标,y n表示以所述激光线设在所述待检测工件平面的深度方向作为y轴时,激光点d n对应的y轴坐标; Acquire point cloud data related to the laser line according to the image; the point cloud data is the coordinate data sequence D n projected by the laser line on the plane of the workpiece to be detected; wherein D n ={d 1 (x 1 , y 1 )...d n (x n , y n )}, n is a positive integer, d n (x n , y n ) indicates that the laser point d n on the laser line is projected on the workpiece to be inspected The coordinates of the plane, x n represents the x-axis coordinate corresponding to the laser point d n when the length direction of the laser line is taken as the x-axis, and y n represents the depth direction of the laser line set on the plane of the workpiece to be detected as the x-axis. On the y-axis, the y-axis coordinate corresponding to the laser point d n ;
    在所述点云数据中确定位于磨损区域的一致性点集DS n;其中,DS n为D n的子集; Determine the consistent point set DS n in the wear area in the point cloud data; wherein, DS n is a subset of D n ;
    根据所述一致性点集拟合出用于表示磨损区域的参考线f(x,y);Fitting a reference line f(x, y) for representing the wear area according to the set of consistency points;
    根据所述参考线f(x,y)相对于所述x轴的斜率,确定旋转参考线f'(x',y'),以使所述旋转参考线f'(x',y')相对于所述x轴的斜率在包含0的区间内;According to the slope of the reference line f(x, y) with respect to the x-axis, the rotation reference line f'(x', y') is determined so that the rotation reference line f'(x', y') the slope with respect to the x-axis is in an interval containing 0;
    根据所述旋转参考线,确定所述待测工件平面的磨损程度。According to the rotation reference line, the degree of wear of the plane of the workpiece to be measured is determined.
  2. 根据权利要求1所述的方法,其特征在于,所述确定旋转参考线根据旋转公式计算,所述旋转公式为:The method according to claim 1, wherein the determined rotation reference line is calculated according to a rotation formula, and the rotation formula is:
    Figure PCTCN2021130178-appb-100001
    Figure PCTCN2021130178-appb-100001
    其中,
    Figure PCTCN2021130178-appb-100002
    为所述旋转参考线f'(x',y')中各点的坐标,
    Figure PCTCN2021130178-appb-100003
    为所述参考线f(x,y)中各点的坐标,k为所述参考线f(x,y)相对于所述x轴的斜率,θ为所述参考线f(x,y)相对于所述x轴的旋转角度。
    in,
    Figure PCTCN2021130178-appb-100002
    is the coordinate of each point in the rotation reference line f'(x', y'),
    Figure PCTCN2021130178-appb-100003
    is the coordinate of each point in the reference line f(x, y), k is the slope of the reference line f(x, y) relative to the x-axis, θ is the reference line f(x, y) The angle of rotation relative to the x-axis.
  3. 根据权利要求1所述的方法,其特征在于,所述根据所述旋转参考线,确定所述待测工件平面的磨损程度,包括:The method according to claim 1, wherein the determining the degree of wear of the plane of the workpiece to be measured according to the rotation reference line comprises:
    在所述旋转参考线所在的区域确定未磨损点;determining an unworn point in the area where the rotation reference line is located;
    根据所述未磨损点和所述旋转参考线,确定磨损深度。Based on the unworn point and the rotation reference line, the depth of wear is determined.
  4. 根据权利要求3所述的方法,其特征在于,所述在所述旋转参考线所在的区域确定未磨损点,包括:The method according to claim 3, wherein the determining an unworn point in the area where the rotation reference line is located comprises:
    搜索低于所述旋转参考线的区域的最低点作为未磨损点。The lowest point of the area below the rotation reference line is searched as the unworn point.
  5. 根据权利要求3所述的方法,其特征在于,所述根据所述未磨损点和所述旋转参考线,确定磨损深度,包括:The method according to claim 3, wherein the determining the wear depth according to the unworn point and the rotation reference line comprises:
    从所述未磨损点,向所述一致性点集的中心查找,将在所述旋转参考线的预设范围内的点作为磨损点;From the unworn point, search to the center of the consistent point set, and use the point within the preset range of the rotation reference line as the wear point;
    根据所述磨损点及所述未磨损点,确定磨损深度。According to the worn point and the unworn point, the wear depth is determined.
  6. 根据权利要求3所述的方法,其特征在于,所述根据所述磨损点及所述未磨损点,确定磨损深度,包括:The method according to claim 3, wherein the determining the wear depth according to the worn point and the unworn point comprises:
    根据所述未磨损点和所述磨损点,确定最大磨损程度、平均磨损程度或磨损一致性中的至少一种磨损程度。According to the unworn point and the worn point, at least one of a maximum wear degree, an average wear degree or a wear consistency is determined.
  7. 根据权利要求6所述的方法,其特征在于,所述确定磨损一致性,包括:The method according to claim 6, wherein the determining the wear consistency comprises:
    根据所述磨损点,确定磨损区域;According to the wear point, determine the wear area;
    根据所述参考线的曲率和所述磨损区域对应的点集的离散性确定所述磨损一致性信息;determining the wear consistency information according to the curvature of the reference line and the discreteness of the point set corresponding to the wear area;
    输出所述磨损一致性信息。The wear consistency information is output.
  8. 根据权利要求1所述的方法,其特征在于,所述确定最大磨损程度,包括:The method according to claim 1, wherein the determining the maximum degree of wear comprises:
    获取所述磨损点的坐标信息;obtain the coordinate information of the wear point;
    在所述磨损点的纵坐标为最大值时,确定所述磨损点为最大磨损点;When the ordinate of the wear point is the maximum value, determining the wear point as the maximum wear point;
    输出所述最大磨损点对应的坐标信息,作为最大磨损信息。The coordinate information corresponding to the maximum wear point is output as the maximum wear information.
  9. 根据权利要求3所述的方法,其特征在于,在所述根据所述未磨损点和所述旋转参考线,确定磨损深度之后,所述方法还包括:The method according to claim 3, wherein after determining the wear depth according to the unworn point and the rotation reference line, the method further comprises:
    在所述磨损深度超过预设磨损程度时,输出提示用户更换所述待检工件的提示信息。When the wear depth exceeds a preset wear degree, output prompt information prompting the user to replace the workpiece to be inspected.
  10. 根据权利要求1至9中任一项所述的方法,其特征在于,所述在所述点云数据中确定位于磨损区域的一致性点集,包括:The method according to any one of claims 1 to 9, wherein the determining, in the point cloud data, a set of consistent points located in the wear area comprises:
    在所述点云数据中查找连续的、损失函数小于预设值且符合预设长度的区段作为母线;Searching for a continuous segment in the point cloud data whose loss function is less than a preset value and conforms to a preset length as a busbar;
    根据所述母线扩充一致点;Expand the coincidence point according to the busbar;
    剔除所述一致点中的奇异点,得到初始点集;Eliminate singular points in the consistent points to obtain an initial point set;
    利用所述损失函数对所述初始点集进行一致性评估;Using the loss function to evaluate the consistency of the initial point set;
    在所述初始点集通过所述一致性评估时,将所述初始点集作为所述一致性点集。When the initial point set passes the consistency evaluation, the initial point set is used as the consistency point set.
  11. 根据权利要求10所述的方法,其特征在于,所述在所述点云数据中查找连续的、损失函数小于预设值且符合预设长度的区段作为母线,包括:The method according to claim 10, wherein the searching for continuous segments in the point cloud data whose loss function is smaller than a preset value and conforms to a preset length as a busbar comprises:
    在所述点云数据中,由所述点云数据的中心向两端或由所述点云数据的两端向中心开始查找连续的、损失函数小于预设值且符合预设长度的区段作为母线。In the point cloud data, start from the center of the point cloud data to both ends or from the two ends of the point cloud data to the center to search for continuous segments whose loss function is less than a preset value and conforms to a preset length as a busbar.
  12. 根据权利要求10所述的方法,其特征在于,所述根据所述母线扩充一致点,包括:The method according to claim 10, wherein the expanding the coincidence point according to the bus bar comprises:
    在所述母线的预设范围内,计算所述母线的预设范围内的点到所述母线的欧式距离;Within the preset range of the busbar, calculate the Euclidean distance from the point within the preset range of the busbar to the busbar;
    若所述欧式距离小于预设距离,则将对应的点与所述母线组合,得到一致点。If the Euclidean distance is less than the preset distance, the corresponding point is combined with the bus bar to obtain a consistent point.
  13. 根据权利要求10所述的方法,其特征在于,所述剔除所述一致点中的奇异点,得到初始点集,包括:The method according to claim 10, wherein the removing singular points in the consistent points to obtain an initial point set, comprising:
    剔除所述一致点中的包括离散点、孔洞斜纹干扰点中的至少一种奇异点,得到所述初始点集。At least one singular point including discrete points and hole twill interference points in the consistent points is eliminated to obtain the initial point set.
  14. 一种工件平面磨损的测量系统,其特征在于,所述系统包括:A measurement system for workpiece plane wear, characterized in that the system comprises:
    支架;bracket;
    激光器,固定于所述支架上,所述激光器向所述待检工件平面投射激光线;a laser, which is fixed on the bracket, and the laser projects a laser line to the plane of the workpiece to be inspected;
    相机,固定于所述支架上,所述相机用于采集包含所述激光线的图像;a camera, fixed on the bracket, and the camera is used to collect an image containing the laser line;
    至少一个处理器,以及at least one processor, and
    存储器,所述存储器与所述至少一个处理器通信连接,所述存储器存储有可被所述至少一个处理器执行的指令,所述指令被所述至少一个处理器执行,以使所述至少一个处理器能够执行权利要求1-13任一项所述的方法。a memory in communication with the at least one processor, the memory storing instructions executable by the at least one processor, the instructions being executed by the at least one processor to cause the at least one processor The processor is capable of performing the method of any of claims 1-13.
  15. 一种非易失性计算机可读存储介质,其特征在于,所述计算机可读存储介质存储有计算机可执行指令,当所述计算机可执行指令被工件平面磨损的测量系统执行时,使所述工件平面磨损的测量系统执行如权利要求1-13任一项所述的方法。A non-volatile computer-readable storage medium, characterized in that, the computer-readable storage medium stores computer-executable instructions, when the computer-executable instructions are executed by the workpiece plane wear measurement system, make the A measurement system for flat wear of a workpiece performs the method of any one of claims 1-13.
PCT/CN2021/130178 2020-11-17 2021-11-12 Method and system for measuring wear of workpiece plane WO2022105676A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202011287507.1 2020-11-17
CN202011287507.1A CN112284256B (en) 2020-11-17 2020-11-17 Method and system for measuring plane abrasion of workpiece

Publications (1)

Publication Number Publication Date
WO2022105676A1 true WO2022105676A1 (en) 2022-05-27

Family

ID=74399025

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/130178 WO2022105676A1 (en) 2020-11-17 2021-11-12 Method and system for measuring wear of workpiece plane

Country Status (2)

Country Link
CN (1) CN112284256B (en)
WO (1) WO2022105676A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116703892A (en) * 2023-08-01 2023-09-05 东莞市京品精密模具有限公司 Image data-based lithium battery cutter abrasion evaluation and early warning method

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112284256B (en) * 2020-11-17 2022-06-10 深圳市道通科技股份有限公司 Method and system for measuring plane abrasion of workpiece
CN113096067B (en) * 2021-03-04 2022-10-11 深圳市道通科技股份有限公司 Method and system for determining surface wear of workpiece
CN114383502A (en) * 2021-12-29 2022-04-22 国能铁路装备有限责任公司 Method and device for measuring wear amount of fittings of bogie and measuring equipment

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003011702A (en) * 2001-06-29 2003-01-15 Mitsubishi Heavy Ind Ltd Wear measuring method and wear measuring device
CN1894557A (en) * 2003-12-16 2007-01-10 特里伯耶拿有限公司 Calibration of a surveying instrument
CN105913061A (en) * 2016-04-29 2016-08-31 广东小天才科技有限公司 Picture correction method and device
CN106872476A (en) * 2017-03-31 2017-06-20 武汉理工大学 A kind of casting class workpiece surface quality detection method and system based on line-structured light
CN109856642A (en) * 2018-12-20 2019-06-07 上海海事大学 A kind of rotated three dimensional laser measurement system and its plane reference method
CN110030956A (en) * 2019-05-22 2019-07-19 福建工程学院 A kind of contactless building roughness measurement method
CN111220100A (en) * 2020-04-10 2020-06-02 广东博智林机器人有限公司 Laser beam-based measurement method, device, system, control device, and medium
CN111830049A (en) * 2020-07-24 2020-10-27 深圳市道通科技股份有限公司 Brake disc wear area identification method and wear identification system
CN112284256A (en) * 2020-11-17 2021-01-29 深圳市道通科技股份有限公司 Method and system for measuring plane abrasion of workpiece

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2902113B1 (en) * 2006-06-09 2008-08-08 Ecl Soc Par Actions Simplifiee METHOD OF MEASURING THE RISE OF THE HEIGHT OF AN ELECTROLYSIS ANODE
ES2369002T3 (en) * 2007-05-23 2011-11-24 Snap-On Equipment Srl A Unico Socio PROCEDURE AND APPLIANCE TO DETERMINE THE GEOMETRIC DIMENSION OF A VEHICLE WHEEL THAT INCLUDES OPTICAL SENSORS.
JP2013164329A (en) * 2012-02-10 2013-08-22 Mitsubishi Heavy Ind Ltd Shape measuring instrument
CN203101537U (en) * 2012-11-30 2013-07-31 深圳市深越光电技术有限公司 Multipoint touch control test platform
CN104792796A (en) * 2015-04-13 2015-07-22 太原理工大学 On-line monitoring system for mining adhesive tape operation condition based on machine vision
WO2016204385A1 (en) * 2015-06-15 2016-12-22 한국철도기술연구원 Method and apparatus for detecting vibration information of electric railway vehicle
CN107321894B (en) * 2017-07-12 2023-02-28 第一拖拉机股份有限公司 Multi-tooth online detection device and detection method for precision forging of straight bevel gear
CN109017867B (en) * 2018-08-01 2021-05-25 湖南大学 Dynamic measuring method for rail corrugation
CN210981799U (en) * 2019-12-26 2020-07-10 杰胜卡特汽车检测设备(北京)有限公司 Laser emitter for collecting parallelism of axles
CN111156899B (en) * 2020-02-18 2022-04-12 广东博智林机器人有限公司 Vision measurement device and method and robot
CN111141818A (en) * 2020-02-19 2020-05-12 兖矿集团有限公司 Laser strong-magnetic flat steel wire rope nondestructive flaw detection system and method

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003011702A (en) * 2001-06-29 2003-01-15 Mitsubishi Heavy Ind Ltd Wear measuring method and wear measuring device
CN1894557A (en) * 2003-12-16 2007-01-10 特里伯耶拿有限公司 Calibration of a surveying instrument
CN105913061A (en) * 2016-04-29 2016-08-31 广东小天才科技有限公司 Picture correction method and device
CN106872476A (en) * 2017-03-31 2017-06-20 武汉理工大学 A kind of casting class workpiece surface quality detection method and system based on line-structured light
CN109856642A (en) * 2018-12-20 2019-06-07 上海海事大学 A kind of rotated three dimensional laser measurement system and its plane reference method
CN110030956A (en) * 2019-05-22 2019-07-19 福建工程学院 A kind of contactless building roughness measurement method
CN111220100A (en) * 2020-04-10 2020-06-02 广东博智林机器人有限公司 Laser beam-based measurement method, device, system, control device, and medium
CN111830049A (en) * 2020-07-24 2020-10-27 深圳市道通科技股份有限公司 Brake disc wear area identification method and wear identification system
CN112284256A (en) * 2020-11-17 2021-01-29 深圳市道通科技股份有限公司 Method and system for measuring plane abrasion of workpiece

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116703892A (en) * 2023-08-01 2023-09-05 东莞市京品精密模具有限公司 Image data-based lithium battery cutter abrasion evaluation and early warning method
CN116703892B (en) * 2023-08-01 2023-11-14 东莞市京品精密模具有限公司 Image data-based lithium battery cutter abrasion evaluation and early warning method

Also Published As

Publication number Publication date
CN112284256B (en) 2022-06-10
CN112284256A (en) 2021-01-29

Similar Documents

Publication Publication Date Title
WO2022105676A1 (en) Method and system for measuring wear of workpiece plane
Shan et al. A stereovision-based crack width detection approach for concrete surface assessment
JP5671281B2 (en) Position / orientation measuring apparatus, control method and program for position / orientation measuring apparatus
JP5618569B2 (en) Position and orientation estimation apparatus and method
JP6736257B2 (en) Information processing device, information processing method, and program
JP2015147256A (en) Robot, robot system, control device, and control method
CN109801333B (en) Volume measurement method, device and system and computing equipment
EP3023913A1 (en) Crack data collection method and crack data collection program
JP2011185872A (en) Information processor, and processing method and program of the same
CN112184811B (en) Monocular space structured light system structure calibration method and device
CN111325723A (en) Hole site detection method, device and equipment
US20210132214A1 (en) Synthetic aperture radar image analysis system, synthetic aperture radar image analysis method, and synthetic aperture radar image analysis program
WO2018120168A1 (en) Visual detection method and system
JP2018036770A (en) Position attitude estimation device, position attitude estimation method, and position attitude estimation program
CN116542979B (en) Image measurement-based prediction correction method and terminal
JP5976089B2 (en) Position / orientation measuring apparatus, position / orientation measuring method, and program
Eastwood et al. Autonomous close-range photogrammetry using machine learning
JP5928010B2 (en) Road marking detection apparatus and program
CN111192358A (en) Pipeline crack detection method, device, equipment and storage medium based on three dimensions
CN114396875B (en) Rectangular package volume measurement method based on vertical shooting of depth camera
JP5960642B2 (en) 3D information acquisition method and 3D information acquisition apparatus
TW201317587A (en) Dimension measuring device and method thereof
CN113095447B (en) Detection method and system based on image recognition
CN111473944B (en) PIV data correction method and device for observing complex wall surface in flow field
Frangione et al. Multi-step approach for automated scaling of photogrammetric micro-measurements

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21893823

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21893823

Country of ref document: EP

Kind code of ref document: A1