CN111583234A - Geometric form evaluation method and detection and evaluation system of honeycomb product - Google Patents

Geometric form evaluation method and detection and evaluation system of honeycomb product Download PDF

Info

Publication number
CN111583234A
CN111583234A CN202010387864.9A CN202010387864A CN111583234A CN 111583234 A CN111583234 A CN 111583234A CN 202010387864 A CN202010387864 A CN 202010387864A CN 111583234 A CN111583234 A CN 111583234A
Authority
CN
China
Prior art keywords
cell
top surface
honeycomb product
deviation angle
deviation
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202010387864.9A
Other languages
Chinese (zh)
Other versions
CN111583234B (en
Inventor
王中钢
崔灿
施冲
梁习锋
李振东
孙博
雷紫平
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Central South University
Original Assignee
Central South University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Central South University filed Critical Central South University
Priority to CN202010387864.9A priority Critical patent/CN111583234B/en
Priority to US17/422,721 priority patent/US11893725B2/en
Priority to PCT/CN2020/109731 priority patent/WO2021227288A1/en
Publication of CN111583234A publication Critical patent/CN111583234A/en
Application granted granted Critical
Publication of CN111583234B publication Critical patent/CN111583234B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • G06T7/0004Industrial image inspection
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B17/00Details of cameras or camera bodies; Accessories therefor
    • G03B17/56Accessories
    • G03B17/566Accessory clips, holders, shoes to attach accessories to camera
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/70Denoising; Smoothing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/13Edge detection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/60Analysis of geometric attributes
    • HELECTRICITY
    • H02GENERATION; CONVERSION OR DISTRIBUTION OF ELECTRIC POWER
    • H02KDYNAMO-ELECTRIC MACHINES
    • H02K7/00Arrangements for handling mechanical energy structurally associated with dynamo-electric machines, e.g. structural association with mechanical driving motors or auxiliary dynamo-electric machines
    • H02K7/06Means for converting reciprocating motion into rotary motion or vice versa
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02PCLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/30Computing systems specially adapted for manufacturing

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Quality & Reliability (AREA)
  • Power Engineering (AREA)
  • Geometry (AREA)
  • Image Analysis (AREA)
  • Length Measuring Devices By Optical Means (AREA)

Abstract

A method of evaluating the geometry of a cellular product, comprising: acquiring a top surface image and a side surface image of the honeycomb product; performing vertex extraction on the top surface image to obtain vertex coordinates; carrying out cell reconstruction on the top surface image to obtain serial numbers of six vertexes of each cell; calculating deviation values of six internal angles of each cell based on the serial number of the six vertexes of each cell and the vertex coordinates of the six vertexes of each cell; extracting top and side edge lines of the honeycomb product from the top and side images; calculating the top surface maximum deflection and the side surface maximum deflection of the honeycomb product based on the top surface side line and the side surface side line; and judging whether the honeycomb product is qualified or not based on the deviation angle, the top surface maximum deflection and the side surface maximum deflection. The geometric form evaluation method of the invention accurately judges whether the geometric form of the honeycomb product is qualified or not without damaging the honeycomb product by simply processing the image in a non-contact mode.

Description

Geometric form evaluation method and detection and evaluation system of honeycomb product
Technical Field
The invention relates to the fields of design, manufacture, application and the like of light structural products of equipment such as transportation, machinery, aerospace, ships and the like, in particular to a geometric form evaluation method and a detection and evaluation system of a honeycomb product.
Background
Lightweight honeycomb structures are widely used in various engineering fields due to their excellent load bearing and energy absorbing properties. However, various structural defects such as bowing, warping, cell malformation of the honeycomb core block inevitably occur during the production and manufacturing process of the product, and these defects have proved to have a great influence on the load-bearing and energy-absorbing properties. In addition, since the honeycomb product is a periodically arranged porous structure and has the characteristics of typical multiple vertexes, thin wall, wide bearing surface and the like, the traditional ultrasonic detection technology cannot obtain the characteristic information of the structural defects. Therefore, work on the regularity detection and evaluation of cellular products to avoid the use risk of inferior products is urgently needed.
Disclosure of Invention
Objects of the invention
The invention aims to provide a geometric form evaluation method and a geometric form detection and evaluation system of a honeycomb product, which can accurately evaluate the geometric form of the honeycomb product.
(II) technical scheme
To solve the above problems, a first aspect of the present invention provides a method for evaluating a geometry of a honeycomb product, including: acquiring a top surface image and a side surface image of the honeycomb product; performing vertex extraction on the top surface image to obtain vertex coordinates; carrying out cell reconstruction on the top surface image to obtain serial numbers of six vertexes of each cell; calculating deviation values of six internal angles of each cell based on the serial number of the six vertexes of each cell and the vertex coordinates of the six vertexes of each cell; extracting top and side edge lines of the honeycomb product from the top and side images; calculating a top surface maximum deflection and a side surface maximum deflection of the honeycomb product based on the top surface side line and the side surface side line; determining whether the honeycomb product is acceptable based on the deviation angle, the top surface maximum deflection, and the side surface maximum deflection.
Optionally, said determining whether said honeycomb product is acceptable based on said deviation angle, said top surface maximum deflection and said side surface maximum deflection comprises: and judging the geometric regularity of the honeycomb product based on the deviation angle, the top surface maximum deflection and the side surface maximum deflection, wherein the honeycomb product is qualified if the geometric regularity reaches a preset standard.
Optionally, the geometric regularity comprises: the cell regularity of the top surface, the flatness of the side surface and the flatness of the top surface; determining the geometric regularity of the honeycomb product based on the deviation angle, the top surface maximum deflection and the side surface maximum deflection, wherein if the geometric regularity reaches a preset standard, the honeycomb product is qualified, and the method comprises the following steps: determining the regularity of the top surface cell based on the deviation angle; determining the side flatness based on the top surface maximum deflection; determining the top surface flatness based on the side surface maximum deflection; and if the regularity of the top surface cell elements, the flatness of the side surface and the flatness of the top surface all reach preset standards, the honeycomb product is qualified.
Optionally, the determination index of the regularity of the top surface cell includes: one or more of a maximum deviation angle, a mean deviation angle, a maximum of a cell deviation angle average, a standard deviation of a deviation angle, and a standard deviation of a cell deviation angle average; and if one or more of the maximum deviation angle, the average deviation angle, the maximum of the average of the deviation angles of the cells, the standard deviation of the deviation angle and the standard deviation of the average of the deviation angles of the cells are less than a preset threshold, the regularity of the top surface cells reaches a preset standard.
Optionally, the determination index of the regularity of the top surface cell includes: one or more of a maximum deviation angle, a mean deviation angle, a maximum of a cell deviation angle average, a standard deviation of a deviation angle, and a standard deviation of a cell deviation angle average; and if the proportion of one or more of the maximum deviation angle, the average deviation angle, the maximum of the average of the deviation angles of the cell elements, the standard deviation of the deviation angles and the standard deviation of the average of the deviation angles of the cell elements, which is larger than a preset threshold value, is smaller than a preset proportion, the regularity of the top-surface cell elements reaches a preset standard.
Optionally, the determination index of the regularity of the top surface cell includes: cell deviation angle average; and if the average cell deviation angle is not more than the percentage of the whole cell occupied by the cells A1, A2, A3, A4 and A5 in sequence and is less than the corresponding thresholds B1, B2, B3, B4 and B5 in sequence, the regularity of the top surface cell reaches the standard.
Optionally, the vertex extraction method includes: obtaining a skeleton graph of the vertex image; searching eight neighborhoods of each pixel point on the skeleton graph for a week according to a preset sequence, and if the change times of the pixel points are 6, taking the pixel points as vertexes.
Optionally, the vertex extracting method includes S1: acquiring a square window with a preset side length L, setting a square window with the side length sequentially increased from 3 pixels, and after the square window traverses the vertex image, firstly setting the minimum value of the number of pixels with the pixel value of 0 in the square window to be non-zero S2: traversing each pixel point with the pixel value of 1 in the vertex image by the square window, and then assigning the sum of the number of the pixels with the pixel value of 1 in each square window to the pixel point at the center point of the square window; s3: establishing a square area with the initial side length E equal to L by taking the pixel point with the maximum assignment as the center, calculating the difference absolute value of the assignment of each pixel point on four boundaries of the square area and the assignment of the center point of the square area, and recording the minimum difference absolute value Z and the coordinate of the boundary pixel point corresponding to the minimum difference absolute value Z; s4: establishing a new square area by E-E +2 pixels, repeating S3 until the minimum absolute value of the difference has obvious trend of increasing reversely, obtaining the coordinate of the boundary pixel point of the minimum absolute value of the difference Z and the coordinate of the center point of the corresponding square area, and solving to obtain the side length A of the honeycomb cell element by the coordinate value of the boundary pixel point of the Z value and the coordinate value of the center point of the corresponding square area; s5: determining the pixel point with the maximum assignment as a vertex, establishing an annihilation window of a square with the side length A of the honeycomb cell as the side length by taking the vertex as the center, resetting all assignments on the pixel point with the pixel value of 1 in the annihilation window, finding out the pixel point with the maximum assignment from the rest assignments, determining the pixel point as the vertex and recording the pixel point, repeating the operation of the annihilation window until the assignments on the pixel point with the pixel value of 1 are smaller than a given threshold value, and extracting all the vertices.
Optionally, the method for cell reconstruction includes: tracking the boundary of each cell element by adopting a Moore neighborhood tracking algorithm; and establishing a window with a preset size by taking each tracked boundary point as a center, recording the number of a vertex and storing the number of the vertex under the name of the cell if the vertex exists in the window, sequencing the vertices of the cell according to the sequence of the encountered vertices, and connecting the vertices of each cell in sequence after tracking is finished to obtain a cell reconfiguration picture.
The second aspect of the present invention provides a geometric shape detection and evaluation system for a cellular product, for implementing the geometric shape evaluation method, including: the object placing table is used for placing honeycomb products; the cameras are arranged on the top surface and the side surface of the honeycomb product and are used for photographing the honeycomb product to obtain an original top surface image and an original side surface image of the honeycomb product; camera moving means for moving the camera over the top and sides of the honeycomb product to obtain a complete original top image and a complete original side image; the analysis and evaluation module is used for acquiring the complete original top surface image and the complete original side surface image, and performing noise reduction filtering, binarization and morphological filtering processing to obtain a top surface image and a side surface image; performing vertex extraction on the top surface image to obtain vertex coordinates; carrying out cell reconstruction on the top surface image to obtain serial numbers of six vertexes of each cell; calculating deviation values of six internal angles of each cell based on the serial number of the six vertexes of each cell and the vertex coordinates of the six vertexes of each cell; extracting top and side edges of the honeycomb product from the preprocessed top and side images; calculating a top surface maximum deflection and a side surface maximum deflection of the honeycomb product based on the top surface side line and the side surface side line; determining whether the honeycomb product is acceptable based on the deviation angle, the top surface maximum deflection, and the side surface maximum deflection.
(III) advantageous effects
The technical scheme of the invention has the following beneficial technical effects:
the geometric form evaluation method of the invention accurately judges whether the geometric form of the honeycomb product is qualified or not without damaging the honeycomb product by simply processing the image in a non-contact mode.
Drawings
FIG. 1 is a flow chart of a method of evaluating the geometry of a cellular product of the present invention;
FIG. 2 is a top view of a honeycomb product of the present invention;
FIG. 3 is a side profile view of a honeycomb product of the present invention;
fig. 4 is a schematic top view of a geometry inspection and evaluation system of a honeycomb product according to embodiment 2 of the present invention;
fig. 5 is a schematic diagram of a test structure of a geometry inspection and evaluation system of a honeycomb product according to embodiment 2 of the present invention.
Reference numerals:
1: a placing table; 2: a honeycomb product; 3: a camera; 4: a camera moving device; 41: a walking gantry; 42: a slide rail; 43: a roller; 44: a moving block; 5: an analysis evaluation module; 6: a clamp; 7: a lifting device.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention will be described in further detail with reference to the accompanying drawings in conjunction with the following detailed description. It should be understood that the description is intended to be exemplary only, and is not intended to limit the scope of the present invention. Moreover, in the following description, descriptions of well-known structures and techniques are omitted so as to not unnecessarily obscure the concepts of the present invention.
In the drawings a schematic view of a layer structure according to an embodiment of the invention is shown. The figures are not drawn to scale, wherein certain details are exaggerated and possibly omitted for clarity. The shapes of various regions, layers, and relative sizes and positional relationships therebetween shown in the drawings are merely exemplary, and deviations may occur in practice due to manufacturing tolerances or technical limitations, and a person skilled in the art may additionally design regions/layers having different shapes, sizes, relative positions, as actually required.
It is to be understood that the embodiments described are only a few embodiments of the present invention, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
In the description of the present invention, it should be noted that the terms "first", "second", and "third" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance.
In addition, the technical features involved in the different embodiments of the present invention described below may be combined with each other as long as they do not conflict with each other.
FIG. 2 is a top view of a honeycomb product of the present invention; figure 3 is a side profile view of a honeycomb product of the present invention.
Before describing the embodiments of the present invention, the present invention will be described in terms of orientation, referring to fig. 2, wherein (a) is a top view of a standard honeycomb product and (b) is a top view of a honeycomb product to be evaluated, and an original side image of the honeycomb product of the present application is obtained by looking in the direction of the arrows, i.e., fig. 3. Referring to fig. 3, wherein (a) is an outline of a standard honeycomb product and (b) is an outline of a honeycomb product to be evaluated, an original top surface image of the honeycomb product of the present application can be obtained by looking in the direction of arrows.
Example 1
Fig. 1 is a flowchart of a method for evaluating the geometry of a honeycomb product according to embodiment 1 of the present application.
As shown in fig. 1, the present embodiment provides a method for evaluating a geometry of a honeycomb product, including: acquiring a top surface image and a side surface image of the honeycomb product; performing vertex extraction on the top surface image to obtain vertex coordinates; carrying out cell reconstruction on the top surface image to obtain serial numbers of six vertexes of each cell; calculating deviation values of six internal angles of each cell based on the serial number of the six vertexes of each cell and the vertex coordinates of the six vertexes of each cell; extracting top surface side lines and side surface side lines of the honeycomb product from the preprocessed top surface image and side surface image; calculating the top surface maximum deflection and the side surface maximum deflection of the honeycomb product based on the top surface side line and the side surface side line; and judging whether the honeycomb product is qualified or not based on the deviation angle, the top surface maximum deflection and the side surface maximum deflection. Referring to fig. 2, (b) is a top view of the honeycomb product to be evaluated, wherein the dashed portion is a top profile view of a standard honeycomb product, from which the side surface maximum deflection is visible in fig. 2. Referring to fig. 3, (b) is a top view of the honeycomb product to be evaluated, wherein the dashed portion is a top profile view of a standard honeycomb product, with the side maximum deflection visible in fig. 2.
The method judges whether the geometric regularity is qualified or not by acquiring the top surface image and the side surface image of the honeycomb product, and accurately judges whether the geometric shape of the honeycomb product is qualified or not by simply processing the images in a non-contact mode. After the geometric form of the honeycomb product is qualified, the mechanical property of the honeycomb product meets the requirements of products such as airfoil surfaces, cabin covers, floors, engine shields, tail nozzles, acoustical panels, thermal insulation boards, satellite star shells, rigid solar battery wings, parabolic antennas, rocket propellant tank bottoms and the like.
Specifically, the absolute value of the difference between the internal angle and 120 ° is the deviation angle of the vertex corresponding to the cell.
In an alternative embodiment of this embodiment, determining whether the honeycomb product is acceptable based on the deviation angle, the top surface maximum deflection, and the side surface maximum deflection comprises: and judging the geometric regularity of the honeycomb product based on the deviation angle, the maximum deflection of the top surface and the maximum deflection of the side surface, wherein the honeycomb product is qualified if the geometric regularity reaches a preset standard. The geometric regularity includes: the cell regularity of the top surface, the flatness of the side surface and the flatness of the top surface;
in an alternative embodiment of this embodiment, obtaining the top surface image and the side surface image of the honeycomb product comprises obtaining a complete original top surface image and obtaining a complete original side surface image, and preprocessing the original top surface image and the obtained complete original side surface image to obtain the top surface image and the side surface image.
Wherein, the pretreatment comprises the following steps:
the image processing sequence required by the calculation of the regularity of the top surface cell element comprises noise reduction filtering, binarization and morphological filtering: the noise reduction filtering adopts a median filtering method to reduce the noise of the image; binarization adopts Otsu's method, the pixel of the cell wall is 1 after execution, and the pixel of the background, i.e. the hole part, is 0; the morphological filtering can correct the binary error;
calculating the side flatness by image processing: on the basis of the steps, hole filling, edge extraction and contour line filtering are performed;
calculating the required image processing of the top surface flatness: performing edge extraction on the basis of noise reduction filtering, binarization and morphological filtering; the edge extraction is to extract the contour line of the edge of the top surface image or the side surface image by adopting a canny algorithm or/and a sobel algorithm; the hole filling is to fill the cellular holes in the top surface image with pixels with a pixel value of 1 by adopting a morphological hole filling method; contour line filtering is to filter contour lines in an image by adopting a Gaussian filtering method so as to enable the contour lines to be smoother;
in an alternative embodiment of this embodiment, the geometric regularity comprises: the cell regularity of the top surface, the flatness of the side surface and the flatness of the top surface; the geometric regularity of the honeycomb product is judged based on the deviation angle, the maximum deflection of the top surface and the maximum deflection of the side surface, and if the geometric regularity reaches a preset standard, the honeycomb product is qualified and comprises: determining the regularity of the top surface cell based on the deviation angle; determining the flatness of the side surface based on the maximum deflection of the top surface; determining the flatness of the top surface based on the maximum deflection of the side surface; if the regularity of the cells on the top surface, the flatness of the side surfaces and the flatness of the top surface all reach preset standards, the honeycomb product is qualified.
In an alternative embodiment of this embodiment, the determination index of the regularity of the top cell includes: one or more of a maximum deviation angle, a mean deviation angle, a maximum of a cell deviation angle average, a standard deviation of a deviation angle, and a standard deviation of a cell deviation angle average; and if one or more of the maximum deviation angle, the average deviation angle, the maximum value of the average value of the cell deviation angles, the standard deviation of the deviation angles and the standard deviation of the average value of the cell deviation angles are smaller than a preset threshold value, the regularity of the top cell reaches a preset standard. After reaching the preset standard, the mechanical properties of the honeycomb product meet the requirements of products such as airfoil surfaces, cabin covers, floors, engine shields, tail nozzles, acoustical panels, thermal insulation boards, satellite star shells, rigid solar battery wings, parabolic antennas, rocket propellant tank bottoms and the like.
In an alternative embodiment of this embodiment, the determination index of the regularity of the top cell includes: one or more of a maximum deviation angle, a mean deviation angle, a maximum of a cell deviation angle average, a standard deviation of a deviation angle, and a standard deviation of a cell deviation angle average; and if the proportion of one or more of the maximum deviation angle, the average deviation angle, the maximum value of the average value of the cell deviation angles, the standard deviation of the deviation angles and the standard deviation of the average value of the cell deviation angles, which is larger than a preset threshold value, is smaller than a preset proportion, the regularity of the top cell reaches a preset standard. After reaching the preset standard, the mechanical properties of the honeycomb product meet the requirements of products such as airfoil surfaces, cabin covers, floors, engine shields, tail nozzles, acoustical panels, thermal insulation boards, satellite star shells, rigid solar battery wings, parabolic antennas, rocket propellant tank bottoms and the like.
In an alternative embodiment of this embodiment, the determination index of the regularity of the top cell includes: cell deviation angle average; if the average value of the cell deviation angles is not more than the percentage of the whole cell occupied by the cells A1, A2, A3, A4 and A5 in turn and is less than the corresponding thresholds B1, B2, B3, B4 and B5 in turn, the regularity of the top surface cell reaches the standard. After reaching the preset standard, the mechanical properties of the honeycomb product meet the requirements of products such as airfoil surfaces, cabin covers, floors, engine shields, tail nozzles, acoustical panels, thermal insulation boards, satellite star shells, rigid solar battery wings, parabolic antennas, rocket propellant tank bottoms and the like.
Wherein, the maximum deviation angle: i.e. the maximum value of all deviation angles
Average deviation angle: i.e. the average of all deviation angles;
maximum value of cell deviation angle average: firstly, calculating the average value of each deviation angle of a single cell element, wherein the average value of the deviation angles of the cell elements is the average value of the deviation angles of the cell elements, and the maximum value of the average values of the deviation angles of all the cell elements is the average value of the deviation angles of the cell elements;
standard deviation of deviation angle: calculating to obtain the standard deviation of the deviation angles by taking all the deviation angles as samples;
standard deviation of the cell deviation angle mean: calculating to obtain the standard deviation of the average value of the cell deviation angles by taking the average value of all the cell deviation angles as a sample;
in an optional implementation of this embodiment, the method for vertex extraction includes: a branching point method, a HARRIS method, and a moving window method.
The branch point method comprises the following steps: obtaining a skeleton graph of the vertex image; searching eight neighborhoods of each pixel point on the skeleton graph for a circle according to a preset sequence, and if the change times of the pixel points are 6, taking the pixel points as vertexes. Specifically, firstly, drawing a line with a pixel value of 1 into a skeleton diagram by adopting a line segment with a line width of 1 pixel on the basis of a form image; secondly, traversing pixel points 1 to k on the basis of a skeleton graph with k pixel points, and when encountering a pixel point with a pixel value equal to 1, searching for a circle around an eight-neighborhood of the pixel point in a clockwise or anticlockwise direction to obtain the change times of one pixel value; if the pixel value change times is 4, displaying that two straight lines exist in the pixel point, and determining the pixel point as an edge vertex and recording when the two straight lines have a reasonable included angle through coordinate calculation; if the number of times of pixel value change is 6, three straight lines of the pixel point are displayed, the pixel point is determined to be a middle vertex and is recorded, and the vertex is extracted completely. Wherein the morphological image is obtained by preprocessing.
The HARRISS method: firstly, drawing a skeleton graph by using a line segment with the line width of 1 pixel for a line with the pixel value of 1 on the basis of a form image; secondly, on the basis of the skeleton image, establishing a window with the size of 5 multiplied by 5 pixels by taking a pixel point with the pixel value equal to 1 as a central point, if partial area of the window overflows the skeleton image, assigning all pixel values of pixel points of an overflow area as 0, and then calculating a corner point response function value R corresponding to the central point by adopting a Harris algorithm; setting the R values at pixel points smaller than 1% of the maximum R value to be zero in all the R values in the same window, and repeating the operation to traverse the whole skeleton diagram; and establishing a window with the size of 3 x 3 pixels by taking the pixel point with the pixel value being 1 and the R value being larger than zero as a central point, recording the point as a vertex if the R value of the central point is the maximum value in the window, repeating the above operations to traverse the whole skeleton map, and finishing the vertex extraction. Wherein the morphological image is obtained by preprocessing.
A moving window method comprising: s1: acquiring a square window with a preset side length L, wherein the minimum value of the number of pixels with the pixel value of 0 in the square window is nonzero after the square window traverses the vertex image; wherein, obtain the square window of predetermineeing length of side L, include: setting a square window with the side length capable of changing from small to large by taking the form image as an object, and defining the side length of the square window as a wall thickness L if the minimum value of the pixel number of a pixel value 0 in the window is non-zero after the form image is traversed by the window with a certain side length;
s2: traversing each pixel point with the pixel value of 1 in the vertex image by using a square window, and then assigning the sum of the number of the pixels with the pixel value of 1 in each square window to the pixel point at the center point of the square window;
s3: establishing a square area with the initial side length E equal to L by taking the pixel point with the maximum assignment as the center, calculating the difference absolute value of the assignment of each pixel point on four boundaries of the square area and the assignment of the center point of the square area, and recording the minimum difference absolute value Z and the coordinate of the boundary pixel point corresponding to the minimum difference absolute value Z;
s4: establishing a new square area by E-E +2 pixels, repeating S3 until the minimum absolute value of the difference has an obvious trend of increasing reversely, obtaining the coordinate of the boundary pixel point of the minimum absolute value of the difference Z and the coordinate of the center point of the corresponding square area at the moment, and solving to obtain the side length A of the honeycomb cell element by the coordinate value of the boundary pixel point of the value Z and the coordinate value of the coordinate of the center point of the corresponding square area; the obvious trend of increasing reversely means that the absolute value of the minimum difference value is firstly decreased and then increased.
S5: determining the pixel point with the maximum assignment as a vertex, establishing an annihilation window of a square with the side length A of the honeycomb cell as the side length by taking the vertex as the center, completely clearing the assignments on the pixel point with all pixel values being 1 in the annihilation window, on the basis, finding out the pixel point with the maximum assignment from the rest assignments, determining the pixel point as the vertex and recording, repeating the operation of the annihilation window until the assignments on the pixel point with the pixel value being 1 are smaller than a given threshold value, and extracting all the vertices. Wherein the given threshold is related to the specific cell wall thickness L, and does not have a uniform value, the principle of threshold selection is to average the largest assignment in the image with the assignment corresponding to the cell wall center pixel point.
In an alternative implementation of this embodiment, the method for cell reconstruction includes: a neighborhood window recursion method. The neighborhood window recursion method comprises the following steps: tracking the boundary of each cell element by adopting a Moore neighborhood tracking algorithm; and establishing a window with a preset size by taking each tracked boundary point as a center, recording the number of a vertex and storing the number of the vertex under the name of the cell if the vertex exists in the window, sequencing the vertices of the cell according to the sequence of the encountered vertices, and connecting the vertices of each cell in sequence after tracking is finished to obtain a cell reconfiguration picture.
Specifically, cell reconstruction refers to establishing a mapping relationship between cells and vertices, i.e. which vertices belong to a cell, and connecting the vertices accordingly to obtain an image of the cellular structure again, and the method used is a neighborhood window recursion method: tracking the boundary of each cell by adopting a Moore neighborhood tracking algorithm, establishing a window with a proper size by taking each tracked boundary point as a center, recording the number of a vertex in the window and storing the number of the vertex under the name of the cell if the vertex exists in the window, sequencing the vertices of the cell according to the sequence of the encountered vertices, and connecting the vertices of each cell in sequence after tracking is finished to obtain a cell reconfiguration picture.
Specifically, the step "reconstructing a cell" includes edge extension and vertex linking; the step of 'edge expansion' is based on a form image, the width of at least 1 pixel is outwards expanded at the outermost edge of four edges of the form image to form an expansion area, and the pixel values of all pixel points in the expansion area are all set to be 1, so that an expansion image is obtained; step 'vertex connecting line' is to use an extended image as an object, traverse the extended image from left to right and from top to bottom, when a pixel point with a pixel value equal to 0 is encountered, find and record the vertex and the connection sequence of the same cell element by adopting a Moore neighborhood tracking algorithm and record the vertex and the connection sequence under the name of the cell element, delete repeated records on the principle that at most six vertices of each cell element are reserved, carry out vertex connecting line according to the reserved records and draw a complete cell element; then setting all pixel values of all pixel points in the cell element as 1; on the basis, the pixel point with the next pixel value equal to 0 is searched, the operations are repeated, and the cell reconfiguration is completed while the traversal is completed.
Example 2
Fig. 3 is a schematic top view of a geometry inspection and evaluation system of a honeycomb product according to embodiment 2 of the present invention; fig. 4 is a schematic test structure of the geometry inspection and evaluation system of the honeycomb product according to embodiment 2 of the present invention.
As shown in fig. 4 and 5, the present embodiment provides a system for detecting and evaluating the geometric shape of a honeycomb product, including:
the article placing table 1 is used for placing the honeycomb product 2;
the cameras 3 are arranged on the top surface and the side surface of the honeycomb product 2 and are used for photographing the honeycomb product 2 to obtain an original top surface image and an original side surface image of the honeycomb product 2;
camera moving means 4 for moving the camera 3 over the top and side of the cellular product 2 to obtain a complete original top image and a complete original side image;
the analysis and evaluation module 5 is used for acquiring a complete original top surface image and a complete original side surface image, and performing noise reduction filtering, binarization and morphological filtering processing to obtain a top surface image and a side surface image; performing vertex extraction on the top surface image to obtain vertex coordinates; carrying out cell reconstruction on the top surface image to obtain serial numbers of six vertexes of each cell; calculating deviation values of six internal angles of each cell based on the serial number of the six vertexes of each cell and the vertex coordinates of the six vertexes of each cell; extracting top surface side lines and side surface side lines of the honeycomb product 2 from the preprocessed top surface image and side surface image; calculating the top surface maximum deflection and the side surface maximum deflection of the honeycomb product 2 based on the top surface side line and the side surface side line; and judging whether the honeycomb product 2 is qualified or not based on the deviation angle, the top surface maximum deflection and the side surface maximum deflection.
The invention judges whether the geometric shape of the honeycomb product is qualified or not by acquiring the top surface image and the side surface image of the honeycomb product, and accurately judges whether the geometric shape of the honeycomb product 2 is qualified or not by simply processing the images in a non-contact mode.
The analysis and evaluation module 5 of this embodiment is further configured to implement all the contents of embodiment 1, and details are not repeated here.
In an alternative implementation of this embodiment, the camera moving device 4 includes: the walking type portal frame 41 is connected with the camera 3; the slide rail 42 is provided along the longitudinal direction of the honeycomb product 2, and the running gantry 41 is provided on the slide rail 42 and moves along the slide rail 42.
In an optional implementation of this embodiment, the camera moving device 4 further includes: the camera 3 slides the assembly. The camera moving assembly is connected with the walking type portal frame 41 in a sliding mode, the camera 3 is arranged on the camera moving assembly, and the camera 3 slides on the walking type portal frame 41 through the camera moving assembly.
In an alternative implementation of this embodiment, the camera moving assembly includes: the camera 3 is detachably connected with the moving block 44, and the complete original top surface image and the complete original side surface image of the honeycomb product 2 are obtained through the movement of the moving block 44. Optionally, the system for detecting and evaluating the geometric shape of the honeycomb product further comprises a fixture 6 for fixing the position of the honeycomb product 2 on the object placing table 1 so that the camera 3 can take a picture.
In the optional implementation scheme of this embodiment, the clamp 6 is composed of four flat plates and a driving device, and can be moved close to the honeycomb product 2 under the action of the driving device, and is locked after being moved close to the honeycomb product 2 to be measured, so as to position the honeycomb product 2 to be measured.
In an alternative embodiment of this embodiment, the side of the jig 6 adjacent to the honeycomb product 2 is colored bright yellow to clearly define the boundary of the honeycomb product 2 in the image to assist in image processing.
In an optional embodiment of this embodiment, the geometric shape detection and evaluation system of the honeycomb product 2 further includes a lifting device 7 of the object placing table 1, which is used to adjust the height of the honeycomb product 2, so that the honeycomb product 2 is at a suitable distance from the camera 3 disposed on the top surface of the honeycomb product 2, and the camera 3 can take a picture. Further alternatively, the upper plane of the honeycomb product 2 and the upper plane of the jig 6 may be maintained at the same height by the lifting device 7, the vertical distance between the jig 6 and the camera 3 is not changed, and the fixed distance between the upper plane of the honeycomb product 2 and the camera 3 is further maintained, so that the camera 3 can take a picture. Specifically, the lifting device 7 includes a hydraulic lever.
In an optional implementation of this embodiment, the system for detecting and evaluating the geometric form of the honeycomb product 2 further includes a display module, and the display module is connected to the analysis and evaluation module 5 and is configured to display whether the geometric form of the honeycomb product 2 is qualified.
In an optional implementation of this embodiment, the display module includes a display lamp, and if the honeycomb product 2 is qualified, the display module lights up a green light, and if the honeycomb product is not qualified, the display module lights up a red light.
In an optional implementation of this embodiment, the system for detecting and evaluating the geometric shape of the honeycomb product 2 further includes a calibration module: the calibration board is a display board adopting an electronic ink screen, can display standard honeycombs with adjustable side length and wall thickness, and displays the color which is in color comparison with the honeycombs in pairs on the outer side of the screen. After the calibration board is placed on the object placing table 16 and is positioned by the clamp 68, the camera 3 is adjusted to a proper position, the photo of the calibration board is obtained, the photo is transmitted to the analysis and evaluation module 5 for calibration, and the detection accuracy of the system is checked.
It is to be understood that the above-described embodiments of the present invention are merely illustrative of or explaining the principles of the invention and are not to be construed as limiting the invention. Therefore, any modification, equivalent replacement, improvement and the like made without departing from the spirit and scope of the present invention should be included in the protection scope of the present invention. Further, it is intended that the appended claims cover all such variations and modifications as fall within the scope and boundaries of the appended claims or the equivalents of such scope and boundaries.

Claims (11)

1. A method for evaluating the geometry of a honeycomb article, comprising:
acquiring a top surface image and a side surface image of the honeycomb product;
performing vertex extraction on the top surface image to obtain vertex coordinates;
carrying out cell reconstruction on the top surface image to obtain serial numbers of six vertexes of each cell;
calculating deviation values of six internal angles of each cell based on the serial number of the six vertexes of each cell and the vertex coordinates of the six vertexes of each cell;
extracting top and side edge lines of the honeycomb product from the top and side images;
calculating a top surface maximum deflection and a side surface maximum deflection of the honeycomb product based on the top surface side line and the side surface side line;
determining whether the honeycomb product is acceptable based on the deviation angle, the top surface maximum deflection, and the side surface maximum deflection.
2. The method of evaluating the geometry of a honeycomb product according to claim 1, wherein said determining whether the honeycomb product is acceptable based on the deviation angle, the top surface maximum deflection and the side surface maximum deflection comprises:
and judging the geometric regularity of the honeycomb product based on the deviation angle, the top surface maximum deflection and the side surface maximum deflection, wherein the honeycomb product is qualified if the geometric regularity reaches a preset standard.
3. The method of evaluating the geometry of a honeycomb product according to claim 2, wherein the geometric regularity comprises: the cell regularity of the top surface, the flatness of the side surface and the flatness of the top surface;
determining the geometric regularity of the honeycomb product based on the deviation angle, the top surface maximum deflection and the side surface maximum deflection, wherein if the geometric regularity reaches a preset standard, the honeycomb product is qualified, and the method comprises the following steps:
determining the regularity of the top surface cell based on the deviation angle;
determining the side flatness based on the top surface maximum deflection;
determining the top surface flatness based on the side surface maximum deflection;
and if the regularity of the top surface cell elements, the flatness of the side surface and the flatness of the top surface all reach preset standards, the honeycomb product is qualified.
4. The method of claim 3, wherein the criterion of the regularity of the top cells comprises: one or more of a maximum deviation angle, a mean deviation angle, a maximum of a cell deviation angle average, a standard deviation of a deviation angle, and a standard deviation of a cell deviation angle average;
and if one or more of the maximum deviation angle, the average deviation angle, the maximum of the average of the deviation angles of the cells, the standard deviation of the deviation angle and the standard deviation of the average of the deviation angles of the cells are less than a preset threshold, the regularity of the top surface cells reaches a preset standard.
5. The method of claim 3, wherein the criterion of the regularity of the top cells comprises: one or more of a maximum deviation angle, a mean deviation angle, a maximum of a cell deviation angle average, a standard deviation of a deviation angle, and a standard deviation of a cell deviation angle average;
and if the proportion of one or more of the maximum deviation angle, the average deviation angle, the maximum of the average of the deviation angles of the cell elements, the standard deviation of the deviation angles and the standard deviation of the average of the deviation angles of the cell elements, which is larger than a preset threshold value, is smaller than a preset proportion, the regularity of the top-surface cell elements reaches a preset standard.
6. The method of claim 3, wherein the criterion of the regularity of the top cells comprises: cell deviation angle average;
and if the average cell deviation angle is not more than the percentage of the whole cell occupied by the cells A1, A2, A3, A4 and A5 in sequence and is less than the corresponding thresholds B1, B2, B3, B4 and B5 in sequence, the regularity of the top surface cell reaches the standard.
7. The method of evaluating the geometry of a honeycomb article of claim 1 wherein said method of apex extraction comprises:
obtaining a skeleton graph of the vertex image;
searching eight neighborhoods of each pixel point on the skeleton graph for a week according to a preset sequence, and if the change times of the pixel points are 6, taking the pixel points as vertexes.
8. The method of evaluating the geometry of a honeycomb article of claim 1 wherein said method of apex extraction comprises:
s1: acquiring a square window with a preset side length L, setting a square window with the side length sequentially increased from 3 pixels, and after the square window traverses the vertex image, firstly enabling the minimum value of the number of pixels with the pixel value of 0 in the square window to be nonzero;
s2: traversing each pixel point with the pixel value of 1 in the vertex image by the square window, and then assigning the sum of the number of the pixels with the pixel value of 1 in each square window to the pixel point at the center point of the square window;
s3: establishing a square area with the initial side length E equal to L by taking the pixel point with the maximum assignment as the center, calculating the difference absolute value of the assignment of each pixel point on four boundaries of the square area and the assignment of the center point of the square area, and recording the minimum difference absolute value Z and the coordinate of the boundary pixel point corresponding to the minimum difference absolute value Z;
s4: establishing a new square area by E-E +2 pixels, repeating S3 until the minimum absolute value of the difference has obvious trend of increasing reversely, obtaining the coordinate of the boundary pixel point of the minimum absolute value of the difference Z and the coordinate of the center point of the corresponding square area, and solving to obtain the side length A of the honeycomb cell element by the coordinate value of the boundary pixel point of the Z value and the coordinate value of the center point of the corresponding square area;
s5: determining the pixel point with the maximum assignment as a vertex, establishing an annihilation window of a square with the side length A of the honeycomb cell as the side length by taking the vertex as the center, resetting all assignments on the pixel point with the pixel value of 1 in the annihilation window, finding out the pixel point with the maximum assignment from the rest assignments, determining the pixel point as the vertex and recording the pixel point, repeating the operation of the annihilation window until the assignments on the pixel point with the pixel value of 1 are smaller than a given threshold value, and extracting all the vertices.
9. The method of claim 1, wherein the method of cell reconstruction comprises:
tracking the boundary of each cell element by adopting a Moore neighborhood tracking algorithm;
and establishing a window with a preset size by taking each tracked boundary point as a center, recording the number of a vertex and storing the number of the vertex under the name of the cell if the vertex exists in the window, sequencing the vertices of the cell according to the sequence of the encountered vertices, and connecting the vertices of each cell in sequence after tracking is finished to obtain a cell reconfiguration picture.
10. A system for detecting and evaluating the geometry of a cellular product, comprising:
the article placing table (1) is used for placing the honeycomb product (2);
the cameras (3) are arranged on the top surface and the side surface of the honeycomb product (2) and are used for photographing the honeycomb product (2) to obtain an original top surface image and an original side surface image of the honeycomb product (2);
camera moving means (4) for moving the camera (3) over the top and side of the cellular product (2) to obtain a complete original top image and a complete original side image;
the analysis and evaluation module (5) is used for acquiring the complete original top surface image and the complete original side surface image, and performing noise reduction filtering, binarization and morphological filtering processing to obtain a top surface image and a side surface image; performing vertex extraction on the top surface image to obtain vertex coordinates; carrying out cell reconstruction on the top surface image to obtain serial numbers of six vertexes of each cell; calculating deviation values of six internal angles of each cell based on the serial number of the six vertexes of each cell and the vertex coordinates of the six vertexes of each cell; extracting top and side edge lines of the honeycomb product (2) from the preprocessed top and side images; calculating a top surface maximum deflection and a side surface maximum deflection of the honeycomb product (2) based on the top surface side line and the side surface side line; determining whether the honeycomb product (2) is acceptable based on the deviation angle, the top surface maximum deflection, and the side surface maximum deflection.
11. The system for geometry detection and evaluation of cellular products according to claim 10, characterized in that said camera movement means (4) comprise:
the camera (3) is connected with the walking portal frame (41);
the sliding rail (42) is arranged along the length direction of the honeycomb product, and the walking portal frame (41) is arranged on the sliding rail (42) and moves along the sliding rail (42).
CN202010387864.9A 2020-05-09 2020-05-09 Geometric form evaluation method, detection and evaluation system for honeycomb products Active CN111583234B (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
CN202010387864.9A CN111583234B (en) 2020-05-09 2020-05-09 Geometric form evaluation method, detection and evaluation system for honeycomb products
US17/422,721 US11893725B2 (en) 2020-05-09 2020-08-18 Method for evaluating and system for detecting and evaluating geometric form of honeycomb product
PCT/CN2020/109731 WO2021227288A1 (en) 2020-05-09 2020-08-18 Method for evaluating geometrical morphology of honeycomb product, and detection and evaluation system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010387864.9A CN111583234B (en) 2020-05-09 2020-05-09 Geometric form evaluation method, detection and evaluation system for honeycomb products

Publications (2)

Publication Number Publication Date
CN111583234A true CN111583234A (en) 2020-08-25
CN111583234B CN111583234B (en) 2023-05-23

Family

ID=72112142

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010387864.9A Active CN111583234B (en) 2020-05-09 2020-05-09 Geometric form evaluation method, detection and evaluation system for honeycomb products

Country Status (1)

Country Link
CN (1) CN111583234B (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101915545A (en) * 2010-08-13 2010-12-15 南京柯瑞特种陶瓷股份有限公司 Method and device for automatically detecting honeycomb ceramics
US20160247301A1 (en) * 2015-02-25 2016-08-25 National Chiao Tung University Light detection apparatus and image reconstruction method using the same
CN106530481A (en) * 2016-11-02 2017-03-22 深圳怡化电脑股份有限公司 Method and device for detecting abnormal transmission of paper money
CN107123108A (en) * 2017-03-30 2017-09-01 上海卫星装备研究所 Remote sensor light shield honeycomb defect automatic testing method based on machine vision
CN108801787A (en) * 2018-05-31 2018-11-13 深圳市乾行达科技有限公司 Cellular material produces detection method and equipment
CN210253172U (en) * 2019-07-19 2020-04-07 东莞恩浩电子有限公司 Automatic system for visual inspection

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101915545A (en) * 2010-08-13 2010-12-15 南京柯瑞特种陶瓷股份有限公司 Method and device for automatically detecting honeycomb ceramics
US20160247301A1 (en) * 2015-02-25 2016-08-25 National Chiao Tung University Light detection apparatus and image reconstruction method using the same
CN106530481A (en) * 2016-11-02 2017-03-22 深圳怡化电脑股份有限公司 Method and device for detecting abnormal transmission of paper money
CN107123108A (en) * 2017-03-30 2017-09-01 上海卫星装备研究所 Remote sensor light shield honeycomb defect automatic testing method based on machine vision
CN108801787A (en) * 2018-05-31 2018-11-13 深圳市乾行达科技有限公司 Cellular material produces detection method and equipment
CN210253172U (en) * 2019-07-19 2020-04-07 东莞恩浩电子有限公司 Automatic system for visual inspection

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
CAN CUI,ZHONGGANG WANG,WEI ZHOU: "Branch point algorithm for structural irregularity determination of honeycomb" *
ZHONGGANG WANG,ZHENDONG LI: "On the influence of structural defects for honeycomb structure" *
史俊伟: "复合材料蜂窝夹层结构制件的超声可视化无损检测" *

Also Published As

Publication number Publication date
CN111583234B (en) 2023-05-23

Similar Documents

Publication Publication Date Title
CN114219842B (en) Visual identification, distance measurement and positioning method in port container automatic loading and unloading operation
CN111784684B (en) Method and device for detecting internal defects of transparent product at fixed depth based on laser assistance
CN107392954A (en) A kind of gross error point elimination method based on sequence image
CN111524134B (en) Method and device for detecting regularity of honeycomb products on production line
CN109253722A (en) Merge monocular range-measurement system, method, equipment and the storage medium of semantic segmentation
US11893725B2 (en) Method for evaluating and system for detecting and evaluating geometric form of honeycomb product
CN111583234A (en) Geometric form evaluation method and detection and evaluation system of honeycomb product
CN111583243B (en) Method for reconstructing adjacent point cell for detecting cellular regularity
CN111583237B (en) Neighborhood window recursion cell reconstruction method for detecting cellular regularity
CN117058411A (en) Method, device, medium and equipment for identifying edge appearance flaws of battery
CN111583241A (en) Mobile detection method and device for regularity of honeycomb product with super-large area
CN111583239B (en) Honeycomb structure geometric regularity image recognition method and system
CN116385356A (en) Method and system for extracting regular hexagonal hole features based on laser vision
CN115061497B (en) Unmanned aerial vehicle photovoltaic panel inspection method and system
CN111583235B (en) Branch point identification vertex extraction method and system for detecting cellular regularity
WO2021227285A1 (en) Image recognition method for geometrical regularity of cellular structure, and system
CN116228697A (en) Steel bar part quality detection method based on unmanned aerial vehicle image point cloud data
CN110411384B (en) Method for detecting surface roughness of internal rod piece of three-dimensional printing lattice structure
WO2021227286A1 (en) Mobile testing method and apparatus for regularity of honeycomb product with ultra-large area
CN112053331B (en) Bridge crack detection method based on image superposition and crack information fusion
CN111524133B (en) Window statistical vertex extraction method and system for honeycomb regularity detection
Yeung et al. A preliminary investigation into automated identification of structural steel without a priori knowledge
CN111583236B (en) Dynamic adjustment method and device for geometric form of honeycomb product and production method
CN111583242A (en) Morphological vertex extraction method and detection device for detecting cellular regularity
CN111583238B (en) Method for extracting vertex of included angle of contour line of honeycomb, method for detecting vertex of included angle of contour line of honeycomb and device for detecting vertex of included angle of contour line of honeycomb

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant